ML Serving Example

This tutorial contains and example of how to deploy a Machine Leaning Model (LLM) on your own infrastructure using Kserver and a simple chatbot using React.

1. Folder server contains the MLOps source code
2. Folder web contains the React frontend of the chatbot.

Developement

Clone the repo

git clone https://github.com/transformatek/mlserving-example.git

Running the ML serving

cd sevrer
python ..

Running the frontend

cd web
npm run ...

Useful links

• Deploy Custom Python Serving Runtime with InferenceService