Skip to content

dockersamples/chatbot-model-runner

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

29 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

hello-genai

A simple chatbot web application built in Go, Python and Node.js that connects to a local LLM service (llama.cpp) to provide AI-powered responses.

Environment Variables

The application uses the following environment variable defined in the .env file:

  • LLM_MODEL_NAME: The model name to use

To change these settings, simply edit the .env file in the root directory of the project.

Quick Start

  1. Clone the repository:

    git clone https://github.com/docker/hello-genai
    cd hello-genai
  2. Run the application using the script:

    docker compose up --build
  3. Open your browser and visit the following links:

    http://localhost:8080 for the GenAI Application in Go

    http://localhost:8081 for the GenAI Application in Python

    http://localhost:8082 for the GenAI Application in Node

About

Very simple GenAI application to try the Docker Model Runner

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • HTML 40.9%
  • Go 35.4%
  • JavaScript 9.7%
  • Python 8.4%
  • Dockerfile 5.6%