Skip to content

Rag/rag transition 2 #23

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: rag/rag-transition-1
Choose a base branch
from
Open

Conversation

xhr15
Copy link
Member

@xhr15 xhr15 commented Mar 12, 2025

See A RAG Library for Elixir

We want to turn chatbot_ex into a RAG system that answers question about (ecto)[https://hex.pm/packages/ecto]. Out of the box, chatbot_ex knows nothing about ecto.

In Step one, we ran the generator.

Removing the LLM serving

chatbot_ex is using Ollama for text generation. Ollama is kind of a package manager for LLMs. It is easy to install and allows you to switch between models easily. Therefore, we can remove the Nx.Serving for text generation.

@xhr15 xhr15 force-pushed the rag/rag-transition-2 branch from d11a6fd to 64937d0 Compare March 12, 2025 11:25
@xhr15 xhr15 added BLOG POST EXAMPLE see [A RAG Library for Elixir](https://bitcrowd.dev/a-rag-library-for-elixir#build-your-rag-system) do not merge labels Mar 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
BLOG POST EXAMPLE see [A RAG Library for Elixir](https://bitcrowd.dev/a-rag-library-for-elixir#build-your-rag-system) do not merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant