Pinned Loading

1. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   Port of Facebook's LLaMA model in C/C++

   C++ 97 17

2. ollama ollama Public

   Forked from ollama/ollama

   Get up and running with Llama 3, Mistral, Gemma, and other large language models.

   Go 27 14

3. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python 1

4. open-webui open-webui Public

   Forked from open-webui/open-webui

   User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

   JavaScript

5. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

6. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python