Pinned Loading

1. Mooncake Mooncake Public

   Forked from kvcache-ai/Mooncake

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++

2. kvcache-blog kvcache-blog Public

   Forked from kvcache-ai/kvcache-blog

   JavaScript

3. kvcache-ai/Mooncake kvcache-ai/Mooncake Public

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++ 5.9k 978

4. kvcache-ai/kvcache-blog kvcache-ai/kvcache-blog Public

   JavaScript 18 13

5. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 30.5k 7.3k

6. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 86.6k 19.6k