Atoma AI

Popular repositories Loading

1. atoma-infer atoma-infer Public

   Fast serverless LLM inference, in Rust.

   Rust 135 23

2. open-webui open-webui Public

   Forked from open-webui/open-webui

   User-friendly WebUI for AI (Formerly Ollama WebUI)

   JavaScript 3 1

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 1

4. mistral.rs mistral.rs Public

   Forked from EricLBuehler/mistral.rs

   Blazingly fast LLM inference.

   Rust 1

5. tdx tdx Public

   Forked from canonical/tdx

   Intel confidential computing - TDX

   Python

6. nvml-wrapper nvml-wrapper Public

   Forked from rust-nvml/nvml-wrapper

   Safe Rust wrapper for the NVIDIA Management Library

   Rust