Staff Engineer at Apple, working on ML serving.
Author of Text Generation Inference (TGI), the first open-source LLM serving backend.
Pinned Loading
-
huggingface/text-generation-inference
huggingface/text-generation-inference PublicLarge Language Model Text Generation Inference
-
huggingface/text-embeddings-inference
huggingface/text-embeddings-inference PublicA blazing fast inference solution for text embeddings models
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.





