Text Generation Inference
Open Source
Library
Archived Hugging Face LLM inference server
About
DISCONTINUED. Text Generation Inference (TGI) is Hugging Face's production-grade toolkit for serving open LLMs, with tensor parallelism, continuous batching, quantization, and an OpenAI-compatible API for high-throughput deployment. Hugging Face archived the repository on March 21, 2026 and placed the project in maintenance mode, accepting only minor bug fixes and documentation changes.
Compatibility
Supported Languages
python
rust
Details
- Category
- Library
- License
- Apache-2.0