Xinference
Open Source
Library
Serve LLMs, embeddings, and more
About
Xinference (Xorbits Inference) is an open-source framework for serving language, embedding, multimodal, and speech models with a single command and an OpenAI-compatible API, across laptops to clusters.
Compatibility
Supported Languages
python
Details
- Category
- Library
- License
- Apache-2.0