Company behind the open-source Xinference model serving framework.
Xinference (Xorbits Inference) is an open-source framework for serving language, embedding, multimodal, and speech models with a single command and an OpenAI-compatible API, across laptops to clusters.