LiteLLM
LiteLLM provides a unified interface to call 100+ LLMs using the OpenAI format. Features include automatic retries with exponential backoff, cost tracking across providers, load balancing and fallbacks, streaming support, and a proxy server for centralized LLM management. Open-source with enterprise support available. Simplifies multi-provider LLM integration with consistent error handling.
