LiteLLM
Unified API to call 100+ LLM providers
⭐15,000
AI DevelopmentFree (open-source) + Enterprise
About LiteLLM
LiteLLM provides a unified Python SDK and proxy to call 100+ LLM APIs using a consistent interface. It handles load balancing, fallbacks, spend tracking, and API key management — essential for production LLM applications.
Features
✦100+ providers
✦Load balancing
✦Budget tracking
✦Caching
✦OpenAI-compatible
Pros & Cons
Pros
- +One interface for 100+ providers
- +Load balancing and fallbacks
- +Spend tracking and budgets
- +OpenAI-compatible proxy
- +Open-source
Cons
- −Added complexity layer
- −Proxy adds latency
- −Configuration can be complex
- −Some provider features unavailable
Platforms
LinuxmacOSDocker
Tags
Similar Tools
Hugging Face
The AI community platform with 500K+ models and datasets
Free + Pro $9/mo + EnterpriseLlamaIndex
Data framework for connecting LLMs to external data
Free (open-source) + CloudWhisper
OpenAI's open-source speech recognition model
Free (open-source)Bark
Text-to-audio model supporting speech, music, and sound effects
Free (open-source)Need help choosing?
Compare LiteLLM with alternatives side by side
Compare Tools →