LocalAI vs LiteLLM

FeatureLocalAILiteLLM
CategoryLocal AI InfrastructureAI Development
PricingFree (open-source)Free (open-source) + Enterprise
GitHub Stars25,00015,000
PlatformsLinux, macOS, DockerLinux, macOS, Docker
Features
  • ✓ OpenAI-compatible API
  • ✓ Multiple models
  • ✓ Text-to-speech
  • ✓ Image generation
  • ✓ Embeddings
  • ✓ 100+ providers
  • ✓ Load balancing
  • ✓ Budget tracking
  • ✓ Caching
  • ✓ OpenAI-compatible
Tags
localapiopenai-compatibleopen-source
api-gatewaymulti-providerproxyopen-source