Jan vs Portkey

FeatureJanPortkey
CategoryLocal AI InfrastructureAI Development
PricingFree (open-source)Free + Pro plans
GitHub Stars25,0006,000
PlatformsmacOS, Linux, WindowsWeb, Docker
Features
  • ✓ Local inference
  • ✓ Model library
  • ✓ Extensions
  • ✓ Privacy-first
  • ✓ Offline mode
  • ✓ AI gateway
  • ✓ Fallbacks
  • ✓ Load balancing
  • ✓ Caching
  • ✓ Observability
Tags
localprivacychatopen-source
gatewayreliabilityobservabilityapi