LocalAI

Drop-in replacement for OpenAI API running locally

⭐25,000
Local AI InfrastructureFree (open-source)
🌐 Visit Website📦 GitHub

About LocalAI

LocalAI is a drop-in replacement for the OpenAI API that runs entirely locally. It supports text generation, image generation, audio, and embeddings — all through an OpenAI-compatible API without requiring a GPU.

Features

✦OpenAI-compatible API
✦Multiple models
✦Text-to-speech
✦Image generation
✦Embeddings

Pros & Cons

Pros

  • +Full OpenAI API compatibility
  • +CPU inference (no GPU required)
  • +Text + image + audio + embeddings
  • +Docker-ready
  • +Multiple model formats

Cons

  • −Slower without GPU
  • −Complex configuration
  • −Some API endpoints incomplete
  • −Documentation could be clearer

Platforms

LinuxmacOSDocker

Tags

#local#api#openai-compatible#open-source

Similar Tools

Ollama

Run large language models locally with one command

Free (open-source)

GPT4All

Run large language models locally on your computer

Free (open-source)

Text Generation WebUI

Gradio web UI for running large language models

Free (open-source)

Jan

Open-source ChatGPT alternative that runs locally

Free (open-source)

Need help choosing?

Compare LocalAI with alternatives side by side

Compare Tools →