🏠 Local AI Infrastructure

Run large language models locally with one command

Run large language models locally on your computer

Gradio web UI for running large language models

Open-source ChatGPT alternative that runs locally

Drop-in replacement for OpenAI API running locally

Easy-to-use local AI text generation with GGUF support

High-throughput LLM serving engine

Beautiful desktop app for running local LLMs