ContextQMD
Back to Localai

Index

docs/content/_index.md

4.1.33.7 KB
Original Source

+++ title = "LocalAI" description = "The free, OpenAI, Anthropic alternative. Your All-in-One Complete AI Stack" type = "home" +++

The free, OpenAI, Anthropic alternative. Your All-in-One Complete AI Stack - Run powerful language models, autonomous agents, and document intelligence locally on your hardware.

No cloud, no limits, no compromise.

{{% notice tip %}} ⭐ Star us on GitHub - 40k+ stars and growing!

Drop-in replacement for OpenAI API - modular suite of tools that work seamlessly together or independently.

Start with LocalAI's OpenAI-compatible API, extend with LocalAGI's autonomous agents, and enhance with LocalRecall's semantic search - all running locally on your hardware.

Open Source MIT Licensed. {{% /notice %}}

<center><iframe width="560" height="315" src="https://www.youtube.com/embed/PDqYhB9nNHA?si=jUClTH7uuGMwMvFw" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe></center>

Why Choose LocalAI?

OpenAI API Compatible - Run AI models locally with our modular ecosystem. From language models to autonomous agents and semantic search, build your complete AI stack without the cloud.

Key Features

  • LLM Inferencing: LocalAI is a free, Open Source OpenAI alternative. Run LLMs, generate images, audio and more locally with consumer grade hardware.
  • Agentic-first: Extend LocalAI with LocalAGI, an autonomous AI agent platform that runs locally, no coding required. Build and deploy autonomous agents with ease.
  • Memory and Knowledge base: Extend LocalAI with LocalRecall, A local rest api for semantic search and memory management. Perfect for AI applications.
  • OpenAI Compatible: Drop-in replacement for OpenAI API. Compatible with existing applications and libraries.
  • No GPU Required: Run on consumer grade hardware. No need for expensive GPUs or cloud services.
  • Multiple Models: Support for various model families including LLMs, image generation, and audio models. Supports multiple backends for inferencing.
  • Privacy Focused: Keep your data local. No data leaves your machine, ensuring complete privacy.
  • Easy Setup: Simple installation and configuration. Get started in minutes with Binaries installation, Docker, Podman, Kubernetes or local installation.
  • Community Driven: Active community support and regular updates. Contribute and help shape the future of LocalAI.

Quick Start

Docker is the recommended installation method for most users:

bash
docker run -p 8080:8080 --name local-ai -ti localai/localai:latest

For complete installation instructions, see the Installation guide.

Get Started

  1. Install LocalAI - Choose your installation method (Docker recommended)
  2. Quickstart Guide - Get started quickly after installation
  3. Install and Run Models - Learn how to work with AI models
  4. Try It Out - Explore examples and use cases

Learn More