LocalAI

Orchestration Intermediate Open source Free

A self-hosted, OpenAI and Anthropic-compatible API server that runs LLM, vision, audio, image, and video models locally across many backends.

Strengths

Drop-in OpenAI/Anthropic-compatible API, so existing clients work unchanged
Runs on CPU, with optional NVIDIA, AMD, Intel, or Apple acceleration
Modular design covers many modalities: text, vision, audio, image, and video

Weaknesses

The broad feature set and separate backend images add configuration complexity
CPU-only performance is limited for large models
Managing backend dependencies has a learning curve for simple deployments

At a glance

Licence: MIT
Pricing: Free
Platforms: macOS, Windows, Linux, Docker
GPU required: No

Links

Related guides

See also

Glossary

Entry last verified 18 August 2026.