AnythingLLM
An all-in-one local AI application from Mintplex Labs, built around document chat and agents. It bundles an LLM connector, an embedder, and a LanceDB vector store, so you can index and chat with your own documents out of the box.
Strengths
- Document chat and RAG work with little setup, batteries included
- Runs as a desktop app or a self-hosted server, with multi-user support
- Open source under MIT, and works fully offline with a local backend
Weaknesses
- The bundled defaults are convenient but less tunable than a custom RAG stack
- Retrieval quality depends on the models and settings you choose
- Broad feature set means more surface area to learn than a plain chat app
At a glance
- Licence
- MIT
- Pricing
- Open core
- Platforms
- macOS, Windows, Linux, Docker
- GPU required
- No
Links
See also
Entry last verified 30 July 2026.