AnythingLLM review

AnythingLLM is built around the most common reason people want a local model: asking questions about their own documents. Every file you add becomes part of a workspace knowledge base, and the vendor says models, documents and chat history stay on your machine with nothing phoning home. The desktop app installs from one file on macOS (Apple Silicon and Intel), Windows (x64 and ARM) and Linux, needs no account, and can pick a model for your hardware. Its built-in engine now runs llama.cpp managed by AMD's Lemonade, and on Windows it can use Microsoft Foundry Local to reach the CPU, GPU and NPU. Beyond chat it adds a no-code agent builder, MCP support, scheduled jobs, web search and an on-device meeting assistant that transcribes and summarizes calls without a bot joining. The project is MIT licensed and can be self-hosted with Docker for free. A hosted Cloud instance costs $50 a month for Basic or $99 for Pro.

Who it is for

People who mainly want to chat with their own files, notes and meetings without an account or API key.

Price

Desktop app free; self-host with Docker free; hosted Cloud Basic $50 per month, Pro $99 per month.

Basic Perfect for independent use or small teams. $50 /monthly
Quoted from the vendor pricing page on November 10, 2026.

Key features

• Document knowledge base that stays on the device
• On-device meeting assistant with transcripts and summaries
• Built-in llama.cpp engine managed by AMD's Lemonade
• No-code agent builder, scheduled jobs and MCP support
• Multi-user workspaces in the Docker version

Strengths and weaknesses

• Strength: No account, sign-up or API key needed for the desktop app
• Strength: Native builds for Apple Silicon, Intel Macs, Windows x64 and ARM, and Linux
• Strength: Auto-recommends a model for your hardware
• Weakness: Multi-user permissions and the website chat widget need the Docker version
• Weakness: Hosted Cloud plans start at $50 a month
• Weakness: The built-in engine changed from Ollama to llama.cpp in October 2026

Key facts

• License: MIT
• Desktop app: Free, no account needed
• Cloud Basic: $50 per month, private instance
• Cloud Pro: $99 per month, 72-hour support SLA

Where it ranks

AnythingLLM is No. 2 in our Best Local LLM Apps verdict.