Local LLM
MaxKB
🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。
★ 22.9k starsGPL-3.0
View guide →LibreAI / RAG & Knowledge / anything-llm
// rag · Mintplex-Labs/anything-llm
anything-llm
anything-llm is an open-source rag & knowledge project by Mintplex-Labs (Mintplex-Labs/anything-llm on GitHub). It has 66,695 GitHub stars and 7,442 forks, is released under the MIT license, and was last updated on GitHub on 3 October 2026.
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
★ 66.7k stars⑂ 7.4k forksMITupdated 2026-10
▦ visual — this project's README ships no embeddable screenshot,
so here's a placeholder. The guide below is complete regardless.
so here's a placeholder. The guide below is complete regardless.
// project facts
Project facts
- Repository
- Mintplex-Labs/anything-llm
- GitHub stars
- 66,695
- Forks
- 7,442
- License
- MIT
- Last updated on GitHub
- 3 October 2026
- Category
- RAG & Knowledge
- Listing
- Full install guide
- Official site
- Official site
// how it works
How it works
- Install the runtime
One binary or app gets you a working local model setup.
- Download a model
Pick a size that fits your RAM/VRAM; smaller models run on laptops.
- Chat or integrate
Use the built-in UI, or point OpenAI-compatible clients at it.
- Go private
Airplane mode works — your prompts never leave the device.
// features
Why people love it
No subscriptions
Pay nothing per token, ever.
100% private
Prompts and documents stay on your hardware, always.
Extensible
RAG, tools, and agents build on the same base.
Quantized efficiency
Smart compression runs big models on modest hardware.
Offline capable
Works on planes, in basements, behind firewalls.
Model choice
Swap between hundreds of open models freely.
Advertisement
// run it
Run it yourself
- Step 1 — Clone the repo
Download the source and move into the project folder.
git clone https://github.com/Mintplex-Labs/anything-llm.git cd anything-llm - Step 2 — Check the README
Every project documents its own setup; start with install requirements.
cat README.md | head -60 - Step 3 — Run it
Follow the project's launch command — Docker, pip, npm, or a binary release.
# see README for the exact launch command
// use cases
What you can build
- Chat privately with your documents.
- Draft and edit without cloud AI.
- Run AI on air-gapped machines.
- Prototype AI features for free.
The Local LLM shelf also holds pentest-harness — Heaven for Hackers.
Advertisement
// faq
Questions, answered
Who maintains anything-llm?
It is an open-source project at Mintplex-Labs/anything-llm with 7,442 forks. Check the repo's contributors and recent commits to see how active maintenance is.
Is anything-llm free for commercial use?
MIT licensed — use it commercially, no strings attached.
Is it really private?
Yes — with no network calls, there's nothing to leak.
Are local models as good as GPT-4?
Close on many tasks now; frontier cloud models still lead on hard reasoning.
What hardware do I need?
8B models run on 16GB RAM; bigger models want a real GPU.
// keep exploring
Similar tools
Local LLM
ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in productio…
★ 3.1k starsMIT
View guide →Local LLM
node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
★ 2.2k starsMIT
View guide →RAG & Knowledge
AutoRAG
An agent that finds anything on your computer — federated search over your files, in place.
★ 5.1k starsMIT
View guide →RAG & Knowledge
llm-wiki-agent
A personal knowledge base that builds itself — drop in sources, get a persistent interlinked wiki.
★ 3.6k starsMIT
View guide →RAG & Knowledge
uteke
Self-hosted rag & knowledge: 🧠 the brain for your ai — local-first memory engine for.
★ 268 starsApache-2.0
View guide →// alternatives
Alternatives in RAG & Knowledge
The most-starred other RAG & Knowledge projects in the LibreAI catalogue — the realistic shortlist if anything-llm is not the right fit.
- MarkItDown★ 193.5k
MarkItDown — Microsoft tool that converts PDFs, Office files, images and more to clean Markdown for LLMs, MIT
- Dify★ 157.8k
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or…
- ragflow★ 91.6k
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context…
- PaddleOCR★ 90.8k
Lightweight OCR toolkit turning PDFs and images into structured, LLM-ready data in 100+ languages
- MinerU★ 82.5k
MinerU — turns PDFs and Office documents into LLM-ready Markdown and JSON for agents and RAG pipelines, Apache-2.0 plus terms
// more in rag
More in RAG & Knowledge
Nearby RAG & Knowledge projects in the catalogue, closest in stars to anything-llm — keep exploring the shelf either side of it.
- MinerU★ 82.5k
MinerU — turns PDFs and Office documents into LLM-ready Markdown and JSON for agents and RAG pipelines, Apache-2.0 plus terms
- llm-app★ 58.8k
Ready-to-run templates for RAG, AI pipelines and enterprise search that stay in sync with live data
- PaddleOCR★ 90.8k
Lightweight OCR toolkit turning PDFs and images into structured, LLM-ready data in 100+ languages
- private-gpt★ 57.6k
Complete API layer for private AI apps on local models: RAG, skills, tools, MCP and text-to-SQL
- ragflow★ 91.6k
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context…
- faiss★ 41.1k
Meta's library for efficient similarity search and clustering of dense vectors, in C++ and Python
Get anything-llm
Free and open — grab the source, star the repo, and start creating.