LLM local
ComfyUI-GGUF
GGUF Quantization support for native ComfyUI models
★ 4,1k estrellasApache-2.0
Ver la guía →// local-llm · lm-sys/FastChat
FastChat
FastChat es un proyecto de LLM local de código abierto de lm-sys (lm-sys/FastChat en GitHub). Tiene 39.555 estrellas en GitHub y 4.776 bifurcaciones, se publica bajo la licencia Apache-2.0 y se actualizó por última vez en GitHub el 1 de mayo de 2026.
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
★ 39,6k estrellas⑂ 4,8k bifurcacionesApache-2.0actualizado may 2026
▦ visual: el README de este proyecto no incluye ninguna captura incrustable,
así que aquí va un marcador. La guía de abajo está completa de todos modos.
así que aquí va un marcador. La guía de abajo está completa de todos modos.
// datos del proyecto
Datos del proyecto
- Repositorio
- lm-sys/FastChat
- Estrellas en GitHub
- 39.555
- Bifurcaciones
- 4.776
- Licencia
- Apache-2.0
- Última actualización en GitHub
- 1 de mayo de 2026
- Categoría
- LLM local
- Tipo de ficha
- Guía de instalación completa
- Sitio oficial
- GitHub repo
// cómo funciona
Cómo funciona
- Install the runtime
One binary or app gets you a working local model setup.
- Download a model
Pick a size that fits your RAM/VRAM; smaller models run on laptops.
- Chat or integrate
Use the built-in UI, or point OpenAI-compatible clients at it.
- Go private
Airplane mode works — your prompts never leave the device.
// características
Por qué gusta tanto
Offline capable
Works on planes, in basements, behind firewalls.
Model choice
Swap between hundreds of open models freely.
OpenAI-compatible APIs
Existing tools plug in by changing one URL.
Document chat
Ask questions over your PDFs, notes, and codebases.
No subscriptions
Pay nothing per token, ever.
100% private
Prompts and documents stay on your hardware, always.
Advertisement
// ejecútalo
Ejecútalo tú mismo
- Step 1 — Clone the repo
Download the source and move into the project folder.
git clone https://github.com/lm-sys/FastChat.git cd FastChat - Step 2 — Check the README
Every project documents its own setup; start with install requirements.
cat README.md | head -60 - Step 3 — Run it
Follow the project's launch command — Docker, pip, npm, or a binary release.
# see README for the exact launch command
// casos de uso
Qué puedes crear
- Chat privately with your documents.
- Draft and edit without cloud AI.
- Run AI on air-gapped machines.
- Prototype AI features for free.
Advertisement
// preguntas frecuentes
Preguntas frecuentes
Who maintains FastChat?
It is an open-source project at lm-sys/FastChat with 4,776 forks. Check the repo's contributors and recent commits to see how active maintenance is.
Is FastChat free for commercial use?
Apache 2.0 licensed — commercial use allowed with attribution.
What hardware do I need?
8B models run on 16GB RAM; bigger models want a real GPU.
Which model should I start with?
A recent 8–32B instruct model is the sweet spot for most machines.
Is it really private?
Yes — with no network calls, there's nothing to leak.
// sigue explorando
Herramientas similares
Productividad
MyBrain
All-in-one productivity app and AI assistant with Tasks, Notes, Calendar, Diary and Bookmarks.
★ 2,2k estrellasGPL-3.0
Ver la guía →RAG y conocimiento
anything-llm
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
★ 66,7k estrellasMIT
Ver la guía →LLM local
BitNet
BitNet — Microsoft's official inference framework for 1-bit large language models, running fast on ordinary CPUs, MIT
★ 41,2k estrellasMIT
Ver la guía →LLM local
llm
Access large language models from the command-line
★ 12,6k estrellasApache-2.0
Ver la guía →LLM local
GPT-OSS
GPT-OSS — OpenAI open-weight language models: gpt-oss-120b for production reasoning and gpt-oss-20b for local use, Apache-2.0
★ 20,5k estrellasApache-2.0
Ver la guía →// alternativas
Alternativas en LLM local
Los demás proyectos de LLM local con más estrellas del catálogo de LibreAI: la lista realista de alternativas si FastChat no es lo que buscas.
- Ollama★ 182,1k
The simplest way to run open language models on your own machine.
- Open Webui★ 153,9k
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
- llama.cpp★ 130,2k
LLM inference in C/C++
- vLLM★ 93,1k
A high-throughput and memory-efficient inference and serving engine for LLMs
- lobehub★ 83,0k
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
// más en local-llm
Más en LLM local
Proyectos de LLM local cercanos en el catálogo, los más próximos en estrellas a FastChat: sigue explorando a ambos lados.
- BitNet★ 41,2k
BitNet — Microsoft's official inference framework for 1-bit large language models, running fast on ordinary CPUs, MIT
- llmfit★ 37,5k
Hundreds of models & providers. One command to find what runs on your hardware.
- Fabric★ 44,2k
Fabric is an open-source framework for augmenting humans using AI. It provides a modular system for solving specific problems using a crowdsourced set of AI …
- airllm★ 35,5k
Run a 70B LLM on a single 4GB GPU — layer-by-layer inference with almost no memory tricks skipped
- Jan★ 44,8k
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer
- Strata★ 33,3k
Strata — one-click Qwen3.8-Flash-Next inference on consumer hardware: chat, code and images, locally, no account, MIT
Consigue FastChat
Gratis y abierto: consigue el código fuente, dale una estrella al repositorio y empieza a crear.