Local LLM
GPT-OSS
GPT-OSS — OpenAI open-weight language models: gpt-oss-120b for production reasoning and gpt-oss-20b for local use, Apache-2.0
★ 20.5k starsApache-2.0
View guide →// local-llm · allenai/Olmo-core
OLMo-core
OLMo-core is an open-source local llm project by allenai (allenai/Olmo-core on GitHub). It has 1,772 GitHub stars and 364 forks, is released under the Apache-2.0 license, and was last updated on GitHub on 2 November 2026.
OLMo-core — the current PyTorch building blocks for the OLMo open language model ecosystem, Apache-2.0
★ 1.8k stars⑂ 364 forksApache-2.0updated 2026-11
▦ visual — this project's README ships no embeddable screenshot,
so here's a placeholder. The guide below is complete regardless.
so here's a placeholder. The guide below is complete regardless.
// project facts
Project facts
- Repository
- allenai/Olmo-core
- GitHub stars
- 1,772
- Forks
- 364
- License
- Apache-2.0
- Last updated on GitHub
- 2 November 2026
- Category
- Local LLM
- Listing
- Full install guide
- Official site
- Documentation
// how it works
How it works
- Clone the repository
Clone the current OLMo-core repository from GitHub.
- Install from source or PyPI
Install in editable mode with all extras for training work, or take the published package for library use.
- Build on the OLMo blocks
Use the documented modelling and training building blocks for your own OLMo-based model or experiment.
// features
Why people love it
The current OLMo codebase
The successor the old OLMo repo itself points to — actively pushed, not a frozen snapshot.
PyTorch building blocks
Modelling and training components for the OLMo ecosystem, rather than a single fixed model script.
Fully open lineage
OLMo is the fully open model family from AI2: open weights, data and code are the stated principles of the project.
Documented on Read the Docs
API documentation for the library lives on its Read the Docs site.
Advertisement
// run it
Run it yourself
- Clone and install from source
The README install route: clone, then editable install with all extras.
git clone https://github.com/allenai/Olmo-core.git cd Olmo-core pip install -e .[all] - Install the package
The published package for library use.
pip install ai2-olmo-core - Read the documentation
Modelling and training docs for the OLMo building blocks.
https://olmo-core.readthedocs.io/en/latest/
// use cases
What you can build
- Building and training models on the OLMo ecosystem
- Studying fully open language-model design with open code
- Running OLMo-based experiments from the current codebase
- Extending OLMo modelling blocks for new research
Advertisement
// faq
Questions, answered
Who makes OLMo-core?
The Allen Institute for AI (AI2), as the building-blocks library for its OLMo model family.
Is OLMo-core free?
Yes — Apache-2.0 licensed.
Is this the same as the old OLMo repo?
No — the old allenai/OLMo repo says it is out of date and no longer active and points here; OLMo-core is the current codebase.
Is OLMo-core a chatbot?
No — it is a PyTorch library of modelling and training building blocks for researchers and engineers.
How do I get started?
Clone allenai/Olmo-core, pip install -e .[all], and follow the Read the Docs documentation.
// keep exploring
Similar tools
Local LLM
sre
Cloud-native runtime for building and running agentic AI in production.
★ 1.3k starsMIT
View guide →Local LLM
DeepSeek-Coder-V2
DeepSeek-Coder-V2 — DeepSeek's open code model family that challenged closed-source code models.
★ 7.0k starsMIT
View guide →Local LLM
ChatLLM-Web
Private AI chat and model studio that runs in your browser via WebGPU.
★ 636 starsMIT
View guide →Local LLM
Step-3.5-Flash
StepFun's open 196B MoE model that activates 11B parameters per token, built for fast agentic reasoning.
★ 2.1k starsApache-2.0
View guide →Local LLM
Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
★ 8.1k starsApache-2.0
View guide →// alternatives
Alternatives in Local LLM
The most-starred other Local LLM projects in the LibreAI catalogue — the realistic shortlist if OLMo-core is not the right fit.
- Ollama★ 182.1k
The simplest way to run open language models on your own machine.
- Open Webui★ 153.9k
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
- llama.cpp★ 130.2k
LLM inference in C/C++
- vLLM★ 93.1k
A high-throughput and memory-efficient inference and serving engine for LLMs
- lobehub★ 83.0k
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
// more in local-llm
More in Local LLM
Nearby Local LLM projects in the catalogue, closest in stars to OLMo-core — keep exploring the shelf either side of it.
- ai-file-sorter★ 1.8k
AI file organizer that sorts and renames files by understanding content.
- OpenOSINT★ 1.7k
AI OSINT agent with 20 tools and REPL — for authorized research only.
- AIaW★ 1.8k
Elegant AI chat client with workspaces, plugins, and local-first sync.
- subsai★ 1.7k
Whisper-powered subtitle generation: Web UI, CLI, and package.
- waku-agent★ 1.9k
Local-first agent harness with loop, memory, and evals in readable code.
- lemonai★ 1.6k
Self-evolving general AI agent running fully locally, a Manus-style alternative.
Get OLMo-core
Free and open — grab the source, star the repo, and start creating.