LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
FreeLLMAPI is an open-source dev tools project by tashfeenahmed (tashfeenahmed/freellmapi on GitHub). It has 52,700 GitHub stars and 7,381 forks, is released under the MIT license, and was last updated on GitHub on 15 November 2026.
87 free LLM providers behind one OpenAI-compatible endpoint, with routing and failover
Get the source, which ships a Docker Compose file.
Bring the container up in the background.
Open the dashboard, add provider keys on the Keys page, and order the fallback chain.
Use the unified API key from the Keys page header with any OpenAI SDK.
87 free providers and 1,313 free endpoints behind a single OpenAI-compatible /v1 API.
The router picks the best available model per request and fails over when a provider rate-limits.
Usage is tracked per key so you stay under every free-tier cap.
Provider keys are stored encrypted, not in plain text.
The model catalog updates from a signed feed — new free models and quota changes without a git pull.
Compatible with OpenAI SDKs, CLIs and coding agents that speak the /v1 API.
Download the source and move into the folder.
git clone https://github.com/tashfeenahmed/freellmapi.git
cd freellmapiBring the service up with Docker Compose.
docker compose up -dConfirm the dashboard answers on port 3001.
curl -s -o /dev/null -w "%{http_code}\n" http://localhost:3001For comparison, the same shelf also holds LocalAI — is the open-source AI engine and llama.cpp — LLM inference in C/C++. The complete list is the Dev Tools shelf.
A self-hosted aggregator that puts dozens of providers’ free LLM tiers behind one OpenAI-compatible /v1 endpoint.
The software is MIT licensed and free to self-host. You still need your own provider keys, and each provider’s free tier has its own terms.
It picks the best available model per request, fails over to the next provider on rate limits, and tracks usage per key.
The live model catalog, updated the same day. Free installs get the monthly snapshot instead — a 30-day lag on new models.
The quick start uses Docker Compose; there is also a desktop app and a source run.
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
LLM inference in C/C++
A high-throughput and memory-efficient inference and serving engine for LLMs
One Rust CLI for every LLM: shell assistant, chat REPL, RAG, tools and agents across 20+ providers.
CLI proxy that cuts LLM token consumption 60-90% on common dev commands — one Rust binary
TOON: a compact, human-readable serialization of JSON that saves tokens in LLM prompts
The most-starred other Dev Tools projects in the LibreAI catalogue — the realistic shortlist if FreeLLMAPI is not the right fit.
The open source coding agent
The model-definition framework behind modern AI — thousands of pretrained transformers for text, vision, and audio.
Anthropic's agentic coding tool that lives in your terminal and works across your whole codebase
Cross-platform desktop all-in-one manager for Claude Code, Codex, OpenCode and other coding agents
OpenAI's lightweight coding agent that runs locally in your terminal
Nearby Dev Tools projects in the catalogue, closest in stars to FreeLLMAPI — keep exploring the shelf either side of it.
Anthropic's official collection of notebooks and recipes for using Claude effectively
Aider is AI pair programming in your terminal
Context7 Platform -- Up-to-date code documentation for LLMs and AI code editors
An AI compute engine: a distributed runtime plus libraries for scaling ML and LLM workloads
OmO: a batteries-included orchestration layer that turns OpenCode into a multi-agent master
Build machine-learning web demos in Python within minutes — the fastest way to share a model with the world.
Free and open — grab the source, star the repo, and start creating.