LibreAI / Dev Tools / FreeLLMAPI
// devtools · tashfeenahmed/freellmapi

FreeLLMAPI

FreeLLMAPI is an open-source dev tools project by tashfeenahmed (tashfeenahmed/freellmapi on GitHub). It has 52,700 GitHub stars and 7,381 forks, is released under the MIT license, and was last updated on GitHub on 15 November 2026.

87 free LLM providers behind one OpenAI-compatible endpoint, with routing and failover

★ 52.7k stars⑂ 7.4k forksMITupdated 2026-11
▦ visual — this project's README ships no embeddable screenshot,
so here's a placeholder. The guide below is complete regardless.
// project facts

Project facts

GitHub stars
52,700
Forks
7,381
License
MIT
Last updated on GitHub
15 November 2026
Category
Dev Tools
Listing
Full install guide
Official site
Official site
// how it works

How it works

  1. Clone the repo

    Get the source, which ships a Docker Compose file.

  2. Start it with Compose

    Bring the container up in the background.

  3. Add your keys

    Open the dashboard, add provider keys on the Keys page, and order the fallback chain.

  4. Point your client at it

    Use the unified API key from the Keys page header with any OpenAI SDK.

// features

Why people love it

One endpoint, many free tiers

87 free providers and 1,313 free endpoints behind a single OpenAI-compatible /v1 API.

Smart routing and failover

The router picks the best available model per request and fails over when a provider rate-limits.

Per-key usage tracking

Usage is tracked per key so you stay under every free-tier cap.

Encrypted keys

Provider keys are stored encrypted, not in plain text.

Self-updating catalog

The model catalog updates from a signed feed — new free models and quota changes without a git pull.

Works with your clients

Compatible with OpenAI SDKs, CLIs and coding agents that speak the /v1 API.

// run it

Run it yourself

  1. Step 1 — Clone the repo

    Download the source and move into the folder.

    git clone https://github.com/tashfeenahmed/freellmapi.git
    cd freellmapi
  2. Step 2 — Start it

    Bring the service up with Docker Compose.

    docker compose up -d
  3. Step 3 — Check it is up

    Confirm the dashboard answers on port 3001.

    curl -s -o /dev/null -w "%{http_code}\n" http://localhost:3001
// use cases

What you can build

  • Use many providers’ free tiers through one API key and one endpoint.
  • Keep coding agents running when one provider rate-limits, via automatic failover.
  • Stay under every free-tier cap with per-key usage tracking.
  • Try models from 736 families without signing up to each provider separately.

For comparison, the same shelf also holds LocalAI — is the open-source AI engine and llama.cpp — LLM inference in C/C++. The complete list is the Dev Tools shelf.

// faq

Questions, answered

What is FreeLLMAPI?

A self-hosted aggregator that puts dozens of providers’ free LLM tiers behind one OpenAI-compatible /v1 endpoint.

Is it really free?

The software is MIT licensed and free to self-host. You still need your own provider keys, and each provider’s free tier has its own terms.

How does the router work?

It picks the best available model per request, fails over to the next provider on rate limits, and tracks usage per key.

What is the $19/yr premium?

The live model catalog, updated the same day. Free installs get the monthly snapshot instead — a 30-day lag on new models.

Do I need Docker?

The quick start uses Docker Compose; there is also a desktop app and a source run.

// keep exploring

Similar tools

AI Agents

LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

★ 49.4k starsMIT
View guide →
Local LLM

llama.cpp

LLM inference in C/C++

★ 130.2k starsMIT
View guide →
Local LLM

vLLM

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 93.1k starsApache-2.0
View guide →
Dev Tools

aichat

One Rust CLI for every LLM: shell assistant, chat REPL, RAG, tools and agents across 20+ providers.

★ 10.5k starsApache-2.0
View guide →
Dev Tools

rtk

CLI proxy that cuts LLM token consumption 60-90% on common dev commands — one Rust binary

★ 82.7k starsApache-2.0
View guide →
Dev Tools

toon

TOON: a compact, human-readable serialization of JSON that saves tokens in LLM prompts

★ 25.5k starsMIT
View guide →
// alternatives

Alternatives in Dev Tools

The most-starred other Dev Tools projects in the LibreAI catalogue — the realistic shortlist if FreeLLMAPI is not the right fit.

  • OpenCode★ 211.6k

    The open source coding agent

  • Transformers★ 166.9k

    The model-definition framework behind modern AI — thousands of pretrained transformers for text, vision, and audio.

  • claude-code★ 149.7k

    Anthropic's agentic coding tool that lives in your terminal and works across your whole codebase

  • cc-switch★ 141.3k

    Cross-platform desktop all-in-one manager for Claude Code, Codex, OpenCode and other coding agents

  • codex★ 128.2k

    OpenAI's lightweight coding agent that runs locally in your terminal

// more in devtools

More in Dev Tools

Nearby Dev Tools projects in the catalogue, closest in stars to FreeLLMAPI — keep exploring the shelf either side of it.

  • claude-cookbooks★ 53.3k

    Anthropic's official collection of notebooks and recipes for using Claude effectively

  • Aider★ 49.4k

    Aider is AI pair programming in your terminal

  • Context7★ 62.6k

    Context7 Platform -- Up-to-date code documentation for LLMs and AI code editors

  • ray★ 44.0k

    An AI compute engine: a distributed runtime plus libraries for scaling ML and LLM workloads

  • oh-my-openagent★ 69.9k

    OmO: a batteries-included orchestration layer that turns OpenCode into a multi-agent master

  • Gradio★ 43.7k

    Build machine-learning web demos in Python within minutes — the fastest way to share a model with the world.

Get FreeLLMAPI

Free and open — grab the source, star the repo, and start creating.