LibreAI / LLM locaux / FreeToken
// local-llm · FlashML-org/FreeToken

FreeToken

FreeToken est un projet de LLM locaux open source, créé par FlashML-org (FlashML-org/FreeToken sur GitHub). Il compte 17 211 étoiles sur GitHub et 1 705 forks, il est publié sous la licence Apache-2.0 et a été mis à jour pour la dernière fois sur GitHub le 15 novembre 2026.

Run 290B+ frontier MoE models on your own gaming PC at interactive speed

★ 17,2 k étoiles⑂ 1,7 k forksApache-2.0mis à jour nov. 2026
▦ visuel — le README de ce projet ne contient aucune capture intégrable,
voici donc un emplacement réservé. Le guide ci-dessous est complet malgré tout.
// détails du projet

Détails du projet

Étoiles GitHub
17 211
Forks
1 705
Licence
Apache-2.0
Dernière mise à jour sur GitHub
15 novembre 2026
Catégorie
LLM locaux
Type de fiche
Guide d'installation complet
Site officiel
Official site
// fonctionnement

Comment ça marche

  1. Clone the repo

    Get the source and move into the project folder.

  2. Install it

    Install with uv, including the acceleration extras.

  3. Pick a model

    Choose a supported open-weight MoE model and follow the README serving example.

  4. Serve it

    Run the engine and point your client at it.

// fonctionnalités

Pourquoi on l'adore

Frontier MoE on consumer hardware

290B+ open-weight MoE models on a gaming PC, per the project’s own claim.

Bandwidth-adaptive co-execution

CPU-GPU co-execution that adapts to the bandwidth your machine actually has.

Semantic-aware caching

Semantic anchor checkpoints for recurrent state and KV caches, so agentic context edits skip recomputation.

Elastic memory

Dynamic VRAM re-allocation between expert caches and KV memory, without restarts or weight reloading.

Broad MoE support

DeepSeek-V4-Flash, Qwen3.6-35B-A3B, GLM-5.2 and other frontier open-weight MoE models.

Fast weight format

The FTW fast weight format plus double-buffered prefill streaming for interactive speeds.

// lancez-le

Lancez-le vous-même

  1. Step 1 — Clone the repo

    Download the source and move into the folder.

    git clone https://github.com/FlashML-org/FreeToken.git && cd FreeToken
  2. Step 2 — Install it

    Install in editable mode with the acceleration extras.

    uv pip install -e ".[accel]"
  3. Step 3 — Start serving

    Pick a supported model and follow the README serving example.

    # see README for the exact serve command and model flags
// cas d'usage

Ce que vous pouvez créer

  • Run a 290B+ open-weight MoE model on hardware you already own.
  • Serve frontier models locally for agents without a datacenter bill.
  • Keep long agent contexts cheap with semantic-aware KV caching.
  • Reallocate VRAM between experts and KV memory without restarting.

For comparison, the same shelf also holds llama.cpp — LLM inference in C/C++ and colibri — Tiny C engine that runs huge MoE models on the. The complete list is the Local LLM shelf. Before running a model locally, check how much VRAM you need for local LLMs — model size has to match your hardware.

// faq

Questions fréquentes

What is FreeToken?

An edge-native MoE serving engine that runs frontier-scale open-weight models on personal and consumer hardware.

Which models does it support?

Frontier open-weight MoE models including DeepSeek-V4-Flash, Qwen3.6-35B-A3B and GLM-5.2.

Do I need a datacenter GPU?

No — that is the point: it treats your GPU, CPU, host memory and interconnects as one elastic inference platform.

Is it free?

Yes, Apache-2.0 licensed. You still need the model weights, which you download yourself.

How do I install it?

Clone the repo and install with uv, including the [accel] extras; the README has the serving examples.

// continuez l'exploration

Outils similaires

LLM locaux

llama.cpp

LLM inference in C/C++

★ 130,2 k étoilesMIT
Voir le guide →
LLM locaux

colibri

Tiny C engine that runs huge MoE models on the machine you already own — GLM, Kimi K3, DeepSeek, Qwen, Apache-2.0

★ 49,3 k étoilesApache-2.0
Voir le guide →
LLM locaux

GPT4All

GPT4All — run local LLMs on any device: a free desktop chat client and Python SDK that run open models entirely on your CPU, no GPU or cloud required

★ 77,4 k étoilesMIT
Voir le guide →
LLM locaux

Ollama

The simplest way to run open language models on your own machine.

★ 182,1 k étoilesMIT
Voir le guide →
LLM locaux

kalosm

Run controllable pre-trained AI models locally, written in Rust.

★ 2,2 k étoilesApache-2.0
Voir le guide →
LLM locaux

whatcanirun

Find the best local models for your hardware — and how to run them.

★ 247 étoilesMIT
Voir le guide →
// alternatives

Alternatives en LLM locaux

Les autres projets de la catégorie LLM locaux avec le plus d'étoiles du catalogue LibreAI — la sélection réaliste d'alternatives si FreeToken ne vous convient pas.

  • Ollama★ 182,1 k

    The simplest way to run open language models on your own machine.

  • Open Webui★ 153,9 k

    User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

  • llama.cpp★ 130,2 k

    LLM inference in C/C++

  • vLLM★ 93,1 k

    A high-throughput and memory-efficient inference and serving engine for LLMs

  • lobehub★ 83,0 k

    🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.

// plus en local-llm

Plus en LLM locaux

Projets de la catégorie LLM locaux proches dans le catalogue, les plus proches en étoiles de FreeToken — continuez à explorer de part et d'autre.

  • Web LLM★ 19,2 k

    High-performance In-browser LLM Inference Engine

  • Qwen3-Coder★ 16,8 k

    Qwen3-Coder - Alibaba's open code model series for agentic coding, up to 1M tokens of context

  • GPT-OSS★ 20,5 k

    GPT-OSS — OpenAI open-weight language models: gpt-oss-120b for production reasoning and gpt-oss-20b for local use, Apache-2.0

  • MNN★ 16,2 k

    Alibaba's lightweight, blazing-fast inference engine for on-device LLMs and edge AI.

  • omlx★ 22,6 k

    A fast LLM inference server for Apple Silicon, managed from the macOS menu bar

  • nano-vllm★ 15,7 k

    A lightweight vLLM implementation built from scratch in about 1,200 readable lines of Python.

Obtenir FreeToken

Gratuit et ouvert : récupérez le code source, mettez une étoile au dépôt et commencez à créer.