AI Agents
agent-squad
Flexible and powerful framework for managing multiple AI agents and handling complex conversations
★ 7.8k starsApache-2.0
View guide →// agents · unclecode/crawl4ai
crawl4ai
crawl4ai is an open-source ai agents project by unclecode (unclecode/crawl4ai on GitHub). It has 84,698 GitHub stars and 8,763 forks, is released under the Apache-2.0 license, and was last updated on GitHub on 25 September 2026.
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
★ 84.7k stars⑂ 8.8k forksApache-2.0updated 2026-09
▦ visual — this project's README ships no embeddable screenshot,
so here's a placeholder. The guide below is complete regardless.
so here's a placeholder. The guide below is complete regardless.
// project facts
Project facts
- Repository
- unclecode/crawl4ai
- GitHub stars
- 84,698
- Forks
- 8,763
- License
- Apache-2.0
- Last updated on GitHub
- 25 September 2026
- Category
- AI Agents
- Listing
- Full install guide
- Official site
- Official site
// how it works
How it works
- Define the job
Research, coding, browsing, or ops — agents work best with a clear goal.
- Pick a framework
From no-code builders to code-first SDKs, match complexity to the task.
- Give it tools
Web search, code execution, and APIs are what make agents useful.
- Run and supervise
Watch the trace, approve consequential actions, iterate.
// features
Why people love it
LLM-powered
Large language models drive its smartest features, locally or via API.
Markdown-native
Plain-text Markdown keeps your content portable forever.
Memory
Long-term memory across sessions, not goldfish chat.
Multi-agent teams
Specialized agents collaborate on bigger jobs.
Tool use
Agents call real tools: browsers, terminals, APIs.
Evaluations
Benchmarks keep agent quality measurable.
Advertisement
// run it
Run it yourself
- Step 1 — Clone the repo
Download the source and move into the project folder.
git clone https://github.com/unclecode/crawl4ai.git cd crawl4ai - Step 2 — Check the README
Every project documents its own setup; start with install requirements.
cat README.md | head -60 - Step 3 — Run it
Follow the project's launch command — Docker, pip, npm, or a binary release.
# see README for the exact launch command
// use cases
What you can build
- Automate deep research tasks.
- Let agents write and test code.
- Build support bots that actually act.
- Orchestrate multi-step business ops.
duckle opens source ETL/ELT you deploy on your own servers or cloud. The AI Agents shelf also holds tradememory-protocol — Decision audit trail + persistent memory for ai trading, open-so... Readers working through the AI Agents shelf also stop at agentkit, Every AI agent deserves a wallet — onchain tools from Coinbase.
Advertisement
// faq
Questions, answered
Who maintains crawl4ai?
It is an open-source project at unclecode/crawl4ai with 8,763 forks. Check the repo's contributors and recent commits to see how active maintenance is.
Is crawl4ai free for commercial use?
Apache 2.0 licensed — commercial use allowed with attribution.
How do I keep them safe?
Sandboxing, approval gates, and least-privilege credentials.
Do I need to code?
Builders exist, but code-first frameworks go further.
What does it cost to run?
Model API bills dominate; self-hosted stacks cut that sharply.
// keep exploring
Similar tools
AI Agents
ruoyi-ai
Enterprise-grade AI agent framework with multi-provider LLM management, secure knowledge bases and high-precision RAG, visual workflow orchestration, and mul…
★ 5.7k starsMIT
View guide →AI Agents
TradingAgents-astock
A股多Agent投研框架 — 适配A股数据源(龙虎榜/游资/解禁等)，7位分析师基于A股规则的辩论决策，基于TradingAgents深度改造，适配大A。A-share multi-agent investment research framework — 7 AI analysts, bull/bear deb…
★ 3.6k starsApache-2.0
View guide →AI Agents
firecrawl
Turn any website into clean, agent-ready data with one API.
★ 189.6k starsAGPL-3.0
View guide →AI Agents
docling
Convert PDFs, DOCX, and HTML into clean, AI-ready documents.
★ 68.5k starsMIT
View guide →AI Agents
page-agent
Alibaba's in-page GUI agent: control any web interface with natural language, from one script tag
★ 29.4k starsMIT
View guide →// alternatives
Alternatives in AI Agents
The most-starred other AI Agents projects in the LibreAI catalogue — the realistic shortlist if crawl4ai is not the right fit.
- openclaw★ 391.6k
A personal AI that really does things — on any OS, with your data staying yours.
- superpowers★ 294.9k
An agentic skills framework & software development methodology that works.
- ECC★ 275.2k
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
- hermes-agent★ 252.0k
The agent that grows with you — a Python framework for adaptive AI agents.
- deepseek-harness★ 245.5k
DeepSeek's plugin-based agent harness where everything is a plugin.
// more in agents
More in AI Agents
Nearby AI Agents projects in the catalogue, closest in stars to crawl4ai — keep exploring the shelf either side of it.
- OpenHands★ 90.3k
Open-source AI-driven development platform: autonomous software agents in a sandbox
- deer-flow★ 83.4k
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message…
- servers★ 91.1k
The official collection of reference Model Context Protocol servers.
- AppFlowy★ 77.1k
Bring projects, wikis, and teams together with AI. AppFlowy is the AI collaborative workspace where you achieve more without losing control of your data. The…
- Agent-Reach★ 94.0k
Give your AI agent eyes on the whole internet: Twitter, Reddit, YouTube, GitHub and more, one CLI
- ruflo★ 74.1k
Agent harness for multi-agent swarms: deploy, coordinate and federate autonomous workflows
Get crawl4ai
Free and open — grab the source, star the repo, and start creating.