Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

Omnigraph
Omnigraph
Busbar
Busbar
OfinTech Desk
OfinTech Desk
It's a plan
It's a plan
Bifrost
Bifrost

unclecode/crawl4ai

Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.

#Web scraping
Visit GitHub
Python
87.5k
9.5k
81 contributors
Apache License 2.0
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Busbar

Control what AI can do before it acts

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Momentum

How fast unclecode/crawl4ai is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 19 – Nov 18, 2026

Stars +3,678 in 61 days

050100150
129

Forks +628 in 61 days

0102030
25

Merged PRs 57 in 61 days

051015
14

Trendshift Trendingwhere the repository ranked each day it made the top 25

Not in the Trendshift top 25 in this period

Sep 19Sep 27Oct 5Oct 13Oct 21Oct 29Nov 6Nov 14
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRs
Sat, Sep 19, 2026+41+60
Sun, Sep 20, 2026+99+170
Mon, Sep 21, 2026+63+50
Tue, Sep 22, 2026+47+45
Wed, Sep 23, 2026+79+112
Thu, Sep 24, 2026+54+90
Fri, Sep 25, 2026+48+150
Sat, Sep 26, 2026+45+30
Sun, Sep 27, 2026+52+80
Mon, Sep 28, 2026+57+50
Tue, Sep 29, 2026+67+140
Wed, Sep 30, 2026+93+100
Thu, Oct 1, 2026+37+80
Fri, Oct 2, 2026+35+110
Sat, Oct 3, 2026+47+90
Sun, Oct 4, 2026+60+140
Mon, Oct 5, 2026+36+92
Tue, Oct 6, 2026+61+100
Wed, Oct 7, 2026+61+140
Thu, Oct 8, 2026+107+210
Fri, Oct 9, 2026+71+80
Sat, Oct 10, 2026+67+120
Sun, Oct 11, 2026+98+130
Mon, Oct 12, 2026+129+2514
Tue, Oct 13, 2026+73+82
Wed, Oct 14, 2026+88+72
Thu, Oct 15, 2026+73+170
Fri, Oct 16, 2026+45+120
Sat, Oct 17, 2026+55+60
Sun, Oct 18, 2026+54+100
Mon, Oct 19, 2026+85+120
Tue, Oct 20, 2026+68+151
Wed, Oct 21, 2026+61+100
Thu, Oct 22, 2026+63+62
Fri, Oct 23, 2026+61+120
Sat, Oct 24, 2026+71+140
Sun, Oct 25, 2026+75+150
Mon, Oct 26, 2026+65+95
Tue, Oct 27, 2026+84+190
Wed, Oct 28, 2026+56+130
Thu, Oct 29, 2026+76+102
Fri, Oct 30, 2026+73+60
Sat, Oct 31, 2026+47+90
Sun, Nov 1, 2026+61+210
Mon, Nov 2, 2026+68+105
Tue, Nov 3, 2026+61+101
Wed, Nov 4, 2026+55+107
Thu, Nov 5, 2026+49+40
Fri, Nov 6, 2026+56+80
Sat, Nov 7, 2026+48+130
Sun, Nov 8, 2026+42+90
Mon, Nov 9, 2026+47+91
Tue, Nov 10, 2026+44+101
Wed, Nov 11, 2026+43+60
Thu, Nov 12, 2026+47+111
Fri, Nov 13, 2026+39+93
Sat, Nov 14, 2026+37+80
Sun, Nov 15, 2026+43+40
Mon, Nov 16, 2026+46+70
Tue, Nov 17, 2026+35+61
Wed, Nov 18, 2026+30+20
Total+3,678+62857
  • 1#1 on the list
  • 7Rank that day
  • Not trending
1
  • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    Sep 29, 2024 – Sep 1, 2026#1 on 3 days

    #1#5#10#15#20#25
    Top 10
    Oct 2024Jan 2025AprJulOctJan 2026AprJul
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about unclecode/crawl4ai, and every badge it has earned
    1. Nov 172 posts
      • 建这个号就干两件事:扒拉真正能打的 AI 开源平替,顺便琢磨怎么用自动化工作流搞点副业收入 平时爱折腾,偶尔上头,测评不一定全对,踩过的坑也会直接说人话吐槽 顺手整理了 6 个我目前高频在用的工具,能替掉一部分付费订阅,但别把源码公开当成随便商用 1 n8n:把大模型和各种业务工具串起来,省掉不少来回复制粘贴 就是节点多了眼花,自己内部用和拿去卖托管服务,也不是同一套授权边界 2…

        Read full on X, posted by @urnyw1

        @urnyw1 · x.com

      • 14 free github repos to stitch together a research-to-video pipeline you can pass straight into claude code: 01 skills → official skills for articles, decks, and spreadsheets 02 superpowers →…

        Read full on X, posted by @cyrilXBT

        @cyrilXBT · x.com

    2. Nov 162 posts
      • 2/ Firecrawl (YC W24) Turn websites into clean, LLM-ready markdown. • Crawls entire domains with subpage recursion • Handles JS rendering and bot barriers • Clean markdown and JSON schema outputs

        Read full on X, posted by @vedangvatsa

        @vedangvatsa · x.com

      • 副业一个人就是一家公司 Muse 装这 14 个免费技能,写稿、做表、做幻灯片不用再雇人,省下的就是利润 全部在 GitHub 上免费开源 1. Superpowers — 从查资料到写稿,一整套干活的方法 2. Skills — 做文章、做 PPT、做表格,官方的技能包 3. Crawl4AI — 自动搜集网上的信息 4. grok_x_search — 在 Muse 里直接搜 X 5.…

        Read full on X, posted by @nanajiang8888

        @nanajiang8888 · x.com

    3. Nov 121 post
      • 9 GitHub repos that can level up your AI agents. 🚀 Browser automation, web scraping, multi-agent systems and LLM infrastructure — all open source. Which one deserves a deep dive? Follow…

        Read full on X, posted by @payasi_pa66104

        @payasi_pa66104 · x.com

    4. Nov 71 post
      • 2027年你的工作可能不安全,先把这7个GitHub仓库学会。 ⚒️它们能帮你用AI而不是被AI取代: 1. GPT Researcher AI研究代理,能搜索网页、深入调查复杂话题,并写出带引用的详细报告。 2. OpenHands AI软件工程师,可以写代码、修bug、处理开发任务。 3. Activepieces 跨应用自动化重复工作,让AI代理执行真实工作流。 4. CrewAI…

        Read full on X, posted by @mr_mofun

        @mr_mofun · x.com

    5. Nov 63 posts
      • 5/6: 4. n8n-io/n8n Workflow automation with AI built in. Visual editor or code, self-hosted or cloud. Fair-code license. 5. unclecode/crawl4ai Turns websites into clean, LLM-ready Markdown.…

        Read full on X, posted by @AiBoosting_net

        @AiBoosting_net · x.com

      • 9 GITHUB REPOS THAT LET YOU SCRAPE ANY WEBSITE WITHOUT GETTING BLOCKED. Most scrapers get banned in the first 100 requests. These ones do not. Crawl4AI — AI-powered crawler built for LLM pipelines.…

        Read full on X, posted by @cyrilXBT

        @cyrilXBT · x.com

      • 还在把整页 HTML 硬塞给 Agent?CSS、导航、广告一起进上下文,Token 烧得飞快,还容易幻觉。 推荐一个开源神器:Crawl4AI(约 8.7 万星 · Apache 2.0)。网页 → 干净 Markdown / 结构化 JSON,专为喂 LLM;库本地跑、Docker 自托管都行。 → 场景 1:竞品 / 文档站洗成 RAG 语料,少带噪声进知识库 → 场景 2:定价页 /…

        Read full on X, posted by @perry_weijie

        @perry_weijie · x.com

    6. Nov 51 post
      • Today's top opensource GitHub repo of the day: unclecode/crawl4ai async open-source web crawler for AI extraction pipelines. why builders should care: runs js and extracts structured schemas at high…

        Read full on X, posted by @HamburgerButton

        @HamburgerButton · x.com

    You might also like

    Repositories close to unclecode/crawl4ai
    FeaturedAdvertise to 180K+ monthly visitors
    OfinTech Desk

    An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

    Omnigraph

    Versioned graph database on object storage. Git-style workflows and multimodal retrieval

    Busbar

    Control what AI can do before it acts

    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    It's a plan

    Open-source Linear alternative

    An issue tracker where AI agents take the work you assign them

    GramosoftAI/GcrawlAI

    Python

    Turn any website into clean, LLM-ready data. Open-source web crawler with stealth mode, distributed crawling, real-time WebSocket progress & Markdown output. Power your AI apps with GcrawlAI.

    604

    0xMassi/webclaw

    Rust

    Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

    2.5k282

    Anakin-Inc/anakin

    Go

    Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up

    3.9k310

    lumpinif/deepcrawl

    TypeScript

    100% free and full open-source edge Firecrawl alternative with better links extraction for agents - that you can deploy to cloudflare or vercel by yourself.

    70385

    fastcrw/crw

    Rust

    Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

    1.3k119

    BrowserCash/teracrawl

    TypeScript

    High-performance web crawler API optimized for LLMs. Turn any search or website into clean Markdown using remote browsers. Firecrawl alternative

    29037

    xberg-io/crawlberg

    Rust

    Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language.

    19732

    YOLOW92/pagesift

    Rust

    Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary.

    28037

    firecrawl/firecrawl

    TypeScript

    Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

    202.8k11.1k