Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

  • Terms and conditions
  • Privacy policy

More

  • Pricing
  • Advertise
  • onedump
  • gosnakego
  • Contact us

Social

  • X (Twitter)
  • GitHub
Trendshift owl
What they build speaks louder than words
© 2026 Trendshift, created by Julian Li with ❤️
SignalAdvertise
Trendshift
SignalAdvertise
Sign in
Trendshift owl

Discover trends that matter

SignalAdvertise
DailyWeeklyMonthlyYearly
Live mentionsTopics
RepositoriesDevelopers
InsightsStats

It's a plan
It's a plan
Bifrost
Bifrost
Omnigraph
Omnigraph
Busbar
Busbar
OfinTech Desk
OfinTech Desk

D4Vinci/Scrapling

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

#Web scraping
Visit GitHub
Python
104.1k
11.3k
25 contributors
BSD 3-Clause "New" or "Revised" License
website
AchievementsView all →
FeaturedAdvertise to 180K+ monthly visitors
It's a plan

Open-source Linear alternative

An issue tracker where AI agents take the work you assign them

Bifrost

Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

Omnigraph

Versioned graph database on object storage. Git-style workflows and multimodal retrieval

Busbar

Control what AI can do before it acts

OfinTech Desk

An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

Momentum

How fast D4Vinci/Scrapling is gaining stars, and where it lands on Trendshift and GitHub Trending

Activity and trending

Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending

Sep 19 – Nov 18, 2026

Stars +21,947 in 61 days

01K2K
1,958

Forks +2,710 in 61 days

0100200
187

Merged PRs 39 in 61 days

0510
7

Trendshift Trendingwhere the repository ranked each day it made the top 25

Top 25 overall

1386410

Top 25 in Python

2319161011224102515142024
Sep 19Sep 27Oct 5Oct 13Oct 21Oct 29Nov 6Nov 14
The left and right arrow keys step from day to day; Home and End go to the first and the last

Stars, forks, merged pull requests and Trendshift Trending rank, by day
DayStars gainedForks gainedMerged PRsAll languagesPython
Sat, Sep 19, 2026+249+343Not trendingNot trending
Sun, Sep 20, 2026+210+220Not trendingNot trending
Mon, Sep 21, 2026+197+190Not trendingNot trending
Tue, Sep 22, 2026+151+180Not trendingNot trending
Wed, Sep 23, 2026+210+440Not trendingNot trending
Thu, Sep 24, 2026+251+392Not trendingNot trending
Fri, Sep 25, 2026+275+270Not trending#23
Sat, Sep 26, 2026+174+241Not trendingNot trending
Sun, Sep 27, 2026+168+280Not trendingNot trending
Mon, Sep 28, 2026+279+260Not trendingNot trending
Tue, Sep 29, 2026+198+240Not trendingNot trending
Wed, Sep 30, 2026+194+230Not trendingNot trending
Thu, Oct 1, 2026+288+440Not trending#19
Fri, Oct 2, 2026+222+390Not trendingNot trending
Sat, Oct 3, 2026+221+260Not trendingNot trending
Sun, Oct 4, 2026+221+251Not trendingNot trending
Mon, Oct 5, 2026+170+190Not trendingNot trending
Tue, Oct 6, 2026+136+143Not trendingNot trending
Wed, Oct 7, 2026+187+342Not trendingNot trending
Thu, Oct 8, 2026+203+250Not trendingNot trending
Fri, Oct 9, 2026+155+100Not trendingNot trending
Sat, Oct 10, 2026+166+220Not trendingNot trending
Sun, Oct 11, 2026+151+140Not trendingNot trending
Mon, Oct 12, 2026+163+200Not trendingNot trending
Tue, Oct 13, 2026+323+450Not trending#16
Wed, Oct 14, 2026+266+520Not trendingNot trending
Thu, Oct 15, 2026+307+357Not trendingNot trending
Fri, Oct 16, 2026+210+431Not trendingNot trending
Sat, Oct 17, 2026+181+272Not trendingNot trending
Sun, Oct 18, 2026+194+360Not trendingNot trending
Mon, Oct 19, 2026+190+270Not trendingNot trending
Tue, Oct 20, 2026+195+270Not trendingNot trending
Wed, Oct 21, 2026+166+150Not trendingNot trending
Thu, Oct 22, 2026+159+220Not trendingNot trending
Fri, Oct 23, 2026+150+200Not trendingNot trending
Sat, Oct 24, 2026+131+210Not trendingNot trending
Sun, Oct 25, 2026+221+360Not trendingNot trending
Mon, Oct 26, 2026+180+310Not trendingNot trending
Tue, Oct 27, 2026+170+240Not trendingNot trending
Wed, Oct 28, 2026+158+250Not trendingNot trending
Thu, Oct 29, 2026+112+230Not trendingNot trending
Fri, Oct 30, 2026+157+210Not trendingNot trending
Sat, Oct 31, 2026+389+1091Not trending#10
Sun, Nov 1, 2026+862+1870#13#1
Mon, Nov 2, 2026+1,053+1245#8#1
Tue, Nov 3, 2026+1,958+1793#6#2
Wed, Nov 4, 2026+1,729+1655#4#2
Thu, Nov 5, 2026+1,449+1600#10#4
Fri, Nov 6, 2026+905+970Not trending#10
Sat, Nov 7, 2026+488+490Not trendingNot trending
Sun, Nov 8, 2026+534+460Not trending#25
Mon, Nov 9, 2026+688+690Not trending#15
Tue, Nov 10, 2026+580+510Not trendingNot trending
Wed, Nov 11, 2026+510+390Not trendingNot trending
Thu, Nov 12, 2026+497+410Not trending#14
Fri, Nov 13, 2026+369+520Not trending#20
Sat, Nov 14, 2026+432+463Not trendingNot trending
Sun, Nov 15, 2026+378+460Not trending#24
Mon, Nov 16, 2026+337+530Not trendingNot trending
Tue, Nov 17, 2026+301+400Not trendingNot trending
Wed, Nov 18, 2026+179+70Not trendingNot trending
Total+21,947+2,71039
  • 1#1 on the list
  • 7Rank that day
  • Not trending
1
  • GitHub trending history

    Where the repository ranked on GitHub Trending, one dot for each day it was on a list

    Feb 24 – Nov 5, 2026#1 on 1 day

    #1#5#10#15#20#25
    Top 10
    Aug 2025OctDecFebAprJunAugOct
    The left and right arrow keys step from day to day; Home and End go to the first and the last

    Mentions and achievements

    Where people are talking about D4Vinci/Scrapling, and every badge it has earned
    1. Nov 172 posts
      • You don't need a better AI model. You need these 10 GitHub repos to get more out of the one you already use. 1.) Ponytail: Stops Claude from writing code you don't need. 2.) Hallmark: Builds pages…

        Read full on X, posted by @suraj_sharma14

        @suraj_sharma14 · x.com

      • AI 做项目少不了浏览器,最烦自动化访问被识别。Mac 上 4 个工具简单试跑:agent-browser、Lightpanda 正常;Scrapling 缺 Playwright,Browser Use 卡在 Chrome 权限。反检测还没实测,别只看跑分。

        Read full on X, posted by @hfcorriez

        @hfcorriez · x.com

    2. Nov 162 posts
      • Claude picked the right Scrapling tool every time. The waste was the format: it asked for HTML. Add "as markdown" next to the selector: same books, under a quarter of the text.

        Read full on X, posted by @SurendarR151771

        @SurendarR151771 · x.com

      • Setup in Claude Code: pip install "scrapling[ai]" scrapling install claude mcp add ScraplingServer "$(which scrapling-mcp)" Restart Claude Code and ask for the data, as markdown.

        Read full on X, posted by @SurendarR151771

        @SurendarR151771 · x.com

    3. 7 days earlier
    4. Nov 91 post
      • 一天涨了 1655 颗星。 Scrapling 是个 Python 爬虫框架,发请求、隐身浏览器、解析、整站抓取都在一个库里,所以收藏的人多,快 10 万星了。 想把一个网站整理成干净的 Markdown,或者让 AI Agent 通过它的 MCP 抓数据,都能直接用。 免费开源。 地址:

        Read full on X, posted by @SarahMitch34776

        @SarahMitch34776 · x.com

    5. Nov 81 post
      • Your scraper dies the day the HTML moves one class over. Scrapling is a Python scraping framework: fast HTTP + stealth browsers, adaptive selectors, spiders, CLI, and MCP for agents. 98k stars.…

        Read full on X, posted by @wushi123321

        @wushi123321 · x.com

    6. Nov 71 post
      • 几个GitHub项目,比那些天天刷榜的大仓库更实用,也更新鲜。 **CleanYourTV** 用WiFi把Android TV/Google TV里的广告、预装垃圾清掉,再换一个接近Apple TV风格的干净桌面。不用root,也不用插线,小米、TCL、Sony这些都有人实测过。 **REA**…

        Read full on X, posted by @pytzl

        @pytzl · x.com

    7. Nov 63 posts
      • Craft Anything studies a website, app or game. A coding agent you're signed in to builds a new project, then it checks the result against the original. It's a free alpha. In our test the app launched…

        Read full on X, posted by @buildwithneej

        @buildwithneej · x.com

      • Scrapling:網站改版也不容易壞的 Python 開源爬蟲框架。 網站一改版,辛苦寫的爬蟲就整個壞掉? 這個框架快 10 萬星,今天一天又多 1,600 多星,官方跑分擷取文字比 BeautifulSoup 快約 785 倍。 三步驟上手: 第一步:pip install scrapling 裝好 第二步:一行 page.markdown() 把整頁轉成乾淨 Markdown,直接丟給…

        Read full on X, posted by @0xSpeter

        @0xSpeter · x.com

      • 今天 GitHub 日榜,3 个开源项目分别瞄准电脑操作、工程效率和网页抓取。看点不止热度,也能直观看到 Agent 工具链与开发者工作流的不同方向: 1. vercel-labs/agent-desktop|总约 17,054 ⭐|今日约 +2,173|Rust:为 AI Agent 提供电脑操作 CLI。 2. mattpocock/skills|总约 315,443 ⭐|今日约…

        Read full on X, posted by @panExorcist

        @panExorcist · x.com

    You might also like

    Repositories close to D4Vinci/Scrapling
    FeaturedAdvertise to 180K+ monthly visitors
    Bifrost

    Fastest Enterprise AI Gateway for Routing, Governing, and Securing all your AI Traffic

    Omnigraph

    Versioned graph database on object storage. Git-style workflows and multimodal retrieval

    It's a plan

    Open-source Linear alternative

    An issue tracker where AI agents take the work you assign them

    Busbar

    Control what AI can do before it acts

    OfinTech Desk

    An open-source AI workspace for finance and accounting teams, in which every figure is traced to its source

    omkarcloud/botasaurus

    TypeScript

    The All in One Framework to Build Undefeatable Scrapers

    5.8k522

    mldsveda/PyScrappy

    Python

    Adaptive Python web scraping toolkit + MCP server for AI agents. Self-healing selectors that survive site changes, TLS-fingerprint stealth to bypass anti-bot filters, CSS/XPath parsing, and 24 built-in scrapers, clean, structured, LLM-ready data from any URL.

    26592

    scrapfly/python-scrapfly

    Python

    Official Python SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Integrates with Scrapy, LlamaIndex, and LangChain.

    6317

    mdowis/anansi

    Python

    A self-healing scraper for hostile sites: broken selectors repair themselves, browser rendering kicks in when needed, and a coherent identity layer (Chrome TLS fingerprints, matched personas, vendor-aware Cloudflare/Akamai/DataDome handling) works to slip past bot detection. Ships with an MCP server so any LLM can drive a full crawl by conversation.

    11723

    alex-on-ai/WebReaper

    C#

    AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.

    15333

    apify/crawlee-python

    Python

    Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.

    9.7k862

    scraperai/scraperai

    HTML

    ScraperAI is an open-source, AI-powered tool designed to simplify web scraping for users of all skill levels.

    49972

    isdk/web-fetcher.js

    HTML

    A web automation library that lets AI agents browse the web using declarative JSON, with a unified dual-engine API and powerful anti-bot evasion.

    234

    apify/apify-sdk-python

    Python

    Apify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Built on top of the the Apify API Client.

    18036