List of libraries, tools and APIs for web scraping and data processing.

The All in One Framework to Build Undefeatable Scrapers

Web data extraction tool implemented as chrome extension

Web Data Scraper - no-code internet scraping. Extract and export to CSV, Excel, JSON, Google Sheets, and Webhook.

MCP server enabling agents to debug HTTP requests better (using powhttp)

Instagram user's photos and videos downloader. Download all media files from any username. Working 2022!

Simple library which helps you to retrieve the source of various video streaming sites.

Spin up Tor containers and then proxy HTTP requests via these Tor instances

📱 A utility for downloading Android apps from the Google Play Store and Xiaomi App Store (the Chinese App Store).

Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

Producthunt.com famous website scraper script. Scrap all offers and save in spreadsheet excel file.

An declarative and easy to use web crawler and scraper in C#

An API wrapper for Scrappey.com written in Python

A list of libraries, tools, and APIs for web scraping and data processing. Find everything you need for extracting, managing, and processing data from the web, from HTTP libraries to browser automation tools and proxy services.

Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt

This project was inspired by the unclecode/crawl4ai repository. It provided valuable insights and ideas that helped shape the development of Crewzombitx64.

Scrappey.js: A versatile JavaScript wrapper for Scrappey API

GPT4 Assisted Web Scraping Library

一个自适应Web Scraping框架，能处理从单个请求到大规模爬取的一切需求。 它的解析器能够从网站变化中学习，并在页面更新时自动重新定位您的元素。它的Fetcher能够开箱即用地绕过Cloudflare Turnstile等反机器人系统。它的Spider框架让您可以扩展到并发、多Session爬取，支持暂停/恢复和自动Proxy轮换——只需几行Python代码。一个库，零妥协。