Scrapy, a fast high-level web crawling & scraping framework for Python.

Elegant Scraper and Crawler Framework for Golang

Pythonic HTML Parsing for Humans™

A scalable web crawler framework for Java.

Crawlee—A web scraping and browser automation library for Node.js that helps you build reliable crawlers. Fast.

Tabula is a tool for liberating data tables trapped inside PDF files

Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)

List of libraries, tools and APIs for web scraping and data processing.

Declarative web scraping

Distributed crawler powered by Headless Chrome

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Mechanize is a ruby library that makes automated web interaction easy.

Collection of useful data science topics along with articles, videos, and code

Up-to-date simple useragent faker with real world database

Do you want to LEARN NEW STUFF for FREE? Don't worry, with the power of web-scraping and automation, this script will find the necessary Udemy coupons & enroll you for PAID UDEMY COURSES, ABSOLUTELY FREE!

A browser testing and web crawling library for PHP and Symfony

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.

Getting started with Puppeteer and Chrome Headless for Web Scraping

Web Scraping Framework

A curated list of awesome puppeteer resources.