List of libraries, tools and APIs for web scraping and data processing.

a reliable high-level web crawling & scraping framework for Node.js.

Lightweight web scraping toolkit for documents and structured data.

👋 HOLA 👋 HOLA 👋 HOLA ! ENJOY OUR GOOGLE MAPS SCRAPER 🚀 TO EFFORTLESSLY EXTRACT DATA SUCH AS NAMES, ADDRESSES, PHONE NUMBERS, WEBSITES, AND RATINGS FROM GOOGLE MAPS WITH EASE! 🤖

Pythonic HTML Parsing for Humans™

✨ Bose is a a feature-rich Python framework for Web Scraping and Bot Development. 🤖

👋 HOLA 👋 HOLA 👋 HOLA ! ENJOY OUR OUTLOOK ACCOUNT GENERATOR BOT 🤖 TO CREATE 💯 OF OUTLOOK ACCOUNTS

Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis

Serritor is an open source web crawler framework built upon Selenium and written in Java. It can be used to crawl dynamic web pages that require JavaScript to render data.

ProxyCrawl PHP library for scraping and crawling websites

A simple, easy to use, scalable scraping framework written in PHP

Web scraping API to outsource tons of GET & xpath to cloud computing

🚀 THIS G2 PYTHON SCRAPER ALLOWS YOU TO SCRAPE PRODUCT INFORMATION FROM G2 🤖

An API wrapper for Scrappey.com written in Python (cloudflare bypass & solver)

An API wrapper for Scrappey.com written in Node.js (cloudflare bypass & solver)

🚀 OFFICIAL STARTER TEMPLATE FOR BOSE SCRAPING FRAMEWORK 🤖

🚀 FINAL CODE FOR TUTORIAL ON HOW TO SOLVE CAPTCHA IN SELENIUM USING 2CAPTCHA 🤖

✨ NodeJs crawling & scraping framework heavily inspired by Scrapy

🚀 OMKAR TEMP MAIL HELPS YOU USE TEMPORARY EMAILS. 🤖

M.A. Thesis work, news scraping framework/pipeline using python, beautifulsoup, newspaper3k, flask and mongodb with a custom api.