Create agents that monitor and act on your behalf. Your agents are standing by!

List of libraries, tools and APIs for web scraping and data processing.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

A cli tool to browse and play anime

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?

Web Scraper in Go, similar to BeautifulSoup

The web scraping open project repository aims to share knowledge and experiences about web scraping with Python

👻 Experimental library for scraping websites using OpenAI's GPT API.

Persistent HTTP cache for python requests

Creating Scrapy scrapers via the Django admin interface

LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping

🥫 The simple, fast, and modern web scraping library

Suck the InTernet

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

Powerful and flexible Instagram scraping library for Python, providing easy-to-use and expressive tools for accessing data programmatically

🗽 A Simple Demonstration of the New York Times App 📱 using Jsoup web crawler with MVVM Architecture 🔥

Take the hassle out of web scraping

Extract price and indicator data from TradingView charts to create ML datasets

This repository contains all the code I use in my YouTube tutorials.

a class that uses scraped proxies to make http GET/POST requests (Python requests)