The Wayback Machine - https://web.archive.org/web/20220606082115/https://github.com/topics/scrape
Here are
371 public repositories
matching this topic...
An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
Updated
May 19, 2022
Python
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
Updated
Feb 3, 2021
Python
A Python module to bypass Cloudflare's anti-bot page.
Updated
Dec 21, 2021
Python
scrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot
Updated
Apr 11, 2022
Python
Get unified metadata from websites using Open Graph, Microdata, RDFa, Twitter Cards, JSON-LD, HTML, and more.
Updated
May 31, 2022
HTML
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers, user info, images...
Updated
May 13, 2022
Python
Scrape Instagram's API with Puppeteer
Updated
May 18, 2022
TypeScript
Scrape any website, article or RSS/Atom Feed with ease!
Updated
Jul 25, 2020
Elixir
Scrape domain names from SSL certificates of arbitrary hosts
Google/Bing Images Web Downloader
Updated
Jan 17, 2021
Python
Python library for retrieving free proxies (HTTP, HTTPS, SOCKS4, SOCKS5).
Updated
Sep 22, 2021
Python
Node.js package to bypass CloudFlare's anti-bot JavaScript challenges
Updated
Feb 6, 2022
JavaScript
A instagram scraper wrote in python. Similar to instagram-php-scraper.Usages are in example.py. Enjoy it!
Updated
Jun 1, 2021
Python
Simply scrape / download all the media from an fansly account
Updated
May 12, 2022
Python
Advanced python library to scrap Twitter (tweets, users) from unofficial API, fully covered by integration tests
Updated
Oct 26, 2021
Python
A webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)
Updated
May 10, 2022
JavaScript
scrape google search results
Golang pkg to quickly return a preview of a webpage (title/description/images)
Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.
Updated
Jun 1, 2022
Python
🕷️ The PHP SERP Spider - A search engine scraper
API to get enormous amount of high resolution satellite images from satellites.pro quickly through multi-threading! create map your own map dataset. Bringing data to Humans.
Updated
May 1, 2022
Python
📰 Build RSS 2.0 feeds from websites (and JSON APIs) with a few CSS selectors.
Updated
May 19, 2022
Ruby
A fast and easy to use library for html parsing & node selecting & node mutation, suitable for web scraping and html confusion.
Updated
Apr 26, 2022
Rust
Shopee Scrape is a tool that functions to collect data - the data needed, such as finding data from photos, prices, names, store locations and others.
A lightning fast package to scrape YouTube search results. This was made and optimized for Discord Bots.
Updated
May 4, 2022
JavaScript
A sports data scraping and analysis tool
Updated
Jul 12, 2019
Python
[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library
MetroLyrics API for Python
Updated
Oct 13, 2021
Python
A standalone package to scrape financial data from listed Vietnamese companies via Vietstock
Updated
Sep 27, 2021
Python
Improve this page
Add a description, image, and links to the
scrape
topic page so that developers can more easily learn about it.
Curate this topic
Add this topic to your repo
To associate your repository with the
scrape
topic, visit your repo's landing page and select "manage topics."
Learn more
You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session.
You signed out in another tab or window. Reload to refresh your session.
It seems the scrapper doesn't work at all anymore to retrieve experiences for linkedIn profiles.