website-scraper

Download website to local directory (including all css, images, js, etc.)

Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.

A new web development methodology for JavaScript & C# developers. A super fast and very easy to use CMS.

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

Plugin for website-scraper which returns html for dynamic websites using puppeteer

A server to collect & archive websites that also supports video downloads

Plugin for website-scraper which returns html for dynamic websites using PhantomJS.

🕸 Generates and delivers RSS feeds via HTTP. Docker image available! Create your own feeds or get started quickly with the included configs.

Wayback Machine Downloader. 🔥 Download your entire archived websites from the Internet Archive Wayback Machine.

Evaluate JavaScript on a URL through headless Chrome browser.

A spider to crawl webpages

JSON collection of scraped file extensions, along with their description and type, from FileInfo.com

Now you can keep track of your followers from YouTube, Instagram and Twitter accounts - Followers scraper API on AWS serverless

Website Penetration Testing Tool With Dos Attack Feature

sᴇᴀʀᴄʜ ᴇɴɢɪɴᴇ sᴄʀᴀᴘᴇʀ ᴛᴏᴏʟ (ʙᴀsʜ)

Scraping websites made easy! A minimalistic yet powerful tool for collecting data from websites.

Bandwidth efficient scheduled downloads

Download ALL the images (JPEG/GIF/PNG) from any Tumblr website! This project employs Python3 and BeautifulSoup4 to scrape a Tumblr site (with the url provided by the user) to download, page by page, all the images from the Tumblr site's posts. Ideal for archiving other peoples' Tumblrs <3

This is a python based website crawling script equipped with Random time intervals, User Agent switching and IP rotation through proxy server capabilities to trick the website robot and avoid getting blocked.

Alexa Bulk Website Rank Checker PHP Script 2020 Latest! you can grab 200+ URL's website ranking at once!