Create agents that monitor and act on your behalf. Your agents are standing by!
#
webscraping
Repositories 1,124
Web Scraper in Go, similar to BeautifulSoup
Creating Scrapy scrapers via the Django admin interface
Python
Updated Feb 15, 2019
Take the hassle out of web scraping
Ruby
Updated Mar 28, 2019
a class that uses scraped proxies to make an http GET/POST request (Python requests)
python
requests-module
requests
proxy
proxy-server
proxy-list
webscraping
webscraper
webscraper-api
recursion-problem
recursion
http-getter
http-get
http
http-proxy
http-proxy-middleware
python3
python-requests
proxy-requests
Python
Updated Mar 26, 2019
Use SQL on various data sources
C#
Updated Mar 19, 2019
Open Source web scraping API. Falkor turns web pages into queryable JSON
Clojure
Updated Feb 12, 2016
A command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, …
xquery
xml
html
json
xpath
cli
command-line
http
web
rest
css-selector
wget
curl
httpie
xmlstarlet
webscraper
webscraping
scraper
datascraping
headless
Pascal
Updated Mar 30, 2019
An R web crawler and scraper
R
Updated Mar 26, 2019
bot
question-answering
python3
questions-and-answers
webcrawler
webscraping
hq-trivia
cashshow
hq
trivia
trivia-game
hq-trivia-bot
hq-bot
tesseract
hq-trivia-hack
Python
Updated Dec 28, 2018
Be nice on the web
R
Updated Dec 18, 2018
Scrapes g4g and creates PDF
An extensible API for breaking captchas
R
Updated Feb 8, 2019
A php crawler that finds emails on the internets
PHP
Updated Jan 24, 2019
Code for the second edition Web Scraping with Python book by Packt Publications
Python
Updated Jul 5, 2018
Go
Updated Jan 2, 2019
Web scraping using rvest, httr and Rselenium.
R
Updated Mar 13, 2019
Chemical Information from the Web
R
Updated Apr 1, 2019
Github stargazers information gathering tool
Python
Updated Mar 10, 2019
robots.txt file parsing and checking for R
R
Updated Jan 10, 2019
Plugin based RSS feed generator for sites that don't offer any. Serves RSS, Atom and JSON Feeds.
Go
Updated Sep 4, 2018
Let's you to access your FB account from the command line and returns various things number of unread notifications, …
Syllabus and example code for 7-week class at NYU/ITP
Python
Updated Mar 10, 2017
Documentation and example scripts for SeeShell Automation
test-automation
sample-app
webscraping
image-recognition
freeware
desktop-automation
sikuli
sikulix
uipath
screen-scraping
robotic-process-automation
rpa
gui-testing
ocr
computer-vision
Visual Basic
Updated Oct 11, 2018
State of the art object detection in real-time using YOLOV3 algorithm. Augmented with a process that allows easy trai…
video-recognition
image-recognition
yolov2
yolo
yolo2
tensorflow
darknet
deep-learning
convolutional-neural-networks
image-processing
machine-learning
real-time
object-detection
webscraping
webcam
google-image-search
yolov2-model
web-scraper
automatic
alerts
Python
Updated Feb 17, 2019
Predict stock price based on financial news feeds
Jupyter Notebook
Updated Apr 6, 2018
Change cover photo of all your songs automatically using python
Python
Updated Jan 7, 2019
News extraction and scraping. Article Parsing
HTML
Updated Nov 21, 2018
Web data extraction tool implemented as chrome extension