Awesome Web Scraping

The list of tools, programming libraries and web services used in web scraping and data processing.

Web scraping chats: @grablab (English) and @grablab_ru (Russian)

Programming Libraries

• Python
• PHP
• Ruby
• JavaScript
• Go

Other Things

• Web Scraping Services
• Console tools
• dhamaniasad / HeadlessBrowsers - a list of (almost) all headless web browsers in existence
• DNS over HTTPS providers - list of DNS over HTTPs providers

Captcha Solving Services

These two links point to same captcha service, it is just a different language versions

• 2captcha.com - English UI language
• rucaptcha.com - Russian UI language

Contributing

See Contributing document.

Credits

The list is based initially on some data from these sources awesome-python, awesome-php, awesome-ruby, ruby-nlp, awesome-javascript