Crawlab Team

Repositories

• crawlab

  Distributed web crawler admin platform for spiders management regardless of languages and frameworks.

  go redis crawler admin framework spider mongodb
  Go BSD-3-Clause 629 4,573 49 (1 issue needs help) 0 Updated Feb 23, 2020

• crawlab-sdk

  SDK for Crawlab, including SDK for different programming languages such as Python, Node.js and Java, and a CLI Tool written in Python.
  Python BSD-3-Clause 1 6 0 0 Updated Feb 21, 2020

• crawlab-docs

  Documentation for Crawlab

  documentation gitbook-cli crawlab
  JavaScript 3 4 0 0 Updated Feb 15, 2020

• artipub

  Article publishing platform that automatically distributes your articles to various media channels

  nodejs docker typescript mongodb article media csdn
  TypeScript BSD-3-Clause 233 1,633 30 (3 issues need help) 1 Updated Jan 16, 2020

• crawlab-guide

  Guide to safely crawl web pages instead of POP (Prison Oriented Programming)
  BSD-3-Clause 0 0 0 0 Updated Nov 27, 2019

• crawlab-plugins

  Plugins and extensions for Crawlab
  Go 1 2 0 0 Updated Nov 25, 2019