Focused crawls are collections of frequently-updated webcrawl data from narrow (as opposed to broad or wide) web crawls, often focused on a single domain or subdomain.
Since the server already hosts cpanel I want to provide its own subdomain cert &key and let errbit serve itself over HTTPS on some non-conventional port. I didn't find a way to specify that in environment config, tough.
I propose to add an entrypoint script that checks for a SERVE_HTTPS=1 and runs the appropriate
Is your feature request related to a problem? Please describe.
The .. module has a conditional dependency on the parseurl library. This library is not an agent dependency. However, if parseurl is present then the agent will use it instead of it's own home grown URL parsing.
I saw this: https://github.com/errbit/errbit/blob/master/docs/deployment.md
Since the server already hosts cpanel I want to provide its own subdomain cert &key and let errbit serve itself over HTTPS on some non-conventional port. I didn't find a way to specify that in environment config, tough.
I propose to add an entrypoint script that checks for a
SERVE_HTTPS=1and runs the appropriate