Focused crawls are collections of frequently-updated webcrawl data from narrow (as opposed to broad or wide) web crawls, often focused on a single domain or subdomain.
Finds subdomains of a web server by querying Google's Certificate Transparency logs database (https://crt.sh).
At the moment the script reports all hostname-like identities where the input/target hostname is present somewhere in the identity. Specifically, the script does not verify that a returned identity is truly a subdomain of the target hostname.
As an example, one of the returned identities for google.com is google.com.gr. An even more egregious example is that www.google.com returns www.google.com-----------------r.reflectiz.com.
I am inclined to fix this but first I am soliciting feedback whether there are users that use the script to fish out domains that are not strictly subdomains. One possibility is to control the script behavior with a script argument.
The text was updated successfully, but these errors were encountered:
The original idea was subdomains but I do see value of discovering other domains, possibly malicious used for phishing. I think the best way would be to add an argument so we support both use cases.
Ps. Thanks for updating the script! We are currently down to only 1 hostmap script, hostmap-robtex is still broken!
The script is described as
At the moment the script reports all hostname-like identities where the input/target hostname is present somewhere in the identity. Specifically, the script does not verify that a returned identity is truly a subdomain of the target hostname.
As an example, one of the returned identities for
google.comisgoogle.com.gr. An even more egregious example is thatwww.google.comreturnswww.google.com-----------------r.reflectiz.com.I am inclined to fix this but first I am soliciting feedback whether there are users that use the script to fish out domains that are not strictly subdomains. One possibility is to control the script behavior with a script argument.
The text was updated successfully, but these errors were encountered: