-
Notifications
You must be signed in to change notification settings - Fork 82
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Limit Hosts crawled #37
Comments
You may add url_match_rule for url_filter in gopa.yml |
Thank you for your response. Once I have added this to the yml file and stop and start the server, the crawl continues to crawl the other hosts. Do I need to do something else to get the existing crawl to stop. Thanks, Michael |
host_match_rule: I put it as array format and it works |
I running a crawl on my companies intranet. Is there a way to limit what hosts it crawls. It seems to be crawling every connection on our intranet.
The text was updated successfully, but these errors were encountered: