Robots.txt Disallowed in Chrome with OffiDocs
Ad
DESCRIPTION
See if a URL is allowed or disallowed in robots.
txt for a specific user-agent token.
If the URL is disallowed, it will not be crawled by the crawler with the matching user-agent token.
Additional Information:
- Offered by XYZing
- Average rating : 0 stars (hated it)
- Developer This email address is being protected from spambots. You need JavaScript enabled to view it.
Robots.txt Disallowed web extension integrated with the OffiDocs Chromium online
