Robots.txt Disallowed in Chrome with OffiDocs
Robots.txt Disallowed Chrome web store extension
DESCRIPTION:
Run the Chrome online web store extension Robots.txt Disallowed using OffiDocs Chromium online.
See if a URL is allowed or disallowed in robots.txt for a specific user-agent token.
If the URL is disallowed, it will not be crawled by the crawler with the matching user-agent token.
Additional Information:
- Offered by XYZing
- Average rating : 0 stars (hated it)
- Developer This email address is being protected from spambots. You need JavaScript enabled to view it.
Robots.txt Disallowed web extension integrated with the OffiDocs Chromium online