Discoverability
Store classification
Categories
No public values available.
Store labels
No public values available.
Catalog ID eljVGGgVp852aTmcD
Public Apify Actor
sbio-apps/robots-txt-auditor
Read robots.txt for supplied websites and export user-agent groups, allow/disallow rules, sitemap declarations, extension directives and parsing warnings. Identify missing files and compare content hashes in your crawl configuration workflows.
Active users / 30d
1
Total users
2
Runs / 30d
7
Total runs
11
Rating
—
No reviews
Bookmarks
0
Usage history
Latest captured Active users / 30d
1
0 since 8 Sept
8 of 30 UTC days captured
Latest captured Runs / 30d
7
+6 since 8 Sept
8 of 30 UTC days captured
1
Users / 7d
Discoverability
Categories
No public values available.
Store labels
No public values available.
Monetization
Pay per event
1 charge event configured
Completed check
robots-checked
One completed source check, including empty or unchanged results. See README for charged HTTP observations and free errors.
$0.005
Loading public Actor documentation
Reading the current public Store definition and reviews.
1
Users / 30d
1
Users / 90d
Sitemap Delta Monitor | New & Changed URLs
1 active users · 7 runs / 30d