Discoverability
Store classification
Categories
Store labels
No public values available.
Catalog ID XDFLVvke4Ay7oNwxB
Public Apify Actor
junipr/robots-txt-policy-auditor
Fetch and audit robots.txt files, parse crawl directives, test important paths, and report sitemap and policy risks.
Active users / 30d
1
Total users
2
Runs / 30d
28
Total runs
54
Rating
—
No reviews
Bookmarks
0
Usage history
Latest captured Active users / 30d
1
0 since 18 Aug
29 of 30 UTC days captured
Latest captured Runs / 30d
28
+27 since 18 Aug
29 of 30 UTC days captured
1
Users / 7d
Discoverability
Categories
Store labels
No public values available.
Monetization
Pay per event
5 charge events configured
Robots Txt Policy Auditor Actor Start
actor-start
Robots Txt Policy Auditor: charged when actor start is completed. The price includes Apify platform usage; no separate usage pass-through is intended.
$0.005
Robots Txt Policy Auditor Robots File Checked
1
Users / 30d
1
Users / 90d
robots-file-checked
Robots Txt Policy Auditor: charged when robots file checked is completed. The price includes Apify platform usage; no separate usage pass-through is intended.
$0.0049
Robots Txt Policy Auditor Rule Parsed
rule-parsed
Robots Txt Policy Auditor: charged when rule parsed is completed. The price includes Apify platform usage; no separate usage pass-through is intended.
$0.00372
Robots Txt Policy Auditor Finding Emitted
finding-emitted
Robots Txt Policy Auditor: charged when finding emitted is completed. The price includes Apify platform usage; no separate usage pass-through is intended.
$0.00372
Robots Txt Policy Auditor Audit Report Generated
audit-report-generated
Robots Txt Policy Auditor: charged when audit report generated is completed. The price includes Apify platform usage; no separate usage pass-through is intended.
$0.05
Loading public Actor documentation
Reading the current public Store definition and reviews.
More from this builder
Video Metadata & Format Inventory — URLs, Thumbnails & Tracks
4 active users · 39 runs / 30d
Earnings Call Scraper — Transcripts, Speakers & Q&A
4 active users · 278 runs / 30d
Email Validator & Verifier — MX, SMTP & Syntax
4 active users · 86 runs / 30d
B2B Lead Scraper — Company Emails, Phones & Tech Stack
3 active users · 34 runs / 30d