Discoverability
Store classification
Categories
AI
DEVELOPER_TOOLS
AUTOMATION
Store labels
No public values available.
Catalog ID AIhBoLb0hekfgfowc
Public Apify Actor
dravara/robots-peek
Enter one public domain to fetch its robots.txt. Get declared sitemap URLs, user-agent groups, and disallow rules as structured data; this does not determine legal permission to crawl.
Active users / 30d
1
Total users
2
Runs / 30d
25
Total runs
27
Rating
—
No reviews
Bookmarks
0
Usage history
Latest captured Active users / 30d
1
+1 since 21 Aug
26 of 30 UTC days captured
Latest captured Runs / 30d
25
+24 since 21 Aug
26 of 30 UTC days captured
1
Users / 7d
Discoverability
Categories
Store labels
No public values available.
Monetization
Pay per event
2 charge events configured
robots.txt read
robots-read
1
Users / 30d
1
Users / 90d
Fetch robots.txt for one public domain and return sitemap URLs and disallows. Read the default dataset. Set maxTotalChargeUsd above $0.03.
$0.02
Actor Start
apify-actor-start
Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).
$0.00005
Loading public Actor documentation
Reading the current public Store definition and reviews.
More from this builder