Discoverability
Store classification
Categories
DEVELOPER_TOOLS
Store labels
No public values available.
Catalog ID nldCjwKWAyhPjeh2p
Public Apify Actor
perryay/robots-txt-sitemap-analyzer
Fetch, parse, and analyze robots.txt and sitemap.xml for any domain. Extract crawl directives, test URL compliance against robots.txt rules, and discover all URLs from sitemaps including nested sitemap indexes. Supports batch analysis with structured JSON output.
Active users / 30d
1
Total users
2
Runs / 30d
31
Total runs
61
Rating
—
No reviews
Bookmarks
0
Usage history
Latest captured Active users / 30d
1
0 since 17 Aug
30 of 30 UTC days captured
Latest captured Runs / 30d
31
+5 since 17 Aug
30 of 30 UTC days captured
0
Users / 7d
Discoverability
Categories
Store labels
No public values available.
Monetization
Pay per event
4 charge events configured
Actor Start
apify-actor-start
Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).
$0.005
Robots.txt Analysis
robots-analysis
Per domain robots.txt analysis
1
Users / 30d
1
Users / 90d
$0.01
Sitemap Extract
sitemap-extract
Per domain sitemap extraction
$0.01
Batch Analyze
batch-analyze
Batch mode surcharge
$0.005
Loading public Actor documentation
Reading the current public Store definition and reviews.
More from this builder
Image Metadata Analyzer & Privacy Stripper
16 active users · 97 runs / 30d
Website Performance Auditor — Lighthouse & PageSpeed
9 active users · 41 runs / 30d
YouTube Video Info Extractor — Metadata & Captions API
5 active users · 36 runs / 30d
Mock Data Generator — Realistic test data
2 active users · 30 runs / 30d