Discoverability
Store classification
Categories
SEO_TOOLS
DEVELOPER_TOOLS
Store labels
No public values available.
01
Tools & integrations
02
Core features
03
How it works
04
MCP server
05
Plans & pricing
06
Get started
07
The builder's digest
Catalog ID uALIX0HL55DhfPbvg
Public Apify Actor
automation-lab/robots-sitemap-analyzer
This actor fetches and parses robots.txt and sitemap.xml files for any list of websites. It extracts crawl directives (user-agent rules, allowed/disallowed paths, crawl-delay), discovers sitemap URLs, and counts the number of pages listed in each sitemap. Use it for SEO audits, competitive...
Active users / 30d
1
Total users
20
Runs / 30d
30
Total runs
453
Rating
—
No reviews
Bookmarks
0
Usage history
Latest captured Active users / 30d
1
0 since 2 Oct
30 of 30 UTC days captured
Latest captured Runs / 30d
30
0 since 2 Oct
30 of 30 UTC days captured
1
Users / 7d
Discoverability
Categories
Store labels
No public values available.
Monetization
Pay per event
2 charge events configured
Run started
start
One-time charge when the actor starts
$0.035
Site analyzed
1
Users / 30d
3
Users / 90d
site-analyzed
Charge per website analyzed
$0.00115
Loading public Actor documentation
Reading the current public Store definition and reviews.
More from this builder
Facebook Ads Library Scraper
2K active users · 151.9K runs / 30d
Est. monthly creator revenue
Reddit Scraper
1.5K active users · 197.6K runs / 30d
Est. monthly creator revenue
Trustpilot Reviews Scraper
1.1K active users · 39K runs / 30d
Est. monthly creator revenue
Threads Scraper
446 active users · 22.3K runs / 30d
Est. monthly creator revenue