Discoverability
Store classification
Categories
SEO_TOOLS
DEVELOPER_TOOLS
Store labels
No public values available.
Catalog ID NUj19Ac4elQCjEvLR
Public Apify Actor
technicaldost/robots-sitemap-extractor
Fetch and parse robots.txt and XML sitemaps for any domain. Extract allowed and disallowed paths, sitemap URLs and every listed page. Great for SEO audits and crawl planning. JSON output.
Active users / 30d
1
Total users
2
Runs / 30d
29
Total runs
63
Rating
—
No reviews
Bookmarks
0
Usage history
Latest captured Active users / 30d
1
0 since 17 Aug
30 of 30 UTC days captured
Latest captured Runs / 30d
29
0 since 17 Aug
30 of 30 UTC days captured
1
Users / 7d
Discoverability
Categories
Store labels
No public values available.
Monetization
Pay per event
2 charge events configured
Actor start
actor-start
Charged once per run
$0.001
Result
1
Users / 30d
1
Users / 90d
result
Charged per successful result
$0.005
Loading public Actor documentation
Reading the current public Store definition and reviews.
More from this builder
RSS Feed Scraper
25 active users · 2.8K runs / 30d
Shopee Product & Review Scraper — SG MY TH ID PH VN
9 active users · 43 runs / 30d
Douyin Scraper — Hot List, Video Detail, No Watermark 抖音
5 active users · 48 runs / 30d
XiaoHongShu (RedNote) Scraper — Notes, Search, Comments 小红书
4 active users · 38 runs / 30d