Discoverability
Store classification
Categories
SEO_TOOLS
DEVELOPER_TOOLS
BUSINESS
Store labels
No public values available.
Catalog ID gbcMks1dajKqSIDyP
Public Apify Actor
bgfc97/robots-txt-sitemap-analyzer
Fetch and parse robots.txt for many domains: user-agent groups, allow/disallow rules, crawl-delay, declared sitemaps and whether crawlers are blocked. Technical SEO auditing. No key.
Active users / 30d
1
Total users
2
Runs / 30d
29
Total runs
55
Rating
—
No reviews
Bookmarks
0
Usage history
Latest captured Active users / 30d
1
0 since 17 Aug
30 of 30 UTC days captured
Latest captured Runs / 30d
29
+4 since 17 Aug
30 of 30 UTC days captured
1
Users / 7d
Discoverability
Categories
Store labels
No public values available.
Monetization
Pay per event
1 charge event configured
Domain analyzed
domain-analyzed
Each domain's robots.txt fetched and parsed
$0.005
1
Users / 30d
1
Users / 90d
Loading public Actor documentation
Reading the current public Store definition and reviews.
More from this builder