Extract page URLs from robots.txt and sitemap.xml files for SEO audits, URL discovery crawl planning, and data pipelines.
1
Users / 7d
29
Runs / 30d
—
Rating
Updated 19 Sept 2026
Apify builder
@lnlenost
Leaderboard position
out of 6,392
New Actors / 7d
#3550
Total Actors
#4964
Active users / 7d
#3908
Total users
#5464
Runs / 30d
#4688
Total runs
#5032
Portfolio stats
New Actors / 7d
0
Total Actors
1
Active users / 7d
1
No change
Total users
2
Runs / 30d
29
No change
Total runs
74
Portfolio history
Daily publishing
0
Each bar represents one UTC day.
No new public Actors were detected during this 7-day window.
Actor portfolio
1 matching of 1 Actors · page 1 of 1
Extract page URLs from robots.txt and sitemap.xml files for SEO audits, URL discovery crawl planning, and data pipelines.
1
Users / 7d
29
Runs / 30d
—
Rating