Discoverability
Store classification
Categories
SEO_TOOLS
DEVELOPER_TOOLS
Store labels
No public values available.
Catalog ID MQI0FbwgqF5ulWlLe
Public Apify Actor
davidbenittah/ai-crawler-robots-audit
Check robots.txt and llms.txt on up to 50 sites and see which AI crawlers are blocked: OAI-SearchBot, ChatGPT-User, PerplexityBot, Claude-SearchBot, GPTBot and ClaudeBot. Returns a 0-100 AI search access score, the rule matched per bot, and a paste-ready robots.txt fix.
Active users / 30d
3
Total users
3
Runs / 30d
31
Total runs
95
Rating
—
No reviews
Bookmarks
0
Usage history
Latest captured Active users / 30d
3
+1 since 17 Aug
30 of 30 UTC days captured
Latest captured Runs / 30d
31
0 since 17 Aug
30 of 30 UTC days captured
0
Users / 7d
Discoverability
Categories
Store labels
No public values available.
Monetization
Pay per event
2 charge events configured
Actor Start
apify-actor-start
Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).
$0.005
Website audited
3
Users / 30d
3
Users / 90d
apify-default-dataset-item
One website checked.
$0.008
Loading public Actor documentation
Reading the current public Store definition and reviews.
More from this builder
Pige Immobiliere: French Real Estate CRM Leads
2 active users · 33 runs / 30d
ATS Job Scraper: Greenhouse Jobs, Lever Jobs & Ashby Jobs
2 active users · 43 runs / 30d
Instagram Competitor Analysis & Content Report
1 active users · 32 runs / 30d
Career Page Jobs Scraper & ATS Hiring Monitor
1 active users · 65 runs / 30d