Discoverability
Store classification
Categories
DEVELOPER_TOOLS
SEO_TOOLS
Store labels
No public values available.
Catalog ID d5hILdRBrIMUPO109
Public Apify Actor
lwsdjfls/crawlability-ai-access-auditor
AI crawler access audit and robots.txt checker for any domain: rules per crawler (GPTBot, ClaudeBot, CCBot, Google-Extended and 25 more), Content-Signal and Content-Usage, sitemaps with URL counts, llms.txt, meta robots on sample pages, TDM opt-out detection and the anti-bot service in front.
Active users / 30d
1
Total users
2
Runs / 30d
1
Total runs
6
Rating
—
No reviews
Bookmarks
0
Usage history
Latest captured Active users / 30d
1
1 of 30 UTC days captured
Trend baseline is forming
The first observation was captured on 19 Sept. Daily bars and change arrows appear after the next UTC catalog snapshot.
Latest captured Runs / 30d
1
1 of 30 UTC days captured
Trend baseline is forming
The first observation was captured on 19 Sept. Daily bars and change arrows appear after the next UTC catalog snapshot.
1
Users / 7d
Discoverability
Categories
Store labels
No public values available.
Monetization
Pay per event
2 charge events configured
Actor Start
apify-actor-start
Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).
$0.00005
Domain audited
1
Users / 30d
1
Users / 90d
domain-audited
One domain audited: robots.txt per crawler (AI crawlers included), Content-Signal and Content-Usage rules, sitemaps with URL counts and dates, llms.txt, meta robots and X-Robots-Tag on a sample of pages, TDM reservation signals in headers, metadata, tdmrep.json and terms pages, and the bot-management service in front of the site. A domain that does not answer at all is free.
$0.02
Loading public Actor documentation
Reading the current public Store definition and reviews.
More from this builder
VIES VAT Validator – Bulk EU VAT Number Check
1 active users · 1 runs / 30d
ECHA REACH Lookup – SVHC, Annex XIV & XVII Status
1 active users · 1 runs / 30d
EU Company ID Resolver – VAT, KVK, KBO & LEI
1 active users · 1 runs / 30d
Benelux Insolvency Radar – NL & BE Bankruptcies
1 active users · 1 runs / 30d