DevilScrapes

Query any CKAN open-data portal's Action API -- data.gov.uk, open.canada.ca, data.gov, the EU portal, and national/city catalogues. Give us a portal URL plus package_search, package_show, or organization_list and we page results, retry on throttling, and skip not-found errors so the run keeps going.

Search ClinicalTrials.gov and export structured trial records — NCT ID, title, phase, status, sponsor, conditions, interventions, enrollment, locations, and start/completion dates — as clean JSON, CSV or Excel.

Scrape Clutch.co B2B agency and vendor directory listings by category (and optional location) into clean leads — name, rating, verification tier, employee/rate/min-project bands, phone, and a per-agency service-mix breakdown other Clutch scrapers skip.

Bulk-export US Medicare-certified healthcare facilities — nursing homes, hospitals, home health agencies, hospices — from the official CMS Provider Data Catalog. Filter by state or city; quality and star-rating columns included. No login, no API key.

Pull CoinMarketCap's ranked cryptocurrency listing — rank, price, market cap, volume, tags, and supply metrics — for the top coins in one run, sorted and filtered your way. We handle retries and proxy routing so the data lands. Keyless, no API key needed.

Search Coursera and export every course, specialization, and professional certificate result into clean dataset rows — partner university, star rating, review count, difficulty, duration, skills gained, and access tags. Devil Scrapes handles the fetching so your dataset stays clean.

Search 240,000+ U.S. court opinions on CourtListener's free, keyless full-text API and export clean, paginated case-law rows — case name, court, filing date, citations, cite count, and a direct opinion URL. No API key, no PACER account, no docket-reseller subscription.

Export US Consumer Product Safety Commission (CPSC) recall records via the public, keyless SaferProducts.gov REST service — products, hazards, remedies, retailers, injuries and images — as clean flattened JSON rows for any bounded date window.

Scrape Craigslist listings across many US metro areas and categories in one run. Get titles, prices, locations, images, posted/updated dates, structured attributes, descriptions, and public reply links -- normalized into one clean dataset instead of one run per city.

Search Crossref's 150M+ DOI registry by bibliographic query and metadata filters, and export title, publisher, journal, full author list with ORCID and affiliation, citation counts, funder/award data, license, ISSN, and abstract as clean JSON, CSV, or Excel.

Enumerate subdomains and audit certificate hygiene via crt.sh's public Certificate Transparency log — no API key. Get one row per certificate or unique subdomain with computed expiry, wildcard, and freshness signals, capped so a popular domain never blows your bill.

Look up Czech companies in the official ARES registry by IČO or free-text business name — identity, registered address, NACE activity codes, and active registry sub-sources, as clean, flattened JSON/CSV/Excel rows for KYC, AML, and B2B lead-gen workflows.

Pull articles from DEV.to by tag, author, or feed via the official dev.to v1 API — title, body (Markdown), author, tags, reading time, reactions, comment count, publish timestamp — export to JSON or CSV. Free, no key needed for read access.

Bulk DNS record lookup for any list of domains. Resolves A, AAAA, MX, TXT, NS, CNAME, SOA and CAA records via Cloudflare and Google DNS-over-HTTPS, with automatic fallback between resolvers. One clean row per domain, ready for portfolio monitoring or DNS change detection.

Give us repository names or a search term; we page through Docker Hub's public API, retry on rate limits, and return typed rows per image tag -- digest, size, architectures, and freshness. No auth token needed.

Bulk domain WHOIS lookup over the IETF RDAP network — no API key required. Feed a list of domains and get registrar, registration/expiration dates, name servers, and status codes as structured rows. We resolve each domain to the correct registry via the IANA RDAP bootstrap file, paced and retried.

Search eBay's live active listings by keyword. Get title, price, condition, buying format, item URL, and thumbnail per card. Filter by category, condition, price range, and buying format. We handle the warm-up cookies and retries so you get clean rows every run.

Pull official European Central Bank euro reference exchange rates from the ECB free, keyless SDMX Data API — daily, monthly, quarterly, or annual rates for any currency the ECB publishes, flattened into clean one-row-per-observation records. No API key, no subscription.

Extract currently-in-force US federal regulations from the Electronic Code of Federal Regulations (eCFR). Give it Title/Part pairs and get one row per section with citation, heading and full body text as clean JSON.

Search EPA ECHO's Clean Water Act facility registry by US state and export flat rows — name, address, registry/source IDs, county, EPA region, permit status. Keyless federal API. Built for ESG analysts, environmental compliance teams and site-diligence buyers.

EU CORDIS API scraper for Horizon Europe and Horizon 2020 grant projects. Exports funding amounts, coordinator, participants, programme, dates, and objectives as structured JSON. Four input modes, 20 fields per row.

Export EU TED (Tenders Electronic Daily) public procurement notices as flat, buyer-ready rows: buyer, title, CPV code, estimated value, deadline, and winner info. Keyless EU API — filter by CPV code, buyer country, notice type, and publication date.

Scrape live Fashionphile.com luxury handbag inventory by brand or keyword search — price, condition, SKU, images, and retail savings per row, sourced directly from Fashionphile's own Algolia search backend. No per-item HTTP calls, no HTML parsing, fully-resolved records in one pass.

Export openFDA 510(k) premarket device clearance records — applicant, device name, decision date and code, product code, advisory committee, device class and regulation number — filterable by applicant, device, product code, committee, class or decision-date range, as clean JSON, CSV or Excel.