Crawler Bros

Scrape Dailymotion - search videos by keyword, browse trending videos, get videos from a specific user/channel, or browse by topic. Extracts title, views, likes, duration, thumbnail, tags, owner info, and more.

Scrape City of Dallas building permit records from the official Dallas Open Data portal (dallasopendata.com). Filter by permit type, land use, ZIP code, issued-date range, contractor, work description, and permit value/area. Lookup exact permits by permit number. No auth, no proxy required.

Scrape dangdang.com - Chinese books e-commerce. Search by keyword, browse book categories, or fetch product details. Emits title, author, publisher, prices, discount, rating, review count and cover images.

Scrape the Data.gov catalog (catalog.data.gov). Search 300,000+ open government datasets by keyword, organization, and format. Fetch dataset details or list organizations. No API key required.

Scrape DataCamp's full content catalog - 750+ courses, 30+ career tracks, and 250+ hands-on projects. Filter by topic, technology, and skill level across Data Science, Python, ML, SQL, and more.

Scrape the French government open-data portal (data.gouv.fr). Search datasets by keyword, fetch full dataset details by ID/slug, list datasets by organization, and search organizations and reuses - with titles, descriptions, resources/formats, licenses, temporal coverage and metrics.

Scrape debenhams.com, the UK department store retailer. Search by keyword, browse any department, filter by brand/gender/price/discount, or fetch specific product URLs. Returns pricing, sale price, sizes, colours, images, ratings, descriptions.

Scrape Decathlon US (decathlon.com) sporting-goods catalog. Search by keyword, browse any of 200+ categories, or fetch specific products by handle/URL. Get pricing, discounts, stock, brand, images, colors, sizes and full descriptions.

Scrape delish.com for popular recipes.

Scrape DesignCrowd.com - the crowdsourced design platform. Browse designer profiles by category and country. Extracts designer name, rating, country, earnings rank, portfolio image, and profile URL.

Scrape Telefoonboek.nl, the Netherlands' official business and phone directory. Search by trade/category and city, or fetch business detail pages directly. Get name, address, phone, category, rating, opening hours, website and more - no login required.

Scrape Dev.to, the popular blogging platform for developers (forem.com). Search by tag, by username, fetch by article ID, list latest / top / featured articles. Pulls title, body markdown, tags, reactions, comments, reading time, author, organization. HTTP-only via the public dev.to/api.

Scrape Dezeen - world's most visited architecture and design magazine. Search articles, browse by category (Architecture, Interiors, Design, Technology, Furniture, Lighting), or fetch the latest articles.

Scrape DHgate - China's wholesale & B2C marketplace. Search products, browse categories and seller shops, or fetch product pages with full details: prices, MOQ, seller ratings, sales counts, specs, images, variants and shipping info.

Scrape Discogs, the world's largest music database and marketplace. Search releases, masters, artists, and labels; pull full discographies; resolve marketplace listings and price stats. HTTP-only via the official Discogs API.

Scrape Distiller (distiller.com) for spirits data. Search for whisky, bourbon, gin, rum, vodka, tequila, and more. Get Distiller scores, community ratings, ABV, tasting notes, flavor profiles, price history, and detailed metadata.

Scrape the Directory of Open Access Journals (DOAJ) - 20K+ peer-reviewed open access journals and 10M+ articles. Search journals/articles by keyword or subject, filter by language, or look up by ISSN or DOAJ article ID.

Scrape the Directory of Open Access Journals (DOAJ), 20K+ peer-reviewed open access journals and 10M+ articles. Search journals by subject/country, search articles by keyword, or look up by ISSN or DOI.

Scrape Docker Hub, container image search, pull counts, star counts, publisher and verified-publisher data, tags, architectures, OS support, categories, and user/org profiles. Pure HTTP, no auth required

Scrape the U.S. Department of Energy's OSTI.GOV public research repository - search millions of DOE-funded technical reports, journal articles, conference papers, patents, theses, and datasets by keyword, author, national lab, subject, or date range, or fetch a single record by OSTI ID.

Scrape DogTrekker.com's directory of 9,600+ dog-friendly hotels, restaurants, parks, beaches, wineries, and services across California and Nevada. Search by keyword, browse by category/region/state/city, or fetch a specific listing by ID.

Search U.S. Department of Labor (EBSA) Form 5500 retirement & employee benefit plan disclosure filings by sponsor name, EIN, state, plan year, or plan type. Free, public, no login required.

Scrape Dongchedi (dongchedi.com) - ByteDance's auto platform. Hot cars by category, recent new-car launches with prices and images, car-name lookup, and hot-brand directory - all parsed from the public homepage. No login required.

Scrape Dotfyle (dotfyle.com) - a directory of 2,500+ Neovim plugins. Browse trending/popular/new plugins, search by keyword, filter by category/tag, and look up a specific plugin by owner/repo. Returns name, author, GitHub URL, description, stars, category, last-synced date.