Crawler Bros

Scrape the WHO ICTRP clinical trials search portal, aggregating 22+ national registries (ClinicalTrials.gov, EU-CTR/CTIS, ISRCTN, ChiCTR, ANZCTR, CTRI and more). Search by condition, intervention, sponsor, status or trial ID; get full trial metadata.

Scrape Workable job boards - search 50,000+ remote and on-site jobs globally, or scrape specific company boards by slug. Extracts title, department, location, description, employment type, workplace type, requirements, benefits, and application URL.

Scrape Xueqiu (xueqiu.com) - China's largest investor community. Hot stocks, real-time quotes + K-line history via the v5 API, and stock/discussion search - after a browser warm-up that clears Xueqiu's JS challenge. No login required.

Search zefix.ch - the Swiss Central Business Names Index (Zentraler Firmenindex). Find companies by name, UID/CHE number, or FCRO-ID, and get legal form, registered address, canton, status, SOGC/SHAB publication history, auditors, branches, and merger history.

Scrape Zillow market data for cities, ZIP codes, and states. Returns median listing price, days on market, inventory, price cuts, sale-to-list ratio, and historical trend arrays.

Scrape DBA.dk - Denmark's largest online marketplace for used and new items. Search by keyword, browse by category, search cars, or fetch full listing details by item ID/URL. Get prices, images, condition, location, seller type and more - no login required.

Scrape Hacker News - search stories and comments, fetch top/new/best stories, get user profiles and submission history. Uses the official Algolia HN Search API and Hacker News Firebase API.

Scrape Royal Road - the leading platform for serialized web fiction (progression fantasy, LitRPG, GameLit). Browse curated lists, search by genre/tag/status, fetch full fiction details with chapter lists, or list an author's fictions. No login required.

Scrape StorageTreasures.com self-storage unit auctions - browse active or upcoming lien/charity/manager-special auctions nationwide, filter by state, city, zip, category, unit size or keyword, look up specific auctions or facilities by ID, and track in-person live auction events.

Extract job postings from ZipRecruiter.com including title, company, location, salary range, city, state, and apply URL. Walks paginated search results without proxy or login.

Scrape classified listings from Kleinanzeigen.de (formerly eBay Kleinanzeigen). Extract listing details including title, price, description, location, seller info, images, and category-specific attributes.

Extract tweets from Twitter/X based on keywords. Scrapes tweet text, usernames, engagement metrics, media, and timestamps for multiple search terms.

Search 2GIS business directory across 11 country domains (RU, KZ, UAE, UZ, BY, AM, AZ, GE, TJ, KG, .com). Extract place name, address, postcode, structured address, rating, category, reviews, photos, contacts, working hours, and social links via the Catalog API.

Scrape ESPN news articles and headlines across 16 leagues and 5 sports. Optional team filter. No account or proxy required.

Scrape hotels, restaurants, attractions, and vacation rentals from TripAdvisor. Search by keyword or provide direct URLs. Extract names, ratings, rankings, addresses, contact info, prices, and more. No login required.

Scrape hotel listings from Expedia search results. Extract hotel names, prices, ratings, reviews, neighborhoods, descriptions and images for any destination and travel dates.

Scrape live matches from FlashScore for football, basketball, tennis, hockey, baseball and 11 other sports. Returns match ID, teams, live score, status, league, start time and optional event timeline.

Scrape Flickr public photo search results - extract photo metadata including title, owner, tags, views, and image URLs. No API key required.

Extract posts from Instagram hashtags with complete metadata including engagement metrics, captions, media info, and author details. Features smart pagination, anti-block strategies, and multiple scraping approaches.

Creates an oriented graph visualizing links between webpages. Outputs: graph.png (visual network diagram) and graph.json (structured data) saved to Key-Value Store, plus detailed dataset of all crawled pages. Configure depth, boundaries, and layout.

Find alumni from any university or school on LinkedIn. Enter a school name or LinkedIn school URL to get alumni profiles with name, headline, current company, location, and more.

Scrape job listings from Glassdoor by keyword, location, or company URL. Extracts job title, company, salary estimates, location, skills, and more.

Extract used car listings from mobile.de with make, model, price, mileage, year, fuel, transmission, dealer info, and photos.

Extract classified ads from leboncoin.fr with title, price, location, images, attributes, owner type. Supports all categories (real estate, vehicles, jobs, services, etc.) with filter URL pass-through.