Crawler Gang

Scrapes Go package metadata from pkg.go.dev and Go module proxy. Search packages by query or fetch specific modules by path.

Scrape GOG.com game catalog with search by title, browse by genre, or fetch specific games by ID. Gets prices, ratings, developers, screenshots, platforms and more from the public GOG catalog API. No auth, no proxy

Scrape federal grant opportunities from Grants.gov - search by keyword, agency, status, or category. Returns full opportunity metadata: award amounts, deadlines, agency, CFDA numbers, eligibility, and synopsis. Uses the public Grants.gov v1 search API. No login required.

Scrape Grafana Plugin Catalog - search 300+ plugins by name/type or fetch specific plugin details. Returns metadata including downloads, author, version, signature status, keywords, and links.

Scrape job listings from Greenhouse.io company boards. Get all jobs from one or more companies, or fetch specific job details by ID - with location, departments, salary, and apply links.

Scrapes Haskell package metadata from Hackage (hackage.haskell.org). Search packages by query, or fetch specific packages by name.

Scrape the Hacker News job board - the famous 'Who is Hiring' startup job posts on news.ycombinator.com. Fetches live job listings posted by startups and tech companies via the official HN Firebase API. No authentication required.

Scrape hardlyeverwornit.com - a UK-based luxury pre-owned fashion marketplace. Search by keyword, browse by category or brand. Returns title, brand, price, condition, size, color, images, and listing URL.

Scrape Singapore HDB resale flat transaction data from the official data.gov.sg open API. Filter by town, flat type, price range, floor area, and date range. No auth, no proxy required.

Scrape Hex.pm - the package manager for Erlang/Elixir. Search packages or fetch by name. Returns downloads, versions, owners, licenses, and repository links.

Scrape the Hodinkee Shop - curated luxury and limited-edition watches. Browse collections, search by brand, and fetch full product details including price, availability, images, and watch specifications.

Scrape the Home Assistant integrations catalog - 1,400+ smart home integrations. Search by keyword, browse by category/IoT class, or fetch specific integrations by domain name.

Scrape Homebrew formulae and casks - search by name/description or fetch specific packages with install analytics and metadata.

Scrape horseracingnation.com - horse racing news, race cards, horse profiles, and upcoming race listings covering major stakes races including the Triple Crown.

Scrape Humble Bundle with browse current game, book, and software bundles; search the store; or fetch any bundle/product URL. Extracts tier prices, items, end dates, and partner details without any login.

Scrape NIH iCite - search PubMed biomedical publications, fetch by PubMed IDs, or browse by year. Returns citation counts, relative citation ratios, abstracts, DOIs, and full PubMed links.

Scrape ILO labour statistics (unemployment, employment, labour force participation) via the World Bank WDI API which publishes ILO Modelled Estimates. Supports 17+ indicators across 170+ countries with year-range filtering.

Scrape property listings from Imovirtual.com - Portugal's #1 real estate portal. Search for apartments, houses, land, garages, and commercial properties for rent or sale.

Scrape US import records and global supplier data from ImportYeti.com - search US importers and global suppliers by company name or product keyword.

Scrape iNaturalist - the world's largest nature observation platform with 200M+ wildlife sightings. Search observations by species name, browse taxa, filter by location and date, find common species in a region. Completely free, no API key required.

Searches and retrieves items from the Internet Archive (archive.org) - 44M+ books, videos, audio, software, and web archives. Free, no API key required.

Track upcoming and recent IPOs from stockanalysis.com - get IPO dates, offer prices, amounts raised, exchange listings, company details, and performance data for new stock offerings.

Scrape IQAir.com for real-time air quality data - city and country AQI rankings, PM2.5, PM10, ozone levels, and historical data. No API key required.

Scrape iSeeCars.com with 4M+ used and new car listings with price analysis. Extract title, price, VIN, mileage, condition, colors, engine, MPG, transmission, drivetrain, features, dealer info, price rating (Great/Good/Fair Deal), and savings vs market value.