Crawler Bros

Extract posts from Instagram keyword search results. Scrape post URLs, captions, usernames, media URLs, hashtags, engagement metrics, and more. Supports multiple keywords with anti-detection features.

Extract transcripts from Instagram videos and reels using auto-generated captions or AI-powered speech-to-text. Returns clean, timestamped transcript segments with full video metadata.

Extract job postings from ZipRecruiter.com with FULL job descriptions. Returns title, company, location, salary, skills, and the full job description body per listing. Walks paginated search results.

Scrape Instagram followers and following lists. Extract username, display name, verification status, privacy flag, and profile picture for every account. Supports followers, following, or both modes across multiple profiles with configurable limits.

Scrape public job listings from Wellfound.com. Extracts job ID, title, compensation, remote status, location, company name, company logo. HTTP-only, no login.

Scrape Google News in real-time. Supports keyword search, date filters, full-text article extraction, and image extraction.

Scrape product listings from Etsy search results, categories, shops, and product pages. Extract prices, ratings, reviews, seller info, badges, and product details.

Scrape LinkedIn public profiles without login. Get name, headline, experience, education, followers, and recent articles.

Scrape Reddit Comments from a post on Reddit. Provides comment text, the parent of the thread, score and timestamps.

Given a company name, return the company's official website domain and its social media links (LinkedIn, X/Twitter, Facebook, Instagram, YouTube, TikTok, GitHub).

Scrape TikTok posts by URL and extract comprehensive video metadata including engagement stats, author information, music details, and hashtags.

Scrape the official MLB Stats API, comprehensive baseball data including teams, players, schedules, standings, and detailed statistics. Official MLB data source, no authentication required.

Scrape public Instagram posts, reels, IGTV and carousel posts from direct URLs with no login, no cookies, no browser required. Supply a list of Instagram links and receive a structured dataset with author details, caption, media URLs, engagement counts, publish date, music, location, and more.

Extract comprehensive data from Instagram profiles including posts, reels, photos, and engagement metrics.

Find social media profiles across 400+ platforms by username. Search Instagram, TikTok, YouTube, LinkedIn, GitHub, Twitter/X, Reddit, Snapchat, Steam, Twitch, Pinterest, Medium, Discord, Telegram, Spotify, and hundreds more.

Scrape and optionally download Instagram stories for specified usernames using Playwright. Also obtain metadata for stories, such as story id, publish date, expiry date, mentions, links and etc.

Scrape entire subreddits with this crawler. Returns the posts in a subreddit along with their title, text, scores and timestamps etc.

Scrape jobs from Indeed worldwide. Search by keywords and location across 60+ countries. Get full job descriptions, salaries, company info, ratings, and more. No login or API key needed.

Download photos, videos, reels, and carousels from Instagram posts. Extracts detailed metadata for videos and images.

Scrape business leads from Google Maps. Search by query and extract business name, category, address, phone, website, rating, review count, place ID, and coordinates. Optionally enrich with emails, phone numbers, and social links crawled from each business's website.

Extract transcripts and captions from YouTube videos with language selection support. Returns timestamped segments, full concatenated text, and basic video metadata.

Scrape public Tumblr posts from any blog URL, search query, or tag. Returns blog name, post URL, date, tags, content text, note count, like/reblog counts, and media URLs. HTTP-only, no cookies, no login, no API key.

Extract comments from Instagram posts and reels with complete metadata including replies, likes, and author details. Features smart pagination, reply threading, and safe browser automation.

Scrape product listings from homedepot.com by keyword or direct URL. Returns product ID, title, brand, price, rating, reviews, image, and URL.