Crawler Bros

Extract posts from Instagram keyword search results. Scrape post URLs, captions, usernames, media URLs, hashtags, engagement metrics, and more. Supports multiple keywords with anti-detection features.

Extract transcripts from Instagram videos and reels using auto-generated captions or AI-powered speech-to-text. Returns clean, timestamped transcript segments with full video metadata.

Scrape public job listings from Wellfound.com. Extracts job ID, title, compensation, remote status, location, company name, company logo. HTTP-only, no login.

Extract job postings from ZipRecruiter.com with FULL job descriptions. Returns title, company, location, salary, skills, and the full job description body per listing. Walks paginated search results.

Scrape Google News in real-time. Supports keyword search, date filters, full-text article extraction, and image extraction.

Scrape Instagram followers and following lists. Extract username, display name, verification status, privacy flag, and profile picture for every account. Supports followers, following, or both modes across multiple profiles with configurable limits.

Scrape product listings from Etsy search results, categories, shops, and product pages. Extract prices, ratings, reviews, seller info, badges, and product details.

Scrape LinkedIn public profiles without login. Get name, headline, experience, education, followers, and recent articles.

Scrape the official MLB Stats API, comprehensive baseball data including teams, players, schedules, standings, and detailed statistics. Official MLB data source, no authentication required.

Scrape UFC fighter rankings, fight results, and event data from ESPN's public MMA API. Search fighters, browse weight-class rankings, and fetch completed event fight cards with results.

Scrape entire subreddits with this crawler. Returns the posts in a subreddit along with their title, text, scores and timestamps etc.

Scrape Reddit Comments from a post on Reddit. Provides comment text, the parent of the thread, score and timestamps.

Find social media profiles across 400+ platforms by username. Search Instagram, TikTok, YouTube, LinkedIn, GitHub, Twitter/X, Reddit, Snapchat, Steam, Twitch, Pinterest, Medium, Discord, Telegram, Spotify, and hundreds more.

Extract comments from Instagram posts and reels with complete metadata including replies, likes, and author details. Features smart pagination, reply threading, and safe browser automation.

Scrape TikTok posts by URL and extract comprehensive video metadata including engagement stats, author information, music details, and hashtags.

Scrape jobs from Indeed worldwide. Search by keywords and location across 60+ countries. Get full job descriptions, salaries, company info, ratings, and more. No login or API key needed.

Given a company name, return the company's official website domain and its social media links (LinkedIn, X/Twitter, Facebook, Instagram, YouTube, TikTok, GitHub).

Scrape and optionally download Instagram stories for specified usernames using Playwright. Also obtain metadata for stories, such as story id, publish date, expiry date, mentions, links and etc.

Scrape public Instagram posts, reels, IGTV and carousel posts from direct URLs with no login, no cookies, no browser required. Supply a list of Instagram links and receive a structured dataset with author details, caption, media URLs, engagement counts, publish date, music, location, and more.

Find B2B leads by job title, location, and industry. Extracts name, title, company, LinkedIn URL, and guessed email from public search results. No API keys or credentials needed.

Search for usernames across 400+ social networks and websites. Find all social media accounts linked to a username using the Sherlock OSINT tool.

Search Quora by keywords and extract questions, answers, author info, upvotes, and engagement metrics. Find relevant Q&A content across any topic.

Extract comprehensive data from Instagram profiles including posts, reels, photos, and engagement metrics.

Download photos, videos, reels, and carousels from Instagram posts. Extracts detailed metadata for videos and images.