Web Scraping Layers for AI & Automation

Scrape Y Combinator startup job listings with salary, equity, visa sponsorship, founder data, and full descriptions. Filter by role and location. Job-centric output ready for recruiting, salary benchmarking, and startup research.

Download Kick.com videos, VODs, and clips in up to 1080p60 quality. Save Kick stream recordings, highlights, and clips to Apify storage. No proxy needed. Export download links via API. Supports batch downloads.

Scrape remote job listings from We Work Remotely, the world's largest remote job board. Filter by category, country, salary range, engagement type, and skills. Extract job details, company info, descriptions, and apply links.

Send HTTP requests (GET, POST, PUT, PATCH, DELETE) to any API endpoint with customizable headers, parameters, and body data. Forward responses via callback URL. Perfect for Clay users and no-code API integrations.

Scrape Polymarket leaderboard rankings with full trader profiles. Extract wallet addresses, usernames, profit/loss, volume, positions, recent trades, bios, and social links. Filter by time range, category, and ranking type.

Scrape Rozee.pk job listings in bulk. Extract job titles, companies, salaries, skills, experience levels, descriptions, and location data from Pakistan's largest job portal. Filter by keyword and city. Export as JSON, CSV, Excel.

Scrape detailed job listings from Hiring.cafe — titles, salaries, companies, locations, tech stacks, and 30+ fields from 2.8M+ postings across 46 ATS platforms. Filter by keyword, location, salary, seniority, and more. Export as JSON, CSV, Excel, or access via API.

Scrape public Threads search posts by keyword or hashtag. Extract post text, authors, engagement metrics, media URLs, hashtags, mentions. Export JSON, CSV, Excel.

Scrape Shopify store leads by keyword or category. Extract emails, phone numbers, addresses, ratings, social links, and sample products. Filter by location, price, and shipping. Export as JSON, CSV, Excel.

Scrape Unsplash images by keyword with orientation, color, and sort filters. Extract image URLs, photographer info, tags, and metadata. No API key needed. Export as JSON, CSV, Excel.

Check Gmail username availability in bulk. Validate @gmail.com usernames, detect available or taken names, schedule runs, use the API, and export JSON, CSV, or Excel.

Scrape Polymarket prediction markets with prices, volume, liquidity, and outcomes. Filter by category, status, keyword, and minimum volume. Sort by volume, liquidity, newest, or closing soon.

Convert public X/Twitter article and tweet content to Markdown by tweet ID. Batch up to 10 IDs and export Markdown as JSON, CSV, or Excel.

Scrape contractor data from BuildZoom. Search by city and trade, filter by construction type and project value. Extract BZ scores, licenses, permits, reviews, insurance, and contact info for 4M+ US contractors.

Scrape design job listings from Dribbble, the #1 job board for graphic design jobs. Filter by specialty, location, remote, full-time, or freelance. Extract job details, descriptions, company info, and apply links.

Extract property listings from Fotocasa.es, Spain's largest real estate portal. Scrape prices, rooms, area, GPS coordinates, agency contacts, and images. Filter by location, operation, property type, price range, size, and publication date. Export as JSON, CSV, or Excel. API access included.

Scrape designer profiles from Dribbble, the world's largest design community. Filter by category, budget, location, rating, PRO status, and more. Extract skills, pricing, reviews, and contact info.

Scrape business listings from YellowPages.com. Extract names, phone numbers, emails, addresses, ratings, reviews, hours, categories, and websites. Search any industry and US city. Listing and detail modes with Pay-per-event pricing.

Generate AI images from text prompts using Artbreeder. Choose from 7 models (Flux, Flux Krea, SDXL Lightning, SD-3.5). Customize dimensions, guidance scale, inference steps. Batch processing with NSFW detection. Export as JSON, CSV, Excel.

Scrape Bayt.com job listings across the Middle East, UAE, Saudi Arabia, and 30+ countries. Extract job titles, companies, salaries, skills, descriptions, career levels, and preferred candidate data. Filter by country, city, or keyword. Export as JSON, CSV, Excel.

Extract posts from Truth Social profiles including Donald Trump. Scrape content, interactions, media, replies, and account data. Incremental scraping with per-user tracking. Export as JSON, CSV, Excel. API access included.

Scrape Substack leaderboard rankings across 30 categories. Extract top bestseller and rising publications with subscriber counts, pricing tiers, author details, and ranking metrics.

Scrape Naukri.com job listings across India — titles, companies, salaries, skills, descriptions, AmbitionBox reviews. Filter by keyword, location, experience, salary range, work mode, and 15+ filters. Two modes: fast search summaries or full job details. Export as JSON, CSV, Excel.

Extract template data from the Framer Marketplace — the leading platform for responsive website templates. Browse all templates or filter by category, pricing, and search query. Optionally visit detail pages for rich metadata including features, screenshots, and page lists.

Scrape public Threads user posts, search posts, and profile matches. Extract post text, profile data, engagement metrics, media URLs, contacts, hashtags, and mentions. Export JSON, CSV, Excel.

Extract emails, phone numbers, and social media profiles (LinkedIn, Twitter/X, Facebook, Instagram) from any website. Crawls contact pages, about pages, and footers automatically. Bulk processing for lead generation, sales prospecting, and CRM enrichment. Export as JSON, CSV, Excel.

Extract deep metadata from skills.sh, the open agent skills directory. Scrape weekly installs, GitHub stars, security audits, agent adoption breakdown, SKILL.md content, and more from every skill listing.

Scrape BuiltIn.com tech job listings — titles, companies, salaries, seniority levels, categories, skills, workplace types, and descriptions. Search by keyword, location, or custom URL. Export as JSON, CSV, Excel.

Scrape YouTube search results — videos, channels, playlists, shorts, and movies. Filter by type, duration, upload date, sort order, and video features (HD, 4K, CC, Live). Get titles, view counts, thumbnails, channel info, and publish dates. Export as JSON, CSV, Excel.

Scrape eBay sold listings with real transaction prices across 8 marketplaces. Filter by keyword, category, price, condition, date range, and sort order. Returns 22+ fields per item including sold price, shipping, seller info, and listing type.

Scrape portfolio holdings of 82 tracked superinvestors from Dataroma. Get stock positions, allocation percentages, recent buy/sell activity, reported prices, current prices, and sector breakdowns for investors like Warren Buffett, Bill Ackman, and Seth Klarman.

Download YouTube video thumbnails in bulk — HD, SD, or custom quality with automatic fallback. Supports all URL formats: watch pages, Shorts, embeds, youtu.be links. No browser needed. Export thumbnail metadata as JSON, CSV, Excel, or download images directly.

Scrape Dutch real estate listings from Funda.nl — prices, photos, coordinates, characteristics, neighborhood data, and more.

Scrape CutShort.io tech and startup jobs — titles, companies, salaries, skills, experience, descriptions, recruiter details, tech stacks, funding stage. Search by skill or paste URLs. Output modes: full, summary, urls_only. Export JSON, CSV, Excel. No login needed.

Scrape remote job listings from RemoteOK.com — titles, companies, salaries, tags, locations, and apply links. Filter by skill tags, keyword, and minimum salary. No proxy or authentication needed. Export as JSON, CSV, Excel.

Scrape GMGN.ai copytrade wallet leaderboards across Solana, Ethereum, BSC, Base, Tron, and Monad. Extract wallet PnL, win rates, realized profit, transactions, balances, tags, and social profiles. Filter by trader type, sort by any metric. Export JSON, CSV, Excel.

Scrape Polymarket markets with active liquidity rewards. Get daily reward rates, max spread requirements, min share sizes, competitiveness scores, and real-time pricing data. Filter by category, reward rate, and keyword.

Scrape 1688 wholesale products, supplier details, tiered prices, MOQ, SKUs, shipping, certifications, dropship signals, and images. Export JSON, CSV, Excel.

[💰 $2.69/ 1K] Extract Craigslist real estate listings: prices, beds, baths, square footage, photos, descriptions, owner/dealer flags, and public contact signals. Search cities or paste listing URLs. Export as JSON, CSV, Excel.

[💰 $1 / 1K] Scrape Craigslist listings across cars, housing, jobs, electronics, furniture, services, gigs, and events. Filter by keyword, price, condition, or sort. Each row includes title, price, location, description, images, post ID, and category-specific attributes. Export as JSON, CSV, Excel.

Extract vehicle listings from AutoTrader.co.uk — prices, specs (make, model, year, mileage), finance quotes with APR and payments, dealer ratings and contact info, high-res images, and vehicle history checks. Export as JSON, CSV, Excel.

Scrape real-time SEC Form 4 insider transaction data from Dataroma. Filter by timeframe, transaction type, minimum amount, and stock symbols. Get insider buys and sells with filing dates, prices, shares, and SEC filing links.

Extract Snapchat profile data: username, display name, bio, subscriber count, category, website, images, address, story status, and timestamps. Export as JSON, CSV, Excel.

Extract job listings from Startup.jobs — titles, companies, salaries, locations, descriptions, and application links. Filter by keyword and location. Export as JSON, CSV, Excel. Pay per result.

Merge and deduplicate Apify datasets by any field combination. Remove duplicate rows while keeping the first or last occurrence. Supports case-insensitive matching and whitespace trimming.

Scrape Xing job listings across the DACH region — titles, salaries, companies, locations, descriptions, and 60+ structured fields. Filter by keyword, location, and discipline. Export as JSON, CSV, or Excel.

Scrape ATP and WTA match histories from Tennis Abstract by player. Extract scores, surfaces, rounds, rankings, and serve/return stats like ace rate, dominance ratio, and break points saved.

Scrape job listings from Arbeitsagentur.de (Bundesagentur für Arbeit) — Germany's largest public employment database with 1.5M+ active postings. Extract titles, employers, locations, contracts, descriptions, and 30+ fields per listing.

Scrape tech job listings from Dice.com — titles, salaries, companies, locations, work settings, descriptions, and 30+ fields per listing. Filter by keyword, location, and posting date. Export as JSON, CSV, or Excel.

Extract Propertyfinder real estate listings across MENA: prices, locations, images, agents, brokers, amenities, and contacts. Export as JSON, CSV, or Excel with API access.

Scrape Pinterest search results by keyword. Extract pin IDs, titles, pinner profiles, follower counts, creation dates, content type, and HD image URLs. Use scheduling, API access, integrations, and JSON, CSV, Excel exports.

Scrape HelloWork job listings across France — titles, companies, salaries, skills, locations, contract types, and descriptions. Filter by keyword, location, or category. Export as JSON, CSV, Excel.

Extract plugin data from the Framer Marketplace. Browse all plugins or filter by category, pricing, and search query. Optionally visit detail pages for rich metadata including descriptions, changelogs, version info, user counts, and creator emails.

Scrape GetYourGuide tours and activities by query or URL. Extract titles, prices, ratings, reviews, images, highlights, durations, and cancellation policies. Export JSON, CSV, Excel.

Scrape GetYourGuide product reviews: ratings, titles, review text, authors, dates, helpful votes, photos, owner responses, and product ratings. Export JSON, CSV, Excel.

Scrape car rental offers from Kayak: provider, agency, vehicle type, day/total price, mileage and fuel policy, cancellation terms, and booking links for any Kayak car search URL.

Scrape job listings from JobsDB (Thailand and Hong Kong): titles, companies, salaries, locations, work types, classifications, and posting dates.

Scrape French company data from Pappers.fr — SIREN, legal form, address, directors, financials, and establishments. Search by keyword or paste pappers.fr/recherche URLs with filters. Export as JSON, CSV, Excel.

Extract Skool community data: names, descriptions, pricing, member counts, owner profiles, social links, courses, images, and timestamps. Export as JSON, CSV, Excel.

Scrape Product Hunt launches, leaderboards, categories, and topics. Extract product names, taglines, upvotes, ranks, makers, reviews, comments, and emails. Export as JSON, CSV, Excel.

Scrape AutoTrader.ca vehicle listings at scale — prices, specs, mileage, dealer info, Carfax links, and photos. Paste any search URL, paginate automatically, export as JSON, CSV, Excel. API access and scheduling included.

Scrape Workday job listings and direct job pages. Extract titles, descriptions, locations, salary text, apply URLs, and public employer emails. Export JSON, CSV, Excel.

Extract DexScreener token data: prices, liquidity, market cap, volume, transactions, FDV, pair URLs, socials. Filter, schedule, use API, export JSON, CSV, Excel.

Extract U.S. Congress stock trades and financial disclosures by member, ticker, and date. Get transaction rows with assets, owners, amounts, filing IDs, and PDF quality.

Discover Pinterest keyword suggestions from autocomplete data. Enter a seed keyword and extract related search phrases for SEO, trend research, content planning, ads, and Pinterest scraper workflows. Export as JSON, CSV, Excel.

Extract Pinterest profile data by username: profile IDs, names, bios, follower counts, board counts, pin counts, images, cover data, websites, verification flags, and SEO fields. Use API access, scheduling, integrations, and JSON, CSV, Excel exports.

Scrape Trendyol product data, prices, ratings, sellers, reviews, Q&A, coupons, badges, and promotion signals. Use API access, scheduling, integrations, and JSON, CSV, Excel exports.

Download Pinterest image metadata from pin URLs. Extract titles, source URLs, media variants, dimensions, quality labels, and direct image links. Export as JSON, CSV, Excel.

Scrape commercial real estate listings from fundainbusiness.nl — offices, retail, warehouses, industrial, and agricultural properties in the Netherlands.

Clean messy data — remove nulls, normalize case, trim whitespace, format phone numbers and emails, extract domains, convert types, and more. Works with Apify datasets or direct JSON input.

Extract component data from the Framer Marketplace. Browse all components or filter by category, pricing, and search query. Optionally visit detail pages for rich metadata including descriptions, install counts, categories, and creator emails.

Scrape paid jobs, volunteering, events, and training courses from doinggoodleeds.org.uk via WP-JSON. Four entity types, ~178 items total. Title, employer, location, salary, apply email/URL, full description HTML. Export as JSON, CSV, Excel.

Find Shopify stores by niche keyword and extract B2B leads: emails, phones, addresses, owner names, social profiles, installed apps, product counts, and theme. Export as JSON, CSV, Excel.

Scrape the full public product catalog of any Shopify store. Extract titles, prices, sale status, stock flags, variants, options, images, tags, vendor, product type, and timestamps. Export as JSON, CSV, Excel.

Scrape job listings from Arbeitnow.com — titles, companies, locations, remote status, tags, and apply links. Filter by keyword, location, and remote. Export as JSON, CSV, or Excel.

Scrape remote job listings from Jobicy — titles, salaries, industries, job type, seniority, and full descriptions via the public jobs API.

Check every hyperlink and anchor in your Markdown files for broken links. Point it at raw Markdown URLs or paste text directly — use it as a CI/CD gate before you deploy or publish.

Search remote jobs across Arbeitnow, Jobicy, Himalayas, and RemoteOK in one run — one keyword, one unified output schema, no separate scrapers to manage.

Scrape financial services job listings from eFinancialCareers — titles, salaries, companies, locations, sectors, and 30+ fields from 70,000+ postings in banking, trading, and fintech.

Scrape job listings from Workopolis.com: titles, companies, salaries, locations, employment type, remote/hybrid settings, and full descriptions.

Scrape job listings from Workable's job board: titles, companies, salaries, locations, employment type, workplace type, and full descriptions.

Scrape JustJoin.it tech job listings: titles, companies, salaries, skills, workplace type, and 20+ fields. Filter by keyword or Polish city.

Extract prediction market data from Kalshi: series, events, markets, prices, volume, and resolution rules. Search by keyword or paste Kalshi market URLs.

Extract free stock photos from Pexels: titles, tags, colors, dimensions, download URLs, and photographer details. Search by keyword or paste a Pexels search URL, filter by orientation, size, and color.

Extract property listings from VivaReal, Brazil's leading real estate portal: prices, location, rooms, amenities, media, and seller contact details. Search by city or neighborhood, or paste listing URLs directly.

Extract free stock images from Pixabay: titles, tags, dimensions, download URLs, and uploader details. Search by keyword and location, or paste a Pixabay search URL.

Scrape rent, buy, and PG property listings from NoBroker.in — prices, deposits, amenities, owner contact names, and full descriptions across Indian cities.

Scrape property listings from MagicBricks: rent and buy prices, area, BHK, amenities, RERA IDs, location, and full descriptions for Indian cities.

Scrape Naver Blog and Naver Cafe posts by keyword or direct URL: full content, images, tags, category, likes, comments, and place info. Export JSON, CSV, Excel.

Scrape Naver Map places by keyword or URL: name, category, address, phone, business hours, menus, facilities, images, and reviews. Export JSON, CSV, Excel.

Scrape Handshake job and internship listings: job title, company, location, salary, employment type, posted date, industry, and full description. Export to JSON, CSV, or Excel.

Scrape Naver Place reviews: visitor review text, star ratings, visit dates, voted keywords, owner replies, photos, and Naver Blog reviews. Export JSON, CSV, Excel.

Scrape Eluta.ca job listings: titles, salaries, employer profiles, NAICS codes, Top Employer badges, and resolved ATS apply links. Monitor new postings daily.

Scrape probate, foreclosure, sheriff sale, tax lien, and tax sale leads from US county and state open-data portals. Normalized fields: case number, owner/defendant name, address, sale date, equity estimate.

Scrape verified UK tradesperson listings from Checkatrade. Extract ratings, phone numbers, VAT status, service areas, badges, and full profile details by location and trade category.

[💰 $0.9 / 1K] Scrape live scores, fixtures, lineups, statistics, odds, and standings from SofaScore. Search by team/player/tournament, paste match links, or pull every live or scheduled match across any sport.

[💰 $0.79 / 1K] Scrape Google Ads Transparency Center by domain, keyword, or advertiser ID. Get advertiser, format, first/last shown dates, and ad/preview URLs for any brand's Search, YouTube, Shopping, Maps, and Play ads.

Scrape Internshala internships and jobs by category, city, stipend, salary, and experience. Extract company, skills, badges, stipend/salary, duration, and full descriptions.

Scrape job listings from Wuzzuf: titles, companies, salaries, locations, job types, career levels, skills, and full descriptions.

Extract Telegram post media URLs, titles, descriptions, thumbnails, and media metadata from public Telegram channels or groups. Use API access, scheduling, integrations, and JSON, CSV, Excel exports.

Extract Skool classroom and community data: posts, courses, comments, authors, engagement, media links, and timestamps. Export JSON, CSV, Excel.

Scrape BusinessesForSale.com listings: titles, prices, revenue, cash flow, locations, categories, tags, images, and contact links. Use URLs or keyword searches. Export as JSON, CSV, Excel.

Scrape remote job listings from Himalayas — titles, salaries, seniority, employment type, company data, and full descriptions via the public search API.

Scrape MLB teams, rosters, schedules, standings, player stats, and game details from MLB's official Stats API. Get team info, player bios, box scores, and hitting/pitching/fielding stats by season.

Scrape IT jobs from Hirist.tech by keyword, city, and experience. Extract title, company, rating, salary, experience, skills, and full descriptions from India's IT-focused job board.