scrapers 开源项目推荐（216 个）

emcf /thepipe

Get clean data from tricky documents, powered by vision-language models ⚡

openstates /openstates-scrapers

开放状态抓取器的来源

alltheplaces /alltheplaces

A set of spiders and scrapers to extract location information from places that post their location on the internet.

firecrawl /firecrawl-app-examples

🔥 This repository contains complete application examples, including websites and other projects, developed using Firecrawl.

josephlimtech /linkedin-profile-scraper-api

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON.

AbirHasan2005 /TelegramScraper

抓取Telegram群组成员（隐藏成员也包括）并添加到你的群组。

oxylabs /quick-start-guide

Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.

AlexMathew /scrapple

A framework for creating semi-automatic web content extractors

needmorecowbell /sniff-paste

Pastebin OSINT Harvester

amoudgl /short-jokes-dataset

Python scripts for building 'Short Jokes' dataset, featured on Kaggle

cporter202 /software-income-playbooks

Curated software income playbooks and monetization-focused API ideas for founders, agencies, and automation builders.

DiegoCaraballo /Email-extractor

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

html2rss /html2rss

📰 Build RSS 2.0 feeds from websites (and JSON APIs) automatically or with a few CSS selectors.

RealEstateWebTools /property_web_scraper

Web based UI to make processing scraped data from real estate websites super simple

alash3al /scraply

Scraply 是一个简单的 dom 抓取工具，可以从任何基于 html 的网站获取信息

philshem /gmaps_popular_times_scraper

Scraper for Google Maps "Popular Times" for place entries

rjriajul /FZBypassBot

A Elegant Fast Multi Threaded Bypass Bot for Bigger Deeds. Try Now !!

hilmiazizi /tokopaedi

A Python scraper for Tokopedia that supports filtered product search, detailed product information, and customer reviews with accurate mobile pricing and Jupyter Notebook compatibility.

xbmc /repo-scrapers

Official source repository for Kodi scraper add-ons

shashwatah /instahunter

CLI OSINT app that can fetch data from Instagram's Web API without authentication.