python-web-scraper 开源项目推荐（77 个）

omkarcloud /botasaurus

用于构建无敌爬虫的一站式框架

d60 /twikit

Twitter API 抓取器 | 无需 API 密钥 | Twitter 内部 API | 免费 | Twitter 抓取器 | Twitter 机器人

oxylabs /scrape-google-python

在本教程中，我们展示了如何使用Python和Oxylabs API抓取公共Google数据。

je-suis-tm /web-scraping

面向初学者的详细网络爬虫教程，涵盖 Reddit WallStreetBets、CME（期权与期货）、美国财政部、CFTC、LME、MacroTrends、SHFE 上的金融数据爬虫，以及 Tomtom、BBC、《华尔街日报》、半岛电视台、路透社、《金融时报》、彭博社、CNN、《财富》、《经济学人》上的另类数据爬虫

oxylabs /web-scraping-google-sheets

Guide to Using Google Sheets for Basic Web Scraping

jpjacobpadilla /Stealth-Requests

Undetected web-scraping & seamless HTML parsing in Python!

oxylabs /ebay-scraper

eBay Scraper for extracting product titles, descriptions, prices, specifications, customer reviews, and ratings from eBay

davidteather /everything-web-scraping

在YouTube上与David Teather Codes一起学习所有网页爬虫知识

oxylabs /Python-Web-Scraping-Tutorial

In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex.

oxylabs /aliexpress-scraper

Easily collect public AliExpress data like prices, product details, and ratings with AliExpress Scraper API

thewebscraping /tls-requests

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

Conso1eCowb0y /Deepminer

Deep web crawler and search engine

Decodo /Google-News-scraper

Python Google News scraper for headlines, sources & publication dates. Monitor topics and trends with residential proxies & automated CSV export.

J4NN0 /linkedin-web-scraper

LinkedIn Python Web Scraper to collect and store company data

Decodo /Python-scraper-tutorial

A short introduction to scraping with Python with given steps and an example scraper script.

stabldev /mangareader-api

A Python based web scraping api built with fastapi to get manga contents.

sallamy2580 /python-web-scrapping

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

luminati-io /google-flights-api

Real-time flight data from Google Flights using a free scraper or Bright Data’s high-volume Google Flights Scraper API for reliable, scalable data collection.

JohnScooby /Google-Scraper

A Simple Python Based Google Search Results Scraper.

kowshika-n /Python-Scrapers

This repo includes a collection of Python scripts and tools built for enabling web scraping and data entry. Results are extracted and exported to CSV or Excel files as per requirements.