scrape-websites 开源项目推荐（40 个）

cassidoo /scrapers

A list of scrapers from around the web.

yusuzech /r-web-scraping-cheat-sheet

Guide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.

warifp /Shopee-Scrape

Shopee Scrape 是一款用于收集数据的工具——比如从照片、价格、名称、门店位置等中查找数据。

joelbarmettlerUZH /Scrapeasy

Scraping in python made easy - receive the content you like in just one line of code

ohmybahgosh /FONTS_DOT_COM_RIPPER

Script to extract entire font families from Fonts.com, rips them as woff2 and final output includes woff2 and ttf files

GreenTreeTeam /WebScraper

A simple tool made with server-side and client-side for Scraping Websites and downloading them.

TufayelLUS /LinkedIn-CV-Downloader

A Python based GUI automation software for downloading bulk LinkedIn CV / LinkedIn Resume from a list of profile links

MagdaleneHo /Predicting-Forex-with-Sentiment-Analysis

An undergraduate research in predicting Forex movement with sentiment analysis of news headlines.

Ashwagandhae /evidencer

Debate card cutting chrome extension

g-bhagwanani /py-trains

Scraping data from railyatri.in to find trains for a given source and destination on a given date

omkarcloud /shopee-scraper

Shopee Scraper — free, open-source Shopee scraper. Unlimited products, flash deals, shops and reviews as clean JSON, no API key, no proxies.

jinudaniel /reddit-post-classification

Scrape Reddit for posts related to popular front frameworks like React, Angular and Vue and build ML/DL models for classifying these posts.

x1ao4 /tvdb-scraper

通过 python 脚本使用 lxml 从 tvdb 上获取剧集信息及封面 / get episode information and covers from tvdb via python script using lxml

nmaties /google-emails-scraper

Node.js Google email addresses scraper using puppeteer. https://www.backlinkx.io

tomaszcekalo /UfcComScraper

Scraper for ufc.com site

CitywideMars50 /GameTDB-Bot

GameTDB and Khinsider Game Title + OST Discord Bot. Scrapes Box Art, metadata and Game OST's using Python and Discord-py

omkarcloud /shine-scraper

Shine Scraper — free, open-source Shine scraper. Unlimited India jobs, skills, salaries and employer profiles as clean JSON, no API key, no proxies.

harpreetvirkk /Scrape-Amazon-Flipkart

Python Scripts to Scrape Amazon & Flipkart Websites

rahulelex /scrape-employees-data-from-greythr

This repository serves as an illustration of how to retrieve and scrape data from a website using Selenium.

omkarcloud /chrome-web-store-scraper

Chrome Web Store Scraper — free, open-source Chrome Web Store scraper. Unlimited extensions, reviews & developer contacts as clean JSON, no API key, no proxies.