webscrape 开源项目推荐（64 个）

libraryofcelsus /Aetherius_AI_Assistant

一个完全私密、本地操作的AI助手/聊天机器人/子代理框架，采用开源大型语言模型实现真实的长期记忆和思维形成。Qdrant用于向量数据库。

gopiashokan /AI-Resume-Analyzer-and-LinkedIn-Scraper-using-Generative-AI

Developed an AI application using LLM to analyze user resumes and provided the summarization, strengths, weaknesses, suggestions, suitable job titles, and also scraping job details from LinkedIn using Selenium. This application reduces time by 30% and helps candidates tailor their resumes effectively.

adriaan90 /Facebook-web-scraper

A collection of tools that you can use to collect data from Facebook

bosniankicks /greenlight

A Golang based Undetected Web Automation Framework

Disane87 /scrape-dojo

🥷 Master the art of web scraping with JSON-powered workflows Define scrapes declaratively · Template everything · Run and monitor in style

NicholasMontalbano /apt_finder_streeteasy_scrape

StreetEasy webscraper and apartment finder https://nicholasmontalbano.github.io/apt_finder_streeteasy_scrape/visuals/filter_table.html

aditeyabaral /newsnow

Automated document merging and extractive summarization of news articles

vbaliga165 /PickMyChamp

PickMyChamp is a utility to generate the best choice of champion in a game of League of Legends (LoL)

hansengianto /smuledownloader

Smule Video Downloader

eru123 /eru123.github.io

Free Web Services, Informations, Medias and Entertainment all in one Application without annoying Ads

MarsRon /konosuba-data

Text data of KonoSuba: God's Blessing on This Wonderful World! Light Novel Volume 1 to 17 + short stories (English fan translation).

FahimFBA /scrapelite-guardian

Extract data from websites using the web-scrapper. Made with nodejs, ExpressJS, axios & cheerio.

DeepIntoData /AmazonWebScraper

An Amazon Web Scraper - Find the best deals on Amazon products. Deployed on Heroku!

mattmiller87 /RLScrape

Automated retrieval of Rocket League Player Data using a webscraper for https://rocketleague.tracker.network/

cristobalmitchell /sport-scraper

Simple web scraper package for gathering sports data from ESPN.com

fredysomy /Covid19data

This repo consists of data retrieving function (Python) from a dataset related to covid 19..read readme for more info...

haadijafari /SessProject

Python program to help me choose my university unit

jimnoneill /PubMed-FAST-Scrape

PubMed-FAST-Scrape is a Python package intended for Biomedical NLP scientists. Offers x200 faster scraping than otherwise. It enables researchers and data scientists to easily gather articles based on a field of interest, year range, and minimum number of citations.

BLOB-browser /OATFLAKE

这个RAG栈可以在树莓派（16GB CPU）上运行

ng10op /TradeSphere

TradeSphere is a web-based application designed for stock analysis, utilizing web scraping to collect, analyze, and visualize stock market data.