ai-web-scraper 开源项目推荐（23 个）

ScrapingBee /ai-web-scraper

Effortlessly extract data with our AI scraper API. Simplify data extraction, get clean JSON outputs and adapt to page changes. Try it free today!

ScrapingBee /n8n-no-code-web-scraper

No-code web scraper built with n8n and ScrapingBee for AI-powered data extraction and automated web scraping workflows without writing code.

m92vyas /llm-reader

将网页转换为对 LLM 友好的输入文本。类似 Firecrawl 和 Jina Reader API。让 RAG、AI 网页抓取、图像与网页链接提取变得简单。

m92vyas /AI-web_scraper

只需说出你想要什么，它就会从网络中提取/抓取数据。可用于创建 AI 网络搜索+提取/抓取代理、基于网络数据的 RAG 等。

ToufiqQureshi /chuscraper

Stealth-native web & Android scraping framework powered by CDP and ADB with adaptive fingerprint rotation and bot-protection bypass.

oxylabs /web-scraping-machine-learning

Web Scraping for Machine Learning

ScraperHub /web-scraper-with-Perplexity-ai

Web Scraper powered by Perplexity AI in Python.

teamreboott /Tapestry

🌐 Open-Source Web Search Backend Framework via Plug-and-Play Configuration

nsourlos /AI_tools

AI tools to enhance productivity and automate web-scraping

javapuppteernodejs /ai-web-unlocker

该项目在 GitHub 上没有填写描述

luminati-io /web-scraping-with-scrapegraphai

Use ScrapeGraphAI and LLMs for web scraping. Automate data extraction, bypass site changes, and enhance scraping efficiency with AI-powered tools.

ScraperHub /web-scraper-with-gemini-ai

Web Scraper powered by Gemini AI in Python.

bright-data-de /web-scraping-with-scrapegraphai

Verwenden Sie ScrapeGraphAI und LLMs für Web-Scraping. Automatisieren Sie die Datenextraktion, umgehen Sie Website-Änderungen und verbessern Sie die Scraping-Effizienz mit KI-gestützten Tools.

olostep-api /olostep-claude-code-skill

Claude Code skill for the Olostep API — the web scraping, crawling, and search infrastructure used by top AI companies. Gives Claude Code full knowledge of every endpoint, async flow, and edge case, without pasting docs.

sergiocalvog /ai-web-to-markdown-client-sdk

Official Node.js client SDK for AI Web-to-Markdown Extract API. Convert URL to Clean JSON & Markdown for LLMs and RAG pipelines.

bright-jp /web-scraping-with-scrapegraphai

ScrapeGraphAI と LLM を Webスクレイピングに活用します。データ抽出を自動化し、サイト変更を回避し、AI 搭載ツールでスクレイピング効率を向上させます。

ScraperHub /vpn-vs-ai-proxy-for-web-scraping

Comparing VPNs vs AI proxies for web scraping with real performance data and working Python examples. Includes comprehensive guide and code for Crawlbase Smart AI Proxy.

Weekend-Dev-Labs /crawlio-js

该项目在 GitHub 上没有填写描述

NithinGowda67 /WebSage-AI-Scraper

WebSage is an AI-powered web scraping and analysis platform built with Gemini embeddings, BeautifulSoup, and Streamlit. It automates product data extraction, supports semantic search, and offers analytics with visual reports. Scalable and modular, it applies to e-commerce, real estate, jobs, and travel.

shamspias /web-scraper

A Web Scraper that automatically extracts data from websites, processes the information, and stores it in a structured format