content-extraction 开源项目推荐（331 个）

firecrawl /firecrawl-mcp-server

官方 Firecrawl MCP 服务器，面向 AI 智能体的上下文 API：搜索、抓取网页并与之交互，还可通过任意 MCP 客户端进行解析、爬取、映射、Agent 和 Monitor。

extractus /article-extractor

使用Node.js从给定URL中提取主要文章

runesleo /x-reader

Universal content reader MCP Server for 10+ platforms

graphlit /graphlit-mcp-server

Model Context Protocol (MCP) Server for Graphlit Platform

teng-lin /agent-fetch

面向 AI 智能体的全文网页抓取器——Chrome TLS 指纹、浏览器模拟、多策略文章提取和网页抓取。

currentslab /extractnet

A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one package

originaleric /digcrawl

Built by Dig: A local-first content crawler for AI agents. Retrieve web pages, posts, images, and videos from public and user-authorized signed-in sources via Agent Skills, MCP, and CLI.

chatnoir-eu /chatnoir-resiliparse

A robust web archive analytics toolkit

pinkpixel-dev /web-scout-mcp

An MCP server providing web search and content extraction capabilities. Integrates DuckDuckGo search functionality and URL content extraction into your MCP environment, enabling AI assistants to search the web and extract webpage content.

mvasilkov /readability2

Readability2 converts HTML to plain text.

mavam /webfox

The web, from your terminal. Search, extract pages, get grounded answers, and run deep research with your choice of providers. CLI, TypeScript library, and Pi extension.

feyninc /pulpie

Pareto-optimal models for cleaning the web — fast, encoder-based main-content extraction from HTML.

zoharbabin /web-researcher-mcp

Search the web and primary sources, read full pages, and check every citation. MCP server for Claude, Cursor, Codex and more. Runs on your machine.

Murrough-Foley /rs-trafilatura

Fast, accurate web content extraction in Rust. ML page-type classification, per-type extraction, confidence scoring. F1=0.966 on ScrapingHub (#1), F1=0.859 across 2,008 annotated pages (1,497 development + 511 held-out test

tuffstuff9 /nextjs-pdf-parser

Next.js template for seamless PDF parsing using pdf2json and FilePond. Ideal for developers seeking a ready-to-use solution for PDF content extraction in Next.js projects.

developer0hye /anytomd-rs

Pure Rust document-to-Markdown converter for LLM workflows (DOCX, PPTX, XLSX, HTML, CSV, JSON, XML, images).

blessonism /openclaw-skills

A collection of OpenClaw Agent Skills — search, analysis, content extraction, and more.

mukul975 /mcp-web-scrape

🚀 mcp-web-scrape — Clean, cache-aware web content fetcher for AI agents. Fetch any URL → extract readable content → return Markdown/JSON with citations. ⚡ Fast caching, 🤝 robots.txt compliant, 📝 Markdown-ready output, �� works with ChatGPT/Claude Desktop.

k-kolomeitsev /agent-browser-workspace

本地浏览器工具包：AI代理：深入调研与浏览器自动化，配合本地Chrome（CDP）+ Playwright。灵活、可扩展的脚本，用于网页导航、提取和工作流程自动化——专为可重复的研究和代理驱动浏览而打造。

gorschal /wanish

Summarize web articles: extract clean content, title, image, language, and generate text summaries