article-extractor 开源项目推荐（100 个）

adbar /trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

extractus /article-extractor

使用Node.js从给定URL中提取主要文章

scotteh /php-goose

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

lightfeed /extractor

使用 LLM 稳健提取网页数据

opendatalab /MinerU-HTML

MinerU-HTML：一个基于STM的HTML主内容提取器，输出干净的HTML正文。非常适合深度研究代理、RAG应用程序和训练数据生成。

Strumenta /SmartReader

SmartReader is a library to extract the main content of a web page, based on a port of the Readability library by Mozilla

hipstermojo /paperoni

An article extractor in Rust

artiomn /markdown_articles_tool

Parse markdown article, download images and replace images URL's with local paths

fterh /sneakpeek

Reddit bot to preview and post hyperlinks as comments

web64 /nlpserver

NLP Web Service

inaridiy /webforai

Any HTML to the cleanest Markdown, for humans and AI agents: a TypeScript library, a CLI with an Agent Skill, and a hosted crawl/scrape API.

web64 /laravel-nlp

Laravel wrapper for common NLP tasks

clarivate /wos-excel-converter

This is a small and easy-to-use desktop application that allows exporting Web of Science API Expanded and InCites API data in Excel/CSV/JSON/XML with a configurable and flexible data export structure.

alphap365 /open-news

An extensible Python engine and library for news discovery, aggregation, processing, search, and AI-ready intelligence.

myifeng /article-parser

Extract article or news by url or html, parse the title and content, output in markdown format.

johnbumgarner /newshound

This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around the world in over 50 languages.

Creator-SN /IKFB

Involution King Fun Book (IKFB, Chinese: 快卷, 卷王快乐本) is an integrated management system for papers and literature. Powered by Electron.

KotlinSpringBoot /saber

【 Spring Boot 实战开发】10 分钟快速构建一个自己的技术文章博客

woojubb /html-article-extractor

A web page content extractor

lord-alfred /dnlp

📚 Сборник полезных штук из Natural Language Processing: Определение языка текста, Разделение текста на предложения, Получение основного содержимого из html документа