Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
文本挖掘和预处理工具（文本清洗、新词发现、情感分析、实体识别链接、关键词抽取、知识抽取、句法分析等），无监督或弱监督方法
E2M converts various file types (doc, docx, epub, html, htm, url, pdf, ppt, pptx, mp3, m4a) into Markdown. It’s easy to install, with dedicated parsers and converters, supporting custom configs. E2M offers an all-in-one, flexible, and open-source solution.
🧹 Python package for text cleaning
A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one package
Tools for cleaning and normalizing text data
Grammarify is a npm package that safely cleans up text that has mispellings, improper capitalization, lexical illusions, among other things.
📖 一键修复网络小说排版，智能换行、章节重排、繁简转换、广告清理 ｜ Downloaded a novel that's one giant wall of text? Fix line breaks, chapter order, ads and 简/繁 in one pass
A Python toolkit for file processing, text cleaning and data splitting. 文件处理，文本清洗和数据划分的python工具包。
NLP预/后处理工具。
Text preprocessing tools in python.
A plugin for Obsidian.md which removes newlines and blank lines from selected or pasted text.
Dataiku DSS plugin to detect languages, correct misspellings, and clean text data 🧼
Text Preprocessing Package includes cleaning, tokenization, dataset preparation ...etc
Korean text data preprocess toolkit for NLP
A Python package to get useful information from documents using TopicRank Algorithm.
Remove AI text artifacts, hidden unicode characters and file metadata before you publish. Deterministic, offline, zero dependencies. Python and Node CLIs with one shared rule set.
Text preprocessing package for use in NLP tasks https://pypi.org/project/textcl/
Portfolio-grade audit of a student mental health & academic pressure survey. Measures coverage and sample imbalance, runs validity checks, highlights measurement and selection bias risks, and converts messy open-text “stress causes” into a transparent taxonomy. Ships a Markdown report, figures, and a Streamlit dashboard.
🖹 Smart Text Cleaner and Formatter