text-data 开源项目推荐（73 个）

microsoft /DialoGPT

Large-scale pretraining for dialogue

asyml /texar

基于 TensorFlow 的机器学习、自然语言处理和文本生成工具包。这是 CASL 项目的一部分：http://casl-project.ai/

microsoft /GODEL

用于目标导向对话的大规模预训练模型

asyml /texar-pytorch

Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/

asyml /forte

Forte is a flexible and powerful ML workflow builder. This is part of the CASL project: http://casl-project.ai/

thu-coai /cotk

Conversational Toolkit. An Open-Source Toolkit for Fast Development and Fair Evaluation of Text Generation

LoLei /redditcleaner

Cleans Reddit Text Data 📜 🧹

trinker /textreadr

Tools to uniformly read in text data including semi-structured transcripts

trinker /textshape

Tools for reshaping text data

PratikBarhate /question-classification

Question Classification for the dataset CogComp QC Dataset - [ http://cogcomp.org/Data/QA/QC/ ].

BALaka-18 /rake_new2

A Python library that enables smooth keyword extraction from any text using the RAKE(Rapid Automatic Keyword Extraction) algorithm.

YaleDHLab /wordmap

Visualize large text collections with WebGL

carted /processing-text-data

Presents an optimized Apache Beam pipeline for generating sentence embeddings (runnable on Cloud Dataflow).

PedroBarcha /old-books-dataset

Old book pages (with groundtruth), formerly used for OCR studies. There are several versions of the set (concerning resolution and binarization). Noised and denoised sets (done by several methods) are eventually going to be uploaded.

tylerjthomas9 /ScrapeSEC.jl

Scrape EDGAR filings from https://www.sec.gov/

tayebiarasteh /retweet

How Will Your Tweet Be Received? Predicting theSentiment Polarity of Tweet Replies

Hsankesara /The-Tweets-of-Wisdom

A dataset which contains 30k+ so called "self-help" tweets from 100+ authors.

FareedKhan-dev /NLP-1K-Stories-Dataset-Genres-100

This repository hosts a diverse NLP dataset comprising 1,000 stories spanning 100 genres for comprehensive language understanding tasks.

mrchypark /gomSubtitleData

곰tv 자막 데이터 수집 코드

XMU-Kuangnan-Fang-Team /SpecificLDA

A Python package implementing the Directed LDA model for targeted extraction of specific topics from text data