nlp-datasets 开源项目推荐（209 个）

mihail911 /nlp-library

curated collection of papers for the nlp practitioner 📖👩‍🔬

StonyBrookNLP /appworld

🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource Paper.

guhhhhaa /4675-scifi

chinese NLP corpus of chinese science fiction,chinese science fiction corpus : About 4675 Chinese science fiction novels 大约有4675本科幻小说，中文科幻小说自然语言处理语料库，中文科幻小说文本语料库，中文科幻小说文本数据库，科幻小说语料

hellohaptik /multi-task-NLP

multi_task_NLP is a utility toolkit enabling NLP developers to easily train and infer a single model for multiple tasks.

dkulagin /kartaslov

Открытые лингвистические датасеты: тональный словарь русского языка КартаСловСент, датасет по семантике, ассоциативный граф и датасет по орфографическим ошибкам и опечаткам.

quincyliang /nlp-public-dataset

Chinese, English NER, English-Chinese machine translation dataset. 中英文实体识别数据集，中英文机器翻译数据集, 中文分词数据集

grammarly /ua-gec

UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language

irfnrdh /Awesome-Indonesia-NLP

Resource NLP & Bahasa

liutiedong /goat

a Fine-tuned LLaMA that is Good at Arithmetic Tasks

cjiang2 /VDCNN

Implementation of Very Deep Convolutional Neural Network for Text Classification

INK-USC /TriggerNER

TriggerNER: Learning with Entity Triggers as Explanations for Named Entity Recognition (ACL 2020)

INK-USC /CommonGen

A Constrained Text Generation Challenge Towards Generative Commonsense Reasoning

guhhhhaa /wula-scifi

chinese NLP corpus of chinese science fiction, chinese science fiction corpus: Archive of the Ark Plan of Ula Science Fiction Website 乌拉科幻小说网方舟计划存档，中文科幻小说自然语言处理语料库，中文科幻小说文本语料库，中文科幻小说文本数据库，科幻小说语料

secsilm /zi-dataset

汉字数据集，包括汉字的相关信息，例如笔画数、部首、拼音、英文释义/同义词等。

xtea /chinese_medical_words

手工整理医疗行业词汇、术语等语料。可用于语音识别、对话系统等各类nlp模型训练。

Niger-Volta-LTI /yoruba-text

Yorùbá language training text for NLP, ASR and TTS tasks

kelvin-jiang /FreebaseQA

The release of the FreebaseQA data set (NAACL 2019).

Pzoom522 /HistSumm

Code and data for "Summarising Historical Text in Modern Languages" (EACL 2021)

AndyTheFactory /romanian-nlp-datasets

A list of Romanian NLP Datasets

selimfirat /bilkent-turkish-writings-dataset

Compilation of Turkish writings dataset that promotes creativity, content, composition, grammar, spelling and punctuation.