corpus-processing 开源项目推荐（95 个）

BLKSerene /Wordless

一个集成语料库工具，支持多语言学习语言、文学和翻译

bitextor /bitextor

Bitextor generates translation memories from multilingual websites

hankcs /TreebankPreprocessing

Python scripts preprocessing Penn Treebank and Chinese Treebank

Helsinki-NLP /OpusFilter

OpusFilter - Parallel corpus processing toolkit

NathanDuran /Switchboard-Corpus

Utilities for Processing the Switchboard Dialogue Act Corpus

OHNLP /MedTator

A Serverless Text Annotation Tool for Corpus Development

johentsch /ms3

A parser for annotated MuseScore 3 files.

uma-pi1 /OPIEC

Reading the data from OPIEC - an Open Information Extraction corpus

NathanDuran /MRDA-Corpus

Utilities for Processing the Meeting Recorder Dialogue Act Corpus

versotym /rhymetagger

A simple collocation-driven recognition of rhymes. Contains pre-trained models for Czech, Dutch, English, French, German, Russian, and Spanish poetry

notesjor /corpusexplorer2.0

Korpuslinguistik war noch nie so einfach...

Bibliome /alvisnlp

ALvisNLP corpus processing engine

zgornel /StringAnalysis.jl

Hard-Forked from JuliaText/TextAnalysis.jl

uma-pi1 /OPIEC-pipeline

该项目在 GitHub 上没有填写描述

ilinguistics /corpus_similarity

Measure the similarity of text corpora for 74 languages

felipetovarhenao /exquisitecorpus

A set of corpus-based sampling & analysis M4L devices

kennedyCzar /NLP-PROJECT-BOOK-INSIGHTS-WITH-PLOTLY

Plotly-Dash NLP project. Document similarity measure using Latent Dirichlet Allocation, principal component analysis and finally follow with KMeans clustering. Project is completed with dynamic visual interaction.

ilinguistics /common_crawl_corpus

Scripts for building a geo-located web corpus using Common Crawl data

ku-nlp /kyoto-reader

A processor for KyotoCorpus, KWDLC, and AnnotatedFKCCorpus

NathanDuran /Maptask-Corpus

Utilities for Processing the HCRC Map Task Corpus