low-resource-languages 开源项目推荐（568 个）

RichardLitt /low-resource-languages

A curated list of resources for the conservation, development, and documentation of low resource (human) languages.

csebuetnlp /xl-sum

本仓库包含论文《XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages》的代码、数据和模型，该论文发表于Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021。

cisnlp /GlotLID

[EMNLP 2023] 💬 Language Identification with Support for More Than 2000 Labels

csebuetnlp /banglanmt

本仓库包含论文《Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Datasets for Bengali-English Machine Translation》的代码和数据，该论文发表于 2020 年自然语言处理经验方法会议（EMNLP 2020）论文集，2020 年 11 月 16 日至 20 日。

AuvroIslam /Nongor

Offline crisis companion for Bangladesh floods. Signed phone-to-phone SOS, flood-avoiding shelter routing, first aid and emergency translation for six languages Google Translate doesn't carry — no internet, no server, no account. Gemma 4 runs on the handset.

salikhussain71-code /PAKGOV-RAG-project

Research project on bilingual Urdu-English retrieval-augmented generation for Pakistani government and legal documents, with OCR, hybrid retrieval, citation grounding, and evaluation.

Andrews2017 /africanlp-public-datasets

A repository for publicly/freely available Natural Language Processing (NLP) datasets for African languages.

somastllc /somali-nlp-corpus

Somali NLP Corpus is an open, high-quality Somali text corpus designed to support research and development in Natural Language Processing (NLP), Large Language Models (LLMs), and other AI applications for the Somali language.

somastllc /somali-language-standard

The open, machine-readable standard for the Somali language — orthography, grammar, terminology, translation, and AI/benchmark resources, as a versioned, citable RFC-style catalog.

sefineh-ai /Amharic-Tokenizer

Syllable-aware BPE tokenizer for the Amharic language (አማርኛ) – fast, accurate, trainable.

ljvmiranda921 /calamanCy

NLP pipelines for Tagalog using spaCy

Rumeysakeskin /Turkish-Text-to-Speech

Speech synthesis (TTS) in low-resource languages by training from scratch with Fastpitch and fine-tuning with HifiGan

back-kh /SADA-Ancient-Palm-Leaf-Manuscripts-Recognitions

[PRL 2025, APSIPA 2022] Syllable Analysis Data Augmentation (SADA), This project introduces a glyph dictionary and grammar-aware augmentation strategy designed to enhance Khmer palm leaf manuscript recognition. By modeling the language's grammatical structure, we support more robust OCR performance in low-resource settings.

jcblaisecruz02 /Filipino-Text-Benchmarks

开源基准数据集和菲律宾语预训练变压器模型。

emotion-analysis-project /SemEval2025-Task11

SemEval2024-task 11: Bridging the Gap in Text-Based Emotion Detection

kbatsuren /CogNet

CogNet: a large-scale, high-quality cognate database for 338 languages, 1.07M words, and 8.1 million cognates

EveryVoiceTTS /EveryVoice

The EveryVoice TTS Toolkit - Text To Speech for your language

hausanlp /NaijaSenti

This is a repository for NaijaSenti. A Lacuna Funded Project for the development of sentiment corpus for four Nigerian languages: Igbo, Hausa, Yoruba and Pidgin.

kaunghtetsan275 /ricelang

Tiny language detector + tokenizer for 50+ SE/South Asian languages (Burmese, Karen, Chin, Shan, Mon, Khmer, Lao, Thai, Tamil, Hindi, …). Revamp of pyidaungsu.

xzx34 /Cross-Lingual-Pitfalls

ACL 2025: Search-based multilingual LLM evaluation that discovers English-correct, target-language-wrong failures; code and 6,713-pair dataset across 16 languages.