language-classification 开源项目推荐（43 个）

pemistahl /lingua-py

Python最准确的自然语言检测库，适合短文本和混合语言文本

pemistahl /lingua-go

The most accurate natural language detection library for Go, suitable for short text and mixed-language text

pemistahl /lingua-rs

The most accurate natural language detection library for Rust, suitable for short text and mixed-language text

pemistahl /lingua

The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike

cisnlp /GlotLID

[EMNLP 2023] 💬 Language Identification with Support for More Than 2000 Labels

oscar-project /ungoliant

🕷️ The pipeline for the OSCAR corpus

oscar-project /goclassy

An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.

nitotm /efficient-language-detector

Fast and accurate natural language detection. Detector written in PHP. Nito-ELD, ELD.

JasonFengGit /RNN-Language-Classifier

A Language Classifier powered by Recurrent Neural Network implemented in Python without AI libraries. AI from scratch.

searchpioneer /lingua-dotnet

Natural language detection library for .NET, suitable for long and short text alike

gokadin /hyperdimensional-computing

Hyperdimensional computing explained and demonstrated

omarmhaimdat /whatlang-pyo3

Python Binding for Rust WhatLang, a language detection library

hb20007 /greek-dialect-classifier

Classifier that identifies Greek text as Cypriot Greek or Standard Modern Greek

nitotm /eldc

The fastest high-accuracy natural language detector. Written in C.

thunderpoot /isogloss

ISO 639 and IETF Language Code Lookup Tool

sileixinhua /Python_sklearn_svm_language

语言识别数据集的基本数据分析方法，包括SVM算法。

jfernsler /ASRS_Classifier

Language classifier based on BERT to classify Aviation Safety Reporting System (ASRS) narratives into categories that were clustered by using language embedding similarity.

Katashynskyi /Voice_assistant_UA_EN

No api-keys | local | llama3.1 For language studying and live translation

sbdzdz /hate-tweet

Detecting hate speech in tweets using bag-of-trick models and bi-LSTM networks.

azagniotov /language-detection

This is a refined and re-implemented version of the archived plugin for ElasticSearch elasticsearch-langdetect, which itself builds upon the original work by Nakatani Shuyo, found at https://github.com/shuyo/language-detection. The aforementioned implementation by Nakatani Shuyo serves as the default language detection component within Apache Solr.