languagemodel 开源项目推荐（23 个）

salesforce /CodeGen

CodeGen 是一系列用于程序合成的开源模型。在 TPU-v4 上训练。可与 OpenAI Codex 竞争。

yobulkdev /yobulkdev

🔥 🔥 🔥Open Source & AI driven Data Onboarding Platform:Free flatfile.com alternative

salesforce /CodeRL

This is the official code for the paper CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning (NeurIPS22).

yxuansu /SimCTG

[NeurIPS'22 Spotlight] 面向神经文本生成的对比框架

TIGER-AI-Lab /CritiqueFineTuning

Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]

asahi417 /lmppl

用预训练的语言模型计算文本的困惑度。支持多层次传销（例如：DeBERTa），反复出现的LM（例如：GPT3），以及编码-解码器LM（例如：Flan-T5）。

CLUEbenchmark /LightLM

高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task

ViralLab /TurkishBERTweet

TurkishBERTweet: Fast and Reliable Large Language Model for Social Media Analysis

CLARIN-PL /embeddings

Embeddings: State-of-the-art Text Representations for Natural Language Processing tasks, an initial version of library focus on the Polish Language

shammur /SemEval2022Task3

The PreTENS shared task hosted at SemEval 2022 aims at focusing on semantic competence with specific attention on the evaluation of language models with respect to the recognition of appropriate taxonomic relations between two nominal arguments (i.e. cases where one is a supercategory of the other, or in extensional terms, one denotes a superset…

SALT-NLP /FormalityStyleTransfer

Code for "Semi-supervised Formality Style Transfer using Language Model Discriminator and Mutual Information Maximization"

spallas /wsd

A 78.5% word sense disambiguator based on Transformers and RoBERTa (PyTorch)

BigSalmon2 /InformalToFormalDataset

Informal to formal dataset mask MLM

ManuPer3z /Sentiment-Analysis-Project

A project that harnesses the Stanford NLP library to gauge sentiment from provided text via an intuitive graphical interface.

r1cc4rd0m4zz4 /traNsLatorLaB

translatorlab: a machine translation tool that uses artificial intelligence models to provide accurate and fast translations between different languages

voytas75 /TextGenerator-PowerShell

The PowerShell Random Text Generator is a script that generates random text based on a given model.

soumyagautam /Conversational-AI-Obsolete

This is an API which uses Google PaLM API to give responses to user requests

RadostinaIvanova /Personality-test

Personality test which classifies in four personality types. For the classification is used the natural language processing classification algorithm - Multinomial Naive-Bayes.

imirzadeh /RNN_LM

Language Model with RNN in tensorflow

WonYong-Jang /Text-Data-Analysis

N gram language model