Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization
- Updated
Jun 6, 2026 - JavaScript
langauge-model - 技术专题
相关标签
Here are 27 public repositories matching this topic...
Traditional Mandarin LLMs for Taiwan
- Updated
Apr 20, 2025 - Python
Natural Language Processing (NLP). Covering topics such as Tokenization, Part Of Speech tagging (POS), Machine translation, Named Entity Recognition (NER), Classification, and Sentiment analysis.
nlp natural-language-processing awesome machine-translation natural-language speech-synthesis speech-recognition awesome-list nlp-parsing nlp-resources nlp-library semantic-search speech-processing nlp-machine-learning nlp-keywords-extraction speech-enhancement langauge-model gpt-3 natural-language-procressing
- Updated
Jan 4, 2024 - Python
Tensorflow implementation of Semi-supervised Sequence Learning (https://arxiv.org/abs/1511.01432)
- Updated
Oct 29, 2022 - Python
Source code for our paper: "ARIA: Training Language Agents with Intention-Driven Reward Aggregation".
- Updated
Aug 9, 2025 - Python
Python scripts and datasets of the "Extremely Low-Resource Neural Machine Translation: A Case Study of Cantonese" project
machine-translation transformer neural-machine-translation cantonese transfer-learning lstm-neural-networks unsupervised-machine-learning langauge-model unsupervised-machine-translation cantonese-machine-translation
- Updated
Oct 28, 2022 - Python
Initial Exploratory Works on Knowledge Tracing in Transformer Based Language Models
- Updated
Feb 21, 2024 - Python
From-scratch 0.15B BitNet 1.58-bit (ternary) RWKV-7 LLM trained on an 8GB GPU — QAT, 2-bit packing, RFT, local chat app.
deep-learning cuda pytorch quantization from-scratch bitnet langauge-model ternary-weights quantization-aware-training llm rwkv
- Updated
May 30, 2026 - Python
Worth-reading papers and related resources on pretrained-language models(PLMs). On the Shoulder of Giants!
- Updated
Sep 11, 2025 - Jupyter Notebook
A small language model built from scratch in PyTorch utilizing transformers. Trained on WikiText-2 with character- and word-level tokenization. Educational project to explore embeddings, positional encodings, multi-head self-attention, and transformer decoder blocks for text generation.
- Updated
Sep 25, 2025 - Python
Custom GPT-2 (124M) built from scratch in PyTorch — Multi-Head Attention, Transformer Blocks, SSE streaming, and an OpenAI-compatible REST API. No SDKs. Just raw math.
nlp docker flask deep-learning sse pytorch transformer from-scratch langauge-model gpt-2 huggingface llm
- Updated
May 31, 2026 - Python
An end-to-end RNN-based text generation pipeline built with PyTorch. Includes web scraping, preprocessing, vocabulary construction, sequence generation, model training, and sample text generation.
nlp natural-language-processing text-mining ai deep-learning text-generation pytorch web-scraping neural-networks rnn langauge-model ai-engineer ai-engineering
- Updated
Jun 22, 2025 - Jupyter Notebook
This repository contains the training, evaluation, and inference code for a Sign Language Production (SLP) system based on the principles of the SOKE (Sign as Tokens) architecture. The goal of this system is to translate spoken language (text) into highly realistic, continuous 3D SL motion.
- Updated
Jul 28, 2026 - Python
Official Code for ReactionTeam: Teaming Experts for Divergent Thinking Beyond Typical Reaction Patterns (In IEEE Conference BigData 2025 Oral)
- Updated
Nov 12, 2025 - Python
Vector Space Model and Language Model for Information Retrieval system based on collections of text documents.
- Updated
Jan 31, 2022 - Python
Redefining prompt engineering as structured cognition.
- Updated
Aug 15, 2025
This repository contains the code and resources for the paper "Exploring Explainability in Arabic Language Models: An Empirical Analysis of Techniques," accepted at ACLing 2024.
- Updated
Jul 15, 2026 - Python
This repo contains notes of the Spacy Masterclass (NLP Course)
- Updated
Jul 3, 2023 - Jupyter Notebook
A hands-on implementation of the technologies behind modern Large Language Models, covering gradient descent, backpropagation, tokenization, transformers, self-attention, and GPT architecture. The project emphasizes understanding AI systems from first principles rather than relying solely on high-level frameworks.
machine-learning natural-language-processing deep-learning neural-network transformers text-generation pytorch artificial-intelligence attention gradient-descent backpropagation tokenization self-attention langauge-model large-language-models generative-pre-trained-transformer decoder-only-transformer
- Updated
Jun 12, 2026 - Python