from-scratch 开源项目推荐（3,513 个）

rasbt /LLMs-from-scratch

从零开始，逐步用 PyTorch 实现一个类似 ChatGPT 的大语言模型

rohitg00 /ai-engineering-from-scratch

学习 AI 工程！学习它，构建它，为他人交付它。

FareedKhan-dev /kimi-k3-in-c

2.78万亿参数Kimi K3在8.24 GB RAM中的单个中央处理器上运行推理。便携式C99：无BLAS、无框架、无图形处理器。

raiyanyahya /how-to-train-your-gpt

Build a modern LLM from scratch. Every line commented. Explained like we are five.

zauonlok /renderer

A shader-based software renderer written from scratch in C89

Exorust /TorchLeet

LeetCode for PyTorch — 65 ML/AI interview problems from real interviews at Google, Meta, Anthropic. Jupyter notebooks, an auto-grader, and an MCP AI tutor.

fancyboi999 /ai-engineering-from-scratch-zh

Agent工程师最全学习路径 · 从零精通 AI 工程 · 20 阶段 503 课 · 中文全量翻译 + 配套站点 + 动画讲解视频 · 如何成为 AI Agent 工程师的修成指南

solcloud /Counter-Strike

多人第一人称射击游戏 - 反恐精英：橄榄球 🏉

keyvank /femtoGPT

纯Rust实现的最小生成预训练变换器

TrenTorch /TrenTorch

Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning

szq0214 /DSOD

DSOD: Learning Deeply Supervised Object Detectors from Scratch. In ICCV 2017.

PhilippRados /wrecc

A x86_64 C99 compiler written in Rust from scratch

YuvrajSingh-mist /Paper-Replications-and-Experiments

From-scratch PyTorch replications of classic and SOTA AI/ML papers: transformers, attention, GANs, diffusion, CLIP, LoRA, MoE, plus SFT/GRPO post-training experiments.

themartiano /luz

C++ Path Tracer from scratch with zero third-party libraries.

aa1143 /NamiAgent

零基础入门 AI Agent 的基础教程。不只是教程，也是一个能在本地跑起来的 Agent：读写文件、执行命令、MCP、长期记忆，自带网页端看清每一步。从 100 行最小循环开始，一课加一个能力，最后拆解 Claude Code、Codex 等主流 Agent

kasvith /kache

A simple in memory cache written using go

sagi21805 /LearnixOS

An OS which is all about learning!

YuvrajSingh-mist /NeatRL

Readable single-file PyTorch implementations of deep RL algorithms

admtrv /objcurses

ncurses 3d object viewer

zeyadusf /LLMs-from-Scratch

Build a Large Language Model (From Scratch) book and Finetuned Models