positional-encoding 开源项目推荐（133 个）

lucidrains /rotary-embedding-torch

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

liruilong940607 /prope

Cameras as Relative Positional Encoding

therealoliver /Deepdive-llama3-from-scratch

分步实现llama 3推理，掌握核心概念，掌握流程推导，实现代码。

guyyariv /DyPE

[ICML 2026] “DyPE：面向超高分辨率扩散的动态位置外推”的官方实现。

zylwithxy /HRDiT

[ECCV 2026] Official implementation of "HRDiT: Training-Free High-Resolution Image Generation with Off-the-Shelf Diffusion Transformer Models"

yiqun-wang /PET-NeuS

PET-NeuS: Positional Encoding Tri-Planes for Neural Surfaces (CVPR 2023)

vijaydwivedi75 /gnn-lspe

Source code for GNN-LSPE (Graph Neural Networks with Learnable Structural and Positional Representations), ICLR 2022

universome /inr-gan

[CVPR 2021] Adversarial Generation of Continuous Images

ziplab /FASeg

[CVPR 2023] This is the official PyTorch implementation for "Dynamic Focus-aware Positional Queries for Semantic Segmentation".

willGuimont /learnable_fourier_positional_encoding

Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding

gcambara /cape

Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch

Breeze648 /Transformer-from-Scratch

本仓库定位为 AI论文复现 / 从零实现 Transformer。 代码遵循原论文的模块划分，包含位置编码、多头注意力、前馈网络、编码器‑解码器等全部组件，并附带详细的中文拆解文档与英文注释，方便学习与二次开发。

VITA-Group /Ms-PoE

"Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiwei Liu, Zhewei Yao, Olatunji Ruwase, Beidi Chen, Xiaoxia Wu, Zhangyang Wang.

osiriszjq /complex_encoding

Trading Positional Complexity vs Deepness in Coordinate Networks

AliAmini93 /ViViT-Medical-Video-Classification

Developed the ViViT model for medical video classification, enhancing 3D organ image analysis using transformer-based architectures.

HySonLab /Multires-Graph-Transformer

Multiresolution Graph Transformers and Wavelet Positional Encoding for Learning Long-Range and Hierarchical Structures

imics-lab /positional-encoding-benchmark

This repository offers a comprehensive overview and quantitative benchmarking of positional encoding methods in transformer-based time series models.

liaoyanqing666 /transformer_pytorch

完整的原版transformer程序，complete origin transformer program

oceanflowlab /QuatRoPE

[CVPR 2026] Scalable Object Relation Encoding for Better 3D Spatial Reasoning in Large Language Models

AlgonetLabs /Cable

Context-aware Biases for Length Extrapolation