HSMR

Reconstructing Humans with a Biomechanically Accurate Skeleton

Reconstructing Humans with a Biomechanically Accurate Skeleton
Yan Xia, Xiaowei Zhou, Etienne Vouga, Qixing Huang, Georgios Pavlakos
CVPR 2025 (Oral)

📢 News

• [2025.04.04] HSMR has been accepted as Oral paper at CVPR 2025! 🎉
• [2025.03.28] Release HSMR demo code, evaluation code and training code.

⚒️ Setup

1. 🌏 Environment Setup
2. 📦 Data Preparation

🚀 Demo & Quick Start

python exp/run_demo.py --help

Quick start with images:

# Folders wil be identified as image folders by default if `--input_type` is not specified.
python exp/run_demo.py --input_path "data_inputs/demo/example_imgs"

Quick start with videos:

# Single file wil be identified as a video by default if `--input_type` is not specified.
python exp/run_demo.py --input_path "data_inputs/demo/example_videos/gymnasts.mp4"

Tips: Rendering skeleton meshes is pretty slow. For videos, adding --ignore_skel or decrease --max_instances could boost the speed. Check lib/kits/hsmr_demo.py:parse_args() for more details.

🧱 Reproducibility

For reproducing the results in the paper, please refer to docs/EVAL.md and docs/TRAIN.md.

We also provide the SKELify optimization pipeline, which optimizes SKEL parameters according to trustworthy 2D keypoints. Please refer to docs/OPTIM.md for more details.

🗓️ TODOs

• Release Colab demo.
• Release Huggingface demo.
• Release SKELify pipeline.
• Release training code & data.

📝 Citation

@inproceedings{xia2025hsmr,
  title={Reconstructing Humans with a Biomechanically Accurate Skeleton},
  author={Xia, Yan and Zhou, Xiaowei and Vouga, Etienne and Huang, Qixing and Pavlakos, Georgios},
  booktitle={CVPR},
  year={2025},
}

📜 Acknowledgement

Parts of the code are adapted from the following repos: SKEL, 4D-Humans/HMR2.0, SMPLify-X, SPIN, ProHMR, ViTPose, Detectron2, and GVHMR.