HUMOS: HUman MOtion Model Conditioned on Body Shape

ECCV 2024

1Max Planck Institute for Intelligent Systems, 2Epic Games

Generating 3D human motion conditioned on body shape. People with different body shapes perform the same motion differently. Our method, HUMOS, generates natural, physically plausible, and dynamically stable human motions based on body shape. HUMOS introduces a novel identity-preserving cycle consistency loss and uses differentiable dynamic stability and physics terms to learn an identity-conditioned manifold of human motions. The illustration shows the same walking motion with a skip-step in the middle, generated by HUMOS for five different identities. To demonstrate shape-conditioning, we visualize the same motion, changing the identity after every 30 frames.

Abstract

Generating realistic human motion is essential for many computer vision and graphics applications. The wide variety of human body shapes and sizes greatly impacts how people move. However, most existing motion models ignore these differences, relying on a standardized, average body. This leads to uniform motion across different body types, where movements don't match their physical characteristics, limiting diversity. To solve this, we introduce a new approach to develop a generative motion model based on body shape. We show that it's possible to train this model using unpaired data by applying cycle consistency, intuitive physics, and stability constraints, which capture the relationship between identity and movement. The resulting model generates diverse, physically plausible, and dynamically stable human motions that are both quantitatively and qualitatively more realistic than current state-of-the-art methods.

Contact

For technical questions, please contact shashank.tripathi123@gmail.com
For commercial licensing, please contact carsten.stoll@epicgames.com

BibTeX

@inproceedings{tripathi2024humos,
  title     = {{HUMOS}: Human Motion Model Conditioned on Body Shape},
  author    = {Tripathi, Shashank and Taheri, Omid and Lassner, Christoph and Black, Michael J. and Holden, Daniel and Stoll, Carsten},
  booktitle = {European Conference on Computer Vision ({ECCV})},
  year      = {2024},
}