Towards Multi-Layered 3D Garments Animation
ICCV, 2023
Realistic Predictions (Non-SMPL Human)
D-LAYERS Dataset Samples
The
Abstract
Mimicking realistic dynamics in 3D garment animations is a challenging task due to the complex nature of multi-layered garments and the variety of outer forces involved. Existing approaches mostly focus on single-layered garments driven by only human bodies and struggle to handle general scenarios. In this paper, we propose a novel data-driven method, called LayersNet, to model garment-level animations as particle-wise interactions in a micro physics system. We improve simulation efficiency by representing garments as patch-level particles in a two-level structural hierarchy. Moreover, we introduce a novel Rotation Equivalent Transformation with Rotation Invariant Attention that leverage the rotation invariance and additivity of physics systems to better model outer forces. To verify the effectiveness of our approach and bridge the gap between experimental environments and real-world scenarios, we introduce a new challenging dataset, D-LAYERS, containing 700K frames of dynamics of 4,900 combinations of multi-layered garments driven by human bodies and randomly sampled wind. Our LayersNet achieves superior performance both quantitatively and qualitatively.
Dataset
D-LAYERS
Diverse Dynamics
Triple Garments
Experiments
Qualitative Results
Predicted Animatioins with Customized Settings
Predicted Animatioins
Baseline Comparisons
Experimental
Results
Euclidean error (mm) on sampled D-LAYERS with maximum sequence length of 35 frames. The collision rates between different layers of garments are shown under L-Collision, while the collision rates between garments and human bodies are shown under H-Collision. Models trained with full collision loss are marked by +. Our LayersNet achieves superior results in all cases.
Methods
Jacket
Jacket + Hood
Dress
Jumpsuit
Skirt
DeePSD+
1830.1±803.3
1566.0±527.1
1333.0±349.2
1219.0±186.8
1194.7±311.2
GarSim+
1412.1±886.8
1139.1±653.5
674.4±451.8
317.8±157.4
689.9±386.7
LayersNet(Ours)
571.9±451.9
493.9±354.2
397.2±342.2
264.0±200.2
301.3±79.3
LayersNet+(Ours)
567.3±425.5
491.4±361.3
379.1±299.7
260.1±222.2
299.5±92.3
Methods
Pants
T-shirt
Overall
L-Collision(%)
H-Collision(%)
DeePSD+
1185.7±213.3
1202.9±233.6
1563.4.9±486.8
8.78±5.12
19.47±6.38
GarSim+
317.8±150.1
447.6±303.8
1028.3±581.0
6.03±4.23
15.11±7.11
LayersNet(Ours)
234.4±206.3
273.3±169.0
472.8±343.5
3.13±2.22
10.68±4.53
LayersNet+(Ours)
200.9±140.1
267.8±189.6
467.2±330.7
3.77±2.60
2.16±1.46
Paper
Citation
@InProceedings{shao2023layersnet,
author = {Shao, Yidi and Loy, Chen Change and Dai, Bo},
title = {Towards Multi-Layered 3D Garments Animation},
booktitle = {ICCV},
year = {2023}
}
Experiments
Qualitative Results
Predicted Animatioins with Customized Settings
Predicted Animatioins
Baseline Comparisons
Baseline Comparisons
Experimental
Results
Methods | Jacket | Jacket + Hood | Dress | Jumpsuit | Skirt |
---|---|---|---|---|---|
DeePSD+ | 1830.1±803.3 | 1566.0±527.1 | 1333.0±349.2 | 1219.0±186.8 | 1194.7±311.2 |
GarSim+ | 1412.1±886.8 | 1139.1±653.5 | 674.4±451.8 | 317.8±157.4 | 689.9±386.7 |
LayersNet(Ours) | 571.9±451.9 | 493.9±354.2 | 397.2±342.2 | 264.0±200.2 | 301.3±79.3 |
LayersNet+(Ours) | 567.3±425.5 | 491.4±361.3 | 379.1±299.7 | 260.1±222.2 | 299.5±92.3 |
Methods | Pants | T-shirt | Overall | L-Collision(%) | H-Collision(%) |
DeePSD+ | 1185.7±213.3 | 1202.9±233.6 | 1563.4.9±486.8 | 8.78±5.12 | 19.47±6.38 |
GarSim+ | 317.8±150.1 | 447.6±303.8 | 1028.3±581.0 | 6.03±4.23 | 15.11±7.11 |
LayersNet(Ours) | 234.4±206.3 | 273.3±169.0 | 472.8±343.5 | 3.13±2.22 | 10.68±4.53 |
LayersNet+(Ours) | 200.9±140.1 | 267.8±189.6 | 467.2±330.7 | 3.77±2.60 | 2.16±1.46 |
Paper
Citation
@InProceedings{shao2023layersnet,
author = {Shao, Yidi and Loy, Chen Change and Dai, Bo},
title = {Towards Multi-Layered 3D Garments Animation},
booktitle = {ICCV},
year = {2023}
}