AutoPhyX predicts text-conditioned physical properties that work with Gaussian splats

Bei Huang, Yixin Chen, Hongbin Zha, Yuru Pei and Siyuan Huang present AutoPhyX, a text-conditioned framework for predicting spatially varying physical properties for 4D simulation. Because appearance alone cannot distinguish properties such as the stiffness of rubber, the method trains on a part-controllable dataset that decomposes 3D assets into semantic components paired with physically plausible parameters and text descriptions, and uses text features to modulate visual features.
Property prediction is formulated as a voxel field, so the same output is compatible with meshes, point clouds, Gaussian Splatting and NeRF. The authors report physically plausible, text-driven parameter assignment in a single forward pass, with robust generalization to in-the-wild objects.