Comparison of existing 3D style transfer methods and our DiLAST pipeline. (a) Existing methods rely solely on internal attention of 3D generative models and often fail when handling OOD styles. (b) In contrast, DiLAST leverages a pretrained 2D diffusion teacher, whose attention distillation gradients guide the denoising trajectory of 3D latents, successfully transferring arbitrary OOD styles.
Overview of our DiLAST. We leverage a 2D LDM as a teacher and optimize the 3D latent through three parallel branches, guiding the generated 3D asset toward the target style. The 3D asset highlighted by the green bracket, generated at the final optimization step, is the final output.
Each column is one example. From the content image in the first row and the style image in the second, DiLAST produces the stylized 3D asset shown in the third row.
Qualitative comparison against 3D style transfer baselines. Each column is one style image (top row) and each row is one content image (left of the row), repeated for the three methods. MorphAny3D and StyleSculptor drift away from the content geometry once the style is out of distribution, while DiLAST keeps the object intact and still takes on the style. Every result is a rendered orbit of the generated 3D asset.
A natural alternative is to run 2D style transfer on the content image first and then lift the stylized image to 3D. That route runs into a trade-off with no good setting. When content preservation is too strong, the style cannot be effectively transferred. Conversely, when content preservation is too weak, the stylized image deviates further from the training distribution of the 3D generative model, leading to poor generation quality. In practice, it is often difficult for 2D style transfer to find a suitable level of content preservation that remains “recognizable” to the 3D model. In contrast, DiLAST directly guides the 3D latents, indirectly injecting an appropriate degree of style into the latent space while achieving suitable content preservation, without being affected by the 2D stylized image.
If you find our work helpful, please consider citing us:
@article{qiao2026structured,
title={Structured {3D} Latents Are Surprisingly Powerful: Unleashing Generalizable Style with {2D} Diffusion},
author={Qiao, Yiran and Lu, Yiren and Zhou, Yunlai and Liu, Disheng and Hou, Linlin and Yang, Rui and Yin, Yu and Ma, Jing},
journal={arXiv preprint arXiv:2605.04412},
year={2026}
}