A review of 3D neural stylization papers, mainly neural stylization on 3D data with image or text reference.
Other variants are also welcomed, e.g., with other/no reference, 3D-aware neural stylization, non-neural 3D stylization.
If you think I have missed out on something (or) have any suggestions (papers, implementations and other resources), feel free to pull a request
Feedback and contributions are welcome!
markdown format:
**Here is the Paper Name.**<br>
*[Author 1](homepage), Author 2, and Author 3.*<br>
Conference or Journal Year. <br>
[[Paper](link)] [[Project](link)] [[Github](link)] [[Video](link)] [[Data](link)]Advances in 3D Neural Stylization: A Survey
Yingshu Chen, Guocheng Shao, Ka Chun Shum, Binh-Son Hua, Sai-Kit Yeung. 2023.
If you find this work useful, please cite our paper:
@article{chen2023advances3dstyle,
title={Advances in 3D Neural Stylization: A Survey},
author={Chen, Yingshu and Shao, Guocheng and Shum, Ka Chun and Hua, Binh-Son and Yeung, Sai-Kit},
journal={arXiv preprint arXiv:2311.18328},
year={2023}
}Neural Style Transfer: A Review [Paper] [Project]
Yongcheng Jing, Yezhou Yang, Zunlei Feng, Jingwen Ye, Yizhou Yu, Mingli Song. TVCG, 2019.
Multimodal Image Synthesis and Editing: The Generative AI Era [Paper] [Project]
Fangneng Zhan, Yingchen Yu, Rongliang Wu, Jiahui Zhang, Shijian Lu, Lingjie Liu, Adam Kortylewski, Christian Theobalt, Eric Xing. TPAMI, 2023.
Diffusion Models in Vision: A Survey [Paper] [Project]
Florinel-Alin Croitoru, Vlad Hondru, Radu Tudor Ionescu, Mubarak Shah. TPAMI, 2023.
Diffusion Models: A Comprehensive Survey of Methods and Applications [Paper][Project]
Ling Yang, Zhilong Zhang, Yang Song, Shenda Hong, Runsheng Xu, Yue Zhao, Wentao Zhang, Bin Cui, Ming-Hsuan Yang. ACM Computing Surveys 2023.
State of the Art on Diffusion Models for Visual Computing [Paper] [Project]
Ryan Po, Yifan Wang, Vladislav Golyanik, Kfir Aberman, Jon T. Barron, Amit Bermano, Eric Chan, Tali Dekel, Aleksander Holynski, Angjoo Kanazawa, C. Karen Liu, Lingjie Liu, Ben Mildenhall, Matthias Niessner, Björn Ommer, Christian Theobalt, Peter Wonka, and Gordon Wetzstein. State of the Art Report at EUROGRAPHICS 2024.
State of the Art on Neural Rendering [Paper]
Ayush Tewari, Ohad Fried, Justus Thies, Vincent Sitzmann, Stephen Lombardi, Kalyan Sunkavalli, Ricardo Martin-Brualla, Tomas Simon, Jason Saragih, Matthias Nießner, Rohit Pandey, Sean Fanello, Gordon Wetzstein, Jun-Yan Zhu, Christian Theobalt, Maneesh Agrawala, Eli Shechtman, Dan B Goldman, Michael Zollhöfer. State of the Art Report at EUROGRAPHICS 2020.
Neural Rendering [Project] CVPR 2020 Tutorial.
Advances in Neural Rendering [Paper] [Project] SIGGRAPH 2021 Courses.
Advances in Neural Rendering [Paper]
Ayush Tewari, Justus Thies, Ben Mildenhall, Pratul Srinivasan, Edgar Tretschk, Yifan Wang, Christoph Lassner, Vincent Sitzmann, Ricardo Martin-Brualla, Stephen Lombardi, Tomas Simon, Christian Theobalt, Matthias Niessner, Jonathan T. Barron, Gordon Wetzstein, Michael Zollhoefer, Vladislav Golyanik. State of the Art Report at EUROGRAPHICS 2022.
Neural Fields in Visual Computing and Beyond [Paper] [Project]
Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, Srinath Sridhar. State of the Art Report at EUROGRAPHICS 2022.
Neural Fields for Visual Computing [Paper] [Project]
Towaki Takikawa, Shunsuke Saito, James Tompkin, Vincent Sitzmann, Srinath Sridhar, Or Litany, Alex Yu. SIGGRAPH 2023 Courses.
Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era [Paper]
Chenghao Li, Chaoning Zhang, Atish Waghwase, Lik-Hang Lee, Francois Rameau, Yang Yang, Sung-Ho Bae, Choong Seon Hong
Text-to-3D Shape Generation [Paper] [Project]
Han-Hung Lee, Manolis Savva, and Angel Xuan Chang. State of the Art Report at EUROGRAPHICS 2024.
3D Gaussian Splatting as New Era: A Survey [Paper]
Ben Fei, Jingyi Xu, Rui Zhang, Qingyuan Zhou, Weidong Yang, Ying He. TVCG 2024.
- Mesh Stylization (Detail)
- Neural Field Stylization (Detail)
- Multi-view Stylization
- Point Cloud Stylization (Detail)
- Volumetric Stylization (Detail)
- Implicit Shape Stylization
- Other 3D Stylization
- Related 3D Generation
- Evaluation
Text guidance: 
3D/4D guidance: 
Mesh Stylization
| Abbr. | Title | Venue | Paper | Project | Github |
|---|---|---|---|---|---|
| FlashTex |
FlashTex: Fast Relightable Mesh Texturing with LightControlNet | ECCV 2024(Oral) | [Paper] | [Project] | [Github] |
| TexGen |
TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resampling | ECCV 2024 | [Paper] | [Project] | |
| TexDreamer |
TexDreamer: Towards Zero-Shot High-Fidelity 3D Human Texture Generation | ECCV 2024 | [Paper] | [Project] | [Github] |
| Scene-Conditional 3D |
Scene-Conditional 3D Object Stylization and Composition | ECCV 2024 | [Paper] | [Project] | |
| VCD-Texture |
VCD-Texture: Variance Alignment based 3D-2D Co-Denoising for Text-Guided Texturing | ECCV 2024 | [Paper] | ||
| MMDMC |
Towards High-Quality 3D Motion Transfer with Realistic Apparel Animation | ECCV 2024 | [Paper] | [Data] | |
| StyleCity |
StyleCity: Large-Scale 3D Urban Scenes Stylization | ECCV 2024 | [Paper] | [Project] | [Github(TBA)] |
| Img2LEGO |
Creating LEGO Figurines From Single Images | SIGGRAPH 2024 | [Paper] | ||
| CNSTDM |
Controllable Neural Style Transfer for Dynamic Meshes | SIGGRAPH 2024 | [Paper] | ||
| HeadArtist |
HeadArtist: Text-conditioned 3D Head Generation with Self Score Distillation | SIGGRAPH 2024 | [Paper] | [Project] | [Github] |
| MaPa |
MaPa: Text-driven Photorealistic Material Painting for 3D Shapes | SIGGRAPH 2024 Conf Paper | [Paper] | [Project] | |
| DTP |
Diffusion Texture Painting | SIGGRAPH 2024 Conf Paper | [Paper] | [Project] | [Github] |
| TexPainter |
TexPainter: Generative Mesh Texturing With Multi-view Consistency | SIGGRAPH 2024 Conf Paper | [Paper] | [Project] | [Github] |
| DreamMat |
DreamMat: High-quality PBR Material Generation With Geometry- and Light-aware Diffusion Models | SIGGRAPH/TOG 2024 | [Paper] | [Project] | [Github] |
| EASI-Tex |
EASI-Tex: Edge-Aware Mesh Texturing from Single Image | SIGGRAPH/TOG 2024 | [Paper] | [Project] | [Github] |
| Coin3D |
Coin3D: Controllable and Interactive 3D Assets Generation With Proxy-guided Conditioning | SIGGRAPH 2024 Conf Paper | [Paper] | [Project] | [Github(TBA)] |
| ThemeStation |
ThemeStation: Generating Theme-Aware 3D Assets from Few Exemplars | SIGGRAPH 2024 Conf Paper | [Paper] | [Project] | [Github] |
| DressCode |
DressCode: Autoregressively Sewing and Generating Garments from Text Guidance | SIGGRAPH/TOG 2024 | [Paper] | [Project] | [Github] |
| MeshNCA |
Mesh Neural Cellular Automata | SIGGRAPH/TOG 2024 | [Paper] | [Project] | [Github] |
| Paint3D |
Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models | CVPR 2024 | [Paper] | [Project] | [Github] |
| TextureDreamer |
TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion | CVPR 2024 | [Paper] | [Project] | |
| TeMO |
TeMO: Towards Text-Driven 3D Stylization for Multi-Object Meshes | CVPR 2024 | [Paper] | [Github(TBA)] | |
| 3DPaintbrush |
3D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillation | CVPR 2024 | [Paper] | [Project] | [Github] |
| As-Plausible-As-Possible | As-Plausible-As-Possible: Plausibility-Aware Mesh Deformation Using 2D Diffusion Priors | CVPR 2024 | [Paper] | [Project] | [Github] |
| SceneTex |
SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors | CVPR 2024 | [Paper] | [Project] | [Github] |
| Paint-it |
Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Rendering | CVPR 2024 | [Paper] | [Project] | [Github] |
| DreamSpace |
Dreaming Your Room Space with Text-Driven Panoramic Texture Propagation | IEEE VR 2024 | [Paper] | [Project] | [Github] |
| TECA |
TECA: Text-Guided Generation and Editing of Compositional 3D Avatars | 3DV 2024 | [Paper] | [Project] | [Github] |
| StyleAvatar |
StyleAvatar: Stylizing Animatable Head Avatars | WACV 2024 | [Paper] | ||
| Text2Scene |
Text2Scene: Text-Driven Indoor Scene Stylization With Part-Aware Details | CVPR 2023 | [Paper] | [Video] | |
| TextDeformer |
TextDeformer: Geometry Manipulation using Text Guidance | SIGGRAPH 2023 Conf Paper | [Paper] | [Project] | [Github] |
| TEXTure |
TEXTure: Text-Guided Texturing of 3D Shapes | SIGGRAPH 2023 Conf Paper | [Paper] | [Project] | [Github] |
| Creative Birds |
Creative Birds: Self-Supervised Single-View 3D Style Transfer | ICCV 2023 | [Paper] | [Github] | |
| Text2Tex |
Text2Tex: Text-driven Texture Synthesis via Diffusion Models | ICCV 2023 | [Paper] | [Project] | [Github] |
| TexFusion |
TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models | ICCV 2023 | [Paper] | [Project] | |
| X-Mesh |
X-Mesh:Towards Fast and Accurate Text-driven 3D Stylization via Dynamic Textual Guidance | ICCV 2023 | [Paper] | [Project] | [Github] |
| Point-UV Diffusion |
Texture Generation on 3D Meshes with Point-UV Diffusion | ICCV 2023 | [Paper] | [Project] | [Github] |
| 3DStyle-Diffusion |
3DStyle-Diffusion: Pursuing Fine-grained Text-driven 3D Stylization with 2D Diffusion Models | ACM MM 2023 | [Paper] | [Github] | |
| RoomDreamer |
RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture | ACM MM 2023 | [Paper] | [Video] | |
| Decorate3D |
Decorate3D: Text-Driven High-Quality Texture Generation for Mesh Decoration in the Wild | NeurIPS 2023 | [Paper] | [Project] | [Github] |
| HyperDreamer |
HyperDreamer: Hyper-Realistic 3D Content Generation and Editing from a Single Image | SIGGRAPH Asia 2023 Conf Paper | [Paper] | [Project] | [Github] |
| AlteredAvatar |
AlteredAvatar: Stylizing Dynamic 3D Avatars with Fast Style Adaptation | Arxiv 2023 | [Paper] | [Project] | |
| HeadSculpt |
HeadSculpt: Crafting 3D Head Avatars with Text | Neurips 2023 | [Paper] | [Project] | [Github(TBA)] |
| StyleMesh |
StyleMesh: Style Transfer for Indoor 3D Scene Reconstructions | CVPR 2022 | [Paper] | [Project] | [Github] |
| Latent-NeRF |
Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures | CVPR 2022 | [Paper] | [Video] | [Github] |
| Text2Mesh |
Text2Mesh: Text-Driven Neural Stylization for Meshes | CVPR 2022 | [Paper] | [Project] | [Github] |
| TANGO |
TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decomposition | NeurIPS 2022 | [Paper] | [Project] | [Github] |
| CLIP-Mesh |
CLIP-Mesh: Generating textured meshes from text using pretrained image-text models | SIGGRAPH Asia 2022 | [Paper] | [Project] | [Github] |
| 3DStyleNet |
3DStyleNet: Creating 3D Shapes with Geometric and Texture Style | ICCV 2021 | [Paper] | [Project] | |
| DGTS |
Deep Geometric Texture Synthesis | SIGGRAPH 2020 | [Paper] | [Project] | [Github] |
| Paparazzi |
Paparazzi: Surface Editing by way of Multi-View Image Processing | SIGGRAPH Asia 2018 | [Paper] | [Project] | [Github] |
| Neural Renderer |
Neural 3D Mesh Renderer | CVPR 2018 | [Paper] | [Project] | [Github] |
Novel View or Neural Field Stylization
| Abbr. | Title | Venue | Paper | Project | Github |
|---|---|---|---|---|---|
| ReGS |
ReGS: Reference-based Controllable Scene Stylization with Gaussian Splatting | NeurIPS 2024 | [Paper] | ||
| WaSt-3D |
WaSt-3D: Wasserstein-2 Distance for Scene-to-Scene Stylization on 3D Gaussians | ECCV 2024 | [Paper] | [Project] | |
| LatentEditor |
LatentEditor: Text Driven Local Editing of 3D Scenes | ECCV 2024 | [Paper] | [Project] | [Github(TBA)] |
| MIGS |
MIGS: Multi-Identity Gaussian Splatting via Tensor Decomposition | ECCV 2024 | [Paper] | [Project] | |
| 3DEgo |
3DEgo: 3D Editing on the Go! | ECCV 2024 | [Paper] | [Project] | [Data] |
| VcEdit |
View-Consistent 3D Editing with Gaussian Splatting | ECCV 2024 | [Paper] | [Project] | |
| MALD-NeRF | Taming Latent Diffusion Model for Neural Radiance Field Inpainting | ECCV 2024 | [Paper] | [Project] | |
| DATENeRF |
DATENeRF: Depth-Aware Text-based Editing of NeRFs | ECCV 2024 | [Paper] | [Project] | |
| Gaussian Grouping | Gaussian Grouping: Segment and Edit Anything in 3D Scenes | ECCV 2024 | [Paper] | [Project] | [Github] |
| Watch Your Steps |
Watch Your Steps: Local Image and Scene Editing by Text Instructions | ECCV 2024 | [Paper] | [Project] | |
| CE3D |
Chat-Edit-3D: Interactive 3D Scene Editing via Text Prompts | ECCV 2024 | [Paper] | [Project] | [Github(TBA)] |
| GaussCtrl |
GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing | ECCV 2024 | [Paper] | [Project] | [Github] |
| Free-Editor |
Free-Editor: Zero-shot Text-driven 3D Scene Editing | ECCV 2024 | [Paper] | [Project] | [Github(TBA)] |
| Freditor |
Freditor: High-Fidelity and Transferable NeRF Editing by Frequency Decomposition | Arxiv 2024 | [Paper] | [Project] | |
| StyleGaussian |
StyleGaussian: Instant 3D Style Transfer with Gaussian Splatting | Arxiv 2024 | [Paper] | [Project] | [Github] |
| StylizedGS |
StylizedGS: Controllable Stylization for 3D Gaussian Splatting | Arxiv 2024 | [Paper] | ||
| 3DFaceHybrid |
3D Face Style Transfer with a Hybrid Solution of NeRF and Mesh Rasterization | WACV 2024 | [Paper] | ||
| NeRFEditor |
NeRFEditor: Differentiable Style Decomposition for 3D Scene Editing | WACV 2024 | [Paper] | [Project] | |
| TIP-Editor | TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts | SIGGRAPH/TOG 2024 | [Paper] | [Project] | [Github] |
| Portrait3D |
Portrait3D: Text-Guided High-Quality 3D Portrait Generation Using Pyramid Representation and GANs Prior | SIGGRAPH/TOG 2024 | [Paper] | [Project] | [Github] |
| SketchDream |
SketchDream: Sketch-based Text-to-3D Generation and Editing | SIGGRAPH/TOG 2024 | [Paper] | [Project] | [Github(TBA)] |
| DreamFont3D |
DreamFont3D: Personalized Text-to-3D Artistic Font Generation | SIGGRAPH 2024 Conf Paper | [Paper] | ||
| Spice-E |
Spice-E: Structural Priors in 3D Diffusion using Cross-Entity Attention | SIGGRAPH 2024 Conf Paper | [Paper] | [Project] | [Github] |
| 3Doodle |
3Doodle: Compact Abstraction of Objects with 3D Strokes | SIGGRAPH/TOG 2024 | [Paper] | ||
| ED-NeRF |
ED-NeRF: Efficient Text-Guided Editing of 3D Scene With Latent Space NeRF | ICLR 2024 | [Paper] | [Project] | |
| FPRF |
FPRF: Feed-Forward Photorealistic Style Transfer of Large-Scale 3D Neural Radiance Fields | AAAI 2024 | [Paper] | [Project] | [Github] |
| PNeSM |
PNeSM: Arbitrary 3D Scene Stylization via Prompt-Based Neural Style Mapping | AAAI 2024 | [Paper] | ||
| Neural3DStrokes (3D Strokes) |
Neural 3D Strokes: Creating Stylized 3D Scenes with Vectorized 3D Strokes | CVPR 2024 | [Paper] | [Project] | [Github] |
| Geo-SRF |
Geometry Transfer for Stylizing Radiance Fields | CVPR 2024 | [Paper] | [Project] | [Github(TBA)] |
| S-DyRF |
S-DyRF: Reference-Based Stylized Radiance Fields for Dynamic Scenes | CVPR 2024 | [Paper] | [Project] | [Github] |
| LAENeRF |
LAENeRF: Local Appearance Editing for Neural Radiance Fields | CVPR 2024 | [Paper] | [Project] | [Github] |
| PDS |
Posterior Distillation Sampling | CVPR 2024 | [Paper] | [Project] | [Github] |
| NeRF Analogies |
NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs | CVPR 2024 | [Paper] | [Project] | |
| UAV-ENeRF |
UAV-ENeRF: Text-driven UAV Scene Editing with Neural Radiance Fields | TGRS 2024 | [Paper] | ||
| SC-GS | SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes | CVPR 2024 | [Paper] | [Project] | [Github] |
| CineTransfer |
Cinematic Behavior Transfer via NeRF-based Differentiable Filming | CVPR 2024 | [Paper] | [Project] | [Github] |
| SC4D |
SC4D: Sparse-Controlled Video-to-4D Generation and Motion Transfer | Arxiv 2024 | [Paper] | [Project] | |
| GSDeformer | GSDeformer: Direct Cage-based Deformation for 3D Gaussian Splatting | Arxiv 2024 | [Paper] | [Project] | |
| IReNe | IReNe: Instant Recoloring of Neural Radiance Fields | CVPR 2024 | [Paper] | [Project] | |
| Control4D |
Control4D: Efficient 4D Portrait Editing with Text | CVPR 2024 | [Paper] | [Project] | |
| Instruct 4D-to-4D |
Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D Diffusion | CVPR 2024 | [Paper] | [Project] | |
| GaussianEditor(Huawei) |
GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions | CVPR 2024 | [Paper] | [Project] | |
| GaussianEditor(NTU) |
GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting | CVPR 2024 | [Paper] | [Project] | [Github] |
| CoARF |
CoARF: Controllable 3D Artistic Style Transfer for Radiance Fields | 3DV 2024 | [Paper] | [Project] | |
| RePaint-NeRF |
RePaint-NeRF: NeRF Editing via Semantic Masks and Diffusion Models | IJCAI 2023 | [Paper] | [Project] | [Github] |
| DreamEditor |
DreamEditor: Text-Driven 3D Scene Editing with Neural Fields | SIGGRAPH Asia 2023 Conf Paper | [Paper] | [Project] | [Github] |
| AvatarStudio |
AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars | SIGGRAPH Asia 2023 Conf Paper | [Paper] | [Project] | |
| UPST-NeRF |
UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scene | TVCG 2024 | [Paper] | [Project] | [Github] |
| ViCA-NeRF |
ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fields | NeurIPS 2023 | [Paper] | [Project] | [Github] |
| TSNeRF |
TSNeRF: Text-driven stylized neural radiance fields via semantic contrastive learning | Computers & Graphics 2023, CCF CAD/Graphics 2023 | [Paper] | ||
| LocalStyleNeRF |
Locally Stylized Neural Radiance Fields | ICCV 2023 | [Paper] | [Project] | [Github] |
| Instruct-NeRF2NeRF |
Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions | ICCV 2023 | [Paper] | [Project] | [Github] |
| Blending-NeRF |
Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fields | ICCV 2023 | [Paper] | [Project] | |
| Vox-E |
Vox-E: Text-guided Voxel Editing of 3D Objects | ICCV 2023 | [Paper] | [Project] | [Github] |
| ClimateNeRF | ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Field | ICCV 2023 | [Paper] | [Project] | [Github] |
| LipRF |
Transforming Radiance Field with Lipschitz Network for Photorealistic 3D Scene Stylization | CVPR 2023 | [Paper] | ||
| StyleRF |
StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fields | CVPR 2023 | [Paper] | [Project] | [Github] |
| Ref-NPR |
Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields for Controllable Scene Stylization | CVPR 2023 | [Paper] | [Project] | [Github] |
| SINE |
Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field | CVPR 2023 | [Paper] | [Project] | [Github] |
| NeRF-Art |
NeRF-Art: Text-Driven Neural Radiance Fields Stylization | TVCG 2023 | [Paper] | [Project] | [Github] |
| InstantNeRFStyle |
Instant Photorealistic Neural Radiance Fields Stylization | ICASSP 2024 | [Paper] [IEEE] |
[Github] | |
| SNeRF |
SNeRF: Stylized Neural Implicit Representations for 3D Scenes | SIGGRAPH 2022 | [Paper] | [Project] | |
| ArtNV |
Artistic Style Novel View Synthesis Based on A Single Image | CVPRW 2022, SIGGRAPH Posters 2022 | [Paper] | [Project] | [Github] |
| StylizedNeRF |
StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning | CVPR 2022 | [Paper] | [Project] | [Github] |
| 3D Photo Stylization |
3D Photo Stylization: Learning to Generate Stylized Novel Views from a Single Image | CVPR 2022 | [Paper] | [Project] | [Github] |
| ARF |
ARF: Artistic Radiance Fields | ECCV 2022 | [Paper] | [Project] | [Github] |
| INS |
Unified Implicit Neural Stylization | ECCV 2022 | [Paper] | [Project] | [Github] |
| HyperStyle |
Stylizing 3D Scene via Implicit Representation and HyperNetwork | WACV 2022 | [Paper] | [Project] | [Github] |
| LSNV |
Learning to stylize novel views | ICCV 2021 | [Paper] | [Project] | [Github] |
Multi-view / Light Field Stylization
| Abbr. | Title | Venue | Paper | Project | Github |
|---|---|---|---|---|---|
| MuVieCAST |
MuVieCAST: Multi-View Consistent Artistic Style Transfer | 3DV 2024 | [Paper] | [Project] | [Github] |
| LFST |
Style Transfer for Light Field Photography | WACV 2020 | [Paper] | [Github] | |
| NSIST |
Neural Stereoscopic Image Style Transfer | ECCV 2018 | [Paper] | ||
| StereoNST |
Stereoscopic Neural Style Transfer | CVPR 2018 | [Paper] | [Video] |
Point Cloud Stylization
| Abbr. | Title | Venue | Paper | Project | Github |
|---|---|---|---|---|---|
| PointInverter | PointInverter: Point Cloud Reconstruction and Editing via a Generative Model with Shape Priors | WACV 2023 | [Paper] | [Project] | |
| PSNet |
PSNet: A Style Transfer Network for Point Cloud Stylization on Geometry and Color | WACV 2020 | [Paper] | [Video] | [Github] |
Volumetric Stylization
| Abbr. | Title | Venue | Paper | Project | Github |
|---|---|---|---|---|---|
| StyleRF-VolVis |
StyleRF-VolVis: Style Transfer of Neural Radiance Fields for Expressive Volume Visualization | IEEE VIS 2024 | [Paper] | ||
| ShaDDR |
ShaDDR: Interactive Example-Based Geometry and Texture Generation via 3D Shape Detailization and Differentiable Rendering | SIGGRAPH Asia 2023 Conf Paper | [Paper] | [Project] | [Github] |
| ENST |
Efficient Neural Style Transfer For Volumetric Simulations | SIGGRAPH Asia 2022 | [Paper] | [Project] | |
| SKPN |
Volumetric appearance stylization with stylizing kernel prediction network | SIGGRAPH 2021 | [Paper] | [Video] | |
| LNST |
Lagrangian Neural Style Transfer for Fluids | SIGGRAPH 2020 | [Paper] | [Video] | [Github] |
| TNST |
Transport-Based Neural Style Transfer for Smoke Simulations | SIGGRAPH Asia 2019 | [Paper] | [Video] | [Github] |
Implicit Shape Stylization
| Abbr. | Title | Venue | Paper | Project | Github |
|---|---|---|---|---|---|
| NeuSDFusion | NeuSDFusion: A Spatial-Aware Generative Model for 3D Shape Completion, Reconstruction, and Generation | ECCV 2024 | [Paper] | [Project] | |
| CNS-Edit | CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimization | SIGGRAPH 2024 | [Paper] | ||
| EXIM |
EXIM: A Hybrid Explicit-Implicit Representation for Text-Guided 3D Shape Generation | SIGGRAPH Asia/TOG 2023 | [Paper] | [Project] | [Github] |
| SALAD |
SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulation | ICCV 2023 | [Paper] | [Project] | [Github] |
| Neural Wavelet | Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulation | SIGGRAPH Asia 2022 Conf Paper, TOG 2024 | [Paper] | [Github] | |
| SPAGHETTI | SPAGHETTI: Editing Implicit Shapes Through Part Aware Generation | SIGGRAPH/TOG 2022 | [Paper] | [Project] | [Github] |
Text guidance:
3D guidance:
| Abbr. | Title | Venue | Paper | Project | Github |
|---|---|---|---|---|---|
| Meta 3D AssetGen |
Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materials | NeurIPS 2024 | [Paper] | [Project] | |
| WordRobe |
WordRobe: Text-Guided Generation of Textured 3D Garments | ECCV 2024 | [Paper] | [Project] | |
| CRM |
CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Model | ECCV 2024 | [Paper] | [Github] | |
| HiFi-123 |
HiFi-123: Towards High-fidelity One Image to 3D Content Generation | ECCV 2024 | [Paper] | [Project] | [Github] |
| UniDream |
UniDream: Unifying Diffusion Priors for Relightable Text-to-3D Generation | ECCV 2024 | [Paper] | [Project] | [Github(TBA)] |
| GVGEN |
GVGEN: Text-to-3D Generation with Volumetric Representation | ECCV 2024 | [Paper] | [Project] | [Github] |
| DreamView |
DreamView: Injecting View-specific Text Guidance into Text-to-3D Generation | ECCV 2024 | [Paper] | [Github] | |
| ScaleDreamer |
ScaleDreamer: Scalable Text-to-3D Synthesis with Asynchronous Score Distillation | ECCV 2024 | [Paper] | [Project] | [Github] |
| RodinHD |
RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Models | ECCV 2024 | [Paper] | [Project] | [Github(TBA)] |
| BlockFusion | BlockFusion: Expandable 3D Scene Generation using Latent Tri-plane Extrapolation | SIGGRAPH/TOG 2024 | [Paper] | [Project] | [Github(TBA)] |
| MVD2 |
MVD2: Efficient Multiview 3D Reconstruction for Multiview Diffusion | SIGGRAPH 2024 Conf Paper | [Paper] | ||
| HiFA |
HiFA: High-fidelity Text-to-3D with Advanced Diffusion Guidance | ICLR 2024 | [Paper] | [Project] | [Github] |
| DreamCraft3D |
DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior | ICLR 2024 | [Paper] | [Project] | [Github] |
| DreamGaussian |
DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation | ICLR 2024 | [Paper] | [Project] | [Github] |
| Progressive3D |
Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts | ICLR 2024 | [Paper] | [Project] | [Github] |
| SyncDreamer |
SyncDreamer: Generating Multiview-consistent Images from a Single-view Image | ICLR 2024 | [Paper] | [Project] | [Github] |
| GaussianDreamer |
GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Models | CVPR 2024 | [Paper] | [Project] | [Github] |
| GSGEN |
GSGEN: Text-to-3D using Gaussian Splatting | CVPR 2024 | [Paper] | [Github] | |
| LucidDreamer |
LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes | CVPR 2024 | [Paper] | [Project] | [Github] |
| DreamFusion |
DreamFusion: Text-to-3D using 2D Diffusion | ICLR 2023 | [Paper] | [Project] | [Github] (unofficial) |
| SJC |
Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation | CVPR 2023 | [Paper] | [Project] | [Github] |
| Magic3D |
Magic3D: High-Resolution Text-to-3D Content Creation | CVPR 2023 | [Paper] | [Project] | |
| Fantasia3D |
Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation | ICCV 2023 | [Paper] | [Project] | [Github] |
| Zero-1-to-3 |
Zero-1-to-3: Zero-shot One Image to 3D Object | ICCV 2023 | [Paper] | [Project] | [Github] |
| ProlificDreamer |
ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation | NeurIPS 2023 | [Paper] | [Project] | [Github] |
| 3D VADER |
Autodecoding Latent 3D Diffusion Models | NeurIPS 2023 | [Paper] | [Project] | [Github] |
| CLIP-Mesh |
CLIP-Mesh: Generating textured meshes from text using pretrained image-text models | SIGGRAPH Asia 2022 Conf Paper | [Paper] | [Project] | [Github] |
Text guidance:
3D guidance:
| Abbr. | Title | Venue | Paper | Project | Github |
|---|---|---|---|---|---|
| Texture-GS | Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editing | ECCV 2024 | [Paper] | [Project] | [Github] |
| SMooDi |
SMooDi: Stylized Motion Diffusion Model | ECCV 2024 | [Paper] | [Project] | [Github] |
| SRFoE | Stylized Rendering as a Function of Expectation | SIGGRAPH/TOG 2024 | [Paper] | ||
| LayGA |
LayGA: Layered Gaussian Avatars for Animatable Clothing Transfer | SIGGRAPH 2024 Conf Paper | [Paper] | [Project] | |
| Stealth Shaper | Stealth Shaper: Reflectivity Optimization as Surface Stylization | SIGGRAPH 2023 Conf Paper | [Paper] | [Project] | [Github] |
| Stroke Transfer |
Stroke Transfer: Example-based Synthesis of Animatable Stroke Styles | SIGGRAPH 2022 Conf Paper | [Paper] | [Project] | [Github] |
| Normal-Driven |
Normal‐Driven Spherical Shape Analogies | Computer Graphics Forum, SGP 2021 | [Paper] | [Video] | [Github1] [Github2] |
| PBFLR | Physically-based Feature Line Rendering | SIGGRAPH Asia/TOG 2021 | [Paper] | [Project] | |
| StyleProp |
StyleProp: Real‐time Example‐based Stylization of 3D Models | Computer Graphics Forum, PG 2020 | [Paper] | [Project] | |
| StyleBlit |
StyleBlit: Fast Example‐Based Stylization with Local Guidance | Computer Graphics Forum, EG 2019 | [Paper] | [Project] | [Github] [Unity Plugin] |
| Cubic Stylization |
Cubic Stylization | SIGGRAPH Asia 2019 | [Paper] | [Project] | [Github1] [Github2] |
| StyleLit |
StyLit: Illumination-Guided Example-Based Stylization of 3D Renderings | SIGGRAPH 2016 | [Paper] | [Project] | [Demo] |
Neural 3D Mesh Renderer
Hiroharu Kato, Yoshitaka Ushiku, Tatsuya Harada
CVPR 2018. [Paper][Project] [Github]
Features:
- approximate gradient for rasterization
- single-image 3d mesh reconstruction with 2d supervision
- gradient-based 3d mesh editing including 2d->3d style transfer(image->mesh)
Paparazzi: Surface Editing by way of Multi-View Image Processing
Hsueh-Ti Derek Liu, Michael Tao, Alec Jacobson
SIGGRAPH Asia 2018. [Paper] [Project] [Github]
Features:
- image-guided mesh surface stylization
- vertex position optimization
- sample training cameras on the offset surface
3DStyleNet: Creating 3D Shapes with Geometric and Texture Style
Kangxue Yin, Jun Gao, Maria Shugrina, Sameh Khamis, Sanja Fidler
ICCV 2021. [Paper] [Project]
Features:
- 3D shape and texture style tranfer
- 3D textured model as guidance
- Large 3D data driven
StyleMesh: Style Transfer for Indoor 3D Scene Reconstructions
Lukas Höllein, Justin Johnson, Matthias Nießner
CVPR 2022. [Paper] [Project] [Github]
Features:
- 3D consistent texture optimization
- depth-aware and angle-aware optimization for equally-sized and unstreched stylization patterns
Text2Mesh: Text-Driven Neural Stylization for Meshes
Oscar Michel, Roi Bar-On, Richard Liu, Sagie Benaim, Rana Hanocka
CVPR 2022.[Paper] [Project] [Github]
Features:
- based on CLIP[Github]
- handle low quality meshes
TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decomposition
Yongwei Chen, Rui Chen, Jiabao Lei, Yabin Zhang, Kui Jia
Neurips 2022. [Paper] [Project] [Github]
Creative Birds: Self-Supervised Single-View 3D Style Transfer
Renke Wang, Guimin Que, Shuo Chen, Xiang Li, Jun Li, Jian Yang
ICCV 2023. [Paper] [Github]
Text2Scene: Text-Driven Indoor Scene Stylization With Part-Aware Details
Inwoo Hwang, Hyeonwoo Kim, Young Min Kim
CVPR 2023. [Paper] [Video] [Github]
TextDeformer: Geometry Manipulation using Text Guidance
William Gao, Noam Aigerman, Thibault Groueix, Vladimir G. Kim, Rana Hanocka
SIGGRAPH Conference Proceedings 2023. [Paper] [Project] [Github]
TEXTure: Text-Guided Texturing of 3D Shapes
Elad Richardson, Gal Metzer, Yuval Alaluf, Raja Giryes, Daniel Cohen-Or
SIGGRAPH Conference Proceedings 2023. [Paper] [Project] [Github]
Text2Tex: Text-driven Texture Synthesis via Diffusion Models
Dave Zhenyu Chen, Yawar Siddiqui, Hsin-Ying Lee, Sergey Tulyakov, Matthias Nießner
ICCV 2023. [Paper] [Project] [Github]
X-Mesh:Towards Fast and Accurate Text-driven 3D Stylization via Dynamic Textual Guidance
Yiwei Ma, Xiaioqing Zhang, Xiaoshuai Sun, Jiayi Ji, Haowei Wang, Guannan Jiang, Weilin Zhuang, Rongrong Ji
ICCV 2023. [Paper] [Project] [Github]
Transport-Based Neural Style Transfer for Smoke Simulations
Byungsoo Kim, Vinicius C. Azevedo, Markus Gross, Barbara Solenthaler
SIGGRAPH Asia 2019.| [Paper] [Video] [Github]
Features:
- dynamic smoke
- optimization-based stylization
Lagrangian Neural Style Transfer for Fluids
Byungsoo Kim, Vinicius C. Azevedo, Markus Gross, Barbara Solenthaler
SIGGRAPH 2020. [Paper] [Video] [Github]
Features:
- fluid
- optimization-based stylization
Volumetric appearance stylization with stylizing kernel prediction network
Jie Guo, Mengtian Li, Zijing Zong, Yuntao Liu, Jingwu He, Yanwen Guo, Ling-Qi Yan
SIGGRAPH 2021. [Paper)] [Video]|
Features:
- dynamic or static model
- arbitrary style transfer
Efficient Neural Style Transfer For Volumetric Simulations
Joshua Aurand, Raphaël Oritz, Sylvia Nauer, Vinicius Azevedo
ACM SIGGRAPH Asia, 2022. [Paper][Video]
Features:
- mainly for smoke
- view-independent stylization
- feed-forward network for acceleration
PSNet: A Style Transfer Network for Point Cloud Stylization on Geometry and Color
Xu Cao, Weimin Wang, Katashi Nagao, Ryosuke Nakamura
Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2020
[Paper] [Github] [Video]
Features:
- explicit point cloud stylization
- geometric and color stylization
Learning to stylize novel views
Hsin-Ping Huang, Hung-Yu Tseng, Saurabh Saini, Maneesh Singh, Ming-Hsuan Yang.
ICCV 2021. [Paper] [Project] [Github]
Features:
- Point-cloud based feature
- Style feature transformation
- Require MVS reconstruction, depth rendering
- zero-shot novel view stylization
3D Photo Stylization: Learning to Generate Stylized Novel Views from a Single Image
Fangzhou Mu, Jian Wang, Yicheng Wu, Yin Li
CVPR 2022. [Paper] [Project] [Github]
Features:
- pre-trained NeRF with color prediction module replaced with a style network
- mutual learning for two parts mentioned above
Artistic Style Novel View Synthesis Based on A Single Image
Kuan-Wei Tseng, Yao-Chih Lee, Chu-Song Chen
CVPR Workshop 2022 / SIGGRAPH Poster 2022.[Paper] [Project] [Github]
Features:
- based on Synsin(differentiable point cloud renderer)[Paper]
- occlusion aware dense matching
- mainly for VR
Stylizing 3D Scene via Implicit Representation and HyperNetwork
Pei-Ze Chiang, Meng-Shiun Tsai, Hung-Yu Tseng, Wei-sheng Lai, Wei-Chen Chiu.
WACV 2022. [Paper] [Project] [Github]
Features:
- hypernetwork to control NeRF weights
- two-step training and patch-subsampling
- zero-shot novel view stylization
StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning
Yi-Hua Huang, Yue He, Yu-Jie Yuan, Yu-Kun Lai, Lin Gao
CVPR 2022. [Paper] [Project] [Github]
Features:
- pre-trained NeRF with color prediction module replaced with a style network
- mutual learning for two parts mentioned above
- zero-shot novel view stylization
ARF: Artistic Radiance Fields
Kai Zhang, Nick Kolkin, Sai Bi, Fujun Luan, Zexiang Xu, Eli Shechtman, Noah Snavely
ECCV 2022. [Paper] [Project] [Github]
Features:
- pre-trained NeRF with color prediction module replaced with a style network
- mutual learning for two parts mentioned above
Unified Implicit Neural Stylization
Zhiwen Fan, Yifan Jiang, Peihao Wang, Xinyu Gong, Dejia Xu, Zhangyang Wang
ECCV 2022. [Paper] [Project] [Github]
Features:
- continuous in the style space(allow interpolation between styles)
Instant Neural Radiance Fields Stylization
Shaoxu Li, Ye Pan
[Paper] [Github]
Features:
- training for novel view stylization image synthesis only costs 10 minutes.
- extend the style target of NeRF stylization from images to 3D scene image sets
SNeRF: Stylized Neural Implicit Representations for 3D Scenes
Thu Nguyen-Phuoc, Feng Liu, Lei Xiao
SIGGRAPH 2022.[Paper]
Features:
- applies to indoor scenes, outdoor scenes and 4D dynamic avatars
- reduce GPU memory requirement
Transforming Radiance Field with Lipschitz Network for Photorealistic 3D Scene Stylization
Zicheng Zhang, Yinglu Liu, Congying Han, Yingwei Pan, Tiande Guo, Ting Yao
CVPR 2023. [Paper]
Features:
- photo-realistic
- based on Lipschitz transformation and condition
StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fields
Kunhao Liu, Fangneng Zhan, Yiwen Chen, Jiahui Zhang, Yingchen Yu, Abdulmotaleb El Saddik, Shijian Lu, Eric Xing
CVPR 2023. [Paper] [Project] [Github]
Features:
- zero-shot 3d stylization
- sampling-invariant content transformation
- deferring style transformation to 2D feature maps
- zero-shot novel view stylization
Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields for Controllable Scene Stylization
Yuechen Zhang, Zexin He, Jinbo Xing, Xufeng Yao, Jiaya Jia
CVPR 2023. [Paper] [Project] [Github]
Features:
- reference based ray registration process and a template-based feature matching scheme to achieve geometrically and perceptually consistent stylization
Locally Stylized Neural Radiance Fields
Hong-Wing Pang, Binh-Son Hua, Sai-Kit Yeung
ICCV 2023. [Paper] [Project] [Github]
Features:
- explicitly semantic match stylization
- based on instant-NGP
- room stylization
Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field
Chong Bao, Yinda Zhang, Bangbang Yang, Tianxing Fan, Zesong Yang, Hujun Bao, Guofeng Zhang, Zhaopeng Cui
CVPR 2023. [Paper] [Project] [Github]
Features:
- edit a photo-realistic NeRF with a single-view image or with text prompts
- cyclic constraints with a proxy mesh for geometric editing
- the color compositing mechanism to enhance texture editing
- feature-cluster-based regularization to control the affected editing area and maintain irrelevant parts unchanged
NeRF-Art: Text-Driven Neural Radiance Fields Stylization
Can Wang, Ruixiang Jiang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao
TVCG 2023. [Paper] [Project] [Github]
Features:
- combine CLIP[Github] with NeRF
- cover global structures and local details
- adopt a weight regularization to effectively reduce cloudy artifacts and geometry noises
Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions
Ayaan Haque, Matthew Tancik, Alexei A. Efros, Aleksander Holynski, Angjoo Kanazawa
ICCV 2023. [Paper] [Project] [Github]
Features:
- extract shape and appearance priors from a 2D diffusion model
- edit input images and change 3d implicit field representation
Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fields
ICCV 2023. [Paper] [Project]
Features:
- text-guided local editing