University of Leicester
Browse

Photometric Regularization for 3D Gaussian Splatting in Multi-View Surface Projection

Download (7.19 MB)
journal contribution
posted on 2025-11-07, 14:28 authored by Yakun JuYakun Ju, Y Zhao, J Xiao, C Zhang, Zheheng JiangZheheng Jiang, Huiyu ZhouHuiyu Zhou, W Zhou, H Yu, J Dong
3D surface representation from multi-view photometric stereo (MVPS) remains a challenging task due to accumulated errors and geometric inconsistencies in conventional fusion-based methods. While 3D Gaussian Splatting (3DGS) enables real-time rendering, its explicit point-based representation struggles to preserve fine geometric details when directly applied to MVPS. To address this limitation, we propose PSGS, a novel photometric-regularized Gaussian splatting framework that integrates surface normal priors to enhance multiview surface projection. Specifically, PS-GS introduces three regularization strategies: (1) normal-guided initialization, which aligns Gaussian splats with photometric surface normals; (2) adaptive splat cloning, which dynamically adjusts point density in regions with high normal variation to improve local detail preservation; and (3) visibility-aware occlusion handling, which ensures geometric consistency across multi-view projections. Unlike NeRF-based MVPS methods, our approach does not rely on implicit volumetric representations and instead optimizes explicit surface projections, achieving efficient and artifact-free rendering. Experimental results on the DiLiGenT-MV benchmark demonstrate that PS-GS significantly improves 2D photometric fidelity, achieving a 2.18 dB PSNR gain over NeRFbased MVPS methods while maintaining around 150× faster rendering efficiency. Additionally, our normal-guided splatting enhances view-consistent normal alignment, reducing artifacts in challenging regions. Although PS-GS does not perform full 3D mesh reconstruction or relighting, its efficient rendering and surface-aware regularization make it a promising approach for real-time multi-view image synthesis in MVPS applications.<p></p>

History

Author affiliation

University of Leicester College of Science & Engineering Comp' & Math' Sciences

Version

  • AM (Accepted Manuscript)

Published in

IEEE Journal on Selected Topics in Signal Processing

Publisher

Institute of Electrical and Electronics Engineers (IEEE)

issn

1932-4553

eissn

1941-0484

Copyright date

2025

Available date

2025-11-07

Language

en

Deposited by

Professor Huiyu Zhou

Deposit date

2025-10-30