UniK3D: Universal Camera Monocular 3D Estimation – Luigi Piccinelli

UniK3D is capable of estimating metric 3D scenes across domains and for any camera from solely single images. UniK3D directly predicts metric 3D points from the input image at inference time without any additional information. Abstract Monocular 3D estimation is crucial for visual perception. However, current methods fall short by relying on oversimplified assumptions, such as pinhole camera models or rectified images. These limitations severely restrict their general applicability, causing poor performance in real-world scenarios with fisheye or panoramic images and resulting in substantial context loss. To address this, we present UniK3D, the first generalizable method for monocular 3D estimation able to model any camera. Our method introduces a spherical 3D representation which allows for better disentanglement of camera and scene geometry and enables accurate metric 3D reconstruction for unconstrained camera models. Our camera component features a novel, model-independent represe ... Read full article.