Unified Shape and SVBRDF Recovery using Differentiable Monte Carlo Rendering

نویسندگان

چکیده

Reconstructing the shape and appearance of real-world objects using measured 2D images has been a long-standing inverse rendering problem. In this paper, we introduce new analysis-by-synthesis technique capable producing high-quality reconstructions through robust coarse-to-fine optimization physics-based differentiable rendering. Unlike most previous methods that handle geometry reflectance largely separately, our method unifies both by leveraging image gradients with respect to object geometry. To obtain physically accurate gradient estimates, develop GPU-based Monte Carlo renderer recent advances in theory offer unbiased while enjoying better performance than existing tools like PyTorch3D [RRN*20] redner [LADL18]. further improve robustness, utilize several material priors as well strategy reconstruct Using synthetic real input images, demonstrate can produce higher quality methods.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

DiCE: The Infinitely Differentiable Monte-Carlo Estimator

The score function estimator is widely used for estimating gradients of stochastic objectives in Stochastic Computation Graphs (SCG), e.g., in reinforcement learning and meta-learning. While deriving the first order gradient estimators by differentiating a surrogate loss (SL) objective is computationally and conceptually simple, using the same approach for higher order gradients is more challen...

متن کامل

Mathematical Basics of Monte Carlo Rendering Algorithms

The high computational costs associated with global illumination in the field of computer graphics call for effective ways of handling complicated integrals and sums. This paper offers an overview of Monte Carlo methods, stochastic methods of approximating such constructs. Starting with the necessary mathematical basis for understanding Monte Carlo, the paper continues with a survey of sampling...

متن کامل

Efficient Monte Carlo rendering with realistic lenses

In this paper we present a novel approach to simulate image formation for a wide range of real world lenses in the Monte Carlo ray tracing framework. Our approach sidesteps the overhead of tracing rays through a system of lenses and requires no tabulation. To this end we first improve the precision of polynomial optics to closely match ground-truth ray tracing. Second, we show how the Jacobian ...

متن کامل

Recent Advances in Monte Carlo Offline Rendering

The research problems in Monte Carlo rendering have changed over the years. At first, the question was one of efficiency: how can we render an image quickly? Recent research has focused on rendering more complex effects, such as soft shadows and motion blur. There has also been research into the Monte Carlo technique itself; while it is a wellknown numerical technique, many subtleties have been...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Computer Graphics Forum

سال: 2021

ISSN: ['1467-8659', '0167-7055']

DOI: https://doi.org/10.1111/cgf.14344