FAU  >  Technische Fakultät  >  Informatik  >  Lehrstuhl 15 (Digital Reality)

 
[Unified Neural Encoding of BTFs]

Unified Neural Encoding of BTFs

Gilles Rainer1,  Abhijeet Ghosh2,  Wenzel Jakob3,  Tim Weyrich1

1 University College London
2 Imperial College London
3 Ecole Polytechnique Fédérale de Lausanne (EPFL)

Abstract

Realistic rendering using sets of discrete reflectance measurements is challenging, because any directions on the light and view hemispheres could be queried at render time. This motivates the need for continuous parametrizations and models akin to analytic BRDFs; however, fitting BRDF parameters to complex data such as BTF texels can prove challenging, as models tend to describe restricted function spaces that cannot encompass real-world behavior. Recent advances in this area have increasingly relied on neural representations that are trained to reproduce acquired reflectance data. The associated training process is extremely costly and must typically be repeated for each material. Inspired by autoencoders, we propose a unified network architecture that is trained on a variety of materials, and which projects reflectance measurements to a shared latent parameter space. Similarly to SVBRDF fitting, real-world materials are mapped to a set of parameters, and the decoder network is analog to the analytic BRDF expression (also parameterized on light and view directions for practical rendering application). With this approach, encoding materials becomes a simple matter of evaluating the network. We train and validate on BTF datasets of the University of Bonn, but there are no prerequisites on either the number of angular reflectance samples, or the sample positions. Additionally, we show that the latent space is well-behaved and can be sampled from, for applications such as mipmapping and texture synthesis.

Citation Style:    Publication

Unified Neural Encoding of BTFs.
Gilles Rainer, Abhijeet Ghosh, Wenzel Jakob, Tim Weyrich.
Computer Graphics Forum (Proc. Eurographics), 39(2), pp. 167–178, July 2020.
Gilles Rainer, Abhijeet Ghosh, Wenzel Jakob, and Tim Weyrich. Unified neural encoding of BTFs. Computer Graphics Forum (Proc. Eurographics), 39(2):167–178, July 2020.Rainer, G., Ghosh, A., Jakob, W., and Weyrich, T. 2020. Unified neural encoding of BTFs. Computer Graphics Forum (Proc. Eurographics) 39, 2 (July), 167–178.G. Rainer, A. Ghosh, W. Jakob, and T. Weyrich, “Unified neural encoding of BTFs,” Computer Graphics Forum (Proc. Eurographics), vol. 39, no. 2, pp. 167–178, Jul. 2020.

Acknowledgments

We would like to thank Reinhard Klein and his team for providing their BTF database. We would also like to acknowledge the EPSRC Early Career Fellowship EP/N006259/1, and the EPSRC grant EP/K023578/1.


Privacy: This page is free of cookies or any means of data collection. Copyright disclaimer: The documents contained in these pages are included to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.