Multi-Feature Matching of Fresco Fragments

Abstract

We present a multiple-feature approach for determining matches between small fragments of archaeological artifacts such as Bronze-Age and Roman frescoes. In contrast with traditional 2D and 3D shape matching approaches, we introduce a set of feature descriptors that are based on not only color and shape, but also normal maps. These are easy to acquire and combine high data quality with discriminability and robustness to some types of deterioration. Our feature descriptors range from general-purpose to domain-specific, and are quick to compute and match. We have tested our system on three datasets of fresco fragments, demonstrating that multi-cue matching using different subsets of features leads to different tradeoffs between efficiency and effectiveness. In particular, we show that normal-based features are more effective than color-based ones at similar computational complexity, and that 3D features are more discriminative than ones based on 2D or normals, but at higher computational cost. We also demonstrate how machine learning techniques can be used to effectively combine our new features with traditional ones. Our results show good retrieval performance, significantly improving upon the match prediction rate of state-of-the-art 3D matching algorithms, and are expected to extend to general matching problems in applications such as texture synthesis and forensics.

Citation Style:    Display Alpha ACM SIGGRAPH IEEEtran Publication

Multi-Feature Matching of Fresco Fragments. Corey Toler-Franklin, Benedict Brown, Tim Weyrich, Thomas Funkhouser, Szymon Rusinkiewicz. ACM Transactions on Graphics (Proc. SIGGRAPH Asia), Vol. 29, No. 5, pp. 185:1–185:11, Seoul, 2010.Corey Toler-Franklin, Benedict Brown, Tim Weyrich, Thomas Funkhouser, and Szymon Rusinkiewicz. Multi-feature matching of fresco fragments. ACM Trans. on Graphics (Proc. SIGGRAPH Asia), 29(5):185:1–185:11, 2010.Toler-Franklin, C., Brown, B., Weyrich, T., Funkhouser, T., and Rusinkiewicz, S. 2010. Multi-feature matching of fresco fragments. ACM Trans. on Graphics (Proc. SIGGRAPH Asia) 29, 5, 185:1–185:11.C. Toler-Franklin, B. Brown, T. Weyrich, T. Funkhouser, and S. Rusinkiewicz, “Multi-feature matching of fresco fragments,” ACM Trans. on Graphics (Proc. SIGGRAPH Asia), vol. 29, no. 5, pp. 185:1–185:11, 2010. PDF (3.7 MB) BibTeX

Acknowledgments

We thank Professor Christos Doumas, Andreas Vlachopoulos, and the conservators and archeologists at the Akrotiri Excavation Laboratory of Wall Paintings for their time and commitment. Lara Laken provided insight and access to the Kerkrade Frescos. We thank Dimitris Gondicas and Peter Nomikos Jr. for their continuing support. Benedict Brown is a Postdoctoral Fellow of the Research Foundation Flanders. The Kress Foundation, Seeger Foundation, Thera Foundation, Cotsen Family Foundation, and NSF Grants CCF-0347427 and CCF-0702580 provided funding.