Using a Panoramic Camera for 3D Head Tracking in an AR Environment

Abstract

For Augmented Reality using a pair of transparent 3D glasses, a precise and fast method for head tracking is required, to determine the user’s position and direction of gaze in all six degrees of freedom. The methods currently available require expensive external sensors and have small working areas and/or other limitations. We propose a method that uses a panoramic camera that is mounted directly on the user’s head, combined with cheap, easily mountable passive artificial landmarks. The panoramic camera uses a paraboloid mirror, which allows for interesting algorithmic simplifications. The system has been tested both in simulation and in reality and shows promising results.

Citation Style:    Display Alpha ACM SIGGRAPH IEEEtran Publication

Using a Panoramic Camera for 3D Head Tracking in an AR Environment. Björn Giesler, Tobias Salb, Tim Weyrich, Rüdiger Dillmann. In Proceedings of 9th IEEE Int. Conference on Mechatronics and Machine Vision in Practice, Chiang Mai, Thailand, Sep 10-12, 2002.Björn Giesler, Tobias Salb, Tim Weyrich, and Rüdiger Dillmann. Using a panoramic camera for 3D head tracking in an AR environment. In Proceedings of 9th IEEE Int. Conference on Mechatronics and Machine Vision in Practice 2002, pages 10–12, Chiang Mai, Thailand, September 2002.Giesler, B., Salb, T., Weyrich, T., and Dillmann, R. 2002. Using a panoramic camera for 3D head tracking in an AR environment. In Proceedings of 9th IEEE Int. Conference on Mechatronics and Machine Vision in Practice 2002, 10–12.B. Giesler, T. Salb, T. Weyrich, and R. Dillmann, “Using a panoramic camera for 3D head tracking in an AR environment,” in Proceedings of 9th IEEE Int. Conference on Mechatronics and Machine Vision in Practice 2002, Chiang Mai, Thailand, Sep. 2002, pp. 10–12. PDF BibTeX