Recovering 3-D gaze scan path and scene structure from inside-out camera
Pages 198 - 201
Abstract
First-Person Vision (FPV) is a wearable sensor that takes images from a user's visual field and interprets them, with available information about the user's head motion and gaze, through eye tracking [1]. Measuring the 3-D gaze trajectory of a user moving dynamically in 3-D space is interesting for understanding a user's intention and behavior. In this paper, we present a system for recovering 3-D scan path and scene structure in 3-D space on the basis of ego-motion computed from an inside-out camera. Experimental results show that the 3-D scan paths of a user moving in complex dynamic environments were recovered.
References
[1]
T. Kanade and M. Hebert. First-person vision. Proceedings of the IEEE, 100(8):2442--2453, 2012.
[2]
D. Noton. Eye movements and visual perception. Scientific American, 6:34--43, 1971.
[3]
T. Ono. What can be learned from eye movement?: Understanding higher cognitive processes from eye movement analysis. Cognitive Studies, 9(4):565--579, 2002.
[4]
Arrington Research, inc. EyetrackerViewPoint.
[5]
ISCAN. AA-ETL-500B.
[6]
NAC Image Technology Inc. eyemark recorderEMR-9.
[7]
Tobii. Tobii XL.
[8]
S. Shimizu and H. Fujiyoshi. Acquisition of 3d gaze information from eyeball movements using inside-out camera. In Proceedings of the 2nd Augmented Human International Conference, page 6, 2011.
[9]
R. Y. Tsai. A versatile camera calibration technique for high-accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses. IEEE Journal of Robotics and Automation, 3(4):323--344, 1922.
[10]
Z. Zhang. A flexible new technique for camera calibration. PAMI, 22(11):1330--1334, 2000.
[11]
H. Badino and T. Kanade. A head-wearable short-baseline stereo system for the simultaneous estimation of structure and motion. In IAPR Conference on Machine Vision Applications (MVA), 2011.
[12]
J. Shi and C. Tomasi. Good features to track. In Computer Vision and Pattern Recognition, pages 593--600, 1994.
[13]
Z. Zhang and O. Faugeras. 3d dynamic scene analysis: a stereo based approach. 1992.
[14]
T. Ohno, T. Mukawa, and A. Yoshikawa. Freegaze: a gaze tracking system for everyday gaze interaction. In the symposium on ETRA 2002: eye tracking research & applications symposium, pages 125--132, 2002.
[15]
S. Tanaka, H. Hikita, T. Kasai, and T. Takeda. Eye-gaze detection based on the position of the cornea curvature center using two near-infrared light sources. IEICE technical report. ME and bio cybernetics, 108(479):177--180, 2009.
[16]
Y. Sakashita, H. Fujiyoshi, Y. Hirata, and N. Fukaya. Real-time measurement system of cyclodction movement based on fast ellipse detection. IEEJ Transactions on Electrical and Electronic Engineering, 127-C:591--598, 2007.
[17]
Y. Kanatani, K. Sugaya and H. Niitsuma. Triangulation from two views revisited: Hartley-sturm vs. optimal correction. Proceedings of the 19th British Machine Vision Conference (BMVC'08), 8:173--182, 2008.
Index Terms
- Recovering 3-D gaze scan path and scene structure from inside-out camera
Recommendations
Acquisition of 3D gaze information from eyeball movements using inside-out camera
AH '11: Proceedings of the 2nd Augmented Human International ConferenceWe propose a method for obtaining 3D gaze information using inside-out camera. Such information on 3D gaze points can be useful not only to clarify higher cognitive processes in humans but also to reproduce the 3D shape of an object from eyeball ...
3D point-of-regard, position and head orientation from a portable monocular video-based eye tracker
ETRA '08: Proceedings of the 2008 symposium on Eye tracking research & applicationsTo study an observer's eye movements during realistic tasks, the observer should be free to move naturally throughout our three-dimensional world. Therefore, a technique to determine an observer's point-of-regard (POR) as well as his/her motion ...
Eye gaze tracking using an RGBD camera: a comparison with a RGB solution
UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct PublicationMost commercial eye gaze tracking systems are based on the use of infrared lights. However, such systems may not work outdoor or may have a very limited head box for them to work. This paper proposes a non-infrared based approach to track one's eye gaze ...
Comments
Information & Contributors
Information
Published In
March 2013
254 pages
ISBN:9781450319041
DOI:10.1145/2459236
- General Chair:
- Albrecht Schmidt,
- Program Chairs:
- Andreas Bulling,
- Christian Holz
Copyright © 2013 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
- SimTech: SimTech
- Universität Stuttgart: Universität Stuttgart
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 March 2013
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
AH'13
Sponsor:
- SimTech
- Universität Stuttgart
Acceptance Rates
AH '13 Paper Acceptance Rate 49 of 69 submissions, 71%;
Overall Acceptance Rate 121 of 306 submissions, 40%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 112Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)0
Reflects downloads up to 13 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in