- Authors:
- Miles Hansard,
- Seungkyu Lee,
- Ouk Choi,
- Radu Horaud
Time-of-flight (TOF) cameras provide a depth value at each pixel, from which the 3D structure of the scene can be estimated. This new type of active sensor makes it possible to go beyond traditional 2D image processing, directly to depth-based and 3D scene processing. Many computer vision and graphics applications can benefit from TOF data, including 3D reconstruction, activity and gesture recognition, motion capture and face detection. It is already possible to use multiple TOF cameras, in order to increase the scene coverage, and to combine the depth data with images from several colour cameras. Mixed TOF and colour systems can be used for computational photography, including full 3D scene modelling, as well as for illumination and depth-of-field manipulations. This work is a technical introduction to TOF sensors, from architectural and design issues, to selected image processing and computer vision methods.
Cited By
Lee J, Chacko J, Dai B, Reza S, Sagar A, Eliceiri K, Velten A and Gupta M (2019). Coding Scheme Optimization for Fast Fluorescence Lifetime Imaging, ACM Transactions on Graphics, 38:3, (1-16), Online publication date: 15-Jun-2019.- Avola D, Cinque L, Foresti G, Marini M and Pannone D (2018). VRheab, Multimedia Tools and Applications, 77:19, (24955-24982), Online publication date: 1-Oct-2018.
- (2017). Modeling large-scale indoor scenes with rigid fragments using RGB-D cameras, Computer Vision and Image Understanding, 157:C, (103-116), Online publication date: 1-Apr-2017.
- Callenberg C, Heide F, Wetzstein G and Hullin M (2017). Snapshot difference imaging using correlation time-of-flight sensors, ACM Transactions on Graphics, 36:6, (1-11), Online publication date: 20-Nov-2017.
- Fairchild A, Campion S, Garcia A, Wolff R, Fernando T and Roberts D (2017). A Mixed Reality Telepresence System for Collaborative Space Operation, IEEE Transactions on Circuits and Systems for Video Technology, 27:4, (814-827), Online publication date: 1-Apr-2017.
- Horaud R, Hansard M, Evangelidis G and Ménier C (2016). An overview of depth cameras and range scanners based on time-of-flight technologies, Machine Vision and Applications, 27:7, (1005-1020), Online publication date: 1-Oct-2016.
- Stahlschmidt C, Gavriilidis A, Velten J and Kummert A (2016). Applications for a people detection and tracking algorithm using a time-of-flight camera, Multimedia Tools and Applications, 75:17, (10769-10786), Online publication date: 1-Sep-2016.
- Cruz J, Yin X, Liu X, Imran S, Morris D, Kramer D and Chen J (2016). Multi-modality imagery database for plant phenotyping, Machine Vision and Applications, 27:5, (735-749), Online publication date: 1-Jul-2016.
- Orts-Escolano S, Rhemann C, Fanello S, Chang W, Kowdle A, Degtyarev Y, Kim D, Davidson P, Khamis S, Dou M, Tankovich V, Loop C, Cai Q, Chou P, Mennicken S, Valentin J, Pradeep V, Wang S, Kang S, Kohli P, Lutchyn Y, Keskin C and Izadi S Holoportation Proceedings of the 29th Annual Symposium on User Interface Software and Technology, (741-754)
- Zhang L, Dong H and Saddik A (2015). From 3D Sensing to Printing, ACM Transactions on Multimedia Computing, Communications, and Applications, 12:2, (1-23), Online publication date: 3-Mar-2016.
- Shrestha S, Heide F, Heidrich W and Wetzstein G (2016). Computational imaging with multi-camera time-of-flight systems, ACM Transactions on Graphics, 35:4, (1-11), Online publication date: 11-Jul-2016.
- Amine K and Hayet Farida M (2015). Quantitative Comparison of Deformable Models in Range Segmentation, Cybernetics and Information Technologies, 14:4, (66-79), Online publication date: 1-Jan-2015.
- Tilo T, Jin Z and Cheng F Super-Resolution of Depth Map Exploiting Planar Surfaces Proceedings, Part II, of the 16th Pacific-Rim Conference on Advances in Multimedia Information Processing -- PCM 2015 - Volume 9315, (632-641)
- Kiran A and Sreeni K A Robust Oversegmentation Algorithm using Colour and Geometric Cues Proceedings of the 2014 Indian Conference on Computer Vision Graphics and Image Processing, (1-7)
Index Terms
- Time-of-Flight Cameras: Principles, Methods and Applications
Recommendations
Efficient Disparity Map Generation Using Stereo and Time-of-Flight Depth Cameras
Proceedings, Part II, of the 16th Pacific-Rim Conference on Advances in Multimedia Information Processing -- PCM 2015 - Volume 9315Three-dimensional content 3D creation has received a lot of attention due to numerous successes of 3D entertainment. Accurate estimation of depth information is necessary for efficient 3D content creation. In this paper, we propose a disparity map ...
Cross-calibration of time-of-flight and colour cameras
Survey of depth-colour calibration methods.Novel calibration method based on projective alignment.Indepth experimental validation and error analysis.Alignment of time-of-flight and colour camera networks. Time-of-flight cameras provide depth information,...
Modeling and correction of multipath interference in time of flight cameras
Multipath interference of light is the cause of important errors in Time of Flight (ToF) depth estimation. This paper proposes an algorithm that removes multipath distortion from a single depth map obtained by a ToF camera. Our approach does not require ...