Skip to main content

Eyal Ofek

Microsoft Research, Natural Interaction, Senior Researcher

Followers

61

Following

31

Co-authors

17

Public Views

I am a principal researcher at the Microsoft Research lab in Redmond, WA. My research interests include Augmented Reality (AR)/Virtual Reality (VR), Haptics, interactive projection mapping, and computer vision for human-computer interaction.

I am also the Specialty Chief Editor of Frontiers in Virtual Reality, for the area of Haptics and an Assoc. Editor of IEEE Computer Graphics and Application (CG&A).

Prior to joining Microsoft Research obtained my Ph.D. at the Hebrew University of Jerusalem and has founded a couple of companies in the area of computer graphics, including a successful drawing and photo editing application (Photon-Paint ) and developing the world first time-of-flight video cameras which was a basis for the HoloLens depth camera.
Address: 1 Microsoft way

less

InterestsView All (7)

Uploads

Papers by Eyal Ofek

The Rocketbox Library and the Utility of Freely Available Rigged Avatars

Frontiers in Virtual Reality, 2020

Breaking the Screen: Interaction Across Touchscreen Boundaries in Virtual Reality for Mobile Knowledge Workers

IEEE Transactions on Visualization and Computer Graphics, 2020

19th ACM SIGSPATIAL International Symposium on Advances in Geographic Information Systems, ACM-GIS 2011, November 1-4, 2011, Chicago, IL, USA, Proceedings

Extended Reality for Knowledge Work in Everyday Environments

ArXiv, 2021

Virtual and Augmented Reality (VR and AR) have the potential to change information work. The abil... more Virtual and Augmented Reality (VR and AR) have the potential to change information work. The ability to modify the workers senses can transform everyday environments into a productive office, using portable head-mounted displays (HMDs) combined with conventional interaction devices, such as keyboards and tablets. While a stream of better, cheaper and lighter HMDs have been introduced for consumers in recent years, there are still many challenges to be addressed to allow this vision to become reality. This chapter summarizes the state of the art in the field of extended reality for knowledge work in everyday environments and proposes steps to address the open challenges.

Accuracy Evaluation of Touch Tasks in Commodity Virtual and Augmented Reality Head-Mounted Displays

An increasing number of consumer-oriented head-mounted displays (HMD) for augmented and virtual r... more An increasing number of consumer-oriented head-mounted displays (HMD) for augmented and virtual reality (AR/VR) are capable of finger and hand tracking. We report on the accuracy of off-the-shelf VR and AR HMDs when used for touch-based tasks such as pointing or drawing. Specifically, we report on the finger tracking accuracy of the VR head-mounted displays Oculus Quest, Vive Pro and the Leap Motion controller, when attached to a VR HMD, as well as the finger tracking accuracy of the AR head-mounted displays Microsoft HoloLens 2 and Magic Leap. We present the results of two experiments in which we compare the accuracy for absolute and relative pointing tasks using both human participants and a robot. The results suggest that HTC Vive has a lower spatial accuracy than the Oculus Quest and Leap Motion and that the Microsoft HoloLens 2 provides higher spatial accuracy than Magic Leap One. These findings can serve as decision support for researchers and practitioners in choosing which s...

Towards Interaction Around Unmodified Camera-equipped Mobile Devices

Around-device interaction promises to extend the input space of mobile and wearable devices beyon... more Around-device interaction promises to extend the input space of mobile and wearable devices beyond the common but restricted touchscreen. So far, most around-device interaction approaches rely on instrumenting the device or the environment with additional sensors. We believe, that the full potential of ordinary cameras, specifically user-facing cameras, which are integrated in most mobile devices today, are not used to their full potential, yet. We To this end, we present a novel approach for extending the input space around unmodified mobile devices using built-in front-facing cameras of unmodified handheld devices. Our approach estimates hand poses and gestures through reflections in sunglasses, ski goggles or visors. Thereby, GlassHands creates an enlarged input space, rivaling input reach on large touch displays. We discuss the idea, its limitations and future work.

A Line of Work following Bell Et Al. [2] on View Management for Augmented Reality Uses Constraint-based

We introduce a layout manager that exploits the robust sensing capabilities of next-generation he... more We introduce a layout manager that exploits the robust sensing capabilities of next-generation head-worn displays by embedding virtual application windows in the user’s surroundings. With the aim of allowing users to find applications quickly, our approach leverages spatial memory of a known body-centric configuration. The layout manager balances multiple constraints to keep layouts consistent across environments while observing geometric and visual features specific to each locale. We compare various constraint weighting schemas and discuss outcomes of this approach applied to models of two test environments.

Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, 2015

Peeking Template Matching for Depth Extension

2015 IEEE International Conference on Computer Vision (ICCV), 2015

Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, 2016

Spatial Constancy of Surface-Embedded Layouts across Multiple Environments

Proceedings of the 3rd ACM Symposium on Spatial User Interaction, 2015

SurroundWeb: Mitigating Privacy Concerns in a 3D Web Browser

2015 IEEE Symposium on Security and Privacy, 2015

Stereoscopic Displays and Virtual Reality Systems X, 2003

The Known Stranger

Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2015

Reducing disruption from subtle information delivery during a conversation

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2013

Proceedings of the 22nd annual ACM symposium on User interface software and technology - UIST '09, 2009

Implementation of modeling hair from multiple views

ACM SIGGRAPH 2005 Sketches on - SIGGRAPH '05, 2005

ABSTRACT Hako-ne is an augmented reality hybrid art/technology project. Users will be able to see... more

Landmark-based routing

Guided Photography Based on Image Capturing Device Rendered User Recommendations

Detection of Objectionable Videos

The Rocketbox Library and the Utility of Freely Available Rigged Avatars

Frontiers in Virtual Reality, 2020

Breaking the Screen: Interaction Across Touchscreen Boundaries in Virtual Reality for Mobile Knowledge Workers

IEEE Transactions on Visualization and Computer Graphics, 2020

19th ACM SIGSPATIAL International Symposium on Advances in Geographic Information Systems, ACM-GIS 2011, November 1-4, 2011, Chicago, IL, USA, Proceedings

Extended Reality for Knowledge Work in Everyday Environments

ArXiv, 2021

Virtual and Augmented Reality (VR and AR) have the potential to change information work. The abil... more Virtual and Augmented Reality (VR and AR) have the potential to change information work. The ability to modify the workers senses can transform everyday environments into a productive office, using portable head-mounted displays (HMDs) combined with conventional interaction devices, such as keyboards and tablets. While a stream of better, cheaper and lighter HMDs have been introduced for consumers in recent years, there are still many challenges to be addressed to allow this vision to become reality. This chapter summarizes the state of the art in the field of extended reality for knowledge work in everyday environments and proposes steps to address the open challenges.

Accuracy Evaluation of Touch Tasks in Commodity Virtual and Augmented Reality Head-Mounted Displays

An increasing number of consumer-oriented head-mounted displays (HMD) for augmented and virtual r... more An increasing number of consumer-oriented head-mounted displays (HMD) for augmented and virtual reality (AR/VR) are capable of finger and hand tracking. We report on the accuracy of off-the-shelf VR and AR HMDs when used for touch-based tasks such as pointing or drawing. Specifically, we report on the finger tracking accuracy of the VR head-mounted displays Oculus Quest, Vive Pro and the Leap Motion controller, when attached to a VR HMD, as well as the finger tracking accuracy of the AR head-mounted displays Microsoft HoloLens 2 and Magic Leap. We present the results of two experiments in which we compare the accuracy for absolute and relative pointing tasks using both human participants and a robot. The results suggest that HTC Vive has a lower spatial accuracy than the Oculus Quest and Leap Motion and that the Microsoft HoloLens 2 provides higher spatial accuracy than Magic Leap One. These findings can serve as decision support for researchers and practitioners in choosing which s...

Towards Interaction Around Unmodified Camera-equipped Mobile Devices

Around-device interaction promises to extend the input space of mobile and wearable devices beyon... more Around-device interaction promises to extend the input space of mobile and wearable devices beyond the common but restricted touchscreen. So far, most around-device interaction approaches rely on instrumenting the device or the environment with additional sensors. We believe, that the full potential of ordinary cameras, specifically user-facing cameras, which are integrated in most mobile devices today, are not used to their full potential, yet. We To this end, we present a novel approach for extending the input space around unmodified mobile devices using built-in front-facing cameras of unmodified handheld devices. Our approach estimates hand poses and gestures through reflections in sunglasses, ski goggles or visors. Thereby, GlassHands creates an enlarged input space, rivaling input reach on large touch displays. We discuss the idea, its limitations and future work.

A Line of Work following Bell Et Al. [2] on View Management for Augmented Reality Uses Constraint-based

We introduce a layout manager that exploits the robust sensing capabilities of next-generation he... more We introduce a layout manager that exploits the robust sensing capabilities of next-generation head-worn displays by embedding virtual application windows in the user’s surroundings. With the aim of allowing users to find applications quickly, our approach leverages spatial memory of a known body-centric configuration. The layout manager balances multiple constraints to keep layouts consistent across environments while observing geometric and visual features specific to each locale. We compare various constraint weighting schemas and discuss outcomes of this approach applied to models of two test environments.

Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, 2015

Peeking Template Matching for Depth Extension

2015 IEEE International Conference on Computer Vision (ICCV), 2015

Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, 2016

Spatial Constancy of Surface-Embedded Layouts across Multiple Environments

Proceedings of the 3rd ACM Symposium on Spatial User Interaction, 2015

SurroundWeb: Mitigating Privacy Concerns in a 3D Web Browser

2015 IEEE Symposium on Security and Privacy, 2015

Stereoscopic Displays and Virtual Reality Systems X, 2003

The Known Stranger

Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2015

Reducing disruption from subtle information delivery during a conversation

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2013

Proceedings of the 22nd annual ACM symposium on User interface software and technology - UIST '09, 2009

Implementation of modeling hair from multiple views

ACM SIGGRAPH 2005 Sketches on - SIGGRAPH '05, 2005

ABSTRACT Hako-ne is an augmented reality hybrid art/technology project. Users will be able to see... more

Landmark-based routing

Guided Photography Based on Image Capturing Device Rendered User Recommendations

Detection of Objectionable Videos