Baričević et al., 2016 - Google Patents

User-perspective AR magic lens from gradient-based IBR and semi-dense stereo

Baričević et al., 2016

View PDF
Document ID
5845889614184406812
Author
Baričević D
Höllerer T
Sen P
Turk M
Publication year
Publication venue
IEEE transactions on visualization and computer graphics

External Links

Snippet

We present a new approach to rendering a geometrically-correct user-perspective view for a magic lens interface, based on leveraging the gradients in the real world scene. Our approach couples a recent gradient-domain image-based rendering method with a novel …
Continue reading at ieeexplore.ieee.org (PDF) (other versions)

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • G06T15/205Image-based rendering
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/04Texture mapping
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/50Lighting effects
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/005General purpose rendering architectures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic or multiview television systems; Details thereof
    • H04N13/02Picture signal generators
    • H04N13/0203Picture signal generators using a stereoscopic image camera
    • H04N13/0239Picture signal generators using a stereoscopic image camera having two 2D image pickup sensors representing the interocular distance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic or multiview television systems; Details thereof
    • H04N13/02Picture signal generators
    • H04N13/0203Picture signal generators using a stereoscopic image camera
    • H04N13/0207Picture signal generators using a stereoscopic image camera involving a single 2D image pickup sensor
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformation in the plane of the image, e.g. from bit-mapped to bit-mapped creating a different image
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • G06T2207/10012Stereo images
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration, e.g. from bit-mapped to bit-mapped creating a similar image
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic or multiview television systems; Details thereof
    • H04N13/0003Stereoscopic image signal coding, multiplexing, processing, recording or transmission
    • H04N13/0007Processing stereoscopic image signals
    • H04N13/0011Transformation of stereoscopic image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic or multiview television systems; Details thereof
    • H04N13/04Picture reproducers

Similar Documents

Publication Publication Date Title
Attal et al. MatryODShka: Real-time 6DoF video view synthesis using multi-sphere images
Serrano et al. Motion parallax for 360 RGBD video
Huang et al. 6-DOF VR videos with a single 360-camera
Taguchi et al. TransCAIP: A live 3D TV system using a camera array and an integral photography display with interactive control of viewing parameters
US9041819B2 (en) Method for stabilizing a digital video
Lin et al. Deep multi depth panoramas for view synthesis
WO2013074561A1 (en) Modifying the viewpoint of a digital image
US8611642B2 (en) Forming a steroscopic image using range map
Baričević et al. User-perspective augmented reality magic lens from gradients
Bonatto et al. Real-time depth video-based rendering for 6-DoF HMD navigation and light field displays
JP2023524326A (en) Neural blending for novel view synthesis
US12039632B2 (en) Synthesized camera arrays for rendering novel viewpoints
Baričević et al. User-perspective AR magic lens from gradient-based IBR and semi-dense stereo
Mulligan et al. Stereo-based environment scanning for immersive telepresence
Guo et al. Real-Time Free Viewpoint Video Synthesis System Based on DIBR and A Depth Estimation Network
da Silveira et al. Omnidirectional visual computing: Foundations, challenges, and applications
Pintore et al. Deep synthesis and exploration of omnidirectional stereoscopic environments from a single surround-view panoramic image
Gong Real-time joint disparity and disparity flow estimation on programmable graphics hardware
Gradient-Based User-Perspective AR Magic Lens from Gradient-Based IBR and Semi-Dense Stereo
Fülöp-Balogh et al. Dynamic scene novel view synthesis via deferred spatio-temporal consistency
Mori et al. Exemplar-based inpainting for 6dof virtual reality photos
Paliwal et al. Implicit view-time interpolation of stereo videos using multi-plane disparities and non-uniform coordinates
Qi et al. Dense view synthesis for three-dimensional light-field display based on scene geometric reconstruction
Deng et al. Foveated neural radiance fields for real-time and egocentric virtual reality
Rongsirigul et al. Novel view synthesis with light-weight view-dependent texture mapping for a stereoscopic HMD