JP2020098381A - Positioning method and reality presentation apparatus - Google Patents

Abstract

To provide a positioning method applied to a reality presentation apparatus.SOLUTION: A positioning method applied to a reality presentation apparatus includes: a step that collects a plurality of first images of a reality environment and constructs a virtual environment corresponding to the reality environment according to the plurality of first images; a step that acquires a second image of the reality environment with the reality presentation apparatus; a step that calculates an initial virtual position in the virtual environment corresponding to the second image according to the plurality of first images and the second image; and a step that displays the virtual environment from the perspective of the initial virtual position when starting a specified application of the reality presentation apparatus with the realty presentation apparatus. The initial virtual position corresponds to an initial reality location in the reality environment where the reality presentation apparatus acquires the second image.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to a positioning method and a reality presentation device, and more particularly to a positioning method and a reality presentation device that can calculate an initial virtual position corresponding to a real place.

As technology evolves and develops, the demand for interaction between computer games and users is increasing. Human-computer interaction techniques, such as somatosensory games, virtual reality (VR) environments, augmented reality (AR) environments, mixed reality (MR) environments, and augmented reality (XR) environments, have their physiological and entertainment functions. It has become popular because of it.

A user or player may play a game in a virtual environment, which may be constructed to emulate a real environment. In the prior art, for games involving virtual environments that emulate real-world environments, the user/player has to stay in a predefined location to start the game, which is inconvenient for the user/player. Bring That is, the user/player is unable to start the game anywhere in the real environment, and the user/player is losing his freedom to start the game anywhere he wants.

Therefore, an object of the present disclosure is to provide a positioning method and a reality presentation device.

The embodiment of the present disclosure discloses a positioning method. The positioning method includes a step of collecting a plurality of first images of the real environment and constructing a virtual environment corresponding to the real environment according to the plurality of first images, and a second image of the real environment by the reality presentation device. And calculating the initial virtual position in the virtual environment corresponding to the second image according to the plurality of first images and the second image, and specifying the reality presentation device by the reality presentation device. Displaying the virtual environment from the perspective of the initial virtual position when the application is started, the initial virtual position corresponding to the initial physical location in the physical environment in which the reality presentation device captures the second image. ..

Another embodiment of the present disclosure discloses a reality presentation device capable of displaying a virtual environment for a user, and the virtual environment is constructed based on the real environment and a plurality of first images captured from the reality presentation device. It The reality presentation device includes an image capturing module configured to capture a second image from the real environment, a step of constructing a virtual environment corresponding to the real environment according to the plurality of first images, and a plurality of first image capture modules. A processing unit configured to perform a step of calculating an initial virtual position in a virtual environment corresponding to the second image according to the first image and the second image, and a specific application of the reality presentation device are started. And a display screen configured to display the virtual environment from the viewpoint from the initial virtual position, the initial virtual position being the initial physical location in the physical environment in which the reality presentation device captures the second image. Correspond.

Another embodiment of the present disclosure discloses a system capable of displaying a virtual environment to a user, and the virtual environment is constructed based on a real environment and a plurality of first images captured from a reality presentation device. The system is a reality presentation device, an image capture module configured to capture a second image from a real environment, and an initial virtual position when a specific application of the reality presentation device is started. And a step of constructing a virtual environment corresponding to the real environment according to the plurality of first images, the reality presenting apparatus including a display screen configured to display the virtual environment from the viewpoint of the plurality of first images. A remote computing device configured to perform the step of calculating an initial virtual position in the virtual environment corresponding to the second image according to the image and the second image, wherein the initial virtual position is Corresponds to the initial physical location in the physical environment capturing the second image.

These and other objects of the invention will no doubt become apparent to those skilled in the art upon reading the following detailed description of the preferred embodiments illustrated in the various charts and drawings.

1 is a schematic diagram of a reality presentation device according to an embodiment of the present disclosure. It is an external view of the reality presentation apparatus shown by FIG. FIG. 7 is a schematic diagram of a process according to an embodiment of the present disclosure. 1 is a schematic diagram of a system according to an embodiment of the present disclosure.

FIG. 1 is a functional block diagram of a reality presenting device 10 according to an embodiment of the present disclosure. FIG. 2 is an exemplary external view of the reality presentation device 10. The reality presentation device 10 may be a virtual reality (VR) device, an augmented reality (AR) device, a mixed reality (MR) device, or an extended reality (XR) device. Unlike the reality presentation device in the related art, the reality presentation device 10 can calculate a virtual position in the virtual environment corresponding to a real place in the real environment in addition to simply constructing the virtual environment. The reality presentation device 10 includes an image capturing module 12, a processing unit 14, and a display screen 16. The image capture module 12 may include a lens and a light sensitive pixel array and is configured to capture an image. The images produced by the image capture module 12 may include two-dimensional (2D) images, such as RGB images, and/or three-dimensional (3D) images that include depth information that can be acquired via infrared (IR). The processing unit 14 may be, for example, without limitation, an application processor, a microcontroller, or an application specific integrated circuit (ASIC). The display screen is configured to display a sense of reality or virtual environment for the user/player.

FIG. 3 is a schematic diagram of a process 30 according to an embodiment of the invention. The process 30 includes the following steps.

Step 302: Capture a plurality of first images of the real environment.

Step 304: Build a virtual environment corresponding to the real environment according to the plurality of first images.

Step 306: Capture a second image of the real environment.

Step 308: Calculate an initial virtual position in the virtual environment corresponding to the second image according to the plurality of first images and the second image.

Step 310: Display a virtual environment from a viewpoint from an initial virtual position when a specific application of the reality presentation device is started.

In step 302 and step 304 (which may be in the offline phase), the image capturing module 12 captures a plurality of first images IMG ₁ from the real environment REN, and the virtual environment VEN corresponding to the real environment REN has a plurality of virtual environments VEN. Constructed based on the first image IMG ₁ . In the example, the virtual environment VEN may be constructed by the processing unit 14. The real environment REN may be, for example, an office, a living room, a conference room in a real life. The virtual environment VEN may include a plurality of VR images displayed by the reality presentation device 10, for example, VR 360° images, so that when the user/player wears the reality presentation device 10 shown in FIG. The user/player perceives a plurality of VR images and feels as if he/she is immersed in the virtual environment VEN. In another example, all or some of the plurality of first images IMG ₁ can be collected from a source other than the image capture module 12, such as a cloud database or the Internet.

In an embodiment, the user/player may roam the real environment REN and the image capture device 12 captures different pictures, ie a plurality of first images IMG ₁ , so that the processing unit 14 makes a plurality of images. The virtual environment VEN corresponding to the real environment REN can be constructed according to the first image IMG ₁ of In an embodiment, the user/player may stand in a plurality of predefined locations in the real environment REN and the image capture device 12 may take pictures from different perspectives, thereby providing a plurality of first images. Image IMG _{1 of} is captured. Then, the processing unit 14 can construct the virtual environment VEN corresponding to the real environment REN according to the plurality of first images IMG ₁ . The details of constructing the virtual environment VEN corresponding to the real environment REN according to the plurality of first images IMG ₁ captured from the real environment REN are known in the art and are not mentioned for the sake of brevity.

In step 306, after the virtual environment VEN is constructed, the image capture module 12 captures the second image IMG ₂ of the real environment REN, which may be a real time phase. Step 306 is when/before the user/player starts entering the virtual environment VEN, eg, when the user/player turns on (powers on) the reality presentation device 10, or a particular software application, For example, it may be run when/before the game with virtual reality is started.

In step 308, an initial virtual position VP _I in a virtual environment VEN corresponding to the second image IMG ₂ is calculated according to a plurality of first image IMG ₁ and the second image IMG _2.

In an embodiment, step 308 may be performed by processing unit 14.

Details of step 308 are known in the art. For example, comparing the second image IMG ₂ with the plurality of first images IMG ₁ may be performed, wherein a plurality of correlation coefficients of the plurality of _first images IMG ₁ with the second image IMG _2. c may be acquired.

For example, the plurality of first images IMG ₁ may include the first images IMG _1,1 ,..., IMG _1,N , and the plurality of correlation coefficients c are the correlation coefficients c ₁ ,... ., c _N may be included. Each correlation coefficient c _n represents a quantified correlation of the first image IMG _1,n with respect to the _second image IMG ₂ and/or. The higher the correlation coefficient _{c n,} greater correlation between the first image IMG _{1, n} and the second image IMG ₂ is. That is, it is a higher correlation coefficient _{c n} indicates that the first image IMG _{1, n} and the second image IMG ₂ is more correlated.

The details of acquiring the plurality of correlation coefficients c are not limited. For example, a feature extraction operation may be performed on the plurality of first images IMG ₁ and also on the second image IMG ₂ . Feature extraction operations known in the art include feature identification and appearance count accumulation. For a particular feature, the particular feature may be identified as following a particular geometry. It may be determined whether a particular feature occurs in the image (ie, feature identification), and how many times the particular feature appears in the image (ie, cumulative count) is accumulated. May be. The accumulation result is the number of appearances or the number of appearances of a particular feature. Specifically, determining whether a particular feature appears in an image may also be determining whether a portion of the image in the image or an image object conforms to a particular geometry, which It may be achieved by using some machine learning or computer vision method. If these do, it is recognized that the particular feature has occurred once.

In another aspect, feature identification (ie, to determine if a feature appears in an image) and cumulative number of occurrences (ie, how many times a feature appears in an image) for multiple features. May be performed to obtain the quantification vector. The quantification vector includes a plurality of occurrence numbers corresponding to a plurality of features. For example, the quantification vector corresponding to the image may be obtained after performing the feature identification and the cumulative number of appearances for the first feature, the second feature, and the third feature on the image. The quantification vector can be, for example, [2,3,1]. This means that the first feature appears twice in the image, the second feature appears three times in the image, and the first feature appears once in the image. Illustratively, the first feature may follow a circular shape, the second feature may follow a triangular shape, and the third feature may follow a rectangular shape.

Details of the feature extraction operation are known in the art and are not mentioned here for the sake of brevity.

Briefly, for a plurality of features, for example K features, a feature extraction operation may be performed on the plurality of first images IMG ₁ to obtain a plurality of first quantification vectors QV _1. , this can be done off-line, further, the second acquired quantification vector QV ₂ running feature extraction operation on the second image IMG _2, which can be done in real time.

Specifically, the plurality of first quantification vectors QV _1, are the first quantification vectors QV _1,1 ,... Corresponding to the first images IMG _1,1 ,..., IMG _1,N. , QV _1,n , each first quantification vector QV _{1,n including} a plurality of occurrences appn _n,1 ,...,Appn _n,K corresponding to K features. , The number of appearances appn _n,k indicates that the feature k appears appn _n,k times in the first image IMG _1,n . Mathematically, the first quantification vector QV ₁ may be represented as QV _1,n =[appn _n,1 ,..., Appn _n,K ].

Similarly, the second quantification vector QV ₂ includes a plurality of appearance numbers apn ₁ ,..., Apn _K corresponding to K features, and QV ₂ =[apn _1, ..., Apn _K ]. The number of appearances apn _k indicates that the feature k appears apn _k times in the second image IMG ₂ .

In the example, the correlation coefficients c ₁ ,..., C _N corresponding to the first images IMG _1,1 ,..., IMG _1,N may be calculated. In an embodiment, the correlation coefficients _{c n} between the first image IMG _{1, n} for the second image IMG ₂ and / _{is, c n = (QV 1,} n T · QV 2) / (| QV 1, _n |·|QV ₂ |), where (·) ^T is the transpose operation and |·| is the norm operation. The larger the correlation coefficient _{c n} Gayori, the first image IMG _{1, n} and the second image IMG ₂ are more correlated.

In an embodiment, at least one filtered image IMG _k in the first images IMG _1,1 ,..., IMG _1,N is selected. The filtered image IMG _k has at least one filtered correlation coefficient c _k corresponding to the filtered image IMG _k greater than a certain threshold TH value (eg, the correlation coefficient c _k is greater than 0.8). ) Selected and filtered image IMG _k corresponds to at least one virtual position VP _k in the virtual environment VEN, which virtual position VP _k captures the filtered image IMG _k by the reality presentation device 10. Corresponds to at least one real place in the real environment REN.

Furthermore, one particular filter image _IMG ^{k *} is selected from the image IMG _k the filtered, the specific virtual position _VP ^{k *} corresponding to the particular filter image _IMG ^{k *} is computed. The virtual position VP _k ^* corresponds to the real location RL _k ^* in the real environment REN where the reality presentation device 10 or the image capture module 12 captures the first image IMG _k ^* . Furthermore, the relative virtual position RVP _k ^* relative to the virtual position VP _k ^* (in the virtual position VP ^* ) is determined by the specific filtered image IMG _k ^* and the second image (in the filtered image IMG ^* ). Calculated according to IMG ₂ . According image _IMG ^{k *} and the second image IMG ₂ specified filter, the relative virtual positions _RVP ^{k *} corresponding to the particular filter image _IMG ^{k *} is computed. Selecting a particular filter image IMG _k ^* from the filtered image IMG _k counts the number of number and outliers (outlier) of inliers (inliers), can be achieved by comparison, but not limited to .. Computing the relative virtual position RVP _k ^* is known in the art and is not mentioned here for the sake of brevity. Therefore, the initial virtual position VP _I may be calculated as VP _I =VP _k ^* +RVP _k ^* .

In another example, the filtered image IMG _n ^* in the first image IMG _1,1 ,..., IMG _1,N may be obtained and the phase corresponding to the filtered image IMG _n ^*. correlation coefficients _c ^{n *} correlation coefficients _c 1, · · ·, as is the maximum correlation coefficient in the _{c n,} it may be obtained. Specifically, after the correlation coefficients _c 1, · · ·, _{c N} is calculated, the processing unit 14 performs a sort operation on the correlation coefficients _c 1, · · ·, _{c N,} correlation The correlation coefficient c _n ^* may be chosen such that the number c _n ^* is the maximum of the correlation coefficients c ₁ ,..., C _N , ie the correlation coefficient c _n ^* is c _n ^*. =max(c ₁ ,..., C _N ). Briefly, a filtered image IMG _n ^* corresponding to the correlation coefficient c _n ^* can be obtained and the filtered image IMG _n ^* is the first image IMG _1,1 ,..., IMG _1, It is the first image of _N which is the most correlated with the second image IMG ₂ .

In another perspective, the virtual position VP _n ^* in the virtual environment VEN corresponding/following the first image IMG _n ^* may be obtained. The virtual position VP _n ^* corresponds to the real location RL _n ^* in the real environment REN where the reality presentation device 10 or the image capture module 12 captures the first image IMG _n ^* . The method by which the processing unit 14 acquires the virtual position VP _n ^* is not limited. In an embodiment, the user/player may stand at a predefined physical location RL′ and a virtual position VP′ corresponding to the physical location RL′ may be calculated. If the first image IMG _n ^* captured at the real location RL′ is the first image most correlated with the _second image IMG ₂ , the virtual position VP _n ^* is acquired as the virtual position VP′.

Initial virtual position VP _I in a virtual environment VEN corresponding to the second image IMG ₂ may be calculated in accordance with the first image _IMG ^{n *} and the second image IMG _2. The method of calculating the initial virtual position VP _I is not limited. In an example, the relative virtual position RVP associated with the virtual position VP _n ^* may be calculated according to the first image IMG _n ^* and the second image IMG ₂ , and further the virtual position VP _n ^* and the relative virtual position. Calculate the initial virtual position VP _I according to RVP. Assuming that the virtual position VP _n ^* , the relative virtual position RVP, and the initial virtual position VP _I are represented in a vector format and represent coordinates in 2D space, the initial virtual position VP _I is represented as VP _I =VP _n ^* +RVP. May be done.

In other words, no matter where the user/player is located in the real environment REN, the reality presentation device 10 can acquire the virtual position in the virtual environment VEN corresponding to the real place in the real environment REN.

In the embodiment where the user/player plays a game with a virtual environment VEN corresponding to the real environment REN, the user/player can power on the reality presentation device 10 anywhere in the real environment REN, The unit 14 will calculate an initial virtual position VP _I corresponding to the physical location RL where the user/player and the reality presentation device 10 are located. The reality presenting device 10 may generate a VR360° image according to the initial virtual position VP _I , so that the user/player sees the viewpoint from the initial virtual position VP _I in the virtual environment VEN, Is the same (or the same) as the viewpoint from the real place RL in the real environment REN.

In step 310, the display screen 16 displays the virtual environment VEN from the perspective of the initial virtual position VP _I when the user/player starts a particular software application. The particular software application may be a game involving virtual reality. In other words, the display screen 16 may display a plurality of VR images corresponding to the virtual environment VEN at the viewpoint of the initial virtual position VP _I. The initial virtual position VP _I corresponds to the physical location RL _I in the physical environment REN at which the reality presentation device 10 or the image capture module 12 captures the second image IMG ₂ . When a user/player launches a particular software application, the user/player will perceive multiple VR images of the virtual environment VEN and the user/player will be immersed in the virtual environment VEN, just as if in the real environment REN. to experience the virtual environment VEN like being in the real place RL _I.

By performing the process 30, there is no significant difference between the virtual environment VEN experienced by the user/player and the real environment REN. Therefore, the immersive experience experienced by the user/player is further enhanced.

The embodiments described above are used, inter alia, to illustrate the inventive concept. Persons of ordinary skill in the art may make modifications and variations accordingly and not limited herein. For example, the process 30 may simply be executed by the reality presentation device 10. That is, step 304 and step 308 may be executed by the processing unit 14 of the reality presentation device 10, and this is not limited here. Process 30 may be performed by the system.

FIG. 4 is a schematic diagram of a system 41 according to an embodiment of the present disclosure. The system 41 includes a reality presentation device 40 and a remote computing device 43. The reality presentation device 40 and the remote computing device 43 may be connected via a wireless connection or a wireless interface. The reality presentation device 40 includes an image capturing module 42 and a display screen 46. The remote computing device 43 may be a cloud computing device, an edge computing device, or a combination of cloud computing devices and edge computing devices, which may be computers or servers. Process 30 may be performed by system 41, in which case steps 302 and 306 may be performed by image capture module 42 and steps 304 and 308 may be performed by remote computing device 43. Step 310 may be performed by display screen 46, which is also within the scope of this disclosure.

In summary, the present disclosure can calculate an initial virtual position that corresponds to the actual location where the user/player and the reality presentation device are located. Compared to the prior art, the user/player can start a game with a virtual environment at any real place in the real environment. There is no significant difference between the virtual environment VEN experienced by the user/player and the real environment REN. Therefore, the immersive experience experienced by the user/player is further enhanced.

One of ordinary skill in the art will readily observe that numerous modifications and variations to the apparatus and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.

Claims (18)

Collecting a plurality of first images of the real environment and constructing a virtual environment corresponding to the real environment according to the plurality of first images;
Acquiring a second image of the real environment with a reality presentation device;
Calculating an initial virtual position in the virtual environment corresponding to the second image according to the plurality of first images and the second image;
A step of displaying the virtual environment from the viewpoint from the initial virtual position when the specific application of the reality presentation device is started by the reality presentation device;
Including,
The positioning method, wherein the initial virtual position corresponds to an initial physical location in the physical environment in which the reality presentation device captures the second image. Comparing the second image with the plurality of first images to obtain a plurality of correlation coefficients of the plurality of first images with respect to the second image;
Obtaining at least one filtered image in the plurality of first images such that at least one filtered correlation coefficient corresponding to the at least one filtered image is greater than a certain threshold. The at least one filtered image corresponds to at least one virtual position in the virtual environment, and the at least one virtual position is the at least one filtered image for the reality presentation device. Corresponding to at least one real location in the real environment to capture, and
Calculating the initial virtual position according to the at least one filtered image and the second image;
The positioning method according to claim 1, further comprising: Comparing the second image with the plurality of first images and obtaining a plurality of correlation coefficients of the plurality of first images with respect to the second image,
Obtaining a plurality of first quantification vectors corresponding to the plurality of first images;
Obtaining a second quantification vector corresponding to the second image;
Calculating a plurality of first correlation coefficients of the plurality of first quantification vectors with respect to the second quantification vector;
Obtaining the plurality of correlation coefficients as the plurality of first correlation coefficients,
The positioning method according to claim 2, further comprising: Obtaining a plurality of first quantification vectors corresponding to the plurality of first images,
Performing a feature extraction operation on the plurality of first images to obtain the plurality of first quantification vectors,
The positioning method according to claim 3, wherein the quantification vector corresponding to the first image in the plurality of first images indicates a plurality of appearance numbers corresponding to the plurality of features in the first image. Acquiring a second quantification vector corresponding to the second image,
Performing a feature extraction operation on the second image to obtain the second quantification vector,
The positioning method according to claim 3, wherein the second quantification vector indicates a plurality of appearance numbers corresponding to a plurality of features in the second image. Calculating the initial virtual position corresponding to the second image in the virtual environment according to the at least one filtered image and the second image,
Calculating a relative virtual position associated with a virtual position within the at least one virtual position according to the at least one filtered image and the second image;
Calculating the initial virtual position corresponding to the second image according to the virtual position and the relative virtual position;
The positioning method according to claim 2, further comprising: A reality presentation device capable of displaying a virtual environment for a user, wherein the virtual environment is constructed based on a plurality of first images captured from the real environment, and the reality presentation device comprises:
An image capture module configured to capture a second image from the real environment;
Constructing the virtual environment corresponding to the real environment according to the plurality of first images, and initializing in the virtual environment corresponding to the second image according to the plurality of first images and the second images A processing unit configured to perform the step of calculating a virtual position,
A display screen configured to display the virtual environment from the viewpoint from the initial virtual position when a specific application of the reality presentation device is started,
The reality presentation device, wherein the initial virtual position corresponds to an initial reality location in the real environment in which the reality presentation device captures the second image. The processing unit is
Comparing the second image with the plurality of first images to obtain a plurality of correlation coefficients of the plurality of first images with respect to the second image;
Obtaining at least one filtered image in the plurality of first images such that at least one filtered correlation coefficient corresponding to the at least one filtered image is greater than a certain threshold. The at least one filtered image corresponds to at least one virtual position in the virtual environment, and the at least one virtual position is the at least one filtered image for the reality presentation device. Corresponding to at least one real location in the real environment to capture, and
Calculating the initial virtual position according to the at least one filtered image and the second image;
The reality presentation device according to claim 7, further configured to perform. The processing unit compares the second image with the plurality of first images to obtain a plurality of correlation coefficients of the plurality of first images with respect to the second image;
Obtaining a plurality of first quantification vectors corresponding to the plurality of first images;
Obtaining a second quantification vector corresponding to the second image;
Calculating a plurality of first correlation coefficients of the plurality of first quantification vectors with respect to the second quantification vector;
Obtaining the plurality of correlation coefficients as the plurality of first correlation coefficients,
The reality presentation device according to claim 8, further configured to perform. The processing unit obtains a plurality of first quantification vectors corresponding to the plurality of first images;
Performing a feature extraction operation on the plurality of first images to obtain the plurality of first quantification vectors, the method further comprising:
The realism presentation according to claim 9, wherein the quantification vector corresponding to the first image in the plurality of first images indicates a plurality of appearance numbers corresponding to the plurality of features in the first image. apparatus. The processing unit obtains a second quantification vector corresponding to the second image;
Performing a feature extraction operation on the second image to obtain the second quantification vector, the method further comprising:
The reality presentation device according to claim 9, wherein the second quantification vector indicates a plurality of appearance numbers corresponding to a plurality of features in the second image. The processing unit calculates the initial virtual position corresponding to the second image in the virtual environment according to the at least one filtered image and the second image;
Calculating a relative virtual position associated with a virtual position within the at least one virtual position according to the at least one filtered image and the second image;
Calculating the initial virtual position corresponding to the second image according to the virtual position and the relative virtual position;
The reality presentation device according to claim 8, further configured to perform. A system capable of displaying a virtual environment for a user, the virtual environment being constructed based on a plurality of first images captured from a real environment, the system comprising:
A reality presentation device,
An image capture module configured to capture a second image from the real environment, and
A display screen configured to display the virtual environment from a viewpoint from an initial virtual position when a specific application of the reality presentation device is started,
A reality presenting device including
Constructing the virtual environment corresponding to the real environment according to the plurality of first images; and
A remote computing device configured to perform the step of calculating the initial virtual position in the virtual environment corresponding to the second image according to the plurality of first images and the second image. ,
The initial virtual position corresponds to an initial physical location in the physical environment in which the reality presentation device captures the second image. The remote computing device is
Comparing the second image with the plurality of first images to obtain a plurality of correlation coefficients of the plurality of first images with respect to the second image;
Obtaining at least one filtered image in the plurality of first images such that at least one filtered correlation coefficient corresponding to the at least one filtered image is greater than a certain threshold. Where the at least one filtered image corresponds to at least one virtual position in the virtual environment, the at least one virtual position being the at least one filtered image by the reality presentation device. Corresponding to at least one real location in the real environment to capture, and
Calculating the initial virtual position according to the at least one filtered image and the second image;
14. The system of claim 13, further configured to perform. The remote computing device compares the second image with the plurality of first images and obtains a plurality of correlation coefficients of the plurality of first images with respect to the second image,
Obtaining a plurality of first quantification vectors corresponding to the plurality of first images;
Obtaining a second quantification vector corresponding to the second image;
Calculating a plurality of first correlation coefficients of the plurality of first quantification vectors with respect to the second quantification vector;
Obtaining the plurality of correlation coefficients as the plurality of first correlation coefficients,
15. The system of claim 14, further configured to perform. The remote computing device obtains a plurality of first quantification vectors corresponding to the plurality of first images;
Performing a feature extraction operation on the plurality of first images to obtain the plurality of first quantification vectors, the method further comprising:
The system of claim 15, wherein the quantification vector corresponding to a first image in the plurality of first images indicates a plurality of occurrences corresponding to a plurality of features in the first image. The remote computing device obtains a second quantification vector corresponding to the second image;
Performing a feature extraction operation on the second image to obtain the second quantification vector, the method further comprising:
The system of claim 15, wherein the second quantification vector indicates a plurality of occurrences corresponding to a plurality of features in the second image. The remote computing device calculates, according to the at least one filtered image and the second image, the initial virtual position corresponding to the second image in the virtual environment;
Calculating a relative virtual position associated with a virtual position within the at least one virtual position according to the at least one filtered image and the second image;
Calculating the initial virtual position corresponding to the second image according to the virtual position and the relative virtual position;
15. The system of claim 14, further configured to perform.

Images