KR101752799B1 - 3d camera capable of acquiring depth information, acquisition method of depth information and the recording medium thereof - Google Patents

Abstract

According to an embodiment of the present invention, since no separate element is required to acquire image depth information, the volume and unit cost of the 3D camera can be reduced, and depth information on the entire region of the object image can be obtained. To this end, in particular, one embodiment of the present invention is a three-dimensional camera capable of extracting depth information of an image for a stereoscopic image, comprising: a lens through which light emitted from a subject is transmitted; A focal length information storage unit for storing a focal length value for each lens position; An image sensor for receiving light and generating an object image corresponding to a movement displacement of the lens; A focal length arithmetic unit for obtaining a maximum sharpness position for each pixel block in the generated subject image and obtaining a movement displacement of the lens corresponding to the highest sharpness position; And a depth information operation unit for obtaining a focal distance value for each pixel block based on the focal distance value and the movement displacement for each position of the lens and acquiring depth information of the subject image corresponding to the focal distance value for each pixel block And a three-dimensional camera capable of extracting depth information.

Description

TECHNICAL FIELD [0001] The present invention relates to a 3D camera capable of extracting depth information of an image, a depth information extracting method of the image, and a recording medium of the extracting method.

The present invention relates to a three-dimensional camera capable of extracting depth information of an image for a stereoscopic image and a method for extracting depth information of the image. More particularly, the present invention relates to a three-dimensional camera capable of extracting depth information of an image, which can extract depth information of a subject using a focal distance of each pixel block of a three-dimensional camera, a depth information extracting method of the image, .

Conventionally, a three-dimensional stereoscopic image or a holography implementation method has been performed by a method of implementing a distance map using a distance measuring sensor and a laser. In particular, the laser is superior to other light sources in terms of monochromaticity and straightness, and has a high brightness, so that interference can be minimized. Thus, the laser is utilized as a three-dimensional laser scanner. In the distance measuring sensor, Is obtained by dividing the time difference (TOF) reaching the ultrasonic wave by the progress speed of the ultrasonic wave to obtain the 3D information.

However, the above-described conventional techniques have disadvantages in that separate elements such as an infrared sensor, an ultrasonic sensor, and a laser are required, and such a separate element is a factor for increasing the size of a three-dimensional camera. Also, since the area of the estimated value increases exponentially as the distance from the subject increases, there is a limit to the implementation of the entire area distance map of the subject image.

Accordingly, there is a need for an apparatus and method for acquiring depth information of a subject image based on a subject image without providing a separate element or the like in the 3D camera.

The present invention relates to a three-dimensional camera capable of extracting depth information of an image, which can extract depth information of an entire region of a subject image using a focal distance of each pixel block of a three-dimensional camera, a method of extracting depth information of an image, Media.

The present invention relates to a three-dimensional camera capable of extracting depth information of an image for a stereoscopic image, the three-dimensional camera comprising: a lens through which light emitted from a subject is transmitted; A focal length information storage unit for storing a focal length value for each lens position; An image sensor for receiving light and generating an object image corresponding to a movement displacement of the lens; A focal length arithmetic unit for obtaining a maximum sharpness position for each pixel block in the generated subject image and obtaining a movement displacement of the lens corresponding to the highest sharpness position; And a depth information operation unit for obtaining a focal distance value for each pixel block based on the focal distance value and the movement displacement for each position of the lens and acquiring depth information of the subject image corresponding to the focal distance value for each pixel block A three-dimensional camera capable of extracting depth information is provided.

The highest sharpness position may be the position of the lens where the high frequency component of the subject image corresponding to the pixel block is the highest.

The focal distance value for each position of the lens may be the corresponding focal length map information from the minimum displacement of the lens to the maximum displacement of the lens.

The depth information of the subject image may be distance information from the lens to the subject.

The depth information of the subject image may be focal length map information corresponding to the entire pixel block constituting the subject image.

The focal length information storage unit may include a nonvolatile memory.

And an actuator for transmitting a displacement driving force to the lens to change the position of the lens.

According to another aspect of the present invention, there is provided a method of extracting depth information of an image for a stereoscopic image, the method comprising the steps of: (S10) storing a focal length value for each lens position in a focal length information storage unit; (S20) an image sensor generates an object image according to the displacement of the lens; Obtaining a maximum sharpness position for each pixel block in the subject image in which the focal length calculating unit is generated (S30); (S40) of obtaining a displacement of the lens corresponding to the highest sharpness position by the focal length calculating unit; Acquiring a focal distance value per pixel block based on the focal distance value and the moving displacement of the depth information calculation unit by the position of the lens (S50); And a step (S60) of obtaining depth information of the object image corresponding to the focal distance value per pixel block by the depth information operation unit.

The present invention also provides a recording medium on which a computer-readable program for executing a method of extracting depth information of an image is recorded.

According to one embodiment of the present invention, since the depth information of the image can be obtained by using the image of the object generated by the image sensor according to the displacement of the lens, no additional element is required. Therefore, Can be reduced.

Also, depth information on the entire area of the subject image can be obtained.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing a configuration of one embodiment of a three-dimensional camera capable of extracting depth information of an image according to the present invention;
FIG. 2 is a flowchart sequentially illustrating an embodiment of a depth information extracting method according to the present invention.

<Three-dimensional camera that can extract depth information of image>

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing a configuration of one embodiment of a three-dimensional camera capable of extracting depth information of an image according to the present invention. 1, the 3D camera of the present invention includes a lens 5, a focal length information storage unit 10, an image sensor 20, a focal length calculation unit 30, and a depth information calculation unit 40, .

One embodiment of the present invention is a three-dimensional camera in which an image sensor 20 receiving light from a subject through a lens 5 generates an object image for each position of the lens 5, 5, the depth information calculator 40 functions to acquire depth information of an object image corresponding to a focal distance of each pixel block of the object image, by calculating the focal length of each pixel block of the object image according to the movement displacement of the object.

Hereinafter, the configuration of this embodiment will be described in detail with reference to Fig.

The lens 5 refracts the light emitted from the subject and transmits the light so as to form an image on the image sensor 20 described below. This lens 5 is driven from the minimum displacement to the maximum displacement with respect to the image sensor 20 as the focusing lens. The actuator 5 may further include a voice coil motor (VCM) actuator or a MEMS (Magnetically Coupled Plasma) actuator. The actuator 5 may be a VCM Microelectromechanical Systems) actuators.

The focal length information storage unit 10 stores the focal length value for each position of the lens 5. The focal distance value of each lens 5 is stored and stored in the corresponding focal distance map information from the minimum displacement to the maximum displacement of the lens 5, . The focal length information storage unit 10 may include a non-volatile memory.

The image sensor 20 receives the light and generates an image of the object according to the movement displacement of the lens 5. Such an image sensor 20 CCD (Charge-Coupled Device) sensor or a CMOS (Complementary Metal-Oxide-Semiconductor) sensor may be used.

The focal length calculating unit 30 obtains the highest sharpness position for each pixel block in the generated subject image and obtains the displacement of the lens 5 corresponding to the highest sharpness position.

Here, the highest sharpness position is the position of the lens 5 where the high-frequency component of the subject image corresponding to the pixel block is the highest, and the edge score of each scene constituting the subject image is calculated to obtain the highest sharpness Can be distinguished. It is possible to obtain the maximum sharpness position individually for each pixel block constituting the subject image and acquire the moving displacement of the lens 5 by receiving the driving displacement information of the corresponding actuator 50. [

The depth information calculation unit 40 calculates the focal length value of each pixel block based on the focal length value and the movement displacement of the lens 5 and acquires depth information of the subject image corresponding to the focal distance value of each pixel block It plays a role. The displacement can be represented by a DAC (Diagital AF Code) code having a predetermined step range. That is, for example, the DAC code and the displacement are proportional to each other, and the displacement is represented by the DAC code.

Here, the depth information of the subject image is obtained as focal length map information corresponding to the entire pixel block constituting the subject image as distance information from the lens 5 to the subject. Since the focal length value of the lens 5 includes the subject distance information between the subject and the lens 5, the focal length value per pixel block means depth information per pixel block of the subject image. Also, the depth information of the subject image can be represented by digital information like the above-described moving displacement.

<Extraction Method of Depth Information of Image>

FIG. 2 is a flowchart sequentially illustrating an embodiment of a depth information extracting method according to the present invention. As shown in FIG. 2, in an embodiment of the depth information extracting method of the present invention, the focal length distance value of the lens 5 is stored in the focal length information storing unit 10 (S10). The focal length value of each lens 5 may be stored in a nonvolatile memory before photographing the subject in the form of a lookup table, which is information necessary to acquire depth information of the subject image.

Next, the image sensor generates an object image corresponding to the displacement of the lens 5 (S20). Here, the moving displacement of the lens 5 is a displacement moving from the minimum displacement to the maximum displacement, and can be represented by a digital code such as a DAC code.

Next, the focal length calculating unit 30 obtains the maximum sharpness position for each pixel block in the generated subject image (S30). The highest sharpness position can be obtained variously for each pixel block, which means that the focal length of the corresponding pixel block is formed at the highest sharpness position.

Next, the focal length calculating section 30 obtains the displacement of the lens 5 corresponding to the highest sharpness position (S40). Since the displacement of the lens 5 is a result of the driving force of the actuator 50, it can be known from the displacement of the actuator 50 and can be represented by the DAC code.

Next, the depth information calculation unit 40 obtains the focal length value for each pixel block based on the focal distance value and the moving displacement for each position of the lens 5 (S50). That is, the focal distance value of each pixel block is obtained based on the moving displacement of the lens 5 with reference to the focal distance value of the pre-stored lens 5.

Finally, an embodiment of a method of extracting depth information of a subject image may be performed by obtaining the depth information of the subject image corresponding to the focal distance value per pixel block (S60). Here, since the depth information of the subject image is distance information between the subject and the lens 5, the focal distance value per pixel block means depth information for each pixel block.

The method of extracting the depth information of the subject image described above can be written in a computer-readable program, and thus the recording medium on which such a program is recorded can be included in an embodiment of the present invention.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, It will be understood that the invention may be practiced. It is therefore to be understood that the embodiments described above are to be considered in all respects only as illustrative and not restrictive. In addition, the scope of the present invention is indicated by the following claims rather than the above detailed description. Also, all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included within the scope of the present invention.

5: Lens
10: Focal length information storage unit
20: Image sensor
30: Focal length calculating unit
40:
50: Actuator

Claims (9)

A three-dimensional camera capable of extracting depth information of an image for a stereoscopic image,
A lens through which light emitted from a subject is transmitted;
A focal length information storage unit for storing a focal length value for each position of the lens;
An image sensor for receiving the light and generating an object image according to a movement displacement of the lens;
A focal length calculating unit for obtaining a maximum sharpness position for each pixel block in the generated subject image and obtaining a displacement of the lens corresponding to the highest sharpness position; And
A depth information calculator for obtaining a focal length value for each pixel block based on the focal length value for each position of the lens and the moving displacement and obtaining depth information of the subject image corresponding to the focal distance value for each pixel block; Including,
Wherein the depth information of the subject image is capable of extracting depth information of an image corresponding to a focal length value of each pixel block in all the pixel blocks constituting the subject image.
The method according to claim 1,
Wherein the maximum sharpness position is capable of extracting depth information of an image that is a position of the lens at which a high frequency component of an object image corresponding to the pixel block is maximized.
The method according to claim 1,
The three-dimensional camera according to claim 1, wherein the focal distance value of the lens is a depth of the image corresponding to the focal length map information from the minimum displacement to the maximum displacement of the lens.
The method according to claim 1,
Wherein the depth information of the subject image is capable of extracting depth information of the image, which is distance information from the lens to the subject.
The method according to claim 1,
Wherein the depth information of the subject image is capable of extracting depth information of an image that is focal length map information corresponding to all pixel blocks constituting the subject image.
The method according to claim 1,
Wherein the focal length information storage unit is capable of extracting depth information of an image including a nonvolatile memory.
The method according to claim 1,
And an actuator for transmitting a displacement driving force to the lens to change a position of the lens.
A method of extracting depth information of an image for a stereoscopic image,
A step (S10) of storing a focal length value for each lens position in a focal length information storage unit;
(S20) an image sensor generates an object image according to a movement displacement of the lens;
(S30) of obtaining a maximum sharpness position for each pixel block in the generated subject image by the focal length calculating unit;
(S40) the focal distance arithmetic unit obtains a displacement of the lens corresponding to the highest sharpness position;
(S50) the depth information calculation unit obtains the focal distance value for each pixel block based on the focal distance value and the moving displacement for each position of the lens; And
(S60) the depth information operation unit obtaining depth information of the subject image corresponding to the focal distance value per pixel block,
Wherein the depth information of the subject image corresponds to a focal length value of each pixel block in all the pixel blocks constituting the subject image.
A recording medium on which a computer-readable program for executing a method of extracting depth information of an image according to claim 8 is recorded.

Images