JPH05135155A - Three-dimensional model constitution device using successive silhouette image - Google Patents

Abstract

PURPOSE:To provide a three-dimensional model constitution device which uses successive silhouette images and constitutes a three-dimensional model with the successive silhouette images of an object body on a turntable under normal lighting conditions. CONSTITUTION:Images of the object body 5 rotating on the turntable 4 are successively picked up by a camera 7, and an image processing computer extracts the silhouette images of the object body from the picked-up images, and measures the horizontal distance to the vertical axis of rotation from the silhouette images. A graphic computer 10 generates the three-dimensional model according to the horizontal distance and angle of rotation, extracts only image data on the vertical line positioned on the axis of rotation of the successively picked-up images, and displays the extracted images on the three-dimensional model display device 11.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus for constructing a three-dimensional model using continuous silhouette images, and in particular, it is used in the fields of image communication, generation of virtual space by graphics, stereoscopic display of video conferences, etc. 3 by the continuous silhouette image that obtains the three-dimensional information of the face using
The present invention relates to a dimensional model construction device.

[0002]

2. Description of the Related Art As a conventional method for constructing a three-dimensional model, a structured light such as a laser or slit light is illuminated on an object, and its deformation is measured to obtain the shape of the object. The light cutting method is known. However, scanning the laser beam on the face is unnatural for humans because it is not possible to obtain a correct shape for hair or other weakly reflective objects. There are other methods, such as depth calculation method using stereo parallax or screen motion, and shape detection method using shading, but the former method is ineffective in uniform shade distribution of the face, and the latter method assumes the same reflectance. However, none of them can provide satisfactory accuracy.

On the other hand, there is also a method of transforming a standard model of a face with reference to an image picked up by a camera, but it has been extremely difficult to transform it into a human image which actually has many changes with a small number of models.

Therefore, a main object of the present invention is to provide a three-dimensional model constructing apparatus using continuous silhouette images, which is capable of constructing a three-dimensional model from an image of a rotated object under normal lighting conditions. That is.

[0005]

SUMMARY OF THE INVENTION The present invention is a three-dimensional model constructing apparatus using continuous silhouette images, and an image pickup means for continuously picking up an image of a target object rotating on a horizontal plane about a vertical rotation axis, and an image pickup means. Silhouette image extraction means for extracting the silhouette image of the target object from the output image obtained by the measurement, measuring means for measuring the horizontal distance from the extracted silhouette image to the vertical rotation axis, and the measured horizontal distance and the rotation angle of the target object A three-dimensional model generating means for generating a three-dimensional model based on the above, an image data extracting means for extracting only image data on a vertical line located on the rotation axis of continuously captured images, and an extracted image are generated. It is configured to include a mapping unit that maps to a three-dimensional model.

[0006]

A three-dimensional model constructing apparatus using continuous silhouette images according to the present invention continuously captures a target object rotating on a horizontal plane, extracts a silhouette image of the target object from the captured images, and extracts a vertical rotation axis from the silhouette image. The horizontal distance up to is measured and based on the horizontal distance and the rotation angle, 3
A three-dimensional model is generated, only image data on a vertical line located on the rotation axis of continuously captured images is extracted, and the extracted image is mapped to the three-dimensional model.

[0007]

1 is a diagram for explaining the principle of the present invention. Referring to FIG. 1, a target object 1 is arranged in front of a background 2 having a color different from that of the target object 1, and a rotary shaft 3
Rotate around. The screen position of the rotary shaft 3 is calibrated in advance, and its rotation angle is known. The camera is placed at a position far from the target object 1,
The projection of the target object 1 on the camera is assumed to be orthogonal projection. The target object 1 is imaged as an image of projections at constant angles around the rotation axis, and the target object 1 at each angle is captured.
3D model is constructed from the image.

FIG. 2 is a schematic block diagram of an embodiment of the present invention. With reference to FIG. 2, a person 5 is placed on the turntable 4. The rotary base 4 is controlled by the rotary base controller 6, and the rotary base controller 6 continuously rotates the rotary base 4 at an angle instructed by the image processing computer 9. The camera 7 captures a face image of the rotating human 5 at each angle, and when the turntable 4 makes one rotation, 360 images are obtained. The image output of the camera 7 is given to the image input device 8, and the silhouette of the face shape seen from each direction is extracted by the image processing computer 9. The continuous silhouette is given to the graphics computer 10, and the three-dimensional shape is reconstructed and displayed by the three-dimensional model display device 11.

FIG. 3 is a diagram for explaining a method for extracting a silhouette from an image, and FIG. 4 is a diagram for explaining a method for obtaining a silhouette distribution from a continuous image.

The silhouette is extracted by detecting edges in one image. That is, a Sobel operator is applied to obtain a differential image in order to detect a portion with a large change in brightness. Then, the peak of differentiation is discriminated in both the horizontal and vertical directions, and if that value exceeds a specified threshold value, it is taken as an edge point. When finding a silhouette, as shown in FIG. 3, edge points are searched from both sides of the screen toward the center, and the first matching point is set as the silhouette point. The distance d (y) from the silhouette extracted at each height y to the screen position of the rotation axis is recorded. If the silhouettes of the image sequences taken by continuous rotation are connected, the silhouette distribution d (θ, y) according to the angle is obtained, as shown in FIG.

FIG. 5 is a diagram for explaining a method of dividing a face portion and a non-face portion in a space in which a line of sight passing through a silhouette, and FIG. FIG. 7 is a diagram for explaining a method of calculating a line of sight through a silhouette, and FIG. 8 is a diagram showing an example in which radiation is drawn from a reference point and an envelope is represented by a sequence of points. is there.

In one embodiment of the present invention, the projection from the three-dimensional space onto the camera 7 is assumed to be orthogonal projection. Therefore, 3
The dimensional model can be constructed in each horizontal plane. Consider a horizontal plane of height y with space. As shown in FIG. 5, the angle θ
It is possible to determine the area of the anti-plane where the line of sight of the camera 7 occupies the face, through one point of the silhouette obtained from the image. When this indexing is performed for angles θ1, θ2, ... With respect to a continuous silhouette, the three-dimensional shape of the face becomes an envelope of the line of sight from any angle, as shown in FIG. Based on the principle, a two-dimensional memory for a horizontal plane of each height y is prepared, and its center is the position of the rotation axis.
Since the distance d (θ, y) from the axis is obtained for each angle θ, the line-of-sight family passing through the silhouette can be calculated by the following formula, as shown in FIG. 7.

One point (x1, z1) through which the line of sight passes x1 = d (θ, y) cos θ z1 = d (θ, y) sin θ is calculated, and the simultaneous equation of the line of sight is x = −sin θd + x1 z = cos θt + z1 ( However, t = 0 → ∞) Therefore, if this envelope is extracted, the shape of the face on the horizontal plane can be obtained. As shown in FIG. 8, when radiation is drawn on a two-dimensional memory using angles at equal intervals from arbitrary points in the envelope, it can be said that the first contact point with the line-of-sight family is at the envelope. Recognize. The point sequence on the ring having the shape thus obtained is described as Pi (x, y, z). The origin of radiation is called the horizontal reference point.

When the above-mentioned method is carried out on a horizontal plane at each height, a model of the whole face is constructed. However, it is necessary to determine a reference point at each height. The conditions are:
First, the reference point must fall within the range occupied by the face.
If the range is more centered, the point P at the boundary of the shape
i (x, y, z) is more evenly distributed. Considering the curved surface of the face, the change in shape with height is continuous, and the reference point of the raw horizontal plane should be the center of gravity of the horizontal plane one level above. Therefore, the reference points are updated one after another to connect the boundaries of the model in each horizontal plane. Once the shape on each horizontal plane is determined, they are connected to complete the model of the entire face. As a method,
The points of the shape ring on each horizontal plane are connected by triangular patches according to the angle θ.

Next, a method of attaching the texture will be described. When inputting continuous images, the texture of the face is also stored at the same time. For each screen, it suffices to copy the RGB values on the vertical line located on the rotation axis in order to the texture image file. The vertical axis of the texture file is the same as the vertical axis of the input image, and the horizontal axis represents the image number, that is, the rotation angle of the object. When attaching the texture, first calculate the angle viewed from the model camera. Then, the texture stored at that angle is used as the color of the boundary point.

9 and 10 show experimental results of the present invention. In particular, FIG. 9 shows an example of silhouette distribution, and FIG.
0 indicates a state in which the face region is cut out by the line-of-sight family. Figure 10
In, we show the last model that we have acquired the structure and then mapped the texture onto it.

[0017]

As described above, according to the present invention, a target object rotating on a horizontal plane is continuously captured, a silhouette image of the target object is extracted from the captured images, and the silhouette image to the vertical rotation axis is extracted. The horizontal distance is measured, a three-dimensional model is generated based on the horizontal distance and the rotation angle, only the image data on the vertical line located on the rotation axis of the continuously captured images is extracted, and the extracted image is set to 3 Since the three-dimensional model is mapped, the three-dimensional model can be obtained stably and accurately. The accuracy of the model depends on the resolution of the image and the density of the image during rotation, and is the same as the light section method in principle. Moreover, according to the present invention, since the photodissection method and the triangulation such as stereo are not used, the calibration of the camera can be made very simple.

[Brief description of drawings]

FIG. 1 is a diagram for explaining the principle of the present invention.

FIG. 2 is a schematic block diagram of an embodiment of the present invention.

FIG. 3 is a diagram for explaining a method of extracting a silhouette from an image.

FIG. 4 is a diagram for explaining a method for obtaining a silhouette distribution from continuous images.

FIG. 5 is a diagram for explaining a method in which a line of sight passing through a silhouette separates a face portion and a non-face portion in space.

FIG. 6 is a diagram for explaining that a portion occupied by a face is surrounded by an envelope of the line-of-sight family.

FIG. 7 is a diagram for explaining a method of calculating a line of sight that passes through a silhouette.

FIG. 8 is a diagram showing an example in which radiation is drawn from reference points and an envelope is represented by a sequence of points.

FIG. 9 is a diagram showing an example of silhouette distribution.

FIG. 10 is a diagram showing a state in which a face region is cut out by a line-of-sight family.

[Explanation of symbols]

 1 Target Object 2 Background 3 Rotation Axis 4 Rotation Platform 6 Rotation Platform Control Device 7 Camera 8 Image Input Device 9 Image Processing Computer 10 Graphic Computer 11 3D Model Display Device

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Yoshio Nagashima, Mihaya-cho, Seika-cho, Sōraku-gun, Kyoto Prefecture 5 Mihiratani, ATR Communication Systems Laboratories, Inc. (72) Inventor, Fumio Kishino Soraku-gun, Kyoto Prefecture Seika-cho, Osamu Osamu, Osamu Osamu, 5 Hiratani, A-T Co., Ltd. Communication Systems Laboratory

Claims (1)

[Claims] 1. An image pickup unit for continuously picking up an image of a target object rotating on a horizontal plane about a vertical rotation axis, and a silhouette image for extracting a silhouette image of the target object from an output image picked up by the image pickup unit. Extraction means, measurement means for measuring the horizontal distance from the silhouette image extracted by the silhouette image extraction means to the vertical rotation axis, based on the horizontal distance measured by the measurement means and the rotation angle of the target object A three-dimensional model generating means for generating a three-dimensional model, an image data extracting means for extracting only image data on a vertical line located on the rotation axis of the images continuously captured by the image capturing means, and the image data extracting means A continuous sill comprising mapping means for mapping the extracted image onto the generated three-dimensional model. 3D model construction apparatus according Tsu preparative image.