WO2006117942A1

WO2006117942A1 - Person imaging device and person imaging method

Info

Publication number: WO2006117942A1
Application number: PCT/JP2006/305658
Authority: WO
Inventors: Takeyoshi Iguchi
Original assignee: Konica Minolta Holdings, Inc.
Priority date: 2005-04-28
Filing date: 2006-03-22
Publication date: 2006-11-09

Abstract

A person imaging device and method for creating a picture showing persons who are smiling. The person imaging device is characterized by comprising face image segmenting means for segmenting face images from a captured image showing persons, smiling face judging means for judging whether or not each of the segmented face image is a smiling face, and control means for storing the captured image in storage means when on or more of the face images of the persons are judged to be smiling by smiling face judging means and displaying the captured image with marks on the face images judged to be not smiling on image display means, and outputting a message to prompt the persons of the marked face images to smile to the image display means and speech outputting means.

Description

Specification

Person photographing device and person photographing method

Technical field

[0001] The present invention relates to a person photographing apparatus and a person photographing method for obtaining a photograph in which a plurality of persons in an image are all smiling.

Background art

[0002] It is rare for a person to shoot a plurality of persons! The faces of all the persons who become subjects are in a desirable state at the same time. To that end, the photographer has made various efforts to create a facial expression that is desired by all the people who are subjects, such as “Yes, cheese” and V. However, even with this ingenuity, it is difficult to obtain a photo that satisfies the facial expressions of all the people who are subjects. It is also common to select a photographed image that seems to be optimal from the above. However, in some cases, the desired shot image could not be obtained and it was necessary to retake the shot.

[0003] In order to cope with such a situation, continuous shooting is performed! A face image of a person taken from a plurality of shot images is cut out, and the cut face image is in a desired state. There is also a proposal to create a group photo in which everyone is in the desired state by extracting only the facial images in which the photographed person is in the desired state by determining whether it is a pass or fail, and combining them (for example, (See Patent Document 1).

Patent Document 1: JP 2000-259833 A (Pages 1 and 2)

Disclosure of the invention

Problems to be solved by the invention

[0004] However, many people cannot create their own expressions as freely as the models whose occupation is to make facial expressions. I often do not know whether or not. Therefore, even if it takes time or multiple shots, it becomes a subject, and it is not clear whether or not it is the ability to create the desired facial expression desired by all of the multiple persons! [0005] The present invention has been made in view of the situation as described above, and its purpose is to identify and identify a person who does not have an expected smile among a plurality of persons who are subjects. A person shoot that creates a smile by creating a smile by using the display image and sound to encourage a person to make a smile, and then acquiring the smile image of everyone and creating a smile An apparatus and a person photographing method are provided.

Means for solving the problem

[0006] The above-described problems are achieved by realizing the following person photographing device and person photographing method.

The person photographing device according to claim 1

Photographing means;

Image display means;

Audio output means;

Storage means;

Face image cutout means for cutting out each face image from a photographed image showing a plurality of persons obtained by photographing by the photographing means;

A smile determination means for determining whether or not each of the cut face images is a smile, and a person photographing device comprising:

When one or more of the face images of a plurality of persons is determined to be a smile by the smile determination means, the photographed image is stored in the storage means, and the face determined not to be a smile A mark is added to the image, the photographed image is displayed on the image display means, and a message for prompting the person of the face image with the mark to make a smile is output to the image display means and the sound output means. It has the control means to do.

The person photographing apparatus according to claim 2 is the person photographing apparatus according to claim 1, wherein the control means prompts the person of the face image to which the mark is added to make a smile. After the message is output to the image display means and the audio output means, the next photographing is performed by the photographing means, the obtained photographed image is stored in the storage means, and the photographing obtained by the previous photographing is performed. Even if the image is misaligned, you should not smile. A mark is assigned to the specified face image, the photographed image is displayed on the image display means, and a message prompting the person of the face image with the mark to make a smile is displayed on the image display means and the voice. It outputs to an output means, It is characterized by the above-mentioned.

The person photographing device according to claim 3 is the person photographing device according to claim 2, wherein the control means gives a mark in the photographed image by repeating photographing a plurality of times. When there are no face images, an image in which everyone is smiling is synthesized from a plurality of photographed images stored in the storage means.

The person photographing device according to claim 4 is the person photographing device according to claim 2, wherein the control means performs a predetermined number of times of photographing and stores a plurality of photographings stored in the storage means. The image is synthesized from the image.

The person photographing method according to claim 5 is:

Image capturing means, image display means, audio output means, storage means, face image cutout means for cutting out each face image from a shot image in which a plurality of persons obtained by shooting by the shooting means are captured, and each of the cut out images A person photographing method for photographing a plurality of persons together using a person photographing device having a smile judging means for judging whether or not a face image is a smile.

A step of cutting out face images of a plurality of persons from the captured image obtained by shooting, a step of determining the degree of smile of each of the cut out face images, and one or more of the face images of a plurality of persons When the image is determined to be a smile, the captured image is stored in the storage means, and a mark is given to the face image determined not to be a smile, and the captured image is displayed on the image display means. Outputting a message prompting the person of the face image to which the mark is given to make a smile to the image display means and the audio output means;

It is characterized by having.

The person photographing method according to claim 6 is the person photographing method according to claim 5, wherein the message for urging the person of the face image to which the mark is added to make a smile. After outputting to the image display means and the sound output means, the next photographing is performed, and the obtained photographed image is stored in the storage means and obtained by the previous photographing. A mark is assigned to a face image that is determined not to be a smile from any of the photographed images, the photographed image is displayed on the image display means, and a smile is made on the person of the face image to which the mark is added. And a step of outputting a message prompting to the image display means and the sound output means.

The person photographing method according to claim 7 is the person photographing method according to claim 6, wherein the face image that adds a mark in the photographed image is eliminated by repeating the photographing a plurality of times. In some cases, the method includes a step of synthesizing an image in which everyone is smiling from a plurality of photographed images stored in the storage means.

The person photographing method according to claim 8 is the person photographing method according to claim 6, wherein a predetermined number of times of photographing are performed, and a plurality of photographed images stored in the storage means are used to generate an image. It has the step which synthesize | combines.

The invention's effect

According to the invention described in claim 1, a mark is given to a face image of a person who is not a smiling face among a plurality of persons who are subjects, and the photographed image is used as an image display means. Since it is displayed, it is possible to realize a human photographing device that can easily recognize that the person is not smiling.

[0008] According to the invention described in claim 2 of the present invention, it is clarified that it is necessary to make a smile at the next shooting for a person whose face image is marked as not smiling. Recognizing and repetitively photographing, a person photographing device is realized in which a plurality of persons who are subjects can acquire all smile images.

[0009] According to the invention described in claim 3 of the present invention, a person photographing apparatus is realized that can make a photograph in which a plurality of persons who are subjects are all smiling.

[0010] According to the invention described in claim 4 of the present invention, it is possible to make a photograph in which many of a plurality of persons who are subjects are smiling from a photographed image obtained by photographing a plurality of times. A human photographing device that can do this is realized.

[0011] According to the invention described in claim 5, a mark is given to a face image of a person who is not a smiling face among a plurality of persons who are subjects, and the photographed image is used as an image display means. Because it is displayed, the person can easily recognize that the expression is not smiling. A person photographing method is realized.

[0012] According to the invention described in claim 6 of the present invention, it is clarified that it is necessary to make a smile at the next shooting for a person whose face image is marked as not smiling. Recognizing and repetitively taking pictures, a person photography method is realized in which a plurality of persons who are subjects can acquire all smile images.

[0013] According to the invention described in claim 7 of the present invention, a person photographing method is realized in which a photograph can be made in which a plurality of persons who are subjects are all smiling.

[0014] According to the invention described in claim 8 of the present invention, it is possible to create a photograph in which many of a plurality of persons who are subjects are smiling from a photographed image obtained by photographing a plurality of times. A person photography method is possible.

Brief Description of Drawings

FIG. 1 is an external view of a person photographing apparatus.

FIG. 2 is a diagram schematically showing a configuration of a person photographing apparatus.

FIG. 3 is a conceptual diagram of a front panel.

FIG. 4 is a block diagram showing a control relationship.

FIG. 5 is a flowchart (1Z3) showing a flow of processing for obtaining a smile photo for all members.

FIG. 6 is a flowchart (2Z3) showing the flow of processing for obtaining a smile photo for everyone.

FIG. 7 is a flowchart (3Z3) showing the flow of processing for obtaining a smile photo for all members.

[FIG. 8] A first example of an image with a mark.

FIG. 9 is a second example of an image with a mark.

[Fig. 10] This is an example of a smile photo for everyone.

FIG. 11 is a diagram for explaining a preferred example of smile determination means.

Explanation of symbols

[0016] 1 box

2 Shooting means

4 Audio output means

5 Image display means

10 Fee payment methods 30 Printing means

A Portrait camera

C Control means

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is an external view of a box-type person photographing apparatus A that is an application example of the present invention.

FIG. 2 is a diagram schematically showing a configuration of the person photographing apparatus A.

FIG. 3 is a conceptual diagram of a front panel of the person photographing apparatus A.

[0021] The person photographing apparatus A includes a box 1 and photographing means 2, illumination means 3, audio output means 4, image display means 5, instruction operation means 6, fee payment means 10, and communication means provided therein. 20, printing means 30, storage medium output means 40, control means C, and the like.

[0022] The box 1 is provided with a curtain 11, and by closing the curtain 11, the person P who is the subject is blocked by the external force, and privacy during photographing is protected. In addition, since the influence of external light can be suppressed, it is possible to obtain optimal illumination conditions for photographing by controlling only the internal illumination means 3. When the person photographing device A is installed outdoors, it also serves as an outdoor house to protect the device from wind and rain.

[0023] The photographing means 2 is a digital camera and may be composed of a plurality of camera cameras. Control means C force The shooting timing is taken by the image capture signal sent, and the face image of the person P is shot through the half mirror 21. Image information obtained by photographing is sent to the control means C and stored in a photographed image file in the memory M. In addition, although the person shown in FIG. 2 is one person, a plurality of persons are lined up in the depth direction of the figure.

[0024] The illumination means 3 has a plurality of illumination lamps and a strobe force, and the intensity of illumination and the lighting timing operation are individually controlled by an instruction signal from the control means C.

[0025] The sound output means 4 is a speaker and is electrically driven by the control means C to output sound.

[0026] The image display means 5 is a display device using CRT, liquid crystal, or plasma, and displays images and characters sent from the control means C. In the present embodiment, the image displayed by the image display means 5 is the person in the box 1 via the half mirror 21 and the touch panel 91. The touch panel 91 appears to the eyes of the object P and looks like the image display surface of the image display means 5 to the person.

The instruction operation means 6 includes a touch panel 91 and a plurality of push buttons arranged below the touch panel 91. The person P sends an instruction or operation signal to the control means C by touching the surface of the touch panel 91 while viewing the image and characters displayed by the image display means 5 or by pressing a push button. Can do.

[0028] Fee payment ヽ means 10 sends a signal of confirmation of charge receipt to the control means C after confirming the amount of coins inserted by the person P or the inserted bill, and is used frequently by vending machines. This is a known one.

[0029] The communication means 20 is used for management of the person photographing apparatus A and image transfer. As a management method, various data including the operating status sent to control means C are sent to the management center, and the upgrade software sent to the management center is received and transferred to control means C. Has been taken. The image transfer function is used to transfer a captured image via a network that is a communication path.

[0030] The printing means 30 is a means for outputting the image information called from the output image file of the memory M as a node copy, and outputs the image by an appropriate method such as a silver salt method, a thermal melting transfer method, an ink jet method, etc. Means are adopted.

[0031] The storage medium output means 40 outputs image information to a medium such as a floppy (registered trademark) disk, CD, DVD, or MO, and is selected according to the medium to be employed. Alternatively, a plurality of types of output means may be provided to support a plurality of types of media.

FIG. 4 is a block diagram showing the control relationship of the person photographing apparatus of the present invention. Control means or CPU, memory M as storage means, arithmetic unit for image processing, drive circuit, etc., and other control means are input / output iZo port, serial or parallel Information is exchanged via the interface and communication means 20. The control means C is controlled by executing a program stored in the memory cell. In the figure, the description of blocks not directly related to the description of the embodiment of the present invention is omitted.

[0033] FIGS. 5 to 7 show that all of a plurality of persons as subjects are photographed with a smile using this person photographing device 装置. It is a flowchart which shows the flow of a process until it obtains the attached photograph.

[0034] When the person P, who is the subject, charges the fee payment means 10 (step SI: Y), 1 is set in the content Ν of the shooting counter CN provided in the memory の of the control means C (S Step S2), the image display means 5 and the sound output means 4 output an image and sound for guiding the person P to smile shooting procedure (step S3).

[0035] Next, in synchronization with the preset display and the shutter sound, the control means C sends a shooting instruction signal to the shooting means 2 (step S4), and the obtained shot image is obtained. Is sent to the control means C and stored in a temporary storage file provided in the memory M (step S5).

[0036] The photographed image stored in the temporary storage file is called by the face image cutout means that is a program, and the face images of a plurality of persons who are subjects are cut out, and the cut image is obtained. Stored. (Step S6). Further, a captured image without a face remaining after the face image is cut out is stored in a mask image file and stored until image synthesis is executed (step S7). Note that a clipping method for clipping a face image from a photographed image is a known technique and can be selected as appropriate.

[0037] For each of the cut face images, whether or not the face image is a smiling face is sequentially determined by smile determination means that is a program (steps S8 to S10). The smile determination means is also a well-known technology and can be selected as appropriate, but smile is determined from the ratio of long side X and short side Y of the rectangle made from the eye angle and mouth angle as shown in Fig. 11. This method is simple and preferable.

[0038] The face image determined to be a smile (step S8: Y) is stored in the smile file (step S9), and it is determined whether all the cut face images have been determined. (Step S10)

[0039] When the determination by the smile determination means for all the extracted face images is completed (step SIO: Y), it is determined whether or not all the extracted face images are stored in the smile file (step S11). If all the extracted face images are determined to be smiles and stored in the smile file (step S11: Y), that is, if all of the face images have been shot with smiles, the face images of all members stored in the smile file And the remaining captured image obtained by cutting out the face image stored in the mask image file, the output image is synthesized by an image synthesizing unit which is a known technical unit. (Step S22), 5 is displayed on the image display means (Step S23), and the face photograph as shown in FIG. 10 in which everyone smiles is output to the print means 30 as a hard copy (Step S24).

[0040] If you have a smile in the clipped face image! If there is a face image determined to be ヽ

(Step Sl l: N), a mark is given to a person who is not smiling on the captured image stored in the temporary storage file and displayed on the image display means 5 (Step S12).

[0041] FIG. 8 shows a first example of an output image. Persons Pl and P3 determined to be smiling are given a mark of “OK”, and person Ρ2 determined to be not smiling Is marked with a blinking dotted circle. FIG. 9 shows a second example of the output image. A mark indicating the remaining number of persons who are not smiling is given to the person Ρ2 who is determined not to smile. A person who is determined not to smile on such a display screen can clearly recognize that he must make a smile.

[0042] Next, 1 is added to the content の of the number-of-times counter CT (step S13), and it is determined whether Ν is greater than or equal to a preset number of times ΝΝ (step S14). If it becomes a habit (step S14: Y), the face image of the person stored in the smile file, the face image of the person who did not get a smile even after the Nth shooting, and the face stored in the mask image file The output image is synthesized from the remaining captured images that were cut out (step S22), the composite image is displayed on the image display means 5 (step S23), and the face photograph is output as a hard copy to the print means 30 (Step S24).

[0043] If N and NN (step S14: N), an image and sound for guiding the next shooting are output (step S15).

[0044] The shot image obtained by shooting (step S16) is stored in the temporary storage file (step S17), and the face image of the person whose face image is not stored in the smile file is shot in the previous shooting. The image is cut out and stored in the cut-out file (step S18).

[0045] For each of the cut face images, whether or not the face image is a smile is sequentially determined by smile determination means that is a program (step S18).

[0046] It is determined whether or not all of the cut face images are smiles (steps S19 to 21), and the face images determined to be smiles are stored in a smile file (step S20). . [0047] Next, if all of the cut out face images are smiling, that is, if all of the face images have been shot with a smile (step S11: Y), all of the face images stored in the smile file are stored. And the remaining captured image obtained by cutting out the face image stored in the mask image file (step S22), the composite image is displayed on the image display means (step S23), and the printing means A face photo in which everyone smiles is output as a hard copy at 30 (step S24).

[0048] If there is a face image that is determined to be a smile in the cut face image!

(Step S11: N), as described above, the photographed image stored in the temporary storage file is displayed on the image display means 5 with a mark that encourages non-smiling people to smile, and the following series of steps ( Step S11, 13: N, 14, 15, 16, 17, 18, 19, 20, 21) Power Whether all face images are stored in the smile file (Step S11: Y), or the number of shots is NN Is repeated until (step S 14: Y) is reached.

[0049] The person photographing apparatus A or the person photographing method as described above automatically identifies a person who is not smiling from the photographed image, and smiles in an easy-to-understand manner using the image display means and sound means. It is possible to create a smile by informing a person who has not made a smile, and from the face images obtained by taking multiple shots, it is possible to compose a photo with all the person who is the subject smiling.

Claims

The scope of the claims

[1] Photography means;

Image display means;

Audio output means;

Storage means;

When one or more of the face images of a plurality of persons is determined to be a smile by the smile determination means, the photographed image is stored in the storage means and a face determined not to be a smile A mark is attached to the image, the photographed image is displayed on the image display means, and a message for prompting the person of the face image with the mark to make a smile is output to the image display means and the sound output means. A human photographing apparatus comprising a control means for performing the above-described operation.

[2] After the control means outputs a message prompting the person of the face image to which the mark is given to make a smile to the image display means and the audio output means, the control means performs the next photographing. The obtained photographed image is stored in the storage means, and a mark is given to the face image that has been determined to be a smile from the deviation of the photographed image obtained so far. Displaying the photographed image on the image display means and outputting a message prompting the person of the face image to which the mark is added to make a smile to the image display means and the voice output means. The person photographing device according to claim 1.

[3] The control means repeats photographing a plurality of times, and when there are no face images to which marks are added in the photographed image, all of the smiles from the plurality of photographed images stored in the storage means. The person photographing device according to claim 2, wherein a certain image is synthesized.

[4] The control means performs a predetermined number of times of photographing and stores a plurality of photographings stored in the storage means. The person photographing device according to claim 2, wherein the images are synthesized from the images.

[5] Shooting means, image display means, sound output means, storage means, face image cutout means for cutting out each face image from a shot image showing a plurality of persons obtained by shooting by the shooting means, and cutout A person photographing method for photographing a plurality of persons together using a person photographing device having a smile judging means for judging whether or not each face image is a smile.

A person photographing method characterized by comprising:

[6] After outputting a message to the image display means and the sound output means to urge the person of the face image to which the mark has been added to make a smile, the next photographing is performed, and the obtained captured image is displayed. A mark is given to a face image that is determined not to be a smile from any of the shot images obtained by shooting so far, and the shot image is displayed on the image display means. 6. The person photographing method according to claim 5, further comprising a step of outputting to the image display means and the sound output means a message prompting to make a smile on the person of the face image assigned with .

[7] By repeating the shooting multiple times, when there are no face images to which marks are added in the shot image, an image in which everyone is smiling is synthesized from the multiple shot images stored in the storage means. The person photographing method according to claim 6, further comprising steps.

8. The person photographing method according to claim 6, further comprising a step of performing photographing a predetermined number of times and combining the images from a plurality of photographed images stored in the storage means.

8S9S0C / 900Zdf / X3d £ 1 H 6JI / 900Z OAV