JP2012227717A - Display device, display program, and display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device, a display program, and a display method which allow intuitive grasping of an imaging position where an image is taken, on the basis of positional information associated with image data.SOLUTION: A display device is provided with: a landmark image storage unit 113 which stores landmark image data in which plural pieces of landmark information respectively generated in correspondence with plural landmarks and including positional information and azimuth information on the landmarks are associated with the images of the landmarks; and a display control unit 130 which on the basis of the positional information associated with respective images and the landmark information, displays on a display unit 9 the plural images and landmark images, reflecting the positional relations with each other.

Description

  The present invention relates to a display device, a display program, and a display method for displaying image data associated with position information using the position information associated with the image data.

  2. Description of the Related Art In recent years, an imaging apparatus such as a digital camera is known that displays an image corresponding to a template prepared in advance on a display monitor and synthesizes and displays information such as characters on the image corresponding to the template. . For example, a technique is known in which an image is automatically combined with a map image and displayed based on position information at the time of shooting the captured image (see Patent Document 1).

JP 2010-68212 A

  By the way, in the conventional technique, the position information associated with the image data is used only when the image data is displayed by being combined with the map image having the position information in advance or when the image data is managed. For this reason, a new display technique capable of intuitively grasping at which position on the map the image data having the position information was photographed has been demanded.

  The present invention has been made in view of the above, and provides a display device, a display program, and a display method capable of intuitively grasping a photographing position where an image is photographed from position information associated with image data. For the purpose.

  In order to solve the above-described problems and achieve the object, the display device according to the present invention generates landmark information corresponding to a plurality of landmarks, and includes landmark information including landmark position information and azimuth information. A landmark image storage unit that stores landmark image data associated with a landmark image, a plurality of images respectively corresponding to a plurality of image data associated with mutually different position information, and the landmark image data The display reflecting the mutual positional relationship between the plurality of images and the landmark image based on the display unit capable of displaying the landmark image, and the position information and the landmark information associated with each image. And a display control unit to be displayed on the unit.

  In the display device according to the present invention, in the above invention, the landmark image storage unit stores landmark image data obtained by photographing each landmark from a predetermined photographing position, and the azimuth information is the predetermined photographing. It includes an orientation in which the landmark is photographed with respect to the position.

  In the display device according to the present invention as set forth in the invention described above, the landmark image storage unit stores a plurality of landmark image data obtained by photographing each landmark from a plurality of directions, and the direction information includes the landmark information. The direction of the landmark when the shooting position is used as a reference is included.

  In the display device according to the present invention, the landmark image stored in the display unit is searched for and displayed on the display unit based on the position information associated with each of the plurality of images. The landmark search unit is further provided, and the display control unit causes the display unit to display the landmark image acquired by the landmark search unit.

  The display device according to the present invention may be configured such that, in the above invention, based on the position information and the landmark information associated with each image, the shooting position of each image is based on the landmark that appears in the landmark image. An azimuth determining unit that determines an azimuth is further provided, and the display control unit causes the display unit to display information related to the determination result determined by the azimuth determining unit.

  Further, in the above invention, the display device according to the present invention is the distance from the landmark that appears in the landmark image to the shooting position of each image based on the position information and the landmark information associated with each image. The distance calculation unit is further provided, and the display control unit causes the display unit to display information on the distance calculated by the distance calculation unit.

  In the display device according to the present invention, in the above invention, the position information includes information expressed using longitude and latitude, and a horizontal direction of the display unit corresponds to one of longitude and latitude, and the display A coordinate setting unit that sets a coordinate system in which the vertical direction of the unit corresponds to the other of longitude or latitude, the positional information associated with each of the plurality of images displayed by the display unit, and the landmark image A boundary image setting unit that sets, as a boundary image, an image located at the boundary of the region including all the landmark information, and the display control unit is based on the position information associated with the boundary image. The plurality of images and the landmark image are displayed on the display unit while reflecting a relative positional relationship with an image other than the boundary image in the coordinate system. To characterized thereby.

  In the display device according to the present invention, the position information associated with each image and the landmark information associated with the landmark image are compared with the position information of another image in the coordinate system. A display position conversion unit that converts the display position information to reflect the relative positional relationship, the display control unit further using the display position information converted by the display position conversion unit, A landmark image is displayed on the display unit.

  Further, in the display device according to the present invention, in the above invention, when the display screen of the display unit is leveled, the orientation of the display device when the direction from the center of the display screen to the screen upper direction is a reference orientation. Further, the landmark detection unit acquires the landmark image corresponding to the direction detected by the direction detection unit from the landmark image storage unit.

  Further, in the display device according to the present invention, in the above invention, the display control unit causes the display unit to display the plurality of images and the landmark image according to the direction detected by the direction detection unit. Features.

  In the display device according to the present invention, in the above invention, the imaging unit that captures a predetermined visual field region to generate image data, the position acquisition unit that acquires the device position information of the display device, and the imaging unit And an image data storage unit that stores the apparatus position information acquired by the position acquisition unit in association with the image data as the position information when the image data is generated.

  In addition, the display program according to the present invention is generated for each of a plurality of landmarks, and landmark image data in which landmark information including landmark position information and azimuth information is associated with the landmark image. And a display unit capable of displaying a plurality of images respectively corresponding to a plurality of image data associated with mutually different position information and a landmark image corresponding to the landmark image data. A display that is displayed on the display unit by reflecting a mutual positional relationship between the plurality of images and the landmark image on the display device provided based on the position information and the landmark information associated with each image. And a control step.

  A display method according to the present invention is a display method that is executed by a display device that includes a display unit that displays an image, and includes the landmark image including landmark information including position information and orientation information. And a display step of displaying an image corresponding to image data having position information based on the mark information on the display screen of the display unit and displaying the image on the display unit.

  According to the present invention, the display control unit reflects the mutual positional relationship between the plurality of images and the landmark image on the display unit based on the positional information associated with each image and the landmark information of the landmark image. Display. Thereby, the user can intuitively grasp the shooting position where the image was shot from the position information associated with the image data.

FIG. 1 is a diagram illustrating a configuration of a side facing the subject (front side) of the imaging apparatus according to the first embodiment of the present invention. FIG. 2 is a diagram illustrating a configuration on the side facing the user of the imaging apparatus according to the first embodiment of the present invention. FIG. 3 is a block diagram illustrating a configuration of the imaging apparatus according to the first embodiment of the present invention. FIG. 4 is a flowchart illustrating an outline of processing performed by the imaging apparatus according to the first embodiment of the present invention. FIG. 5 is a diagram illustrating a situation when shooting is performed in the shooting mode of the imaging apparatus according to the first embodiment of the present invention. FIG. 6 is a diagram illustrating an example of a live view image displayed on the display unit when the imaging apparatus captures images under the situation illustrated in FIG. FIG. 7 is a flowchart showing an overview of the position classification display process shown in FIG. FIG. 8 is a diagram illustrating an outline of a search method detected by the landmark search unit of the imaging apparatus according to the first embodiment of the present invention. FIG. 9 is a diagram illustrating an example of a landmark image acquired by the landmark detection unit of the imaging apparatus according to the first embodiment of the present invention. FIG. 10 is a diagram illustrating an example of a landmark image acquired by the landmark detection unit of the imaging apparatus according to the first embodiment of the present invention. FIG. 11 is a diagram for explaining the outline of the coordinate system set by the coordinate setting unit of the imaging apparatus according to the first embodiment of the present invention on the display screen of the display unit. FIG. 12 is a diagram for explaining the outline of the coordinate system set by the coordinate setting unit of the imaging apparatus according to the first embodiment of the present invention on the display screen of the display unit. FIG. 13 is a diagram for explaining the outline of the coordinate system set by the coordinate setting unit of the imaging apparatus according to the first embodiment of the present invention on the display screen of the display unit. FIG. 14 is a diagram for explaining the outline of the coordinate system set by the coordinate setting unit of the imaging apparatus according to the first embodiment of the present invention on the display screen of the display unit. FIG. 15 is a diagram for explaining the outline of the conversion method by the display position conversion unit of the imaging apparatus according to the first embodiment of the present invention. FIG. 16 is a diagram illustrating an example of an image displayed by the display unit of the imaging apparatus according to the first embodiment of the present invention. FIG. 17 is a flowchart illustrating an overview of the orientation determination process shown in FIG. FIG. 18 is a diagram for explaining an overview of the direction determination method by the direction determination unit of the imaging apparatus according to the first embodiment of the present invention. FIG. 19 is a diagram illustrating an outline of a distance calculation method by the distance calculation unit of the imaging apparatus according to the first embodiment of the present invention. FIG. 20 is a diagram illustrating an example of an image displayed by the display unit of the imaging apparatus according to the first embodiment of the present invention. FIG. 21 is a block diagram illustrating a configuration of the imaging apparatus according to the second embodiment of the present invention. FIG. 22 is a flowchart showing an overview of the position classification display process shown in FIG. FIG. 23 is a diagram illustrating a state in which the imaging apparatus according to the second embodiment of the present invention is leveled. FIG. 24 is a diagram for explaining an overview of a display method by the display control unit of the imaging apparatus according to the second embodiment of the present invention. FIG. 25 is a diagram illustrating a state in which the imaging apparatus according to the second embodiment of the present invention is leveled. FIG. 26 is a diagram illustrating an example of an image displayed by the display unit of the imaging apparatus according to the second embodiment of the present invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings. The present invention is not limited to the embodiments described below. In the following description, an imaging apparatus provided with a display device will be described as an example. Furthermore, the same code | symbol is attached | subjected to the same part in description of drawing.

(Embodiment 1)
FIG. 1 is a diagram illustrating a configuration of a side facing the subject (front side) of the imaging apparatus according to the first embodiment of the present invention. FIG. 2 is a diagram illustrating a configuration on the side (back side) facing the user of the imaging apparatus according to the first embodiment of the present invention. FIG. 3 is a block diagram illustrating a configuration of the imaging apparatus according to the first embodiment of the present invention.

  As illustrated in FIGS. 1 to 3, the imaging device 1 includes an imaging unit 2, a light emitting unit 3, an attitude detection unit 4, a timer 5, an orientation detection unit 6, an operation input unit 7, and a position acquisition unit. 8, a display unit 9, a touch panel 10, a storage unit 11, and a control unit 12.

  The imaging unit 2 includes a lens unit 21, a lens driving unit 22, a diaphragm 23, a diaphragm driving unit 24, a shutter 25, a shutter driving unit 26, an imaging element 27, an imaging driving unit 28, and a signal processing unit. 29.

  The lens unit 21 includes a plurality of lens groups that can be focused and zoomed, and collects light from a predetermined field of view. The lens driving unit 22 is configured by using a stepping motor or a DC motor, and changes the focus position, the focal length, and the like of the lens unit 21 by moving the lens group of the lens unit 21 along the optical axis L1. .

  The diaphragm 23 adjusts exposure by limiting the amount of incident light collected by the lens unit 21. The aperture drive unit 24 is configured by a stepping motor or the like, and drives the aperture 23.

  The shutter 25 sets the state of the image sensor 27 to an exposure state or a light shielding state. The shutter drive unit 26 is configured by a stepping motor or the like, and drives the shutter 25 according to a release signal.

  The image sensor 27 is configured by a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The image sensor 27 receives light collected by the lens unit 21 and performs photoelectric conversion to convert the light into an electrical signal (analog signal). The imaging drive unit 28 generates a timing pulse for driving the imaging device 27 and causes the signal processing unit 29 to output an electrical signal photoelectrically converted by the imaging device 27.

  The signal processing unit 29 is configured by an analog amplifier, an A / D converter, or the like. The signal processing unit 29 performs signal processing such as amplification (gain adjustment) on the electrical signal output from the image sensor 27, and then converts the digital signal to digital image data by performing A / D conversion. Output.

  The light emitting unit 3 is configured using a xenon lamp, an LED (Light Emitting Diode), or the like. The light emitting unit 3 irradiates strobe light that is auxiliary light toward a field of view imaged by the imaging device 1.

  The posture detection unit 4 is configured using an acceleration sensor. The posture detection unit 4 detects the posture state of the imaging device 1 by detecting the acceleration of the imaging device 1. Specifically, the posture detection unit 4 detects the posture (tilt angle) of the imaging device 1 with respect to the horizontal plane.

  The timer 5 has a timekeeping function and a shooting date / time determination function. The timer 5 outputs the date / time data to the control unit 12 in order to add the date / time data to the captured image data.

  The azimuth detecting unit 6 includes a magnetic azimuth sensor, and detects a designated azimuth preset in the imaging device 1. Specifically, the azimuth detecting unit 6 detects the geomagnetism vertical and horizontal components when the display unit 9 is in a horizontal state, thereby detecting the direction upward from the center of the display screen of the display unit 9. The orientation of the imaging device when the reference orientation is set is detected.

The operation input unit 7 includes a power switch 71 that switches the power state of the imaging apparatus 1 to an on state or an off state, a release switch 72 that receives an input of a release signal that gives a shooting instruction, and various types of shooting set in the imaging apparatus 1. A shooting mode switch 73 for switching modes;
An auxiliary operation switch 74 that receives an input of an instruction signal for displaying various auxiliary information on the display unit 9, a menu switch 75 for displaying various settings of the imaging device 1 on the display unit 9, and an instruction to change the angle of view of the imaging device 1 And a zoom switch 76 for receiving a signal input.

  The position acquisition unit 8 receives orbit information of satellites transmitted from a plurality of GPS satellites constituting a GPS (Global Positioning System) that is a measuring means for measuring the position of an object on the ground, and the received orbit information is included in the received orbit information. Based on this, position information of the imaging device 1 is acquired. This position information is longitude, latitude, and time.

  The display unit 9 is realized by using a display panel made of liquid crystal, organic EL (Electro Luminescence), or the like. The display unit 9 displays an image corresponding to the image data generated by the imaging unit 2. The display unit 9 appropriately displays operation information of the imaging device 1 and information related to shooting.

  The touch panel 10 is provided on the display screen of the display unit 9 (see FIG. 2). The touch panel 10 detects a position touched (touched) by the user based on information displayed on the display unit 9, and receives an input of an instruction signal corresponding to the contact position. In general, the touch panel includes a resistance film method, a capacitance method, an optical method, and the like. In the first embodiment, any type of touch panel is applicable.

  The storage unit 11 is realized using a flash memory that can be fixedly provided inside the imaging apparatus 1 and a semiconductor memory such as a RAM (Random Access Memory). The storage unit 11 includes an image data storage unit 111 that stores image data captured by the imaging unit 2, a program storage unit 112 that stores various programs and display programs executed by the imaging device 1, and a plurality of landmarks. A landmark image storage unit 113 that stores a plurality of landmark image data corresponding to landmarks associated with landmark information including position information, azimuth information, name, altitude, and the like. The landmark image storage unit 113 stores landmark image data obtained by shooting each landmark from a predetermined shooting position. Here, the landmark image is any of an icon, a thumbnail image, a deformed image, a character, and a photograph representing a name having direction information and position information in the direction of shooting. Further, the direction information is the direction in which the landmark is imaged with reference to a predetermined image capturing position, for example, north or south. The position information is the longitude and latitude of the landmark. Note that the storage unit 11 may include a storage medium that can be read by a computer, such as a memory card mounted from the outside.

  The control unit 12 is configured using a CPU (Central Processing Unit) or the like. The control unit 12 controls the operation of the imaging apparatus 1 by performing instructions and data transfer corresponding to each part of the imaging apparatus 1 according to an instruction signal or a switching signal from the operation input unit 7 or the touch panel 10. To control.

  A detailed configuration of the control unit 12 will be described. The control unit 12 includes an image processing unit 121, a header information generation unit 122, an imaging control unit 123, a landmark search unit 124, a coordinate setting unit 125, a boundary image setting unit 126, and a display position conversion unit 127. , Orientation determining unit 128, distance calculating unit 129, and display control unit 130.

  The image processing unit 121 performs various types of image processing on the image data input from the signal processing unit 29. Specifically, the image processing unit 121 performs image processing including at least edge enhancement, white balance, and γ correction on the image data. The image processing unit 121 performs image data compression processing and decompression processing based on a JPEG (Joint Photographic Experts Group) compression method or the like.

  The header information generation unit 122 generates header information of image data. Specifically, the header information generation unit 122 displays the date and time by the timer 5 when the release signal is input, the direction detected by the direction detection unit 6, the device position acquired by the position acquisition unit 8, and the size of the image data. Generated as header information of image data.

  When the release signal is input, the shooting control unit 123 performs control to start the shooting operation in the imaging device 1. Here, the imaging operation in the imaging apparatus 1 is the signal processing unit 29 and the image processing unit 121 performing predetermined processing on the image data output from the imaging device 27 by driving the shutter driving unit 26 and the imaging driving unit 28. Refers to movement. The image data thus processed is stored in the image data storage unit 111 in association with the header information generated by the header information generation unit 122 by the control unit 12.

  The landmark search unit 124 searches the landmark image storage unit 113 based on position information associated with each of the plurality of images displayed by the display unit 9 and acquires a landmark image to be displayed on the display unit 9. . Specifically, the landmark search unit 124 searches the landmark image storage unit 113 and acquires landmark images corresponding to landmarks in the vicinity of the position information associated with each of the plurality of images.

  The coordinate setting unit 125 uses a predetermined position on the display screen of the display unit 9 as an origin, the horizontal direction of the display unit 9 corresponds to one of longitude or latitude, and the vertical direction of the display unit 9 corresponds to the other of longitude or latitude. Set the corresponding coordinate system. For example, the coordinate setting unit 125 sets a coordinate system in which a predetermined position on the display screen of the display unit 9 is the origin, the horizontal direction of the display unit 9 corresponds to longitude, and the vertical direction corresponds to the latitude direction.

  The border image setting unit 126 borders an image located at the border of an area including all the position information associated with each of the plurality of images displayed by the display unit 9 and the position information of the landmark information associated with the landmark image. Set as an image.

  The azimuth determination unit 128 determines the azimuth of the shooting position at which each image was shot based on the landmarks appearing in the landmark image based on the position information associated with each image and the landmark information of the landmark image. judge. The direction determination unit 128 determines the direction in which the landmark is photographed based on the landmark information of the landmark image.

  The distance calculation unit 129 calculates the distance from the landmark appearing in the landmark image to the shooting position where each image was shot based on the position information associated with each image and the landmark information of the landmark image.

  The display control unit 130 causes the display unit 9 to display a plurality of images corresponding to each of the plurality of image data stored in the image data storage unit 111. The display control unit 130 reflects the mutual positional relationship between the plurality of images and the landmark image on the display unit 9 based on the position information associated with each image and the landmark information associated with the landmark image. Display. The display control unit 130 causes the display unit 9 to display information related to the determination result of the azimuth determination unit 128 and the calculation result of the distance calculation unit 129. Further, the display control unit 130 causes the display unit 9 to display reduced images (thumbnail images) obtained by reducing each of the plurality of images. Further, the display control unit 130 causes the display unit 9 to display the landmark image with a size smaller than the display screen of the display unit 9 and with a data volume smaller than the capacity when the full screen display is performed.

  The imaging apparatus 1 having the above configuration may be provided with a voice input / output function, a communication function for performing bidirectional communication via the Internet, and the like.

  Next, operations performed by the imaging apparatus 1 according to the first embodiment will be described. FIG. 4 is a flowchart illustrating an outline of processing performed by the imaging apparatus 1.

  In FIG. 4, the case where the imaging device 1 is set to the shooting mode will be described (step S101: Yes). In this case, the display control unit 130 causes the display unit 9 to display a live view image corresponding to image data continuously generated by the imaging unit 2 at a minute time interval (step S102).

  FIG. 5 is a diagram illustrating a situation when the user performs shooting in the shooting mode of the imaging apparatus 1. FIG. 6 is a diagram illustrating an example of a live view image displayed on the display unit 9 when the imaging apparatus 1 captures images under the situation illustrated in FIG. In FIG. 6, a representative image W1 is shown among the live view images that the display unit 9 sequentially displays in time series. As shown in FIGS. 5 and 6, the user determines a composition for photographing a subject while viewing a live view image such as an image W <b> 1 in FIG. 6.

  Subsequently, when a release signal is input by operating the release switch 72 (step S103: Yes), the imaging apparatus 1 acquires image data under the control of the imaging control unit 123 (step S104). ).

  Thereafter, the header information generation unit 122 generates header information of the image data (step S105). Subsequently, the imaging control unit 123 associates the header information with the image data and stores the image data in the image data storage unit 111 (step S106), and the imaging apparatus 1 returns to step S101.

  In step S103, when a release signal is not input via the release switch 72 (step S103: No), the imaging apparatus 1 returns to step S101.

  Next, a case where the imaging apparatus 1 is not set to the shooting mode in step S101 (step S101: No) will be described. In this case, when the imaging apparatus 1 is set to the reproduction mode (step S107: Yes), the display control unit 130 reduces the list of reduced images obtained by reducing the images corresponding to the image data stored in the image data storage unit 111. Is displayed on the display unit 9 (step S108).

  Subsequently, when a reduced image to be displayed on the full screen is selected via the operation input unit 7 or the touch panel 10 (step S109: Yes), the display control unit 130 displays the selected reduced image for a predetermined time (for example, 3 seconds). Only the full screen is displayed on the display unit 9 (step S110). Thereafter, the imaging apparatus 1 returns to step S101.

  On the other hand, when the reduced image to be displayed on the full screen is not selected via the operation input unit 7 or the touch panel 10 (step S109: No), the control unit 12 is positioned via the operation input unit 7 or the touch panel 10. It is determined whether or not the classification display mode is selected (step S111). For example, the control unit 12 causes the touch panel 10 to select an icon (not shown) indicating the position classification display mode displayed in the display screen of the display unit 9 via the touch panel 10. It is determined whether or not the position classification display mode icon has been selected according to the input instruction signal. When the position classification display mode is selected (step S111: Yes), the imaging device 1 proceeds to step S112 described later. On the other hand, when the position classification display mode is not selected within a predetermined time (for example, within 3 seconds) (step S111: No), the imaging device 1 returns to step S101.

  In step S112, the imaging apparatus 1 executes position classification display processing for displaying on the display unit 9 while reflecting the mutual positional relationship between the plurality of images and the landmark image, and returns to step S101. Details of the position classification display process will be described later.

  Next, the case where the imaging apparatus 1 is not set to the shooting mode and the playback mode (step S101: No, step S107: No) will be described. In this case, when the power of the imaging apparatus 1 is turned off by operating the power switch 71 (step S113: Yes), the imaging apparatus 1 ends a series of processes. On the other hand, when the imaging apparatus 1 is not turned off (step S113: No), the imaging apparatus 1 returns to step S101.

  Next, the position classification display process in step S112 shown in FIG. 4 will be described. FIG. 7 is a flowchart showing an overview of the position classification display process shown in FIG.

  As illustrated in FIG. 4, the control unit 12 determines whether an image for performing position classification display is selected in the list of reduced images displayed by the display unit 9 (Step S <b> 201). Specifically, the control unit 12 determines whether an image for performing position classification display has been selected by the user in response to an instruction signal input from the touch panel 10. When an image for position classification display is selected from the list of reduced images displayed on the display unit 9 (step S201: Yes), the imaging apparatus 1 proceeds to step S202 described later. On the other hand, when the image for position classification display is not selected within a predetermined time (for example, within 5 seconds) (step S201: No), the imaging apparatus 1 returns to the main routine shown in FIG.

  In step S202, the landmark search unit 124 searches the landmark image storage unit 113 based on the header information of the selected plurality of image data, and is closest to the device position (position information) included in the header information. A landmark image in which the landmark is reflected is acquired.

  FIG. 8 is a diagram for explaining an outline of a search method that the landmark search unit 124 searches. In FIG. 8, two images selected by the user are described for the sake of simplicity, and the two selected images have different positions (longitude (K) and latitude (I). ).

As shown in FIG. 8, the landmark search unit 124 uses position information included in the header information of the image data selected by the user as points P ₁ (K ₁ , I ₁ ) and P ₃ (K ₃ , In the case of I ₃ ), the landmark image corresponding to Mt. Fuji at the point P ₂ (K ₂ , I ₂ ) is acquired from the landmark image storage unit 113 as the landmark close to the point P ₁ and the point P ₃ . The point P ₂ indicates the representative position of Mt. Fuji.

  Subsequently, the direction determination unit 128 determines the direction in which the landmark was photographed based on the landmark information of the landmark image acquired by the landmark search unit 124 (step S203). For example, when the landmark search unit 124 acquires the landmark image W2 (see FIG. 9) from the landmark image storage unit 113, the azimuth determination unit 128 obtains the landmark image W2 (see FIG. 9). When the landmark information of the landmark image W2 includes information indicating that the landmark was photographed from the south, the direction in which the landmark was photographed is determined to be south. Further, when the landmark search unit 124 acquires the landmark image W3 (FIG. 10) in which the Mt. Fuji and Lake Kawaguchi (see arrow (b) in FIG. 8) are captured from the landmark image storage unit 113, this landmark image is displayed. When the information indicating that the landmark is photographed from the north is described in the landmark information of W3, the direction in which the landmark is photographed is determined to be north.

  Thereafter, the coordinate setting unit 125 uses the predetermined position on the display screen of the display unit 9 as an origin, the horizontal direction of the display unit 9 as the x axis, and the vertical direction as y according to the determination result determined by the azimuth determination unit 128. A coordinate system as an axis is set (step S204).

  FIGS. 11-14 is a figure explaining the outline | summary of the coordinate system which the coordinate setting part 125 sets with respect to the display screen of the display part 9. FIG. 11 to 14, a coordinate system is considered in which the lower left of the display screen of the display unit 9 is the origin, the horizontal direction of the display unit 9 is the x axis, and the vertical direction is the y axis. In the following, in order to simplify the description, only four patterns of the east, west, south, and north directions of the landmark image will be described. In the following, a coordinate system when the coordinate setting unit 125 sets in an area included in the eastern hemisphere and the northern hemisphere will be described, but the same applies to other areas.

As shown in FIG. 11, when the direction setting unit 128 determines that the direction in which the landmark image is captured is north, the coordinate setting unit 125 sets the origin P ₁₁ as the minimum value (K _min , I _min ) for each longitude and latitude. And the upper right point P ₁₂ on the display screen of the display unit 9 is set as a coordinate system corresponding to the maximum values (K _max , I _max ) of longitude and latitude. As shown in FIG. 12, when the direction setting unit 128 determines that the direction in which the landmark image is captured is south, the coordinate setting unit 125 sets the origin P ₁₁ as the maximum value (K _max , I for each of longitude and latitude). _max) to in correspondence, sets the point P ₁₂ each minimum longitude and latitude (K _min, a coordinate system to correspond to I _min).

Further, as shown in FIG. 13, the coordinate setting unit 125 associates the x axis with the latitude and the y axis with the longitude when the direction determining unit 128 determines that the direction in which the landmark image is captured is west. The origin P ₁₁ is made to correspond to the minimum value of longitude (K _min ) and the maximum value of latitude (I _max ), and the point P _{12 is set} to the maximum value of longitude (K _max ) and the minimum value of latitude (I _min ). Set as the corresponding coordinate system. Furthermore, as shown in FIG. 14, when the direction determining unit 128 determines that the direction in which the landmark image was captured is east, the coordinate setting unit 125 corresponds the x axis to the latitude and the y axis to the longitude. When the origin P ₁₁ is made to correspond to the maximum value of longitude (K _max ) and the minimum value of latitude (I _min ), the point P ₁₂ corresponds to the minimum value of longitude (K _min ) and the maximum value of latitude (I _max ). Set as a coordinate system corresponding to.

  As described above, the coordinate setting unit 125 sets the coordinate system for reflecting the mutual positional relationship between the plurality of images and the landmark image in accordance with the direction in which the landmark image determined by the direction determination unit 128 is captured. .

  Subsequently, the boundary image setting unit 126 sets, as a boundary image, an image located at the boundary of an area including all the position information associated with each of the plurality of images and the landmark image (step S205). For example, the boundary image setting unit 126, based on the header information of each of the plurality of selected image data and the landmark information of the landmark image, the image having the maximum longitude or latitude, and the longitude or latitude respectively The image having the minimum value is set as the boundary image.

  Subsequently, the display position conversion unit 127 selects a plurality of pieces of image data selected based on the positions of the maximum and minimum values of the longitude and latitude of the coordinate system in the display area of the display unit 9 set by the coordinate setting unit 125. The position information of the landmark image is converted into display position information reflecting the relative positional relationship with the position information of other images in the display information of the display unit 9 (step S206).

  FIG. 15 is a diagram for explaining the outline of the conversion method by the display position conversion unit 127. In FIG. 15, a coordinate system is considered in which the lower left of the display screen of the display unit 9 is the origin, the horizontal direction of the display unit 9 is the x axis, and the vertical direction is the y axis. Further, in FIG. 15, a case where the direction in which the landmark image is captured by the direction determination unit 128 is south will be described.

As shown in FIG. 15, the display position conversion unit 127 includes an origin P ₁₁ (0, 0) at which the longitude and latitude are the minimum values (K _max , I _max ), respectively, and the longitude and latitude are the maximum values (K _min , K _max , I _max ). When the coordinates of the point P ₁₂ that becomes I _min ) are (X ₁₀ , Y ₁₀ ), and the coordinates of the point P ₁₅ of the image W 4 having the longitude K ₃ and the latitude I ₃ as position information are (X ₁₅ , Y ₁₅ ). The position information of the image W4 is converted into display position information by the following formula.
_{X 10: X 15 = (K} max -K min) :( K max -K 3) ··· (1)
Therefore,
_{X 15 = X 10 × (K} max -K 3) / (K max -K min) ··· (2)
become. Similarly,
Y ₁₅ = Y ₁₀ × (I _max −I ₃ ) / (I _max −I _min ) (3)
become.

  As described above, the display position conversion unit 127 uses the expressions (2) and (3) to display the header information position information and the landmark image position information of each of the plurality of image data on the display screen of the display unit 9. Are converted into display position information reflecting the relative positional relationship with the position information of other images.

  Subsequently, based on the display position information converted by the display position conversion unit 127, the display control unit 130 arranges a plurality of images and landmarks on the display screen of the display unit 9 and causes the display unit 9 to display them (Step). S207). Specifically, as illustrated in FIG. 16, the display control unit 130 causes the display unit 9 to display the images side by side on the display screen of the display unit 9 by reflecting the mutual positional relationship between the plurality of images and the landmark images. Thereby, the user can grasp | ascertain quickly and intuitively with what positional relationship the image corresponding to the image data which has positional information with respect to the landmark was image | photographed on the map.

  Thereafter, the control unit 12 determines whether or not the auxiliary operation switch 74 has been operated (step S208). When the auxiliary operation switch 74 is operated (step S208: Yes), the imaging apparatus 1 proceeds to step S209 described later. On the other hand, when the auxiliary operation switch 74 is not operated (step S208: No), the imaging apparatus 1 returns to the main routine shown in FIG.

  In step S209, the imaging apparatus 1 executes an orientation determination process for determining an orientation relationship between a plurality of images and landmarks. FIG. 17 is a flowchart illustrating an outline of the orientation determination process.

  As shown in FIG. 17, the orientation determination unit 128 calculates the angle from the landmark to the shooting position where the image was shot based on the position information of the selected image and the landmark information of the landmark image ( Step S301).

FIG. 18 is a diagram for explaining the outline of the direction determination method by the direction determination unit 128. In FIG. 18, consider a coordinate system in which the longitude and latitude of a landmark image are the origin P _LM (K _LM , I _LM ), the horizontal direction is the x axis, and the vertical direction is the y axis. Further, in FIG. 18, the positive direction of the x-axis is considered as east, and the positive direction of the y-axis is considered as north.

As shown in FIG. 18, when the longitude of the image P ₃₁ is K ₃₁ and the latitude is I ₃₁ , the azimuth determination unit 128 uses the following formula to calculate the angle (from the landmark to the shooting position of the image) θ) is calculated.
θ = arctan (I ₃₁ / K ₃₁ ) × 180 / π (degrees) (4)
It becomes. In the equation (4), π is a circumference ratio.

  Subsequently, when the latitude (y) and longitude (x) of the image are positive (step S302: Yes, step S303: Yes), the azimuth determination unit 128 calculates 0 that is 0 ° ≦ θ <22.5. When the angle is ° (step S304: Yes), it is determined that the azimuth of the photographing position with reference to the landmark is east (step S305), and the process returns to the position classification display process of FIG.

  In step S304, the azimuth determination unit 128 determines that the calculated θ is not 0 ° ≦ θ <22.5 ° (No in step S304) and 22.5 ° ≦ θ <67.5 ° (step S306: Yes), it is determined that the orientation of the photographing position when the landmark is the reference is northeast (step S307), and the process returns to the position classification display process of FIG.

  In step S306, if the calculated θ is not 22.5 ° ≦ θ <67.5 ° (step S306: No), the orientation determination unit 128 determines that the orientation of the shooting position with reference to the landmark is north. Then (step S308), the process returns to the position classification display process of FIG.

  In step S303, when the longitude (x) of the image is not positive (step S303: No) and the calculated θ is 90 ° ≦ θ <112.5 ° in step S303 (step S309: Yes). Then, it is determined that the orientation of the shooting position when the landmark is used as a reference is north (step S310), and the process returns to the position classification display process of FIG.

  In step S309, the orientation determination unit 128 does not calculate 90 ° ≦ θ <112.5 ° (step S309: No) but 112.5 ° ≦ θ <157.5 ° (step S311: Yes), it is determined that the orientation of the photographing position when the landmark is the reference is northwest (step S312), and the process returns to the position classification display process of FIG.

  In step S311, if the calculated θ is not 112.5 ° ≦ θ <157.5 ° (step S311: No), the orientation determination unit 128 determines that the orientation of the shooting position with respect to the landmark is west. Then (step S313), the process returns to the position classification display process of FIG.

  In step S302, the orientation determination unit 128 calculates the calculated θ when the latitude (y) of the image is not positive (step S302: No) and the longitude (x) of the image is positive (step S314: Yes). When 270 ° ≦ θ <292.5 ° (step S315: Yes), it is determined that the direction of the photographing position when the landmark is the reference is south (step S316), and the process returns to the position classification display process of FIG. .

  In step S315, the direction determining unit 128 does not calculate 270 ° ≦ θ <292.5 ° (step S315: No) but 292.5 ° ≦ θ <337.5 ° (step S317: Yes), it is determined that the orientation of the photographing position when the landmark is the reference is southeast (step S318), and the process returns to the position classification display process of FIG.

  In step S317, if the calculated θ is not 292.5 ° ≦ θ <337.5 ° (step S317: No), the azimuth determining unit 128 determines that the azimuth of the shooting position with respect to the landmark is east. Then (step S319), the process returns to the position classification display process of FIG.

  In step S314, when the longitude (x) of the image is not positive (step S314: No) and the calculated θ is 180 ° ≦ θ <202.5 ° in step S314 (step S320: Yes). Then, it is determined that the azimuth of the photographing position with reference to the landmark is west (step S321), and the process returns to the position classification display process of FIG.

  In step S320, the azimuth determining unit 128 does not calculate 180 ° ≦ θ <202.5 ° (step S320: No) but 202.5 ° ≦ θ <247.5 ° (step S322: Yes), the azimuth of the photographing position when the landmark is used as a reference is determined to be southwest (step S323), and the process returns to the position classification display process of FIG.

  In step S322, if the calculated θ is not 202.5 ° ≦ θ <247.5 ° (step S322: No), the azimuth determining unit 128 determines that the azimuth of the shooting position with respect to the landmark is south. Then (step S324), the process returns to the position classification display process of FIG.

  Returning to FIG. 7, the processing after step S210 will be described. In step S210, the distance calculation unit 129 calculates the distance between the shooting position where the image was shot and the landmark that appears in the landmark image (step S210).

  FIG. 19 is a diagram for explaining the outline of the distance calculation method by the distance calculation unit 129. In FIG. 19, when the diameter of the reference circle is about 13000 km, the distance per degree of longitude or latitude is assumed to be about 110 km (2 × π × 6500/360).

As shown in FIG. 19, the distance calculation unit 129 is based on the position information of each image and the landmark information of the landmark image, and the distance from the shooting position where each image was shot to the landmark reflected in the landmark image. Is calculated. Specifically, the distance calculation unit 129 assumes that the longitude and latitude of the landmark image are (K _LM , I _LM ), and the longitude and latitude of the image are (K ₄₁ , I ₄₁ ), and the distance is calculated by the following formula. d (km) is calculated.
d = {(K ₄₁ −K _LM ) ² + (I ₄₁ −I _LM ) ² } ^1/2 × 110 (km) (5)
It becomes. In this way, the distance calculation unit 129 calculates the distance from the shooting position where each image was shot to the landmark where the landmark image appears, using Expression (5).

  Subsequently, the display control unit 130 causes the display unit 9 to display information regarding the determination result determined by the orientation determination unit 128 and the calculation result calculated by the distance calculation unit 129 as auxiliary information (step S211). Specifically, as shown in FIG. 20, the display control unit 130 causes the display unit 9 to display information corresponding to the orientation of the shooting position of the image viewed from the landmark as the icon A11, and the distance calculation unit 129 Information corresponding to the calculated distance between the landmark and the image is displayed on the display unit 9 as an icon A12. Further, the display control unit 130 causes the display unit 9 to display an icon A13 corresponding to the name of the landmark. Thereby, the user can grasp | ascertain more intuitively the azimuth | direction and distance to the imaging position of the image seen from the landmark. Thereafter, the imaging apparatus 1 returns to the main routine shown in FIG.

  According to the first embodiment of the present invention described above, the display control unit 130 determines the mutual relationship between a plurality of images and landmark images based on the position information associated with each image and the landmark information of the landmark image. Are reflected on the display screen of the display unit 9 and displayed on the display unit 9. Thereby, the user can grasp | ascertain intuitively the imaging position of the image image | photographed until now from the positional information linked | related with image data with respect to the landmark.

  Moreover, according to Embodiment 1 of this invention, the display control part 130 arrange | positions each of the several image on the display image of the display part 9 according to the azimuth | direction information of the landmark information of a landmark image. As a result, the positional relationship between the landmark image and the plurality of images can be prevented from being displayed in an unnatural state, and the positional relationship suitable for the direction in which the landmark appearing in the landmark image is visible. Each of a plurality of captured images can be displayed.

  Furthermore, according to Embodiment 1 of the present invention, it is not necessary to record dedicated map information, and it is not necessary to search and read dedicated map information, and to adjust the scale, and it is possible to shoot quickly and easily. It is possible to intuitively display the mutual positional relationship between the selected images.

  Furthermore, according to the first embodiment of the present invention, since the positional relationship can be simply displayed, it is not necessary to calculate the scale or record complicated map information, so that the apparatus can be simplified. Costs and space required for the configuration of the apparatus can be reduced.

  Further, according to the first embodiment of the present invention, the display control unit 130 causes the display unit 9 to display the landmark image smaller than the display screen of the display unit 9. Thereby, a sufficient display space for displaying other images on the display screen of the display unit 9 can be secured, and a plurality of images can be displayed on the display unit 9.

  Further, according to the first embodiment of the present invention, the display control unit 130 reduces the landmark image and displays it on the display screen of the display unit 9. For this reason, since the entire display screen of the display unit 9 is not used, it is possible to handle arrangement display and enlargement / reduction similar to a photograph taken by the user. Thereby, the display control unit 130 can omit complicated calculations such as scale switching and distance conversion like a map image, and can speed up the response.

  In the first embodiment of the present invention described above, landmark image data corresponding to a landmark may be stored in the landmark image storage unit 113 as a thumbnail image (an image having a small capacity). In this case, the landmark image recording unit 113 can store the landmark image data of many points in the world because the capacity of each landmark image data becomes small.

  In the first embodiment of the present invention described above, the display control unit 130 imitates the landmark image default image, for example, a mountain in Mt. Fuji so that the user can see where the landmark image is at a glance. The displayed icon may be displayed on the display unit 9. Further, the display control unit 130 may display characters on the display unit 9 by adding or superimposing characters on the image obtained by deforming the landmark image.

  Further, in the first embodiment of the present invention described above, the display control unit 130 may simplify the color usage so that the landmark image is conspicuous so that the user can see where the landmark image is at a glance. Good.

  Further, in the first embodiment of the present invention described above, the image selected by the user has been described as an example. However, for example, when taking a picture while traveling around Tokyo, position classification display indicating whether it is a mountain hand or a downtown area. Is possible. As a result, the user can immediately confirm where the image was captured based on the landmark image, and still captures the image while viewing the position classification of the image displayed on the display unit 9 even during the image capturing. It is possible to check areas that are not present.

  In the first embodiment of the present invention described above, the display control unit 130 displays the calculation result of the distance calculation unit 129 on the display unit 9. When the distance to the photographed position is short, for example, 10 km, the calculation result of the distance calculation unit 129 may not be displayed on the display unit 9.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. Note that the imaging apparatus according to the second embodiment of the present invention has a different configuration of the storage unit, and other configurations have the same configuration as the imaging apparatus according to the first embodiment described above. Furthermore, the operation performed by the imaging apparatus according to the second embodiment of the present invention is different only in the position classification display process, and the other operations are the same as those of the imaging apparatus according to the first embodiment described above. For this reason, in the following, after explaining the configuration different from the above-described first embodiment, the operation position classification display processing by the imaging device according to the second embodiment of the present invention will be described.

  FIG. 21 is a block diagram illustrating a configuration of the imaging apparatus 200 according to the second embodiment of the present invention. As illustrated in FIG. 21, the imaging device 200 includes a storage unit 210.

  The storage unit 210 includes an image data storage unit 111, a program storage unit 112, and a landmark image storage unit 211.

  The landmark image storage unit 211 stores a plurality of landmark image data associated with landmark information including landmark position information and azimuth information. The landmark image storage unit 211 stores a plurality of landmark image data obtained by photographing each landmark from a plurality of directions. This azimuth information is the azimuth of the landmark with reference to the photographing position of the landmark. Landmarks include Japan's 100 famous mountains, such as Mt. Fuji, Kendake and Yatsugatake.

  Next, position classification display processing performed by the imaging apparatus according to the second embodiment will be described. FIG. 22 is a flowchart showing an overview of the position classification display process (step S112) shown in FIG.

  As shown in FIG. 22, the control unit 12 determines whether or not an image for position classification display has been selected in the series of reduced images displayed by the display unit 9 (step S401). When an image for position classification display is selected from the list of reduced images displayed on the display unit 9 (step S401: Yes), the imaging apparatus 200 proceeds to step S402 described later. On the other hand, when an image for position classification display is not selected within a predetermined time (for example, within 5 seconds) (step S401: No), the imaging apparatus 200 returns to the main routine shown in FIG.

  In step S402, the control unit 12 determines whether or not the display screen of the display unit 9 is in a horizontal state. Specifically, the control unit 12 determines whether the display screen of the display unit 9 is in a horizontal state according to the detection result of the posture detection unit 4. When the display screen of the display unit 9 is in a horizontal state (step S402: Yes), the imaging device 200 proceeds to step S403 described later. On the other hand, when the display screen of the display unit 9 is not in the horizontal state (step S402: No), the imaging apparatus 200 proceeds to step S412 described later.

  In step S <b> 403, the landmark search unit 124 searches the landmark image storage unit 211 for a landmark image in which a hundred mountains that are closest to the header information appear based on the header information of the selected plurality of image data. Note that the landmark search unit 124 may acquire a landmark image from the landmark image storage unit 211 in accordance with an instruction signal input from the operation input unit 7 or the touch panel 10.

  Subsequently, the azimuth detection unit 6 detects the azimuth in the upward direction from the center of the display unit 9 by detecting the vertical and horizontal components of the geomagnetism when the display unit 9 is in the horizontal state ( Step S404). Specifically, as illustrated in FIG. 23, the orientation detection unit 6 detects the orientation in the upward direction from the center in the display area of the display unit 9 when the user places the imaging apparatus 200 in a horizontal state. In the case illustrated in FIG. 23, the direction detection unit 6 detects the direction in the upward direction from the center in the display area of the display unit 9 as north (N).

  Thereafter, the landmark search unit 124 acquires a landmark image corresponding to the direction detected by the direction detection unit 6 from the landmark image storage unit 211 (step S405). For example, when the azimuth detected by the azimuth detection unit 6 is north, the landmark search unit 124 acquires a landmark image obtained by photographing the landmark from the south from the landmark image storage unit 211.

  Subsequently, the orientation determination unit 128 determines the positional relationship between the plurality of images and the landmark image based on the position information of each of the plurality of image data and the landmark information of the landmark image (step S406). Specifically, the azimuth determining unit 128 determines the azimuth of each image with reference to a landmark that appears in the landmark image.

  Subsequently, the display control unit 130 arranges each image in the display area of the display unit 9 based on the determination result of the azimuth determination unit 128 (step S407).

FIG. 24 is a diagram for explaining an overview of a display method by the display control unit 130. In FIG. 24, in order to simplify the description, a plurality of images are grouped into an image group, and an average value of position information of each of the plurality of images is taken for explanation. In FIG. 24, the position information of the photographing position where the image group W10 is photographed is (K ₄₁ , I ₄₁ ), and the landmark information indicating the position of the landmark is (K ₄₂ , I ₄₂ ). Moreover, the relationship between the longitude and latitude described above satisfies K ₄₁ <K ₄₂ and I ₄₂ <I ₄₁ , respectively. Further, the display control unit 130 sets the radius r ₁ so that the longitude difference (K ₄₂ −K ₄₁ ) between the image group W 10 and the landmark image W 3 becomes ¼ of the vertical width in the display area of the display unit 9. To do. Also, let φ be the direction that goes counterclockwise from the positive x-axis direction.

As shown in FIG. 24, the display control unit 130 arranges the image group W10 and the landmark image W3 so as to satisfy the following expression.
φ = arctan ((I ₄₁ −I ₄₂ ) / (K ₄₁ −K ₄₂ )) (6)
Therefore, when the display position of the image group W10 is P ₄₁ and the display position P _{42 of the} landmark image,
P ₄₁ = (r ₁ cos (φ−π), r ₁ sin (φ−π)) (7)
become. Similarly, P ₄₂ = (r ₁ cos φ, r ₁ sin φ) (8)
become.

In this way, the display control unit 130 uses the equations (6) to (8) to form a circle having a radius r ₁ with the image group W10 and the landmark image W3 as the center O ₁ of the display area of the display unit 9. placed on the circumference of the C _1.

Subsequently, the orientation detection unit 6 detects an orientation directed upward from the center O ₁ in the display area of the display unit 9 when the imaging apparatus 200 is set in a horizontal state (step S408). For example, in the case shown in FIG. 25, the orientation detection unit 6 detects the orientation in the direction upward from the center O ₁ in the display area of the display unit 9 as east (E).

  Thereafter, the landmark search unit 124 acquires a landmark image corresponding to the direction detected by the direction detection unit 6 from the landmark image storage unit 211 (step S409). For example, in the situation shown in FIG. 25, when the azimuth detection unit 6 detects the azimuth in the upward direction from the center in the display area of the display unit 9 as the east (E), the landmark search unit 124 captures the landmark from the west. The landmark image obtained is acquired from the landmark image storage unit 211.

  Thereafter, the display control unit 130 rotates the display position of each image according to the direction detected by the direction detection unit 6 (step S410). For example, as shown in FIG. 26, the display control unit 130 displays the image group W10 on the lower left in the display area of the display unit 9 and displays the landmark image W12 on the upper right in the display area of the display unit 9. Accordingly, even if the image capturing apparatus 200 is moved while moving, the display positions of the plurality of images and landmark images displayed on the display unit 9 change, so that the user can change the relative position between the landmark and each image. The relationship can be grasped easily and intuitively.

  Subsequently, the control unit 12 determines whether or not an end operation for ending the position classification display has been performed (step S411). Specifically, it is determined whether or not an end operation for ending the position classification display has been performed in response to an instruction signal input from the shooting mode changeover switch 73 or the menu switch 75. When the end operation for ending the position classification display is performed (step S411: Yes), the imaging apparatus 200 returns to the main routine illustrated in FIG. On the other hand, when the end operation for ending the position classification display is not performed (step S411: No), the imaging apparatus 200 returns to step S408.

  In step S402, the control unit 12 will describe a case where the display screen of the display unit is not horizontal (step S402: No). In this case, the display control unit 130 displays a warning on the display unit 9 (step S412). For example, the display control unit 130 causes the display unit 9 to display information instructing the display screen of the display unit 9 to be in a horizontal state. Thereafter, the imaging apparatus 200 returns to the main routine shown in FIG.

  According to the second embodiment of the present invention described above, the positional relationship between the plurality of images and the landmark image in the display area of the display unit 9 according to the direction detected by the direction detection unit 6 by the display control unit 130. Is displayed on the display unit 9 on the display screen of the display unit 9. Thus, when displaying an image on the display unit 9, the user can intuitively grasp the positional relationship between the images according to the direction in which the imaging device 200 is facing, and the above-described first embodiment. The same effect is produced.

  Further, according to the second embodiment of the present invention, as in the first embodiment described above, information on the relative positional relationship between each image and the landmark image, for example, information on the azimuth and distance is displayed on the display unit 9. It may be displayed.

  In the second embodiment of the present invention, the display control unit 130 has described a plurality of images as an image group. However, the display unit 9 reflects the positional relationship between the plurality of images and the landmark image. May be displayed.

  In the second embodiment of the present invention, the display control unit 130 displays the arrangement positions of the plurality of images and landmark images while rotating them according to the detection result of the azimuth detection unit 6. May be displayed while rotating the arrangement positions of the plurality of images and the landmark image based on an instruction signal output from the touch panel 10 in accordance with a trajectory of touching the touch panel 10.

(Other embodiments)
In the embodiment described above, the display control unit displays each selected image in a reduced size based on the display position information converted by the display position conversion unit. May be displayed. Thereby, the display area of the image currently displayed on the display unit can be expanded and displayed. Further, the display control unit may display the display unit with characters, symbols, colors, or the like instead of the selected images.

  In the above-described embodiment, the landmark search unit searches and acquires the landmark image from the landmark image storage unit. For example, the landmark search unit is a server by a communication unit that performs bidirectional communication via the Internet. Alternatively, the landmark image may be retrieved and acquired from an external processing device or the like.

  In the above-described embodiment, the landmark retrieval unit retrieves and acquires only one landmark image from the landmark image storage unit. However, according to the number of images for which position classification display is performed and position information. A plurality of landmark images may be retrieved and acquired.

  In the above-described embodiment, the landmark image storage unit stores the landmark image in advance. For example, the landmark image is updated by a communication unit that performs bidirectional communication via the Internet. Also good. Further, the landmark image storage unit may store an image obtained by photographing the landmark as a landmark image.

  In the above-described embodiment, the display control unit reduces each selected image to be displayed on the display unit. For example, the display control unit displays the date or time on the display position information converted by the display position conversion unit. A range of position information may be provided, and only images that fall within this range may be reduced and displayed on the display unit.

  In the above-described embodiments, the imaging device is described as a digital camera as a display device. For example, a display function such as a digital single-lens reflex camera, a digital video camera, a mobile phone or a tablet-type mobile device, and an electronic photo frame It can be applied to various electronic devices provided with

DESCRIPTION OF SYMBOLS 1,200 Imaging device 2 Imaging part 3 Light emission part 4 Attitude | position detection part 5 Timer 6 Direction detection part 7 Operation input part 8 Position acquisition part 9 Display part 10 Touch panel 11,210 Storage part 21 Lens part 22 Lens drive part 23 Diaphragm 24 Diaphragm Drive unit 25 Shutter 26 Shutter drive unit 27 Imaging element 28 Imaging drive unit 29 Signal processing unit 71 Power switch 72 Release switch 73 Shooting mode switch 74 Auxiliary operation switch 75 Menu switch 76 Zoom switch 111 Image data storage unit 112 Program storage unit 113 , 211 Landmark image storage unit 121 Image processing unit 122 Header information generation unit 123 Shooting control unit 124 Landmark search unit 125 Coordinate setting unit 126 Boundary image setting unit 127 Display position conversion unit 128 Orientation determination unit 129 Distance Calculator 130 display control unit

Claims (13)

A landmark image storage unit that stores landmark image data, each of which is generated corresponding to a plurality of landmarks, and that includes landmark information including landmark position information and azimuth information associated with the landmark image;
A plurality of images respectively corresponding to a plurality of image data associated with different position information and a display unit capable of displaying a landmark image corresponding to the landmark image data;
A display control unit configured to reflect the mutual positional relationship between the plurality of images and the landmark image based on the position information and the landmark information associated with each image;
A display device comprising: The landmark image storage unit stores landmark image data obtained by photographing each landmark from a predetermined photographing position;
The display device according to claim 1, wherein the azimuth information includes a azimuth in which a landmark is photographed when the predetermined photographing position is used as a reference. The landmark image storage unit stores a plurality of landmark image data obtained by photographing each landmark from a plurality of directions,
The display device according to claim 1, wherein the azimuth information includes a azimuth of the landmark when a landmark photographing position is used as a reference. A landmark retrieval unit that retrieves the landmark image storage unit based on the position information associated with each of the plurality of images and acquires the landmark image to be displayed on the display unit;
The display device according to claim 1, wherein the display control unit causes the display unit to display the landmark image acquired by the landmark search unit. Based on the position information associated with each image and the landmark information, further comprising an azimuth determination unit that determines the azimuth of the shooting position of each image with reference to the landmarks that appear in the landmark image,
The display device according to claim 1, wherein the display control unit causes the display unit to display information related to the determination result determined by the orientation determination unit. A distance calculation unit that calculates a distance from a landmark that appears in the landmark image to a shooting position of each image based on the position information and the landmark information associated with each image;
The display device according to claim 1, wherein the display control unit causes the display unit to display information related to the distance calculated by the distance calculation unit. The position information includes information represented using longitude and latitude,
A coordinate setting unit that sets a coordinate system in which the horizontal direction of the display unit corresponds to one of longitude or latitude, and the vertical direction of the display unit corresponds to the other of longitude or latitude;
A boundary image that sets, as a boundary image, the position information associated with each of the plurality of images displayed by the display unit and an image located at the boundary of an area including all the landmark information associated with the landmark image A setting section;
Further comprising
The display control unit reflects the relative positional relationship with an image other than the boundary image in the coordinate system on the basis of the position information associated with the boundary image, and the plurality of images and the land. The display device according to claim 1, wherein a mark image is displayed on the display unit. The position information associated with each image and the landmark information associated with the landmark image are converted into display position information reflecting a relative positional relationship with the position information of another image in the coordinate system. A display position conversion unit;
The display according to claim 7, wherein the display control unit causes the display unit to display the plurality of images and the landmark image by further using the display position information converted by the display position conversion unit. apparatus. In the case where the display screen of the display unit is horizontal, further comprising an azimuth detecting unit that detects the azimuth of the display device when the direction from the center of the display screen toward the upper part of the screen is set as a reference azimuth
The display device according to claim 4, wherein the landmark search unit acquires the landmark image corresponding to the direction detected by the direction detection unit from the landmark image storage unit.   The display device according to claim 9, wherein the display control unit causes the display unit to display the plurality of images and the landmark image according to the direction detected by the direction detection unit. An imaging unit for imaging a predetermined visual field and generating image data;
A position acquisition unit for acquiring device position information of the display device;
An image data storage unit that stores the apparatus position information acquired by the position acquisition unit in association with the image data as the position information when the imaging unit generates image data;
The display device according to claim 1, further comprising: A landmark image storage unit that stores landmark image data, each of which is generated corresponding to a plurality of landmarks, and that includes landmark information including landmark position information and azimuth information associated with the landmark image; A display device comprising: a plurality of images each corresponding to a plurality of image data associated with different position information; and a display unit capable of displaying a landmark image corresponding to the landmark image data.
Based on the position information and the landmark information associated with each image, a display control step of causing the display unit to display a mutual positional relationship between the plurality of images and the landmark image;
A display program characterized in that the program is executed. A display method to be executed by a display device including a display unit for displaying an image,
Along with a landmark image having landmark information including position information and azimuth information, an image corresponding to image data having position information based on the landmark information is arranged on the display screen of the display unit and displayed on the display unit Display process
A display method comprising:

Images