JP5620895B2 - Display control apparatus, method and program - Google Patents

Description

  The present invention relates to a technique for performing predetermined processing on a display image.

  As an operation technique for enlarging / reducing an image displayed on the display device, a technique for enlarging / reducing the image by operating a slider, or when a point on the display image is designated, the image is enlarged to a predetermined magnification and the designated point is displayed on the screen. There is a technology to display so that

  Since the technique using the slider enlarges / reduces the image around a fixed point, if the image is made larger than the screen, a desired portion may protrude from the screen and may not be displayed. In addition, the technique for designating one point of an image does not cause the part to come out of the screen if a desired part is designated. In some cases, a plurality of designation operations are required, which may be burdensome for the user.

  On the other hand, in a device provided with a touch screen, there is a technique for enlarging a display image according to a pinch-out gesture. This pinch-out gesture technique enlarges / reduces an image in accordance with a change in the distance between multi-touch contact points, thereby enabling image processing by an intuitive operation.

  Further, in Patent Document 1, in an apparatus that displays thumbnails of three or more selection target items, when a region touching the touch panel has a circular locus, the item is displayed at a position facing a circular inner region. It is disclosed that an item to be selected is enlarged and displayed.

JP 2011-60111 A

  However, the technique described in Patent Document 1 is a technique for enlarging leaving only an image selected from three or more thumbnail images displayed on the screen, and is a single image such as a map or a document. Could not be adopted as a technology to expand In addition, with the operation technique using a slider or a pinch-out gesture, there are cases where operations in multiple steps are required until the desired portion of the image is enlarged to a desired size and displayed on the screen. There is a problem that it is necessary to reduce this operational burden.

  In view of the above problems, an object of the present invention is to provide a technique capable of quickly specifying a desired region in a display image with a simple operation.

  The display control device according to the present invention is a display control device for displaying an image on a screen, and detects the position of the indicator on the screen and detects the locus of the indicator moving on the screen. An operation detection unit, and a specified region extraction unit that extracts a region having a position and size based on the detected trajectory and having the same aspect ratio as that of the screen as the specified region. Features.

  The method of the present invention is a method for displaying an image on a screen of a display device, and detects the position of the indicator on the screen and detects the locus of movement of the indicator on the screen. The display control device executes a detection step and a designated region extracting step that extracts a region having a position and size based on the detected locus and having the same aspect ratio as that of the screen as the designated region. Method.

  A program according to the present invention is a program for causing a computer to display an image on a screen of a display device, and detects a position of an indicator on the screen and detects a trajectory of the indicator moving on the screen. An instruction operation detecting step for detecting, and a designated area extracting step for extracting a rectangular area having the same aspect ratio as that of the screen as a designated area, the area having a position and size based on the detected locus. A program that causes a computer to execute.

  In the category of the method or program, the apparatus or computer that executes each step may be a single unit, or may be different for each step or for each timing.

  According to the present invention, since it is possible to quickly extract a region to be specified in a display image by an intuitive operation, it is possible to reduce a user's operation burden and improve convenience.

The functional block diagram which shows a structure about embodiment of this invention. The image figure explaining the outline | summary about embodiment of this invention. The flowchart which shows the process sequence in embodiment of this invention. The image figure explaining the outline | summary about embodiment of this invention. The image figure explaining the outline | summary about embodiment of this invention. The image figure explaining the outline | summary about embodiment of this invention. The image figure explaining the outline | summary about embodiment of this invention.

  An embodiment for carrying out the present invention will be described with reference to the drawings. In addition, the assumptions common to the contents already described in the background art and problems are omitted as appropriate.

[1. Constitution〕
As shown in FIG. 1, the display control apparatus 1 (hereinafter referred to as the present apparatus 1) according to the present embodiment generates image data in accordance with an input signal from the input apparatus 2, outputs it to the display apparatus 3, and displays an image. It is a device that displays. Here, the input device 2 is a device for inputting a signal indicating the position of the indicator operated by the user on the screen. For example, the pointer displayed on the screen is “indicator” and the button is pressed. Such as a mouse that inputs the position of the pointer on the screen at the time of the touch, or a touch panel that inputs the position of the pointer directly touching the screen using the user's finger or dedicated pen as the `` indicator '' Any pointing device may be used. The display device 3 has a screen and displays an image on the screen based on the image data output from the device 1.

  The device 1 is a device for displaying an image on the screen of the display device 3, and detects the position of the indicator on the screen based on a signal input from the input device 2, and the indicator is displayed on the screen. An instruction operation detection unit 11 that detects a trajectory that has moved up and an image processing unit 13 that generates image data according to the detected position or trajectory and outputs the image data to the display device 3 are provided. The image processing unit 13 receives predetermined data from the server S or the data storage unit 14 via the communication device 4 in accordance with the position or locus of the indicator on the screen detected by the instruction operation detection unit 11. It has a function of acquiring, generating image data based on the data, and outputting the image data to the display device 3.

  The apparatus 1 further includes a designated area extracting unit 12 that extracts a region having a position and size based on the locus detected by the instruction operation detecting unit 11 and having the same aspect ratio as the screen as the designated region. The image processing means 13 has a function of processing a predetermined content on the display image in the extracted designated area.

  FIG. 2 is an image diagram showing an example of extraction of the designated area by the designated area extracting means 12. FIG. 2 is a diagram exemplifying a case where the input device 2 is a touch panel. The designated area extracting unit 12 of the present embodiment has a trajectory 101 slid on the screen 100 of the user's finger A by the instruction operation detecting unit 11. When detected, a rectangular area having the same aspect ratio as the screen 100 at the position and size based on the trajectory 101 is extracted as the designated area 102. The image processing means 13 has a function of performing processing of a predetermined content such as enlargement, cropping or clipping on the extracted display image in the designated area.

  According to the apparatus 1 having such a configuration, an image region having a desired position and size can be extracted by an intuitive operation.

[2. Operation and action)
Next, the operation of the apparatus 1 configured as described above will be described based on the flowchart of FIG.

[2-1. basic action〕
In the device 1, first, the instruction operation detection unit 11 detects the position of the indicator on the screen based on a signal from the input device 2 in a state where a predetermined image is displayed on the screen of the display device 3. In the case (“YES” in step S10 in FIG. 3), it is determined whether or not the indicator has moved on the screen (step S20), and when it moves, the movement locus is detected (“YES” in step S20). ). Then, the designated area extracting unit 12 extracts an area based on the detected trajectory and having the same aspect ratio as the screen at the position and size based on the trajectory as the designated area (step S30). . Subsequently, the image processing means 13 performs processing of predetermined contents on the display image in the designated area (step S40).

  According to the apparatus 1 having such a configuration, the user can specify the position and size of the image processing target area simply by performing an intuitive operation on the screen with the indicator. The operational burden on the user can be reduced and operability and convenience can be improved.

[2-2. (Indication trajectory detection)
The instruction operation detection means 11 detects the position coordinates of the indicator on the screen based on the signal from the input device 2 and determines the movement locus of the indicator on the screen based on the change in the position coordinates of the indicator. To detect. For example, when the input device 2 has a touch panel, the coordinates of the position touched by the indicator on the screen are detected, and the locus of the slide until the indicator slides away from the screen while touching the screen is detected. To do. When the input device 2 has a mouse, the movement locus of the mouse pointer on the screen until the mouse is slid with the button pressed and the button is released is detected.

  In addition, when the locus of the indicator on the screen is interrupted, it is possible to assist the user's operation and improve operability by complementing the locus of the broken portion and detecting it as a single locus. Can do. In this case, specifically, when the trajectory of the indicator on the screen is interrupted in the middle, the instruction operation detection unit 11 is within a minute value set in advance when the time or distance between the interruptions is within the preset value. The trajectory between them is complemented and detected as one trajectory. In this way, even if the moving locus of the indicator is interrupted due to the user operating the indicator quickly or the like, if the interruption is within a minute time, it is corrected to one locus and detected. The occurrence of an operation error can be suppressed, the number of re-executions can be reduced, and the user's satisfaction can be increased.

[2-3. (Specified area extraction)
The designated area extracting means 12 detects an area having the same aspect ratio as that of a predetermined display screen shape and having a position and size based on the locus detected by the instruction operation detecting means 11 as the designated area. To do. If the designated area to be extracted is a rectangular shape having the same aspect ratio as the screen, for example, the locus detected by the pointing operation detection unit 11 is included inside, and one of the two opposite sides touches the locus, and the other It suffices if the distances from the opposing sides to the locus are the same.

  An example of a technique for extracting such a designated area is shown in FIG. First, when the trajectory 105 shown in FIG. 4A is detected, the designated area extracting unit 12 measures the vertical width a and the horizontal width b of the trajectory 105 as shown in FIG. Based on the aspect ratio, a width to be adopted as the vertical dimension or horizontal dimension of the rectangular area including the locus 105 is selected from the vertical width a and the horizontal width b, and the dimension of the rectangular area is determined based on the selected width. Determine the size of the rectangular area.

  FIG. 4 shows a case where the vertical width a of the trajectory 105 is the vertical dimension of the designated area 106. Then, as shown in FIG. 4C, the position of the rectangular area is adjusted so that the distances d1 and d2 from each side not contacting the locus 105 of the rectangular area to the locus 105 are the same. To confirm.

  By setting such an area as a designated area, an area including the locus in the center with a size that matches the movement locus of the indicator on the screen can be extracted, so an image with a position and size that matches the intention of the user The processing area can be extracted with a simple operation.

  Further, the designated area may be a minimum rectangular area that is centered on the center of gravity of the detected trajectory and includes the trajectory inside. An example of such a method for extracting a designated area is shown in FIG.

  When the trajectory 105 shown in FIG. 5A is detected, the designated area extracting unit 12 calculates the center of gravity G of the trajectory 105 as shown in FIG. Then, as shown in FIG. 5C, the minimum area that is a rectangular area having the same aspect ratio as that of the screen centered on the center of gravity G and that includes the locus 105 inside is determined as the designated area 107.

  In this way, by matching the center of gravity of the detected locus with the center or center of gravity of the designated area, it is possible to extract an area that matches the user's intention with less information processing, and the designated area extraction. The load related to the means 12 can be suppressed.

  The designated area extracted by the designated area extraction unit 12 is an area based on the detected locus, and is not limited to the above-exemplified areas, as long as the area has a position and size based on the locus. May be a region that is included on the inside but not in contact with the locus, or a region where the locus protrudes outward. The designated area is not limited to a rectangular shape but may be an elliptical shape as long as it is a similar area with the same aspect ratio as the screen. In addition, as long as the designated region has a shape determined based on the detected locus, the designated region may not have a shape that is completely similar to the screen shape, and may have a shape that is substantially similar to the screen.

[2-4. Image processing〕
Examples of the process executed by the image processing unit 13 on the display image in the designated area include, for example, a process in which the display image in the designated area is enlarged to the screen size and displayed in the screen, or a display in the designated area. For example, a process of cutting out and displaying only an image.

  Here, the process of enlarging the display image in the designated area to the screen size will be described with a specific example. As shown in FIG. 6, when the mesh image is displayed on the screen 110, when the instruction operation detection unit 11 detects the trajectory 111, the designated region extraction unit 12 extracts the designated region 112. When the designated area 112 is extracted, the image processing means 13 enlarges and enlarges the mesh image so that the image in the designated area 112 fills the screen as shown in FIG. Further, the image processing means 13 has a normal image processing function, such as a function of scrolling the display image according to the movement of the indicator on the screen, a function of reducing the image in accordance with the pinch gesture of the indicator, and the like. The image processing function may be switched between a mode for operating the image processing function and a mode for operating the image enlargement function described above.

  In this way, if the designated area is extracted based on the trajectory of the indicator on the screen and the image in the designated area is enlarged to the screen size, the part of the screen to be enlarged and viewed can be intuitively viewed. The user can enlarge the desired portion at the desired magnification simply by performing the designation operation.

As described above, in the present embodiment, when the movement locus of the indicator on the screen is detected, a rectangular region having a position and a size based on the locus is extracted as a designated region, and the display image in the designated region is extracted. Thus, the user can designate a region having a desired position and size as an image processing target region by simply tracing the desired position on the screen.
Therefore, according to the display control apparatus and its operation method of the present embodiment, it is possible to quickly extract an area to be specified in a display image by an intuitive operation, which reduces the operation burden on the user and improves convenience. Can be improved.

  In addition, about the function of each means 11, 12, 13, 14 of this apparatus 1, or said each step, predetermined | prescribed memorize | stored (installed) in memory beforehand with respect to the computer provided with central processing units, such as CPU, and memory. The central processing unit may be configured to execute information processing according to the program.

  The data storage unit 14 stores data in an arbitrary format such as a file, but may be remote storage by network computing (cloud). The data storage means 14 may be configured to include not only a data storage area but also functions such as data input / output and management. Further, the unit of the data storage means 14 shown in the present embodiment is for convenience of explanation, and the configuration can be divided or integrated as appropriate.

  Also, the arrows in FIG. 1 supplementarily indicate the main direction of the flow of data, control, etc., and do not deny other flows or imply direction limitations. For example, when data is acquired in a certain direction, a prior data request and a subsequent acknowledge (ACK) are transmitted in the reverse direction. In addition, each means other than the storage means is a processing means for realizing and executing the functions and operations of information processing as described below, but these are functional units arranged for explanation, and actual hardware It doesn't matter if it matches elements or software modules.

[3. Other embodiments]
The above embodiment is merely an example, and includes the embodiments exemplified below and other embodiments. For example, the configuration diagrams, data diagrams, flowcharts, and the like in the present application are merely examples, and the presence / absence of each element, the order of the arrangement and processing execution, and the specific contents can be changed as appropriate.

  Moreover, the structure which implement | achieves each means 11, 12, 13, 14 which comprises the display control apparatus 1 of the said embodiment further by an independent apparatus may be sufficient. Further, each means 11, 12, 13, 14 in the display control apparatus 1 of the above embodiment is realized by calling an external platform or the like with an API (application program interface) or network computing (so-called cloud). It may be a configuration. Furthermore, each means 11, 12, 13, and 14 in the said embodiment may be implement | achieved by other information processing mechanisms, such as not only a computer but a physical electronic circuit.

DESCRIPTION OF SYMBOLS 1 Display control apparatus 2 Input apparatus 3 Display apparatus 4 Communication apparatus 11 Instruction operation detection means 12 Designated area extraction means 13 Image processing means 14 Data storage means N Communication network S Server

Claims (6)

A display control device for displaying an image on a screen,
The position of the indicator on the screen is detected, and the locus of movement of the indicator on the screen is detected. If the locus is interrupted, the interruption is determined based on the time between the interruptions. Instruction operation detecting means for complementing the locus of the detected part and detecting it as one locus,
Wherein the shape of the screen and the same aspect ratio, and a region surrounded by the trajectory a rectangle shape including the inside, one of the two opposing sides in contact with the region surrounded by the trajectory, Designated area extracting means for extracting, as the designated area , an area having the same distance from each of the other opposing sides to the locus ;
A display control device.   The display control apparatus according to claim 1, further comprising an image processing unit that enlarges a display image in the designated area to a size of the screen and displays the image in the screen. A method for displaying an image on a screen of a display device,
The position of the indicator on the screen is detected, and the locus of movement of the indicator on the screen is detected. If the locus is interrupted, the interruption is determined based on the time between the interruptions. An instruction operation detection step of detecting a single locus by complementing the locus of the selected portion;
Wherein the shape of the screen and the same aspect ratio, and a region surrounded by the trajectory a rectangle shape including the inside, one of the two opposing sides in contact with the region surrounded by the trajectory, A designated region extraction step for extracting a region having the same distance from each of the other opposing sides to the locus as a designated region;
Is executed by the display control device. The method according to claim 3 , wherein the display control device executes the step of enlarging the display image in the designated area to the size of the screen and displaying it in the screen. A program for causing a computer to display an image on a screen of a display device,
The position of the indicator on the screen is detected, and the locus of movement of the indicator on the screen is detected. If the locus is interrupted, the interruption is determined based on the time between the interruptions. An instruction operation detection step of detecting a single locus by complementing the locus of the selected portion;
Wherein the shape of the screen and the same aspect ratio, and a region surrounded by the trajectory a rectangle shape including the inside, one of the two opposing sides in contact with the region surrounded by the trajectory, A designated region extraction step for extracting a region having the same distance from each of the other opposing sides to the locus as a designated region;
For causing the computer to execute. The program according to claim 5 , causing the computer to execute an image processing step of enlarging a display image in the designated area to a size of the screen and displaying the enlarged image in the screen.

Images