JP2011221821A - Information processing system, operation input device, information processor, information processing method, program and information storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing system capable of widening the variations of processing executed on the basis of a touch operation.SOLUTION: The information processing system such as a portable game machine 1 includes: a display 12a; a touch sensor 12b that is provided with a detection surface in an area including an inner side area 14 occupying at least a part of a display surface of the display 12a and an outer side area 16 which is an area outside the display surface adjacent to the inner side area 14, and detects the position of an object on the detection surface; and a processing execution part which executes the processing based on the position detected by the touch sensor 12b corresponding to the position inside the inner side area 14 and the position detected by the touch sensor 12b corresponding to the position inside the outer side area 16.

Description

  The present invention relates to an information processing system, an operation input device, an information processing device, an information processing method, a program, and an information storage medium.

  There is an information processing system such as a portable game device in which a user can enjoy a game by operating a touch panel (touch screen) configured to include a display unit and a touch sensor.

  In such an information processing system, for example, when a user traces a touch panel using a finger or a stylus, a line is displayed along the traced trace.

  Further, in such an information processing system, for example, when a plurality of images (for example, images showing icons and buttons) are displayed on the touch panel, the user touches one of the images using a finger or a stylus. Then, there are some that execute processing according to the touched image. Patent Document 1 describes a technique in which a display and a touch display different from the display are juxtaposed, and a menu displayed on the touch display is touched to switch display contents on the display.

JP 2003-87673 A

  In the conventional information processing system, the display surface of the display unit included in the touch panel matches the detection surface of the touch sensor included in the touch panel. Therefore, even if the user performs a tracing operation from the outside to the inside of the touch panel (or from the inside to the outside) with a finger or stylus, it is detected separately from the tracing operation from the edge of the touch panel to the inside (or from the inside to the edge). I couldn't. Thus, in the conventional information processing system, there is a limit to the range of operation variations that can be detected on the touch panel, and thus there is a limit to the range of executable process variations.

  The present invention has been made in view of the above problems, and is an information processing system, an operation input device, an information processing device, an information processing method, and a program capable of widening the range of variations of processing executed based on a touch operation. And an information storage medium.

  In order to solve the above-described problem, an information processing system according to the present invention includes a display unit, an inner region that occupies at least a part of a display surface of the display unit, and a region outside the display surface adjacent to the inner region. A touch sensor for detecting a position of an object on the detection surface, and a position detected by the touch sensor corresponding to a position in the inner region, wherein a detection surface is provided in a region including an outer region. And a process execution means for executing a process based on the position detected by the touch sensor corresponding to the position in the outer region.

  The operation input device according to the present invention includes a display unit, an inner region that occupies at least a part of the display surface of the display unit, and an outer region that is an area outside the display surface adjacent to the inner region. A touch sensor for detecting a position of an object on the detection surface, wherein the touch sensor is detected by the touch sensor corresponding to a position in the inner region. Data corresponding to a detection result by the touch sensor is output to a processing execution unit that executes processing based on the position and the position detected by the touch sensor corresponding to the position in the outer region. To do.

  Further, the information processing apparatus according to the present invention has a detection surface in a region including an inner region that occupies at least a part of the display surface of the display unit and an outer region that is an area outside the display surface adjacent to the inner region. Based on a position corresponding to a position in the inner area and a position corresponding to a position in the outer area detected by a touch sensor that detects the position of the object on the detection surface. And a process execution means for executing the process.

  Further, the information processing method according to the present invention provides a detection surface in a region including an inner region that occupies at least a part of the display surface of the display unit, and an outer region that is an area outside the display surface adjacent to the inner region. Based on a position corresponding to a position in the inner area and a position corresponding to a position in the outer area detected by a touch sensor that detects the position of the object on the detection surface. A process execution step for executing the process.

  In the program according to the present invention, the detection surface is provided in a region including an inner region that occupies at least a part of the display surface of the display unit and an outer region that is an area outside the display surface adjacent to the inner region. A process based on a position corresponding to a position in the inner area and a position corresponding to a position in the outer area, which is detected by a touch sensor that detects the position of the object on the detection surface. The computer is caused to function as processing execution means to be executed.

  The above program can also be stored in a computer-readable information storage medium.

  According to the present invention, it is possible to execute processing based on the position corresponding to the position in the display surface and the position corresponding to the position in the outer region outside the display surface. The range of processing variations to be executed can be expanded.

  In one aspect of the present invention, the touch sensor sequentially detects the position of the object, and the processing execution unit executes a process based on a history of positions detected by the touch sensor. By doing so, it is possible to perform processing according to the object movement operation from the inner region to the outer region and the object movement operation from the outer region to the inner region.

  In this aspect, the processing execution means includes a case where the position history detected by the touch sensor includes both a position corresponding to a position in the inner area and a position corresponding to a position in the outer area. Different processing may be executed when the position history detected by the touch sensor includes only the position corresponding to the position in the inner region. In this way, the range of processing variations to be executed can be further expanded.

  Further, in this aspect, the processing execution unit detects a position corresponding to one of the position in the inner region or the position in the outer region after the touch sensor detects the position corresponding to the other. In this case, a predetermined process may be executed. By doing so, it is possible to execute processing according to the movement of the object across the boundary between the inner region and the outer region.

  In one aspect of the present invention, the process execution unit executes a process of displaying information at a position in the display unit specified based on a position detected by the touch sensor. By doing this, it is possible to display information based on the detection position corresponding to the position in the display surface and the detection position corresponding to the position in the outer region outside the display surface.

It is a perspective view which shows an example of the external appearance of the portable game machine which concerns on this embodiment. It is a block diagram which shows an example of an internal structure of the portable game machine shown in FIG. It is a functional block diagram which shows an example of the function implement | achieved with the portable game machine which concerns on this embodiment. It is a figure which shows the 1st usage example of the portable game machine which concerns on this embodiment. It is a figure which shows the 1st usage example of the portable game machine which concerns on this embodiment. It is a figure which shows the 2nd usage example of the portable game machine which concerns on this embodiment. It is a figure which shows the 2nd usage example of the portable game machine which concerns on this embodiment. It is a figure which shows the 2nd usage example of the portable game machine which concerns on this embodiment. It is a figure which shows the 3rd usage example of the portable game machine which concerns on this embodiment. It is a figure which shows the 4th usage example of the portable game machine which concerns on this embodiment. It is a figure which shows the application example which applied the portable game machine which concerns on this embodiment to the portable information terminal. It is a figure which shows the 5th usage example of the portable game machine which concerns on this embodiment. It is a figure which shows the 5th usage example of the portable game machine which concerns on this embodiment. It is a figure which shows the 5th usage example of the portable game machine which concerns on this embodiment.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a perspective view showing an example of the appearance of an information processing system according to an embodiment of the present invention (in this embodiment, for example, a portable game machine 1). As shown in FIG. 1, the casing 10 of the portable game machine 1 has a substantially rectangular flat plate shape as a whole, and a touch panel 12 is provided on the surface thereof. The touch panel 12 has a substantially rectangular shape, and includes a display unit (display 12a) and a touch sensor 12b. The display 12a may be various image display devices such as a liquid crystal display panel and an organic EL display panel.

  The touch sensor 12b is disposed so as to overlap the display 12a, and is provided with a substantially rectangular detection surface having a shape corresponding to the display surface of the display 12a. In the present embodiment, the touch sensor 12b sequentially detects contact of an object such as a user's finger or stylus on the detection surface at a predetermined time interval. When the touch sensor 12b detects the contact of an object, the touch sensor 12b detects the contact position of the object. The touch sensor 12b may be of any type as long as it is a device that can detect the position of an object on the detection surface, such as a capacitance type, a pressure sensitive type, or an optical type.

  As shown in FIG. 1, in this embodiment, the sizes of the display 12a and the touch sensor 12b are different, and the touch sensor 12b is slightly larger than the display 12a. The display 12a and the touch sensor 12b are arranged in the housing 10 so that the center position of the display 12a is slightly lower right than the center position of the touch sensor 12b. Note that the touch sensor 12b and the display 12a may be arranged in the housing 10 so that the positions of the centers overlap. Hereinafter, the touch sensor area where the display 12a and the touch sensor 12b overlap (area that occupies the display surface of the display 12a) will be referred to as the inner area 14, and the touch sensor area outside the display surface of the display 12a that is adjacent to the inner area 14 will be described. Will be referred to as the outer region 16.

  Although not shown in FIG. 1, in addition to the touch panel 12, the portable game machine 1 includes various operation members for receiving user operation inputs such as buttons and switches, and an imaging unit such as a digital camera. May be disposed on the front surface, back surface, side surface, or the like of the housing 10.

  FIG. 2 is a block diagram showing an example of the internal configuration of the portable game machine 1 shown in FIG. As shown in FIG. 2, the portable game machine 1 includes a control unit 20, a storage unit 22, and an image processing unit 24. The control unit 20 is a CPU, for example, and executes various types of information processing according to programs stored in the storage unit 22. The storage unit 22 is, for example, a memory element such as a RAM or a ROM, a disk device, and the like, and stores a program executed by the control unit 20 and various data. The storage unit 22 also functions as a work memory for the control unit 20.

  The image processing unit 24 includes, for example, a GPU and a frame buffer memory, and draws an image to be displayed on the display 12a in accordance with an instruction output from the control unit 20. As a specific example, the image processing unit 24 includes a frame buffer memory corresponding to the display area of the display 12a, and the GPU writes an image to the frame buffer memory every predetermined time in accordance with an instruction from the control unit 20. The image written in the frame buffer memory is converted into a video signal at a predetermined timing and displayed on the display 12a.

  FIG. 3 is a functional block diagram illustrating an example of functions realized by the portable game machine 1 according to the present embodiment. As shown in FIG. 3, the portable game machine 1 according to the present embodiment functions as including a detection result receiving unit 26 and a process execution unit 28. The detection result receiving unit 26 is realized mainly by the touch sensor 12b and the control unit 20. The process execution unit 28 is realized mainly by the control unit 20 and the image processing unit 24. These elements are realized by executing a program installed in the portable game machine 1 that is a computer by the control unit 20 of the portable game machine 1. This program is supplied to the portable game machine 1 via a computer-readable information transmission medium such as a CD-ROM or DVD-ROM, or via a communication network such as the Internet.

  The detection result receiving unit 26 receives a detection result by the touch sensor 12b. In the present embodiment, the touch sensor 12b outputs a detection result corresponding to the contact position of the object to the detection result receiving unit 26 at predetermined time intervals. And the detection result reception part 26 receives sequentially the contact position data corresponding to the contact position of the object detected by the touch sensor 12b for every predetermined time.

  The process execution unit 28 executes various processes using the detection results received by the detection result reception unit 26. Specifically, the process execution unit 28 determines the content of the user's operation input using, for example, the detection result (for example, contact position data) of the position of an object such as the user's finger or stylus by the touch sensor 12b. . And the process according to the content of the determined operation input is performed, and a process result is displayed on the display 12a, and is shown to a user.

  In this embodiment, the detection surface of the touch sensor 12b is provided in the outer region 16 adjacent to the inner region 14 corresponding to the display 12a, so that the display 12a can be moved from the outer side of the display 12a to the inner side of the display 12a. It is possible to detect that an operation of tracing the detection surface of the touch sensor 12b with an object such as a user's finger or stylus (hereinafter referred to as a slide operation) is performed from the inside to the outside of the display 12a. In this way, according to the present embodiment, the range of touch operation variations that can be detected becomes wider than when the display surface of the display 12a and the detection surface of the touch sensor 12b match. In addition, the portable game machine 1 according to the present embodiment can more easily operate the edge of the touch sensor 12b than the portable game machine 1 in which a frame member is provided outside the touch sensor 12b. .

[First use example]
Hereinafter, a usage example of the portable game machine 1 according to the present embodiment will be described.

  4A and 4B are diagrams illustrating a first usage example of the portable game machine 1. In the portable game machine 1 shown in FIG. 4A, a game screen 30 is displayed on the display 12a. When the user touches the game screen 30 with the finger 32 or the like, the detection result receiving unit 26 receives contact position data corresponding to the contact position of the finger 32. And the process execution part 28 performs the process according to the contact position data.

  And the strip | belt-shaped indicator image 34 extended | stretched to the horizontal direction along the edge of the display 12a is arrange | positioned at the upper side of the game screen 30 shown to FIG. 4A. Here, when the user touches the finger 32 on the outer region 16 of the touch sensor 12b and performs a slide operation of the finger 32 toward the inner region 14, the touch sensor 12b touches the finger at that timing every predetermined time. The position where 32 touches the detection surface is sequentially detected. And the detection result reception part 26 receives sequentially a series of contact position data corresponding to the detected contact position. Then, the process execution unit 28 determines that the slide operation of the finger 32 across the indicator image 34 from the outer region 16 to the inner region 14 has been performed based on the received series of contact position data. In response to this determination, the process execution unit 28 displays an operation panel image 36 corresponding to the indicator image 34 on the upper portion of the display 12a as shown in FIG. 4B. The operation panel image 36 includes a button 38 corresponding to a predetermined process. When the user touches any button 38 with the finger 32 or the like, the process execution unit 28 corresponds to the touched button 38. Execute the process. Thus, in the first usage example, the process execution unit 28 executes a process based on the position in the inner region 14 and the position in the outer region 16. Moreover, the process execution part 28 performs the process based on the log | history of the contact position detected by the touch sensor 12b.

  In the first usage example, the user touches the detection surface of the touch sensor 12b with the finger 32 and slides the finger 32 across the indicator image 34 displayed on the edge of the display 12a, whereby the indicator image is displayed. An operation for displaying the operation panel image 36 in the vicinity of the position where 34 is displayed can be performed. In this way, according to the first usage example, the operation to be performed when the operation panel image 36 is displayed can be presented to the user in an easy-to-understand manner using the indicator image 34. In addition, the user can perform display control of the game screen 30 by an intuitively easy-to-understand operation of sliding the finger 32 across the edge of the display 12a. In addition, according to the first usage example, as the width of the indicator image 34 is reduced, an area in the display 12a that can be used as the game screen 30 is increased. Therefore, the display surface of the display 12a can be effectively used. Can do.

  In the first usage example, when the user slides the finger 32 from the outer area 16 at the screen edge where the indicator image 34 is displayed toward the inner area 14, the process execution unit 28 moves the finger 32. The operation panel image 36 may be displayed on the display 12a at the same speed as the sliding speed. In this way, since the slide operation and the state in which the operation panel image 36 is displayed are linked, it is possible to give the user an intuitive operation feeling as if the operation panel image 36 is drawn from the screen end of the display 12a. it can. Further, in the first usage example, the process execution unit 28 may display the operation panel image 36 on the display 12 a in accordance with the slide operation of the finger 32 from the inner region 14 to the outer region 16. In the first usage example, the indicator image 34 may be arranged on the left side, the right side, or the lower side of the display 12a. Then, the operation panel image 36 may be displayed at a position corresponding to the display position of the indicator image 34.

[Second use example]
5A, 5B, and 5C are diagrams illustrating a second usage example of the portable game machine 1. In the portable game machine 1 shown in FIG. 5A, the game screen 30 is displayed on the display 12a. When the user touches the game screen 30 with the finger 32 or the like, the process execution unit 28 executes a process according to the touched position. In FIGS. 5A, 5B and 5C, the rightward direction in the horizontal direction is the X-axis direction and the downward direction in the vertical direction is the Y-axis direction.

  And the strip | belt-shaped indicator image 34 extended | stretched to the vertical direction along the edge of the display 12a is arrange | positioned at the right side of the game screen 30 shown to FIG. 5A. Here, when the user touches a position where the distance from the indicator image 34 is within a predetermined range with the finger 32, and the detection result reception unit 26 receives contact position data corresponding to the position (for example, When the X coordinate of the indicator image 34 and the X coordinate of the contact position of the finger 32 are equal to or less than a predetermined value), the processing execution unit 28 displays a menu image 40 corresponding to the indicator image 34 as shown in FIG. 5B. Displayed on the right side of the game screen 30. In the second usage example, the menu image 40 includes a plurality of options 42 (for example, character strings indicating processing contents) to be selected by the user. The options 42 are displayed side by side along the edge of the display surface of the display 12a. Thus, in the second usage example, the process execution unit 28 displays the options 42 side by side along the edge of the display surface of the display 12a. In the second usage example, the touch position of the finger 32 corresponding to the display operation of the menu image 40 may be a position in the inner area 14 or a position in the outer area 16.

  Then, the process executing unit 28 displays (highlights) the option 42 having the shortest distance from the position corresponding to the contact position data received by the detection result receiving unit 26 in a manner different from the other options 42. In the example of FIG. 5B, a frame is displayed around the option 42 to be highlighted (in the example of FIG. 5B, the character string “browser”), and the option 42 to the right of the option 42 to be highlighted. A selection icon 44 indicating that is selected is displayed. Note that the color of the option 42 to be highlighted may be changed.

  In the second usage example, the touch sensor 12b detects the contact position of the finger 32 every predetermined time, and the detection result receiving unit 26 sequentially receives the contact position data corresponding to the contact position of the finger 32. Then, each time the detection result receiving unit 26 receives the contact position data, the process execution unit 28 compares the contact position data with the contact position data received immediately before to specify the moving direction of the finger 32. When it is determined that the moving direction of the finger 32 is the vertical direction (Y-axis direction), the process execution unit 28 specifies the option 42 to be highlighted based on the received contact position data. . Then, the process execution unit 28 updates the menu image 40 so that the option 42 is highlighted. In the example of FIG. 5C, the option 42 corresponding to the character string “interrupt” is highlighted. In this way, when the user performs a slide operation of the finger 32 along the right edge of the display 12a (for example, a slide operation of the finger 32 along the Y-axis direction), the option 42 to be highlighted is displayed. Will change. In this way, when the detection result corresponding to the movement of the object in the direction along the edge of the display surface of the display 12a is detected by the touch sensor 12b, the processing execution unit 28 is highlighted according to the detection result. The option 42 may be changed.

  Then, the user performs a sliding operation of the finger 32 from the right edge of the display 12a toward the center (for example, a sliding operation of the left finger 32 along the X-axis direction), and the detection result receiving unit 26 However, when receiving a series of contact position data corresponding to this operation, the process execution unit 28 specifies that the movement direction of the finger 32 is the left-right direction (X-axis direction). In this case, the process execution unit 28 executes a process according to the highlighted option 42. In the example of FIG. 5C, the process execution unit 28 executes an interruption process.

  In the second usage example, when the user performs the slide operation of the finger 32 along the edge of the display 12a, for example, the option 42 is displayed to the edge of the display 12a. Even in the situation where 42 is hidden, even if the finger 32 protrudes outside the display 12a, the position of the finger 32 can be detected because the touch sensor 12b is also provided in the outer region 16. Become. Thus, in the second usage example, it is possible to effectively utilize the display surface of the display 12a while maintaining the operability of the touch operation by the user.

  In the second usage example, the process execution unit 28 selects the option 42 (for example, the detection result reception unit 26 receives) specified based on the distance from the position corresponding to the contact position data received by the detection result reception unit 26. The option 42) whose distance from the position corresponding to the contact position data is within a predetermined range may be highlighted. Further, when the user performs a sliding operation of the finger 32 in a direction away from the center from the right edge of the display 12a, the processing execution unit 28 performs processing corresponding to the option 42 highlighted at this timing. May be executed. In the second usage example, when the user touches the close icon 46 included in the menu image 40 with the finger 32, the processing execution unit 28 updates the display content of the display 12a so as to erase the menu image 40. You may do it. Further, the arrangement, shape, and the like of the options 42 in the menu image 40 in the second embodiment are not limited to the above example. For example, the option 42 may be an image such as an icon. Further, the second usage example may be applied to an operation panel in, for example, a music player or a photo viewer. In this case, each option 42 is, for example, a character string or icon corresponding to an operation in a music player, a photo viewer, or the like. The second usage example may be applied to, for example, a control panel for performing various settings. In this case, each option 42 is, for example, a character string or icon corresponding to the setting item. In the second usage example, the process execution unit 28 may display and output menu items that are frequently used by the user as options 42 in the menu image 40.

[Third use example]
FIG. 6 is a diagram illustrating a third usage example of the portable game machine 1. In the third usage example, in the initial state, for example, a game screen 30 similar to that shown in FIG. 5A is displayed on the display 12a. When the user touches the game screen 30 with the finger 32 or the like, the process execution unit 28 executes a process related to the game according to the touched position.

  When the user touches the right outer region 16 with the finger 32 on the display 12a and slides the finger 32 to the left until reaching the inner region 14, the detection result receiving unit 26 performs this operation. A series of corresponding contact position data is received. Then, based on the contact position data, the process execution unit 28 moves the game screen 30 to the left as shown in FIG. 6, and displays the system setting screen 48 of the portable game machine 1 in the right area of the display 12a. indicate. When the user touches the system setting screen 48 with the finger 32 or the like, the process execution unit 28 executes a process related to the system setting of the portable game machine 1 in accordance with the touched position.

  In this way, according to the third usage example, the screen of a program such as an application program currently being executed is dismissed and the screen of another program (for example, an operation system program) is displayed. A production effect can be realized.

[Fourth use example]
FIG. 7 is a diagram illustrating a fourth usage example of the portable game machine 1. In the portable game machine 1 shown in FIG. 7, an icon display screen 52 including a plurality of icons 50 is displayed on the display 12a.

  When the user touches any one of the icons 50 with the finger 32 and moves the finger 32 into the inner region 14, the process execution unit 28 moves the touched icon 50 to the position to which the finger 32 is moved. (Drag and drop).

  When the user touches any icon 50 with the finger 32 and moves the finger 32 to the outer region 16 on the right side of the display 12a, the process execution unit 28 scrolls the icon display screen 52 itself to the left. . Here, when the user moves the finger 32 to the inner region 14, the process execution unit 28 stops scrolling the icon display screen 52.

  Thus, in the fourth usage example, the process execution unit 28 includes a position corresponding to a position in the inner area 14 and a position corresponding to a position in the outer area 16 in the position history detected by the touch sensor 12b. Different processing is executed when both are included, and when only the position corresponding to the position in the inner region 14 is included in the history of positions detected by the touch sensor 12b.

  According to the fourth usage example, the touch sensor 12 b is provided in the outer region 16, so that the touch sensor 12 b moves when the finger 32 is moved in the inner region 14 and from the inner region 14 to the outer region 16. Different detection results are output when the finger 32 is moved. Therefore, the process execution unit 28 can execute different processes depending on whether the finger 32 is moved within the inner region 14 or when the finger 32 is moved from the inner region 14 to the outer region 16. .

  In the above-described example, when the user wants to perform a scroll operation on the icon display screen 52, it is not necessary to provide a position in the display 12a where the user should touch the finger 32. It can be used effectively.

  In the fourth usage example, when the user touches any one of the icons 50 with the finger 32 and moves the finger 32 to the outer region 16 on the right side of the display 12a, the process execution unit 28 causes the display 12a to The icon display screen 52 itself may be scrolled to the left in units of pages corresponding to the size.

[First application example]
Here, an application example in which the present embodiment is applied to a portable information terminal 54 such as a mobile phone will be described. FIG. 8 is a diagram illustrating an application example of this embodiment. In the portable information terminal 54 shown in FIG. 8, the index information 56 is arranged in a line in the vertical direction on the right side of the display 12a. The marks 58 are arranged in a line in the vertical direction in the outer region 16 on the right side of the display 12a. In this application example, the index information 56 (for example, characters) and the mark 58 are in one-to-one correspondence, and the corresponding index information 56 and the mark 58 are arranged side by side. In the storage unit of the portable information terminal 54 shown in FIG. 8, a plurality of pieces of personal information including a person's name and telephone number are registered in advance.

  When the user touches the position in the outer region 16 on the right side of the display 12a with the finger 32, the process execution unit 28 highlights the index information 56 closest to the position, and displays the highlighted index information 56 on the highlighted index information 56. Corresponding information (for example, a list of personal information registered in the portable information terminal 54 in which the highlighted alphabet corresponds to the first letter of the last name) is displayed on the display 12a.

  When the user performs an operation of sliding the finger 32 along the direction in which the marks 58 are arranged, the process execution unit 28 highlights the index information 56 closest to the position of the finger 32 according to the operation. The content displayed on the display 12a is changed.

  According to this application example, the user can perform the selection operation of the index information 56 outside the screen of the display 12a. Therefore, the user can use the index information 56 to display the area near the edge of the display 12a.

  In this application example, after the user touches the position in the outer region 16 with the finger 32, the finger 32 is moved away from the touch sensor 12b, and the user touches the finger 32 with the touch sensor 12b again. The process execution unit 28 highlights the index information 56 closest to the touched position, and updates the display content of the display 12a so that the information corresponding to the highlighted index information 56 is displayed on the display 12a. It may be. In this application example, the mark 58 may not be disposed in the outer region 16 on the right side of the display 12a.

[Second application example]
Here, an application example in which the present embodiment is applied to a portable information terminal 54 with a moving image reproduction function will be described.

  9A, 9B, and 9C are diagrams illustrating a fifth usage example of the portable information terminal 54. FIG. In the portable information terminal 54 shown in FIG. 9A, a strip-shaped indicator image 34 extending in the horizontal direction along the edge of the display 12a is arranged on the lower side of the screen shown in FIG. 9A. Then, when the user touches the indicator image 34 with the finger 32 and performs a slide operation of the finger 32 from the lower edge of the display 12a toward the center, the process execution unit 28, as shown in FIG. 9B, The operation panel image 36 of the first stage portion is displayed and output on the display 12a. In this application example, the process execution unit 28 changes the display content of the display 12a so that the indicator image 34 extends in the vertical direction to become the operation panel image 36, for example. When the user further slides the finger 32 to the center without releasing the display 12a, an operation panel image 36 in which the second stage portion is arranged below the first stage portion is displayed as shown in FIG. 9C. Display output to 12a. When the user releases the finger 32 from the display 12a, the process execution unit 28 controls the display 12a so that the operation panel image 36 disappears from the display 12a.

  In this application example, when the detection result receiving unit 26 receives that the indicator image 34 has been touched, the processing execution unit 28 starts the operation panel image 36 from one end of the display 12a on which the indicator image 34 is arranged. Transition may be displayed so that appears. In this application example, for example, when the process execution unit 28 outputs the operation panel image 36 of the first stage portion on the display 12a in response to one slide operation and receives the same slide operation again. In addition, the operation panel image 36 of the first stage portion may be displayed and output on the display 12a. In addition, the processing execution unit 28 outputs the operation panel image 36 of the first stage portion on the display 12a or outputs the operation of the second stage portion according to the moving amount (or moving speed) of the finger 32 in the slide operation. It may be controlled whether to display up to the panel image 36 on the display 12a.

  The contents displayed as the operation panel image 36 of the first stage part and the contents displayed as the operation panel image 36 of the second stage part may be divided based on a predetermined priority order. Good. 9A, 9B, and 9C show an example of an operation during playback of moving image content. The content displayed as the operation panel image 36 in the first stage portion is also the operation panel image 36 in the second stage portion. The displayed content is also related to the video playback. In this application example, information representing the current moving image playback status such as the current chapter, elapsed time, and timeline appears in the first stage portion, and pause, playback, and stop are displayed in the second stage portion. Function buttons such as fast forward, fast reverse, repeat, and help appear. Note that the portable information terminal 54 of this application example may change the contents displayed in the first stage part and the second stage part and the setting of the function buttons according to the setting operation received from the user.

  In addition, when the user touches the crossed button displayed and output on the upper right of the operation panel image 36, the process execution unit 28 controls the display 12a so that the operation panel image 36 disappears from the display 12a. Also good. Further, when the user touches an area outside the operation panel image 36, the process execution unit 28 may control the display 12a so that the operation panel image 36 disappears from the display 12a. Further, when the user performs a sliding operation of the finger 32 in the direction opposite to the direction in which the operation panel image 36 is displayed and output, the processing execution unit 28 displays the operation panel image 36 so that the operation panel image 36 disappears from the display 12a. You may make it display-control 12a. Here, the process execution unit 28 displays the operation panel image 36 from the display 12a step by step in the order of the second step portion and the first step portion according to the moving amount (or moving speed) of the finger 32 in the slide operation. You may make it display-control the display 12a so that it may disappear.

  The user's slide operation when the operation panel image 36 is displayed on the display 12a is not limited to the above-described operation. For example, the processing execution unit 28 operates a button provided outside the display 12a, a slide operation of the finger 32 from the lower edge of the display 12a toward the center outside the indicator image 34, a display The operation panel image 36 may be displayed and output on the display 12a in accordance with a slide operation into the display 12 from a touch sensor area outside the display 12.

  Note that the present invention is not limited to the above-described embodiments, usage examples, and application examples. Of course, in the information processing system, some of the functions described in the above embodiments, usage examples, and application examples may be combined. For example, the following operations are possible by combining the first usage example and the second usage example. First, in response to the user sliding the finger 32 from the outer region 16 on the right side of the display 12a to the inner region 14 toward the left, the process execution unit 28 displays the menu screen 40 illustrated in FIG. You may make it display within. Then, when the user moves the finger 32 up and down without releasing the finger 32 as it is, the processing execution unit 28 has the shortest distance from the position corresponding to the contact position data received by the detection result receiving unit 26 42 may be highlighted. Then, the user may slide the finger 32 further to the left without releasing the finger 32 as it is, and the process execution unit 28 may execute the process according to the highlighted option 42. In this way, the user can display the menu screen 40 and select the option 42 as a series of operations without releasing the finger 32 from the display 12a.

  For example, a straight line or a curve specified by the process execution unit 28 interpolating the positions indicated by the contact position data sequentially received by the detection result receiving unit 26 in accordance with the user's slide operation on the detection surface of the touch sensor 12b. May be executed on the display surface of the display 12a. Here, the process execution unit 28 may display a line specified by complementing the position indicated by the contact position data corresponding to the position in the outer region 16 on the display surface of the display 12a.

  The touch sensor 12b may detect the contact position of the object and the strength of pressing. In addition, the touch sensor 12b does not necessarily detect the position of the object only when the object touches the detection surface, but the position of the object with respect to the detection surface when the object approaches within the detectable range on the detection surface. May be detected. Further, the width of the touch sensor 12b protruding from the display 12a may be different for each side of the display 12a. In addition, the touch sensor 12b may not protrude from the display 12a for all sides of the display 12a. Further, the touch sensor 12b may not cover the entire area of the display surface in the display 12a. In addition, the display 12a may be disposed closer to the housing 10 than the touch sensor 12b, or the touch sensor 12b may be disposed closer to the housing 10 than the display 12a.

  Further, the present embodiment may be applied to an information processing system other than the portable game machine 1. Specifically, for example, the operation input device configured to include the touch panel 12 and the information processing device functioning as the detection result reception unit 26 and the process execution unit 28 are separate cases, and the operation input device and the information The present embodiment may be applied to an information processing system in which a processing device is connected by a cable or the like.

  DESCRIPTION OF SYMBOLS 1 Portable game machine, 10 housing | casing, 12 touchscreen, 12a display, 12b touch sensor, 14 inner area | region, 16 outer area | region, 20 control part, 22 memory | storage part, 24 image processing part, 26 detection result reception part, 28 process execution Part, 30 game screen, 32 finger, 34 indicator image, 36 operation panel image, 38 button, 40 menu image, 42 options, 44 selection icon, 46 close icon, 48 system setting screen, 50 icon, 52 icon display screen, 54 Mobile information terminal, 56 index information, 58 mark.

Claims (10)

A display unit;
On the detection surface, a detection surface is provided in a region including an inner region that occupies at least a part of the display surface of the display unit and an outer region that is an area outside the display surface adjacent to the inner region. A touch sensor for detecting the position of the object in
Processing execution means for executing processing based on a position detected by the touch sensor corresponding to a position in the inner region and a position detected by the touch sensor corresponding to a position in the outer region;
An information processing system comprising: The touch sensor sequentially detects the position of the object,
The process execution means executes a process based on a history of positions detected by the touch sensor;
The information processing system according to claim 1. A case where the processing execution means includes both a position corresponding to a position in the inner area and a position corresponding to a position in the outer area in the position history detected by the touch sensor; When the position history detected by includes only the position corresponding to the position in the inner region, a different process is executed.
The information processing system according to claim 2. When the position corresponding to one of the position in the inner region or the position in the outer region is detected by the touch sensor and the position corresponding to the other is detected by the touch sensor, Execute the process,
The information processing system according to claim 2 or 3, The process execution means executes a process of displaying information at a position in the display unit specified based on a position detected by the touch sensor;
The information processing system according to claim 1, wherein the information processing system is an information processing system. A display unit;
On the detection surface, a detection surface is provided in a region including an inner region that occupies at least a part of the display surface of the display unit and an outer region that is an area outside the display surface adjacent to the inner region. A touch sensor for detecting the position of the object in
Processing for executing processing based on a position detected by the touch sensor corresponding to a position in the inner region and a position detected by the touch sensor corresponding to a position in the outer region. Outputting data corresponding to the detection result of the touch sensor to the execution means;
An operation input device characterized by that. On the detection surface, a detection surface is provided in a region including an inner region that occupies at least a part of the display surface of the display unit and an outer region that is an area outside the display surface adjacent to the inner region. A process execution means for executing a process based on a position corresponding to a position in the inner area and a position corresponding to a position in the outer area detected by a touch sensor that detects the position of the object;
An information processing apparatus comprising: On the detection surface, a detection surface is provided in a region including an inner region that occupies at least a part of the display surface of the display unit and an outer region that is an area outside the display surface adjacent to the inner region. A process execution step of executing a process based on a position corresponding to a position in the inner area and a position corresponding to a position in the outer area detected by a touch sensor that detects the position of the object;
An information processing method comprising: On the detection surface, a detection surface is provided in a region including an inner region that occupies at least a part of the display surface of the display unit and an outer region that is an area outside the display surface adjacent to the inner region. A process execution means for executing a process based on a position corresponding to a position in the inner area and a position corresponding to a position in the outer area detected by a touch sensor that detects the position of the object;
A program characterized by causing a computer to function.   A computer-readable information storage medium storing the program according to claim 9.

Images