JP2005218757A - Virtual reality tennis game system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily and inexpensively provide the configuration of a VR tennis game system. <P>SOLUTION: A tennis game image including a ball graphic is displayed on a screen 12. A player 16 swings a racket 18 in front of the screen. The racket includes an optical marker which is photographed by cameras 22L, 22R. A computer 42 calculates the mobile amount of the optical marker by processing camera signals and determines that the player swings the racket when the mobile amount is not less than a prescribed value. It is determined whether a forehand swing or a backhand swing is made based on the direction in which the optical marker is moved. Color markers 26R, 26L are attached to the right and left ankles of the player and photographed by another camera 24. Then the position of a foot to be anterior in swinging is detected as "right", "center" or "left", so as to return the ball graphic in the direction corresponding to the detected anterior foot position. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a virtual reality tennis game system, and in particular, a virtual reality (virtual reality, hereinafter referred to as “VR”) in which a player advances an electronic game such as a video game by actually swinging a racket in real space. It relates to a tennis game system.

  For example, Patent Literature 1 discloses a virtual tennis device in which two players hit a virtual ball by shaking a device body simulating a tennis racket in real space. The prior art of Patent Document 1 is to advance a tennis game between two devices by radio and sound. However, since this conventional technique is not a video game using video, it can be enjoyed easily but lacks reality.

  Apart from this, the present inventors have proposed a VR video tennis game system for rehabilitation in Patent Document 2. The conventional technique proposed in Patent Document 2 is a VR tennis game system in which a trainee becomes a real player and hits a ball with a virtual player in a video screen.

In the prior art of Patent Document 2, a real player, that is, a trainee, actually swings a racket in real space, detects the movement and posture of the racket with a three-axis acceleration sensor and a three-axis angular velocity sensor, and the computer detects the racket trajectory. calculate. By determining the relative position between the racket trajectory and the virtual ball trajectory in the game screen, the computer calculates the hit and direction of the racket ball and causes the virtual ball to fly in the game screen.
JP 2000-197773 A [A63F 13/00] JP2003-180896A [A63B 69/00 504 69/38 A63F 13/00]

  In the prior art of Patent Document 2, since an image is used in a VR tennis game that actually uses a racket, the reality is increased as compared with the prior art of Patent Document 1, and the rehabilitation effect is caused by the player moving his body (waving his arm). Can be expected.

  On the other hand, in this prior art, a triaxial acceleration sensor, a triaxial angular velocity sensor, etc. must be used to detect the position and orientation of the racket, which not only complicates the structure of the racket itself but is also expensive as a whole system. This has hindered the spread of such rehabilitation devices.

  Therefore, the main object of the present invention is to provide a novel VR tennis game system.

  Another object of the present invention is to provide a VR tennis game system that is simple and inexpensive.

  The invention of claim 1 is a VR tennis game system in which a player advances a game by swinging a racket in real space so as to hit a ball figure displayed on a screen in a VR tennis game, provided on the racket Fore / back for determining whether the forehand swing or the backhand swing according to the moving direction of the marker by processing the first camera that captures the marker, the first camera that captures the marker, and the first camera signal from the first camera It is a VR tennis game system provided with a determination means.

  In the invention of claim 1, the VR tennis game system (10: reference number corresponding to the embodiment, hereinafter the same) includes a screen (12), and a ball graphic ( A tennis game screen including FIG. 2: 40) is displayed. For example, the player (16) swings the racket (18) in the real space in front of the screen at the timing of hitting a ball figure on the screen. An optical marker (20) such as an LED is provided on the racket (18), and the optical marker (20) is photographed by cameras (22L, 22R) corresponding to the first camera.

  When the racket is swung, the computer (42) shown in FIG. 3 processes the first camera signal including the optical marker (20) (FIG. 5: S21-S31), and moves the optical marker (right → Whether the racket swing is a forehand swing or a backhand swing is determined by (left, left → right) (FIG. 5: S39, S41; S43, S45).

  As described above, it is possible to determine whether the racket swing is a forehand swing or a backhand swing only by processing the first camera signal, and it is not necessary to provide a complicated and expensive special sensor. Therefore, the VR tennis game system can be provided more easily and inexpensively.

  The VR tennis game according to claim 1, further comprising: a serve swing detection unit that detects a serve swing according to a moving direction of the marker by processing a first camera signal from the first camera. System.

  In the invention of claim 2, when the marker moves from top to bottom, the serve detecting means detects the serve swing. Therefore, a special switch or sensor is not required for serve detection.

  The invention of claim 3 further comprises a swing determination means for calculating the amount of movement of the marker by processing the first camera signal, and determining that the player swings the racket when the amount of movement is greater than or equal to a predetermined amount. The VR tennis game system according to 1 or 2.

  In the invention of claim 3, the computer (FIG. 3:42) processes the first camera signal (FIG. 5: S21-S29) and calculates the amount of movement of the marker from the previous frame (FIG. 5: S31). When the movement amount is equal to or greater than the predetermined value, it is determined that the player swings the racket (FIG. 5: S33). Then, the fore / back determination unit determines that the swing is the forehand swing or the backhand swing after determining that the swing is determined by the swing determination unit. Similarly, the serve detection means detects that the swing has been swung by the swing determination means, and then detects that the swing is a serve swing. The presence or absence of a swing can be determined without using a special sensor, and a VR tennis game system can be provided more easily and inexpensively.

  According to the invention of claim 4, forehand swing or backhand is provided by providing color markers of different colors on both feet of the player, further processing a second camera that captures the color marker, and a second camera signal from the second camera. Position determining means for determining the position of the color marker on one of the feet that comes forward during the swing, and a return ball direction control means for controlling the return direction of the ball figure on the screen according to the position determined by the position determination means, A VR tennis game system according to claim 2.

  In the invention of claim 4, the color markers (26L, 26R) are attached to the left and right ankles of the player (16). The colors of the color markers are different from each other. Then, the second camera (24) is provided at a position where the color marker can be photographed, and the computer (42) processes the second camera signal from the second camera. However, the second camera may be the same camera as the first camera.

  When actually swinging the racket, whether the player is a right-handed player or a left-handed player, the forward leg is different between the forehand and the backhand. For example, in a right-handed player, the left foot is forward in the forehand, and the right foot is forward in the backhand. In a left-handed player, the right foot is forward in the forehand, and the left foot is forward in the backhand.

  Therefore, the computer (42) detects the position of the front foot in the forehand or backhand as, for example, “right”, “middle”, or “left” (FIG. 6: S53 (S73) − S57).

  For example, when the position of the forefoot is “right” in both the forehand and the backhand, it is considered that the player's body is relatively directed to the right. Therefore, in the case of an actual tennis game, it can be considered that the racket hits the ball with its rightward posture, and the ball is hit back to the right side of the opponent's court. Similarly, when the front foot is in the “middle” position, the ball is hit back to the center of the opponent's court, and when the front foot is in the “left” position, the ball is hit back to the left of the opponent's court. Therefore, the computer returns the ball figure (FIG. 2:40) in the direction corresponding to the detected position of the forefoot.

  Also in this case, since the return ball direction is controlled only by the position of the forefoot, the processing at the time of the return ball can be easily performed.

  According to the present invention, since it is not necessary to use a complicated and expensive special sensor, a VR tennis game system can be provided easily and inexpensively.

  The above object, other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

  A VR tennis game system 10 according to an embodiment of the present invention shown in FIG. 1 includes a screen 12, and a video for a VR tennis game is displayed on the screen 12 by a projector 14. In this embodiment, the ceiling-mounted projector 14 is used in order to secure a sufficient space on the floor surface, but a floor-standing projector may be used. Furthermore, in this embodiment, a video display device comprising a combination of the screen 12 and the projector 14 is used, but other video display devices such as a large screen television may be used.

  The VR tennis game system 10 of this embodiment can be used mainly for upper limb movement in rehabilitation, and the trainee actually swings the racket 18 in the real space in front of the screen 12 as the player 16. The racket 18 is provided with a light marker 20 such as a visible light emitting diode (LED) such as red.

  In order to provide such an optical marker 20, although not shown, it is necessary to provide the racket 18 with a switch for supplying a battery and power from the battery to the optical marker (LED) 20. However, as this switch, a switch that is turned on when the player holds the racket 18 and turned off when the player releases it can be used.

  On the other hand, one USB camera 22L and 22R as the first camera is provided on each of the left and right sides of the screen 12, and the optical marker 20 of the racket 18 is photographed by the USB cameras 22LR and 22L, thereby making the player as described below. It is detected whether 16 swings the racket 18 (whether it swings).

  Note that a USB camera is connected to a USB (Universal Serial Bus: an interface standard that can connect various peripheral devices with a common connector) terminal of a computer. For example, the horizontal angle is 50 degrees and the number of pixels is 25−. It is a relatively inexpensive camera called a Web camera with about 450,000 pixels. However, a camera with a larger number of pixels may be used. However, according to experiments by the inventors, the tennis game of the example was able to cope with such a number of pixels. Since the number of pixels is small, the amount of computer processing is small, and the system can be constructed inexpensively as a whole.

  Further, one USB camera 24 as a second camera is provided in the lower center of the screen 12. On the other hand, different colors, for example, yellow and blue color markers 26L and 26R are attached to the ankles of the left and right feet of the player 16. By photographing the two color markers 26L and 26R with the USB camera 24, the posture (returning ball direction) at the time of forehand or backhand is determined as will be described later.

  The VR tennis game system 10 of FIG. 1 is provided with stereo speakers 28R and 28L, and the speakers 28R and 28L generate sound of hitting balls, cheering of the audience, or other appropriate BGM.

  FIG. 2 shows a display example of the game screen on the screen 12 when the tennis game is executed in the VR tennis game system 10 of FIG. 1 embodiment. That is, the tennis court figure 30, the net figure 32, and the audience figure 34 are fixedly displayed in the virtual space by the computer 42 (FIG. 3). Further, the computer 42 displays a racket figure 36 representing the racket 18 swung in the real space by the player 16 on the front side of the court, and a virtual player or a computer player figure (virtual player) that is controlled to move by the computer 42 in the opponent court. Player figure) 38, and the tennis ball figure 40 is moved and displayed so as to fly between the racket figure 36 and the virtual player figure 38.

  A block diagram of the VR tennis game system 10 of FIG. 1 embodiment is shown in FIG. The VR tennis game system 10 includes a computer 42 that receives camera signals from USB cameras 22L and 22R and 24. Then, a video signal is supplied from the graphic board 44 to the projector 14 and an audio signal is supplied from the sound board 46 to the speakers 28R and 28L.

  The internal memory 48 of the computer 42 stores a program shown in a flowchart described later, and the internal memory 48 is also used as a working memory, a register, or the like. In particular, the internal memory 48 is a hue register for presetting hue values (yellow and blue in the embodiment) indicating colors (marker colors) to be extracted or acquired by the computer 42 in image processing. (Not shown) is formed.

  An external memory 52 is coupled to the computer 42 via a memory interface 50. The external memory 52 is an arbitrary recording medium or storage medium such as a hard disk, a disk such as a CD-RW or a DVD-RW, or a semiconductor memory. Here, these are referred to as “memory” for convenience. The external memory 52 stores or records master data including trainers (players) and their symptoms necessary for rehabilitation.

  When playing the tennis game with the VR tennis game system 10 of FIG. 1 embodiment, it is determined whether or not the start of the VR tennis game is instructed in the first step S1 of FIG. Specifically, it is determined whether or not a game start operation such as turning on a power source (not shown) has been performed.

  However, at the start of the game, although not shown, for example, initial settings such as setting a hue register or resetting various flags are performed.

  In the subsequent step S3, the computer 42 (FIG. 3) executes a return ball action of the opponent player, that is, the virtual player (computer player). Specifically, in step S5, the trajectory of the ball graphic 40 in the game screen shown in FIG. 2 is calculated, and the ball graphic 40 is drawn so that the ball graphic 40 moves on the trajectory.

  In subsequent step S7, the computer 42 determines whether or not the ball is present at a position where the player 16 (FIG. 1) can hit the ball. More specifically, a position or area where the player 16 can hit the ball graphic 40 (FIG. 2) is set in advance, and when the ball graphic reaches the position or area, “YES” is determined in this step S7. The

  If "YES" is determined in the step S7, the computer 42 determines the swing of the racket 18 in the next step S9. Specifically, this step S9 is executed as a subroutine of FIG.

  In the first step S21 in FIG. 5, the computer 42 captures image signals (first camera signals) from the two USB cameras 22L and 22R. However, since it is only necessary to detect the optical marker 20 (FIG. 1) provided on the racket 18 in the swing determination, the exposure times of the USB cameras 22L and 22R are set to be extremely short, and the USB cameras 22L and 22R are used. Input a monochrome image signal. That is, only the luminance signal is input from the USB cameras 22L and 22R.

  In the next step S23, the computer 42 binarizes the luminance signals from the USB cameras 22L and 22R so that a brightness area considered to be the optical marker 20 can be detected.

  In the subsequent step S25, the computer 42 executes an expansion process (a process of filling a divided area or a holed area into a series of areas).

  In step S27, the computer 42 performs area filtering. That is, in this step S27, the computer 42 detects the high luminance area after binarization in step S23 and the expansion process in step S25, and determines and removes the area having a small area as noise, A region having an area equal to or greater than a predetermined threshold is detected. And the area | region of the largest area is determined to be the optical marker 20 among the area | regions of the area beyond the threshold value.

  After detecting the position of the optical marker 20 in step S27, the barycentric coordinates are measured in step S29. That is, the computer 42 measures the center-of-gravity coordinates on the image and sets the center of the image as the origin. However, the “center of gravity” refers to the center of mass distribution when the pixel value is regarded as density.

  After measuring the center-of-gravity coordinates in step S29, in step S31, the computer 42 calculates the movement amount of the center of gravity based on the center-of-gravity position of the previous (previous frame) and the center-of-gravity position of the current (current frame). Next, in step S33, the computer 42 determines whether the amount of movement is equal to or greater than a predetermined threshold value.

  If “NO” is determined in the step S33, that is, if the amount of movement from the center of gravity position of the previous frame is smaller than the predetermined value, the computer 42 determines that the player 16 is not swinging the racket 18, and step S35. , The swing flag SF is reset (SF = 0). However, this swing flag SF is not shown in the figure, but is provided in the internal memory 48 shown in FIG. 3 in the same manner as a forehand flag FHF, a backhand flag BHF, and a serve flag SVF which will be described later.

  If “YES” is determined in step S33, that is, if the amount of movement from the center of gravity position of the previous frame is equal to or greater than a predetermined value, the computer 42 determines that the player 16 swings the racket 18 in step S37. The swing flag SF is set (SF = 1).

  In this way, it is possible to detect whether or not the player 16 actually swings the racket 18 simply by photographing the optical marker 20 of the racket 18 with the cameras 22L and 22R and processing the camera signal. Therefore, the sensor used in the prior art becomes unnecessary, and it is not necessary to perform complicated signal processing. Therefore, it is possible to detect whether or not the player 16 swings the racket 18 with a simple configuration and simple processing.

  However, in the embodiment, two USB cameras 22L and 22R are used to increase detection accuracy, that is, to avoid detection errors as much as possible. However, only one USB camera may be used for racket swing detection.

  In the next step S39, the computer 42 determines whether or not the optical marker 20 (FIG. 3) has moved from right to left (toward the screen 12 in FIG. 1). That is, in step S31, the amount of movement of the center of gravity of the optical marker 20 from the previous frame in the current frame is calculated. In this calculation process, has the center of gravity moved from right to left in the horizontal direction of the screen 12? , It is possible to determine whether it has moved from left to right. The fact that the light marker 20 has moved from right to left means that the racket 18 has moved from right to left. In this case, if the player 16 is shaking the racket 18 with the right hand, It can be determined as a forehand swing. Therefore, when “YES” is determined in the step S39, the computer 42 sets the forehand flag FHF (FHF = 1) in the subsequent step S41.

  If “NO” in the step S39, the computer 42 determines whether or not the light marker 20 (FIG. 3) has moved from the left to the right toward the screen 12 in the next step S43. Similar to step S39, step S43 can also be determined from the calculation result of step S31. For example, the fact that the optical marker 20 has moved from left to right means that the racket 18 has moved from left to right. In this case, if the racket is shaken with the right hand, the backhand swing is Can be judged. Therefore, when “YES” is determined in the step S43, the computer 42 sets the backhand flag BHF (BHF = 1) in the subsequent step S45.

  When “NO” is determined in the step S43, the computer 42 determines whether or not the light marker 20 has moved from the top to the bottom in the next step S47. As described above, the center of gravity movement amount of the optical marker 20 from the previous frame is calculated in step S31. In this calculation process, whether or not the center of gravity moves from top to bottom in the vertical direction of the screen 12 is also checked. Can be determined. The fact that the optical marker 20 has moved from top to bottom means that the racket 18 has been swung down from top to bottom, regardless of whether it is swung with the right hand or with the left hand. It can be determined as a serve swing. Therefore, when “YES” is determined in the step S47, the computer 42 sets the serve flag SVF (SVF = 1) in the subsequent step S49.

  There is no need to distinguish between right-handed and left-handed. That is, the forehand when the racket is shaken with the right hand becomes the backhand when the racket is shaken with the left hand, the backhand when the racket is shaken with the right hand becomes the forehand when the racket is shaken with the left hand, and the forehand in the former case The flag FHF is set. In the latter case, the backhand flag BHF is only set, and there is no need to change the subsequent processing.

  After the swing determination is made in this way, the process returns to step S11 in FIG. In step S11, the computer 42 determines whether the flag SF and the flags FHF, BHF, or SVF are set to “1”, that is, whether the player swings the racket. If “NO” in the step S11, the computer 42 determines that the swinging is missed, counts the score to the opponent, that is, the computer player, and returns to the step S3.

  If “YES” in the step S11, the computer 42 detects the direction of the body of the player 16 (FIG. 1) in a succeeding step S15. This step S15 is shown in detail in FIG.

  In the first step S51 of FIG. 6, the computer 42 refers to the flag area of the internal memory 48 (FIG. 3) and determines whether or not the forehand flag FHF is “1”. If “YES”, in the next step S53, the computer 42 detects the left foot color marker 26L (not shown). That is, when it is determined that the racket swing direction by the player's right hand is a forehand, the front foot is the left foot, that is, the foot closer to the screen 12 is the left foot. The marker 26L (FIG. 1) is detected.

  For example, in the case of a forehand, assuming that the front foot, that is, the left foot is on the right side of the screen 12, the front of the body of the player 16 is considered to be directed rightward in that state. On the contrary, in the state where the left foot is on the left side in the forehand, the front of the body of the player 16 is considered to be directed leftward. In the state where the left foot is in the middle (center), it is considered that the body of the player 16 faces the screen 12.

  In the forehand, when the front of the body of the player 16 is directed to the right, in the actual tennis game, it is considered that the racket 18 has hit the ball with its right-facing posture. You may think that you are hit back to the right side of the opponent's court.

  On the other hand, when the front of the player 16 is facing left in the forehand, in an actual tennis game, it is considered that the racket 18 has hit the ball with a left-facing posture. You may think that you will be hit back to the left side of the opponent's court.

  When the body of the player 16 faces the screen 12 in the forehand, it may be considered that the ball is simply hit back to the center of the opponent's court in the actual tennis game.

  In this way, it is conceivable to change the direction of the ball that the player 16 strikes depending on whether the position of the left foot in the forehand or the case is right, left, or center. Therefore, in this embodiment, in the case of a forehand, in order to detect the position of the left foot, the left foot color marker 26L is detected in step S53.

  In order to detect the left foot color marker 26L, a subroutine shown in FIG. 7 is executed. That is, in the first step S61, the computer 42 takes in an image signal (second camera signal) from the USB camera 24 installed below the screen 12. In addition to the image of the left foot color marker 26L of the player 16, the image signal includes an image of the background of the player. Therefore, in the next step S63, in order to remove such noise, the computer 42 masks an area other than the area where the left foot color marker 26L is considered to be present, and the masked area, that is, the area other than the left foot color marker existing area. The image signal in this area is excluded from the processing target to reduce the burden on the computer.

  In the subsequent step S65, the computer 42 calculates the hue value (0 to 255) set in the hue register (not shown) from the RGB signal of the image of the area exposed from the mask, that is, the left foot color marker existing area. A region (part) of a specific color indicated by (value) (in this embodiment, the left foot color marker 26L is yellow, so yellow) is extracted.

  In step S67, binarization processing is performed in order to detect a color region that seems to be a left marker from the specific color region acquired in step S65. In subsequent step S69, the computer 42 executes expansion processing.

  In step S71, the computer 42 performs area filtering. In other words, in this step S71, the computer 42 has a smaller area in the same or similar hue area as the left foot color marker 26L (FIG. 1) after binarization in step S67 and expansion processing in step S69. The region is determined as noise and removed, and a region having an area equal to or larger than a predetermined threshold is detected. And the area | region of the largest area among the area | regions of the area more than the threshold value is determined as a left foot color marker. After performing the area filtering process of step S71, the process returns to step S55 of FIG.

  In step S55 of FIG. 6, the barycentric coordinates are measured from the image signal after the area filtering process, as in step S29 (FIG. 5). The barycentric coordinate position is the position of the left foot color marker 26L, and in the next step S57, the detection result of that position (left, middle, right) is returned, and the process returns to step S17 (FIG. 4).

  If “NO” is determined in the step S51 of FIG. 6, the computer 42 determines whether or not the backhand flag BHF is “1” in a next step S59. If “YES” in the step S59, the right foot color marker 26R (FIG. 1) is detected in the same method as the step S53 and the left foot color marker detected in the step S73 in the next step S73.

  That is, when it is determined that the direction of the racket swing by the player's right hand is a backhand, the front foot is a right foot, that is, the foot closer to the screen 12 is a right foot, so in step S73. The right foot color marker 26R is detected.

  For example, in the case of a backhand, assuming that the front foot, that is, the right foot is on the right side toward the screen 12, the body of the player 16 is considered to be on the right side with respect to the screen 12 in that state. On the contrary, in the state where the right foot is on the left side in the backhand, the body of the player 16 is considered to be on the left side toward the screen 12. In the state where the right foot is in the middle (center), the body of the player 16 is considered to be in the center toward the screen 12.

  In backhand, when the player 16 is on the right side, in the case of an actual tennis game, the ball may simply be hit back to the right side of the opponent's court.

  On the other hand, when the player 16's body is on the left side in the backhand, in an actual tennis game, it may be considered that the ball is hit back to the left side of the opponent's court.

  When the body of the player 16 is centered in the left-right direction on the screen 12 in the backhand, it may be considered that the ball is simply hit back to the center of the opponent's court in the actual tennis game.

  In this way, it is conceivable to change the direction of the ball that the player 16 strikes depending on whether the position of the right foot in the backhand is right, left, or center. Therefore, in this embodiment, in the case of backhand, in order to detect the position of the right foot, the right foot color marker 26R is detected in step S73.

  In order to detect the right foot color marker 26R, the subroutine shown in FIG. 7 is executed. Since the detection method is the same as that for the left color marker 26L, redundant description is omitted here. Thereafter, after executing Steps S55 and S57, the detection result of the position (left, middle, right) of the right foot color marker 26R is returned, and the process returns to Step S17 (FIG. 4).

  In step S17 of FIG. 4 returned from step S57 of FIG. 6, the computer 42 determines the position (right, left, center) of the ball figure 40 (FIG. 2) as a result of the hit by the real player 16 in step S57. Return in the direction of.

  In this way, depending on whether it is a forehand or a backhand, by detecting the position of the front foot at that time with the camera, the return direction from the player 16 can be easily determined. Accordingly, complicated calculation processing such as the hitting angle between the racket and the ball and the trajectory calculation is not required.

  In the description of the embodiment, the cameras 22L and 22R for determining the swing of the racket 18 and the forehand or backhand determination and the camera 24 for detecting the positions of the color markers 26L and 26R are separately prepared. However, the racket swing and the position of the front foot may be detected or determined by the camera signal of one camera. However, even in this case, for convenience, a camera for swing determination, forehand or backhand determination is referred to as a first camera, and a camera for forefoot position detection is referred to as a second camera.

  The color markers 26L and 26R are attached to the ankle with a color band, but can be arbitrarily modified. For example, it functions as a color marker even if the shoe color of the player is different between the left and right.

  Further, in the above-described embodiment, the optical marker 20 is provided on the racket 18 and is photographed by the first camera 22 to detect the swing of the racket 18 and its direction. However, the light marker 20 may be replaced with a color marker similar to the player's foot. For example, it is possible to determine the swing of the racket 18 and distinguish the forehand or the backhand by providing color sheets on both sides of the gut of the racket 18 and photographing the color sheets with a camera.

FIG. 1 is an illustrative view showing a VR tennis game system according to one embodiment of the present invention. FIG. 2 is an illustrative view showing a display example of a game screen displayed in the VR tennis game system of FIG. 1 embodiment. FIG. 3 is a block diagram showing the electrical configuration of the embodiment of FIG. FIG. 4 is a flowchart showing the basic operation for the tennis game in FIG. 1 embodiment. FIG. 5 is a flowchart showing the subroutine of step S9 in FIG. FIG. 6 is a flowchart showing the subroutine of step S15 of FIG. FIG. 7 is a flowchart showing a subroutine of step S53 (S73) of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... VR tennis game system 12 ... Screen 14 ... Projector 16 ... Player 18 ... Racket 20 ... Light marker 22L, 22R, 24 ... USB camera 26L ... Left foot color marker 26R ... Right foot color marker

Claims (4)

A virtual reality tennis game system in which a player advances a game by swinging a racket in real space so as to hit a ball figure displayed on a screen in a virtual reality tennis game,
A marker provided on the racket,
A first camera that captures the marker, and a fore / back that determines whether it is a forehand swing or a backhand swing according to the movement direction of the marker by processing a first camera signal from the first camera A virtual reality tennis game system comprising a judging means.   2. The virtual reality tennis game system according to claim 1, further comprising: a serve swing detection unit that detects a serve swing in accordance with a moving direction of the marker by processing a first camera signal from the first camera.   The apparatus further comprises swing determination means for calculating the amount of movement of the marker by processing the first camera signal and determining that the player has swung the racket when the amount of movement is greater than or equal to a predetermined amount. The described virtual reality tennis game system. A color marker of a color different from each other on both feet of the player, and a second camera for photographing the color marker;
Position determining means for processing the second camera signal from the second camera to determine the position of a color marker on one of the front legs during the forehand swing or the backhand swing; and determination by the position determining means The virtual reality tennis game system according to claim 3, further comprising a return ball direction control unit that controls a return ball direction of the ball graphic on the screen in accordance with the played position.

Images