US20200338431A1 - Robotic training systems and methods - Google Patents
Robotic training systems and methods Download PDFInfo
- Publication number
- US20200338431A1 US20200338431A1 US16/914,678 US202016914678A US2020338431A1 US 20200338431 A1 US20200338431 A1 US 20200338431A1 US 202016914678 A US202016914678 A US 202016914678A US 2020338431 A1 US2020338431 A1 US 2020338431A1
- Authority
- US
- United States
- Prior art keywords
- data
- individual
- robotic
- sensor module
- athletic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000012549 training Methods 0.000 title claims abstract description 122
- 238000000034 method Methods 0.000 title claims abstract description 60
- 230000000386 athletic effect Effects 0.000 claims abstract description 130
- 230000004044 response Effects 0.000 claims abstract description 7
- 238000004891 communication Methods 0.000 claims description 45
- 230000005021 gait Effects 0.000 claims description 8
- 230000015654 memory Effects 0.000 description 38
- 230000033001 locomotion Effects 0.000 description 23
- 230000006870 function Effects 0.000 description 20
- 238000012545 processing Methods 0.000 description 20
- 230000001133 acceleration Effects 0.000 description 18
- 230000001413 cellular effect Effects 0.000 description 11
- 238000012806 monitoring device Methods 0.000 description 10
- 238000012544 monitoring process Methods 0.000 description 10
- 230000000007 visual effect Effects 0.000 description 9
- 238000004590 computer program Methods 0.000 description 8
- 239000003973 paint Substances 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 238000012546 transfer Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 230000000875 corresponding effect Effects 0.000 description 3
- 210000002683 foot Anatomy 0.000 description 3
- 239000000446 fuel Substances 0.000 description 3
- 230000001939 inductive effect Effects 0.000 description 3
- 238000003032 molecular docking Methods 0.000 description 3
- 230000005236 sound signal Effects 0.000 description 3
- 244000025254 Cannabis sativa Species 0.000 description 2
- 208000027418 Wounds and injury Diseases 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 239000008280 blood Substances 0.000 description 2
- 210000004369 blood Anatomy 0.000 description 2
- 239000000872 buffer Substances 0.000 description 2
- 230000001276 controlling effect Effects 0.000 description 2
- 230000006378 damage Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000013079 data visualisation Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 208000014674 injury Diseases 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- APTZNLHMIGJTEW-UHFFFAOYSA-N pyraflufen-ethyl Chemical compound C1=C(Cl)C(OCC(=O)OCC)=CC(C=2C(=C(OC(F)F)N(C)N=2)Cl)=C1F APTZNLHMIGJTEW-UHFFFAOYSA-N 0.000 description 2
- 238000010079 rubber tapping Methods 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 241000282465 Canis Species 0.000 description 1
- 241001331845 Equus asinus x caballus Species 0.000 description 1
- JVTAAEKCZFNVCJ-UHFFFAOYSA-M Lactate Chemical compound CC(O)C([O-])=O JVTAAEKCZFNVCJ-UHFFFAOYSA-M 0.000 description 1
- 241000283973 Oryctolagus cuniculus Species 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000037147 athletic performance Effects 0.000 description 1
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000017531 blood circulation Effects 0.000 description 1
- 230000036760 body temperature Effects 0.000 description 1
- 230000000747 cardiac effect Effects 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 230000002860 competitive effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000001351 cycling effect Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000009189 diving Effects 0.000 description 1
- 230000005672 electromagnetic field Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 239000012530 fluid Substances 0.000 description 1
- 210000004744 fore-foot Anatomy 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 210000000474 heel Anatomy 0.000 description 1
- 230000036571 hydration Effects 0.000 description 1
- 238000006703 hydration reaction Methods 0.000 description 1
- 230000001976 improved effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 210000002414 leg Anatomy 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 210000000452 mid-foot Anatomy 0.000 description 1
- 230000001617 migratory effect Effects 0.000 description 1
- 239000003595 mist Substances 0.000 description 1
- 229910052760 oxygen Inorganic materials 0.000 description 1
- 239000001301 oxygen Substances 0.000 description 1
- 238000004091 panning Methods 0.000 description 1
- 230000037081 physical activity Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000000241 respiratory effect Effects 0.000 description 1
- 230000029058 respiratory gaseous exchange Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000012536 storage buffer Substances 0.000 description 1
- 230000008093 supporting effect Effects 0.000 description 1
- 230000009182 swimming Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0686—Timers, rhythm indicators or pacing apparatus using electric or electronic means
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B21/00—Exercising apparatus for developing or strengthening the muscles or joints of the body by working against a counterforce, with or without measuring devices
- A63B21/0004—Exercising devices moving as a whole during exercise
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0075—Means for generating exercise programs or schemes, e.g. computerized virtual trainer, e.g. using expert databases
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0087—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B69/00—Training appliances or apparatus for special sports
- A63B69/0028—Training appliances or apparatus for special sports for running, jogging or speed-walking
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
- A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/20—Control system inputs
- G05D1/24—Arrangements for determining position or orientation
- G05D1/244—Arrangements for determining position or orientation using passive navigation aids external to the vehicle, e.g. markers, reflectors or magnetic means
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/60—Intended control result
- G05D1/646—Following a predefined trajectory, e.g. a line marked on the floor or a flight path
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/60—Intended control result
- G05D1/65—Following a desired speed profile
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
- A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
- A63B2071/0625—Emitting sound, noise or music
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/80—Special sensors, transducers or devices therefor
- A63B2220/806—Video cameras
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2105/00—Specific applications of the controlled vehicles
- G05D2105/60—Specific applications of the controlled vehicles for sport or gaming activities
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2107/00—Specific environments of the controlled vehicles
- G05D2107/20—Land use
- G05D2107/24—Sports fields, e.g. golf courses
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2109/00—Types of controlled vehicles
- G05D2109/10—Land vehicles
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2111/00—Details of signals used for control of position, course, altitude or attitude of land, water, air or space vehicles
- G05D2111/10—Optical signals
Definitions
- Embodiments of the present invention generally relate to systems and methods for using robotics to assist an individual in improving a workout. More particularly, robotic systems and methods may be used as coaching tools, guides, and/or pace setting systems.
- Typical methods include running on circular tracks of known lengths and employing a stop watch to record intervals or calculate speed.
- a running event such as a race
- other runners may be enlisted to aid in the effort and maintain a consistent pace.
- these runners may be called “rabbits” and are often paid to run only a portion of the race to ensure a fast opening pace.
- GPS and accelerometer based devices may be used to provide speed and distance information.
- Fitness monitoring devices have also been developed that are capable of recording information about an individual's performance during an athletic activity using sensors, and in some cases providing feedback about the individual's performance. Some fitness monitoring devices employ sensors attached to the individual's body, while other fitness monitoring devices rely on sensors attached to a piece of athletic equipment. Such sensors may be capable of measuring various physical and/or physiological parameters associated with the individual's physical activity.
- existing athletic/fitness activity monitoring, training, and coaching systems suffer from a number of drawbacks. Many existing systems are limited in the amount of feedback or coaching that they can give. Other systems may provide coaching feedback during the activity, but in a way that distracts that individual or interested observer from focusing on the ongoing athletic activity itself And many existing systems do not provide physical targets for individuals to react to, or an adequate substitute for a training partner. These systems are not suitable for monitoring in many real world athletic competitive or training sessions. Finally, existing athletic activity monitoring, training, and coaching systems often fail to provide the individual or interested observer with quick, accurate, insightful information that would enable them to easily compare past performances, develop strategies for improving future performances, or visualize performances.
- Embodiments of the present invention relate to a robotic training system, for example, an athletic training system for assisting an individual during an athletic activity in an environment.
- the system may include a mobile robotic platform, a sensor module including an array of optical sensors coupled to the mobile robotic platform and configured to obtain sensor data from the environment, a drive system configured to propel the mobile robotic platform, a steering system configured to steer the mobile robotic platform, and a processor.
- the processor may be configured to receive the sensor data from the sensor module, characterize the sensor data into one of edge data, color data, saturation data, threshold data, or keypoint data, and to control one of the drive system and the steering system to follow a path based on the characterized data.
- the sensor data comprises data related to variation of a surface of the environment.
- Embodiments of the present invention also relate to a robotic training system, for example, an athletic training system for assisting an individual during an athletic activity in an environment.
- the system may include a mobile robotic platform, a sensor module including an array of sensors coupled to the mobile robotic platform and configured to obtain data from the environment, a drive system configured to propel the mobile robotic platform, a steering system configured to steer the mobile robotic platform, and a processor.
- the processor may be configured to receive the data from the sensor module and to control one of the drive system and the steering system to follow a path based on the data.
- the data may include data related to variation of a surface of the environment.
- Embodiments of the present invention also relate to a method of training an individual, for example, assisting an individual during an athletic activity in an environment using a robotic athletic training system.
- the method may include controlling the robotic athletic training system with a processor of the robotic athletic training system to move the robotic athletic training system at a velocity, receiving data related to a surface of the environment over which the robotic athletic training system moves and on which the individual conducts their athletic activity with a vision system of the robotic athletic training system, comparing baseline possible surface characteristic data to the received surface data with the processor of the robotic athletic training system, and adjusting a travel direction of the robotic athletic training system in response to the comparison.
- FIG. 1 is an illustration of an individual using a robotic training system according to an embodiment of the present invention.
- FIGS. 2-3 are illustrations of selected robotic training systems according to embodiments of the present invention.
- FIG. 4 is an enlarged view of a sensor array according to an embodiment of the present invention.
- FIG. 5 is a diagram of a sensor module interacting with one of an electronic device, a standalone device, a network, and a server according to an embodiment of the present invention.
- FIG. 6 is a conceptual diagram of a software platform and software modules, according to an embodiment of the present invention.
- FIG. 7 is a diagram of a sensor module according to an embodiment of the present invention.
- FIG. 8 is a diagram of an electronic device according to an embodiment of the present invention.
- FIG. 9 is a flowchart of a method of assisting an individual during an athletic activity in an environment using a robotic athletic training system according to an embodiment of the present invention.
- FIG. 10 is a flowchart of a method of assisting an individual during an athletic activity in an environment using a robotic athletic training system according to an embodiment of the present invention
- FIG. 11 is a flowchart of a method of assisting an individual during an athletic activity in an environment using a robotic athletic training system according to an embodiment of the present invention
- invention or “present invention” as used herein is a non-limiting term and is not intended to refer to any single embodiment of the particular invention but encompasses all possible embodiments as described in the application.
- systems and methods are provided to enhance athletic training.
- the robotic platforms described herein may be autonomous or semi-autonomous small-scale vehicles.
- the systems and methods may, for example, follow the lanes of a running track, and may be used as a virtual coach by providing audio, visual display and haptic feedback to runners and can instruct them to speed up or slow down to meet a specific goal of the run. Additionally, they may be used to set pacing for a runner, coach an individual through different workout intervals, collect athletic data, and record video for gait and/or technique analysis.
- the robotic training systems and methods may give runners a tangible target to focus their workouts. This may advantageously improve the quality of feedback, for example, by having the robotic training system gradually accelerate/decelerate. This is in contrast to coaching being given as discrete, separate steps, in order to avoid over instructing the individual (e.g., change pace to 8 minutes per mile, prepare to run a 30 second interval at maximum speed, etc.). Additionally, rather than telling the individual to accelerate to a certain pace or zone, the robotic training system may simply show them the pace through its motion. In some embodiments, robotic training system may adjust to the individual's ability (e.g., if the individual can't keep up the robotic training system may adjust the pace or direction).
- the individual engaged in athletic activity is able to keep their eyes focused on the robotic training system in front of them instead having to look down at a wrist band, phone, etc., which could dangerously divert their eyes from the route in front of them. Additionally, being able to focus generally in front of the individual, rather than raising an arm or looking down, avoids introducing inefficient body positioning or form into the athletic activity.
- the robotic training system may provide for more granular training/coaching.
- the robotic training system may change velocity at a more frequent interval, e.g., by speeding up or slowing down gradually and having an individual follow the pace.
- other coaching methods attempting to verbally instruct an individual through granular or widely varying velocity risk over-coaching and overwhelming the individual.
- Substantially real time feedback may also be provided by the robotic training system.
- GPS and accelerometer systems may include lags in reporting changes of speed.
- the robotic training system embodiments of the present invention may instead utilize on board speed sensors (e.g., rotational speed sensors) and may use, for example, visual sensors focused on the individual in combination with the robotic training system's speed to adjust the operation of the system.
- on board speed sensors e.g., rotational speed sensors
- robotic training system 10 may include a mobile robotic platform 100 , a sensor module 102 , a drive system 104 configured to propel mobile robotic platform 100 , a steering system 106 configured to steer the mobile robotic platform 100 , and a processor 110 .
- Processor 110 may be configured to receive data (e.g., sensor data) from the sensor module and control the drive system 104 or steering system 106 to follow a predetermined path based on the data received from the sensor module 102 .
- Robotic platform 100 may include a frame, housing, etc., that may support or house various components of system 10 .
- a predetermined path may be, for example, an athletic track 300 , or a paint or chalk line 302 denoting a lane on track 300 , as shown in FIGS. 2 and 3 .
- sensor module 102 may be associated with mobile robotic platform 100 and configured to obtain data from an environment.
- sensor module 102 may include an array of sensors 108 , as shown, for example, in FIG. 4 .
- the sensors 108 may obtain data related to variation of a surface, such as an athletic track.
- sensors 108 may be positioned in a generally linear arrangement, such that sensors are parallel to one another and the direction of a linear axis about which the sensors are aligned extends is generally perpendicular to the sensed portion of the paint/chalk line 302 during use.
- the sensor array may be arranged in a “V” formation as with a group of migratory birds, or in a curved arrangement.
- the sensors of the array may be arranged in an offset fashion where they are not parallel to one another.
- the sensed surface variation data may be optical data, for example, data related to the relative position or composition of the paint or chalk line denoting a line on track 300 .
- the sensed data e.g., optical data
- the sensors transmit data to processor 110 , with the processor being further configured to adjust the drive system 104 or steering system 106 based on the data.
- the sensor array may include an array of sensors (e.g., infrared or “IR” sensors, photo-sensitive systems, CCD, CMOS, etc.), and transmit data related to which sensor is positioned over the paint or chalk line 302 denoting a lane on a track 300 . Paint of chalk line composition, line edge relative angles, or other features may be detected. Speed or direction adjustments of the drive system 104 or steering system 106 may vary according to how many sensors sense the presence of the line, frequency of the frame rate, resolution of the captured data, or the relative angle of the edge of the line with respect to one or more sensors, for example. In some embodiments, speed or direction adjustments may vary according to the location of the sensor along the array that senses the presence of the line. In some embodiments, speed or direction adjustments may vary according to a predetermined threshold of time a particular sensor senses the presence of the line. In some embodiments, sensor position, time, or number of sensors sensing the presence of the line may vary the speed and/or direction.
- sensors e.g., in
- robotic training system 10 of the present invention employing embodiments of sensor module 102 may provide natural, smooth feedback and coaching based on real world track surface conditions.
- drive system 104 and/or steering system 106 may be, for example a wheeled system. In some embodiments, these systems may be a track system, an aerial propulsion system, a magnetic propulsion system, a rail system, a robotic leg system, or other suitable drive system. In some embodiments, the drive system 104 and steering system 106 may be autonomous, or semi-autonomous. Autonomous or semi-autonomous systems may have advantages over known systems that rely on significant user or coach input or control, which may be more cumbersome to control and may limit their use.
- robotic platform 100 may include a frame configured to support athletic equipment or supplies (e.g., used as a type of robotic “pack mule”). For example, some embodiments may be specifically configured to carry and/or dispense water, food, or first aid equipment.
- additional sensor modules 102 may be employed, either physically integrated with robotic platform 100 or separate from robotic platform.
- sensor modules 102 may include additional sensors 148 , for example, physiological sensors or the like.
- system 10 may be partially or wholly solar powered, which may advantageously extend the range of the device of limit the need for frequent charging or battery replacement.
- system 10 may further include a wireless transceiver 112 in communication with an electronic device 400 associated with an individual 500 .
- the electronic device 400 may be, for example, a smart phone, a smart watch, a heads-up-display device, other smart apparel, a tablet, or any other type of suitable mobile computing device.
- transceiver 112 may receive data (e.g., electronic device data, or input data) from electronic device 400 , transmitting that data to processor 110 .
- processor 110 adjusts the drive system 104 or steering system 106 based on the data received from electronic device 400 .
- the transceiver 112 receives data including programmed instructions to control the drive and steering systems 104 / 106 according to a workout program.
- embodiments including a communication with an electronic device 400 may advantageously allow for a higher level of accuracy or customization in the performance of the robotic training system 10 .
- electronic device 400 may function as a sensor module 102 .
- these programs could include instructions to provide coaching feedback to individual 500 during a workout, for example, a training run.
- individual 500 may receive coaching instruction, for example, or encouragement.
- these programs may include a simulated race, where robotic platform 100 may be programmed with prior race data such that it moves according to a race pace and individual 500 may attempt to beat the platform.
- these programs may include world record data, such that individuals 500 may “compete” against current world records.
- Transceiver 112 may be integral with robotic platform 100 , or may be a separate unit. Additional details of the software platform and modules related to such programs along with programs and functions of the components are further discussed herein.
- Transceiver 112 may allow sensor module 102 to communicate, for example, with other locally or remotely located robotic platforms 100 , or other standalone devices 600 , via network 602 , or server 604 , for example, as shown in FIG. 5 . Communication between these components may be one way communication or two way communication.
- system 10 may include a user interface configured to receive input data and transmit the data to processor 110 which may adjust the drive or steering systems 104 / 106 based on the input data.
- the user interface may be displayed on electronic device 400 , for example, or may be integrated directly into robotic platform 100 .
- system 10 may include a video camera 114 .
- Video camera 114 may be configured to record an individual during training, for example.
- video camera 114 may transmit video data to processor 110 .
- processor 110 is configured to analyze physiological characteristics of the individual (e.g., analyze gait or foot strike characteristics, analyze other running form characteristics, recognize onset of fatigue, recognize perspiration levels, etc.).
- video camera 114 may be configured to record the surface an individual is running on, for example, or capture video of environmental surroundings.
- processor 110 may analyze, for example, gait characteristics such as foot strike type (e.g.
- video camera 114 may be configured to record the path ahead of the individual during training so as to record a first person-style view of the route traversed by the robotic training system 10 and the individual.
- the video camera 114 may pan around the environment to record video of competitors, spectators, or other items of interest. The panning may be autonomous or controlled by the individual or a third party such as a coach.
- additional robotic platforms 100 may be able to interact with one another based on sensor feedback.
- a land based robotic platform 100 may carry out training feedback functions to the individual 500
- an aerial based robotic platform 100 may include video camera 114 and carry out aforementioned video functions, based upon position of the land based robotic platform 100 or individual 500 , for example.
- system 10 may include an audio feedback system 116 .
- audio feedback system 116 is configured to provide information about a workout to an individual during the workout.
- audio feedback system 116 may provide audio coaching, for example to alert individual 500 to a change in the workout, to accelerate/decelerate, alert individual 500 of other individuals approaching, or to alert of other robotic platforms 100 (e.g., to urge slower runners to move to the right).
- Combined audio and visual feedback may enhance the coaching of an individual, as it more closely replicates one-on-one coaching between individuals, rather than an individual following only audio prompts.
- audio feedback system 116 may be configured to allow, for example, one-on-one coaching feedback from an individual's coach, in addition to feedback from the system 10 .
- system 10 may include a display system 118 .
- Display system 118 may be, for example, a projector, display screen, laser system, holographic display, paint/chalk display system, or the like.
- display system 118 is configured to provide information about a workout to an individual during the workout or other information or visual cues (e.g., display image on track or body of robotic platform 100 , display a line to follow, follow distance, or workout details).
- display system 118 may display visual cues, such as time remaining, current speed, number of laps, etc.
- display system 118 may allow for video calling other individuals (e.g., friends or competitors).
- display system 118 may include a heads up display (HUD), for example, on a helmet, or electronic eyeglasses.
- the display system 118 may project information or images on the surface of the track ahead of the individual and/or ahead of the robotic training system 10 , which may advantageously allow the individual to visual receive information without having to divert their field of view of otherwise break their form to view a display on a smartphone, smart watch, or other portable display.
- a display mounted on the robotic training system 10 itself may provide a similar benefit.
- system 10 may include an audio input system 120 .
- Audio input system 120 may be configured to accept audio data and transmit the data to the processor to control system 10 .
- audio input system 120 may function as a voice control/recognition system, and accept information such as individual 500 speaking commands to speed up or slow down, provide navigation, place an emergency call, place a call to a coach or trainer, place a video call to other individuals (e.g., friends or competitors), or post an update on a social media platform.
- Some embodiments are directed to a method of training including initiating programming data such that a robotic training system moves at a predetermined velocity, wherein the robotic training system includes a vision system configured to receive data related to a surface, receiving data related to a surface, comparing a baseline data of a desired surface to the received data, and adjusting a travel direction of the robotic system in response to the comparison.
- the data received related to a surface is optical data indicating the position of a line on a track.
- Existing systems often do not account for surface variation (e.g., if an individual begins running on a track but transitions to a grass field).
- embodiments of the present invention may provide variation in coaching feedback depending upon the surface upon which the athletic activity is performed (e.g., a field, artificial turf, track, sidewalk, etc.).
- the method may include controlling a robotic athletic training system with a processor of the robotic athletic training system to move the robotic athletic training system at a velocity.
- the method may then include receiving data related to a surface of the environment over which the robotic athletic training system moves and on which the individual conducts their athletic activity with a vision system of the robotic athletic training system at step 2004 , comparing baseline possible surface characteristic data to the received data related to the surface of the environment with the processor of the robotic athletic training system at step 2006 , and adjusting a travel direction of the robotic athletic training system in response to the comparison at step 2008 .
- Exemplary method 2100 shown at FIG. 10 may include each of the steps shown in method 2000 . Further, the method may include the robotic training system providing coaching feedback to the individual during the athletic activity at step 2010 .
- Exemplary method 2200 shown at FIG. 11 may include each of the steps shown in methods 2000 and 2100 . Additionally, the method may include receiving physiological sensor data at the robotic athletic training system about the individual from a sensor module coupled to the individual during the athletic activity at step 2012 , comparing baseline possible surface characteristic data to the received data related to the surface of the environment with the processor of the robotic athletic training system at step 2014 , and adjusting the velocity of the robotic athletic training system in response to the physiological data comparison at step 2016 . Additionally, each of the methods may include an optional feedback loop from either step back to any previous step.
- the method further includes receiving physiological sensor data at a robotic training system 10 about an individual 500 from a sensor module associated with the individual 500 during an athletic activity engaged in by the individual.
- the method includes comparing the physiological sensor data received to baseline physiological data using a processor (for example processor 110 ), and adjusting the programming data based on the comparison such that the velocity (or direction) of the robotic training system is adjusted.
- the method further includes receiving personal information about the individual prior to receiving the physiological data.
- the personal information includes one of prior injury information, height, weight, gender, an athletic goal, intended athletic environment, intended athletic duration, intended workout intensity.
- the system or method may include receiving data about the individual from a sensor module associated with the individual during a first athletic activity engaged in by the individual.
- the method may also include receiving data about the individual from the sensor module associated with the individual during a second athletic activity engaged in by the individual, and determining a second characteristic based on the data related to the second athletic activity.
- the method may also include comparing the data received during the first/second athletic activities; and providing a recommendation about a workout.
- the first and second data received may include physiological characteristics (e.g. respiratory or cardiac data).
- the method may determine whether a characteristic of the second data represents an improvement over the first data.
- the method may include receiving data (e.g., motion data, physiological data, etc.) via local wired or wireless connection, or via a wide area network.
- the method may include monitoring the motion of an individual in substantially real-time during an athletic activity.
- a sensor module 102 may be provided and configured to obtain data relating to a physiological parameter of the individual 500 during an athletic activity.
- the systems and methods may be effected through software platform 1000 (which may be included in system 10 ), containing software modules, as shown in FIG. 6 , for example. In some embodiments, fewer modules may be included, or additional modules may be included. In some embodiments, modules may be removed or added, for example through a network connection.
- Programming data may include software platform 1000 , for example, as shown in FIG. 6 , and include various modules. Each of the components in sensor module 102 , for example, or electronic device 400 , may feed the modules data that the modules use to formulate a response.
- programming data includes simulated race data such that the robotic training system moves at a race pace.
- the programming data includes feedback data such that the robotic training system provides coaching feedback to an individual during a workout.
- the systems and methods may be effected through software platform 1000 in an electronic device 400 in addition to or instead of in system 10 .
- software platform 1000 may include highlight reel module 1100 , including programming to capture video data from video camera 114 and compose a video montage or highlight reel.
- software platform 1000 may include a statistics module 1102 .
- Statistics module 1102 may be programmed to display relevant statistics regarding the workout such as distance, time, pace, heart rate, physiological data, etc.
- statistics module 1102 may function as a workout coach, by providing instructions or feedback through display system 118 or audio feedback system 116 .
- statistics module 1102 may include a lap counter, for example, in order allow an individual to run accurate distances in any lane.
- software platform 1000 may include a proximity awareness module 1104 .
- Proximity awareness module 1104 may use additional sensor data (or data from sensor module 102 ) to guide robotic platform 100 around obstacles, for example, or to maintain a safe distance from an individual 500 using system 10 .
- proximity awareness module 1104 may notify an individual running of other runners near the individual, or aware of other competitor's status in a race event, for example.
- proximity awareness module 1104 may optimize a route, for example, accounting for particular surfaces or geography, or may analyze a route taken by an individual (e.g., how an individual approaches corners, etc.).
- proximity awareness module 1104 may communicate with other robotic platforms 100 .
- proximity awareness module 1104 may include, for example a radar system or ultrasonic system with radar sensors or ultrasonic sensors.
- software platform 1000 may include a strategy module 1106 .
- Strategy module 1106 may include instructions to coach an individual for particular conditions (e.g., coaching a runner to slow down while traveling uphill or into headwind and accelerate for downhill or tailwind).
- Strategy module 1106 may use data from sensor module 102 , for example vision sensor data, or additional sensor data, such as proximity sensor data.
- strategy module may coach the individual to adjust their performance, for example adjusting their gait, stride, or posture for different terrain (e.g., going uphill or downhill).
- data from video camera 114 may be used as an input to strategy module 1106 and coaching may be dependent upon video data analysis (e.g., fatigue or gait analysis).
- software platform 1000 may include a safety module 1108 .
- Safety module may, for example, coach an individual running to slow down when approaching uneven or dangerous surface conditions, or when physiological data reaches unsafe levels.
- safety module may control driving or steering system 104 / 106 to avoid obstacles or brake if communication or other signals are lost or are abnormal.
- safety module may leave individual 500 and dial an emergency number if cellular coverage is unavailable.
- safety module 1108 may utilize data from sensor module 102 to maintain a predetermined position around individual 500 , for example ahead, behind, or beside individual 500 .
- safety module 1108 calculates an acceptable radius from individual 500 and adjusts based upon the path taken by individual 500 .
- safety module 1108 may for example, pick up litter after a race along a race path.
- software platform 1000 may include a Fuel/Hydrate module 1110 .
- Fuel/Hydrate module 1110 may utilize workout data, data from sensor module 102 , etc., to coach individual 500 on proper food and water intake during a workout.
- robotic platform 1000 may include on board fluid and food to provide to individual 500 .
- Fuel/Hydrate module 1110 may include a mist function, for example, if it is hot outside, or if individual 500 reaches a predetermined temperature as measured by sensor module 102 .
- software platform 1000 includes Charge module 1112 .
- Charge module 1112 may provide an energy source for long races to charge a phone, for example as electronic device 400 .
- Charge module 1112 may activate, for example, Bluetooth charging when electronic device 400 charge level falls below a predetermined threshold. In this regard, charge module 1112 may provide additional energy to allow for longer training or running sessions of individual 500 .
- software platform 1000 includes a Guide module 1114 .
- Guide module 1114 may utilize audio feedback system 116 , for example, to serve as a guide for a blind individual 500 .
- guide module 1114 may travel ahead of individual 500 and “scout” the area, for example.
- guide module 1114 may include a light, for example, an LED light that may be configured to turn on if the environment sensed by sensor module 102 drops below a predetermined light level threshold.
- software platform 1000 includes a Babysitter module 1116 .
- Babysitter module 1116 may configure robotic platform such that it autonomously “walks” an individual's 500 baby around a predetermined path (e.g., around the block).
- babysitter module may “walk” an individual's canine companion.
- babysitter module 1116 may stream video data from video camera 114 to electronic device 400 for monitoring by individual 500 .
- software platform 1000 includes a light module 1118 that may activate a light on robotic platform 100 to illuminate a path for individual to follow.
- software platform 1000 includes vision module 1120 .
- Vision module 1120 may, for example, utilize video camera 114 , or sensor array 108 , or additional sensors 148 to achieve computer vision for system 10 .
- vision module 1120 may be a sub-module of other modules.
- software platform 1000 may include a Fetch module 1124 .
- Fetch module 1124 may communicate with sensor module 102 , and be configured to find and retrieve athletic equipment, for example, soccer balls, or golf balls.
- software platform 1000 includes a weather module 1126 .
- Weather module 1126 may communicate with sensor module 102 , for example, and record/report wind speed, temperature, humidity, etc. This data may be fed back into other modules, for example, to adjust workouts of individual based on weather information.
- software platform 1000 includes referee module 1128 .
- Referee module 1128 may communicate with athletic equipment, for example soccer balls and the like.
- sensor module 102 may determine whether a soccer ball is out of bounds for example, or travels past a goal line.
- software platform 1000 includes skills module 1130 .
- Skills module 1130 may configure robotic platform 100 to perform athletic maneuvers, for example, “kicking” soccer balls for goalie/player training.
- robotic platform 100 may be configured to travel in random or pseudorandom patterns, and have individual 500 follow it.
- Skills module 1130 may include a simulated race mode, such that individual 500 may attempt to follow the robotic platform 100 as it leads them through a simulated race.
- skills module 1130 may include a World Record mode. In the world record mode, the robotic platform 100 may lead individual 500 at a world record pace for a particular distance.
- world record mode may configure robotic platform 100 to “replay” world record or personal record performances so the runner can attempt to “hang on” as long as possible.
- drive system 104 may accelerate and decelerate at a specific pace, e.g., the acceleration at the start and the “kick” at the end of the race, for example.
- software platform 100 includes team module 1132 .
- Team module 1132 may provide feedback to multiple individuals 500 , or coordinate movement between.
- software platform 1000 includes a social module 1134 , for example, to integrate with social networking platforms, or other communication systems such that an individual may stream video of their workout.
- social module 1134 may enable individual 500 to video chat with other individuals engaged in a workout.
- social module 1134 may allow for friends, family, or fans of an individual engaged in a workout to communicate with the individual, for example to cheer them on (e.g., transmit a song designed to encourage or “pump up” individual 500 , or phone a friend when individual 500 is fatigued).
- social module 1134 may include communicating to a communication hub for services, (e.g., such as “OnStar”).
- the individual 500 may use robotic training system 10 to carry out the methods and systems of the present invention. In some embodiments, the individual 500 may use an electronic device 400 to carry out the methods and systems of the present invention.
- the individual 500 may cause different GUI pages to be provided by different modules by selecting their corresponding icons using user input controls. Additional icons corresponding to sub-modules or program wizards associated with a particular module may pop up or otherwise be displayed to the individual 500 if the individual 500 selects, swipes, or hovers over a module icon with a cursor.
- an educational section there may be an educational section. In some embodiments this may include information general to health and fitness, or more specialized information, such as information about running or a particular athletic activity.
- the system may archive individual 500 information in an acceptable way to allow for more storage room on the electronic device 400 or sensor module 102 .
- Archival may include hard drive storage on site, cloud based storage, server storage, or any other acceptable storage medium.
- Examples of athletic goals may include training for a race, or other sporting event, improving individual fitness, simply enjoy running, or the like.
- Frequency intervals may include for example about 1-2 times per week, about 3-4 times per week, about 5-7 times per week, or the individual doesn't know.
- Length intervals may include for example about less than about 5 miles per week, about 5-10 miles per week, about 10-20 miles per week, greater than about 20 miles per week, or the individual doesn't know.
- Examples of intended athletic terrain environments may include roads, track, treadmill, trail, gym, or particular athletic fields designed for a specific sport. These features may be integrated into software platform 1000 and used to control robotic training system 10 .
- All modules may have one or more sub-modules which may be navigated to and from by clicking, swiping, etc.
- the system may allow the individual 500 one of upload photos, videos, medical records, and the like for incorporation into the robotic training system and methods.
- Pairing is a process used in computer networking that helps set up an initial linkage between computing devices to allow communications between them. Pairing may occur wirelessly via a personal area network or local area network using, for example, the Bluetooth wireless protocols.
- the software platform 1000 may prompt the individual 500 to pair their electronic device 400 (or other sensors) to a sensor module 102 , and may display updates to the individual 500 as to the status of the pairing.
- Sensor modules 102 may have a generic registration name in the system that identifies the sensor module as part of the system 10 .
- sensor modules may be identified by the name of the individual using that sensor module. For example a sensor might be registered as RSS0005 as a generic identification name, and the broadcast signal would include this name. Once paired that sensor module may change the broadcast signal to include a name corresponding to the particular individual using that sensor module, such as NAME 01 or NAME 02 .
- registration data and personal information collected from the individual 500 may be loaded onto the sensor modules.
- the system 10 or method may include identifying whether a performance goal has been met.
- the method may include receiving personal information about the individual prior to receiving the data about the individual.
- the personal information may include information such as their name, prior injury information, height, weight, gender, shoe size, an athletic goal, intended athletic environment or terrain, intended athletic activity duration, intended athletic activity frequency, intended athletic activity distance, quantitative or qualitative preferences about athletic equipment or footwear (such as level of cushion, preference of weight, materials and the like), and current athletic footwear.
- the method may include creating an account for the individual. This account may include obtaining personal information from the individual.
- the method may include receiving motion data related to the individual from a sensor module associated with the individual while the individual is engaged in an athletic activity, or other data received from robotic platform 100 and associated sensor modules 102 .
- the method may include storing the personal information, and characteristics in association with the account for the individual.
- the electronic device 400 may be for example one of a desktop computer, a PDA device, MP3 player, an electronic watch having a sports operating mode, a workstation, mobile device (e.g., a mobile phone, personal digital assistant, tablet computer, or laptop), computer, server, compute cluster, server farm, game console, set-top box, kiosk, embedded system, a gym machine, dedicated electronic device, game console controller.
- electronic device 400 may include at least one processor and memory.
- Robotic training system 10 may be suitable for use by individuals 500 for individual athletic activities may be suitable for use by individuals 500 engaged in athletic activities such running or walking.
- the robotic training system 10 may also include or interact with robotic training system software platform 1000 .
- Interface aspects of the robotic training system or robotic training system software could be, for example, presented to an individual 500 via a screen on the individual's 500 electronic device 400 .
- software platform 1000 may be remotely hosted, for example, on a server.
- an individual may download software platform 1000 or various modules to a memory, for example, a flash drive, which may be coupled to the robotic training system 10 to program the robotic platform 100 .
- additional sensors 148 may be utilized, for example additional physiological sensors integrated within an existing piece of athletic activity monitoring equipment such as, for example, a heart rate monitoring device, a pedometer, and accelerometer-based monitoring device, positioning system receiver device (e.g. a GPS receiver), or other fitness monitoring device.
- a heart rate monitoring device e.g. a heart rate monitoring device
- a pedometer e.g. a pedometer
- accelerometer-based monitoring device e.g. a GPS receiver
- positioning system receiver device e.g. a GPS receiver
- Communication may also occur between the sensors, electronic device, and/or a remote server 604 via a network 602 , for example, as shown in FIG. 5 .
- the network is the Internet.
- the Internet is a worldwide collection of servers, routers, switches, and transmission lines that employ the Internet Protocol (TCP/IP) to communicate data.
- the network may also be employed for communication between any two or more of the sensors, the electronic device, the server, etc.
- information is directly communicated between the sensors or processor and the server via the network, thus bypassing the electronic device.
- a variety of information may be communicated between any of the components that may transmit or receive data or information.
- Such information may include, for example, performance parameter data, device settings (including sensor settings), software, and firmware.
- Communication among the various elements of the present invention may occur after the workout/athletic activity has been completed or in substantially real-time during the workout/athletic activity.
- the electronic device 400 may serve a variety of purposes including, for example, providing additional data processing, providing instructions to robotic platform 100 ; providing additional data storage, providing data visualization, providing additional sensor capabilities, relaying information to a network 602 , providing for the playback of music or videos, or the like.
- the electronic device 400 illustrated in the figures may not be a dedicated electronic monitoring device; the electronic device 400 illustrated in the figures may be a mobile phone, dedicated fitness monitor, smart watch, tablet computer, etc.
- the sensor module 102 itself to be embodied by a mobile phone, or for the electronic device 400 to be a mobile phone.
- Including an electronic device 400 in the robotic training system 10 such as a mobile phone, may be desirable as mobile phones are commonly carried by individuals 500 , even when engaging in athletic activities, and they are capable of providing significant additional computing and communication power at no additional cost to the individual 500 .
- processing steps or other calculations recited herein may be capable of being performed by various embodiments of the robotic training system 10 disclosed herein, and are not necessarily limited to being performed by the sensor module 102 , depending on the configuration of a particular embodiment of the present invention.
- any of the processing steps or other calculations recited herein may be performed, in various embodiments, by the sensor module 102 , by a server computer 604 , by an electronic device 400 , and/or any other network component, or by more than one component.
- Embodiments of the present invention may involve the use of so-called “cloud computing.”
- Cloud computing may include the delivery of computing as a service rather than a product, whereby shared resources, software, and information are provided to computers and other devices as a utility over a network (typically the Internet).
- Cloud computing may entrust services (typically centralized) with an individual's 500 data, software and computation on a published application programming interface over a network.
- End users may access cloud-based applications through a web browser or a light weight desktop or mobile app while the business software and data are stored on servers at a remote location.
- Cloud application providers often strive to give the same or better service and performance than if the software programs were installed locally on end-user computers.
- Embodiments of the present invention may incorporate features of motion and performance monitoring systems.
- Exemplary motion monitoring and performance systems are disclosed in commonly owned U.S. patent application Ser. No. 13/077,494, filed Mar. 31, 2011 (which published as U.S. Patent App. Pub. No. 2012/0254934), and commonly owned U.S. patent application Ser. No. 13/797,361, filed Mar. 12, 2013 (which published as U.S. Patent App. Pub. No. 2014/0266160), the entirety of each being incorporated herein by reference thereto.
- the sensor module 102 may include processor 110 (processor 110 may also be a separate component).
- Sensor module 102 may include a power source 140 , a memory 138 , an acceleration sensor 142 , a magnetic field sensor 146 , and a transceiver 112 (transceiver 112 may be a separate component). These components are operatively connected to one another to carry out the functionality of the sensor module 102 . In other embodiments, one or more of these sensor module 102 components may be omitted, or one or more additional components may be added.
- Processor 110 may be included in sensor module 102 , or may be a separate component. Processor 110 may be adapted to implement application programs stored in the memory 138 of the sensor module 102 . The processor 110 may also be capable of implementing analog or digital signal processing algorithms such as raw data reduction and filtering. For example, processor 110 may be configured to receive raw data from sensors and process such data at the sensor module 102 . The processor 110 is operatively connected to the power source 140 , the memory 138 , the acceleration sensor 142 , the magnetic field sensor 146 , and the transceiver 112 .
- calibration of sensor module 102 is performed using, for example, received GPS signals from a position receiver 130 .
- the received GPS signals can be used, for example, to determine a distance that an individual runs or walks during a workout.
- calibration of sensor module 102 may be prepared by using a counter (e.g., additional sensor 148 ) to count revolutions of an axle of drive system 104 , for example.
- the power source 140 may be adapted to provide power to the sensor module 102 .
- the power source 140 may be a battery.
- the power source may be built into the sensor module 102 or removable from the sensor module 102 , and may be rechargeable or non-rechargeable.
- the power source 140 may be recharged by a cable attached to a charging source, such as a universal serial bus (“USB”) FireWire, Ethernet, Thunderbolt, or headphone cable, attached to a personal computer.
- a charging source such as a universal serial bus (“USB”) FireWire, Ethernet, Thunderbolt, or headphone cable
- USB universal serial bus
- the power source 140 may be recharged by inductive charging, wherein an electromagnetic field is used to transfer energy from an inductive charger to the power source 140 when the two are brought in close proximity, but need not be plugged into one another via a cable.
- a docking station may be used to facilitate charging.
- the sensor module 102 may be repowered by replacing one power source 140 with another power source 140 .
- Power source 140 may additionally power robotic platform 100 , including drive and steering systems 104 / 106 .
- the memory 138 may be adapted to store application program instructions and to store athletic activity data.
- the memory 138 may store application programs used to implement aspects of the functionality of the retail enhancement system 10 described herein.
- the memory 138 may store raw data, recorded data, and/or calculated data.
- the memory 138 may act as a data storage buffer.
- the memory 138 may include both read only memory and random access memory, and may further include memory cards or other removable storage devices.
- the memory 138 may store raw data, recorded data, and/or calculated data permanently, while in other embodiments the memory 138 may only store all or some data temporarily, such as in a buffer. In one embodiment of the present invention, the memory 138 , and/or a buffer related thereto, may store data in memory locations of predetermined size such that only a certain quantity of data may be saved for a particular application of the present invention.
- the acceleration sensor 116 may be adapted to measure the acceleration of the sensor module 102 . Accordingly, when the sensor module 102 is physically coupled to robotic platform 100 , the acceleration sensor 116 may be capable of measuring the acceleration of the object 104 , including the acceleration due to the earth's gravitational field, and may allow robotic platform to move with predetermined acceleration patterns. In one embodiment, the acceleration sensor 116 may include a tri-axial accelerometer that is capable of measuring acceleration in three orthogonal directions. In other embodiments one, two, three, or more separate accelerometers may be used.
- the magnetic field sensor 146 may be adapted to measure the strength and direction of magnetic fields in the vicinity of the sensor module 102 . Accordingly, sensor module 102 , utilizing the magnetic field sensor 146 , may be capable of measuring the strength and direction of magnetic fields in the vicinity of the robotic platform 100 , including the earth's magnetic field.
- the magnetic field sensor 146 may be a vector magnetometer. In other embodiments, the magnetic field sensor 146 may be a tri-axial magnetometer that is capable of measuring the magnitude and direction of a resultant magnetic vector for the total local magnetic field in three dimensions. In other embodiments one, two, three, or more separate magnetometers may be used.
- the acceleration sensor 116 and the magnetic field sensor 146 may be contained within a single accelerometer-magnetometer module bearing model number LSM303DLHC made by STMicroelectronics of Geneva, Switzerland.
- the sensor module 102 may include only one of the acceleration sensor 116 and the magnetic field sensor 146 , and may omit the other if desired.
- the transceiver 122 depicted in FIG. 6 may enable the sensor module 102 to wirelessly communicate with other components of the robotic training system 10 , such as those described in further detail below.
- the sensor module 102 and the other local components of the robotic training system 10 may communicate over a personal area network or local area network using, for example, one or more of the following protocols: ANT, ANT+ by Dynastream Innovations, Bluetooth, Bluetooth Low Energy Technology, BlueRobin, or suitable wireless personal or local area network protocols.
- Other known communication protocols suitable for a robotic training system 10 may also be used.
- the transceiver 122 is a low-power transceiver.
- the transceiver 122 may be a two-way communication transceiver 122 , while in other embodiments the transceiver 122 may be a one-way transmitter or a one-way receiver.
- Wireless communication between the sensor module 102 and other components of the robotic training system 10 is described in further detail below.
- the sensor module 102 may be in wired communication with other components of the robotic training system 10 that does not rely on transceiver 122 .
- a sensor module 102 having components such as those depicted in FIG. 6 may be physically coupled to robotic platform 100 during an athletic activity conducted by an individual 500 .
- Sensor module 102 may further monitor changes in the spatial orientation of the individual's 500 body or a piece of the individual's athletic equipment or article of footwear, or to determine a correlation between body or equipment movement data and a characteristic such as gait characteristic.
- sensor module 102 as described, may be used to monitor the surface of a track, for example, to follow chalk/paint line 302 .
- additional sensors 148 not coupled to robotic platform 100 e.g., other acceleration sensors, physiological sensors, etc.
- an additional sensor module 102 may be integrated within an existing piece of athletic activity monitoring equipment possibly having additional or different sensors such as, for example, a heart rate monitoring device, a pedometer, and accelerometer-based monitoring device, or other fitness monitoring device.
- performance parameters may include physical parameters and/or physiological parameters associated with the individual's 500 athletic activity. Physical parameters measured may include, but are not limited to, time, distance, speed, pace, pedal count, wheel rotation count, rotation generally, stride count, stride length, airtime, stride rate, altitude, strain, impact force, jump force, force generally, and jump height. Physiological parameters measured may include, but are not limited to, heart rate, respiration rate, blood oxygen level, blood lactate level, blood flow, hydration level, calories burned, or body temperature.
- sensor module 102 may incorporate other additional components.
- sensor module 102 may incorporate an angular momentum sensor 124 , a heart rate sensor 126 , a temperature sensor 128 , a position receiver 130 , a data port 132 , and a timer 134 operatively connected to one another to carry out the functionality of the sensor module 102 .
- one or more of these sensor module 102 components may be omitted, or one or more additional components may be added.
- the transceiver 122 may be a two-way communication transceiver 122 , while in other embodiments the transceiver 122 may be a one-way transmitter or a one-way receiver.
- the user interface 136 of the sensor module 102 may be used by the individual 500 to interact with the sensor module 102 .
- the user interface 136 may include one or more input buttons, switches, or keys, including virtual buttons, switches, or keys of a graphical user interface touch screen surface. The function of each of these buttons, switches, or keys may be determined based on an operating mode of the sensor module 102 .
- the user interface 136 may include a touch pad, scroll pad and/or touch screen.
- the user interface 136 may include capacitance switches.
- the user interface 136 may include voice-activated controls.
- the sensor module 102 may not include a user interface 136 .
- the sensor module 102 may be capable of communicating with other components of the robotic training system 10 which may themselves include user interfaces, for example, electronic device 400 .
- the angular momentum sensor 124 which may be, for example, a gyroscope, may be adapted to measure the angular momentum or orientation of the sensor module 102 . Accordingly, when the sensor module 102 is physically coupled to robotic platform 100 , the angular momentum sensor 124 may be capable of measuring the angular momentum or orientation of the object 104 . In one embodiment, the angular momentum sensor 124 may be a tri-axial gyroscope that is capable of measuring angular rotation about three orthogonal axes. In other embodiments one, two, three, or more separate gyroscopes may be used. In some embodiments, the angular momentum sensor 124 may be used to calibrate measurements made by one or more of the acceleration sensor 116 and the magnetic field sensor 146 . This may be particularly advantageous for an aerial robotic platform 100 .
- the heart rate sensor 125 may be adapted to measure an individual's 500 heart rate.
- the heart rate sensor 125 may be placed in contact with the individual's 500 skin, such as the skin of the individual's chest, and secured with a strap.
- the heart rate sensor 125 may be capable of reading the electrical activity the individual's 500 heart.
- the temperature sensor 128 may be, for example, a thermometer, a thermistor, or a thermocouple that measures changes in the temperature. In some embodiments, the temperature sensor 128 may primarily be used for calibration other sensors of the robotic training system 10 , for example, the acceleration sensor 116 and the magnetic field sensor 146 .
- the position receiver 130 may be an electronic satellite position receiver that is capable of determining its location (i.e., longitude, latitude, and altitude) using time signals transmitted along a line-of-sight by radio from satellite position system satellites.
- Known satellite position systems include the GPS system, the Galileo system, the BeiDou system, and the GLONASS system.
- the position receiver 130 may be an antenna that is capable of communicating with local or remote base stations or radio transmission transceivers such that the location of the sensor module 102 may be determined using radio signal triangulation or other similar principles.
- position receiver 130 data may allow the sensor module 102 to detect information that may be used to measure and/or calculate position waypoints, time, location, distance traveled, speed, pace, or altitude.
- the data port 132 may facilitate information transfer to and from the sensor module 102 and may be, for example, a USB port. In some exemplary embodiments, data port 132 can additionally or alternatively facilitate power transfer to a power source, in order to a charge power source.
- the timer 134 may be a clock that is capable of tracking absolute time and/or determining elapsed time. In some embodiments, the timer 134 may be used to timestamp certain data records, such that the time that certain data was measured or recorded may be determined and various timestamps of various pieces of data may be correlated with one another.
- the sensor module 102 may also include a button and/or a display.
- the button may serve as the user interface of the sensor module 102 .
- the button may be capable of turning the sensor module 102 on and off, toggling through various display options, or serving a variety of other functions.
- multiple buttons or no buttons may be provided.
- the display may be a relatively simple LED display that is capable of conveying the status or battery life of the sensor module 102 to an individual 500 with different color combinations or flashing patterns, for example.
- the display may be a more advanced display that is capable of displaying performance parameter information, feedback, or other information to the individual 500 , such as a segmented LCD display.
- no button or display may be provided.
- the sensor module 102 may include audio controls such as a speaker and/or microphone for audio communication with an individual 500 . These components may serve as the user interface of the sensor module 102 , and may be included in audio input system 120 . These audio controls may be capable of turning the sensor module 102 on and off, toggling through various display options, or serving a variety of other functions. In one embodiment, the audio controls may be capable of conveying the status or battery life of the sensor module 102 to an individual 500 . In another embodiment, the audio controls may be capable of outputting or receiving performance parameter information, feedback, or other information to and from the individual 500 . In one embodiment, the audio controls may be capable of accepting voice commands form the individual 500 . In another embodiment, the sensor module 102 may be capable of relaying audio information to an individual wirelessly via another device, such as a pair of headphones. Alternatively, audio controls may be provided.
- audio controls may be provided.
- Sensor module 102 may be processed in a variety of ways to yield useful information about the motion of an object 104 of interest during the activity.
- sensor module 102 data may be processed to monitor changes in the spatial orientation of the individual's 500 body or a piece of the individual's 500 athletic equipment.
- sensor module 102 data may be processed to by reference to a predetermined correlation between movement data and a characteristic stored in a data structure.
- sensor modules 102 are used to detect changes in an individual's direction of motion.
- Sensor modules 102 according to the present invention can also be worn by individuals and used to detect and/or track other motions such as, for example, motions associated with push-ups, pull-ups, weightlifting, diving, gymnastics, et cetera.
- electronic device 400 corresponds to a mobile computing device, mobile phone, desktop computer, tablet computer, dedicated electronic device, or the like.
- electronic device 400 may include a processor 402 , memory 406 , a user input control 408 , a display 410 , an audio unit 416 , a transceiver 404 , a cellular transceiver 414 , an optional satellite-based positioning system receiver 412 , a camera 418 , and a battery 420 .
- Processor 402 is a processor capable of implementing application programs or software platforms 1000 stored in memory 406 . Processor 402 is also capable of implementing digital signal processing algorithms. Processor 402 is coupled to memory 304 , user input control 408 , display 410 , audio unit 416 , transceiver 404 , and may include a cellular transceiver 414 .
- Memory 406 is used to store application program instructions (e.g., software platform 1000 ) and data.
- memory 406 stores programs, for example, used to implement all of the functionality of a typical electronic device.
- memory 406 includes both read only memory and random access memory.
- User input control 408 is used by an individual to interact with electronic device 400 .
- user input control 408 includes a variety of input buttons and/or keys. The function of each of these buttons and/or keys is typically determined based on an operating mode of electronic device 400 .
- user input control 408 includes a touch pad or scroll pad and/or touch screen buttons.
- Display 410 is used to display information to an individual.
- display 410 is a liquid crystal display.
- Camera 418 is a small digital camera used to take digital photos or video.
- camera 418 is a CCD camera.
- camera 418 is a CMOS camera.
- Audio unit 416 is used to process audio signals.
- voice signals picked up using a microphone are converted to digital signals so that they can be operated upon, for example, by processor 402 .
- Audio unit 416 also converts, for example, digital audio signals into amplified analog audio signals that can be used to drive one or more speakers.
- audio unit 416 implements signal processing algorithms such as those available from Dolby Laboratories, Inc., which enhance the quality of music.
- Transceiver 404 is a low-power transceiver used to communicate with other components of robotic training system 10 .
- transceiver 404 operates in an unlicensed frequency band such as 2.4 GHz.
- Transceiver 404 is coupled to an antenna 314 .
- the term transceiver means a combination of a transmitter and a receiver. In an embodiment, the transmitter and the receiver are integrated and form, for example, a part of an intergraded circuit.
- Cellular transceiver 414 may be used to send and receive, for example, voice cellular telephone signals. Transceiver 414 can also be used to exchange information with a computer network such as, for example, the Internet. Cellular transceiver 414 is coupled to an antenna 422 .
- the term cellular transceiver means a combination of a cellular transmitter and a cellular receiver. In an embodiment, the transmitter and the receiver are integrated together into a single device.
- cellular transceiver 414 is used to send data described herein to a location where it is analyzed, for example, by a professional trainer.
- the professional trainer can call or text message the individual and provide the individual substantially real-time feedback based on the data. If the individual wants to call the professional trainer, for example, during a workout, the individual can place a call to the professional trainer, for example, by tapping electronic device 400 to place a call to a stored telephone number. In one embodiment, tapping electronic device 400 sends a text message to the professional trainer requesting that the professional trainer call the individual.
- Battery 420 is used to provide power to operate the various components of electronic device 400 .
- battery 420 is recharged periodically using a power adapter that plugs into a typical household power outlet.
- Battery 420 can also be a non-rechargeable battery.
- electronic device 400 also includes an optional satellite-based positioning system (e.g., global positioning system (GPS) or Galileo system) receiver 412 .
- GPS global positioning system
- Galileo system Galileo system
- the satellite-based positioning system (e.g., GPS) receiver 412 is coupled to an antenna 424 .
- GPS receiver 412 enables the electronic device 400 , for example, to provide navigational instructions to a runner using the device. The directions for a running route can be downloaded to the electronic device prior to a run and stored in memory 406 .
- GPS receiver 412 can be used, in an embodiment, to track a route run by a runner.
- the route can be saved in memory 304 and viewed by the runner after the run.
- the route can also be shared with other runners, for example, by posting the route on a computer/web server for down-loading by other runners.
- GPS receiver 412 and information stored in the memory of electronic device 400 are used to provide navigational instructions, for example, to a runner.
- the runner can enter into electronic device 400 that he or she would like to run five kilometers, for example, and the electronic device will automatically select/map-out an appropriate route and provide navigation instructions to the runner during the run.
- the runner can specify both a start point and a stop point for the run. In an embodiment, only one point is specified, which serves as both the start point and the stop point.
- the start and stop points are the point at which the runner is standing (e.g., as determined by GPS receiver 412 ) when the runner enters, for example, that he or she would like to run five kilometers.
- electronic device 400 includes a radio.
- the radio can be an AM only radio, an FM only radio, or both an AM and FM radio.
- the radio is controlled using soft keys presented to an individual on display 410 .
- electronic device 400 includes optional sensors (not shown) for detecting selected weather related data such as, for example, temperature, humidity, ultra-violet radiation, and/or barometric pressure. This data can be used, for example, to determine how an individual's performance is effected by environmental factors.
- an electronic device does not include a display.
- information such as, for example, performance and/or feedback information is provided to an individual audibly during a workout, e.g., through sensor module 102 , or other audio feedback.
- the information can be display to the individual, for example, after the workout using a computer display once the information has been transferred to the computer.
- the information can be transferred to a second processing device such as, for example, a sports watch during the workout and displayed to the individual during the workout on the display of the second processing device.
- an electronic device 400 can be formed, for example, by attaching a dongle (e.g., a small hardware device that protects software) to a conventional phone, a music file player, a personal digital assistant, et cetera.
- the dongle includes, for example, downloadable software that implements some or all of the sport functions described herein.
- the software includes a sport user interface written in the Java programming language.
- the software includes drivers, for example, that enable the software to be used with any ultra low power Bluetooth communications protocol compatible device. Other embodiments are compatible with other communications protocol compatible devices.
- a electronic device is a dedicated device (rather than a device such as, for example, a phone, a music file player, or a personal digital assistant) that implements the robotic training functions as detailed herein.
- a dedicated device rather than a device such as, for example, a phone, a music file player, or a personal digital assistant
- the sensor module 102 may then determine that the movement of an individual 500 indicates the occurrence of a movement to track. In one embodiment, the determination that the movement of the individual 500 indicates the occurrence of a movement to track occurs when a threshold data value is met for a predetermined period of time. For example, the sensor module 102 may determine that a movement of the individual has resulted in a threshold acceleration occurring for a predetermined period of time. This may initiate movement of the robotic platform 100 .
- remote processing may be used to augment the processing discussed herein.
- the remote processing may enable a sensor module 102 to wirelessly transmit data to a remote computer for processing.
- Wireless communication with other elements of the robotic training system 10 is generally described above.
- the processing capabilities of the robotic training system 10 may be enhanced by shifting certain processing and analytical tasks to a remotely located computer, such as a server computer, with greater computational abilities and, in some embodiments, access to additional data, or other resources.
- the data received may be transmitted to the remote computer during the athletic activity. In another embodiment, the data received may be transmitted to the remote computer after the athletic activity has been completed.
- the physiological data received may be compared to data associated with the individual 500 for the present athletic activity and data associated with the individual 500 from a previous athletic activity. In some embodiments, the data may be compared to data received during a different individual's 500 athletic activity.
- embodiments of the present invention may advantageously enable the individual 500 (or their coach, teammate, a spectator, friends, competitors, etc.) to obtain this or other information about the motion of the individual's 500 body or the motion of a piece of the individual's 500 athletic equipment during or after the course of the athletic activity.
- While various embodiments of the present invention are described in the context of the running, the present invention is not so limited and may be applied in a variety of different sports or athletic activities including, for example, sports of soccer (i.e., football), basketball baseball, bowling, boxing, cricket, cycling, football (i.e., American football), golf, hockey, lacrosse, rowing, rugby, running, skateboarding, skiing, surfing, swimming, table tennis, tennis, or volleyball, or during training sessions related thereto.
- sports of soccer i.e., football
- basketball baseball i.e., bowling, boxing, cricket, cycling
- football i.e., American football
- golf i.e., American football
- hockey lacrosse
- rowing rugby
- running skateboarding
- skiing surfing
- sensor module 102 embodiments such as those described above may enable an individual 500 , to determine, for example, characteristics of a runner's motion.
- a sensor module 102 could be used to determine the speed, pace, distance traversed, locations traversed, or to discriminate between different surfaces (e.g., grass, street, or trail) and inclinations (e.g., uphill, flat, or downhill).
- the sensor module 102 may be mounted, for example, on a runner's torso, arm, hand, leg, foot, or head, or on or in their article of footwear, or integrated into robotic platform 100
- the sensor module 102 may be capable of compensating for inherent deficiencies that may be present for various types of sensor contained within or in communication with the sensor module 102 .
- Most real world sensors have limitations. For example, accelerometers, magnetometers, and gyroscopes may have accuracy issues, particularly when used at speeds of motion of the object 104 or under other conditions that differ from their initial calibration conditions.
- the sensor module 102 may communicate with other components of the robotic training system 10 via wired or wireless technologies. Communication between the sensor module 102 and other components of the robotic training system 10 may be desirable for a variety of reasons. For example, to the extent that the sensor module 102 records and stores athletic activity information, it may be useful to transmit this information to another electronic device for additional data processing, data visualization, sharing with others, comparison to previously recorded athletic activity information, or a variety of other purposes. As a further example, to the extent that the sensor module 102 has insufficient processing power, wide area network transmission capabilities, sensor capabilities, or other capabilities, these capabilities can be provided by other components of the robotic training system 10 . With this in mind, possible communications means are described briefly below.
- Wired communication between the sensor module 102 and an electronic device 400 may be achieved, for example, by placing the sensor module 102 —or a piece of athletic equipment including the sensor module 102 —in a docking unit that is attached to the electronic device 400 using a communications wire plugged into a communications port of the electronic device 400 .
- wired communication between the sensor module 102 and the electronic device 400 may be achieved, for example, by connecting a cable between the sensor module 102 —or a piece of athletic equipment including the sensor module 102 —and the computer or standalone device 600 .
- the data port 132 of the sensor module 102 and a communications port of the computer 600 may include USB ports.
- the cable connecting the sensor module 102 and the computer 600 may be a USB cable with suitable USB plugs including, but not limited to, USB-A or USB-B regular, mini, or micro plugs, or other suitable cable such as, for example, a FireWire, Ethernet or Thunderbolt cable.
- suitable USB plugs including, but not limited to, USB-A or USB-B regular, mini, or micro plugs, or other suitable cable such as, for example, a FireWire, Ethernet or Thunderbolt cable.
- such cables could be used to facilitate power transfer to a power source of the sensor module 102 , in order to charge the power source.
- the power source may be recharged by inductive charging, or by using a docking station with a charging base.
- Wired connection to an electronic device 400 may be useful, for example, to upload athletic activity information from the sensor module 102 to the electronic device 400 , or to download application software updates or settings from the electronic device 400 to the sensor module 102 .
- Wireless communication between the sensor module 102 —or a piece of athletic equipment including the sensor module 102 —and the electronic device 400 may be achieved, for example, by way of a wireless wide area network (such as, for example, the Internet), a wireless local area network, or a wireless personal area network.
- a wireless wide area network such as, for example, the Internet
- a wireless local area network such as, for example, the Internet
- a wireless personal area network such as, for example, the Internet
- the sensor module 102 may communicate with a wireless wide area network communications system such as that employed by mobile telephones.
- a wireless wide area network communication system may include a plurality of geographically distributed communication towers and base station systems.
- Communication towers may include one or more antennae supporting long-range two-way radio frequency communication wireless devices, such as sensor module 102 .
- the radio frequency communication between antennae and the sensor module 102 may utilize radio frequency signals conforming to any known or future developed wireless protocol, for example, CDMA, GSM, EDGE, 3G, 4G, IEEE 802.x (e.g., IEEE 802.16 (WiMAX)), etc.
- the information transmitted over-the-air by the base station systems and the cellular communication towers to the sensor module 102 may be further transmitted to or received from one or more additional circuit-switched or packet-switched communication networks, including, for example, the Internet.
- sensor module 102 may communicate with an electronic device, such as a smart phone, that is also carried by the individual 500 during the athletic activity.
- an electronic device such as a smart phone
- the electronic device 400 may take the form of a mobile phone and may include at least a processor, a memory, user input controls, a positioning system receiver, a wireless wide area network (WWAN) transceiver, a visual display, and an audio unit.
- a visual display in the form of a LCD screen, and user input controls in the form of a physical keyboard and a scroll ball may be present.
- the memory of the electronic device 400 may be adapted to store application programs, software platforms or modules, used to implement aspects of the functionality of the robotic training system 10 described herein.
- application programs, software platforms or modules used to implement aspects of the functionality of the robotic training system 10 described herein.
- those of skill in the art will understand that all or part of the software may be stored on the server 604 and accessed over the network 602 and run remotely as a mobile web application, or stored locally in robotic platform 100 , having a memory.
- robotic training system 10 may include a number of different software modules capable of providing training support or other robotic platform 100 interaction to individuals 500 .
- Each module may support one or more graphical user interfaces (“GUIs”) capable of being presented to an individual 500 using the system 10 .
- GUIs graphical user interfaces
- a GUI may offer, for example, graphical elements, visual indicators, and/or text to represent information and actions available to the individual 500 .
- the individual 500 may use a physical input device, such as keyboard or scroll ball to interact with the GUI of the system 10 , for example, on electronic device 400 .
- the individual 500 may use a touch screen to interact directly with what is displayed.
- touch screens such as, for example, resistive or capacitive touch screens, may be employed.
- the software configuration of software stored on an electronic device 400 may include a device operating system, which may be one of the commercially available mobile phone operating systems such as, for example, BlackBerry OS, iPhone OS, Windows Mobile, Symbian, LINUX, WebOS, or Android.
- the device operating system may also have an associated application programming interface through which middleware and application programs may access the services of the operating system.
- the various modules of the system 10 of the present invention may support GUIs through which an individual 500 can interact with the system 10 using the electronic device 400 just prior to and/or during an activity.
- the GUIs may be supported by a mobile device application being run on the electronic device 400 .
- the GUIs may appear as web pages provided by the server 604 via a website that may be accessible to the individual 500 over the network 602 using a web browser on their electronic device 400 .
- the GUIs may be considered to be part of the methods or systems of the present invention.
- the robotic training system 10 may be sold as a package, including a robotic platform 100 , an electronic device 400 , sensor modules 102 for multiple individuals 500 (e.g. runners), and a charger.
- Robotic training system 10 may recognize and record repeat usage of the robotic training system 10 over time, number of times various individuals store their data into a profile and update that data.
- the robotic training system 10 may also be able to integrate with various social media platforms, allowing individuals to share with their social network data regarding their gait characteristics, their usage of the robotic training system 10 .
- program products, methods, and systems for providing robotic training services of the present invention can include any software application executed by one or more electronic devices 400 .
- An electronic device 400 can be any type of computing device having one or more processors.
- the electronic device 400 can be a workstation, mobile device (e.g., a mobile phone, personal digital assistant, tablet computer, or laptop), computer, server, compute cluster, server farm, game console, set-top box, kiosk, embedded system, a gym machine, a retail system or retail enhancement system or other device having at least one processor and memory.
- Embodiments of the present invention may be software executed by a processor, firmware, hardware or any combination thereof in a computing device.
- Computer program medium and “computer-usable medium” may be used to generally refer to media such as a removable storage unit or a hard disk installed in hard disk drive.
- Computer program medium and computer-usable medium may also refer to memories, such as a main memory or a secondary memory, which can be memory semiconductors (e.g., DRAMs, etc.).
- main memory or a secondary memory, which can be memory semiconductors (e.g., DRAMs, etc.).
- Software platform may include or accept computer programs (also called computer control logic, programming data, etc.), which may be stored on main memory and/or secondary memory. Computer programs may also be received via a communications interface. Such computer programs, when executed, may enable computer systems of the present invention to implement embodiments described herein. Where embodiments are implemented using software, the software can be stored on a computer program product and loaded into a computer system using, for example, a removable storage drive, an interface, a hard drive, and/or communications interface.
- the computer programs when executed, can enable one or more processors to implement processes described above, such as the steps in the methods illustrated by the figures.
- the one or more processors can be part of a computing device incorporated in a clustered computing environment or server farm. Further, in some embodiments, the computing process performed by the clustered computing environment may be carried out across multiple processors located at the same or different locations.
- Software of the present invention may be stored on any computer-usable medium. Such software, when executed in one or more data processing device, causes the data processing device to operate as described herein. Embodiments of the invention employ any computer-usable or -readable medium, known now or in the future.
- Examples of computer-usable mediums include, but are not limited to, primary storage devices (e.g., any type of random access or read only memory), secondary storage devices (e.g., hard drives, floppy disks, CD ROMS, ZIP disks, tapes, magnetic storage devices, optical storage devices, MEMS, nanotechnological storage devices, memory cards or other removable storage devices, etc.), and communication mediums (e.g., wired and wireless communications networks, local area networks, wide area networks, intranets, etc.).
- primary storage devices e.g., any type of random access or read only memory
- secondary storage devices e.g., hard drives, floppy disks, CD ROMS, ZIP disks, tapes
- magnetic storage devices e.g., magnetic tapes, magnetic storage devices, optical storage devices, MEMS, nanotechnological storage devices, memory cards or other removable storage devices, etc.
- communication mediums e.g., wired and wireless communications networks, local area networks, wide area networks, intranets, etc.
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Physical Education & Sports Medicine (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biophysics (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Aviation & Aerospace Engineering (AREA)
- Multimedia (AREA)
- Software Systems (AREA)
- Orthopedic Medicine & Surgery (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Public Health (AREA)
- Medical Informatics (AREA)
- Primary Health Care (AREA)
- Epidemiology (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Medical Treatment And Welfare Office Work (AREA)
- Rehabilitation Tools (AREA)
- Toys (AREA)
Abstract
Description
- This application is a continuation of U.S. patent application Ser. No. 15/277,657, filed Sep. 27, 2016, which is incorporated herein in its entirety by reference thereto.
- Embodiments of the present invention generally relate to systems and methods for using robotics to assist an individual in improving a workout. More particularly, robotic systems and methods may be used as coaching tools, guides, and/or pace setting systems.
- Athletic activity is important to maintaining a healthy lifestyle and is a source of entertainment for many people.
- Individuals engaged in athletic activities have sought aids to help with pacing and coaching during running workouts. Typical methods include running on circular tracks of known lengths and employing a stop watch to record intervals or calculate speed. When a running event, such as a race, requires assistance to set a particular pace, other runners may be enlisted to aid in the effort and maintain a consistent pace. In a race environment these runners may be called “rabbits” and are often paid to run only a portion of the race to ensure a fast opening pace.
- In more recent years runners have employed additional tools in an effort to assist in tracking and coaching workouts. For example, GPS and accelerometer based devices may be used to provide speed and distance information. Fitness monitoring devices have also been developed that are capable of recording information about an individual's performance during an athletic activity using sensors, and in some cases providing feedback about the individual's performance. Some fitness monitoring devices employ sensors attached to the individual's body, while other fitness monitoring devices rely on sensors attached to a piece of athletic equipment. Such sensors may be capable of measuring various physical and/or physiological parameters associated with the individual's physical activity.
- An individual engaged in an athletic activity—or an interested observer such as a coach or fan—may desire to receive information about the athletic activity, including information about the individual's performance. But with respect to providing this information, existing athletic/fitness activity monitoring, training, and coaching systems suffer from a number of drawbacks. Many existing systems are limited in the amount of feedback or coaching that they can give. Other systems may provide coaching feedback during the activity, but in a way that distracts that individual or interested observer from focusing on the ongoing athletic activity itself And many existing systems do not provide physical targets for individuals to react to, or an adequate substitute for a training partner. These systems are not suitable for monitoring in many real world athletic competitive or training sessions. Finally, existing athletic activity monitoring, training, and coaching systems often fail to provide the individual or interested observer with quick, accurate, insightful information that would enable them to easily compare past performances, develop strategies for improving future performances, or visualize performances.
- What is needed are athletic activity training, and coaching, systems and methods having improved capabilities over existing systems, thus offering individuals engaged in athletic activities and other interested observers better tools to improve their performance through coaching feedback. At least some of the embodiments of the present invention satisfy the above needs and provide further related advantages as will be made apparent by the description that follows.
- Embodiments of the present invention relate to a robotic training system, for example, an athletic training system for assisting an individual during an athletic activity in an environment. The system may include a mobile robotic platform, a sensor module including an array of optical sensors coupled to the mobile robotic platform and configured to obtain sensor data from the environment, a drive system configured to propel the mobile robotic platform, a steering system configured to steer the mobile robotic platform, and a processor. The processor may be configured to receive the sensor data from the sensor module, characterize the sensor data into one of edge data, color data, saturation data, threshold data, or keypoint data, and to control one of the drive system and the steering system to follow a path based on the characterized data. The sensor data comprises data related to variation of a surface of the environment.
- Embodiments of the present invention also relate to a robotic training system, for example, an athletic training system for assisting an individual during an athletic activity in an environment. The system may include a mobile robotic platform, a sensor module including an array of sensors coupled to the mobile robotic platform and configured to obtain data from the environment, a drive system configured to propel the mobile robotic platform, a steering system configured to steer the mobile robotic platform, and a processor. The processor may be configured to receive the data from the sensor module and to control one of the drive system and the steering system to follow a path based on the data. The data may include data related to variation of a surface of the environment.
- Embodiments of the present invention also relate to a method of training an individual, for example, assisting an individual during an athletic activity in an environment using a robotic athletic training system. The method may include controlling the robotic athletic training system with a processor of the robotic athletic training system to move the robotic athletic training system at a velocity, receiving data related to a surface of the environment over which the robotic athletic training system moves and on which the individual conducts their athletic activity with a vision system of the robotic athletic training system, comparing baseline possible surface characteristic data to the received surface data with the processor of the robotic athletic training system, and adjusting a travel direction of the robotic athletic training system in response to the comparison.
- Additional features of embodiments of the invention will be set forth in the description that follows, and in part will be apparent from the description, or may be learned by practice of the invention. Both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
- The accompanying figures, which are incorporated herein, form part of the specification and illustrate embodiments of the present invention. Together with the description, the figures further serve to explain the principles of and to enable a person skilled in the relevant arts to make and use the invention.
-
FIG. 1 is an illustration of an individual using a robotic training system according to an embodiment of the present invention. -
FIGS. 2-3 are illustrations of selected robotic training systems according to embodiments of the present invention. -
FIG. 4 is an enlarged view of a sensor array according to an embodiment of the present invention. -
FIG. 5 is a diagram of a sensor module interacting with one of an electronic device, a standalone device, a network, and a server according to an embodiment of the present invention. -
FIG. 6 is a conceptual diagram of a software platform and software modules, according to an embodiment of the present invention. -
FIG. 7 is a diagram of a sensor module according to an embodiment of the present invention. -
FIG. 8 is a diagram of an electronic device according to an embodiment of the present invention. -
FIG. 9 is a flowchart of a method of assisting an individual during an athletic activity in an environment using a robotic athletic training system according to an embodiment of the present invention. -
FIG. 10 is a flowchart of a method of assisting an individual during an athletic activity in an environment using a robotic athletic training system according to an embodiment of the present invention -
FIG. 11 is a flowchart of a method of assisting an individual during an athletic activity in an environment using a robotic athletic training system according to an embodiment of the present invention - The present invention will now be described in detail with reference to embodiments thereof as illustrated in the accompanying drawings. References to “one embodiment”, “an embodiment”, “an example embodiment”, “some embodiments”, etc., indicate that the embodiment described may include a particular feature, structure, or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is submitted that it is within the knowledge of one skilled in the art to affect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described.
- The term “invention” or “present invention” as used herein is a non-limiting term and is not intended to refer to any single embodiment of the particular invention but encompasses all possible embodiments as described in the application.
- Various aspects of the present invention, or any parts or functions thereof, may be implemented using hardware, software, firmware, non-transitory tangible computer readable or computer usable storage media having instructions stored thereon, or a combination thereof, and may be implemented in one or more computer systems or other processing systems.
- The methods and systems discussed above are further described below. The figures below may apply to both the method and system embodiments of the invention.
- In general, in some embodiments, systems and methods are provided to enhance athletic training. The robotic platforms described herein may be autonomous or semi-autonomous small-scale vehicles. The systems and methods may, for example, follow the lanes of a running track, and may be used as a virtual coach by providing audio, visual display and haptic feedback to runners and can instruct them to speed up or slow down to meet a specific goal of the run. Additionally, they may be used to set pacing for a runner, coach an individual through different workout intervals, collect athletic data, and record video for gait and/or technique analysis.
- Advantageously, as opposed to audio or video simulations, the robotic training systems and methods may give runners a tangible target to focus their workouts. This may advantageously improve the quality of feedback, for example, by having the robotic training system gradually accelerate/decelerate. This is in contrast to coaching being given as discrete, separate steps, in order to avoid over instructing the individual (e.g., change pace to 8 minutes per mile, prepare to run a 30 second interval at maximum speed, etc.). Additionally, rather than telling the individual to accelerate to a certain pace or zone, the robotic training system may simply show them the pace through its motion. In some embodiments, robotic training system may adjust to the individual's ability (e.g., if the individual can't keep up the robotic training system may adjust the pace or direction). Advantageously, the individual engaged in athletic activity is able to keep their eyes focused on the robotic training system in front of them instead having to look down at a wrist band, phone, etc., which could dangerously divert their eyes from the route in front of them. Additionally, being able to focus generally in front of the individual, rather than raising an arm or looking down, avoids introducing inefficient body positioning or form into the athletic activity.
- In addition, the robotic training system may provide for more granular training/coaching. For example, the robotic training system may change velocity at a more frequent interval, e.g., by speeding up or slowing down gradually and having an individual follow the pace. Disadvantageously, other coaching methods attempting to verbally instruct an individual through granular or widely varying velocity risk over-coaching and overwhelming the individual.
- Substantially real time feedback may also be provided by the robotic training system. GPS and accelerometer systems may include lags in reporting changes of speed. In contrast, the robotic training system embodiments of the present invention may instead utilize on board speed sensors (e.g., rotational speed sensors) and may use, for example, visual sensors focused on the individual in combination with the robotic training system's speed to adjust the operation of the system.
- As shown in
FIGS. 1-4 , in some embodiments,robotic training system 10 may include a mobilerobotic platform 100, asensor module 102, adrive system 104 configured to propel mobilerobotic platform 100, asteering system 106 configured to steer the mobilerobotic platform 100, and aprocessor 110.Processor 110 may be configured to receive data (e.g., sensor data) from the sensor module and control thedrive system 104 orsteering system 106 to follow a predetermined path based on the data received from thesensor module 102.Robotic platform 100 may include a frame, housing, etc., that may support or house various components ofsystem 10. - In some embodiments, a predetermined path may be, for example, an
athletic track 300, or a paint orchalk line 302 denoting a lane ontrack 300, as shown inFIGS. 2 and 3 . In some embodiments,sensor module 102 may be associated with mobilerobotic platform 100 and configured to obtain data from an environment. - In some embodiments,
sensor module 102 may include an array ofsensors 108, as shown, for example, inFIG. 4 . In some embodiments, thesensors 108 may obtain data related to variation of a surface, such as an athletic track. In some embodiments,sensors 108 may be positioned in a generally linear arrangement, such that sensors are parallel to one another and the direction of a linear axis about which the sensors are aligned extends is generally perpendicular to the sensed portion of the paint/chalk line 302 during use. In other embodiments, the sensor array may be arranged in a “V” formation as with a group of migratory birds, or in a curved arrangement. In some embodiments, the sensors of the array may be arranged in an offset fashion where they are not parallel to one another. - The sensed surface variation data may be optical data, for example, data related to the relative position or composition of the paint or chalk line denoting a line on
track 300. In some embodiments, the sensed data (e.g., optical data) may be characterized and/or quantified to identify certain features, such as edge data, color data, saturation data, threshold data, keypoint data, and the like. In some embodiments, these features may be configured to control the drive or steeringsystems 104/106. In some embodiments, the sensors transmit data toprocessor 110, with the processor being further configured to adjust thedrive system 104 orsteering system 106 based on the data. For example, in some embodiments the sensor array may include an array of sensors (e.g., infrared or “IR” sensors, photo-sensitive systems, CCD, CMOS, etc.), and transmit data related to which sensor is positioned over the paint orchalk line 302 denoting a lane on atrack 300. Paint of chalk line composition, line edge relative angles, or other features may be detected. Speed or direction adjustments of thedrive system 104 orsteering system 106 may vary according to how many sensors sense the presence of the line, frequency of the frame rate, resolution of the captured data, or the relative angle of the edge of the line with respect to one or more sensors, for example. In some embodiments, speed or direction adjustments may vary according to the location of the sensor along the array that senses the presence of the line. In some embodiments, speed or direction adjustments may vary according to a predetermined threshold of time a particular sensor senses the presence of the line. In some embodiments, sensor position, time, or number of sensors sensing the presence of the line may vary the speed and/or direction. - Existing athletic training systems lacking tangible targets—or systems that rely on tangible targets that unable to accurately sense track surface conditions and respond accordingly—disadvantageously may not provide a suitable level of natural, smooth feedback and coaching to the individual. In contrast, the
robotic training system 10 of the present invention employing embodiments ofsensor module 102 may provide natural, smooth feedback and coaching based on real world track surface conditions. - In some embodiments drive
system 104 and/orsteering system 106 may be, for example a wheeled system. In some embodiments, these systems may be a track system, an aerial propulsion system, a magnetic propulsion system, a rail system, a robotic leg system, or other suitable drive system. In some embodiments, thedrive system 104 andsteering system 106 may be autonomous, or semi-autonomous. Autonomous or semi-autonomous systems may have advantages over known systems that rely on significant user or coach input or control, which may be more cumbersome to control and may limit their use. In some embodiments,robotic platform 100 may include a frame configured to support athletic equipment or supplies (e.g., used as a type of robotic “pack mule”). For example, some embodiments may be specifically configured to carry and/or dispense water, food, or first aid equipment. - In some embodiments,
additional sensor modules 102 may be employed, either physically integrated withrobotic platform 100 or separate from robotic platform. In some embodiments,sensor modules 102 may includeadditional sensors 148, for example, physiological sensors or the like. - In some embodiments,
system 10 may be partially or wholly solar powered, which may advantageously extend the range of the device of limit the need for frequent charging or battery replacement. - In some embodiments,
system 10 may further include awireless transceiver 112 in communication with anelectronic device 400 associated with an individual 500. In an embodiment, theelectronic device 400 may be, for example, a smart phone, a smart watch, a heads-up-display device, other smart apparel, a tablet, or any other type of suitable mobile computing device. In some embodiments,transceiver 112 may receive data (e.g., electronic device data, or input data) fromelectronic device 400, transmitting that data toprocessor 110. In some embodiments,processor 110 adjusts thedrive system 104 orsteering system 106 based on the data received fromelectronic device 400. In some embodiments, thetransceiver 112 receives data including programmed instructions to control the drive and steeringsystems 104/106 according to a workout program. In this way, embodiments including a communication with anelectronic device 400 may advantageously allow for a higher level of accuracy or customization in the performance of therobotic training system 10. In some embodiments,electronic device 400 may function as asensor module 102. - In some embodiments, these programs could include instructions to provide coaching feedback to
individual 500 during a workout, for example, a training run. In some embodiments, individual 500 may receive coaching instruction, for example, or encouragement. In some embodiments these programs may include a simulated race, whererobotic platform 100 may be programmed with prior race data such that it moves according to a race pace and individual 500 may attempt to beat the platform. In some embodiments, these programs may include world record data, such thatindividuals 500 may “compete” against current world records.Transceiver 112 may be integral withrobotic platform 100, or may be a separate unit. Additional details of the software platform and modules related to such programs along with programs and functions of the components are further discussed herein. -
Transceiver 112 may allowsensor module 102 to communicate, for example, with other locally or remotely locatedrobotic platforms 100, or otherstandalone devices 600, vianetwork 602, orserver 604, for example, as shown inFIG. 5 . Communication between these components may be one way communication or two way communication. - In some embodiments,
system 10 may include a user interface configured to receive input data and transmit the data toprocessor 110 which may adjust the drive or steeringsystems 104/106 based on the input data. In some embodiments, the user interface may be displayed onelectronic device 400, for example, or may be integrated directly intorobotic platform 100. - As shown in
FIGS. 1-3 , for example, in some embodiments,system 10 may include avideo camera 114.Video camera 114 may be configured to record an individual during training, for example. In some embodiments,video camera 114 may transmit video data toprocessor 110. In some embodiments,processor 110 is configured to analyze physiological characteristics of the individual (e.g., analyze gait or foot strike characteristics, analyze other running form characteristics, recognize onset of fatigue, recognize perspiration levels, etc.). In some embodiments,video camera 114 may be configured to record the surface an individual is running on, for example, or capture video of environmental surroundings. In some embodiments,processor 110 may analyze, for example, gait characteristics such as foot strike type (e.g. heel, midfoot, forefoot, etc.), rate of pronation or supination, and degree of pronation and supination. In other embodiments,video camera 114 may be configured to record the path ahead of the individual during training so as to record a first person-style view of the route traversed by therobotic training system 10 and the individual. In other embodiments, thevideo camera 114 may pan around the environment to record video of competitors, spectators, or other items of interest. The panning may be autonomous or controlled by the individual or a third party such as a coach. - In some embodiments, additional
robotic platforms 100 may be able to interact with one another based on sensor feedback. For example, in some embodiments, a land basedrobotic platform 100 may carry out training feedback functions to the individual 500, while an aerial basedrobotic platform 100 may includevideo camera 114 and carry out aforementioned video functions, based upon position of the land basedrobotic platform 100 or individual 500, for example. - In some embodiments,
system 10 may include anaudio feedback system 116. In some embodiments,audio feedback system 116 is configured to provide information about a workout to an individual during the workout. In some embodiments,audio feedback system 116 may provide audio coaching, for example to alert individual 500 to a change in the workout, to accelerate/decelerate,alert individual 500 of other individuals approaching, or to alert of other robotic platforms 100 (e.g., to urge slower runners to move to the right). Combined audio and visual feedback may enhance the coaching of an individual, as it more closely replicates one-on-one coaching between individuals, rather than an individual following only audio prompts. In some embodiments,audio feedback system 116 may be configured to allow, for example, one-on-one coaching feedback from an individual's coach, in addition to feedback from thesystem 10. - In some embodiments,
system 10 may include adisplay system 118.Display system 118 may be, for example, a projector, display screen, laser system, holographic display, paint/chalk display system, or the like. In some embodiments,display system 118 is configured to provide information about a workout to an individual during the workout or other information or visual cues (e.g., display image on track or body ofrobotic platform 100, display a line to follow, follow distance, or workout details). In some embodiments,display system 118 may display visual cues, such as time remaining, current speed, number of laps, etc. In some embodiments,display system 118 may allow for video calling other individuals (e.g., friends or competitors). In some embodiments,display system 118 may include a heads up display (HUD), for example, on a helmet, or electronic eyeglasses. In some embodiments, thedisplay system 118 may project information or images on the surface of the track ahead of the individual and/or ahead of therobotic training system 10, which may advantageously allow the individual to visual receive information without having to divert their field of view of otherwise break their form to view a display on a smartphone, smart watch, or other portable display. In some embodiments, a display mounted on therobotic training system 10 itself may provide a similar benefit. - In some embodiments,
system 10 may include anaudio input system 120.Audio input system 120 may be configured to accept audio data and transmit the data to the processor to controlsystem 10. In some embodiments,audio input system 120 may function as a voice control/recognition system, and accept information such asindividual 500 speaking commands to speed up or slow down, provide navigation, place an emergency call, place a call to a coach or trainer, place a video call to other individuals (e.g., friends or competitors), or post an update on a social media platform. - Some embodiments are directed to a method of training including initiating programming data such that a robotic training system moves at a predetermined velocity, wherein the robotic training system includes a vision system configured to receive data related to a surface, receiving data related to a surface, comparing a baseline data of a desired surface to the received data, and adjusting a travel direction of the robotic system in response to the comparison. In some embodiments, the data received related to a surface is optical data indicating the position of a line on a track. Existing systems often do not account for surface variation (e.g., if an individual begins running on a track but transitions to a grass field). In contrast, embodiments of the present invention may provide variation in coaching feedback depending upon the surface upon which the athletic activity is performed (e.g., a field, artificial turf, track, sidewalk, etc.).
- Turning to an
exemplary method 2000 shown inFIG. 9 , atstep 2002, the method may include controlling a robotic athletic training system with a processor of the robotic athletic training system to move the robotic athletic training system at a velocity. The method may then include receiving data related to a surface of the environment over which the robotic athletic training system moves and on which the individual conducts their athletic activity with a vision system of the robotic athletic training system atstep 2004, comparing baseline possible surface characteristic data to the received data related to the surface of the environment with the processor of the robotic athletic training system atstep 2006, and adjusting a travel direction of the robotic athletic training system in response to the comparison atstep 2008. -
Exemplary method 2100 shown atFIG. 10 may include each of the steps shown inmethod 2000. Further, the method may include the robotic training system providing coaching feedback to the individual during the athletic activity atstep 2010. -
Exemplary method 2200 shown atFIG. 11 may include each of the steps shown inmethods step 2012, comparing baseline possible surface characteristic data to the received data related to the surface of the environment with the processor of the robotic athletic training system atstep 2014, and adjusting the velocity of the robotic athletic training system in response to the physiological data comparison at step 2016. Additionally, each of the methods may include an optional feedback loop from either step back to any previous step. - It should be understood that the order of the operations listed above is exemplary. The order of the operations may be rearranged and some operations may be omitted.
- In some embodiments, the method further includes receiving physiological sensor data at a
robotic training system 10 about an individual 500 from a sensor module associated with the individual 500 during an athletic activity engaged in by the individual. In some embodiments, the method includes comparing the physiological sensor data received to baseline physiological data using a processor (for example processor 110), and adjusting the programming data based on the comparison such that the velocity (or direction) of the robotic training system is adjusted. In some embodiments, the method further includes receiving personal information about the individual prior to receiving the physiological data. In some embodiments the personal information includes one of prior injury information, height, weight, gender, an athletic goal, intended athletic environment, intended athletic duration, intended workout intensity. - The system or method may include receiving data about the individual from a sensor module associated with the individual during a first athletic activity engaged in by the individual. The method may also include receiving data about the individual from the sensor module associated with the individual during a second athletic activity engaged in by the individual, and determining a second characteristic based on the data related to the second athletic activity. The method may also include comparing the data received during the first/second athletic activities; and providing a recommendation about a workout.
- In some embodiments, the first and second data received may include physiological characteristics (e.g. respiratory or cardiac data). In some embodiments, the method may determine whether a characteristic of the second data represents an improvement over the first data. In some embodiments, the method may include receiving data (e.g., motion data, physiological data, etc.) via local wired or wireless connection, or via a wide area network. In some embodiments, the method may include monitoring the motion of an individual in substantially real-time during an athletic activity. In some embodiments, a
sensor module 102 may be provided and configured to obtain data relating to a physiological parameter of the individual 500 during an athletic activity. - The systems and methods may be effected through software platform 1000 (which may be included in system 10), containing software modules, as shown in
FIG. 6 , for example. In some embodiments, fewer modules may be included, or additional modules may be included. In some embodiments, modules may be removed or added, for example through a network connection. Programming data may includesoftware platform 1000, for example, as shown inFIG. 6 , and include various modules. Each of the components insensor module 102, for example, orelectronic device 400, may feed the modules data that the modules use to formulate a response. In some embodiments programming data includes simulated race data such that the robotic training system moves at a race pace. In some embodiments, the programming data includes feedback data such that the robotic training system provides coaching feedback to an individual during a workout. In other embodiments, the systems and methods may be effected throughsoftware platform 1000 in anelectronic device 400 in addition to or instead of insystem 10. - As shown in
FIG. 6 ,software platform 1000 may includehighlight reel module 1100, including programming to capture video data fromvideo camera 114 and compose a video montage or highlight reel. - In some embodiments,
software platform 1000 may include astatistics module 1102.Statistics module 1102 may be programmed to display relevant statistics regarding the workout such as distance, time, pace, heart rate, physiological data, etc. In some embodiments,statistics module 1102 may function as a workout coach, by providing instructions or feedback throughdisplay system 118 oraudio feedback system 116. In some embodiments,statistics module 1102 may include a lap counter, for example, in order allow an individual to run accurate distances in any lane. - In some embodiments,
software platform 1000 may include aproximity awareness module 1104.Proximity awareness module 1104 may use additional sensor data (or data from sensor module 102) to guiderobotic platform 100 around obstacles, for example, or to maintain a safe distance from an individual 500 usingsystem 10. In some embodiments,proximity awareness module 1104 may notify an individual running of other runners near the individual, or aware of other competitor's status in a race event, for example. In some embodiments,proximity awareness module 1104 may optimize a route, for example, accounting for particular surfaces or geography, or may analyze a route taken by an individual (e.g., how an individual approaches corners, etc.). In some embodiments,proximity awareness module 1104 may communicate with otherrobotic platforms 100. In some embodiments,proximity awareness module 1104 may include, for example a radar system or ultrasonic system with radar sensors or ultrasonic sensors. - In some embodiments,
software platform 1000 may include astrategy module 1106.Strategy module 1106 may include instructions to coach an individual for particular conditions (e.g., coaching a runner to slow down while traveling uphill or into headwind and accelerate for downhill or tailwind).Strategy module 1106 may use data fromsensor module 102, for example vision sensor data, or additional sensor data, such as proximity sensor data. In some embodiments, strategy module may coach the individual to adjust their performance, for example adjusting their gait, stride, or posture for different terrain (e.g., going uphill or downhill). In some embodiments, data fromvideo camera 114 may be used as an input tostrategy module 1106 and coaching may be dependent upon video data analysis (e.g., fatigue or gait analysis). - In some embodiments,
software platform 1000 may include asafety module 1108. Safety module may, for example, coach an individual running to slow down when approaching uneven or dangerous surface conditions, or when physiological data reaches unsafe levels. In some embodiments, safety module may control driving orsteering system 104/106 to avoid obstacles or brake if communication or other signals are lost or are abnormal. In some embodiments, safety module may leave individual 500 and dial an emergency number if cellular coverage is unavailable. In some embodiments,safety module 1108 may utilize data fromsensor module 102 to maintain a predetermined position aroundindividual 500, for example ahead, behind, or besideindividual 500. In some embodiments,safety module 1108 calculates an acceptable radius fromindividual 500 and adjusts based upon the path taken byindividual 500. In some embodiments,safety module 1108 may for example, pick up litter after a race along a race path. - In some embodiments,
software platform 1000 may include a Fuel/Hydrate module 1110. Fuel/Hydrate module 1110 may utilize workout data, data fromsensor module 102, etc., to coach individual 500 on proper food and water intake during a workout. In some embodiments,robotic platform 1000 may include on board fluid and food to provide toindividual 500. In some embodiments, Fuel/Hydrate module 1110 may include a mist function, for example, if it is hot outside, or ifindividual 500 reaches a predetermined temperature as measured bysensor module 102. - In some embodiments,
software platform 1000 includesCharge module 1112.Charge module 1112 may provide an energy source for long races to charge a phone, for example aselectronic device 400.Charge module 1112 may activate, for example, Bluetooth charging whenelectronic device 400 charge level falls below a predetermined threshold. In this regard,charge module 1112 may provide additional energy to allow for longer training or running sessions ofindividual 500. - In some embodiments,
software platform 1000 includes aGuide module 1114.Guide module 1114 may utilizeaudio feedback system 116, for example, to serve as a guide for ablind individual 500. In some embodiments,guide module 1114 may travel ahead of individual 500 and “scout” the area, for example. In some embodiments,guide module 1114 may include a light, for example, an LED light that may be configured to turn on if the environment sensed bysensor module 102 drops below a predetermined light level threshold. - In some embodiments,
software platform 1000 includes aBabysitter module 1116.Babysitter module 1116 may configure robotic platform such that it autonomously “walks” an individual's 500 baby around a predetermined path (e.g., around the block). In some embodiments, babysitter module may “walk” an individual's canine companion. In some embodiments,babysitter module 1116 may stream video data fromvideo camera 114 toelectronic device 400 for monitoring byindividual 500. - In some embodiments,
software platform 1000 includes alight module 1118 that may activate a light onrobotic platform 100 to illuminate a path for individual to follow. - In some embodiments,
software platform 1000 includesvision module 1120.Vision module 1120 may, for example, utilizevideo camera 114, orsensor array 108, oradditional sensors 148 to achieve computer vision forsystem 10. In some embodiments,vision module 1120 may be a sub-module of other modules. - In some embodiments,
software platform 1000 may include a Fetchmodule 1124. Fetchmodule 1124 may communicate withsensor module 102, and be configured to find and retrieve athletic equipment, for example, soccer balls, or golf balls. - In some embodiments,
software platform 1000 includes aweather module 1126.Weather module 1126 may communicate withsensor module 102, for example, and record/report wind speed, temperature, humidity, etc. This data may be fed back into other modules, for example, to adjust workouts of individual based on weather information. - In some embodiments,
software platform 1000 includesreferee module 1128.Referee module 1128 may communicate with athletic equipment, for example soccer balls and the like. In someembodiments sensor module 102 may determine whether a soccer ball is out of bounds for example, or travels past a goal line. - In some embodiments,
software platform 1000 includesskills module 1130.Skills module 1130 may configurerobotic platform 100 to perform athletic maneuvers, for example, “kicking” soccer balls for goalie/player training. In some embodiments,robotic platform 100 may be configured to travel in random or pseudorandom patterns, and have individual 500 follow it.Skills module 1130 may include a simulated race mode, such thatindividual 500 may attempt to follow therobotic platform 100 as it leads them through a simulated race. In some embodiments,skills module 1130 may include a World Record mode. In the world record mode, therobotic platform 100 may lead individual 500 at a world record pace for a particular distance. In some embodiments, world record mode may configurerobotic platform 100 to “replay” world record or personal record performances so the runner can attempt to “hang on” as long as possible. For example,drive system 104 may accelerate and decelerate at a specific pace, e.g., the acceleration at the start and the “kick” at the end of the race, for example. - In some embodiments,
software platform 100 includesteam module 1132.Team module 1132 may provide feedback tomultiple individuals 500, or coordinate movement between. - In some embodiments,
software platform 1000 includes asocial module 1134, for example, to integrate with social networking platforms, or other communication systems such that an individual may stream video of their workout. For example,social module 1134 may enable individual 500 to video chat with other individuals engaged in a workout. In some embodiments,social module 1134 may allow for friends, family, or fans of an individual engaged in a workout to communicate with the individual, for example to cheer them on (e.g., transmit a song designed to encourage or “pump up”individual 500, or phone a friend when individual 500 is fatigued). In some embodiments,social module 1134 may include communicating to a communication hub for services, (e.g., such as “OnStar”). - In some embodiments, the individual 500 may use
robotic training system 10 to carry out the methods and systems of the present invention. In some embodiments, the individual 500 may use anelectronic device 400 to carry out the methods and systems of the present invention. - After launching the application software (e.g., software platform 1000), the individual 500 may cause different GUI pages to be provided by different modules by selecting their corresponding icons using user input controls. Additional icons corresponding to sub-modules or program wizards associated with a particular module may pop up or otherwise be displayed to the individual 500 if the individual 500 selects, swipes, or hovers over a module icon with a cursor.
- In some embodiments there may be an educational section. In some embodiments this may include information general to health and fitness, or more specialized information, such as information about running or a particular athletic activity.
- In some embodiments, the system may archive individual 500 information in an acceptable way to allow for more storage room on the
electronic device 400 orsensor module 102. Archival may include hard drive storage on site, cloud based storage, server storage, or any other acceptable storage medium. - Examples of athletic goals may include training for a race, or other sporting event, improving individual fitness, simply enjoy running, or the like. Frequency intervals may include for example about 1-2 times per week, about 3-4 times per week, about 5-7 times per week, or the individual doesn't know. Length intervals may include for example about less than about 5 miles per week, about 5-10 miles per week, about 10-20 miles per week, greater than about 20 miles per week, or the individual doesn't know. Examples of intended athletic terrain environments may include roads, track, treadmill, trail, gym, or particular athletic fields designed for a specific sport. These features may be integrated into
software platform 1000 and used to controlrobotic training system 10. - All modules may have one or more sub-modules which may be navigated to and from by clicking, swiping, etc. In some embodiments, the system may allow the individual 500 one of upload photos, videos, medical records, and the like for incorporation into the robotic training system and methods.
- Pairing is a process used in computer networking that helps set up an initial linkage between computing devices to allow communications between them. Pairing may occur wirelessly via a personal area network or local area network using, for example, the Bluetooth wireless protocols. The
software platform 1000 may prompt the individual 500 to pair their electronic device 400 (or other sensors) to asensor module 102, and may display updates to the individual 500 as to the status of the pairing. -
Sensor modules 102 may have a generic registration name in the system that identifies the sensor module as part of thesystem 10. Once paired, sensor modules may be identified by the name of the individual using that sensor module. For example a sensor might be registered as RSS0005 as a generic identification name, and the broadcast signal would include this name. Once paired that sensor module may change the broadcast signal to include a name corresponding to the particular individual using that sensor module, such as NAME01 or NAME02. Once thesensor modules 102 are paired, registration data and personal information collected from the individual 500 may be loaded onto the sensor modules. - In some embodiments, the
system 10 or method may include identifying whether a performance goal has been met. In some embodiments, the method may include receiving personal information about the individual prior to receiving the data about the individual. The personal information may include information such as their name, prior injury information, height, weight, gender, shoe size, an athletic goal, intended athletic environment or terrain, intended athletic activity duration, intended athletic activity frequency, intended athletic activity distance, quantitative or qualitative preferences about athletic equipment or footwear (such as level of cushion, preference of weight, materials and the like), and current athletic footwear. - In other embodiments, the method may include creating an account for the individual. This account may include obtaining personal information from the individual. The method may include receiving motion data related to the individual from a sensor module associated with the individual while the individual is engaged in an athletic activity, or other data received from
robotic platform 100 and associatedsensor modules 102. In some embodiments, the method may include storing the personal information, and characteristics in association with the account for the individual. - In some embodiments, the
electronic device 400 may be for example one of a desktop computer, a PDA device, MP3 player, an electronic watch having a sports operating mode, a workstation, mobile device (e.g., a mobile phone, personal digital assistant, tablet computer, or laptop), computer, server, compute cluster, server farm, game console, set-top box, kiosk, embedded system, a gym machine, dedicated electronic device, game console controller. In some embodiments,electronic device 400 may include at least one processor and memory. -
Robotic training system 10 according to embodiments of the present invention may be suitable for use byindividuals 500 for individual athletic activities may be suitable for use byindividuals 500 engaged in athletic activities such running or walking. - In some embodiments of the present invention, the
robotic training system 10 may also include or interact with robotic trainingsystem software platform 1000. Interface aspects of the robotic training system or robotic training system software could be, for example, presented to an individual 500 via a screen on the individual's 500electronic device 400. In some embodiments,software platform 1000 may be remotely hosted, for example, on a server. In some embodiments, an individual may downloadsoftware platform 1000 or various modules to a memory, for example, a flash drive, which may be coupled to therobotic training system 10 to program therobotic platform 100. - In some embodiments,
additional sensors 148 may be utilized, for example additional physiological sensors integrated within an existing piece of athletic activity monitoring equipment such as, for example, a heart rate monitoring device, a pedometer, and accelerometer-based monitoring device, positioning system receiver device (e.g. a GPS receiver), or other fitness monitoring device. - Communication may also occur between the sensors, electronic device, and/or a
remote server 604 via anetwork 602, for example, as shown inFIG. 5 . In some embodiments, the network is the Internet. The Internet is a worldwide collection of servers, routers, switches, and transmission lines that employ the Internet Protocol (TCP/IP) to communicate data. The network may also be employed for communication between any two or more of the sensors, the electronic device, the server, etc. In some embodiments of the present invention, information is directly communicated between the sensors or processor and the server via the network, thus bypassing the electronic device. - A variety of information may be communicated between any of the components that may transmit or receive data or information. Such information may include, for example, performance parameter data, device settings (including sensor settings), software, and firmware.
- Communication among the various elements of the present invention may occur after the workout/athletic activity has been completed or in substantially real-time during the workout/athletic activity.
- The
electronic device 400 may serve a variety of purposes including, for example, providing additional data processing, providing instructions torobotic platform 100; providing additional data storage, providing data visualization, providing additional sensor capabilities, relaying information to anetwork 602, providing for the playback of music or videos, or the like. - The
electronic device 400 illustrated in the figures may not be a dedicated electronic monitoring device; theelectronic device 400 illustrated in the figures may be a mobile phone, dedicated fitness monitor, smart watch, tablet computer, etc. In alternate embodiments, it may be possible for thesensor module 102 itself to be embodied by a mobile phone, or for theelectronic device 400 to be a mobile phone. Including anelectronic device 400 in therobotic training system 10, such as a mobile phone, may be desirable as mobile phones are commonly carried byindividuals 500, even when engaging in athletic activities, and they are capable of providing significant additional computing and communication power at no additional cost to the individual 500. - In view of the above discussion, it is apparent that various processing steps or other calculations recited herein may be capable of being performed by various embodiments of the
robotic training system 10 disclosed herein, and are not necessarily limited to being performed by thesensor module 102, depending on the configuration of a particular embodiment of the present invention. For example, any of the processing steps or other calculations recited herein may be performed, in various embodiments, by thesensor module 102, by aserver computer 604, by anelectronic device 400, and/or any other network component, or by more than one component. - Embodiments of the present invention may involve the use of so-called “cloud computing.” Cloud computing may include the delivery of computing as a service rather than a product, whereby shared resources, software, and information are provided to computers and other devices as a utility over a network (typically the Internet). Cloud computing may entrust services (typically centralized) with an individual's 500 data, software and computation on a published application programming interface over a network. End users may access cloud-based applications through a web browser or a light weight desktop or mobile app while the business software and data are stored on servers at a remote location. Cloud application providers often strive to give the same or better service and performance than if the software programs were installed locally on end-user computers.
- Embodiments of the present invention may incorporate features of motion and performance monitoring systems. Exemplary motion monitoring and performance systems are disclosed in commonly owned U.S. patent application Ser. No. 13/077,494, filed Mar. 31, 2011 (which published as U.S. Patent App. Pub. No. 2012/0254934), and commonly owned U.S. patent application Ser. No. 13/797,361, filed Mar. 12, 2013 (which published as U.S. Patent App. Pub. No. 2014/0266160), the entirety of each being incorporated herein by reference thereto.
- An overview of exemplary embodiments of components of the
robotic training system 10 of the present invention, includingexemplary sensor modules 102, has been provided above. - Turning to
FIG. 7 , a block diagram of components of asensor module 102 according to some embodiments of the present invention is shown. In the illustrated embodiment, thesensor module 102 may include processor 110 (processor 110 may also be a separate component).Sensor module 102 may include apower source 140, amemory 138, anacceleration sensor 142, amagnetic field sensor 146, and a transceiver 112 (transceiver 112 may be a separate component). These components are operatively connected to one another to carry out the functionality of thesensor module 102. In other embodiments, one or more of thesesensor module 102 components may be omitted, or one or more additional components may be added.Processor 110 may be included insensor module 102, or may be a separate component.Processor 110 may be adapted to implement application programs stored in thememory 138 of thesensor module 102. Theprocessor 110 may also be capable of implementing analog or digital signal processing algorithms such as raw data reduction and filtering. For example,processor 110 may be configured to receive raw data from sensors and process such data at thesensor module 102. Theprocessor 110 is operatively connected to thepower source 140, thememory 138, theacceleration sensor 142, themagnetic field sensor 146, and thetransceiver 112. - In an embodiment, calibration of
sensor module 102 is performed using, for example, received GPS signals from aposition receiver 130. The received GPS signals can be used, for example, to determine a distance that an individual runs or walks during a workout. In other embodiments, calibration ofsensor module 102 may be prepared by using a counter (e.g., additional sensor 148) to count revolutions of an axle ofdrive system 104, for example. - The
power source 140 may be adapted to provide power to thesensor module 102. In one embodiment, thepower source 140 may be a battery. The power source may be built into thesensor module 102 or removable from thesensor module 102, and may be rechargeable or non-rechargeable. In some embodiments, thepower source 140 may be recharged by a cable attached to a charging source, such as a universal serial bus (“USB”) FireWire, Ethernet, Thunderbolt, or headphone cable, attached to a personal computer. In another embodiment, thepower source 140 may be recharged by inductive charging, wherein an electromagnetic field is used to transfer energy from an inductive charger to thepower source 140 when the two are brought in close proximity, but need not be plugged into one another via a cable. In some embodiment, a docking station may be used to facilitate charging. In other embodiments, thesensor module 102 may be repowered by replacing onepower source 140 with anotherpower source 140.Power source 140 may additionally powerrobotic platform 100, including drive and steeringsystems 104/106. - The
memory 138 may be adapted to store application program instructions and to store athletic activity data. In some embodiments, thememory 138 may store application programs used to implement aspects of the functionality of theretail enhancement system 10 described herein. In one embodiment, thememory 138 may store raw data, recorded data, and/or calculated data. In some embodiments, as explained in further detail below, thememory 138 may act as a data storage buffer. Thememory 138 may include both read only memory and random access memory, and may further include memory cards or other removable storage devices. - In some embodiments of the present invention, the
memory 138 may store raw data, recorded data, and/or calculated data permanently, while in other embodiments thememory 138 may only store all or some data temporarily, such as in a buffer. In one embodiment of the present invention, thememory 138, and/or a buffer related thereto, may store data in memory locations of predetermined size such that only a certain quantity of data may be saved for a particular application of the present invention. - The
acceleration sensor 116 may be adapted to measure the acceleration of thesensor module 102. Accordingly, when thesensor module 102 is physically coupled torobotic platform 100, theacceleration sensor 116 may be capable of measuring the acceleration of theobject 104, including the acceleration due to the earth's gravitational field, and may allow robotic platform to move with predetermined acceleration patterns. In one embodiment, theacceleration sensor 116 may include a tri-axial accelerometer that is capable of measuring acceleration in three orthogonal directions. In other embodiments one, two, three, or more separate accelerometers may be used. - The
magnetic field sensor 146 may be adapted to measure the strength and direction of magnetic fields in the vicinity of thesensor module 102. Accordingly,sensor module 102, utilizing themagnetic field sensor 146, may be capable of measuring the strength and direction of magnetic fields in the vicinity of therobotic platform 100, including the earth's magnetic field. In one embodiment, themagnetic field sensor 146 may be a vector magnetometer. In other embodiments, themagnetic field sensor 146 may be a tri-axial magnetometer that is capable of measuring the magnitude and direction of a resultant magnetic vector for the total local magnetic field in three dimensions. In other embodiments one, two, three, or more separate magnetometers may be used. - In one embodiment of the present invention, the
acceleration sensor 116 and themagnetic field sensor 146 may be contained within a single accelerometer-magnetometer module bearing model number LSM303DLHC made by STMicroelectronics of Geneva, Switzerland. In other embodiments, thesensor module 102 may include only one of theacceleration sensor 116 and themagnetic field sensor 146, and may omit the other if desired. - The
transceiver 122 depicted inFIG. 6 may enable thesensor module 102 to wirelessly communicate with other components of therobotic training system 10, such as those described in further detail below. In one embodiment, thesensor module 102 and the other local components of therobotic training system 10 may communicate over a personal area network or local area network using, for example, one or more of the following protocols: ANT, ANT+ by Dynastream Innovations, Bluetooth, Bluetooth Low Energy Technology, BlueRobin, or suitable wireless personal or local area network protocols. Other known communication protocols suitable for arobotic training system 10 may also be used. - In one embodiment, the
transceiver 122 is a low-power transceiver. In some embodiments, thetransceiver 122 may be a two-way communication transceiver 122, while in other embodiments thetransceiver 122 may be a one-way transmitter or a one-way receiver. Wireless communication between thesensor module 102 and other components of therobotic training system 10 is described in further detail below. In other embodiments, thesensor module 102 may be in wired communication with other components of therobotic training system 10 that does not rely ontransceiver 122. - In some embodiments of the present invention, a
sensor module 102 having components such as those depicted inFIG. 6 may be physically coupled torobotic platform 100 during an athletic activity conducted by an individual 500.Sensor module 102 may further monitor changes in the spatial orientation of the individual's 500 body or a piece of the individual's athletic equipment or article of footwear, or to determine a correlation between body or equipment movement data and a characteristic such as gait characteristic. In some embodiments,sensor module 102, as described, may be used to monitor the surface of a track, for example, to follow chalk/paint line 302. In some embodiments,additional sensors 148 not coupled to robotic platform 100 (e.g., other acceleration sensors, physiological sensors, etc.) may be responsible for collecting the data necessary to carry out the various monitoring calculations. - In some other embodiments, however, it may be desirable to have additional sensors 148 (for example, such as speed sensors, etc.) included within the
sensor module 102, or operatively connected tosensor module 102, or to haveadditional sensors 148 in communication with thesensor module 102. In some embodiments, anadditional sensor module 102 may be integrated within an existing piece of athletic activity monitoring equipment possibly having additional or different sensors such as, for example, a heart rate monitoring device, a pedometer, and accelerometer-based monitoring device, or other fitness monitoring device. - In addition to the
acceleration sensor 116 and themagnetic field sensor 146, other sensors that may be part of thesensor module 102 or separate from but in communication with thesensor module 102 may include sensors capable of measuring a variety of athletic performance parameters. The term “performance parameters” may include physical parameters and/or physiological parameters associated with the individual's 500 athletic activity. Physical parameters measured may include, but are not limited to, time, distance, speed, pace, pedal count, wheel rotation count, rotation generally, stride count, stride length, airtime, stride rate, altitude, strain, impact force, jump force, force generally, and jump height. Physiological parameters measured may include, but are not limited to, heart rate, respiration rate, blood oxygen level, blood lactate level, blood flow, hydration level, calories burned, or body temperature. - As shown in
FIG. 7 , in some embodiments,sensor module 102 may incorporate other additional components. In some embodiments,sensor module 102 may incorporate anangular momentum sensor 124, aheart rate sensor 126, atemperature sensor 128, aposition receiver 130, adata port 132, and atimer 134 operatively connected to one another to carry out the functionality of thesensor module 102. In other embodiments, one or more of thesesensor module 102 components may be omitted, or one or more additional components may be added. - In some embodiments, the
transceiver 122 may be a two-way communication transceiver 122, while in other embodiments thetransceiver 122 may be a one-way transmitter or a one-way receiver. - The
user interface 136 of thesensor module 102 may be used by the individual 500 to interact with thesensor module 102. In some embodiments, theuser interface 136 may include one or more input buttons, switches, or keys, including virtual buttons, switches, or keys of a graphical user interface touch screen surface. The function of each of these buttons, switches, or keys may be determined based on an operating mode of thesensor module 102. In one embodiment, theuser interface 136 may include a touch pad, scroll pad and/or touch screen. In another embodiment, theuser interface 136 may include capacitance switches. In a further embodiment, theuser interface 136 may include voice-activated controls. - In some embodiments, however, the
sensor module 102 may not include auser interface 136. In these embodiments, thesensor module 102 may be capable of communicating with other components of therobotic training system 10 which may themselves include user interfaces, for example,electronic device 400. - The
angular momentum sensor 124, which may be, for example, a gyroscope, may be adapted to measure the angular momentum or orientation of thesensor module 102. Accordingly, when thesensor module 102 is physically coupled torobotic platform 100, theangular momentum sensor 124 may be capable of measuring the angular momentum or orientation of theobject 104. In one embodiment, theangular momentum sensor 124 may be a tri-axial gyroscope that is capable of measuring angular rotation about three orthogonal axes. In other embodiments one, two, three, or more separate gyroscopes may be used. In some embodiments, theangular momentum sensor 124 may be used to calibrate measurements made by one or more of theacceleration sensor 116 and themagnetic field sensor 146. This may be particularly advantageous for an aerialrobotic platform 100. - The heart rate sensor 125 may be adapted to measure an individual's 500 heart rate. The heart rate sensor 125 may be placed in contact with the individual's 500 skin, such as the skin of the individual's chest, and secured with a strap. The heart rate sensor 125 may be capable of reading the electrical activity the individual's 500 heart.
- The
temperature sensor 128 may be, for example, a thermometer, a thermistor, or a thermocouple that measures changes in the temperature. In some embodiments, thetemperature sensor 128 may primarily be used for calibration other sensors of therobotic training system 10, for example, theacceleration sensor 116 and themagnetic field sensor 146. - In one embodiment, the
position receiver 130 may be an electronic satellite position receiver that is capable of determining its location (i.e., longitude, latitude, and altitude) using time signals transmitted along a line-of-sight by radio from satellite position system satellites. Known satellite position systems include the GPS system, the Galileo system, the BeiDou system, and the GLONASS system. In another embodiment, theposition receiver 130 may be an antenna that is capable of communicating with local or remote base stations or radio transmission transceivers such that the location of thesensor module 102 may be determined using radio signal triangulation or other similar principles. In some embodiments,position receiver 130 data may allow thesensor module 102 to detect information that may be used to measure and/or calculate position waypoints, time, location, distance traveled, speed, pace, or altitude. - The
data port 132 may facilitate information transfer to and from thesensor module 102 and may be, for example, a USB port. In some exemplary embodiments,data port 132 can additionally or alternatively facilitate power transfer to a power source, in order to a charge power source. - The
timer 134 may be a clock that is capable of tracking absolute time and/or determining elapsed time. In some embodiments, thetimer 134 may be used to timestamp certain data records, such that the time that certain data was measured or recorded may be determined and various timestamps of various pieces of data may be correlated with one another. - In some embodiments, the
sensor module 102 may also include a button and/or a display. The button may serve as the user interface of thesensor module 102. The button may be capable of turning thesensor module 102 on and off, toggling through various display options, or serving a variety of other functions. Alternatively, multiple buttons or no buttons may be provided. In one embodiment, the display may be a relatively simple LED display that is capable of conveying the status or battery life of thesensor module 102 to an individual 500 with different color combinations or flashing patterns, for example. In another embodiment, the display may be a more advanced display that is capable of displaying performance parameter information, feedback, or other information to the individual 500, such as a segmented LCD display. Alternatively, no button or display may be provided. - In other embodiments, the
sensor module 102 may include audio controls such as a speaker and/or microphone for audio communication with an individual 500. These components may serve as the user interface of thesensor module 102, and may be included inaudio input system 120. These audio controls may be capable of turning thesensor module 102 on and off, toggling through various display options, or serving a variety of other functions. In one embodiment, the audio controls may be capable of conveying the status or battery life of thesensor module 102 to an individual 500. In another embodiment, the audio controls may be capable of outputting or receiving performance parameter information, feedback, or other information to and from the individual 500. In one embodiment, the audio controls may be capable of accepting voice commands form the individual 500. In another embodiment, thesensor module 102 may be capable of relaying audio information to an individual wirelessly via another device, such as a pair of headphones. Alternatively, audio controls may be provided. - Data obtained by the
sensor module 102 may be processed in a variety of ways to yield useful information about the motion of anobject 104 of interest during the activity. In some embodiments,sensor module 102 data may be processed to monitor changes in the spatial orientation of the individual's 500 body or a piece of the individual's 500 athletic equipment. In other embodiment,sensor module 102 data may be processed to by reference to a predetermined correlation between movement data and a characteristic stored in a data structure. - In some embodiments,
sensor modules 102 are used to detect changes in an individual's direction of motion.Sensor modules 102 according to the present invention can also be worn by individuals and used to detect and/or track other motions such as, for example, motions associated with push-ups, pull-ups, weightlifting, diving, gymnastics, et cetera. - Turning to
FIG. 8 , a block diagram ofelectronic device 400 according to an embodiment of the present invention is shown. In an embodiment,electronic device 400 corresponds to a mobile computing device, mobile phone, desktop computer, tablet computer, dedicated electronic device, or the like. As shown inFIG. 7 ,electronic device 400 may include aprocessor 402,memory 406, auser input control 408, adisplay 410, anaudio unit 416, atransceiver 404, acellular transceiver 414, an optional satellite-basedpositioning system receiver 412, acamera 418, and abattery 420. -
Processor 402 is a processor capable of implementing application programs orsoftware platforms 1000 stored inmemory 406.Processor 402 is also capable of implementing digital signal processing algorithms.Processor 402 is coupled to memory 304,user input control 408,display 410,audio unit 416,transceiver 404, and may include acellular transceiver 414. -
Memory 406 is used to store application program instructions (e.g., software platform 1000) and data. In an embodiment,memory 406 stores programs, for example, used to implement all of the functionality of a typical electronic device. In an embodiment,memory 406 includes both read only memory and random access memory. -
User input control 408 is used by an individual to interact withelectronic device 400. In an embodiment,user input control 408 includes a variety of input buttons and/or keys. The function of each of these buttons and/or keys is typically determined based on an operating mode ofelectronic device 400. In one embodiment,user input control 408 includes a touch pad or scroll pad and/or touch screen buttons. -
Display 410 is used to display information to an individual. In an embodiment,display 410 is a liquid crystal display. -
Camera 418 is a small digital camera used to take digital photos or video. In one embodiment,camera 418 is a CCD camera. In another embodiment,camera 418 is a CMOS camera. -
Audio unit 416 is used to process audio signals. In an embodiment, voice signals picked up using a microphone are converted to digital signals so that they can be operated upon, for example, byprocessor 402.Audio unit 416 also converts, for example, digital audio signals into amplified analog audio signals that can be used to drive one or more speakers. In an embodiment,audio unit 416 implements signal processing algorithms such as those available from Dolby Laboratories, Inc., which enhance the quality of music. -
Transceiver 404 is a low-power transceiver used to communicate with other components ofrobotic training system 10. In an embodiment,transceiver 404 operates in an unlicensed frequency band such as 2.4 GHz.Transceiver 404 is coupled to an antenna 314. As used herein, the term transceiver means a combination of a transmitter and a receiver. In an embodiment, the transmitter and the receiver are integrated and form, for example, a part of an intergraded circuit. -
Cellular transceiver 414 may be used to send and receive, for example, voice cellular telephone signals.Transceiver 414 can also be used to exchange information with a computer network such as, for example, the Internet.Cellular transceiver 414 is coupled to anantenna 422. As used herein, the term cellular transceiver means a combination of a cellular transmitter and a cellular receiver. In an embodiment, the transmitter and the receiver are integrated together into a single device. - In one embodiment,
cellular transceiver 414 is used to send data described herein to a location where it is analyzed, for example, by a professional trainer. The professional trainer can call or text message the individual and provide the individual substantially real-time feedback based on the data. If the individual wants to call the professional trainer, for example, during a workout, the individual can place a call to the professional trainer, for example, by tappingelectronic device 400 to place a call to a stored telephone number. In one embodiment, tappingelectronic device 400 sends a text message to the professional trainer requesting that the professional trainer call the individual. These functions may also be included insensor module 102. -
Battery 420 is used to provide power to operate the various components ofelectronic device 400. In an embodiment,battery 420 is recharged periodically using a power adapter that plugs into a typical household power outlet.Battery 420 can also be a non-rechargeable battery. - In an embodiment,
electronic device 400 also includes an optional satellite-based positioning system (e.g., global positioning system (GPS) or Galileo system)receiver 412. This enables the electronic device to determine its location anywhere on the earth. The satellite-based positioning system (e.g., GPS)receiver 412 is coupled to anantenna 424. In an embodiment,GPS receiver 412 enables theelectronic device 400, for example, to provide navigational instructions to a runner using the device. The directions for a running route can be downloaded to the electronic device prior to a run and stored inmemory 406. In addition to navigational instructions, attributes about the running route such as, for example, whether the route has sidewalks, is on a trail, is located within a safe neighborhood, et cetera, can also be downloaded and viewed.GPS receiver 412 can be used, in an embodiment, to track a route run by a runner. The route can be saved in memory 304 and viewed by the runner after the run. The route can also be shared with other runners, for example, by posting the route on a computer/web server for down-loading by other runners. - In an embodiment,
GPS receiver 412 and information stored in the memory of electronic device 400 (or information received, e.g., from the internet using cellular transceiver 414) are used to provide navigational instructions, for example, to a runner. In an embodiment, the runner can enter intoelectronic device 400 that he or she would like to run five kilometers, for example, and the electronic device will automatically select/map-out an appropriate route and provide navigation instructions to the runner during the run. In an embodiment, the runner can specify both a start point and a stop point for the run. In an embodiment, only one point is specified, which serves as both the start point and the stop point. In an embodiment, the start and stop points are the point at which the runner is standing (e.g., as determined by GPS receiver 412) when the runner enters, for example, that he or she would like to run five kilometers. - In an embodiment,
electronic device 400 includes a radio. The radio can be an AM only radio, an FM only radio, or both an AM and FM radio. In an embodiment, the radio is controlled using soft keys presented to an individual ondisplay 410. - In one embodiment,
electronic device 400 includes optional sensors (not shown) for detecting selected weather related data such as, for example, temperature, humidity, ultra-violet radiation, and/or barometric pressure. This data can be used, for example, to determine how an individual's performance is effected by environmental factors. - In one embodiment, an electronic device according to the present invention does not include a display. In this embodiment, information such as, for example, performance and/or feedback information is provided to an individual audibly during a workout, e.g., through
sensor module 102, or other audio feedback. The information can be display to the individual, for example, after the workout using a computer display once the information has been transferred to the computer. In an embodiment, the information can be transferred to a second processing device such as, for example, a sports watch during the workout and displayed to the individual during the workout on the display of the second processing device. - In embodiments, an
electronic device 400 according to the present invention can be formed, for example, by attaching a dongle (e.g., a small hardware device that protects software) to a conventional phone, a music file player, a personal digital assistant, et cetera. The dongle includes, for example, downloadable software that implements some or all of the sport functions described herein. In an embodiment, the software includes a sport user interface written in the Java programming language. In an embodiment, the software includes drivers, for example, that enable the software to be used with any ultra low power Bluetooth communications protocol compatible device. Other embodiments are compatible with other communications protocol compatible devices. - In an embodiment of the present invention, a electronic device according to the present invention is a dedicated device (rather than a device such as, for example, a phone, a music file player, or a personal digital assistant) that implements the robotic training functions as detailed herein.
- In some embodiments, the
sensor module 102 may then determine that the movement of an individual 500 indicates the occurrence of a movement to track. In one embodiment, the determination that the movement of the individual 500 indicates the occurrence of a movement to track occurs when a threshold data value is met for a predetermined period of time. For example, thesensor module 102 may determine that a movement of the individual has resulted in a threshold acceleration occurring for a predetermined period of time. This may initiate movement of therobotic platform 100. - In some embodiments, remote processing may be used to augment the processing discussed herein. The remote processing may enable a
sensor module 102 to wirelessly transmit data to a remote computer for processing. Wireless communication with other elements of therobotic training system 10 is generally described above. In this way, the processing capabilities of therobotic training system 10 may be enhanced by shifting certain processing and analytical tasks to a remotely located computer, such as a server computer, with greater computational abilities and, in some embodiments, access to additional data, or other resources. - In some embodiments, the data received may be transmitted to the remote computer during the athletic activity. In another embodiment, the data received may be transmitted to the remote computer after the athletic activity has been completed.
- In some embodiments, the physiological data received may be compared to data associated with the individual 500 for the present athletic activity and data associated with the individual 500 from a previous athletic activity. In some embodiments, the data may be compared to data received during a different individual's 500 athletic activity.
- By using the
robotic training system 10 including thesensor module 102 described above, embodiments of the present invention may advantageously enable the individual 500 (or their coach, teammate, a spectator, friends, competitors, etc.) to obtain this or other information about the motion of the individual's 500 body or the motion of a piece of the individual's 500 athletic equipment during or after the course of the athletic activity. - While various embodiments of the present invention are described in the context of the running, the present invention is not so limited and may be applied in a variety of different sports or athletic activities including, for example, sports of soccer (i.e., football), basketball baseball, bowling, boxing, cricket, cycling, football (i.e., American football), golf, hockey, lacrosse, rowing, rugby, running, skateboarding, skiing, surfing, swimming, table tennis, tennis, or volleyball, or during training sessions related thereto.
- For running,
sensor module 102 embodiments such as those described above may enable an individual 500, to determine, for example, characteristics of a runner's motion. For example, asensor module 102 could be used to determine the speed, pace, distance traversed, locations traversed, or to discriminate between different surfaces (e.g., grass, street, or trail) and inclinations (e.g., uphill, flat, or downhill). In some embodiments thesensor module 102 may be mounted, for example, on a runner's torso, arm, hand, leg, foot, or head, or on or in their article of footwear, or integrated intorobotic platform 100 - In some embodiments of the present invention, the
sensor module 102 may be capable of compensating for inherent deficiencies that may be present for various types of sensor contained within or in communication with thesensor module 102. Most real world sensors have limitations. For example, accelerometers, magnetometers, and gyroscopes may have accuracy issues, particularly when used at speeds of motion of theobject 104 or under other conditions that differ from their initial calibration conditions. - In some embodiments of the present invention, the
sensor module 102 may communicate with other components of therobotic training system 10 via wired or wireless technologies. Communication between thesensor module 102 and other components of therobotic training system 10 may be desirable for a variety of reasons. For example, to the extent that thesensor module 102 records and stores athletic activity information, it may be useful to transmit this information to another electronic device for additional data processing, data visualization, sharing with others, comparison to previously recorded athletic activity information, or a variety of other purposes. As a further example, to the extent that thesensor module 102 has insufficient processing power, wide area network transmission capabilities, sensor capabilities, or other capabilities, these capabilities can be provided by other components of therobotic training system 10. With this in mind, possible communications means are described briefly below. - Wired communication between the
sensor module 102 and anelectronic device 400 may be achieved, for example, by placing thesensor module 102—or a piece of athletic equipment including thesensor module 102—in a docking unit that is attached to theelectronic device 400 using a communications wire plugged into a communications port of theelectronic device 400. In another embodiment, wired communication between thesensor module 102 and theelectronic device 400 may be achieved, for example, by connecting a cable between thesensor module 102—or a piece of athletic equipment including thesensor module 102—and the computer orstandalone device 600. Thedata port 132 of thesensor module 102 and a communications port of thecomputer 600 may include USB ports. The cable connecting thesensor module 102 and thecomputer 600 may be a USB cable with suitable USB plugs including, but not limited to, USB-A or USB-B regular, mini, or micro plugs, or other suitable cable such as, for example, a FireWire, Ethernet or Thunderbolt cable. As previously explained above, in some embodiments, such cables could be used to facilitate power transfer to a power source of thesensor module 102, in order to charge the power source. Alternatively, the power source may be recharged by inductive charging, or by using a docking station with a charging base. - Wired connection to an
electronic device 400 may be useful, for example, to upload athletic activity information from thesensor module 102 to theelectronic device 400, or to download application software updates or settings from theelectronic device 400 to thesensor module 102. - Wireless communication between the
sensor module 102—or a piece of athletic equipment including thesensor module 102—and theelectronic device 400 may be achieved, for example, by way of a wireless wide area network (such as, for example, the Internet), a wireless local area network, or a wireless personal area network. As is well known to those skilled in the art, there are a number of known standard and proprietary protocols that are suitable for implementing wireless area networks (e.g., TCP/IP, IEEE 802.16, Bluetooth, Bluetooth low energy, ANT, ANT+ by Dynastream Innovations, or BlueRobin). Accordingly, embodiments of the present invention are not limited to using any particular protocol to communicate between thesensor module 102 and the various elements of theretail enhancement system 10 of the present invention. - In one embodiment, the
sensor module 102—or a piece of athletic equipment including thesensor module 102—may communicate with a wireless wide area network communications system such as that employed by mobile telephones. For example, a wireless wide area network communication system may include a plurality of geographically distributed communication towers and base station systems. Communication towers may include one or more antennae supporting long-range two-way radio frequency communication wireless devices, such assensor module 102. The radio frequency communication between antennae and thesensor module 102 may utilize radio frequency signals conforming to any known or future developed wireless protocol, for example, CDMA, GSM, EDGE, 3G, 4G, IEEE 802.x (e.g., IEEE 802.16 (WiMAX)), etc. The information transmitted over-the-air by the base station systems and the cellular communication towers to thesensor module 102 may be further transmitted to or received from one or more additional circuit-switched or packet-switched communication networks, including, for example, the Internet. - As previously noted, in some embodiments of the present invention,
sensor module 102 may communicate with an electronic device, such as a smart phone, that is also carried by the individual 500 during the athletic activity. - In some embodiments of the present invention, for example, as shown in
FIG. 7 , theelectronic device 400 may take the form of a mobile phone and may include at least a processor, a memory, user input controls, a positioning system receiver, a wireless wide area network (WWAN) transceiver, a visual display, and an audio unit. A visual display in the form of a LCD screen, and user input controls in the form of a physical keyboard and a scroll ball may be present. - The memory of the
electronic device 400 may be adapted to store application programs, software platforms or modules, used to implement aspects of the functionality of therobotic training system 10 described herein. Alternatively, those of skill in the art will understand that all or part of the software may be stored on theserver 604 and accessed over thenetwork 602 and run remotely as a mobile web application, or stored locally inrobotic platform 100, having a memory. - As discussed,
robotic training system 10 may include a number of different software modules capable of providing training support or otherrobotic platform 100 interaction toindividuals 500. Each module may support one or more graphical user interfaces (“GUIs”) capable of being presented to an individual 500 using thesystem 10. - A GUI may offer, for example, graphical elements, visual indicators, and/or text to represent information and actions available to the individual 500. The individual 500 may use a physical input device, such as keyboard or scroll ball to interact with the GUI of the
system 10, for example, onelectronic device 400. Alternatively, the individual 500 may use a touch screen to interact directly with what is displayed. Various touch screens such as, for example, resistive or capacitive touch screens, may be employed. - Those skilled in the art will appreciate that alternative or additional software modules and sub-modules may be implemented in order to provide or extend the described or additional functionalities to the individual 500 using the
electronic device 400. For example, the software configuration of software stored on anelectronic device 400 may include a device operating system, which may be one of the commercially available mobile phone operating systems such as, for example, BlackBerry OS, iPhone OS, Windows Mobile, Symbian, LINUX, WebOS, or Android. The device operating system may also have an associated application programming interface through which middleware and application programs may access the services of the operating system. - The various modules of the
system 10 of the present invention may support GUIs through which an individual 500 can interact with thesystem 10 using theelectronic device 400 just prior to and/or during an activity. As will be appreciated by those of skill in the art, in one embodiment the GUIs may be supported by a mobile device application being run on theelectronic device 400. In another embodiment, the GUIs may appear as web pages provided by theserver 604 via a website that may be accessible to the individual 500 over thenetwork 602 using a web browser on theirelectronic device 400. The GUIs may be considered to be part of the methods or systems of the present invention. - In some embodiments, the
robotic training system 10 may be sold as a package, including arobotic platform 100, anelectronic device 400,sensor modules 102 for multiple individuals 500 (e.g. runners), and a charger. -
Robotic training system 10 may recognize and record repeat usage of therobotic training system 10 over time, number of times various individuals store their data into a profile and update that data. Therobotic training system 10 may also be able to integrate with various social media platforms, allowing individuals to share with their social network data regarding their gait characteristics, their usage of therobotic training system 10. - Various aspects of the present invention, or any parts or functions thereof, may be implemented using hardware, software, firmware, tangible non-transitory computer readable or computer usable storage media having instructions stored thereon, or a combination thereof and may be implemented in one or more computer systems or other processing systems.
- As discussed, program products, methods, and systems for providing robotic training services of the present invention can include any software application executed by one or more
electronic devices 400. Anelectronic device 400 can be any type of computing device having one or more processors. For example, theelectronic device 400 can be a workstation, mobile device (e.g., a mobile phone, personal digital assistant, tablet computer, or laptop), computer, server, compute cluster, server farm, game console, set-top box, kiosk, embedded system, a gym machine, a retail system or retail enhancement system or other device having at least one processor and memory. Embodiments of the present invention may be software executed by a processor, firmware, hardware or any combination thereof in a computing device. - In this document, terms such as “computer program medium” and “computer-usable medium” may be used to generally refer to media such as a removable storage unit or a hard disk installed in hard disk drive. Computer program medium and computer-usable medium may also refer to memories, such as a main memory or a secondary memory, which can be memory semiconductors (e.g., DRAMs, etc.). These computer program products provide software to computer systems of the present invention.
- Software platform may include or accept computer programs (also called computer control logic, programming data, etc.), which may be stored on main memory and/or secondary memory. Computer programs may also be received via a communications interface. Such computer programs, when executed, may enable computer systems of the present invention to implement embodiments described herein. Where embodiments are implemented using software, the software can be stored on a computer program product and loaded into a computer system using, for example, a removable storage drive, an interface, a hard drive, and/or communications interface.
- Based on the description herein, a person skilled in the relevant art will recognize that the computer programs, when executed, can enable one or more processors to implement processes described above, such as the steps in the methods illustrated by the figures. In some embodiments, the one or more processors can be part of a computing device incorporated in a clustered computing environment or server farm. Further, in some embodiments, the computing process performed by the clustered computing environment may be carried out across multiple processors located at the same or different locations.
- Software of the present invention may be stored on any computer-usable medium. Such software, when executed in one or more data processing device, causes the data processing device to operate as described herein. Embodiments of the invention employ any computer-usable or -readable medium, known now or in the future. Examples of computer-usable mediums include, but are not limited to, primary storage devices (e.g., any type of random access or read only memory), secondary storage devices (e.g., hard drives, floppy disks, CD ROMS, ZIP disks, tapes, magnetic storage devices, optical storage devices, MEMS, nanotechnological storage devices, memory cards or other removable storage devices, etc.), and communication mediums (e.g., wired and wireless communications networks, local area networks, wide area networks, intranets, etc.).
- Embodiments have been described above with the aid of functional building blocks illustrating the implementation of specified functions and relationships thereof. The boundaries of these functional building blocks have been arbitrarily defined herein for the convenience of the description. Alternate boundaries can be defined so long as the specified functions and relationships thereof are appropriately performed.
- The foregoing description of the specific embodiments of the robotic training system described with reference to the figures will so fully reveal the general nature of the invention that others can, by applying knowledge within the skill of the art, readily modify and/or adapt for various applications such specific embodiments, without undue experimentation, without departing from the general concept of the present invention.
- While various embodiments of the present invention have been described above, they have been presented by way of example only, and not limitation. It should be apparent that adaptations and modifications are intended to be within the meaning and range of equivalents of the disclosed embodiments, based on the teaching and guidance presented herein. It therefore will be apparent to one skilled in the art that various changes in form and detail can be made to the embodiments disclosed herein without departing from the spirit and scope of the present invention. The elements of the embodiments presented above are not necessarily mutually exclusive, but may be interchanged to meet various needs as would be appreciated by one of skill in the art.
- It is to be understood that the phraseology or terminology used herein is for the purpose of description and not of limitation. The breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.
- It is to be appreciated that the Detailed Description section, and not the Summary and Abstract sections, is intended to be used to interpret the claims. The Summary and Abstract sections may set forth one or more but not all exemplary embodiments of the present invention as contemplated by the inventor(s), and thus, are not intended to limit the present invention and the appended claims in any way.
- The present invention has been described above with the aid of functional building blocks illustrating the implementation of specified functions and relationships thereof. The boundaries of these functional building blocks have been arbitrarily defined herein for the convenience of the description. Alternate boundaries can be defined so long as the specified functions and relationships thereof are appropriately performed.
- The foregoing description of the specific embodiments will so fully reveal the general nature of the invention that others can, by applying knowledge within the skill of the art, readily modify and/or adapt for various applications such specific embodiments, without undue experimentation, without departing from the general concept of the present invention. Therefore, such adaptations and modifications are intended to be within the meaning and range of equivalents of the disclosed embodiments, based on the teaching and guidance presented herein. It is to be understood that the phraseology or terminology herein is for the purpose of description and not of limitation, such that the terminology or phraseology of the present specification is to be interpreted by the skilled artisan in light of the teachings and guidance.
- The breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.
- The claims in the instant application are different than those of the parent application or other related applications. The Applicant therefore rescinds any disclaimer of claim scope made in the parent application or any predecessor application in relation to the instant application. The Examiner is therefore advised that any such previous disclaimer and the cited references that it was made to avoid, may need to be revisited. Further, the Examiner is also reminded that any disclaimer made in the instant application should not be read into or against the parent application.
Claims (19)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/914,678 US20200338431A1 (en) | 2016-09-27 | 2020-06-29 | Robotic training systems and methods |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/277,657 US10722775B2 (en) | 2016-09-27 | 2016-09-27 | Robotic training systems and methods |
US16/914,678 US20200338431A1 (en) | 2016-09-27 | 2020-06-29 | Robotic training systems and methods |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/277,657 Continuation US10722775B2 (en) | 2016-09-27 | 2016-09-27 | Robotic training systems and methods |
Publications (1)
Publication Number | Publication Date |
---|---|
US20200338431A1 true US20200338431A1 (en) | 2020-10-29 |
Family
ID=60083089
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/277,657 Active 2038-04-07 US10722775B2 (en) | 2016-09-27 | 2016-09-27 | Robotic training systems and methods |
US16/914,678 Abandoned US20200338431A1 (en) | 2016-09-27 | 2020-06-29 | Robotic training systems and methods |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/277,657 Active 2038-04-07 US10722775B2 (en) | 2016-09-27 | 2016-09-27 | Robotic training systems and methods |
Country Status (4)
Country | Link |
---|---|
US (2) | US10722775B2 (en) |
EP (2) | EP3657510A1 (en) |
JP (1) | JP6740196B2 (en) |
CN (1) | CN107871530B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220171412A1 (en) * | 2020-11-30 | 2022-06-02 | At&T Intellectual Property I, L.P. | Autonomous aerial vehicle outdoor exercise companion |
Families Citing this family (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7771320B2 (en) | 2006-09-07 | 2010-08-10 | Nike, Inc. | Athletic performance sensing and/or tracking systems and methods |
US9339691B2 (en) | 2012-01-05 | 2016-05-17 | Icon Health & Fitness, Inc. | System and method for controlling an exercise device |
CN104884133B (en) | 2013-03-14 | 2018-02-23 | 艾肯运动与健康公司 | Force exercise equipment with flywheel |
EP3974036B1 (en) | 2013-12-26 | 2024-06-19 | iFIT Inc. | Magnetic resistance mechanism in a cable machine |
WO2015138339A1 (en) | 2014-03-10 | 2015-09-17 | Icon Health & Fitness, Inc. | Pressure sensor to quantify work |
US10426989B2 (en) | 2014-06-09 | 2019-10-01 | Icon Health & Fitness, Inc. | Cable system incorporated into a treadmill |
WO2015195965A1 (en) | 2014-06-20 | 2015-12-23 | Icon Health & Fitness, Inc. | Post workout massage device |
US10391361B2 (en) | 2015-02-27 | 2019-08-27 | Icon Health & Fitness, Inc. | Simulating real-world terrain on an exercise device |
US10272317B2 (en) | 2016-03-18 | 2019-04-30 | Icon Health & Fitness, Inc. | Lighted pace feature in a treadmill |
US10625137B2 (en) | 2016-03-18 | 2020-04-21 | Icon Health & Fitness, Inc. | Coordinated displays in an exercise device |
US10493349B2 (en) | 2016-03-18 | 2019-12-03 | Icon Health & Fitness, Inc. | Display on exercise device |
ITUA20162341A1 (en) * | 2016-04-06 | 2017-10-06 | Reaxing Srl | SYSTEM FOR CARRYING OUT MOTOR ACTIVITY |
US10671705B2 (en) | 2016-09-28 | 2020-06-02 | Icon Health & Fitness, Inc. | Customizing recipe recommendations |
US11514812B2 (en) * | 2018-04-02 | 2022-11-29 | Pinegem Technologies LLC | Autonomous physical activity assistance systems and methods thereof |
US11740630B2 (en) * | 2018-06-12 | 2023-08-29 | Skydio, Inc. | Fitness and sports applications for an autonomous unmanned aerial vehicle |
EP3588471A1 (en) | 2018-06-28 | 2020-01-01 | West & Berg Holding AB | Real time sports motion training aid |
KR102675698B1 (en) * | 2018-12-18 | 2024-06-20 | 삼성전자주식회사 | Autonomous driving method and apparatus thereof |
US11471741B2 (en) * | 2018-12-21 | 2022-10-18 | SurfaSense LLC | Adaptive tennis ball machine |
JP2021142588A (en) * | 2020-03-10 | 2021-09-24 | 本田技研工業株式会社 | Operation system for moving body |
WO2022011435A1 (en) * | 2020-07-16 | 2022-01-20 | Mark Fisher | Motorised apparatus and method for sports training |
CN113332661B (en) * | 2021-07-05 | 2022-12-02 | 东莞市本末科技有限公司 | Dual-motor shake counteracting fitness device |
PT117350B (en) * | 2021-07-15 | 2024-01-04 | Inst Superior Tecnico | MOBILE PLATFORM FOR PHYSICAL STIMULATION AND REHABILITATION |
US20230215473A1 (en) * | 2021-12-30 | 2023-07-06 | Ifit Inc. | Systems and methods for synchronizing workout equipment with video files |
KR102669062B1 (en) * | 2023-06-21 | 2024-05-29 | (주)로보케어 | Exercise assistance service providing robot and exercise assistance service providing method |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140039677A1 (en) * | 2012-08-03 | 2014-02-06 | Toyota Motor Engineering & Manufacturing North America, Inc. | Robots Comprising Projectors For Projecting Images On Identified Projection Surfaces |
US9259634B1 (en) * | 2012-10-08 | 2016-02-16 | Earl L. Bouse | Method and system for creating and controlling a vehicular robot athlete |
US20160144511A1 (en) * | 2014-11-26 | 2016-05-26 | Irobot Corporation | Systems and Methods for Use of Optical Odometry Sensors In a Mobile Robot |
Family Cites Families (79)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4031510A (en) * | 1975-12-19 | 1977-06-21 | King Frederick N | Speed detection system for automobiles and other motor-driven objects |
US5083968A (en) * | 1988-11-29 | 1992-01-28 | Hart Frank J | Interactive toy |
US5213555A (en) * | 1990-02-27 | 1993-05-25 | Hood Robert L | Exercise equipment information, communication and display system |
US5716063A (en) * | 1995-03-20 | 1998-02-10 | Csia Research Foundation | Walking aid |
US5568935A (en) * | 1995-06-09 | 1996-10-29 | Mason; William P. | Recumbent cycle with improved drive and steering |
JP2000510013A (en) * | 1996-05-08 | 2000-08-08 | リアル ヴィジョン コーポレイション | Real-time simulation using position detection |
US5645279A (en) * | 1996-05-20 | 1997-07-08 | Reutlinger; Alicia L. | Vehicle history and trivia race game |
US5938564A (en) * | 1998-02-02 | 1999-08-17 | Bachman; Ron G. | Track runner pacing device |
US6155582A (en) * | 1998-09-29 | 2000-12-05 | Bourbeau; Charle | Bicycle coupling device |
US6447424B1 (en) * | 2000-02-02 | 2002-09-10 | Icon Health & Fitness Inc | System and method for selective adjustment of exercise apparatus |
US6540305B2 (en) * | 2000-03-20 | 2003-04-01 | Edward W. Phillips | Electric floor covering removal apparatus |
US6746371B1 (en) * | 2000-04-28 | 2004-06-08 | International Business Machines Corporation | Managing fitness activity across diverse exercise machines utilizing a portable computer system |
US6468086B1 (en) * | 2000-07-03 | 2002-10-22 | Shelly Brady-Koontz | Method of display of video images of exercises |
EP1307269A1 (en) * | 2000-08-02 | 2003-05-07 | Timothy James Ball | Simulation system |
US8306635B2 (en) * | 2001-03-07 | 2012-11-06 | Motion Games, Llc | Motivation and enhancement of physical and mental exercise, rehabilitation, health and social interaction |
JP3849442B2 (en) * | 2001-03-27 | 2006-11-22 | 株式会社日立製作所 | Self-propelled vacuum cleaner |
US6921351B1 (en) * | 2001-10-19 | 2005-07-26 | Cybergym, Inc. | Method and apparatus for remote interactive exercise and health equipment |
US6733383B2 (en) * | 2002-05-17 | 2004-05-11 | Electronic Arts Inc. | Systems and methods for simulating game state changes responsive to an interrupt condition |
US6793552B2 (en) * | 2002-12-20 | 2004-09-21 | Steven J. Derrah | Radio controlled surfboard with robotic rider controlled by two-string roto-wing |
KR100648342B1 (en) * | 2003-02-10 | 2006-11-23 | 엘지전자 주식회사 | navigation system and the operating method |
JP2004267236A (en) * | 2003-03-05 | 2004-09-30 | Hitachi Ltd | Self-traveling type vacuum cleaner and charging device used for the same |
US7001313B1 (en) * | 2003-05-23 | 2006-02-21 | Crnkovich Gary M | Exercise assistance device |
US7217224B2 (en) * | 2003-08-14 | 2007-05-15 | Tom Thomas | Virtual exercise system and method |
US7220219B2 (en) * | 2003-10-07 | 2007-05-22 | Bci Manufacturing, Inc. | Bicycle treadmill having automatic speed and resistance adjustments |
WO2005086866A2 (en) * | 2004-03-09 | 2005-09-22 | Heartrate Games, Inc. | User interactive exercise system |
US20060204045A1 (en) * | 2004-05-27 | 2006-09-14 | Antonucci Paul R A | System and method for motion performance improvement |
US7341294B2 (en) * | 2004-10-15 | 2008-03-11 | Thomas Wilson Olmstead | Tennis ball retrieval cart and practice hopper |
US20060206246A1 (en) * | 2004-10-28 | 2006-09-14 | Walker Richard C | Second national / international management and security system for responsible global resourcing through technical management to brige cultural and economic desparity |
JP4316477B2 (en) * | 2004-11-18 | 2009-08-19 | パナソニック株式会社 | Tracking method of mobile robot |
WO2006081395A2 (en) * | 2005-01-26 | 2006-08-03 | Bentley Kinetics, Inc. | Method and system for athletic motion analysis and instruction |
US20070078018A1 (en) * | 2005-09-30 | 2007-04-05 | Norman Kellogg | Golf range with automated ranging system |
ATE524784T1 (en) * | 2005-09-30 | 2011-09-15 | Irobot Corp | COMPANION ROBOTS FOR PERSONAL INTERACTION |
EP1800588B1 (en) * | 2005-12-20 | 2010-02-24 | Wessel-Werk Gmbh | Self-propelled vacuum cleaning apparatus |
US7481445B1 (en) * | 2006-03-28 | 2009-01-27 | Carmel Highland Inventions, Llc | Combination walker and wheelchair with improved ergonomic design |
US20070269300A1 (en) * | 2006-05-17 | 2007-11-22 | Larry Menard | Variable speed motor driven hand truck |
US20080023247A1 (en) * | 2006-07-27 | 2008-01-31 | Hall Mark L | Reverse drive safety system for vehicle |
CN101594844B (en) * | 2006-09-15 | 2012-12-26 | 达氏阿委有限公司 | Mobilizer for exercise, rehabilitation and wellness |
US8924248B2 (en) * | 2006-09-26 | 2014-12-30 | Fitbit, Inc. | System and method for activating a device based on a record of physical activity |
US8346391B1 (en) | 2006-12-28 | 2013-01-01 | Science Applications International Corporation | Methods and systems for an autonomous robotic platform |
US7658694B2 (en) * | 2007-04-30 | 2010-02-09 | Nike, Inc. | Adaptive training system |
EP2574265B1 (en) * | 2007-05-09 | 2015-10-14 | iRobot Corporation | Compact autonomous coverage robot |
JP2008284157A (en) * | 2007-05-17 | 2008-11-27 | Pilot Ink Co Ltd | Traveling toy and traveling toy set using the same |
US20090242285A1 (en) * | 2008-04-01 | 2009-10-01 | Whetstone Jr Henry M | Transportation cart with extendable arm and a throttle coupled thereto for controlling a motor and associated methods |
US20100056238A1 (en) * | 2008-08-30 | 2010-03-04 | Terrell Ii James Richard | Racing management and information system |
US9422018B2 (en) * | 2008-11-25 | 2016-08-23 | Fox Factory, Inc. | Seat post |
EP4039342A1 (en) * | 2008-11-25 | 2022-08-10 | Fox Factory, Inc. | Methods and apparatus for virtual competition |
ES2711815T3 (en) * | 2008-12-23 | 2019-05-07 | Paul Mazzanobile | Tracking training device |
US8702566B2 (en) * | 2008-12-23 | 2014-04-22 | Paul Mazzanobile | Speed and/or agility training devices and systems and methods for use thereof |
JP2011019627A (en) * | 2009-07-14 | 2011-02-03 | Yasuhiro Shitan | Fitness machine, method and program |
US9757639B2 (en) * | 2009-11-24 | 2017-09-12 | Seth E. Eisner Trust | Disparity correction for location-aware distributed sporting events |
WO2011089506A1 (en) | 2010-01-21 | 2011-07-28 | Stellenbosch University | An athletic training device |
SI23421A (en) * | 2010-07-07 | 2012-01-31 | Univerza V Ljubljani | Device for assessing and display of vector differences by forces, performed by a pair of hands or legs |
US9090214B2 (en) * | 2011-01-05 | 2015-07-28 | Orbotix, Inc. | Magnetically coupled accessory for a self-propelled device |
US9767257B2 (en) | 2011-03-31 | 2017-09-19 | Adidas Ag | Group performance monitoring system and method |
WO2013017167A1 (en) * | 2011-08-02 | 2013-02-07 | Alfred Kärcher Gmbh & Co. Kg | Drivable floor cleaning machine and method for operating a floor cleaning machine |
JP5968627B2 (en) * | 2012-01-17 | 2016-08-10 | シャープ株式会社 | Vacuum cleaner, control program, and computer-readable recording medium recording the control program |
US9452341B2 (en) * | 2012-02-29 | 2016-09-27 | Mizuno Corporation | Running form diagnosis system and method for scoring running form |
US9168419B2 (en) * | 2012-06-22 | 2015-10-27 | Fitbit, Inc. | Use of gyroscopes in personal fitness tracking devices |
US9039547B2 (en) * | 2012-08-03 | 2015-05-26 | Michael Yeager | Personal sports simulation robot |
CN108261295B (en) * | 2012-08-17 | 2021-02-05 | 罗伯特·卡尔洛维奇 | Movement assistance device |
US9483055B2 (en) * | 2012-12-28 | 2016-11-01 | Irobot Corporation | Autonomous coverage robot |
US9433552B2 (en) * | 2013-01-17 | 2016-09-06 | Lg Electronics Inc. | Electric walking assistant device |
US9500464B2 (en) * | 2013-03-12 | 2016-11-22 | Adidas Ag | Methods of determining performance information for individuals and sports objects |
US20160030825A1 (en) | 2013-03-14 | 2016-02-04 | Paul Mazzanobile | Multiple target speed and/or agility training systems |
WO2014150457A2 (en) * | 2013-03-15 | 2014-09-25 | Nike, Inc. | Feedback signals from image data of athletic performance |
WO2014179707A1 (en) * | 2013-05-02 | 2014-11-06 | Rolley David | System and method for collecting, analyzing and reporting fitness activity data |
JP2015047944A (en) * | 2013-08-30 | 2015-03-16 | 船井電機株式会社 | Manual propulsion vehicle |
JP6270115B2 (en) * | 2013-11-22 | 2018-01-31 | 地方独立行政法人東京都立産業技術研究センター | Exercise support system and exercise support program |
US9438824B2 (en) | 2014-09-17 | 2016-09-06 | Darren R. Kelley | Video recording assembly |
EP2997872B1 (en) * | 2014-09-20 | 2017-06-28 | Viking GmbH | Self-propelled work device |
US9798328B2 (en) * | 2014-10-10 | 2017-10-24 | Irobot Corporation | Mobile robot area cleaning |
JP6075365B2 (en) * | 2014-12-09 | 2017-02-08 | トヨタ自動車株式会社 | Walking training system |
US20160292865A1 (en) * | 2015-04-02 | 2016-10-06 | Sportvision, Inc. | Automated framing and selective discard of parts of high resolution videos of large event space |
JP2016220879A (en) * | 2015-05-29 | 2016-12-28 | セイコーエプソン株式会社 | Motion measurement device, motion measurement system, motion measurement method, and motion measurement program |
US9827162B1 (en) * | 2015-11-04 | 2017-11-28 | David J. Vidmar | Mobile body unweighted sit and stand chair assembly and method of operation |
CN105879305B (en) * | 2016-04-12 | 2018-02-02 | 中国科学院合肥物质科学研究院 | A kind of treadmill adaptive speed regulation system based on video |
US10383552B2 (en) * | 2016-04-26 | 2019-08-20 | Toyota Jidosha Kabushiki Kaisha | Gait analysis medical assistance robot |
US9789023B1 (en) * | 2016-09-29 | 2017-10-17 | Lunghwa University Of Science And Technology | Multi-function lower limb ambulation rehabilitation and walking assist device |
US9849057B1 (en) * | 2016-11-18 | 2017-12-26 | More Joyful Living, LLC | Stroller rollator |
-
2016
- 2016-09-27 US US15/277,657 patent/US10722775B2/en active Active
-
2017
- 2017-09-26 JP JP2017184652A patent/JP6740196B2/en active Active
- 2017-09-26 EP EP19217029.8A patent/EP3657510A1/en active Pending
- 2017-09-26 EP EP17193112.4A patent/EP3299070B1/en active Active
- 2017-09-27 CN CN201710888791.XA patent/CN107871530B/en active Active
-
2020
- 2020-06-29 US US16/914,678 patent/US20200338431A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140039677A1 (en) * | 2012-08-03 | 2014-02-06 | Toyota Motor Engineering & Manufacturing North America, Inc. | Robots Comprising Projectors For Projecting Images On Identified Projection Surfaces |
US9259634B1 (en) * | 2012-10-08 | 2016-02-16 | Earl L. Bouse | Method and system for creating and controlling a vehicular robot athlete |
US20160144511A1 (en) * | 2014-11-26 | 2016-05-26 | Irobot Corporation | Systems and Methods for Use of Optical Odometry Sensors In a Mobile Robot |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220171412A1 (en) * | 2020-11-30 | 2022-06-02 | At&T Intellectual Property I, L.P. | Autonomous aerial vehicle outdoor exercise companion |
Also Published As
Publication number | Publication date |
---|---|
US20180085654A1 (en) | 2018-03-29 |
EP3299070B1 (en) | 2019-12-25 |
JP2018108339A (en) | 2018-07-12 |
CN107871530B (en) | 2022-01-25 |
US10722775B2 (en) | 2020-07-28 |
EP3657510A1 (en) | 2020-05-27 |
CN107871530A (en) | 2018-04-03 |
JP6740196B2 (en) | 2020-08-12 |
EP3299070A1 (en) | 2018-03-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3299070B1 (en) | Robotic training systems and methods | |
US20220034641A1 (en) | Methods of determining performance information for individuals and sports objects | |
US11878213B2 (en) | Automatic cycling workout detection systems and methods | |
US20230102808A1 (en) | Retail store motion sensor systems and methods | |
US12070655B2 (en) | Sport ball athletic activity monitoring methods and systems | |
US11779810B2 (en) | Increasing accuracy in workout autodetection systems and methods | |
JP6039640B2 (en) | Fitness monitoring method, system, program product and application thereof | |
JP5200142B2 (en) | Location-aware fitness monitoring method | |
US20180160943A1 (en) | Signature based monitoring systems and methods | |
Kim et al. | Development and Implementation of Mobile Gear for Skier Training System |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: ADIDAS AG, GERMANY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BLACK, STEPHEN JOHN;DIBENEDETTO, CHRISTIAN;REEL/FRAME:053086/0535 Effective date: 20160923 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |