WO2015163500A1

WO2015163500A1 - Electronic device set system including input-assisting device and electronic device for processing input using same

Info

Publication number: WO2015163500A1
Application number: PCT/KR2014/003624
Authority: WO
Inventors: 손동현; 조한울참; 이호찬; 우수지; 장수진
Original assignee: 손동현
Priority date: 2014-04-24
Filing date: 2014-04-24
Publication date: 2015-10-29
Also published as: KR20160148567A

Abstract

The present invention relates to an electronic device set system comprising: an input-assisting device including a gesture input unit for inputting a gesture and a code input unit for inputting a code; and an electronic device including a gesture input reception unit for receiving the gesture input and a code input reception unit for receiving the code input.

Description

Electronic device set device including an input auxiliary device and an electronic device for processing the input using the same

The present invention relates to an electronic device set device including an input auxiliary device and an interface for processing an input of the input auxiliary device. In particular, it relates to a smartphone comprising a smartphone cover (Cover) and an interface for processing the input of the smartphone cover.

The display screen of a smartphone is made of glass and can be easily broken when falling on the floor or colliding with another object. Thus, a smartphone cover (Cover) has appeared to protect the glass of the smartphone. The smart phone cover can make a variety of products by changing the color, material and shape at a lower cost than the smart phone. The expensive smartphone appearance, which can be monotonous, can be easily changed by using the smartphone cover. In addition, the smart phone cover may add a business card or a card as an additional function. With the recent increase in the use of smartphone covers, the demand for such additional functions is increasing.

An object of the present invention is to provide an input auxiliary device that helps to make a gesture input and a sign input without seeing.

An object of the present invention is to provide an electronic device including an interface for processing a gesture input, a motion input, or a sign input.

SUMMARY OF THE INVENTION The present invention has been made in an effort to provide an electronic device set device including an input auxiliary device capable of operating without seeing and an electronic device for processing the input.

According to an aspect of the inventive concept, an electronic device set device includes an input auxiliary device including a gesture input unit for gesture input and a code input unit for sign input, and a gesture input for receiving the gesture input. An electronic device includes a receiver and a code input receiver to receive the code input.

According to an embodiment of the inventive concept, the electronic device is a smart phone or a game machine or a remote control or a calculator or a tablet PC.

According to an embodiment of the inventive concept, the sign input unit includes a braille input unit for braille input.

According to an embodiment of the inventive concept, the braille input unit may include a rubber material or a sponge material including a silicon material or a rubber material or a metal.

According to an embodiment of the inventive concept, the sign input unit may include a Korean input unit for Korean input, a numeric input unit for numeric input, or an English input unit for English input.

According to an embodiment of the inventive concept, the Hangul input unit or the numeric input unit or the English input unit may include a rubber material or a sponge material including a silicon material or a rubber material or a metal.

According to an embodiment of the present disclosure, the electronic device includes a touch display unit including the input receiver and a voice output unit for notifying the gesture input or the code input.

According to an embodiment of the inventive concept, the gesture input selects an upper menu according to a horizontal gesture, and selects a lower menu according to a vertical touch.

According to an embodiment of the present disclosure, the upper menu is a message related menu, a weather guidance menu, a current time menu, a location information menu, a current date menu, a calculator menu, or a telephone related menu.

According to an embodiment of the present disclosure, the lower menu is a message transmission menu or a message storage menu according to the selection of the upper message related menu.

According to an embodiment of the present disclosure, the electronic device may include a braille / character converter for converting the braille input into Korean, English, Japanese, German, Chinese, Spanish, Portuguese, Russian, Hebrew, or Hindi characters.

According to an embodiment of the inventive concept, the braille / character conversion unit converts by referring to a hash table.

According to an embodiment of the inventive concept, a material of the gesture input unit and a material of the code input unit are the same.

According to an embodiment of the inventive concept, an input assistance device includes a gesture input unit for gesture input and a sign input unit for sign input, and the gesture input unit and the sign input unit are located at different positions. Position it.

According to an embodiment of the inventive concept, the input assistance device is a smartphone cover.

According to an embodiment of the inventive concept, the braille input unit may include a rubber material or a sponge material including a silicon material or rubber or metal.

According to an embodiment of the inventive concept for achieving the above technical problem, a smart phone cover includes a braille input unit including at least six braille input buttons or holes in different positions for braille input.

According to an embodiment of the inventive concept, the apparatus further includes a sign input unit including at least one sign input button or hole for sign input.

According to an aspect of the present disclosure, an electronic device includes a touch display unit having a gesture input receiving unit for receiving a gesture input and a code input receiving unit for receiving a code input, and including the gesture input receiving unit; The sign input receiver is positioned at different positions of the touch display unit.

According to an embodiment of the inventive concept, the electronic device is a smartphone or a game machine or a remote controller or a calculator or tablet PC.

According to an embodiment of the inventive concept, the electronic device further includes a voice output unit for notifying the gesture input and the code input by voice.

According to an embodiment of the inventive concept, the gesture input selects an upper menu according to a horizontal gesture, and selects a lower menu according to a vertical gesture.

According to an embodiment of the inventive concept, the message transmission menu or the message storage menu is selected according to the selection of the upper message transmission menu.

According to an embodiment of the present disclosure, the electronic device further includes a braille / character converter for converting the braille input into Korean, English, Japanese, German, Chinese, Spanish, Portuguese, Russian, Hebrew, or Hindi characters. .

According to an embodiment of the inventive concept, the braille / character converting apparatus converts with reference to a hash table.

According to an embodiment of the inventive concept, an electronic device includes a motion sensor that selects an upper menu according to a horizontal motion, and selects a lower menu according to a vertical motion operation.

According to an embodiment of the inventive concept, the motion sensor selects the upper menu according to the vertical motion, and selects the lower menu in the horizontal motion.

1 is an electronic device set device according to an embodiment of the present invention.

2 is an electronic device set device for braille input according to an embodiment of the present invention.

3A illustrates an electronic device set device for smartphone keyboard input according to an embodiment of the present invention.

3B illustrates an electronic device set device for inputting a Qwerty keyboard according to an embodiment of the present invention.

4A to 4F are various input auxiliary devices according to an embodiment of the present invention.

5A to 5B are cross-sectional views of an input auxiliary device for braille input according to an embodiment of the present invention.

6A and 6B are electronic devices illustrating a gesture input according to an embodiment of the present invention.

7 is a conceptual diagram illustrating horizontal and vertical menu selection according to an embodiment of the present invention.

8 is another conceptual diagram illustrating horizontal and vertical menu selection according to an embodiment of the present invention.

9 is another conceptual diagram illustrating horizontal and vertical menu selection according to an embodiment of the present invention.

10 is a table showing a shortcut gesture input according to an embodiment of the present invention.

11A through 11B are electronic devices illustrating a motion input according to an embodiment of the present invention.

12A is a tablet PC showing a gesture input in accordance with one embodiment of the present invention.

12B is a tablet PC showing a motion input according to one embodiment of the invention.

13A to 13B are remote controllers showing a gesture input and a motion input according to an embodiment of the present invention.

14 is a conceptual diagram of processing a gesture input and a sign input according to an embodiment of the present invention.

15 is a hash table for Hangul conversion of Braille according to an embodiment of the present invention.

16 is a flowchart illustrating an electronic device operating method for selecting a horizontal and vertical menu according to an embodiment of the present invention.

17 is a flowchart illustrating an electronic device operating method for booting according to an embodiment of the present invention.

18 is a flowchart illustrating an electronic device operating method for converting braille input according to an embodiment of the present invention.

19 is a method of operating an electronic device for selecting a phone number according to an embodiment of the present invention.

20A to 20B illustrate an electronic device set device for a game according to an embodiment of the present invention.

21 is a flowchart illustrating a method of manufacturing an input auxiliary device according to an embodiment of the present invention.

The present invention relates to an electronic device set device including an input auxiliary device and an electronic device for processing an input using the same.

Referring to FIG. 1, the electronic device set device 10 includes an input auxiliary device 100 and an electronic device 200. The input assistance device 100 may be a smartphone cover, and the electronic device 200 may be a smartphone. The input assistance device 100 includes a gesture input unit 110 and a sign input unit 120. The gesture input 110 and the sign input unit 120 are located in the input auxiliary device 100 so as not to overlap each other. The input assistance device 100 includes a home button input unit 195 for inputting a home button 295 of the smart phone 200. The home button may be made of a hole. In addition, the code input unit 120 may be included. In addition, the input auxiliary device 100 may include a motion input sensor hole 194 for inputting a motion motion, a voice output hole 190 for transmitting an output voice, and an image sensor hole 191 for taking a photo; It includes an illuminance sensor hole 192 for detecting the brightness of the light and a temperature sensor hole 193 for detecting the temperature. The electronic device 200 includes a gesture input receiver 210 and a sign input receiver 220. The gesture input receiver 210 and the sign input receiver 220 are located in the electronic device 200 so as not to overlap each other. The electronic device 200 includes a home button 295, a motion sensor 294, a speaker 290, an image sensor 291, an illuminance sensor 292, a temperature sensor 293, and a touch display unit 235. do. The input auxiliary device 100 and the electronic device 200 are connected by the connection unit 150. The connection unit 150 may include an electrical material or a circuit line to electrically connect the electronic device 200 and the sign input unit 120 of the input auxiliary device 100. When the input assistance device 100 overlaps the upper portion of the electronic device 200, the gesture input unit 110 and the gesture input receiver 210 are located at the same position, and the code input unit 120 and the code input unit are provided. The receiver 220 is also located at the same position. The gesture input unit 110 may include a rubber or sponge material including a hole or a silicon material or a rubber material or a metallic material. The materials are materials that facilitate the gesture input, and are not limited to the materials, and may include all materials capable of touch input.

Referring to FIG. 2, the sign input unit 120 of the input assistance device 100 is shown in detail. The sign input unit 120 includes six

braille input units

124, 125, 126, 127, 128, and 129 for braille input and

function input units

121, 122, 123, 130, and 131 for function input. . The home button may also be included in the sign input unit 120. The braille input button 124 and the function input unit 121 includes a braille 133 so that the visually impaired person can easily know the meaning and location of the input units. The electronic device 200 includes a sign input receiver 220. The sign input receiver 220 includes six

braille input receivers

224, 225, 226, 227, 228, and 229 and

function input receivers

221, 222, 223, 230, and 231. The

braille input receivers

221, 222, 223, 230, and 231 may each have a circular shape. The

function input receivers

221, 222, 223, 230, and 231 are deleted with an English-Korean numeral input receiver 221, a double vowel input receiver 222, and a rewrite input receiver 223 for inputting English, Korean, and numbers. The input receiver 230 and the confirmation input receiver 231 may be included in the shape of a quadrangle. When the input auxiliary device 100 is positioned above the electronic device 200, the

braille input units

124, 125, 126, 127, 128, 129 and the

braille input receivers

221, 222, 223, 230 and 231 are located at the same position.

Referring to FIG. 3A, the input assistance device 101 includes a gesture input unit 110 and a sign input unit 140. The code input unit 140 includes smartphone keyboard input units 141 for inputting letters, numbers, and symbols of the smartphone. The electronic device 201 includes a sign input receiver 240 including a gesture input receiver 210 and smartphone keyboard input receivers 241, and is located at different positions of the touch display unit 235. When the smartphone keyboard input unit 141 of the code input unit 140 is superimposed on the electronic device 201, the smartphone keyboard input receivers 141 of the electronic device 201 are input. It is located almost identically to the location. The smartphone keyboard input result is also output as voice. The visually impaired person can know what type of keyboard he / she has typed and immediately enter it. When the visually impaired person is accustomed to using the input auxiliary device 101, the electronic device 201 may be used without using the input auxiliary device 101.

Referring to FIG. 3B, the sign input unit 150 of the input assistance device 102 includes Qwerty keyboard input units 151. The sign input receiver 250 of the electronic device 202 includes QWERTY keyboard input receivers 251.

4A to 4F, various input auxiliary devices according to an embodiment of the present invention are described. 4A illustrates that the input assistance device 103 includes a gesture input unit, a menu selection input unit, and a braille input unit, and are located at different positions. The gesture input unit is located above the auxiliary input device 103, and the menu selection input unit is positioned between the gesture input unit and the braille input unit. The menu selection input includes settings, weather, calculator, radio, music, phone, current location, internet and clock menus. The braille input unit includes six braille input units, a clock input unit and a confirmation input unit. Referring to FIG. 4B, in the input assistance device 104 of FIG. 4B, the braille input unit is positioned between the gesture input unit and the menu selection input unit. Referring to FIG. 4C, the input assistance device 105 includes a first menu selection input unit, a braille input unit, and a second menu selection input unit. The braille input unit is positioned between the first menu selection input unit and the second menu selection input unit. Referring to FIG. 4D, the input assistance device 106 includes a braille input unit, a menu selection input unit, and a gesture input unit. The braille input unit of the input assistance device 100 is located above, and in the order of the menu selection input unit and the gesture input unit below. The braille input unit includes braille input units, and each braille input unit has a display for knowing each meaning. For example, braille can be used for blind people. On each of the menu selection input units, various displays including squares, triangles, and circles can be displayed so that each function can be known only by the feeling of a finger. As a result, menu selection or braille input is possible only with the feeling of a finger without seeing with eyes. Referring to FIG. 4E, the input assistance device 107 includes a first braille input unit, a second braille input unit, and a menu selection input unit. The first braille input unit includes three braille input units, and the second braille input unit includes three braille input units different from the first braille input unit. When the visually impaired user inputs braille, the user may input using the first braille input unit using a finger of the right hand, and input using the second braille input unit using a finger of the left hand. The menu selection input unit is located between the first braille input unit and the second braille input unit. Referring to FIG. 4F, the input auxiliary device set 13 includes an input auxiliary device 108 and an electronic device auxiliary device 108-1. The input assistance device 108 includes a menu selection input unit, a braille input unit, and a gesture input unit for gesture input. The electronic device assisting device 108-1 may include concave or convex guides 108-2. It helps to know the sign input position when inputting electronic equipment. For example, when an input for driving a calculator is displayed on the touch display unit of the electronic device, the finger holding the electronic device is positioned in the concave or convex guides, and the electronic device is used to feel the finger. You can see the calculator input position of the hand that is not held.

5A to 5C, FIG. 5A is a view of FIG. 2 rotated 90 degrees to the left. 5B is a cross-sectional view of A to B of the input auxiliary device 100 of FIG. The cross-sectional view of the input assisting device 100 shows a front side F and a rear side R, and shows cross sections of the

braille input units

127, 128, and 129. The braille input unit 127 includes Brailles 127-1 and 127-2 to know the location and location of the braille input button. The braille input unit 127 includes a conductive material. Also, it may include a rubber material or a sponge material or a plastic material including a silicon material or a rubber material or a conductive material. The gesture input unit 110 of the input assistance device may include an empty space or a thin transparent plastic material 111. In addition, the

braille input unit

127, 128, 129 may include the same material as the material included. The thickness A of the disc 135 of the input auxiliary device 100 may be 2 mm or less as the thickness between the front surface F and the front surface R. FIG. The thickness B is the length from the front surface F of the input auxiliary device 100 to the braille that protrudes longest. The thickness C is the length from the surface of the

braille inputs

127, 128, 129 to the longest protruding braille. The thickness B may be larger than the thickness A in order to identify the

braille input units

127, 128, and 129 using only a feeling of a finger. However, when the discriminating power is increased, the difference between the thickness B and the thickness C can be almost equal to or smaller than zero. Referring to FIG. 5C, another cross-sectional view of the input auxiliary device 100 is illustrated. The cross section of the input interpolation device 100 includes an input auxiliary device disc 135, a gesture input unit 110, and

Braille input units

127, 128, and 19. The gesture input unit 110 may include a conductive material including a metal for gesture input. Also, it may include a rubber material or a sponge material or a plastic material including a silicon material or a rubber material or a conductive material. The thickness A is the thickness of the input auxiliary device disc 135. The thickness D is the length from the rear surface R of the input auxiliary device to the longest protruding braille of the

braille input units

127, 128, 129. The thickness A and the thickness D may be equal to or smaller than when the braille input unit is formed into a groove. Instead of the braille, you can make various protrusions such as squares, asterisks, and triangles. The difference between the thickness B and the thickness A may be 1 mm or less. When the visually impaired people use an input assistance device having a thickness of 1 mm or less, it is difficult to visually distinguish the input assistance device from other general users. The material of the gesture input unit 110 and the material of the

code input units

127a, 128a, and 129a may be formed of the same material. The gesture input unit 110 and the

code input units

127a, 128a, and 129a may transmit an input to an electronic device by a touch, and operate by a “TAP” gesture.

Referring to FIG. 6A, the electronic device 201 includes a gesture input receiver 210 and a code input receiver 240 including a smart phone key input unit. The gesture input receiver 210 may receive a horizontal gesture input and a vertical gesture input. The horizontal gesture input may be performed by contacting the finger or the object with electricity in the horizontal direction with the gesture input receiver and dragging the contact after a certain time.

Referring to FIG. 6B, the electronic device 200 includes a sign input receiver 240 including a gesture input receiver 210 and a braille input receiver. The touch input receiver 210 may receive a horizontal gesture input and a vertical gesture input.

Referring to FIG. 7, the upper and lower menus are selected through horizontal and vertical gesture inputs of the touch input unit 210 of the electronic device 201 of FIG. 6A and the electronic device 200 of FIG. 6B. Shows that One of the upper menus 1-0, 2-0, 3-0, 4-0, 5-0, 6-0 is selected by the horizontal gesture input. If the horizontal gesture is input from the right menu to the left side in the upper menu 5-0, the user moves to the upper menu 6-0, and if the horizontal gesture is input again from the right to the left side, the upper menu 1-0 can be selected. After selecting the upper menu 2-0, the lower menus 2-1, 2-2, and 2-3 can be selected by the vertical gesture input. When a vertical gesture is input from the top to the bottom of the screen of the upper menu 2-0, the lower menu 2-1 is selected. Repeat to select Menu 2-2. If it repeats again, it moves to the upper menu 2-0. The upper menu and the lower menu may be displayed on the gesture input receiver 210 on the touch display of the electronic device 200. After selecting the sub-menus 2-1 or the sub-menu 2-2, if the horizontal gesture is input from left to right, the menu moves directly to the upper menu 3-0 (A, B). can do. Although not shown in FIG. 7, the upper menu can be selected by the vertical gesture input, and the lower menu can be selected by the horizontal gesture input.

Referring to FIG. 8, the specific embodiment of FIG. 7 is described. The top menu includes directions, music, calculator, phone, current time, messages, weather, my location, internet, calendar, and app selection. The upper menu may further include a setting menu and a radio menu for setting the electronic device. The upper menu may be selected by a horizontal gesture input. After selecting a message menu, which is an upper menu, a message transmission, a message reading, a message storing, and a message searching menu, which are lower menus, may be selected by the horizontal gesture input. After selecting a message transmission, one of the lower menus, a horizontal gesture is input from right to left or from left to right to directly move to the current menu or the weather menu. The upper menus and the lower menus may be displayed in all or part of the gesture input receiver 210 of the electronic device 200. After selecting the app selection menu, which is the upper menu, and continuing the horizontal gesture input in the same direction, the user may move to the directions menu. In addition, after selecting a message storage menu, which is a sub-menu, and inputting a vertical gesture from the top to the bottom, a message search menu can be moved. The selected upper menu or lower menu can be executed by tap gesture input. When the horizontal or vertical gesture is paused for a predetermined time, the selected menus are determined as the selected menu and output the stored voice of the corresponding menu. The voice selected menu can be known.

Referring to FIG. 9, an interface method for selecting an upper and lower menu by horizontal and vertical gesture inputs is one of a plurality of applications (Applications, App 1, ..., App 16) on the electronic device 200. Can be used when selecting. For example, after selecting App6, App5 and App7 can be selected through the horizontal gesture. In addition, the app 2 and the app 10 may be selected through the vertical gesture input. The app screen may be composed of at least two apps. For example, App 1 and App 2 may be simultaneously displayed on one gesture input receiver 210. The horizontal and vertical gesture input may also be used when selecting group apps including a plurality of apps.

Referring to FIG. 10A, a corresponding menu may be immediately selected and executed by a gesture input input through the gesture input receiver 210 of the electronic device 200 of FIGS. 6A to 6B. Referring to the table of FIG. 10A, the menus for directions, music, calculator, current time, phone, message, weather, my location, internet, calendar, app selection, and setting menu are displayed according to the shortcut gesture type of the table. You can choose. Shortcut gesture types are Type 1 (1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12) and Type 2 (a, b, c, d, e, f, g, h, i) and type 3 (♡, C, A, ♪, □, ○, P, M, W, +, ☆, C, A). When the letters or shapes of the type 1, the type 2, and the type 3 are drawn as they are using a pen having a finger or electricity, the menu corresponding to the table of FIG. 10 can be moved and executed. For example, when the number “2” is drawn in contact with the gesture input receiver of the electronic device, the user may move to and execute the route guidance menu. As shown in FIG. 10B, if a code including Korean, English, numerals, and special characters is input like a letter, it may be converted into the same character as the input character. The shortcut gesture is converted into a voice and output at about the same time as the input.

11A and 11B, the

electronic device

200 or 201 includes a smartphone keyboard input receiver or a braille input receiver and a motion sensor 194. The motion sensor 194 may detect a hand motion or a horizontal motion and a vertical motion of an object. When the motion detection mode of the electronic device is set, the upper menu is selected by the horizontal motion as shown in the menu selection of FIG. 8 without receiving the gesture input of the gesture input receiving unit 210 and the vertical direction. You can select submenu by motion. The upper or lower menu can be selected as the stop motion or "click" sound of the human hand. Based on the screen of the gesture input receiver 201, the horizontal and vertical motion directions and the upper and lower menu moving directions are the same. For example, if you move your hand vertically up and down, the submenu will also move up and down.

Referring to FIG. 12A, the electronic device 300 is a tablet PC including a large screen touch display 310 for receiving a gesture input. In the tablet PC, an upper menu is selected through a horizontal gesture input, and a lower menu is selected through a vertical gesture input. The reverse is also possible. Referring to FIG. 12B, the electronic device 300 includes a motion sensor 394 and a large screen touch display 310 for receiving a gesture input. The motion sensor selects an upper menu by horizontal motion and a lower menu by vertical motion. The reverse is also possible.

Referring to FIG. 13A, the electronic device 400 includes a display on / off switch 410, a satellite or internet on / off switch 420, operation buttons 430, and a gesture input receiver 440. The gesture input receiver 440 selects an upper menu by a horizontal gesture input, and selects a lower menu by a vertical gesture input. The reverse is also possible. Referring to FIG. 13B, the electronic device 400 of FIG. 13A further includes a motion sensor 494. The motion sensor 494 may detect a horizontal motion to select an upper menu of a display screen such as a TV, and detect a vertical motion to select a lower menu. The reverse is also possible.

Referring to FIG. 14, the electronic device 200 of FIG. 2 is a system for gesture input and sign input processing of the input auxiliary device 100. In order to process the gesture input, the electronic device 200 may include a gesture input receiver 510, a gesture input identifier 511, a gesture processor 513, an operation processor 520, a memory 530, and a voice output unit. 550 and a code / Korean transmission unit 560. The gesture input is transmitted to the gesture input receiver 510, and the gesture input identification unit 521 converts various gesture inputs including horizontal or vertical gestures into digital signals and informs the operation processing controller 520. The arithmetic processing control unit 520 determines whether to output a screen, a message or a voice stored in the memory 530 according to the digital signal. The arithmetic processing control unit 520 may be a CPU or an AP. The gesture processor 513 includes a gesture / Hangul converter 524. The memory 530 is referred to by the digital signal of the gesture input identification unit 511, and based on the referenced result, the gesture / sign converter 514 uses the input gesture as a sign including letters, numbers, or special characters. Convert to The converted code is converted into voice by the voice converter 540 and output by the voice output unit 550. On the other hand, the code converted in the gesture input is transmitted as a message by the code / Hangul transmitter 560. For the sign input processing, the electronic device 200 includes a sign input identification unit 571 including a sign input receiving unit 570 and a braille input identification unit 572 and a braille / Hangul conversion unit 574. A code processing unit 573 is further included. The code input receiving unit 570 may receive Korean or English or Japanese or German or Chinese or Spanish or Portuguese or Russian or Hebrew or Hindi. Also, numbers (1, 2, ...) and special characters (@, #, #, $,%, ^, & ,, *, (,),-, +,?,>, [,], { ,},:,:, ", \, ~). The code input identification unit 571 may further include a numeric input identification unit and a special character identification unit for identifying the letters, the numbers, and the special characters. The braille input identification unit 572 of the sign input identification unit 571 is converted into a digital signal, and the result is transmitted to the arithmetic processing control unit 520 and the sign processing unit 573. The processing unit 573 includes a braille / Hangul conversion unit 574, and converts the braille input to Korean by referring to the hash table 531 of the memory 530. The result is converted into the voice conversion unit 540. After the voice signal is converted, the voice output unit 550 outputs the voice signal by the voice output unit 550. The gesture input and the code input may be simultaneously processed by the arithmetic processing control unit 520.

Referring to Fig. 15, the hash table 531 of Fig. 14 is shown. In the hash table 531, one of six braille combinations corresponds to Korean initial consonant, neutral vowel, and final consonant. Due to the characteristics of Braille and Hangul, there is a limit that one-to-one correspondence cannot be achieved. When entering Hangul consonants with one of the six Braille combinations, it is necessary to distinguish between the initial and the final Hangul. In addition, when inputting a vowel of Korean, it is necessary to distinguish between a short vowel and a double vowel. The hash table 531 converts Braille into Korean by using a hash table to distinguish between Korean initials, neutrals, and verticals corresponding to each Braille. The hash table 531 shows the horizontal addresses (1, 2, ..., 23) and the vertical addresses (1, 2, ..., 6). For example, when the vertical address is 1 and the horizontal address is 1, the input of the braille “ㄱ” may be recognized as “a” of the Hangul Jongjong and converted. The distinction between the initial and the finality of the braille input may be determined in the order from the first note input of the confirmation input receiver 231 of FIG. 2 until the next confirmation button is input. After inputting the Hangul Hangul characters, the Hangul characters received by the input of the confirmation input receiver 231 may be confirmed by voice. "Second" of the hash table means initial property, and "parent" means vowel. The hash table may be constructed in other combinations. The hash table can be used to convert Braille to English or Japanese or German or Chinese or Spanish or Portuguese or Russian or Hebrew or Hindi.

Referring to FIG. 16, a method of operating the electronic device 200 of FIG. 2 is described. The electronic device 200 receives a horizontal motion by the gesture input receiver from the horizontal direction gesture or the motion sensor 610 and performs a horizontal motion by the gesture input identifier by the horizontal gesture or the motion sensor. Recognizing step 620 and selecting the upper menu corresponding to the horizontal motion by the horizontal gesture or the motion sensor by the operation processing control unit 630 and vertical gesture or the by the gesture input receiver Receiving vertical motion by a motion sensor (640), Recognizing the vertical motion by the vertical gesture or the motion sensor by the gesture input receiver (650) and by the arithmetic processing control unit To select a vertical gesture or a sub-menu corresponding to the vertical motion And a system (660).

Referring to FIG. 17, the electronic device 200 may include booting an electronic device (710), automatically executing a program for the visually impaired by the electronic device (720), and executing a general program by the electronic device. Or maintaining (730) an active state and selecting (740) upper and lower menus by recognizing horizontal and vertical gestures or horizontal and vertical motions by the arithmetic processing control unit of the electronic device.

Referring to FIG. 18, another method of operation of the electronic device 200 is described. Receiving the braille by the braille input receiver 810 of the electronic device 200 and converting the braille input to Korean or English by the code processor 820 and the Hangul or the converted by the voice converter Converting English to speech 830 and outputting the converted speech signal to speech 840.

Referring to FIG. 19, a method of selecting a telephone number of the electronic device 200 is described. First, a horizontal gesture or motion 950 is used to select the first Korean letter (ㄱ, ㄴ, ..., ㅎ) or the first letter of English name (A, B, ..., Z) as the upper menu. Can be. The selected first Korean letter or first letter of English may be displayed on the gesture

input receiving unit

901, 902, 903, ..., 90n. Next, a

name

921, 922,..., 927 of the person who wants to call the vertical gesture or motion 960 may be selected as a submenu. After selecting a submenu, you can call the Tap gesture. For example, "a" or "A" may be first selected by the horizontal gesture or motion input, and "kim-gil" or "Amus" may be selected by the vertical gesture or motion input. For example, when the current selection is the gesture input receiver 902, the finger 950 moves in close contact with the gesture input receiver 902 in a first horizontal touch direction 950-2 (right to left) to move a predetermined distance. After the separation, the controller moves to the gesture input receiver 903 according to the menu movement direction 950-4. When the finger 950 moves in close contact with the gesture input receiving unit 902 in the second horizontal touch direction 950-1 (from left to right), and then separates the finger 950, the finger 950 is moved according to the menu moving direction 950-3. The gesture input receiver 901 is moved. The first horizontal touch direction 950-2 (right to left) and the second horizontal touch direction 950-1 (left to right) which are the horizontal direction gestures are the moving directions 950-4 and 950-of the upper menu. The opposite of 3). On the other hand, when the gesture input receiver 901 is selected and a lower menu is selected, the finger 960 is in close contact with the gesture input receiver 901 in the first vertical touch direction 960-2, from the top to the bottom. If the distance is moved and then separated, the submenu “Steel” 921 is selected. In addition, when the finger 960 moves in close contact with the gesture input receiver 901 in the second vertical touch direction 960-1 (from the top to the bottom) after moving a predetermined distance, the sub-menu “Kim Gil-dong” 923 is displayed. Is selected. The first vertical touch and the second vertical touch input directions of the vertical gesture are opposite to the moving directions 960-3 and 960-4 of the submenu. Based on the upper or lower menu displayed on the gesture input receiver 902 of the electronic device 200, the vertical and horizontal touch directions and the upper and lower menu moving directions are the same. The relationship between the horizontal and vertical touch directions and the moving directions of the upper and lower menus can be relatively viewed according to the reference.

20A and 20B, the electronic device set device 30 includes an input auxiliary device 105 and an electronic device 203. The input auxiliary device 105 may include a first operation input unit 150 and a second operation input unit 151 for input of the electronic device 203, a function input button unit 153 for setting, a gesture input, and the electronic input. The gesture input / screen display unit 155 for viewing the screen of the device 203 is included. The electronic device 203 includes a first manipulation input receiver 250, a second manipulation input receiver 251, a function input button receiver 253, a gesture input receiver, and a screen display output unit 255. The

input units

150, 151, 153, and 155 of the input auxiliary device 105 are located at different positions in the input auxiliary device 105, respectively. In addition, the

input receivers

250, 251, 253, and 255 of the electronic device 203 are located at different positions in the electronic device 203, respectively. When the input auxiliary device 105 is positioned on the electronic device 203, the respective input units and the input receivers are located at the same position. For example, the position of the first manipulation input unit 150 is located at substantially the same position as the first manipulation input receiver 250. The inputs of the input auxiliary device 105 may be used as an input auxiliary device for game operation. In addition, the input receivers of the electronic device 203 may be used for input processing for a game. Referring to FIG. 20B, the electronic device set device 30 of FIG. 20A includes a gesture input unit, a screen display input unit 154, a third manipulation input unit 152, a fourth manipulation input unit 158, and a motion sensor home of a larger size. And an input auxiliary device 105 including 157 and 157-1. Due to the larger gesture input unit and the screen display input unit 156, the third manipulation input unit 150 is located directly below the spigger output unit 159. In addition, the electronic device set device 30 of FIG. 20B includes a gesture input unit and a screen display input receiver 256, a third manipulation input receiver 251, a fourth manipulation input receiver 250, and a motion sensor 257 having a larger size. It may include an electronic device 203 including). When the input auxiliary device 105 and the electronic device 203 are turned on, the positions of the input parts of the input auxiliary device 105 and the receivers of the electronic device 203 are substantially the same. The electronic device set device 30 may further include input and

reception units

152, 158, 252, and 258 of operation buttons for the convenience of game operation.

Referring to FIG. 21, a method of manufacturing the input auxiliary device 100 is described. The method of manufacturing the input auxiliary device 100 includes a step of making an electronic device cover almost identical to the size of the electronic device for input to the electronic device 100 and a gesture input unit and a sign for inputting a gesture to the electronic device cover. Distinguishing a sign input unit for input (971), removing the gesture input unit and the sign input unit from the cover (972), a gesture input unit capable of touch input using a material different from the cover material, and a sign input capable of touch input A step (973) of combining the electronic device cover with the gesture input unit and the code input unit with the touch input unit including the material different from the electronic device cover and the sign input unit including the touch input unit Step 974. The touch input unit and the touch input code input unit of the input assistance device 100 may be made of a silicon material or a rubber material or a sponge material including a conductive material.

Claims

An input auxiliary device including a gesture input unit for gesture input and a code input unit for sign input; And

And an electronic device including a gesture input receiver configured to receive the gesture input and a code input receiver configured to receive the code input.
The apparatus of claim 1, wherein the electronic device is a smartphone, a game machine, a remote control, a calculator, or a tablet PC.
The apparatus of claim 1, wherein the code input unit comprises a braille input unit for braille input.
The apparatus of claim 3, wherein the braille input unit is a rubber material or a sponge material including a silicon material, a rubber material, or a metal.
The apparatus of claim 1, wherein the sign input unit comprises a Korean input unit for Korean input, a numeric input unit for numeric input, or an English input unit for English input.
The apparatus of claim 5, wherein the Hangul input unit, the numeric input unit, or the English input unit is a rubber material or a sponge material including a silicon material, a rubber material, or a metal.
The electronic device of claim 1, further comprising a touch display unit including the gesture input receiver and the code input receiver, and a voice output unit to inform the gesture input or the code input by voice. Set device
The apparatus of claim 1, wherein the gesture input selects an upper menu according to a horizontal gesture, and selects a lower menu according to a vertical gesture.
The apparatus of claim 8, wherein the upper menu is a message menu or a phone menu.
The apparatus of claim 9, wherein the lower menu is a message transmission menu or a message storage menu according to the selection of the upper message related menu.
The electronic device of claim 1, further comprising a braille / character converter configured to convert the braille input into Hangul or English or Japanese or German or Chinese or Spanish or Portuguese or Russian or Hebrew or Hindi characters. Appliance set device
The apparatus of claim 11, wherein the braille / character converter converts the data by referring to a hash table.
The apparatus of claim 1, wherein a material of the gesture input unit and a material of the code input unit are the same.
A gesture input unit for gesture input; And

A sign input unit for sign input,

And the gesture input unit and the sign input unit are located at different positions.
The input assisting device of claim 14, wherein the input assisting device is a smartphone cover.
The input assistance apparatus of claim 14, wherein the sign input unit comprises a braille input unit for braille input.
The input assistance device of claim 16, wherein the braille input unit is a rubber material or a sponge material including a silicon button or a rubber material or a metal.
The apparatus of claim 14, wherein the sign input unit comprises a Korean input unit for Korean input, a numeric input unit for numeric input, or an English input unit for English input.
The input assistance apparatus of claim 18, wherein the Hangul input unit, the numeric input unit, or the English input unit is a rubber material or a sponge material including a silicon material, a rubber material, or a metal.
Smartphone cover, characterized in that it comprises a braille input unit comprising at least six braille input buttons or holes located at different positions for braille input
21. The smartphone cover of claim 20, further comprising a sign input unit including at least one sign input button or hole for sign input.
And a touch display unit including a gesture input receiving unit for receiving a gesture input and a code input receiving unit for receiving a sign input, wherein the gesture input receiving unit and the sign input receiving unit are located at different positions of the touch display unit. Electronics
The electronic device of claim 22, wherein the electronic device is a smartphone, a game machine, a remote control, a calculator, or a tablet PC.
23. The electronic device of claim 22, wherein the electronic device further comprises a voice output unit for notifying the gesture input and the code input by voice.
The electronic device of claim 22, wherein the gesture input selects an upper menu according to a horizontal gesture and selects a lower menu according to a vertical gesture.
The electronic device of claim 25, wherein the upper menu includes a message menu or a phone menu.
The electronic device of claim 25, wherein the lower menu is a message transmission menu or a message storage menu according to the upper message related menu selection.
The electronic device of claim 22, wherein the electronic device further comprises a braille / character converter for converting the braille input into Korean, English, Japanese, German, Chinese, Spanish, Portuguese, Russian, Hebrew, or Hindi characters. device
The electronic device of claim 28, wherein the braille / character converter converts the data by referring to a hash table.
And an motion sensor for selecting an upper menu according to the horizontal motion and selecting a lower menu according to the vertical motion.
The electronic device of claim 30, wherein the electronic device is a smartphone, a game machine, a remote control, a calculator, or a tablet PC.
The electronic device of claim 30, wherein the motion sensor selects the upper menu according to the vertical motion and selects the lower menu according to the horizontal motion.