CN110931011A - AI intelligent voice interaction method applied to intelligent retail equipment - Google Patents

AI intelligent voice interaction method applied to intelligent retail equipment Download PDF

Info

Publication number
CN110931011A
CN110931011A CN202010015341.1A CN202010015341A CN110931011A CN 110931011 A CN110931011 A CN 110931011A CN 202010015341 A CN202010015341 A CN 202010015341A CN 110931011 A CN110931011 A CN 110931011A
Authority
CN
China
Prior art keywords
voice
intelligent
processing module
module
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010015341.1A
Other languages
Chinese (zh)
Inventor
李亚橙
陈高其
姜凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Kaiqi Technology Co Ltd
Original Assignee
Hangzhou Kaiqi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Kaiqi Technology Co Ltd filed Critical Hangzhou Kaiqi Technology Co Ltd
Priority to CN202010015341.1A priority Critical patent/CN110931011A/en
Publication of CN110931011A publication Critical patent/CN110931011A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Cash Registers Or Receiving Machines (AREA)

Abstract

The invention relates to the technical field of unmanned retail, and discloses an AI intelligent voice interaction method applied to intelligent retail equipment. The output end of the camera is connected with the input end of the image recognition processing module, the output end of the earphone is connected with the input end of the voice input processing module, the input end of the control module is simultaneously connected with the output ends of the background information management module, the image recognition processing module and the voice input processing module, the output end of the control module is connected with the input end of the voice output processing module, and the output end of the voice output processing module is connected with the equipment body loudspeaker box. According to the invention, through voice interaction and control, the functionality of the intelligent retail equipment is enhanced, the technological sense of the intelligent retail equipment is enhanced, the interactivity of the intelligent retail equipment and a user is enriched, and the consumption experience of the user is improved.

Description

AI intelligent voice interaction method applied to intelligent retail equipment
Technical Field
The invention belongs to the technical field of unmanned retail, and particularly relates to an AI intelligent voice interaction method applied to intelligent retail equipment.
Background
With the explosion of the unmanned retail industry, intelligent retail equipment is in force and gradually becomes a key component of the field of unmanned retail. The birth of the intelligent retail device provides more diversified consuming ways, more convenient consuming means and more pleasant consuming experience for consumers.
The intelligent retail equipment is a product which meets the requirements of customers, provides goods and obtains corresponding currency in an environment without manual intervention, and the usability and the intelligent degree of the functions of the intelligent retail equipment directly influence the consumption experience of consumers and further influence the development of the unmanned retail industry. However, the existing intelligent retail equipment has a single functionality, and the main function development angles are from operators or equipment developers, such as highly adaptive shelves, pure gravity identification, interference or prevention of radio frequency signal leakage, and the like, and the function development angles from consumers are seriously lacked.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: the AI intelligent voice interaction method applied to the intelligent retail equipment enables the intelligent retail equipment to perform personalized voice conversation with a user, enhances man-machine interaction, stimulates the consumption desire of the user, and improves the consumption experience of the user.
In order to solve the technical problems, the invention adopts the following technical scheme:
an AI intelligent voice interaction method applied to intelligent retail equipment comprises a camera for collecting images, an image recognition processing module, a receiver for collecting sound, a voice input processing module, a background user information management module, a control module, a voice output processing module and a sound box for outputting sound by a user;
the output end of the camera is connected with the input end of the image recognition processing module and is used for collecting image information;
the output end of the image recognition processing module is connected with the input end of the control module and is used for recognizing and processing the acquired image information and transmitting the image information to the control module;
the output end of the receiver is connected with the input end of the voice input processing module and used for collecting voice information;
the output end of the voice input processing module is connected with the input end of the control module and used for recognizing, processing and transmitting the collected voice information to the control module;
the output end of the background user information management module is connected with the input end of the control module and is used for transmitting the collected background user information to the control module;
the control module receives and processes the image information recognition processing result transmitted by the image recognition processing module, the voice information recognition processing result transmitted by the voice input processing module and the background user information transmitted by the background user information management module;
the output end of the control module is connected with the input end of the voice output processing module and is used for converting the information transmitted by the control module;
the output end of the voice output processing module is connected with the input end of the sound box and used for outputting voice information.
Preferably, the background user information management module can store and query a user historical purchase record and analyze the user purchase habits.
Preferably, the image recognition processing module can perform image processing operations such as conversion and processing of image information acquired by the camera, package image digitization, image enhancement, image data encoding, and image recognition.
Preferably, the voice input module can convert and process the input sound signal, including sound preprocessing operations such as noise processing and spectrum analysis.
Preferably, the control module can identify the input image and voice, extract keywords and features, match the voice data with the data transmitted by the background user information management module for user information, and form personalized dialogue language conforming to the user and control output by combining the user purchasing habits conforming to the matching result.
Preferably, the background user information management module, the image recognition processing module, the voice output processing module, the control module and the voice output processing module may be integrated into a host and installed in the console.
Preferably, the receiver, the sound box and the camera are used as hardware equipment for man-machine interaction between the intelligent retail equipment and the user, and the installation positions of the hardware equipment are optimally adjusted according to the scene of the layout of the intelligent retail equipment, so that the equipment can acquire user information to the maximum extent.
The invention has the beneficial effects that:
according to the invention, through voice interaction control, the functionality of the intelligent retail equipment is enhanced, the technological sense of the intelligent retail equipment is enhanced, the interactivity of the intelligent retail equipment and a user is enriched, the consumption experience of the user is improved, and a reliable equipment foundation is provided for the unmanned retail industry.
Drawings
FIG. 1 is a schematic structural diagram of an AI intelligent voice interaction method applied to an intelligent retail device according to the invention;
fig. 2 is a schematic diagram of the installation of the components of the AI intelligent voice interaction method applied to the intelligent retail device in the intelligent retail device.
Wherein: 1. a camera; 2. a handset; 3. a sound box.
Detailed Description
The following detailed description of the preferred embodiments of the present invention, taken in conjunction with the accompanying drawings, will make the advantages and features of the invention easier to understand by those skilled in the art, and thus will clearly and clearly define the scope of the invention.
Referring to fig. 1 and 2, an embodiment of the present invention includes:
an AI intelligent voice interaction method applied to intelligent retail equipment comprises a camera for collecting images, an image recognition processing module, a receiver for collecting sound, a voice input processing module, a background user information management module, a control module, a voice output processing module and a sound box for outputting sound by a user;
the output end of the camera is connected with the input end of the image recognition processing module and is used for collecting image information;
the output end of the image recognition processing module is connected with the input end of the control module and is used for recognizing and processing the acquired image information and transmitting the image information to the control module;
the output end of the receiver is connected with the input end of the voice input processing module and used for collecting voice information;
the output end of the voice input processing module is connected with the input end of the control module and used for recognizing, processing and transmitting the collected voice information to the control module;
the output end of the background user information management module is connected with the input end of the control module and is used for transmitting the collected background user information to the control module;
the control module receives and processes the image information recognition processing result transmitted by the image recognition processing module, the voice information recognition processing result transmitted by the voice input processing module and the background user information transmitted by the background user information management module;
the output end of the control module is connected with the input end of the voice output processing module and is used for converting the information transmitted by the control module;
the output end of the voice output processing module is connected with the input end of the sound box and used for outputting voice information.
Preferably, the background user information management module can store and query a user historical purchase record and analyze the user purchase habits.
Preferably, the image recognition processing module can perform image processing operations such as conversion and processing of image information acquired by the camera, package image digitization, image enhancement, image data encoding, and image recognition.
Preferably, the voice input module can convert and process the input sound signal, including sound preprocessing operations such as noise processing and spectrum analysis.
Preferably, the control module can identify the input image and voice, extract keywords and features, match the voice data with the data transmitted by the background user information management module for user information, and form personalized dialogue language conforming to the user and control output by combining the user purchasing habits conforming to the matching result.
Preferably, the background user information management module, the image recognition processing module, the voice output processing module, the control module and the voice output processing module may be integrated into a host and installed in the console.
Preferably, the receiver, the sound box and the camera are used as hardware equipment for man-machine interaction between the intelligent retail equipment and the user, and the installation positions of the hardware equipment are optimally adjusted according to the scene of the layout of the intelligent retail equipment, so that the equipment can acquire user information to the maximum extent.
For example, when a user enters a camera detection area of the intelligent retail equipment, the system can automatically acquire image information of the user, the system can actively carry out voice communication with the user according to the acquired user information, and when the user scans the two-dimensional code on the intelligent retail equipment and the scanning is successful, the intelligent retail equipment is unlocked and the user is prompted to open a gate of the equipment through voice. At this time, the system further performs personalized man-machine interaction with the user according to the user information such as the user historical purchase record and the like stored in the background user information management module, wherein the personalized man-machine interaction comprises the steps that the home page of the intelligent retail equipment displays commodities which the user may like, and related preferential activities of the voice interaction user like products and the like. Furthermore, when the user speaks the desired content, such as the name of a specific commodity, the price of the specific commodity, the introduction of the specific commodity, the latest sold commodity, the future weather condition, even the coupon of the commodity, etc., the system can recognize and output the corresponding result through the equipment sound box.
It should be noted that, in the above system embodiment, each included unit is only divided according to functional logic, but is not limited to the above division as long as the corresponding function can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
In addition, those skilled in the art will appreciate that all or part of the steps in the method for implementing the embodiments described above can be implemented by hardware related to program instructions.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise embodiments disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention. The invention is limited only by the claims and their full scope and equivalents.

Claims (7)

1. An AI intelligent voice interaction method applied to intelligent retail equipment is characterized in that: the system comprises a camera for collecting images, an image recognition processing module, a receiver for collecting sound, a voice input processing module, a background user information management module, a control module, a voice output processing module and a sound box for outputting sound by a user;
the output end of the camera is connected with the input end of the image recognition processing module and is used for collecting image information;
the output end of the image recognition processing module is connected with the input end of the control module and is used for recognizing and processing the acquired image information and transmitting the image information to the control module;
the output end of the receiver is connected with the input end of the voice input processing module and used for collecting voice information;
the output end of the voice input processing module is connected with the input end of the control module and used for recognizing, processing and transmitting the collected voice information to the control module;
the output end of the background user information management module is connected with the input end of the control module and is used for transmitting the collected background user information to the control module;
the control module receives and processes the image information recognition processing result transmitted by the image recognition processing module, the voice information recognition processing result transmitted by the voice input processing module and the background user information transmitted by the background user information management module;
the output end of the control module is connected with the input end of the voice output processing module and is used for converting the information transmitted by the control module;
the output end of the voice output processing module is connected with the input end of the sound box and used for outputting voice information.
2. The AI intelligent voice interaction method of claim 1 applied to an intelligent retail device, wherein: the background user information management module can store and inquire the historical purchase records of the user and analyze the purchase habits of the user.
3. The AI intelligent voice interaction method of claim 1 applied to an intelligent retail device, wherein: the image recognition processing module can convert and process image information acquired by the camera, and perform image processing operations such as block image digitization, image enhancement, image data coding, image recognition and the like.
4. The AI intelligent voice interaction method of claim 1 applied to an intelligent retail device, wherein: the voice input module can convert and process input voice signals, and comprises voice preprocessing operations such as noise processing and spectrum analysis.
5. The AI intelligent voice interaction method of claim 1 applied to an intelligent retail device, wherein: the control module can identify the input image and voice, extract keywords and features, match the voice data with the data transmitted by the background user information management module for user information, and form personalized dialogue language conforming to the user and control the output by combining the user purchasing habits conforming to the matching result.
6. The AI intelligent voice interaction method of claim 1 applied to an intelligent retail device, wherein: the background user information management module, the image recognition processing module, the voice output processing module, the control module and the voice output processing module can be integrated into a host and installed in the center console.
7. The AI intelligent voice interaction method of claim 1 applied to an intelligent retail device, wherein: the earphone, the sound box and the camera are used as hardware equipment for man-machine interaction between the intelligent retail equipment and the user, and the installation position of the hardware equipment is optimized and adjusted according to the layout scene of the intelligent retail equipment, so that the equipment can acquire user information to the maximum extent.
CN202010015341.1A 2020-01-07 2020-01-07 AI intelligent voice interaction method applied to intelligent retail equipment Pending CN110931011A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010015341.1A CN110931011A (en) 2020-01-07 2020-01-07 AI intelligent voice interaction method applied to intelligent retail equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010015341.1A CN110931011A (en) 2020-01-07 2020-01-07 AI intelligent voice interaction method applied to intelligent retail equipment

Publications (1)

Publication Number Publication Date
CN110931011A true CN110931011A (en) 2020-03-27

Family

ID=69854425

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010015341.1A Pending CN110931011A (en) 2020-01-07 2020-01-07 AI intelligent voice interaction method applied to intelligent retail equipment

Country Status (1)

Country Link
CN (1) CN110931011A (en)

Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017034441A1 (en) * 2015-08-21 2017-03-02 Кирилл Эдуардович ПИЩИК Vending machine for distance selling regulated goods
CN106886912A (en) * 2011-10-28 2017-06-23 阿迪达斯股份公司 Interactive retail system
CN107331048A (en) * 2017-07-05 2017-11-07 李大宁 Unattended store system and retail method
CN107590905A (en) * 2017-09-25 2018-01-16 福州米鱼信息科技有限公司 Artificial intelligence sells cargo aircraft automatically
CN107680261A (en) * 2017-09-25 2018-02-09 福州米鱼信息科技有限公司 A kind of automatic vending system
CN107730726A (en) * 2017-10-23 2018-02-23 秦卓奕 A kind of commodity, service sales exhibition method and intelligence sales exhibition terminal
CN107977852A (en) * 2017-09-29 2018-05-01 京东方科技集团股份有限公司 A kind of intelligent sound purchase guiding system and method
CN108182939A (en) * 2017-12-13 2018-06-19 苏州车萝卜汽车电子科技有限公司 For the method for speech processing and device of Self-Service
CN108242102A (en) * 2017-12-28 2018-07-03 纳恩博(北京)科技有限公司 Information processing method and device, electronic equipment and storage medium
CN108416909A (en) * 2018-04-23 2018-08-17 福建自贸试验区厦门片区益客联信息科技有限公司 A kind of intelligence sales counter and intelligent good selling method
CN108748218A (en) * 2018-08-27 2018-11-06 浙江华嘉驰智能科技有限公司 New retail intelligent shopping guide robot and shopping guide method based on machine vision Yu AR technologies
CN108922028A (en) * 2018-08-03 2018-11-30 济南每日优鲜便利购网络科技有限公司 Automatic vending equipment, the control method and system of automatic vending equipment
CN208298301U (en) * 2018-04-23 2018-12-28 福建自贸试验区厦门片区益客联信息科技有限公司 A kind of intelligence sales counter
CN109109857A (en) * 2018-09-05 2019-01-01 深圳普思英察科技有限公司 A kind of unmanned vendors' cart and its parking method and device
CN109801438A (en) * 2019-01-18 2019-05-24 创新奇智(南京)科技有限公司 A kind of intelligent sales counter based on recognition of face and interactive voice
CN109920404A (en) * 2019-01-31 2019-06-21 安徽智佳信息科技有限公司 Possess the information collecting device and acquisition method of the automatic selling Advertising Management System of Intellisense effect
CN110097687A (en) * 2019-01-31 2019-08-06 安徽智佳信息科技有限公司 Automatic selling Advertising Management System with Intellisense function
CN110113646A (en) * 2019-03-27 2019-08-09 深圳康佳电子科技有限公司 Intelligent interaction processing method, system and storage medium based on AI voice
CN110634053A (en) * 2019-09-24 2019-12-31 广东爱贝佳科技有限公司 Active interactive intelligent selling system and method

Patent Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106886912A (en) * 2011-10-28 2017-06-23 阿迪达斯股份公司 Interactive retail system
WO2017034441A1 (en) * 2015-08-21 2017-03-02 Кирилл Эдуардович ПИЩИК Vending machine for distance selling regulated goods
CN107331048A (en) * 2017-07-05 2017-11-07 李大宁 Unattended store system and retail method
CN107590905A (en) * 2017-09-25 2018-01-16 福州米鱼信息科技有限公司 Artificial intelligence sells cargo aircraft automatically
CN107680261A (en) * 2017-09-25 2018-02-09 福州米鱼信息科技有限公司 A kind of automatic vending system
CN107977852A (en) * 2017-09-29 2018-05-01 京东方科技集团股份有限公司 A kind of intelligent sound purchase guiding system and method
CN107730726A (en) * 2017-10-23 2018-02-23 秦卓奕 A kind of commodity, service sales exhibition method and intelligence sales exhibition terminal
CN108182939A (en) * 2017-12-13 2018-06-19 苏州车萝卜汽车电子科技有限公司 For the method for speech processing and device of Self-Service
CN108242102A (en) * 2017-12-28 2018-07-03 纳恩博(北京)科技有限公司 Information processing method and device, electronic equipment and storage medium
CN108416909A (en) * 2018-04-23 2018-08-17 福建自贸试验区厦门片区益客联信息科技有限公司 A kind of intelligence sales counter and intelligent good selling method
CN208298301U (en) * 2018-04-23 2018-12-28 福建自贸试验区厦门片区益客联信息科技有限公司 A kind of intelligence sales counter
CN108922028A (en) * 2018-08-03 2018-11-30 济南每日优鲜便利购网络科技有限公司 Automatic vending equipment, the control method and system of automatic vending equipment
CN108748218A (en) * 2018-08-27 2018-11-06 浙江华嘉驰智能科技有限公司 New retail intelligent shopping guide robot and shopping guide method based on machine vision Yu AR technologies
CN109109857A (en) * 2018-09-05 2019-01-01 深圳普思英察科技有限公司 A kind of unmanned vendors' cart and its parking method and device
CN109801438A (en) * 2019-01-18 2019-05-24 创新奇智(南京)科技有限公司 A kind of intelligent sales counter based on recognition of face and interactive voice
CN109920404A (en) * 2019-01-31 2019-06-21 安徽智佳信息科技有限公司 Possess the information collecting device and acquisition method of the automatic selling Advertising Management System of Intellisense effect
CN110097687A (en) * 2019-01-31 2019-08-06 安徽智佳信息科技有限公司 Automatic selling Advertising Management System with Intellisense function
CN110113646A (en) * 2019-03-27 2019-08-09 深圳康佳电子科技有限公司 Intelligent interaction processing method, system and storage medium based on AI voice
CN110634053A (en) * 2019-09-24 2019-12-31 广东爱贝佳科技有限公司 Active interactive intelligent selling system and method

Similar Documents

Publication Publication Date Title
CN102298443B (en) Smart home voice control system combined with video channel and control method thereof
CN106778179B (en) Identity authentication method based on ultrasonic lip language identification
US6543052B1 (en) Internet shopping system utilizing set top box and voice recognition
CN1752975B (en) Method and system for voice-enabled autofill
US20200219384A1 (en) Methods and systems for ambient system control
CN105740686A (en) Application control method and device
GB0501642D0 (en) Portal for distributing business and product information
CN106653031A (en) Voice wake-up method and voice interaction device
WO2023222089A1 (en) Item classification method and apparatus based on deep learning
CN101740028A (en) Voice control system of household appliance
CN102779509A (en) Voice processing equipment and voice processing method
CN104820921A (en) Method and device for transaction in user equipment
CN104505091A (en) Human-machine voice interaction method and human-machine voice interaction system
CN110164455A (en) Device, method and the storage medium of user identity identification
CN108111538A (en) Smart projector speech control system and its method based on sound groove recognition technology in e
CN102354461A (en) Reading system and reading device client, server as well as reading method thereof
CN103632276A (en) Anti-fake system and method for extracting real-time videos through scanning two-dimension codes of commodities by virtue of mobile phone
CN101505328A (en) Network data retrieval method applying speech recognition and system thereof
CN110931011A (en) AI intelligent voice interaction method applied to intelligent retail equipment
US20120330663A1 (en) Identity authentication system and method
CN109564758A (en) Electronic equipment and its audio recognition method
CN117198311A (en) Voice control method and device based on voice noise reduction
US20070061395A1 (en) Gateway apparatus for information processing using mobile communication
CN208819593U (en) Image processing system with voice control function
CN110503975B (en) Smart television voice enhancement control method and system based on multi-microphone noise reduction

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20200327