WO2017071420A1 - Method, apparatus and system for voice communication with smart device - Google Patents

Method, apparatus and system for voice communication with smart device Download PDF

Info

Publication number
WO2017071420A1
WO2017071420A1 PCT/CN2016/099097 CN2016099097W WO2017071420A1 WO 2017071420 A1 WO2017071420 A1 WO 2017071420A1 CN 2016099097 W CN2016099097 W CN 2016099097W WO 2017071420 A1 WO2017071420 A1 WO 2017071420A1
Authority
WO
WIPO (PCT)
Prior art keywords
smart device
voice
command
smart
string
Prior art date
Application number
PCT/CN2016/099097
Other languages
French (fr)
Chinese (zh)
Inventor
王涛
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2017071420A1 publication Critical patent/WO2017071420A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/26—Devices for calling a subscriber
    • H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/274—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
    • H04M1/2745—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/26—Devices for calling a subscriber
    • H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/274—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
    • H04M1/2745—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
    • H04M1/27453—Directories allowing storage of additional subscriber data, e.g. metadata
    • H04M1/27457—Management thereof, e.g. manual editing of data
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/26—Devices for calling a subscriber
    • H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/271—Devices whereby a plurality of signals may be stored simultaneously controlled by voice recognition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72418—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting emergency services
    • H04M1/72421—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting emergency services with automatic activation of emergency service functions, e.g. upon sensing an alarm
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72484—User interfaces specially adapted for cordless or mobile telephones wherein functions are triggered by incoming communication events
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725—Cordless telephones
    • H04M1/72502—Cordless telephones with one base station connected to a single line
    • H04M1/72505—Radio link set-up procedures
    • H04M1/72511—Searching for available channels
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/26—Devices for calling a subscriber
    • H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/274—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
    • H04M1/2745—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
    • H04M1/2753—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips providing data content

Definitions

  • the present invention relates to the field of smart home communication, and in particular, to a method, device and system for voice communication of a smart device.
  • the voice interaction between human and intelligent hardware and smart home is basically one-way, that is, the control of people on the device. Two ways:
  • the person controls the device by voice through the mobile terminal and the wearable device.
  • the embodiment of the invention provides a method, a device and a system for voice communication of a smart device, so that voice communication can be realized between a person and an intelligent hardware.
  • a smart device voice communication method includes:
  • the method includes:
  • binding the smart device comprises:
  • establishing a voice connection with the smart device includes:
  • the embodiment of the present invention further provides a method for voice communication of a smart device, including:
  • an embodiment of the present invention further provides a smart device voice communication device, including:
  • a first voice switching module configured to establish a voice connection with the smart device
  • a first language mapping module configured to receive a voice input of the user, and map the voice input to a command or a character string corresponding to the smart device;
  • the first communication module is configured to send the command or string to the smart device.
  • the device further comprises:
  • the address book management module is configured to search for and bind the smart device.
  • the address book management module is further configured to:
  • establishing a voice connection between the voice switching module and the smart device means:
  • an embodiment of the present invention further provides a smart device voice communication device, including:
  • a second communication module configured to receive a notification request sent by the smart device
  • a second voice switching module configured to establish a voice connection with the smart device
  • the second language mapping module is configured to receive a command or a string sent by the smart device, and map the command or string into a natural language.
  • an embodiment of the present invention further provides a smart device voice communication system, including the above-mentioned smart device voice communication device and smart device.
  • the embodiment of the present invention has the following beneficial effects:
  • the solution provided by the embodiment of the present invention uses natural language interaction between the user and the mobile phone when the user talks with the smart device; and provides a mapping mechanism between the mobile phone and the smart device to complete the "command/string" and the "natural” in real time.
  • the remote communication mode of people and devices can be changed from the centralized control mode of the APP to the voice communication dialogue mode before the ordinary person and the person.
  • the design of the existing smart device is retained, and there is no need to add additional components such as SIM card, voice input and output, etc., which saves cost and is easily accepted by home appliance manufacturers.
  • FIG. 1 is a flowchart of a method for voice communication of a smart device according to an embodiment of the present invention
  • FIG. 2 is a flowchart of another method for voice communication of a smart device according to an embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of a voice communication device of a smart device according to an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of another smart device voice communication device according to an embodiment of the present invention.
  • FIG. 5 is a flowchart of adding a device contact according to Embodiment 1 of the present invention.
  • FIG. 6 is a schematic diagram of a call link according to Embodiment 1 of the present invention.
  • FIG. 7 is a schematic diagram of a language mapping engine according to Embodiment 1 of the present invention.
  • an embodiment of the present invention provides a method for voice communication of a smart device, including:
  • the method Before establishing a voice connection with the smart device, the method includes:
  • the binding the smart device includes:
  • the establishing a voice connection with the smart device includes:
  • the embodiment of the present invention provides a method for voice communication of a smart device, including:
  • the smart device can appear as an independent individual in the mobile phone's address book; the person calls the smart device, establishes the call link, asks the status of the intelligent hardware, requires the intelligent hardware to do certain things; the intelligent hardware caller establishes the call link, tells the person Whether or not the inquirer is going to take certain actions in his current state and requirements.
  • the mobile phone After the mobile phone first scans to the smart device and establishes a connection with the smart device, the mobile phone prompts the user whether to add a device contact in the address book. Once added, the user can learn about the device details in the contact entry and learn about the device's features and supported features.
  • the user can find the device in the contact list and use a normal call to establish a connection with the device. After the call, the user uses the natural language to query the current state of the device, and asks the device to perform a certain job.
  • the smart device When the smart device generates some alarm events or reaches a certain condition preset by the user, the smart device will initiate a call and a contact call occurs on the user's mobile phone. After the user answers, you can hear the device notification described by the natural language mode, and you can use the technology in 2 to talk to the smart device.
  • Smart devices such as smart homes and smart hardware are mostly limited in software and hardware resources, and cannot handle language processing and voice signal transmission.
  • the smart device described in the embodiments of the present invention refers to a device that is limited in resources and cannot directly perform voice transmission and language processing.
  • the smart device when the smart device and the user make a call, the smart device does not actually send and receive the voice signal, and does not need to perform language processing.
  • the embodiment of the present invention provides a voice communication device for a smart device, including:
  • a first voice switching module configured to establish a voice connection with the smart device
  • a first language mapping module configured to receive a voice input of the user, and map the voice input to a command or a character string corresponding to the smart device;
  • the first communication module is configured to send the command or string to the smart device.
  • the device further includes:
  • the address book management module is configured to search for and bind the smart device.
  • the address book management module is also set to:
  • the voice switching module establishes a voice connection with the smart device, which means:
  • an embodiment of the present invention further provides a smart device voice communication device, including:
  • a second communication module configured to receive a notification request sent by the smart device
  • a second voice switching module configured to establish a voice connection with the smart device
  • the second language mapping module is configured to receive a command or a string sent by the smart device, and map the command or string into a natural language.
  • the premise of the call between the person and the smart device is to add the smart device as a contact in the mobile phone address book.
  • the embodiment of the present invention generalizes the concept of "person", and in the address book, in addition to the real natural person, the smart device is allowed to be a virtual person.
  • the contact presets two attribute selections, a person and a device, and the default attribute is a person.
  • the contact's information such as a phone number
  • adding a device contact select the attribute "Device" and after confirming that it is created, the phone starts searching for nearby smart devices.
  • Mobile search smart devices can use a variety of wireless technologies such as wlan and bt, or use point-to-point direct connection and bridge through routers. Once the smart device is discovered, the phone can bind to the device and establish a connection with it. In addition, information broadcasted by the device, including functions supported by the device, can be obtained.
  • wireless technologies such as wlan and bt, or use point-to-point direct connection and bridge through routers.
  • the mobile phone After the mobile phone obtains the information of the device, such as the function and the name, the user determines to save the contact of the device, and the smart device is included in the address book management, and the device contact is created.
  • a remote call between a person and a smart device is a call link for voice transmission.
  • Figure 6 shows the call link architecture between a person and a smart device. The comparison also lists the call link between people.
  • the calling call module When the user is calling.
  • the calling call module first checks the contact to be called, and if it is a real person with a telephone number, the communication link is established by using a protocol specified by the wireless voice service; if it is a device contact without a phone number, the calling call module performs the call request. Device voice transfer processing.
  • the device voice transfer process establishes a wireless data link with the smart device according to the address information stored in the device contact, such as a local area network address, a cloud address, and the like.
  • the establishment of the link may be divided into three types: a short-range wireless direct connection, a short-range router connection, and a remote cloud connection. The specific process has been implemented by a mature technology, and will not be repeated in the embodiment of the present invention.
  • the detection signal is sent to the smart device, and after the heartbeat signal returned by the device is obtained, the calling call module prompts both parties to be in the call.
  • the device When the user is called, that is, the smart device is called, the device sends a notification message to the bound mobile phone.
  • the mobile phone receives a notification request from the device, the router, and the cloud, the device voice transfer process is a virtual triggering of a contact call event, causing the call call module to work, and prompting the user device to contact the call. Call after the user is connected The link is established.
  • the smart device described in the embodiment of the present invention does not directly send and recognize a natural language, and the interface language with the outside world is a string form such as a command/message.
  • a two-way mapping mechanism is established between the "natural language and the command/message", so that the effect of the ordinary call conversation can also be generated between the user and the smart device.
  • This mapping mechanism is referred to below as the language mapping engine.
  • the language mapping engine and the connections to other modules are described in detail in FIG.
  • TTS voice "The current temperature is 25 degrees"
  • TTS voice "Someone asks for access, what do I need to do?"

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Library & Information Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • General Business, Economics & Management (AREA)
  • Telephonic Communication Services (AREA)
  • Telephone Function (AREA)

Abstract

Proposed are a method, apparatus and system for voice communication with a smart device, which relate to the field of smart home communications. The method comprises: establishing a voice connection with a smart device; receiving a voice input of a user, and mapping the voice input into a command or a character string corresponding to the smart device; and sending the command or the character string to the smart device. When a user makes a call with a smart device, a natural language is used to perform interaction between a human and a mobile phone.

Description

一种智能设备语音交流方法、装置和系统Intelligent device voice communication method, device and system 技术领域Technical field
本发明涉及智能家居通信领域，具体涉及一种智能设备语音交流方法、装置和系统。The present invention relates to the field of smart home communication, and in particular, to a method, device and system for voice communication of a smart device.
背景技术Background technique
通过手机、PC(Personal Computer，个人计算机)和互联网，目前已经普及了人和人的即时互联和交流。随着物联网、智能硬件、智能家居的兴起，技术和产业的演进重点，已经转向了人和物、物和物之间的互联和交流。同时，作为最重要的一种交流方式，语音人机交流近年来也开始广泛商用，比如苹果的Siri、中兴的语音手机。Through mobile phones, PCs (Personal Computers) and the Internet, the instant interconnection and communication between people and people has been popularized. With the rise of the Internet of Things, intelligent hardware, and smart homes, the focus of technology and industry evolution has shifted to the interconnection and exchange between people and things, things and things. At the same time, as the most important form of communication, voice and human-computer communication has also been widely used in recent years, such as Apple's Siri and ZTE's voice mobile phone.
目前人和智能硬件、智能家居间的语音交互，基本都是单向的，即人对设备的控制。方式两种：At present, the voice interaction between human and intelligent hardware and smart home is basically one-way, that is, the control of people on the device. Two ways:
一.人对设备本身直接语音命令控制；1. The person directly controls the voice command of the device itself;
二.人通过移动终端、可穿戴类设备，用语音对设备进行控制。2. The person controls the device by voice through the mobile terminal and the wearable device.
在从设备到人的方向上，少数高端的智能家居产品支持语音告警或提示的方式，来通知在它附近的人。而绝大部分智能硬件，都无法内置语音处理系统。同时，目前的智能设备也都还不支持远程和人进行通话和交互。In the direction from device to person, a few high-end smart home products support voice alerts or prompts to inform people nearby. Most of the smart hardware cannot have a built-in voice processing system. At the same time, current smart devices also do not support remote and human calls and interactions.
发明内容Summary of the invention
本发明实施例提供一种智能设备语音交流方法、装置和系统，使人和智能硬件之间，可以实现语音通话交流。The embodiment of the invention provides a method, a device and a system for voice communication of a smart device, so that voice communication can be realized between a person and an intelligent hardware.
为了实现上述发明目的，本发明实施例采取的技术方案如下：In order to achieve the above object, the technical solution adopted by the embodiment of the present invention is as follows:
一种智能设备语音交流方法，包括：A smart device voice communication method includes:
与智能设备建立语音连接；Establish a voice connection with the smart device;
接收用户的语音输入，并将所述语音输入映射成所述智能设备对应的命令或者字符串； Receiving a voice input of the user, and mapping the voice input to a command or a character string corresponding to the smart device;
将所述命令或者字符串发送至智能设备。Send the command or string to the smart device.
优选地，与所述智能设备建立语音连接之前包括：Preferably, before establishing a voice connection with the smart device, the method includes:
搜索并绑定所述智能设备。Search for and bind the smart device.
优选地，绑定所述智能设备包括：Preferably, binding the smart device comprises:
将所述智能设备添加至通讯录中。Add the smart device to your address book.
优选地，与所述智能设备建立语音连接包括：Preferably, establishing a voice connection with the smart device includes:
向所述智能设备发出语音请求；Sending a voice request to the smart device;
接收到所述智能设备返回的心跳信号。Receiving a heartbeat signal returned by the smart device.
为解决上述技术问题，本发明实施例还提供一种智能设备语音交流方法，包括：To solve the above technical problem, the embodiment of the present invention further provides a method for voice communication of a smart device, including:
接收智能设备发送的通知请求；Receiving a notification request sent by the smart device;
与所述智能设备建立语音连接；Establishing a voice connection with the smart device;
接收智能设备发送的命令或者字符串，并将所述命令或者字符串映射称自然语言。Receiving a command or a string sent by the smart device, and mapping the command or string into a natural language.
为解决上述技术问题，本发明实施例还提供一种智能设备语音交流装置，包括：To solve the above technical problem, an embodiment of the present invention further provides a smart device voice communication device, including:
第一语音转接模块，设置为与智能设备建立语音连接；a first voice switching module, configured to establish a voice connection with the smart device;
第一语言映射模块，设置为接收用户的语音输入，并将所述语音输入映射成所述智能设备对应的命令或者字符串；a first language mapping module, configured to receive a voice input of the user, and map the voice input to a command or a character string corresponding to the smart device;
第一通讯模块，设置为将所述命令或者字符串发送至智能设备。The first communication module is configured to send the command or string to the smart device.
优选地，所述的装置还包括：Preferably, the device further comprises:
通信录管理模块，设置为搜索并绑定所述智能设备。The address book management module is configured to search for and bind the smart device.
优选地，通信录管理模块还设置为：Preferably, the address book management module is further configured to:
将所述智能设备添加至通讯录中。Add the smart device to your address book.
优选地，语音转接模块与所述智能设备建立语音连接是指：Preferably, establishing a voice connection between the voice switching module and the smart device means:
向所述智能设备发出语音请求； Sending a voice request to the smart device;
接收到所述智能设备返回的心跳信号。Receiving a heartbeat signal returned by the smart device.
为解决上述技术问题，本发明实施例还提供一种智能设备语音交流装置，包括：To solve the above technical problem, an embodiment of the present invention further provides a smart device voice communication device, including:
第二通讯模块，设置为接收智能设备发送的通知请求；a second communication module, configured to receive a notification request sent by the smart device;
第二语音转接模块，设置为与所述智能设备建立语音连接；a second voice switching module, configured to establish a voice connection with the smart device;
第二语言映射模块，设置为接收智能设备发送的命令或者字符串，并将所述命令或者字符串映射称自然语言。The second language mapping module is configured to receive a command or a string sent by the smart device, and map the command or string into a natural language.
为解决上述技术问题，本发明实施例还提供一种智能设备语音交流系统，包括上述的智能设备语音交流装置和智能设备。To solve the above technical problem, an embodiment of the present invention further provides a smart device voice communication system, including the above-mentioned smart device voice communication device and smart device.
本发明实施例和相关技术相比，具有如下有益效果：Compared with the related art, the embodiment of the present invention has the following beneficial effects:
本发明实施例提供的方案当用户和智能设备通话时，人和手机之间采用自然语言交互；手机和智能设备之间，则提供一个映射机制，来实时完成“命令/字符串”与“自然语言”的转化。可以将人和设备的远程交流模式，从APP的集中控制模式，改变成普通人和人之前的语音交流对话模式。同时，还保留了现有智能设备的设计，不需要额外再增加SIM卡、语音输入输出等部件，节约成本，容易被家电厂家接受。The solution provided by the embodiment of the present invention uses natural language interaction between the user and the mobile phone when the user talks with the smart device; and provides a mapping mechanism between the mobile phone and the smart device to complete the "command/string" and the "natural" in real time. The transformation of the language. The remote communication mode of people and devices can be changed from the centralized control mode of the APP to the voice communication dialogue mode before the ordinary person and the person. At the same time, the design of the existing smart device is retained, and there is no need to add additional components such as SIM card, voice input and output, etc., which saves cost and is easily accepted by home appliance manufacturers.
附图说明DRAWINGS
图1是本发明实施例的一种智能设备语音交流方法的流程图；1 is a flowchart of a method for voice communication of a smart device according to an embodiment of the present invention;
图2是本发明实施例的另一种智能设备语音交流方法的流程图；2 is a flowchart of another method for voice communication of a smart device according to an embodiment of the present invention;
图3是本发明实施例的一种智能设备语音交流装置的结构示意图；3 is a schematic structural diagram of a voice communication device of a smart device according to an embodiment of the present invention;
图4是本发明实施例的另一种智能设备语音交流装置的结构示意图；4 is a schematic structural diagram of another smart device voice communication device according to an embodiment of the present invention;
图5是本发明实施例1的添加设备联系人的流程图；FIG. 5 is a flowchart of adding a device contact according to Embodiment 1 of the present invention; FIG.
图6是本发明实施例1的通话链路示意图；6 is a schematic diagram of a call link according to Embodiment 1 of the present invention;
图7是本发明实施例1的语言映射引擎示意图。FIG. 7 is a schematic diagram of a language mapping engine according to Embodiment 1 of the present invention.
具体实施方式detailed description
为使本发明的发明目的、技术方案和有益效果更加清楚明了，下面结合附图对本 发明的实施例进行说明，需要说明的是，在不冲突的情况下，本申请中的实施例和实施例中的特征可以相互任意组合。In order to make the objects, technical solutions and advantageous effects of the present invention more clear, the following The embodiments of the present invention are described. It should be noted that the features in the embodiments and the embodiments in the present application may be arbitrarily combined with each other without conflict.
如图1所示，本发明实施例提供一种智能设备语音交流方法，包括：As shown in FIG. 1 , an embodiment of the present invention provides a method for voice communication of a smart device, including:
与智能设备建立语音连接；Establish a voice connection with the smart device;
接收用户的语音输入，并将所述语音输入映射成所述智能设备对应的命令或者字符串；Receiving a voice input of the user, and mapping the voice input to a command or a character string corresponding to the smart device;
将所述命令或者字符串发送至智能设备。Send the command or string to the smart device.
与所述智能设备建立语音连接之前包括：Before establishing a voice connection with the smart device, the method includes:
搜索并绑定所述智能设备。Search for and bind the smart device.
其中，绑定所述智能设备包括：The binding the smart device includes:
将所述智能设备添加至通讯录中。Add the smart device to your address book.
其中，与所述智能设备建立语音连接包括：The establishing a voice connection with the smart device includes:
向所述智能设备发出语音请求；Sending a voice request to the smart device;
接收到所述智能设备返回的心跳信号。Receiving a heartbeat signal returned by the smart device.
如图2所示，本发明实施例提还供一种智能设备语音交流方法，包括：As shown in FIG. 2, the embodiment of the present invention provides a method for voice communication of a smart device, including:
接收智能设备发送的通知请求；Receiving a notification request sent by the smart device;
与所述智能设备建立语音连接；Establishing a voice connection with the smart device;
接收智能设备发送的命令或者字符串，并将所述命令或者字符串映射称自然语言。Receiving a command or a string sent by the smart device, and mapping the command or string into a natural language.
智能设备可以作为独立的个体出现在手机的通信录中；人呼叫智能设备，建立通话链接，问询智能硬件的状态，要求智能硬件做某些事情；智能硬件呼叫人，建立通话链接，告诉人自己现在的状态和要求，问询人是否要采取某些行动。The smart device can appear as an independent individual in the mobile phone's address book; the person calls the smart device, establishes the call link, asks the status of the intelligent hardware, requires the intelligent hardware to do certain things; the intelligent hardware caller establishes the call link, tells the person Whether or not the inquirer is going to take certain actions in his current state and requirements.
支撑本发明实施例的技术要点有：The technical points supporting the embodiments of the present invention are as follows:
将智能设备作为手机的普通联系人来管理Manage smart devices as regular contacts for your phone
在手机首次扫描到智能设备、并和智能设备建立连接后，手机提示用户是否在通信录添加设备联系人。添加后，用户可以在联系人条目中了解设备详情，知悉该设备的特性和支持的功能。 After the mobile phone first scans to the smart device and establishes a connection with the smart device, the mobile phone prompts the user whether to add a device contact in the address book. Once added, the user can learn about the device details in the contact entry and learn about the device's features and supported features.
手机→智能设备的语音通话技术Mobile phone → smart device voice call technology
当需要了解智能设备的状态或安排某项工作时，用户可以在联系人列表中找到该设备，采用普通通话呼叫的方式，来和设备建立连接。呼通后，用户采用与人对话的方式，用自然语言来问询设备的当前状态，要求设备执行某项工作。When you need to know the status of a smart device or schedule a job, the user can find the device in the contact list and use a normal call to establish a connection with the device. After the call, the user uses the natural language to query the current state of the device, and asks the device to perform a certain job.
智能设备→手机的语音通话技术Smart device → mobile phone voice call technology
当智能设备发生一些告警事件或达到用户预设的某个条件时，智能设备会主动发起呼叫，并在用户的手机上发生联系人来电的情景。用户接听后，可以听到自然语言方式描述的设备通知，并可以采用2中的技术，与智能设备进行对话。When the smart device generates some alarm events or reaches a certain condition preset by the user, the smart device will initiate a call and a contact call occurs on the user's mobile phone. After the user answers, you can hear the device notification described by the natural language mode, and you can use the technology in 2 to talk to the smart device.
“命令/字符串”<——>自然语言之间的转化"Command / String" <——> conversion between natural languages
智能家居、智能硬件等智能设备，大多软硬件资源很有限，本身不能进行语言处理和语音信号传输。本发明实施例中所述的智能设备，除非特指，都是指这类资源受限、无法直接进行语音传输和语言处理的设备。在本发明实施例中，当智能设备和用户进行通话时，智能设备并不真实的发送和接收语音信号，也不需要进行语言处理。Smart devices such as smart homes and smart hardware are mostly limited in software and hardware resources, and cannot handle language processing and voice signal transmission. The smart device described in the embodiments of the present invention, unless specifically referred to, refers to a device that is limited in resources and cannot directly perform voice transmission and language processing. In the embodiment of the present invention, when the smart device and the user make a call, the smart device does not actually send and receive the voice signal, and does not need to perform language processing.
如图3所示，本发明实施例提还供一种智能设备语音交流装置，包括：As shown in FIG. 3, the embodiment of the present invention provides a voice communication device for a smart device, including:
第一语音转接模块，设置为与智能设备建立语音连接；a first voice switching module, configured to establish a voice connection with the smart device;
第一语言映射模块，设置为接收用户的语音输入，并将所述语音输入映射成所述智能设备对应的命令或者字符串；a first language mapping module, configured to receive a voice input of the user, and map the voice input to a command or a character string corresponding to the smart device;
第一通讯模块，设置为将所述命令或者字符串发送至智能设备。The first communication module is configured to send the command or string to the smart device.
所述的装置还包括：The device further includes:
通信录管理模块，设置为搜索并绑定所述智能设备。The address book management module is configured to search for and bind the smart device.
通信录管理模块还设置为：The address book management module is also set to:
将所述智能设备添加至通讯录中。Add the smart device to your address book.
语音转接模块与所述智能设备建立语音连接是指：The voice switching module establishes a voice connection with the smart device, which means:
向所述智能设备发出语音请求；Sending a voice request to the smart device;
接收到所述智能设备返回的心跳信号。Receiving a heartbeat signal returned by the smart device.
如图4所示，本发明实施例还提供一种智能设备语音交流装置，包括：As shown in FIG. 4, an embodiment of the present invention further provides a smart device voice communication device, including:
第二通讯模块，设置为接收智能设备发送的通知请求； a second communication module, configured to receive a notification request sent by the smart device;
第二语音转接模块，设置为与所述智能设备建立语音连接；a second voice switching module, configured to establish a voice connection with the smart device;
第二语言映射模块，设置为接收智能设备发送的命令或者字符串，并将所述命令或者字符串映射称自然语言。The second language mapping module is configured to receive a command or a string sent by the smart device, and map the command or string into a natural language.
实施例1Example 1
人和智能设备间通话的前提，是在手机通信录中，将智能设备添加为联系人。本发明实施例泛化了联系“人”的概念，在通信录中，除了真实的自然人，还允许智能设备作为虚拟的人。The premise of the call between the person and the smart device is to add the smart device as a contact in the mobile phone address book. The embodiment of the present invention generalizes the concept of "person", and in the address book, in addition to the real natural person, the smart device is allowed to be a virtual person.
如图5所示，在本发明实施例的通信录中，联系人预置两种属性选择——人和设备，可以默认属性为人。添加真实的自然联系人时，因为用户已经掌握了该联系人的信息，如电话号码，直接输入即可创建。在添加设备联系人时，选择属性为“设备”，确定创建后，手机开始搜索附近的智能设备。As shown in FIG. 5, in the address book of the embodiment of the present invention, the contact presets two attribute selections, a person and a device, and the default attribute is a person. When adding a real natural contact, because the user has already mastered the contact's information, such as a phone number, you can create it by typing directly. When adding a device contact, select the attribute "Device" and after confirming that it is created, the phone starts searching for nearby smart devices.
手机搜索智能设备，可以通过wlan和bt等多种无线技术，也可以采用点对点直连和通过路由器桥接的方式。发现智能设备后，手机可以绑定该设备，并与之建立连接。进而还可以获取设备广播出来的信息，包括该设备支持的功能等。Mobile search smart devices can use a variety of wireless technologies such as wlan and bt, or use point-to-point direct connection and bridge through routers. Once the smart device is discovered, the phone can bind to the device and establish a connection with it. In addition, information broadcasted by the device, including functions supported by the device, can be obtained.
手机获得设备的信息，如功能、名称后，用户确定保存该设备联系人，将此智能设备纳入通信录管理，创建设备联系人完成。After the mobile phone obtains the information of the device, such as the function and the name, the user determines to save the contact of the device, and the smart device is included in the address book management, and the device contact is created.
本发明实施例中人与智能设备的远程通话，关键是语音传输的通话链路。图6给出了人和智能设备间的通话链路架构，作为对比也列出了人和人之间的通话链路。In the embodiment of the present invention, a remote call between a person and a smart device is a call link for voice transmission. Figure 6 shows the call link architecture between a person and a smart device. The comparison also lists the call link between people.
用户主叫时。呼叫通话模块先检查要呼叫的联系人，如果是带电话号码的真人，则采用无线语音业务规定的协议来建立通信链接；如果是无电话号码的设备联系人，则呼叫通话模块对呼叫请求进行设备语音转接处理。When the user is calling. The calling call module first checks the contact to be called, and if it is a real person with a telephone number, the communication link is established by using a protocol specified by the wireless voice service; if it is a device contact without a phone number, the calling call module performs the call request. Device voice transfer processing.
设备语音转接流程是根据设备联系人中保存的地址信息，如局域网地址、云地址等，建立与智能设备之间的无线数据链接。建立链接的情况，可分为近距无线直连、近距路由器连接、远程云端连接3种，具体过程已有成熟技术实现了，本发明实施例不做重述。链接建立后，向智能设备端发送检测信号，得到设备端返回的心跳信号后，呼叫通话模块提示双方处在通话中。The device voice transfer process establishes a wireless data link with the smart device according to the address information stored in the device contact, such as a local area network address, a cloud address, and the like. The establishment of the link may be divided into three types: a short-range wireless direct connection, a short-range router connection, and a remote cloud connection. The specific process has been implemented by a mature technology, and will not be repeated in the embodiment of the present invention. After the link is established, the detection signal is sent to the smart device, and after the heartbeat signal returned by the device is obtained, the calling call module prompts both parties to be in the call.
用户被叫，即智能设备主叫时，设备向绑定的手机发送通知消息。手机收到来自设备、路由器和云端传来的通知请求时，由设备语音转接流程是虚拟触发有联系人来电事件，使呼叫通话模块工作，并提示用户设备联系人来电。用户接通后，呼叫通话 链路即建立。When the user is called, that is, the smart device is called, the device sends a notification message to the bound mobile phone. When the mobile phone receives a notification request from the device, the router, and the cloud, the device voice transfer process is a virtual triggering of a contact call event, causing the call call module to work, and prompting the user device to contact the call. Call after the user is connected The link is established.
在呼叫通话链路建立后，用户和智能设备即进入语音通话状态。本发明实施例所述的智能设备，本身并不直接发送和识别自然语言，与外界的接口语言是命令/消息等字符串形式。本发明实施例在“自然语言和命令/消息”之间，建立双向映射机制，使得用户和智能设备之间，也可以产生普通呼叫通话的效果。以下把这种映射机制，称为语言映射引擎，图7中详细描述了语言映射引擎，以及和其它模块间的联系。After the call link is established, the user and the smart device enter the voice call state. The smart device described in the embodiment of the present invention does not directly send and recognize a natural language, and the interface language with the outside world is a string form such as a command/message. In the embodiment of the present invention, a two-way mapping mechanism is established between the "natural language and the command/message", so that the effect of the ordinary call conversation can also be generated between the user and the smart device. This mapping mechanism is referred to below as the language mapping engine. The language mapping engine and the connections to other modules are described in detail in FIG.
以人呼叫空调，和空调通话为例，来阐述图7中的主叫方向：Take the person to call the air conditioner, and the air-conditioning call as an example to illustrate the caller direction in Figure 7:
人——>空调：People -> Air Conditioning:
自然语言    ："现在多少度？"Natural language: "How many degrees now?"
正则表达式  ：目前的温度是__度Regular expression: The current temperature is __ degrees
命令映射    ：temperature＝？Command map :temperature=?
命令接口    ：getTemperature()Command interface : getTemperature()
空调——>人Air conditioning -> people
通知消息    ：“temperature＝＝25”Notification message: "temperature==25"
消息映射    ：temperature＝25Message map :temperature=25
正则表达式  ：目前的温度是25度Regular expression: the current temperature is 25 degrees
TTS语音     ：“目前的温度是25度”TTS voice: "The current temperature is 25 degrees"
以智能门锁系统呼叫人，和人通话为例，阐述图3中的被叫方向：In the smart door lock system caller, and the person to talk as an example, explain the direction of the call in Figure 3:
智能门锁系统——>人Intelligent door lock system -> people
通知消息    ：“Request Entering”Notification message: "Request Entering"
消息映射    ：RequestEntering＝yesMessage map :RequestEntering=yes
正则表达式  ：有人请求进入，我需要怎么做？Regular expressions: Someone requests to enter, what do I need to do?
TTS语音     ：“有人请求进入，我需要怎么做？”TTS voice: "Someone asks for access, what do I need to do?"
人——>红外感应器People -> infrared sensor
情况1：指纹识别通过，或图像识别通过Case 1: Fingerprint recognition passed, or image recognition passed
自然语言    ："好的，允许进入" Natural language : "OK, allow access"
正则表达式  ：允许进入Regular expression: allow access
命令映射    ：EnteringPermission＝yesCommand map : EnteringPermission=yes
命令接口    ：SetEnteringPer(True)Command interface : SetEnteringPer(True)
情况2：验证不通过Case 2: Verification fails
自然语言    ："不允许进入"Natural language : "Not allowed to enter"
正则表达式  ：不允许进入Regular expression: not allowed to enter
命令映射    ：EnteringPermission＝noCommand map : EnteringPermission=no
命令接口    ：SetEnteringPer(False)Command interface : SetEnteringPer(False)
虽然本发明所揭示的实施方式如上，但其内容只是为了便于理解本发明的技术方案而采用的实施方式，并非用于限定本发明。任何本发明所属技术领域内的技术人员，在不脱离本发明所揭示的核心技术方案的前提下，可以在实施的形式和细节上做任何修改与变化，但本发明所限定的保护范围，仍须以所附的权利要求书限定的范围为准。The embodiments disclosed in the present invention are as described above, but the contents thereof are only for the purpose of facilitating understanding of the technical solutions of the present invention, and are not intended to limit the present invention. Any modifications and changes in the form and details of the embodiments may be made by those skilled in the art without departing from the scope of the present invention. It is subject to the scope defined by the appended claims.
工业实用性Industrial applicability
通过上述实施例及优选实施方式，当用户和智能设备通话时，人和手机之间采用自然语言交互；手机和智能设备之间，则提供一个映射机制，来实时完成“命令/字符串”与“自然语言”的转化。可以将人和设备的远程交流模式，从APP的集中控制模式，改变成普通人和人之前的语音交流对话模式。同时，还保留了现有智能设备的设计，不需要额外再增加SIM卡、语音输入输出等部件，节约成本，容易被家电厂家接受。 Through the above embodiments and the preferred embodiments, when the user talks with the smart device, natural language interaction is adopted between the person and the mobile phone; between the mobile phone and the smart device, a mapping mechanism is provided to complete the “command/string” in real time. Conversion of "natural language." The remote communication mode of people and devices can be changed from the centralized control mode of the APP to the voice communication dialogue mode before the ordinary person and the person. At the same time, the design of the existing smart device is retained, and there is no need to add additional components such as SIM card, voice input and output, etc., which saves cost and is easily accepted by home appliance manufacturers.

Claims (11)

  1. 一种智能设备语音交流方法，包括：A smart device voice communication method includes:
    与智能设备建立语音连接；Establish a voice connection with the smart device;
    接收用户的语音输入，并将所述语音输入映射成所述智能设备对应的命令或者字符串；Receiving a voice input of the user, and mapping the voice input to a command or a character string corresponding to the smart device;
    将所述命令或者字符串发送至智能设备。Send the command or string to the smart device.
  2. 如权利要求1所述的方法，其中：与所述智能设备建立语音连接之前包括：The method of claim 1 wherein: before establishing a voice connection with the smart device comprises:
    搜索并绑定所述智能设备。Search for and bind the smart device.
  3. 如权利要求2所述的方法，其中：绑定所述智能设备包括：The method of claim 2 wherein: binding the smart device comprises:
    将所述智能设备添加至通讯录中。Add the smart device to your address book.
  4. 如权利要求1所述的方法，其中：与所述智能设备建立语音连接包括：The method of claim 1 wherein: establishing a voice connection with the smart device comprises:
    向所述智能设备发出语音请求；Sending a voice request to the smart device;
    接收到所述智能设备返回的心跳信号。Receiving a heartbeat signal returned by the smart device.
  5. 一种智能设备语音交流方法，包括：A smart device voice communication method includes:
    接收智能设备发送的通知请求；Receiving a notification request sent by the smart device;
    与所述智能设备建立语音连接；Establishing a voice connection with the smart device;
    接收智能设备发送的命令或者字符串，并将所述命令或者字符串映射称自然语言。Receiving a command or a string sent by the smart device, and mapping the command or string into a natural language.
  6. 一种智能设备语音交流装置，包括：A smart device voice communication device includes:
    第一语音转接模块，设置为与智能设备建立语音连接；a first voice switching module, configured to establish a voice connection with the smart device;
    第一语言映射模块，设置为接收用户的语音输入，并将所述语音输入映射成所述智能设备对应的命令或者字符串；a first language mapping module, configured to receive a voice input of the user, and map the voice input to a command or a character string corresponding to the smart device;
    第一通讯模块，设置为将所述命令或者字符串发送至智能设备。The first communication module is configured to send the command or string to the smart device.
  7. 如权利要求6所述的装置，其中：还包括：The apparatus of claim 6 further comprising:
    通信录管理模块，设置为搜索并绑定所述智能设备。 The address book management module is configured to search for and bind the smart device.
  8. 如权利要求7所述的装置，其中：通信录管理模块还设置为：The apparatus of claim 7 wherein: the address book management module is further configured to:
    将所述智能设备添加至通讯录中。Add the smart device to your address book.
  9. 如权利要求6所述的装置，其中：语音转接模块与所述智能设备建立语音连接是指：The apparatus of claim 6 wherein: the voice switching module establishing a voice connection with the smart device means:
    向所述智能设备发出语音请求；Sending a voice request to the smart device;
    接收到所述智能设备返回的心跳信号。Receiving a heartbeat signal returned by the smart device.
  10. 一种智能设备语音交流装置，包括：A smart device voice communication device includes:
    第二通讯模块，设置为接收智能设备发送的通知请求；a second communication module, configured to receive a notification request sent by the smart device;
    第二语音转接模块，设置为与所述智能设备建立语音连接；a second voice switching module, configured to establish a voice connection with the smart device;
    第二语言映射模块，设置为接收智能设备发送的命令或者字符串，并将所述命令或者字符串映射称自然语言。The second language mapping module is configured to receive a command or a string sent by the smart device, and map the command or string into a natural language.
  11. 一种智能设备语音交流系统，包括权利要求6至10任一所述的智能设备语音A smart device voice communication system, comprising the smart device voice according to any one of claims 6 to 10.
    交流装置和智能设备。 AC devices and smart devices.
PCT/CN2016/099097 2015-10-30 2016-09-14 Method, apparatus and system for voice communication with smart device WO2017071420A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510728451.1 2015-10-30
CN201510728451.1A CN106657521A (en) 2015-10-30 2015-10-30 Smart device voice communication method, apparatus and system

Publications (1)

Publication Number Publication Date
WO2017071420A1 true WO2017071420A1 (en) 2017-05-04

Family

ID=58629816

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/099097 WO2017071420A1 (en) 2015-10-30 2016-09-14 Method, apparatus and system for voice communication with smart device

Country Status (2)

Country Link
CN (1) CN106657521A (en)
WO (1) WO2017071420A1 (en)

Cited By (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110097883A (en) * 2018-06-01 2019-08-06 苹果公司 For accessing the interactive voice of the call function of corollary equipment at main equipment
US10720160B2 (en) 2018-06-01 2020-07-21 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US10878809B2 (en) 2014-05-30 2020-12-29 Apple Inc. Multi-command single utterance input method
CN112528004A (en) * 2020-12-24 2021-03-19 北京百度网讯科技有限公司 Voice interaction method, voice interaction device, electronic equipment, medium and computer program product
US10978090B2 (en) 2013-02-07 2021-04-13 Apple Inc. Voice trigger for a digital assistant
US11009970B2 (en) 2018-06-01 2021-05-18 Apple Inc. Attention aware virtual assistant dismissal
US11037565B2 (en) 2016-06-10 2021-06-15 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US11070949B2 (en) 2015-05-27 2021-07-20 Apple Inc. Systems and methods for proactively identifying and surfacing relevant content on an electronic device with a touch-sensitive display
US11087759B2 (en) 2015-03-08 2021-08-10 Apple Inc. Virtual assistant activation
US11120372B2 (en) 2011-06-03 2021-09-14 Apple Inc. Performing actions associated with task items that represent tasks to perform
US11126400B2 (en) 2015-09-08 2021-09-21 Apple Inc. Zero latency digital assistant
US11133008B2 (en) 2014-05-30 2021-09-28 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US11152002B2 (en) 2016-06-11 2021-10-19 Apple Inc. Application integration with a digital assistant
CN113535987A (en) * 2021-09-13 2021-10-22 杭州涂鸦信息技术有限公司 Linkage rule matching method and related device
US11169616B2 (en) 2018-05-07 2021-11-09 Apple Inc. Raise to speak
US11237797B2 (en) 2019-05-31 2022-02-01 Apple Inc. User activity shortcut suggestions
US11257504B2 (en) 2014-05-30 2022-02-22 Apple Inc. Intelligent assistant for home automation
US11321116B2 (en) 2012-05-15 2022-05-03 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US11348582B2 (en) 2008-10-02 2022-05-31 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US11380310B2 (en) 2017-05-12 2022-07-05 Apple Inc. Low-latency intelligent automated assistant
US11388291B2 (en) 2013-03-14 2022-07-12 Apple Inc. System and method for processing voicemail
US11405466B2 (en) 2017-05-12 2022-08-02 Apple Inc. Synchronization and task delegation of a digital assistant
US11423886B2 (en) 2010-01-18 2022-08-23 Apple Inc. Task flow identification based on user intent
US11431642B2 (en) 2018-06-01 2022-08-30 Apple Inc. Variable latency device coordination
US11468282B2 (en) 2015-05-15 2022-10-11 Apple Inc. Virtual assistant in a communication session
US11467802B2 (en) 2017-05-11 2022-10-11 Apple Inc. Maintaining privacy of personal information
US11488406B2 (en) 2019-09-25 2022-11-01 Apple Inc. Text detection using global geometry estimators
US11500672B2 (en) 2015-09-08 2022-11-15 Apple Inc. Distributed personal assistant
US11516537B2 (en) 2014-06-30 2022-11-29 Apple Inc. Intelligent automated assistant for TV user interactions
US11526368B2 (en) 2015-11-06 2022-12-13 Apple Inc. Intelligent automated assistant in a messaging environment
US11532306B2 (en) 2017-05-16 2022-12-20 Apple Inc. Detecting a trigger of a digital assistant
US11580990B2 (en) 2017-05-12 2023-02-14 Apple Inc. User-specific acoustic models
US11599331B2 (en) 2017-05-11 2023-03-07 Apple Inc. Maintaining privacy of personal information
US11657813B2 (en) 2019-05-31 2023-05-23 Apple Inc. Voice identification in digital assistant systems
US11671920B2 (en) 2007-04-03 2023-06-06 Apple Inc. Method and system for operating a multifunction portable electronic device using voice-activation
US11675491B2 (en) 2019-05-06 2023-06-13 Apple Inc. User configurable task triggers
US11675829B2 (en) 2017-05-16 2023-06-13 Apple Inc. Intelligent automated assistant for media exploration
US11696060B2 (en) 2020-07-21 2023-07-04 Apple Inc. User identification using headphones
US11705130B2 (en) 2019-05-06 2023-07-18 Apple Inc. Spoken notifications
US11710482B2 (en) 2018-03-26 2023-07-25 Apple Inc. Natural assistant interaction
US11727219B2 (en) 2013-06-09 2023-08-15 Apple Inc. System and method for inferring user intent from speech inputs
US11755276B2 (en) 2020-05-12 2023-09-12 Apple Inc. Reducing description length based on confidence
US11765209B2 (en) 2020-05-11 2023-09-19 Apple Inc. Digital assistant hardware abstraction
US11783815B2 (en) 2019-03-18 2023-10-10 Apple Inc. Multimodality in digital assistant systems
US11790914B2 (en) 2019-06-01 2023-10-17 Apple Inc. Methods and user interfaces for voice-based control of electronic devices
US11798547B2 (en) 2013-03-15 2023-10-24 Apple Inc. Voice activated device for use with a voice-based digital assistant
US11809483B2 (en) 2015-09-08 2023-11-07 Apple Inc. Intelligent automated assistant for media search and playback
US11809783B2 (en) 2016-06-11 2023-11-07 Apple Inc. Intelligent device arbitration and control
US11838734B2 (en) 2020-07-20 2023-12-05 Apple Inc. Multi-device audio adjustment coordination
US11853647B2 (en) 2015-12-23 2023-12-26 Apple Inc. Proactive assistance based on dialog communication between devices
US11854539B2 (en) 2018-05-07 2023-12-26 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US11853536B2 (en) 2015-09-08 2023-12-26 Apple Inc. Intelligent automated assistant in a media environment
US11886805B2 (en) 2015-11-09 2024-01-30 Apple Inc. Unconventional virtual assistant interactions
US11888791B2 (en) 2019-05-21 2024-01-30 Apple Inc. Providing message response suggestions
US11893992B2 (en) 2018-09-28 2024-02-06 Apple Inc. Multi-modal inputs for voice commands
US11914848B2 (en) 2020-05-11 2024-02-27 Apple Inc. Providing relevant data items based on context
US11947873B2 (en) 2015-06-29 2024-04-02 Apple Inc. Virtual assistant for media playback
US12010262B2 (en) 2013-08-06 2024-06-11 Apple Inc. Auto-activating smart responses based on activities from remote devices
US12014118B2 (en) 2017-05-15 2024-06-18 Apple Inc. Multi-modal interfaces having selection disambiguation and text modification capability
US12051413B2 (en) 2015-09-30 2024-07-30 Apple Inc. Intelligent device identification
US12067985B2 (en) 2018-06-01 2024-08-20 Apple Inc. Virtual assistant operations in multi-device environments
US12073147B2 (en) 2013-06-09 2024-08-27 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US12087308B2 (en) 2010-01-18 2024-09-10 Apple Inc. Intelligent automated assistant

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108390859B (en) * 2018-01-22 2021-03-23 深圳慧安康科技有限公司 Intelligent robot device for intercom extension
WO2019205134A1 (en) * 2018-04-28 2019-10-31 深圳魔耳智能声学科技有限公司 Smart home voice control method, apparatus, device and system
CN108566322A (en) * 2018-07-24 2018-09-21 珠海格力电器股份有限公司 Call method and device, storage medium and electronic device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011001370A1 (en) * 2009-06-29 2011-01-06 Avraham Ben-David Intelligent home automation
CN102332204A (en) * 2011-06-15 2012-01-25 上海理工大学 Wireless voice domestic barrier-free environment control system
CN102855872A (en) * 2012-09-07 2013-01-02 深圳市信利康电子有限公司 Method and system for controlling household appliance on basis of voice interaction between terminal and internet
CN103730116A (en) * 2014-01-07 2014-04-16 苏州思必驰信息科技有限公司 System and method for achieving intelligent home device control on smart watch

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011001370A1 (en) * 2009-06-29 2011-01-06 Avraham Ben-David Intelligent home automation
CN102332204A (en) * 2011-06-15 2012-01-25 上海理工大学 Wireless voice domestic barrier-free environment control system
CN102855872A (en) * 2012-09-07 2013-01-02 深圳市信利康电子有限公司 Method and system for controlling household appliance on basis of voice interaction between terminal and internet
CN103730116A (en) * 2014-01-07 2014-04-16 苏州思必驰信息科技有限公司 System and method for achieving intelligent home device control on smart watch

Cited By (98)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11979836B2 (en) 2007-04-03 2024-05-07 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US11671920B2 (en) 2007-04-03 2023-06-06 Apple Inc. Method and system for operating a multifunction portable electronic device using voice-activation
US11900936B2 (en) 2008-10-02 2024-02-13 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US11348582B2 (en) 2008-10-02 2022-05-31 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US12087308B2 (en) 2010-01-18 2024-09-10 Apple Inc. Intelligent automated assistant
US11423886B2 (en) 2010-01-18 2022-08-23 Apple Inc. Task flow identification based on user intent
US11120372B2 (en) 2011-06-03 2021-09-14 Apple Inc. Performing actions associated with task items that represent tasks to perform
US11321116B2 (en) 2012-05-15 2022-05-03 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US11636869B2 (en) 2013-02-07 2023-04-25 Apple Inc. Voice trigger for a digital assistant
US11557310B2 (en) 2013-02-07 2023-01-17 Apple Inc. Voice trigger for a digital assistant
US10978090B2 (en) 2013-02-07 2021-04-13 Apple Inc. Voice trigger for a digital assistant
US11862186B2 (en) 2013-02-07 2024-01-02 Apple Inc. Voice trigger for a digital assistant
US12009007B2 (en) 2013-02-07 2024-06-11 Apple Inc. Voice trigger for a digital assistant
US11388291B2 (en) 2013-03-14 2022-07-12 Apple Inc. System and method for processing voicemail
US11798547B2 (en) 2013-03-15 2023-10-24 Apple Inc. Voice activated device for use with a voice-based digital assistant
US12073147B2 (en) 2013-06-09 2024-08-27 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US11727219B2 (en) 2013-06-09 2023-08-15 Apple Inc. System and method for inferring user intent from speech inputs
US12010262B2 (en) 2013-08-06 2024-06-11 Apple Inc. Auto-activating smart responses based on activities from remote devices
US11810562B2 (en) 2014-05-30 2023-11-07 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US12118999B2 (en) 2014-05-30 2024-10-15 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US10878809B2 (en) 2014-05-30 2020-12-29 Apple Inc. Multi-command single utterance input method
US11257504B2 (en) 2014-05-30 2022-02-22 Apple Inc. Intelligent assistant for home automation
US11133008B2 (en) 2014-05-30 2021-09-28 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US11699448B2 (en) 2014-05-30 2023-07-11 Apple Inc. Intelligent assistant for home automation
US11670289B2 (en) 2014-05-30 2023-06-06 Apple Inc. Multi-command single utterance input method
US12067990B2 (en) 2014-05-30 2024-08-20 Apple Inc. Intelligent assistant for home automation
US11516537B2 (en) 2014-06-30 2022-11-29 Apple Inc. Intelligent automated assistant for TV user interactions
US11838579B2 (en) 2014-06-30 2023-12-05 Apple Inc. Intelligent automated assistant for TV user interactions
US11842734B2 (en) 2015-03-08 2023-12-12 Apple Inc. Virtual assistant activation
US11087759B2 (en) 2015-03-08 2021-08-10 Apple Inc. Virtual assistant activation
US11468282B2 (en) 2015-05-15 2022-10-11 Apple Inc. Virtual assistant in a communication session
US12001933B2 (en) 2015-05-15 2024-06-04 Apple Inc. Virtual assistant in a communication session
US11070949B2 (en) 2015-05-27 2021-07-20 Apple Inc. Systems and methods for proactively identifying and surfacing relevant content on an electronic device with a touch-sensitive display
US11947873B2 (en) 2015-06-29 2024-04-02 Apple Inc. Virtual assistant for media playback
US11809483B2 (en) 2015-09-08 2023-11-07 Apple Inc. Intelligent automated assistant for media search and playback
US11550542B2 (en) 2015-09-08 2023-01-10 Apple Inc. Zero latency digital assistant
US11500672B2 (en) 2015-09-08 2022-11-15 Apple Inc. Distributed personal assistant
US11853536B2 (en) 2015-09-08 2023-12-26 Apple Inc. Intelligent automated assistant in a media environment
US11126400B2 (en) 2015-09-08 2021-09-21 Apple Inc. Zero latency digital assistant
US11954405B2 (en) 2015-09-08 2024-04-09 Apple Inc. Zero latency digital assistant
US12051413B2 (en) 2015-09-30 2024-07-30 Apple Inc. Intelligent device identification
US11526368B2 (en) 2015-11-06 2022-12-13 Apple Inc. Intelligent automated assistant in a messaging environment
US11809886B2 (en) 2015-11-06 2023-11-07 Apple Inc. Intelligent automated assistant in a messaging environment
US11886805B2 (en) 2015-11-09 2024-01-30 Apple Inc. Unconventional virtual assistant interactions
US11853647B2 (en) 2015-12-23 2023-12-26 Apple Inc. Proactive assistance based on dialog communication between devices
US11037565B2 (en) 2016-06-10 2021-06-15 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US11657820B2 (en) 2016-06-10 2023-05-23 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US11152002B2 (en) 2016-06-11 2021-10-19 Apple Inc. Application integration with a digital assistant
US11809783B2 (en) 2016-06-11 2023-11-07 Apple Inc. Intelligent device arbitration and control
US11749275B2 (en) 2016-06-11 2023-09-05 Apple Inc. Application integration with a digital assistant
US11599331B2 (en) 2017-05-11 2023-03-07 Apple Inc. Maintaining privacy of personal information
US11467802B2 (en) 2017-05-11 2022-10-11 Apple Inc. Maintaining privacy of personal information
US11380310B2 (en) 2017-05-12 2022-07-05 Apple Inc. Low-latency intelligent automated assistant
US11405466B2 (en) 2017-05-12 2022-08-02 Apple Inc. Synchronization and task delegation of a digital assistant
US11837237B2 (en) 2017-05-12 2023-12-05 Apple Inc. User-specific acoustic models
US11538469B2 (en) 2017-05-12 2022-12-27 Apple Inc. Low-latency intelligent automated assistant
US11580990B2 (en) 2017-05-12 2023-02-14 Apple Inc. User-specific acoustic models
US11862151B2 (en) 2017-05-12 2024-01-02 Apple Inc. Low-latency intelligent automated assistant
US12014118B2 (en) 2017-05-15 2024-06-18 Apple Inc. Multi-modal interfaces having selection disambiguation and text modification capability
US12026197B2 (en) 2017-05-16 2024-07-02 Apple Inc. Intelligent automated assistant for media exploration
US11532306B2 (en) 2017-05-16 2022-12-20 Apple Inc. Detecting a trigger of a digital assistant
US11675829B2 (en) 2017-05-16 2023-06-13 Apple Inc. Intelligent automated assistant for media exploration
US11710482B2 (en) 2018-03-26 2023-07-25 Apple Inc. Natural assistant interaction
US11900923B2 (en) 2018-05-07 2024-02-13 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US11487364B2 (en) 2018-05-07 2022-11-01 Apple Inc. Raise to speak
US11907436B2 (en) 2018-05-07 2024-02-20 Apple Inc. Raise to speak
US11854539B2 (en) 2018-05-07 2023-12-26 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US11169616B2 (en) 2018-05-07 2021-11-09 Apple Inc. Raise to speak
US12061752B2 (en) 2018-06-01 2024-08-13 Apple Inc. Attention aware virtual assistant dismissal
US12080287B2 (en) 2018-06-01 2024-09-03 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US11431642B2 (en) 2018-06-01 2022-08-30 Apple Inc. Variable latency device coordination
US10984798B2 (en) 2018-06-01 2021-04-20 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
CN110097883B (en) * 2018-06-01 2020-04-28 苹果公司 Voice interaction for accessing calling functionality of companion device at primary device
CN110097883A (en) * 2018-06-01 2019-08-06 苹果公司 For accessing the interactive voice of the call function of corollary equipment at main equipment
US11360577B2 (en) 2018-06-01 2022-06-14 Apple Inc. Attention aware virtual assistant dismissal
US11630525B2 (en) 2018-06-01 2023-04-18 Apple Inc. Attention aware virtual assistant dismissal
US12067985B2 (en) 2018-06-01 2024-08-20 Apple Inc. Virtual assistant operations in multi-device environments
US11009970B2 (en) 2018-06-01 2021-05-18 Apple Inc. Attention aware virtual assistant dismissal
US10720160B2 (en) 2018-06-01 2020-07-21 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US11893992B2 (en) 2018-09-28 2024-02-06 Apple Inc. Multi-modal inputs for voice commands
US11783815B2 (en) 2019-03-18 2023-10-10 Apple Inc. Multimodality in digital assistant systems
US12136419B2 (en) 2019-03-18 2024-11-05 Apple Inc. Multimodality in digital assistant systems
US11705130B2 (en) 2019-05-06 2023-07-18 Apple Inc. Spoken notifications
US11675491B2 (en) 2019-05-06 2023-06-13 Apple Inc. User configurable task triggers
US11888791B2 (en) 2019-05-21 2024-01-30 Apple Inc. Providing message response suggestions
US11237797B2 (en) 2019-05-31 2022-02-01 Apple Inc. User activity shortcut suggestions
US11657813B2 (en) 2019-05-31 2023-05-23 Apple Inc. Voice identification in digital assistant systems
US11790914B2 (en) 2019-06-01 2023-10-17 Apple Inc. Methods and user interfaces for voice-based control of electronic devices
US11488406B2 (en) 2019-09-25 2022-11-01 Apple Inc. Text detection using global geometry estimators
US11924254B2 (en) 2020-05-11 2024-03-05 Apple Inc. Digital assistant hardware abstraction
US11914848B2 (en) 2020-05-11 2024-02-27 Apple Inc. Providing relevant data items based on context
US11765209B2 (en) 2020-05-11 2023-09-19 Apple Inc. Digital assistant hardware abstraction
US11755276B2 (en) 2020-05-12 2023-09-12 Apple Inc. Reducing description length based on confidence
US11838734B2 (en) 2020-07-20 2023-12-05 Apple Inc. Multi-device audio adjustment coordination
US11750962B2 (en) 2020-07-21 2023-09-05 Apple Inc. User identification using headphones
US11696060B2 (en) 2020-07-21 2023-07-04 Apple Inc. User identification using headphones
CN112528004A (en) * 2020-12-24 2021-03-19 北京百度网讯科技有限公司 Voice interaction method, voice interaction device, electronic equipment, medium and computer program product
CN113535987A (en) * 2021-09-13 2021-10-22 杭州涂鸦信息技术有限公司 Linkage rule matching method and related device

Also Published As

Publication number Publication date
CN106657521A (en) 2017-05-10

Similar Documents

Publication Publication Date Title
WO2017071420A1 (en) Method, apparatus and system for voice communication with smart device
KR101597177B1 (en) Context awareness proximity-based establishment of wireless communication connection
US7027774B2 (en) Method for direct voice telephone call using bluetooth terminal
JP7144479B2 (en) TERMINAL AND OPERATION METHOD THEREOF
WO2015074600A1 (en) Call forwarding method and terminal
WO2015043198A1 (en) Method, device and system for controlling access to router
CN102572584A (en) Intelligent television system and intelligent television method capable of expanding cellphone
EP2171594A1 (en) A host controlling an interfaced pda&#39;s applications directly
WO2016127795A1 (en) Service processing method, server, and terminal
CN104205998A (en) Method and apparatus for relaying data communications in a bluetooth network
US9258672B2 (en) Short-range wireless communication device
CN103379448A (en) Method of reducing a waiting time when cancelling a connection and an electronic device therefor
WO2018095235A1 (en) Call forwarding method and system
US20230138804A1 (en) Enhanced video call method and system, and electronic device
US20160173820A1 (en) Video Communication Method and Device
US7580704B2 (en) Communication systems and methods for switching communication services
CN104581665A (en) Call transfer method and device
WO2021239032A1 (en) Bluetooth protocol connection method and apparatus, storage medium, and related device
US12034561B2 (en) Processing method, device and storage medium
US20120002570A1 (en) Coordinating and Establishing Communication Networks Between Communication Devices
KR20210008415A (en) Access control method, message broadcast method, and related devices
WO2020221308A1 (en) Pc5 link establishment method, device and system
CN111935849A (en) Information processing method, device and storage medium
CN111787496B (en) Method and equipment for switching calls between mobile phones
CN101919184A (en) Method for monitoring host machines, monitoring device and host machine

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16858856

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16858856

Country of ref document: EP

Kind code of ref document: A1