A voice control system is directed to a car navigation device that includes: a display unit; a microphone; a speech recognition unit for recognizing, as a command, a speech uttered by a user; and a navigation ECU to which the voice recognition unit outputs the command. When the user inputs the speech, auxiliary switches are shown on the display unit. When the user selects one of the auxiliary switches, respective functions that correspond to the auxiliary switches are executed. The functions include displaying a voice command list or guidance for voice input on the displaying unit or outputting, to the navigation ECU, a result of determination whether a certain function, such as setting of a destination, should be allowed to be executed, the user first being required to affirm or negate the recognized destination setting by voice or auxiliary switch.
|
1. A voice control system for an in-vehicle navigation device, the system including:
a voice inputting unit configured to input a speech uttered by a user through voice input;
a display unit configured to display a switch for a switch operation; and
a controlling unit configured to recognize the inputted speech to thereby execute a function according to a speech content corresponding to the recognized speech, the controlling unit identifying to the user a content of a destination setting that is subsequently executed, and requiring the user to make an instruction for a determination of whether to affirm or negate the destination setting before the destination setting is executed, the instruction for the determination of the destination setting being able to be made by both the switching operation and via the voice input,
the controlling unit comprising:
a display-controlling unit for displaying, when the user utters the speech, an auxiliary switch that executes an auxiliary function for the voice input manipulation; and
an executing unit for executing, when the auxiliary switch is selected, the auxiliary function.
4. A voice input method in a voice control system for an input navigation device, the control system that includes a display unit, voice inputting means for inputting a speech uttered by a user, and controlling means for recognizing, as a speech content, the inputted speech and thereby executing a function according to the speech content, the method comprising:
notifying the user of a content of a destination setting;
displaying on the display unit, simultaneously with the notifying, (i) a first switch for the user to make a first instruction to affirm the destination setting and (ii) a second switch for the user to make a second instruction to negate the destination setting;
requiring the user to provide an instruction to either affirm or negate the destination setting before the destination setting is executed, the instruction to either affirm or negate the designation setting being able to be made by both voice input and a switch operation using the first and second switches; and
providing, when either the first switch or the second switch is selected by the user, an instruction according to the corresponding first or second switch.
2. The voice control system according to
wherein the controlling unit notifies, to the user, the content of the destination setting through instructing the display-controlling unit to display the content of the destination setting on the display unit.
3. The voice control system according to
wherein the display unit includes a screen and a detecting unit for detecting, on the screen, an area that the user touches, and
wherein, when the user touches a predetermined area corresponding to either the first switch or the second switch that is displayed on the screen of the display unit, the executing unit determines that either the first switch or the second switch is selected.
5. The voice input method of
|
This application is based on and incorporates herein by reference Japanese Patent Application No. 2002-197262 filed on Jul. 05, 2002.
The present invention relates to a voice control system that enhances usability in voice input manipulation with having an auxiliary display.
A speech uttered by a speaker is conventionally used for controlling various functions of a camera or a car navigation device. For instance, in JP-A-S64-56428, a camera control system using voice input is described as follows: a speech corresponding to required manipulation is inputted; the speech is recognized by a voice recognition unit; and the camera is controlled based on a control processing corresponding to a recognition result.
In this voice-controlled camera, a certain function can be executed by a certain voice command having one-to-one correspondence with the certain function. For instance, only “no strobe” can be functional as the certain voice command for prohibiting a strobe light at shooting, even though “strobe off,” “stop strobe,” or “flash off” may be used depending on a user.
A user therefore needs to correctly memorize a certain voice command that enables a certain function to be executed. However, user's workload increases with increasing executable functions. This results in worsening usability in voice input.
In voice recognition, a shorter word is apt to be mis-recognized. For instance, there is a case where a user inputs an address of a destination through voice input in a car navigation device and is then required for determining whether a point designated on a map is correct as a destination. In this case, the user sets or cancels the destination by uttering “YES” or “NO,” respectively. However, the short word of “YES” or “NO” is apt to be mis-recognized, so that a function of setting the destination is sometimes executed against user's intention.
It is an object of the present invention to provide a voice control system that enhances usability of voice input manipulation with an auxiliary display.
To achieve the above object, a voice control system having a display is provided with the following. When a user inputs a speech, an auxiliary switch is displayed for executing an auxiliary function of inputting the speech. When the auxiliary switch is selected, the auxiliary function is executed. In this structure, the auxiliary switch can be used for a case where mis-recognizable voice input may be apt to happen. This results in improving usability of a voice control system in comparison with a voice control system that uses voice input alone.
The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description made with reference to the accompanying drawings. In the drawings:
A car navigation device provided in a vehicle will be explained as an embodiment that a voice control system of the present invention is directed to.
As shown in
The navigation ECU 1 is formed as a known computer and includes internal components such as a CPU, a ROM, a RAM, and an input/output (I/O) circuit, and a communications bus that connects the internal components. The ROM is stored with a program that is executed in the navigation device, and the CPU processes according to the program. The program can be obtained through the external I/O unit 7.
As explained above, the position detection section includes, as position sensors, the GPS receiver 9, the speed sensor 10, the geomagnetic sensor 11, and the gyroscope 12. Each of them has respectively differently natured error range, so that a position is calculated by using plural sensors with adjusting each another. In addition, according to accuracy of each sensor, the position detection section can be formed of part of the above position sensors. A revolution sensor for detecting steering position or a yaw rate sensor can be used for detecting the position.
The map data input unit 13 is for inputting, to the navigation ECU 1, map data such as road data or landmark data. The unit 13 includes storage for storing the map data. As the storage, a CD-ROM or a DVD-ROM is generally used due to data volume of the map data. However, a memory card or a hard disk drive can be also used.
The display unit 5 is formed of a liquid crystal display. The display unit 5 shows, on its screen, the map data from the map data input unit 13, an own vehicle mark based on a current position detected by the position detection section, and additional data such as a guiding route.
The external I/O unit 7 is for receiving outside information such as Vehicle Information and Communication System (VICS) or sending out information. The outside information is processed by the navigation ECU 1. The processed information such as traffic jam information or traffic regulation information is superimposed on the map data shown on the screen of the display unit 5. When needed, information processed by the navigation ECU 1 is sent out through the external I/O unit 7.
The manipulation switch input unit 8 is used for input and is formed of a touch switch integrated into the display unit 5, a mechanical switch, or the like. The navigation device of this embodiment has a function of route assistance. Here, when position of a destination is inputted through the manipulation switch input unit 8, an appropriate route from the current position to the destination is automatically selected and shown on the screen of the display unit 5.
The microphone 2 and the talk switch 3 are used for voice input. As a press button of the talk switch 3 is pressed, an input trigger is sent to the VR unit 4. As the VR unit 4 receives the input trigger, it shifts to a voice input mode of accepting the voice input through the microphone 2.
At the voice input mode, when a user utters a speech of “current position,” the speech is converted to a voice signal through the microphone 2 and sent to the VR unit 4. The VR unit 4 recognizes the voice signal, and converts it into a manipulation command corresponding to the speech. The VR unit 4 then sends the manipulation command to the navigation ECU 1. Thus, the speech is recognized as “CURRENT POSITION” and converted into the manipulation command of “DISPLAY CURRENT POSITION.” The navigation ECU 1 that receives this manipulation command displays a road map surrounding the current position on the screen of the display unit 5.
The speaker 6 is used for outputting voice guidance or various alarms. For instance, it can be a speaker that is previously installed in the vehicle or a speaker that is built in the car navigation device.
Processing of the car navigation device will be explained below from when a voice is inputted to when a function based on the inputted voice is executed, referring to
At Step 10, a waiting state continues till the talk switch 3 is pressed by a user, and processing proceeds to Step 20 when the talk switch 3 is pressed.
At Step 20, the VR unit 4 shifts to the voice input mode where the voice input can be received.
At Step 30, almost simultaneously with above shifting to the voice input mode, an assist window and auxiliary switches for assisting the voice input manipulation are shown on the screen of the display unit 5 by the navigation ECU 1.
Instances of the assist window and the switches are shown within a screen in an upper portion of
Here, in order to execute a function of the navigation device through the voice input, a voice command corresponding to the function must be properly uttered. Furthermore, for instance, regarding setting of a destination, there are various input methods that use an address, a phone number, a building name, a genre (such as restaurant and gas station), and the like. Furthermore, in each of the input methods, prescribed commands are needed to be accurately uttered in a prescribed order.
However, it is very difficult for the user to thoroughly memorize rules of the voice input manipulation and voice commands. This results in adversely affecting usability of the voice input manipulation.
In this embodiment, “HELP” is provided, as an auxiliary switch of voice input manipulation, along with the assist window so that the voice input manipulation can be smoothly operated even if the rules or the voice commands are forgotten.
For instance, in a case that the manipulation switch input unit 8 is integrated into the display unit 5 as a touch switch, the auxiliary switch of “HELP” is selected by being touched on the display area of “HELP.” Here, the touch switch is preferable provided in the display unit 5 so that the auxiliary switch can be easily selected by just being touched. Easy manipulation of the touch switch enhances improvement of providing the auxiliary switch.
At Step 40, it is determined whether one of the auxiliary switches is selected. When the one of the auxiliary switches is determined to be selected, the processing proceeds to Step 50.
At Step 50, an auxiliary function corresponding to the selected auxiliary switch is executed. Here, when the switch of “HELP” is selected, a voice recognition (VR) manipulation HELP window is shown with including a list of commands that are recognizable by voice input, as shown on a screen in a lower portion of
A switch of “MANIPULATION GUIDE” is also shown within the HELP window. When this switch is selected, guidance such as the above-mentioned rules for the voice input manipulation can be shown. Furthermore, a switch of “END” is shown within the HELP window. When this switch is selected, this HELP window can be erased.
Along with the auxiliary switch of “HELP,” another auxiliary switch of “STOP” is provided for stopping the voice input mode, as shown within the screen in the upper portion of
Furthermore, the auxiliary switches of “HELP” and “STOP” can be also selected through voice input. When voice of “HELP” or “STOP” inputted through a microphone 2 is recognized, display of the above voice recognition (VR) manipulation HELP window or stopping of the voice input mode is executed respectively.
When a voice command is inputted by the user while the assist window or the HELP window is shown on the screen of the display unit 5 as explained above, processing of voice recognition is executed at Step 60 in
At Step 70, a function corresponding to the extracted speech content is executed.
In the next place, other instances of the assist window and auxiliary switches for assisting the voice input manipulation will be explained below with referring to
A display instance in
In this case, “IS THIS POINT SET AS DESTINATION?” in the assist window is displayed along with auxiliary switches of “YES” and “NO.”
Here, although a short word of “YES” or “NO” is inputted as a voice input, the short word is apt to be mis-recognized in the voice recognition. As a result, even though the user inputs a proper destination through the voice input, setting of the destination is sometimes cancelled, against user's intention, in such a final confirmation step. When the short word or command is inputted through the voice input, addition of switch manipulation input to the voice input can therefore inhibit an unintended function from being executed.
Voice announcement through the speaker 6 can be used along with the assist window on the display unit 5. However, functions that are to be executed such as setting of the destination should be preferentially shown on the screen of the display unit 5 so that the user can visually confirm it.
Another instance in
In this case, “LONG-DISTANCE NO. FIRST” in the assist window is displayed for notifying that the user can input the phone number through the voice input. Here, auxiliary switches of “STOP” and “HELP” are shown simultaneously. When the switch of “STOP” is selected, accepting of the phone number is terminated and the display returns to the initial display shown on the screen in the upper portion of
When the switch of “HELP” is selected, “MANIPULATION GUIDE” showing instruction regarding voice input is shown on the screen of the display unit 5. In detail, there are instructions such as “UTTER LONG-DISTANCE AND LOCAL NO. SEPARATELY” or “NOT FIGURE-INCLUDED READING, BUT SERIAL READING BY DIGIT.” The user thereby inputs voice with considering the instruction. This results in enhancing recognition degree of the inputted phone numbers and to thereby enable the user to smoothly manipulate the voice input.
(Modification)
The assist window or the auxiliary switches are limited to the above-mentioned instances.
For instance, there is a case that a phone number of a destination is inputted while a preset destination is already set. Here, an assist window is shown as inquiring whether the preset destination is altered to the newly inputted destination or the newly inputted destination is added as a passing point. The auxiliary switches can be “ALTER” or “ADD.”
Here, although “ALTER” or “ADD” is apt to be mis-recognized, providing of the auxiliary switches enables executing of a relevant function as the user intends.
In the above embodiment, the VR unit 4 is constructed separately from the navigation ECUL. However, the VR unit 4 can be integrated into the navigation ECU 1.
Furthermore, the present invention can be directed not only to the car navigation device but also other devices such as an electric appliance or a robot, to which the voice recognition can be adopted.
It will be obvious to those skilled in the art that various changes may be made in the above-described embodiments of the present invention. However, the scope of the present invention should be determined by the following claims.
Patent | Priority | Assignee | Title |
10072941, | Mar 26 2012 | HERE Global B.V. | Reverse natural guidance |
10882399, | Nov 17 2005 | IQAR INC | Electric vehicle power management system |
11084377, | Nov 17 2005 | IQAR INC | Vehicle power management system responsive to voice commands from a Gps enabled device |
11168997, | Mar 26 2012 | HERE Global B.V. | Reverse natural guidance |
11518399, | Mar 27 2019 | HONDA MOTOR CO , LTD | Agent device, agent system, method for controlling agent device, and storage medium |
9344554, | May 07 2009 | Samsung Electronics Co., Ltd.; SAMSUNG ELECTRONICS CO , LTD | Method for activating user functions by types of input signals and portable terminal adapted to the method |
9396737, | Jan 07 2013 | Samsung Electronics Co., Ltd. | Display apparatus and method for controlling the display apparatus |
9520133, | Jan 07 2013 | Samsung Electronics Co., Ltd. | Display apparatus and method for controlling the display apparatus |
Patent | Priority | Assignee | Title |
4827520, | Jan 16 1987 | Prince Corporation; PRINCE CORPORATION, A CORP OF MICHIGAN | Voice actuated control system for use in a vehicle |
5754430, | Mar 29 1994 | Agilent Technologies Inc | Car navigation system |
6012030, | Apr 21 1998 | AVAYA Inc | Management of speech and audio prompts in multimodal interfaces |
6040824, | Jul 31 1996 | AISIN AW CO , LTD | Information display system with touch panel |
6098015, | Apr 23 1996 | AISIN AW CO , LTD | Navigation system for vehicles and storage medium |
6157342, | May 27 1997 | CLARION CO , LTD | Navigation device |
6181996, | Nov 18 1999 | International Business Machines Corporation | System for controlling vehicle information user interfaces |
6230132, | Mar 10 1997 | Harman Becker Automotive Systems GmbH | Process and apparatus for real-time verbal input of a target address of a target address system |
6324507, | Feb 10 1999 | Nuance Communications, Inc | Speech recognition enrollment for non-readers and displayless devices |
6560574, | Feb 10 1999 | Nuance Communications, Inc | Speech recognition enrollment for non-readers and displayless devices |
6826472, | Dec 10 1999 | TOMTOM NORTH AMERICA INC | Method and apparatus to generate driving guides |
6968311, | Jul 28 2000 | Continental Automotive Systems, Inc | User interface for telematics systems |
6970824, | Dec 05 2000 | HEWLETT-PACKARD DEVELOPMENT COMPANY L P | Enabling voice control of voice-controlled apparatus using a head mounted camera system |
7167826, | Jul 07 2001 | SAMSUNG ELECTRONICS CO , LTD | Communication terminal controlled through touch screen or voice recognition and instruction executing method thereof |
20010016789, | |||
20020069071, | |||
20020107696, | |||
20020120455, | |||
20030014261, | |||
20030195749, | |||
JP2001282284, | |||
JP2002149192, | |||
JP59157699, | |||
JP6184771, | |||
JP7295586, | |||
JPH376356, | |||
JPH10312193, | |||
JPS57188190, | |||
JPS6121526, | |||
JPS6456428, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jun 16 2003 | TANAKA, MAKOTO | Denso Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 014224 | /0511 | |
Jun 25 2003 | Denso Corporation | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Mar 16 2009 | ASPN: Payor Number Assigned. |
Sep 19 2011 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Apr 17 2013 | ASPN: Payor Number Assigned. |
Apr 17 2013 | RMPN: Payer Number De-assigned. |
Dec 16 2015 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Dec 16 2019 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Jun 24 2011 | 4 years fee payment window open |
Dec 24 2011 | 6 months grace period start (w surcharge) |
Jun 24 2012 | patent expiry (for year 4) |
Jun 24 2014 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jun 24 2015 | 8 years fee payment window open |
Dec 24 2015 | 6 months grace period start (w surcharge) |
Jun 24 2016 | patent expiry (for year 8) |
Jun 24 2018 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jun 24 2019 | 12 years fee payment window open |
Dec 24 2019 | 6 months grace period start (w surcharge) |
Jun 24 2020 | patent expiry (for year 12) |
Jun 24 2022 | 2 years to revive unintentionally abandoned end. (for year 12) |