A user equipment for providing information most relevant to a user as the user becomes impaired or experiences diminishing capacity is disclosed. The user equipment includes a transceiver, a memory, at least one sensor for detecting a biometric measurement of a user of the equipment, a user interface and a processor. The processor filters the biometric measurement, calculates a metric based on the measurement, evaluates the metric, selectively adjusts an amount of information displayed on the user interface based on the evaluated metric and executes an application corresponding to a user actuation of an item of the displayed information.
|
8. A communication method performed by a mobile device, the method comprising:
displaying information on a graphical user interface of the mobile device;
obtaining, from at least one sensor, at least one biometric measurement of a mobile device user of the mobile device;
filtering the at least one obtained measurement;
calculating a metric based on the filtered measurement;
evaluating the metric;
selectively adjusting an amount of information displayed on the user equipment graphical user interface based on the evaluated metric at least one biometric measurement; and
actuating establishing a communication link corresponding to a user selection of an item of information displayed on the user equipment graphical user interface; and
reducing the amount of information displayed if the at least one biometric measurement indicates a worsening user condition.
1. A user equipment mobile device comprising:
a transceiver;
a memory;
at least one sensor for detecting biometric measurements of a user of the equipment;
a user interface; and
a processor processing circuitry configured for to:
display information on a graphical user interface of the mobile device;
obtain, from at least one sensor, biometric measurements of a user of the mobile device;
filtering the biometric measurements;
calculating a metric based on the filtered biometric measurements;
evaluating the metric;
selectively adjusting adjust an amount of information displayed on the graphical user interface based on the evaluated metric biometric measurements; and
executing an application establish a communication link corresponding to a user actuation selection of an item of the displayed information;
wherein the processing circuitry is further configured to reduce the amount of information displayed if the biometric measurements indicate a worsening user condition.
20. A non-transitory computer-readable medium storing a computer program comprising computer readable program modules instructions, which when run on a user equipment mobile device causes the user equipment mobile device to:
display information on a graphical user interface of the mobile device;
obtain, from at least one sensor, at least one biometric measurement of a mobile device user of the mobile device;
filter the at least one obtained measurement;
calculate a metric based on the filtered measurement;
evaluate the metric;
selectively adjust an amount of information displayed on the user equipment graphical user interface based on the evaluated metric at least one biometric measurement; and
actuate establish a communication link corresponding to a user selection of an item at information displayed on the user equipment graphical user interface; and
reduce the amount of information displayed if the at least one biometric measurement indicates a worsening user condition.
2. The user equipment mobile device of
3. The user equipment mobile device of
0. 4. The user equipment of
0. 5. The user equipment of
increasing the amount of information displayed if the evaluated metric indicates an improvement in the user condition.
0. 6. The user equipment of
determining a type of information that is displayed on the user interface.
0. 7. The user equipment of
storing the at least one biometric measurement and the evaluated metric.
9. The method of
10. The method of
11. The method of
13. The method of
0. 14. The method of
15. The method of
determining a type of information that is displayed based on the evaluated metric at least one biometric measurement.
17. The method of
0. 18. The method of
increasing the amount of information displayed on the user interface if the metric evaluation indicates an improved condition of the user.
0. 19. The method of
storing the biometric measurements and the evaluated metric for subsequent retrieval and diagnosis.
21. The user equipment mobile device of claim 1 3, wherein the calculated metric is a combination of a plurality of biometric measurements.
0. 22. The mobile device of claim 1, wherein the at least one sensor is integrated into the mobile device.
0. 23. The mobile device of claim 1, wherein the at least one sensor is separate from the mobile device.
0. 24. The mobile device of claim 23, wherein the at least one sensor communicates with the mobile device over a short range communication interface.
0. 25. The mobile device of claim 1, wherein the reduced amount of information displayed comprises information that is more pertinent to the user in his or her current condition, as determined by the biometric measurements.
0. 26. The mobile device of claim 1, wherein the reduced amount of information displayed comprises an icon for dialing an emergency number.
0. 27. The mobile device of claim 1, wherein establishing the communication link comprises one of the following:
launching an internet browser;
make a phone call; or
launching a navigation application.
0. 28. The method of claim 8, wherein establishing the communication link comprises one of the following:
launching an internet browser;
make a phone call; or
launching a navigation application.
0. 29. The method of claim 8, wherein selectively adjusting the amount of information displayed comprises calculating a metric based on the at least one biometric measurement and comparing the metric to a threshold value.
|
This application is a reissue application of U.S. patent application Ser. No. 13/976,295, filed Jun. 26, 2013, now U.S. Pat. No. 9,135,466 B2, granted Sep. 15, 2015, which was a National Stage Entry of International Patent Application No. PCT/IB10/03488, filed Dec. 30, 2010, the disclosures of which are fully incorporated herein by reference.
The present invention relates to mobile devices and more particularly to methods for adjusting the mobile device user interface to assist a user based on user biometric measurement(s).
The use of sensors assisting users that are impaired in some manner is known. Sensor networks in cars such as that described in U.S. Patent Publication No. 2009/0267774 (“Automobile Physiological Monitoring System and Method for Using the same”) prohibit operation of the car by a user experiencing low blood sugar levels in order to prevent accidents/damages.
Phones have been designed for people with certain handicaps or bad eyesight. These phones include big buttons and are often not equipped with many features that demand a high resolution display or more fine grained controllers.
These phones lack features that are common in other phones such as location sensing (GPS for example), music playing and web browsing. They also require entering the numbers (i.e. dialing using fingers) to make a call and a relatively rudimentary phone book.
Other special phones, such as that described in GB 2431 319 (“Phone for Vulnerable Persons”) for example, are also static and cannot be used as a normal phone or smartphone. They are not designed to assist the user in making the choice that is appropriate for the user's current health condition or to take into account a sudden change in his or her condition.
Smartphones typically include a graphical user interface (GUI) for providing a logical and intuitive interface for making calls, texting or browsing the web for example. An increasing amount of information is being displayed on the smartphone interface as the size, functionality and quality of the user interface continues to increase. Icons, color, shape and animation can be used to convey or highlight information on the mobile device.
While increasing functionality is attractive to users, excessive information displayed on the user interface impedes a user from effectively utilizing the device especially when the user is operating in a diminished capacity such as due to illness or the like.
Normal phones and “easy to use” smartphones still require several steps for a user to take in order to make a call even from the phones contact list. This could be a problem when a person is not even coherent enough to know the emergency number such as “112” in some countries or “911” in the United States or not able to see well enough to distinguish between digits or remember what the required call sequence looks like. Typically, a high density of information on the smartphone user interface (“cluttering”) makes the telephone confusing to use when a user is impaired. Small icons could be misinterpreted and pressing a button to start a game for example might make the situation even worse.
There exists a need for a mobile device which facilitates easier operation for a user experiencing diminishing or diminished capacity.
It should be emphasized that the terms “comprises” and “comprising”, when used in this specification, are taken to specify the presence of stated features, integers, steps or components; but the use of these terms does not preclude the presence or addition of one or more other features, integers, steps, components or groups thereof.
A user equipment provides information on the user interface that is relevant to assisting a user of the equipment when the user equipment detects a diminished capacity or impairment of the user.
According to an exemplary embodiment, a user equipment is disclosed. The user equipment includes a transceiver, a memory, at least one sensor for detecting a biometric measurement of a user of the equipment, a user interface and a processor. The processor filters the biometric measurement, calculates a metric based on the measurement, evaluates the metric, selectively adjusts an amount of information displayed on the user interface based on the evaluated metric and executes an application corresponding to a user actuation of an item of the displayed information.
In other embodiments, a communication method is disclosed. The method includes obtaining at least one biometric measurement of a mobile device user, filtering the at least one obtained measurement, calculating a metric based on the filtered measurement, evaluating the metric, selectively adjusting an amount of information displayed on the mobile device based on the evaluated metric and actuating an item of information displayed on the user equipment.
In further exemplary embodiments, a computer program comprising computer readable program modules is disclosed. The computer program, when run on a user equipment, causes the user equipment to obtain at least one biometric measurement of a mobile device user, filter the at least one obtained measurement, calculate a metric based on the filtered measurement, evaluate the metric, selectively adjust an amount of information displayed on the user equipment based on the evaluated metric and actuate an item of information displayed on the user equipment.
The objects and advantages of the invention will be understood by reading the following detailed description in conjunction with the drawings in which:
The various features of the invention will now be described with reference to the figures, in which like parts are identified with the same reference characters.
The various aspects of the invention will now be described in greater detail in connection with a number of exemplary embodiments. To facilitate an understanding of the invention, many aspects of the invention are described in terms of sequences of actions to be performed by elements of a computer system or other hardware capable of executing programmed instructions. It will be recognized that in each of the embodiments, the various actions could be performed by specialized circuits (e.g., analog and/or discrete logic gates interconnected to perform a specialized function), by one or more processors programmed with a suitable set of instructions, or by a combination of both. The term “circuitry configured to” perform one or more described actions is used herein to refer to any such embodiment (i.e., one or more specialized circuits and/or one or more programmed processors). Moreover, the invention can additionally be considered to be embodied entirely within any form of computer readable carrier, such as solid-state memory, magnetic disk, or optical disk containing an appropriate set of computer instructions that would cause a processor to carry out the techniques described herein. Thus, the various aspects of the invention may be embodied in many different forms, and all such forms are contemplated to be within the scope of the invention. For each of the various aspects of the invention, any such form of embodiments as described above may be referred to herein as “logic configured to” perform a described action, or alternatively as “logic that” performs a described action.
According to exemplary embodiments, biometric measurements of a user may be utilized to minimize or reduce (or adjust) the amount of information that is displayed on a user interface of a mobile device which may also be referred to as a mobile communication device or a user equipment (UE) such as a smartphone. The biometric measurements may be obtained by a plurality of sensors. The sensors may obtain a variety of user biometric measurements including, but not limited to, heart rate, blood pressure, perspiration, etc.
The sensors may be integrated within the mobile device or may transmit the biometric measurements to the mobile device. In some embodiments, the sensors may be within a short communication range of the mobile device.
As a user experiences symptoms associated with a deteriorating health or physical condition, the amount of information (or choices available to the user) displayed on the user equipment display is reduced to only display information that is more pertinent to the user in his or her current condition as determined by the biometric measurements. This information may assist the user in communicating his or her condition or seek appropriate help or assistance. Such reduction simplifies the process needed to assist the user such as in finding and using emergency phone numbers, directions to the nearest emergency room/doctor or a pharmacy and the like.
Many mobile devices such as smartphones include sensors for measuring acceleration (e.g. accelerometers) and detecting location (GPS) for example.
Future mobile devices can easily be equipped with other sensors to obtain various biometric measurements of the user. These measurements can be evaluated individually or combined to determine a present condition of the user.
A mobile device may include biometric sensors for detecting or measuring, for example, blood pressure (BP), pulse (P), hand humidity (HH), hand/body shakiness (HS), blood oxygen levels (O2), etc.
The GUI of the phone may change according to the measured biometric condition of the user. That is, the type of information displayed on the interface may change according to the biometric measurement(s) of the user in some embodiments. The functionality that is made available to the user via icons on the interface may also be reduced to reflect the user's current condition. The assumption is that the biometric measurements reflect a deterioration in the user's physical and/or mental condition.
A smartphone (or user equipment) 100 is illustrated in
As illustrated in
If the heart/pulse rate increases along with an increase in other conditions such as blood pressure, the icons for work may be removed and only the icons for emergency 260, home 270 and security 280 along with location co-ordinates 295 may be displayed on user interface 240 as illustrated in
The size of the icons representing each of the contacting entities may also be adjusted based on the number of icons displayed which may also reflect the condition of the user. That is, in an extreme emergency, a relatively large icon for emergency may occupy virtually the entire user interface.
A change in the information displayed on the interface may be drastic (i.e. a sudden change in the type and amount of information displayed) if a sudden deterioration in the user's condition is detected by the sensor(s). A scaled distress level may also be assigned to the user's condition. The determination of a user's capacity may be based on one of the enumerated conditions in some embodiments; in other embodiments, the determination may be made by combining a number of these conditions to determine the user's capacity. An algorithm may be developed or existing algorithms may be implemented for evaluating the user's condition based on biometric measurements from one or more (biometric) sensors.
In the exemplary embodiment of
While these measurements (i.e. BP, P, HH and HS) have been mentioned herein as examples, the number of measurements parameters may be greater or less than this number (i.e. four) in various embodiments. Similarly, the types of measurement may also differ in various embodiments. Other biometric measurements may include temperature, blood sugar levels, etc.
These measurements may be obtained by the mobile device at 510. In this context, “obtain” may imply that the mobile device has access to the measurements as they could be made by sensors that are both part of the mobile device and by sensors that are not part of the mobile device. They may also be in a memory associated with the mobile device.
The measurement may be filtered at 520. Filtering may include accepting measurements that meet a threshold value for example. Filtering may also include removing unwanted bias in the measurements or removing measurements that change too quickly. A state metric (SM) may be calculated at 530 based on the obtained biometric measurement. The SM may be a combination of various biometric measurements—this may be similar to a health care provider considering multiple symptoms simultaneously to determine a user condition.
The state metric calculation is described in further detail below with reference to
Based on the metric evaluation, a simplified (i.e. less “cluttered”) graphical user interface (GUI) with reduced number of icons may be displayed to the user for actuation at 550. One of the items (or icons) displayed on the user interface may be selected or actuated at 560 to establish a do communication link. Actuation may include selecting an icon displayed on the user interface for example. In some situations (such as an extreme emergency), only one item may be displayed for selection/actuation. Upon establishing the connection, the user may communicate his/her condition or seek help or assistance.
An exemplary flow/process for filtering (corresponding to step 520 of
The state metric may be determined at step 650 based on the filtered values. The state metric may then be provided as input to a state metric evaluation process, which is described in further detail below with reference to
An exemplary state metric evaluation process is illustrated in
Multiple biometric measurements may also be evaluated individually in some embodiments
In some situations, a particular (single) biometric measurement may trigger an indication that the user's condition requires the display to reduce the amount of information displayed and made available to the user for actuation. However, the amount of displayed information or icons may be reduced further if other parameters also exceed a safe threshold level or if a combination of parameters exceed a threshold. That is, if multiple thresholds (both individual and combined) are exceeded, the amount of information being made available to the user may continue to be decreased based on the particular situation.
A plurality of different counters may be increased or decreased depending on the values of the various biometric measurements (e.g. BP, P, HH, HS). As described, these can be individual measurements or combined measurements depending on the particular metrics available from the mobile device. These metrics can also be given different weights and priorities to produce an accurate response from the mobile device. Based on the metric evaluation, a level of inability or impairment for the user may be determined. In some embodiments, a type of impairment (such as a diagnosis of a condition or disease for example) may also be determined based on the metric evaluation. The amount and type of information displayed on the user interface may be based on the level and/or type of inability determined for the user by evaluation of the metric.
The results of the evaluation can be implemented in several ways depending on the metrics that are available. One strategy could be used if there is only one response. More advanced variants could be used if there are several levels of distress that should be considered by the mobile device.
For example, in the figure with several choices of phone numbers (
The particular algorithm(s) used for evaluating the various biometric measurements can vary depending on the intended users, or regions of usage, for the mobile device. The algorithms may be known and are not described further herein.
In some embodiments, calculated and evaluated metric(s) may be stored. The storage may have a particular application in cases where the user may have passed out or became unconscious by the time emergency help arrives. In such cases, the emergency personnel can access the user condition information from the mobile device.
In one embodiment, in order for the processor 130 of
While the description above focuses on a degradation or worsening of a user condition, exemplary embodiments may also increase the amount of displayed information if an improvement in the user's condition is detected.
While the user is presented with a reduced number of icons and functionality as described above, all the capabilities of a mobile device continue to remain available even if some of the icons are not displayed on the user interface. An icon or a particular gesture or pattern may be actuated on the user interface to retrieve the default display if the user is able to actuate the small icon.
Exemplary embodiments as described herein are not limited to assisting users suffering from physical impairment or diminished capacity. A user may be listening to music while engaged in a physical activity such as running. Biometric sensors may determine that the user is running based on elevated heart rate, shaking or vibration associated with running, etc. The features available to the user may be simplified or reduced to “play”, “skip”, “pause”, “stop”, etc.
Various embodiments consistent with the invention provide one or more advantages over conventional systems.
A user will be able to make emergency or important calls even when severely stressed or all without having to have a specific device for emergency use. Exemplary embodiments can be implemented on a normal Smartphone without having to remove or replace existing features in order to provide the features as described above. There is no need for additional (special) buttons that may limit the user interface in other ways.
Exemplary embodiments as described above predicts the user's capacity/ability and present information that is most suitable or appropriate to the user's condition. In a more severe distress situation, a mobile device according to exemplary embodiments can present the information in less overcrowded manner thus makes it easier for a user to comprehend and use. Furthermore, exemplary embodiments may be implemented on any touch screen device.
The invention has been described with reference to particular embodiments. However, it will be readily apparent to those skilled in the art that it is possible to embody the invention in specific forms other than those of the embodiment described above. The described embodiments are merely illustrative and should not be considered restrictive in any way. The scope of the invention is given by the appended claims, rather than the preceding description, and all variations and equivalents which fall within the range of the claims are intended to be embraced therein.
Ökvist, Peter, Lindegren, David, Jönsson, Tomas
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
7170994, | Oct 15 2003 | Google Technology Holdings LLC | Method and apparatus for selecting an alert mode based on user biometrics |
8441356, | Feb 16 2009 | HandHold Adaptive, LLC | Methods for remote assistance of disabled persons |
20030038754, | |||
20090085873, | |||
20090267774, | |||
EP2214387, | |||
GB2431319, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Sep 13 2017 | Telefonaktiebolaget LM Ericsson (publ) | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Sep 13 2017 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Mar 15 2023 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Date | Maintenance Schedule |
Apr 30 2022 | 4 years fee payment window open |
Oct 30 2022 | 6 months grace period start (w surcharge) |
Apr 30 2023 | patent expiry (for year 4) |
Apr 30 2025 | 2 years to revive unintentionally abandoned end. (for year 4) |
Apr 30 2026 | 8 years fee payment window open |
Oct 30 2026 | 6 months grace period start (w surcharge) |
Apr 30 2027 | patent expiry (for year 8) |
Apr 30 2029 | 2 years to revive unintentionally abandoned end. (for year 8) |
Apr 30 2030 | 12 years fee payment window open |
Oct 30 2030 | 6 months grace period start (w surcharge) |
Apr 30 2031 | patent expiry (for year 12) |
Apr 30 2033 | 2 years to revive unintentionally abandoned end. (for year 12) |