There is described a portable electronic device capable of managing screen orientation. The portable electronic device comprises a display, a motion sensor, an image sensor and a processor. The display provides an image at a first orientation. The motion sensor attempts to detect a rotation of the portable electronic device. The image sensor attempts to detect one or more body features. The processor determines a second orientation of the image at the display based on the rotation detected at the motion sensor and/or the body feature or features detected at the image sensor. The portable electronic device may determine an orientation of the image at the display in response to detecting the rotation at the motion sensor and/or the body feature or features at the image sensor.
|
1. A method of a portable electronic device for managing screen orientation, the portable electronic device including a display, a motion sensor and an image sensor, the method comprising:
attempting to detect a rotation at the motion sensor;
detecting an angle of the device relative to a ground surface;
activating the image sensor in response to detecting that the angle of the device relative to the ground surface is less than a predetermined threshold angle between the ground surface and a predefined position relative to the ground surface, wherein the angle between the predefined position and the ground surface is in the range of 20 to 30 degrees;
attempting to detect at least one body feature at the image sensor; and
determining an orientation of an image at the display in response to detecting at least one of the rotation at the motion sensor or the at least one body feature at the image sensor.
14. A portable electronic device capable of managing screen orientation comprising:
a display configured to provide an image at a first orientation;
a motion sensor configured to:
attempt to detect a rotation of the portable electronic device; and
attempt to detect an angle of the portable electronic device relative to a ground surface;
a processor configured to activate an image sensor in response to detecting that the angle of the portable electronic device relative to the ground surface is less than a predetermined threshold angle between the ground surface and a predefined position relative to the ground surface, wherein the angle between the predefined position and the ground surface is in the range of 20 to 30 degrees;
the image sensor configured to attempt to detect at least one body feature; and
the processor configured to determine a second orientation of the image at the display based on at least one of the rotation detected at the motion sensor or the at least one body feature detected at the image sensor.
2. The method of
providing the image at the display at a first orientation before attempting to detect the rotation at the motion sensor; and
providing the image at the display at a second orientation after determining the orientation of the image at the display.
3. The method of
4. The method of
5. The method of
6. The method of
7. The method of
detecting a plurality of body features; and
selecting a particular body feature of the plurality of body features.
8. The method of
9. The method of
10. The method of
11. The method of
12. The method of
13. The method of
determining whether the angle of the device relative to the ground surface is less than the predetermined threshold angle between the ground surface and the predefined position relative to the ground surface; and
responsive to determining that the angle of the device relative to the ground surface is not less than the predetermined threshold angle between the predefined position and the ground surface, not activating the image sensor.
15. The portable electronic device of
the display provides the image at the display at the first orientation before the motion sensor attempts to detect the rotation; and
the display provides the image at the display at the second orientation after the processor determines the second orientation of the image.
16. The portable electronic device of
the display includes a planar surface; and
the motion sensor detects the rotation about an axis substantially orthogonal to the planar surface of the display.
17. The portable electronic device of
18. The portable electronic device of
19. The portable electronic device of
20. The portable electronic device of
21. The portable electronic device of
|
The present disclosure relates generally to a portable electronic device and more particularly to a method and apparatus for managing screen orientation of a portable electronic device.
Portable electronic devices are increasingly being used for accessing content, applications and functionalities. For example, a portable electronic device may include a touch-sensitive screen that enables one to interact directly with what is displayed. The touch-sensitive screen can be used to activate a function of the electronic device or otherwise interact with a user. Users typically use the touch-sensitive screen in two basic orientations, namely a portrait orientation in which the screen is viewed vertically and a landscape orientation in which the screen is viewed horizontally.
A portable electronic device may include an accelerometer to assist with portrait-to-landscape rotations and landscape-to-portrait rotations of its screen. The accelerometer of the device measures device orientation relative to the gravity of Earth and, then, rotates the screen accordingly. Due to the limits of physical law, the orientation cannot be resolved when the device lies flat relative to the surface of the ground. In fact, automatic screen rotation often doesn't work when the device is more horizontal than vertical relative to the surface of the ground. Many users, particularly those who understand the physical limitations of conventional screen rotation, avoid the problem by positioning the device vertically whenever screen rotation is desired.
There is described a portable electronic device, and method thereof, for managing automatic rotation of an image or object at an output component (such as a display) of the device. A first sensor (such as a motion sensor) of the device is used to detect rotation movement of the device, and a second sensor (such as an imager capable of detecting still image and/or motion video) is used to determine the orientation of the image or object relative to the output component. In particular, the second sensor enhances the device's ability to determine whether the image or object should be in a portrait orientation or a landscape orientation.
For one embodiment, the second sensor may be activated in response to the first sensor detecting that the tilt angle of the device relative to the ground surface falls below a predetermined threshold. The predetermined threshold may be determined based on an angle at which the device may not be able to distinguish between portrait and landscape orientations using one sensor alone. Thus, for this embodiment, the second sensor detects a body feature of a user, such as a facial feature of a user's face, and then the image or object may be oriented at the output component according to the detected body feature. Thus, when a user views the image or object at the output component, the image or object is provided at an appropriate orientation for viewing. By considering the tilt angle measured by the first sensor and the facial features detected by the second sensor, automatic landscape-portrait screen rotations may be managed to operate appropriately at all angles.
An aspect of the present invention is a method of a portable electronic device for managing screen orientation. The device attempts to detect a rotation at a motion sensor, and the device attempts to detect one or more body features at an image sensor. Thereafter, an orientation of an image at a display is determined in response to detecting the rotation at the motion sensor, the body feature or features at the image sensor, or both.
Another aspect of the present invention is a portable electronic device capable of managing screen orientation, in which the device comprises a display, a motion sensor, an image sensor and a processor. The display is configured to provide an image at a first orientation. The motion sensor is configured to attempt to detect rotation of the portable electronic device, and the image sensor is configured to attempt to detect one or more body features. The processor is configured to determine a second orientation of the image at the display based on the rotation detected at the motion sensor, the body feature or features detected at the image sensor, or both.
Referring to
The portable electronic device 100 includes at least one output component and at least two input components or sensors. For one embodiment, like the one shown in
The portable electronic device 100 also includes at least two input components or sensors. For one embodiment, like the one shown in
As represented in
Referring to
The processor 203 may generate commands based on information received from one or more input components 209. The processor 203 may process the received information alone or in combination with other data, such as the information stored in the memory 205. Thus, the memory 205 of the internal components 200 may be used by the processor 203 to store and retrieve data. The data that may be stored by the memory 205 includes, but not limited to, operating systems, applications, and data. Each operating system includes executable code that controls basic functions of the portable electronic device 100, such as interaction among the components of the internal components 200, communication with external devices via each transceiver 201 and/or the device interface (see below), and storage and retrieval of applications and data to and from the memory 205. Each application includes executable code utilizing an operating system to provide more specific functionality for the portable electronic device. Data is non-executable code or information that may be referenced and/or manipulated by an operating system or application for performing functions of the portable electronic device 100.
The input components 209, such as a motion sensor, an image sensor, a touch sensitive surface of a display, or other components of the user interface, may produce an input signal in response to a user input. For example, the device 100 may include one or more motion sensors, such as an accelerometer or compass. For another example, the device 100 may include one or more image sensors, such as a camera, a charge-coupled device, complementary metal-oxide semiconductor sensors, video sensors, light sensor, IR or near-IR sensors, thermo sensors, multi-spectral sensors, gamma sensors, x-ray sensors, or the like. In addition, the input components 209 may include an audio input component such as a microphone, or another type of mechanical input component or activator such as button or key selection sensors or switch.
Likewise, the output components 207 of the internal components 200 may include one or more video, audio and/or mechanical outputs. For example, the output components 207 may include the visible display, such as the display 107. Other output components 207 may include a video output component such as a touch screen, a cathode ray tube, liquid crystal display, plasma display, incandescent light, fluorescent light, front or rear projection display, and light emitting diode indicator. Other examples of output components 207 include an audio output component such as a speaker, alarm and/or buzzer, and/or a mechanical output component such as vibrating or motion-based mechanisms.
The internal components 200 may further include a device interface 215 to provide a direct connection to auxiliary components or accessories for additional or enhanced functionality. In addition, the internal components 200 preferably include a power source 217, such as a portable battery, for providing power to the other internal components and allow portability of the portable electronic device 100.
Referring again to the input components 209 of the internal components 200, one embodiment may includes a motion sensor 119 to detect the motion data and an image sensor 221 to enhance the analysis and/or interpretation of the detected motion data.
It is to be understood that
Referring to
At this horizontal position substantially parallel to the ground surface, the portable electronic device has difficultly determining the appropriate orientation for providing the image or object 101 based on the motion sensor alone. Thus, the portable electronic device 100 includes a second input component to assist or supplement the operation of the motion sensor by determining the position of the user 301 relative to the display 107 and/or device 100. For the embodiment shown in
Referring to
The positions and angles of the portable electronic device relative to the ground level 409 are not restricted to strictly horizontal and vertical positions. At a third position 419, the portable electronic device has a third angle 407 greater than the first angle of the horizontal position 415 and less than the threshold angle 413 of the predetermined position 411. At a fourth position 421, the portable electronic device has a fourth angle 405 less than the second angle of the vertical position 417 and greater than the threshold angle 413 of the predetermined position 411. The angle of the third position 419 of the device is less than the threshold angle 413 and, thus, the second sensor may be used to detect a body feature of the user 401 and orient an image or object at the output component according to the detected body feature. The angle of the fourth position 421 of the device is greater than the threshold angle 413. The first sensor may be enough to determine the appropriate orientation of an image or object at the output component, so the second sensor may not be necessary.
For some embodiments, a 3-axis accelerometer may be used to measure projections of the Earth's gravity (denoted by g) in 3 directions, namely X, Y, and Z. The respective values for X, Y and Z may be denoted as ax, ay, az. When the device is orientated at a vertical position, the change of values of ax and ay when the device is rotated may indicate if the device is in a portrait or landscape orientation, as long as the value change is larger than any measurement noise. When the device is tilted (at angle θ from the horizontal direction), the largest difference between ax and ay when the device is rotated from portrait to landscape is Δaxy=g sin(θT). When the tilt angle is below a threshold (denoted by θT), Δaxy will be smaller than measurement noise (denoted by an) and, thus, the measurement may not distinguish a portrait orientation from a landscape orientation. At a threshold angle θT, g sin(θT)=an, so θT=arcsin(an/g). For example, for some embodiments, θT may be in the range of 20 through 30 degrees. When tilt angle falls below θT, the imager may be initiated in the background and image frames may be sent periodically to a body detection component of the device. If a body feature (such as a face) is detected, an image or objected provided by the output component of the device may be rotated to align with the detected body feature. When the tilt angle becomes larger than θT, the imager may be stopped or ignored, and the motion sensor may be used to determine the orientation of the image or object at the output component.
Referring to
Initially, at step 501, the operation 500 identifies a particular orientation of an image or object at the output component. The image or object is provided at the output component at a first orientation before detecting rotation at the primary sensor. The operation 500 then determines, or attempts to determine, whether a rotation action has been detected by the primary sensor at step 503. For example, the rotation may be detected about an axis substantially orthogonal to a planar surface of the output component. If a rotation action has not be detected by the primary sensor, then the operation 500 will check again later. For example, as shown in
After a rotation action is detected by the primary sensor at step 503, and the secondary sensor is activated at step 507 if necessary, the operation 500 determines, or attempts to determine, whether the secondary sensor detects one or more body features at step 509. If the secondary sensor detects a body feature or features, then one or more components of the device (such as the processor 203) may determine, at step 511, an appropriate orientation of the image or object provided by the output component based on the rotation detected by the primary sensor at step 503 and the body feature or features detected at step 509. On the other hand, if the secondary sensor does not detect a body feature or features, then one or more components of the device (such as the processor 203) may determine, at step 513, an appropriate orientation of the image or object provided by the output component based on the rotation detected by the primary sensor at step 503, regardless of what is detected or not detected at step 509. As a result, the image or object is provided at the output component at a second orientation after determining the orientation of the image or display at the output component. For some embodiments, if a plurality of body features is detected, then the operation 500 may select a particular body feature of the plurality of body features before utilizing this information at step 511.
As indicated above, the body feature or features may include, but is not restricted to, one or more facial features. It is to be understood that, since the body feature or features may exist anywhere around the portable electronic device, the device may include a secondary sensor that may be directed in multiple directions (manually or automatically) or multiple sensors directed in different directions about the device. For example, a device may include a front facing imager and a rear facing imager, in which one or both of the imagers may be used as the secondary sensor.
Referring to
Initially, at step 601, the operation 600 identifies a particular orientation of an image or object at the output component. The image or object is provided at the output component at a first orientation before detecting rotation at the primary sensor. The operation 600 then determines, or attempts to determine, whether a rotation action has been detected by the primary sensor at step 603. If a rotation action has not be detected by the primary sensor, then the operation 600 will check again later. If a rotation action is detected by the primary sensor at step 603, the operation 500 may determine the angle of the portable electronic device relative to the ground surface or ground level and compare it to a threshold angle, such as the threshold angle 413 of
If the angle of the device is not determined to be below the threshold in step 605, then the operation 600 may determine, at step 613, an appropriate orientation of the image or object provided by the output component based on the rotation detected by the primary sensor at step 603. If the angle of the device is determined to be below the threshold in step 605, then the operation 600 may activate the secondary sensor at step 607. The secondary sensor may be activated in response to detecting the rotation at the primary sensor. As noted above, it is to be understood that the step 607 of activating the secondary sensor may be optional.
If the angle of the device is determined to be below the threshold in step 605, and the secondary sensor is activated at step 607 if necessary, the operation 600 determines, or attempts to determine, whether the secondary sensor detects one or more body features at step 609. If the secondary sensor detects a body feature or features, then one or more components of the device (such as the processor 203) may determine, at step 611, an appropriate orientation of the image or object provided by the output component based on the rotation detected by the primary sensor at step 603 and the body feature or features detected at step 609. On the other hand, if the secondary sensor does not detect a body feature or features, then one or more components of the device (such as the processor 203) may determine, at step 613, an appropriate orientation of the image or object provided by the output component based on the rotation detected by the primary sensor at step 603, regardless of what is detected or not detected at step 609. As a result, the image or object is provided at the output component at a second orientation after determining the orientation of the image or display at the output component. For some embodiments, if a plurality of body features is detected, then the operation 600 may select a particular body feature of the plurality of body features before utilizing this information at step 611.
Referring to
Initially, at step 701, the operation 700 identifies a particular orientation of an image or object at the output component. The image or object is provided at the output component at a first orientation before detecting a primary sensor error condition. The operation 700 then attempts to detect a rotation action at the primary sensor. In particular, as represented by
If the primary sensor error condition is detected in step 703, and the secondary sensor is activated at step 707 if necessary, the operation 700 determines whether the secondary sensor detects one or more body features at step 709. If the secondary sensor detects a body feature or features, then one or more components of the device (such as the processor 203) may determine, at step 711, an appropriate orientation of the image or object provided by the output component based on the body feature or features detected at step 709. On the other hand, if the secondary sensor does not detect a body feature or features, then one or more components of the device (such as the processor 203) may determine, at step 713, an appropriate orientation of the image or object provided by the output component based on previous orientation at step 701, regardless of what is detected or not detected at step 709. As a result, the image or object is provided at the output component at a second orientation, which in this case is the same as the first orientation, after determining the orientation of the image or display at the output component, since the orientation of the image or object is left unchanged. For some embodiments, instead of leaving the image or object at the existing orientation, the second orientation may be set to a default orientation, which may or may not be the same as the first orientation.
For other embodiments, if a plurality of body features is detected, then the operation 700 may select a particular body feature of the plurality of body features before utilizing this information at step 711. Again, it is to be understood that the device may include a secondary sensor that may be directed in multiple directions (manually or automatically) or multiple sensors directed in different directions about the device.
While the preferred embodiments of the invention have been illustrated and described, it is to be understood that the invention is not so limited. Numerous modifications, changes, variations, substitutions and equivalents will occur to those skilled in the art without departing from the spirit and scope of the present invention as defined by the appended claims.
Zhao, Hong, Thorson, Dean E, Tao, LieJun
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
6246862, | Feb 03 1999 | Google Technology Holdings LLC | Sensor controlled user interface for portable communication device |
7251350, | Oct 23 2002 | Intel Corporation | Method and apparatus for adaptive realtime system power state control |
7636456, | Jan 23 2004 | SONY EUROPE B V | Selectively displaying information based on face detection |
7643658, | Jan 23 2004 | SONY EUROPE B V | Display arrangement including face detection |
20070004451, | |||
20070126884, | |||
20070285528, | |||
20080118152, | |||
20080181502, | |||
20090262078, | |||
20100066763, | |||
20100076720, | |||
20100117949, | |||
20110037866, | |||
20110098024, | |||
20110275317, | |||
20110298887, | |||
EP2280331, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Feb 08 2012 | Google Technology Holdings LLC | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Date | Maintenance Schedule |
Aug 18 2018 | 4 years fee payment window open |
Feb 18 2019 | 6 months grace period start (w surcharge) |
Aug 18 2019 | patent expiry (for year 4) |
Aug 18 2021 | 2 years to revive unintentionally abandoned end. (for year 4) |
Aug 18 2022 | 8 years fee payment window open |
Feb 18 2023 | 6 months grace period start (w surcharge) |
Aug 18 2023 | patent expiry (for year 8) |
Aug 18 2025 | 2 years to revive unintentionally abandoned end. (for year 8) |
Aug 18 2026 | 12 years fee payment window open |
Feb 18 2027 | 6 months grace period start (w surcharge) |
Aug 18 2027 | patent expiry (for year 12) |
Aug 18 2029 | 2 years to revive unintentionally abandoned end. (for year 12) |