The present invention addresses the above described problems by simplifying the assumptions on possible motions made by a user. This simplification process can take place by making an assumption that the motion of the device will travel along a certain preferential motion arc, which will be referred to herein as the “Javal arc.” Calculations of motions of the device can be made based on these Javal arcs. Additionally, the double integration of each accelerometer is now eliminated and the expensive accelerometers are replaced by two magnetic sensors.

Patent
   RE47457
Priority
Aug 07 2001
Filed
Aug 20 2015
Issued
Jun 25 2019
Expiry
Aug 06 2022
Assg.orig
Entity
Large
1
11
all paid
18. A controller for a display on a portable electronic device, the controller comprising:
one gyroscope for measuring sensor data indicative of a motion of said portable electronic device relative to a fixed point, wherein said motion follows a preferential motion arc that is natural to eye and/or hand coordination of a holder of said portable electronic device;
at least one magnetic sensor for measuring said motion; and
logic for calculating said motion with respect to a spheroid given said sensor data indicative of said motion, and for calculating a position on said spheroid of said portable electronic device based on one or more measurements from said one gyroscope and said at least one magnetic sensor;
logic for determining that said motion corresponds to a display command; and
logic for adjusting said display based on said motion and on an angle of said position on said spheroid in response to determining that said motion corresponds to said display command, said angle indicating an orientation of said portable electronic device relative to a line of sight of said holder.
1. A method for controlling a display on a portable electronic device, the method comprising the computer-implemented acts of:
detecting sensor data indicative of a motion of said portable electronic device relative to a fixed point, wherein said motion follows a preferential motion arc that is natural to eye and/or hand coordination of a holder of said portable electronic device;
calculating a position on a spheroid of said portable electronic device based on said sensor data indicative of said motion that is relative to said fixed point;
calculating said motion with respect to said spheroid given said sensor data indicative of said motion and analyzing said sensor data indicative of said motion with respect to said spheroid;
determining that said motion corresponds to a display command; and
adjusting said display based on said motion and on an angle of said position, if on said spheroid in response to determining that said motion corresponds to a user said display command, said angle indicating an orientation of said portable electronic device relative to a line of sight of said holder.
19. A controller for a display on a portable electronic device, the controller comprising:
only one accelerometer for measuring sensor data indicative of a motion of said portable electronic device relative to a fixed point, wherein said motion follows a preferential motion arc that is natural to eye and/or hand coordination of a holder of said portable electronic device;
only two magnetic sensors for measuring said motion; and
logic for calculating said motion with respect to a spheroid given said sensor data indicative of said motion, and for calculating a position on said spheroid of said portable electronic device based on one or more measurements from said only one accelerometer and said only two magnetic sensors;
logic for determining that said motion corresponds to a display command; and
logic for adjusting said display based on said motion and on an angle of said position on said spheroid in response to determining that said motion corresponds to said display command, said angle indicating an orientation of said portable electronic device relative to a line of sight of said holder.
17. A controller for a display on a portable electronic device, the controller comprising:
only two accelerometers for measuring sensor data indicative of a motion of said portable electronic device relative to a fixed point, wherein said motion follows a preferential motion arc that is natural to eye and/or hand coordination of a holder of said portable electronic device;
at least one magnetic sensor for measuring said motion; and
logic for calculating said motion with respect to a spheroid given said sensor data indicative of said motion, and for calculating a position on said spheroid of said portable electronic device based on one or more measurements from said only two accelerometers and said at least one magnetic sensor;
logic for determining that said motion corresponds to a display command; and
logic for adjusting said display based on said motion and on an angle of said position on said spheroid in response to determining that said motion corresponds to said display command, said angle indicating an orientation of said portable electronic device relative to a line of sight of said holder.
9. A controller for a display on a portable electronic device, the controller comprising:
at least one accelerometer for measuring a sensor data indicative of a motion of said portable electronic device relative to a fixed point, wherein said motion follows a preferential motion arc that is natural to eye and/or hand coordination of a holder of said portable electronic device;
at least one magnetic sensor for measuring said motion; and
logic for calculating said motion with respect to a spheroid given said senor data indicative of said motion, and for calculating a position on said spheroid of said portable electronic device based on one or more measurements from said at least one accelerometer and said at least one magnetic sensor;
logic for determining that said motion corresponds to a display command; and
logic for adjusting said display based on said motion and on an angle of said position on said spheroid in response to determining that said motion corresponds to said display command, said angle indicating an orientation of said portable electronic device relative to a line of sight of said holder.
13. A method for controlling a portable electronic device, the method comprising the computer-implemented acts of:
calculating and analyzing a motion of said portable electronic device with respect to a spheroid given sensor data indicative of said motion with respect to said spheroid;
analyzing said sensor data indicative of said motion with respect to said spheroid;
calculating a position on said spheroid of said portable electronic device based on said sensor data indicative of said motion that is relative to a fixed point from said portable electronic device, wherein said motion follows a preferential motion arc that is natural to eye and/or hand coordination of a holder of said portable electronic device; and
determining if that said motion corresponds to a user display command; and
adjusting at least one aspect of a display on said portable electronic device based on said motion when said motion corresponds to a user command and on an angle of said position on said spheroid in response to determining that said motion corresponds to said display command, said angle indicating an orientation of said portable electronic device relative to a line of sight of said holder.
2. The method of claim 1, wherein said act of detecting said sensor data indicative of said motion further comprising comprises:
receiving input from motion sensors which that can detect said sensor data indicative of said motion of said portable electronic device.
3. The method of claim 1, wherein said act of calculating a said position on said spheroid is based on a Javal coordinate system.
4. The method of claim 1, wherein said act of calculating said motion with respect to said spheroid and analyzing said sensor data indicative of said motion is are based on a Javal arc coordinate system.
5. The method of claim 1, wherein said act of calculating said motion with respect to said spheroid and analyzing said sensor data indicative of said motion further comprises measuring changes in a magnetic field.
6. The method of claim 1, wherein said act of calculating said motion with respect to said spheroid and analyzing said sensor data indicative of said motion further comprises measuring one or more angles corresponding to a position of said portable electronic device relative to said fixed point.
0. 7. The method of claim 1, wherein said motion is modeled mathematically by a virtual surface of a virtual thin-walled shell that is approximately spherical in shape.
0. 8. The method of claim 4, wherein an origin of said Javal arc is said fixed point.
10. The controller of claim 9, wherein said motion is modeled by a pre-defined path.
11. The controller of claim 9, wherein said motion is modeled by a Javal arc.
12. The controller of claim 9, wherein said motion is based on a Javal coordinate system.
14. The method of claim 13, wherein said acts of calculating said motion of said portable electronic device and analyzing said sensor data indicative of said motion further comprising comprises:
receiving input from motion sensors which that can detect said sensor data indicative of said motion of said portable electronic device.
15. The method of claim 14, wherein said motion sensors are attached to said portable electronic device.
0. 16. The method of claim 13, further comprising:
calculating a position of said device based on said motion that is relative to said fixed point.
Appendix A
ϵ Sin γ|Cos θ|(H// Cos Φ)−Cos γ(H// Sin Φ)=[hy′″−HSin γ Sin θ]
i.e.,
hX′″=ϵ Cos γ|Cos θ|(H// Cos Φ)−Sin γ(H// Sin Φ)+HCos γ Sin θ  (35.1)
hY′″=ϵ Sin γ|Cos θ|(H// Cos Φ)−Cos γ(H// Sin Φ)+HSin γ Sin θ  (35.2)
Sin γhX′″−Cos γhY′″=2ϵ Sin γ Cos γ|Cos θ|(H// Cos Φ)−Cos γ Sin2 γ(H// Sin Φ)
Sin γhX′″+Cos γhY′″=−(H// Sin Φ)+2HSin γ Cos γ Sin Φ
i.e.,
2ϵ Sin γ Cos γ|Cos θ|(H// Cos Φ)+Cos2 γ Sin2 γ(H// Sin Φ)=(Sin γhX′″−Cos γhY′″)   (36.1)
(H// Sin Φ)+(2 Sin γ Cos γ Sin θ)H=(Sin γhX′″+Cos γhY′″)   (36.2)
HM(1−H//2)1/2   (37)
Where ϵM is known (north or south of magnetic equator).

Thus:
2ϵ Sin γ Cos γ|Cos θ|(H// Cos Φ)+(Cos2 γ−Sin2 γ)(H// Sin Φ)=(Sin γhX′″−Cos γhY′″)   (38.1)
(H// Sin Φ)+ϵM(Sin γ Cos γ Sin θ)(Hpoc2−H//2)1/2=(Sin γhX′″+Cos γhY′″)   (38.2)
If the magnetic inclination δ and the field amplitude Hpoc are assumed to be known:
H//=Hpoc Cos δ  (9.1)
H=Hpoc Sin δ  (39.2)
[2H// Sin γ Cos γ(ϵ|Cos θ|)]Cos Φ+(Cos2 γ−Sin2 γ)(H// Sin Φ)=(Sin γhX′″−Cos γhY′″)   (40.1)
H// Sin Φ+2(Sin γ Cos γ Sin θ)H=(Sin γhX′″+Cos γhY′″)   (40.2)
i.e.,
H// Sin Φ=2(Sin γ Cos γ Sin θ)H−(Sin γhX′″+Cos γhY′″)   (41.1)

H ll Cos Φ = ( Sin γ h X ′′′ - Cos γ h Y ′′′ ) - ( Cos 2 γ - Sin 2 γ ) H ll Sin ϕ 2 Sin γCos γ ( ɛ Cos δ )
γ≃0 then H// Sin Φ≃Cos γhY′″
hX′″≃ϵ|Cos θ|(H// Cos Φ)+HSin θ
i.e.,
ϵ|Cos θ|(H// Cos Φ)≃(hX′″−HSin θ)
(Cos γhX′″−Sin γhy′″)=ϵ|Cos θ|(H// Cos Φ)+(Cos2 γ−Sin2 γ)HSin θ
(Sin γhX′″+Cos γhy′″=−(H// Sin Φ)+2(Sin γ Cos γ)HSin θ
i.e.,
ϵ|Cos θ|(H// Cos Φ)+(Cos2 γ−Sin2 γ)(HSin Φ)=(Cos γhX′″−Sin θhy′″)   (42.1)
−(H// Sin Φ)+2(Sin γ Cos γ)(HSin θ)=(Sin γhX′″+Cos γhy′″)   (42.2)
If γ=0, one has in first approximation:
ϵ|Cos θ|(H// Cos Φ)+(HSin θ)=hx′″
−H// Sin Φ=hy′″
i.e.,

Sin Φ = ( h y ′′′ H ll ) ( 43.1 ) Cos Φ = h x ′′′ - H Sin θ Cos θ H ll ( 43.2 ) assuming ϵ = - 1 ( θ > π 2 ) H ll 2 = ( h y ′′′ ) 2 + ( h x ′′′ - H Sin θ Cos θ ) 2 Sin ϕ = ( - h y ′′′ H ll ) ( 44.1 ) Cos ϕ = H Sin θ - h x ′′′ Cos θ H ll ( 44.2 ) ΔSin ϕ = Cos ϕΔ ϕ = Δ { ( - h y ′′′ ) H ll } ( 45.1 ) Δ Cos ϕ = Sin ϕΔ ϕ = Δ { ( H Sin θ - h x ′′′ ) Cos θ H ll } ( 45.2 ) Cos ϕΔSinϕ - Sin ϕΔCos ϕ = Δϕ = { ( H Sin θ - h x ′′′ ) Cos θ H ll } Δ { ( - h y ′′′ ) H ll } + { ( - h y ′′′ ) H ll } Δ { ( H Sin θ - h x ′′′ ) Cos θ H ll } ( 46 ) v O Y ′′′ = R conf [ ( γ x ′′′ y ) 2 + ( γ y ′′′ y ) 2 ] 1 2 Δ ϕ Δt ( 47 ) v O X ′′′ = R conf Δ θ = R conf ΔSin θ ( 1 - sin 2 θ ) 1 2 Δt ( 48 )

Fateh, Sina, Valdes, Ray, Masiewicz, John

Patent Priority Assignee Title
11368740, Mar 29 2019 TV control system and TV control device suitable therefor
Patent Priority Assignee Title
5506605, Jul 27 1992 Three-dimensional mouse with tactile feedback
5602566, Aug 24 1993 Hitachi Maxell, Ltd Small-sized information processor capable of scrolling screen in accordance with tilt, and scrolling method therefor
5910797, Feb 13 1995 U.S. Philips Corporation Portable data processing apparatus provided with a screen and a gravitation-controlled sensor for screen orientation
6072467, May 03 1996 Mitsubishi Electric Research Laboratories, Inc Continuously variable control of animated on-screen characters
6184847, Sep 22 1998 Facebook, Inc Intuitive control of portable data displays
6201554, Jan 12 1999 Ericsson Inc Device control apparatus for hand-held data processing device
6228704, Mar 31 1998 NEC Electronics Corporation Process for manufacturing semiconductor integrated circuit device
6288704, Jun 08 1999 Meta Platforms, Inc Motion detection and tracking system to control navigation and display of object viewers
6466198, Nov 05 1999 FEINSTEIN, ORNA, MRS View navigation and magnification of a hand-held device with a display
6690358, Nov 30 2000 AT&T Corp Display control for hand-held devices
6847351, Aug 13 2001 UNIFY PATENTE GMBH & CO KG Tilt-based pointing for hand-held devices
//
Executed onAssignorAssigneeConveyanceFrameReelDoc
Aug 20 2015Facebook, Inc.(assignment on the face of the patent)
Oct 28 2021Facebook, IncMeta Platforms, IncCHANGE OF NAME SEE DOCUMENT FOR DETAILS 0588970824 pdf
Date Maintenance Fee Events
Dec 09 2019M1553: Payment of Maintenance Fee, 12th Year, Large Entity.
Dec 09 2019M1556: 11.5 yr surcharge- late pmt w/in 6 mo, Large Entity.


Date Maintenance Schedule
Jun 25 20224 years fee payment window open
Dec 25 20226 months grace period start (w surcharge)
Jun 25 2023patent expiry (for year 4)
Jun 25 20252 years to revive unintentionally abandoned end. (for year 4)
Jun 25 20268 years fee payment window open
Dec 25 20266 months grace period start (w surcharge)
Jun 25 2027patent expiry (for year 8)
Jun 25 20292 years to revive unintentionally abandoned end. (for year 8)
Jun 25 203012 years fee payment window open
Dec 25 20306 months grace period start (w surcharge)
Jun 25 2031patent expiry (for year 12)
Jun 25 20332 years to revive unintentionally abandoned end. (for year 12)