A tracking system includes a first device and a second device. The first device includes plural ultrasonic sources and an inertial measurement unit configured to detect inertial data. The second device includes at least one ultrasonic receiver and a processor. The processor is configured to receive the inertial data, estimate an orientation of the first device according to the received inertial data, determine a first ultrasonic transmitter from the ultrasonic transmitters according to the orientation of the first device and a location of the first device, and send an enablement command about the first ultrasonic transmitter to the first device. The enabled transmitter of the ultrasonic transmitters sends ultrasounds according to the enablement command, the at least one ultrasonic receiver is configured to receive the ultrasounds from the first ultrasonic transmitter, and the processor determines the location of the first device according to the received ultrasounds.
|
7. A tracking method, comprising:
detecting, by an inertial measurement unit of a first device, inertial data;
receiving, by a processor of a second device, the inertial data from the first device;
estimating, by the processor, an orientation of the first device according to the received inertial data;
according to the orientation of the first device and a location of the first device, determining, by the processor, a first ultrasonic transmitter facing the second device as an enabled ultrasonic transmitter from a plurality of ultrasonic transmitters settled on the first device;
sending, by the processor, an enablement command about the enabled ultrasonic transmitter to the first device;
sending, by the enabled ultrasonic transmitter, ultrasounds according to the enablement command, wherein all the ultrasonic transmitters except for the enabled ultrasonic transmitter are not triggered to send ultrasounds;
receiving, by at least one ultrasonic receiver of the second device, the ultrasounds from the enabled ultrasonic transmitter; and
determining, by the processor, the location of the first device according to the received ultrasounds from the enabled ultrasonic transmitter;
wherein the enabled ultrasonic transmitter is changed from the first ultrasonic transmitter to a second ultrasonic transmitter of the ultrasonic transmitters, when the processor determines that the first ultrasonic transmitter no longer faces the second device and the second ultrasonic transmitter faces the second device.
1. A tracking system, comprising:
a first device, comprising:
a plurality of ultrasonic transmitters; and
an inertial measurement unit, configured to detect inertial data; and
a second device, communicating with the first device, the second device comprising:
at least one ultrasonic receiver; and
a processor, configured to receive the inertial data from the first device, estimate an orientation of the first device according to the received inertial data, determine a first ultrasonic transmitter facing the second device as an enabled ultrasonic transmitter from the ultrasonic transmitters according to the orientation of the first device and a location of the first device, and send an enablement command about the enabled ultrasonic transmitter to the first device,
wherein the enabled ultrasonic transmitter is triggered to send ultrasounds according to the enablement command, all the ultrasonic transmitters except for the enabled ultrasonic transmitter are not triggered to send ultrasounds, the at least one ultrasonic receiver is configured to receive the ultrasounds from the enabled ultrasonic transmitter, and the processor determines the location of the first device according to the received ultrasounds from the enabled ultrasonic transmitter;
wherein the enabled ultrasonic transmitter is changed from the first ultrasonic transmitter to a second ultrasonic transmitter of the ultrasonic transmitters, when the processor determines that the first ultrasonic transmitter no longer faces the second device and the second ultrasonic transmitter faces the second device.
2. The tracking system of
3. The tracking system of
4. The tracking system of
5. The tracking system of
6. The tracking system of
8. The tracking method of
9. The tracking method of
before the location of the first device is acquired, sending a re-localization command to the first device by the processor; and
sending, by all the ultrasonic transmitters, ultrasounds sequentially according to the re-localization command.
10. The tracking method of
according to the re-localization command, sequentially sending, by each one of all the ultrasonic transmitters, the ultrasounds in one of plural time divided periods within a cycle.
11. The tracking method of
according to the enablement command, sending, by the enabled ultrasonic transmitter, the ultrasounds in all time divided periods within the cycle.
12. The tracking method of
predicting, by the processor of the second device, a potential movement of the first device according to at least one of the location and the orientation of the first device over time; and
determining, by the processor of the second device, the first ultrasonic transmitter as the enabled ultrasonic transmitter from the ultrasonic transmitters further according to the potential movement.
|
This application claims priority to U.S. Provisional Application Ser. No. 62/439,063, filed on Dec. 26, 2016, which is herein incorporated by reference.
Present disclosure relates to a tracking system and a tracking method. More particularly, present disclosure relates to a tracking device and a tracking method using ultrasounds.
Soundwaves can be used to detect distances. However, when the soundwaves are sent by different sources, it is rather difficult to distinguish the sources of the soundwaves. An approach to solve the problem is to encode the soundwaves. However, it is known that the soundwaves transmitting in the air may pollute each other due to the additive and the subtractive effects.
Apparently, if the sources of the soundwaves cannot be distinguished, it is difficult to tracking devices with soundwaves.
Aiming to solve aforementioned problems, present disclosure provides a tracking system and a tracking method.
The disclosure provides a tracking system includes a first device and a second device. The first device includes a plurality of ultrasonic transmitters and an inertial measurement unit. The inertial measurement unit is configured to detect inertial data. The second device is communicating with the first device. The second device includes at least one ultrasonic receiver and a processor. The processor is configured to configured to receive the inertial data from the first device, estimate an orientation of the first device according to the received inertial data, determine a first ultrasonic transmitter from the ultrasonic transmitters according to the orientation of the first device and a location of the first device, and send an enablement command about the first ultrasonic transmitter to the first device. The first ultrasonic transmitter of the ultrasonic transmitters on the first device is triggered to send ultrasounds according to the enablement command, the at least one ultrasonic receiver is configured to receive the ultrasounds from the first ultrasonic transmitter, and the processor determines the location of the first device according to the received ultrasounds.
Another aspect of disclosure is to provide a tracking method. The method comprises following steps: detecting, by an inertial measurement unit of a first device, inertial data; receiving, by a processor of a second device, the inertial data from the first device; estimating, by the processor, an orientation of the first device according to the received inertial data; according to the orientation of the first device and a location of the first device, determining, by the processor, a first ultrasonic transmitter from a plurality of ultrasonic transmitters settled on the first device; sending, by the processor, an enablement command about the first ultrasonic transmitter to the first device; sending, by the first ultrasonic transmitter of the ultrasonic transmitters on the first device, ultrasounds according to the enablement command; receiving, by at least one ultrasonic receiver of the second device, the ultrasounds from the first ultrasonic transmitter; and determining, by the processor, the location of the first device according to the received ultrasounds.
It is to be understood that both the foregoing general description and the following detailed description are by examples, and are intended to provide further explanation of the disclosure as claimed.
Present disclosure can be more fully understood by reading the following detailed description of the embodiment, with reference made to the accompanying drawings as follows:
Reference will now be made in detail to the present embodiments of the disclosure, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers are used in the drawings and the description to refer to the same or like parts.
As used herein, the terms “comprising,” “including,” “having,” and the like are to be understood to be open-ended, i.e., to mean including but not limited to.
Reference throughout the specification to “one embodiment” or “an embodiment” means that a particular feature, structure, implementation, or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Thus, uses of the phrases “in one embodiment” or “in an embodiment” in various places throughout the specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, implementation, or characteristics may be combined in any suitable manner in one or more embodiments.
In the embodiment, the inertial measurement unit 122 is a device comprises gyros and accelerometers configured to detect angular accelerations and accelerations along at least six axes from the first device 120. The inertial measurement unit 122 can detect inertial data of the first device 120 when the first device 120 is moving or rotating. In the embodiment, the transmission unit 123 of the first device 120 can be, for example, a radio frequency transmitter or an optical transmitter. The transmission unit 123 is configured to send signals to the second device 140 or receive signals from the second device 140 and extract information from the received signals.
In the embodiment, the microprocessor 124 can be, for instance, a CPU or a GPU configured to fetch instructions from a memory and to execute these instructions. By executing some of these instructions, the microprocessor 124 can control the ultrasonic array 121, in specific, the ultrasonic transmitters of the ultrasonic array 121, to send out ultrasounds in a plurality of time divided periods based. It is noted, a single time divided period is a basic time unit that each of the ultrasonic transmitters is able to send the ultrasound. For example, the microprocessor 124 can control the ultrasonic array 121 to broadcast the ultrasounds.
In the embodiment, by executing some of these instructions, the microprocessor 124 of the first device 120 can further retrieve, from the transmission unit 123, the information extracted from the signals sent by the second device 140. Moreover, by executing some of these instructions, the microprocessor 124 can further retrieve the inertial data of the first device 120 from the inertial measurement unit 122 and send the inertial data to the second device 140 via the transmission unit 123.
As shown in
In the embodiment, the transmission unit 142 can be, for example, a radio frequency transmitter or an optical transmitter. The transmission unit 142 of the second device 140 is configured to send signals to or receive signals from the transmission unit 123 of the first device 120. Furthermore, when the signals sent from the transmission unit 123 are received, the transmission unit 123 can extract information from the received signals.
In the embodiment, the processor 143 of the second device 140 can be, for instance, a CPU or a GPU configured to fetch instructions from another memory and to execute these instructions. By executing some of these instructions, the processor 143 can retrieve, from the ultrasonic array 141, the ultrasounds sent by the ultrasonic transmitters of the ultrasonic array 121. The processor 143 can further sample the ultrasounds being received by the ultrasonic array 141. It is noted, through the transmission unit 142 and the transmission unit 123, the processor 143 of the second device 140 is in real-time synchronization with the microprocessor 124 of the first device 120. Therefore, the processor 143 can sample the ultrasounds corresponding to the time divided periods correctly.
Typically, according to the ultrasounds being sampled, the processor 143 can determine the distances between the second device 140 and the first device 120 in a continuous manner. Based on these distances, a location of the first device 120 with respect to the second device 140 can be determined.
However, it is noted, the ultrasonic transmitters of the ultrasonic array 121 are disposed facing different orientations, which means some of the ultrasonic transmitters are inevitably sending ultrasounds toward the orientation that cannot be received by the ultrasonic array 141. In this case, making all the ultrasonic transmitters of the ultrasonic array 121 send the ultrasounds in a sequential manner can introduce a low sample rate for the ultrasounds to be received. Therefore, the processor 143 can determine a specific enabled ultrasonic transmitter from the ultrasonic array 121, and said enabled ultrasonic transmitter should be the ultrasonic transmitter that can send ultrasounds toward the orientation at which the second device 140 is located. In this way, if only the enabled ultrasonic transmitter is triggered to send ultrasounds in the following stage, the sample rate of the received ultrasounds can be improved.
More specifically, in the embodiment, the processor 143 is configured to determine said enabled ultrasonic transmitter based on at least two factors, one is the location of the first device 120, and another is the orientation of the first device 120. As mentioned, the microprocessor 124 of the first device 120 can retrieve the inertial data of the first device 120 from the inertial measurement unit 122, and send the inertial data to the second device 140 via the transmission unit 123. Once the transmission unit 142 of the second device 140 receives the inertial data sent by the transmission unit 123, the inertial data is passed to the processor 143. By executing some instructions, the processor 143 can estimate the orientation of the first device 120 based on the received inertial data. Hence the orientation of the first device 120 is acquired. When the orientation of the first device 120 is acquired, the processor 143 can determine said enabled ultrasonic transmitter based on the location of the first device 120 and the orientation of the first device 120. Then, the processor can generate an enablement command for controlling the enabled ultrasonic transmitter and send the enablement command to the first device 120 via the transmission unit 142.
In some embodiments, except the location of the first device 120 and the orientation of the first device 120, the processor 143 is configured to determine said enabled ultrasonic transmitter further according to the arrangement pattern of the first device 120. It is noted, said arrangement pattern is the arrangement positions of the ultrasonic transmitters on the first device 120. As mentioned, the ultrasonic transmitters of the ultrasonic array 121 are disposed to face different orientations on the first device 120. Therefore, at every moment, there are some of the ultrasonic transmitters are facing the orientation that is pointing away from the second device 140. In this case, if the processor 143 can access the arrangement pattern of the first device 120, the processor can obtain the facing of these ultrasonic transmitters. As such, based on the current orientation and location of the first device 120, and further in view of the arrangement pattern of the first device 120, the processor 143 can determine the most efficient ultrasonic transmitter in current status as the enabled ultrasonic transmitter.
In this case, when the transmission unit 123 of the first device 120 receives the signals encoding with the enablement command, the microprocessor 124 can retrieve the enablement command and control the enabled ultrasonic transmitter in the ultrasonic array 121 to send the ultrasounds in following stage. Afterwards, the processor 143 of the second device 140 can sample the ultrasounds sent by the enabled ultrasonic transmitter of the ultrasonic array 121 accordingly. It is obvious that the sample rate for the processor 143 to sample the received ultrasounds can be improved. The processor 143 will sample the received ultrasounds in the following stage, and the location that the first device 120 relative to the second device 140 can be tracked in a continuous manner.
It is noted, in some embodiments, at the moment the tracking system 100 is initialized, the processor 143 can estimate the orientation of the first device 120 based on the received inertial data, yet the location of the first device 120 remains unknown. In this case, the processor 143 can send a re-localization command to the first device 120 in order to acquire the location of the first device 120. When the re-localization command is passed to the microprocessor 124 of the first device 120, the microprocessor 124 can control all ultrasonic transmitters in the ultrasonic array 121 to send the ultrasounds sequentially according to the re-localization command. More specifically, based on the re-localization command, each of the ultrasonic transmitters in the ultrasonic array 121 is triggered to send one of the ultrasounds one after one along the timeline. In each time the ultrasound is sent, the ultrasonic array 141 can try to receive the ultrasounds. Once the ultrasound is received in one of the time divided periods, the processor 143 can determine the location of the first device 120. Then, in following stages, the processor 143 can send the enablement command to the first device 120 based on the orientation of the first device 120, the location of the first device 120, and the arrangement pattern of the first device 120.
In the embodiment, four ultrasonic transmitters of the ultrasonic array 121 are disposed on a head of the first device 120, which are a first ultrasonic transmitter 121a, a second ultrasonic transmitter 121b, a third ultrasonic transmitter 121c and a fourth ultrasonic transmitter 121d. Reference is further made to
Reference is further made to
Step S401: sending, by the processor of the second device, the re-localization command to the first device. As mentioned, in the embodiment, when the tracking system 100 is initiated, in order to acquire the location of the first device 120, the processor 143 of the second device 140 can generate the re-localization command and send the re-localization command to the first device 120 via the transmission unit 142.
Step S402: detecting the inertial data by the inertial measurement unit of the first device, and sending the ultrasounds sequentially by the ultrasonic transmitters of the first device. As shown in
At the meantime, the inertial measurement unit 122 of the first device 120 is configured to detect the inertial data of the first device 120. As mentioned, the inertial measurement unit 122 includes gyros and accelerometers configured to detect angular accelerations and accelerations along at least six axes from the first device 120. The inertial measurement unit 122 can detect the inertial data of the first device 120 based on the movement of the first device 120. Moreover, the reference can be made to
Step S403: estimating the orientation of the first device by the processor of the second device. In the embodiment, when the inertial data is received by the transmission unit 142 of the second device 140, the inertial data is passed to the processor 143. Based on the received inertial data, the processor 143 can estimate the orientation ORI of the first device 120.
Step S404: determining the location of the first device by the processor of the second device. In the embodiment, as shown in
As shown in
The timeline figure illustrated at the down side of
As mentioned, when the ultrasonic receivers 141a-141c receive the ultrasound emitted by the second ultrasonic transmitter 121b, the received ultrasound is passed to the processor 143. In this case, the processor 143 can obtain the distance between the first device 120 and the second device 140 according to the received ultrasound. In this case, the location of the first device 120 can be determined by the processor 143.
Step S405: determining a specific ultrasonic transmitter of the first device according to the orientation and the location of the first device. As mentioned, after the re-localization stage STR, the orientation ORI of the first device 120 and the location of the first device 120 are both obtained by the processor 143 of the second device 140. Further according to the arrangement pattern of the first device 120 (which indicates the arrangement pattern of the ultrasonic transmitters 121a-121d being configured on the first device 120), the processor 143 can determine the second ultrasonic transmitter 121b, which is the ultrasonic transmitter facing the second device 140, as the enabled ultrasonic transmitter.
Step S406: sending, by the processor of the second device, the enablement command regarding the specific ultrasonic transmitter to the first device. As mentioned, when the enabled ultrasonic transmitter (which is the second ultrasonic transmitter 121b) is determined, processor 143 of the first device 120 can generate the enablement command regarding the second ultrasonic transmitter 121b. Afterwards, the processor 143 can send the enablement command regarding the second ultrasonic transmitter 121b to the first device 120, via the transmission unit 142.
Step S407: sending the ultrasounds by the specific ultrasonic transmitter of the first device according to the enablement command, and detecting the inertial data by the inertial measurement unit of the first device. In the embodiment, when the enablement command is received by the transmission unit 123, the enablement command is passed to the microprocessor 124. According to the enablement command, in first stage ST1 following the re-localization stage STR, the microprocessor 124 controls that only the second ultrasonic transmitter 121b is enabled to send ultrasounds in a sequential manner, just as shown in
As a result, it can be seen in
Moreover, in some embodiments, the processor 143 can predict a potential movement of the first device 120 according to at least one of the location and the orientation of the first device over time. As mentioned, by keep obtaining the inertial data of the first device 120 and receiving the ultrasounds sent by the first device 120, the processor 143 can predict the potential movement. In this case, not only the location, the orientation, the arrangement pattern, the processor 143 further determines the enabled ultrasonic transmitter from the ultrasonic transmitters 121a-121d further according to the potential movement.
As mentioned, the first device 120 is configured with the inertial measurement unit 122. When the first device 120 is moving, the inertial measurement unit 122 detects the orientation data of the first device 120. As can be seen in the
As mentioned, in the embodiment, the information regarding the arrangement pattern of the ultrasonic transmitters 121a-121d (as shown in
For ease of understanding, the reference can be made to
As described above, the tracking device can be used to measure distance between the first device and the second device. However, since the first device can be the controller, the positions that the first device relative to the second device will be changing. In some relative positions, ultrasounds sent from some of the ultrasonic transmitters cannot be received, and in this case, the sample rate that the processor 143 samples the received ultrasounds will be low. As such, present disclosure provides an approach to determine specific enabled ultrasonic transmitter for the ultrasonic transmitters. Through this approach, the sample rate can be increased.
Although the present disclosure has been described in considerable detail with reference to certain embodiments thereof, other embodiments are possible. Therefore, the spirit and scope of the appended claims should not be limited to the description of the embodiments contained herein.
It will be apparent to those skilled in the art that various modifications and variations can be made to the structure of the present disclosure without departing from the scope or spirit of the disclosure. In view of the foregoing, it is intended that the present disclosure cover modifications and variations of this disclosure provided they fall within the scope of the following claims.
Chen, Yuan-Tung, Tsai, Kun-Chun
Patent | Priority | Assignee | Title |
11256090, | Mar 05 2015 | Magic Leap, Inc. | Systems and methods for augmented reality |
11288832, | Dec 04 2015 | Magic Leap, Inc. | Relocalization systems and methods |
11315214, | Mar 17 2017 | Magic Leap, Inc. | Mixed reality system with color virtual content warping and method of generating virtual con tent using same |
11379948, | Jul 23 2018 | CITIBANK, N A | Mixed reality system with virtual content warping and method of generating virtual content using same |
11391952, | Feb 07 2018 | Apple Inc. | AR/VR controller with event camera |
11410269, | Mar 17 2017 | Magic Leap, Inc. | Mixed reality system with virtual content warping and method of generating virtual content using same |
11423626, | Mar 17 2017 | Magic Leap, Inc. | Mixed reality system with multi-source virtual content compositing and method of generating virtual content using same |
11429183, | Mar 05 2015 | Magic Leap, Inc. | Systems and methods for augmented reality |
11486961, | Jun 14 2019 | INVENSENSE, INC | Object-localization and tracking using ultrasonic pulses with reflection rejection |
11536973, | Aug 02 2016 | Magic Leap, Inc. | Fixed-distance virtual and augmented reality systems and methods |
11619988, | Mar 05 2015 | Magic Leap, Inc. | Systems and methods for augmented reality |
11711668, | Jan 23 2017 | Magic Leap, Inc. | Localization determination for mixed reality systems |
11790482, | Jul 23 2018 | Magic Leap, Inc. | Mixed reality system with virtual content warping and method of generating virtual content using same |
11828885, | Dec 15 2017 | Cirrus Logic Inc. | Proximity sensing |
11978175, | Mar 17 2017 | Magic Leap, Inc. | Mixed reality system with color virtual content warping and method of generating virtual content using same |
Patent | Priority | Assignee | Title |
10010788, | Dec 21 2015 | SONY INTERACTIVE ENTERTAINMENT INC | Game controller with lights visible inside and outside the game controller |
10073516, | Dec 29 2014 | SONY INTERACTIVE ENTERTAINMENT INC | Methods and systems for user interaction within virtual reality scene using head mounted display |
10086282, | Jul 27 2002 | SONY INTERACTIVE ENTERTAINMENT INC | Tracking device for use in obtaining information for controlling game program execution |
10198866, | Jun 11 2013 | SONY INTERACTIVE ENTERTAINMENT INC | Head-mountable apparatus and systems |
10241573, | Dec 31 2014 | SONY INTERACTIVE ENTERTAINMENT INC. | Signal generation and detector systems and methods for determining positions of fingers of a user |
10318019, | May 28 2004 | UltimatePointer, L.L.C. | Apparatus for controlling contents of a computer-generated image using three dimensional measurements |
10352853, | Jul 12 2017 | PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD. | Measuring device including light source that emits at least one light pulse group, photodetector, and control circuit |
5144594, | May 29 1991 | Cyber Scientific | Acoustic mouse system |
5645077, | Jun 16 1994 | Massachusetts Institute of Technology | Inertial orientation tracker apparatus having automatic drift compensation for tracking human head and other similarly sized body |
5812257, | Nov 29 1990 | VPL NEWCO, INC | Absolute position tracker |
5850201, | Nov 30 1990 | Sun Microsystems, Inc | Low cost virtual reality system |
5856844, | Sep 19 1996 | Omniplanar, Inc | Method and apparatus for determining position and orientation |
6094625, | Jul 03 1997 | Trimble Navigation Limited | Augmented vision for survey work and machine control |
6172657, | Feb 26 1996 | Seiko Epson Corporation | Body mount-type information display apparatus and display method using the same |
6400374, | Sep 18 1996 | GOOGLE LLC | Video superposition system and method |
6720949, | Aug 22 1997 | Man machine interfaces and applications | |
6757068, | Jan 28 2000 | THALES VISIONIX, INC | Self-referenced tracking |
7034779, | Aug 06 2002 | Information Decision Technologies, LLC | Advanced ruggedized augmented reality instrumented self contained breathing apparatus |
7056216, | Jun 11 1999 | Canon Kabushiki Kaisha | User interface apparatus, user interface method, game apparatus, and program storage medium |
7301648, | Jan 28 2000 | THALES VISIONIX, INC | Self-referenced tracking |
7554511, | Jun 19 2001 | Device and a method for creating an environment for a creature | |
7602301, | Jan 09 2006 | NIKE, Inc | Apparatus, systems, and methods for gathering and processing biometric and biomechanical data |
7610558, | Feb 18 2002 | Canon Kabushiki Kaisha | Information processing apparatus and method |
7716008, | Jan 19 2007 | Nintendo Co., Ltd. | Acceleration data processing program, and storage medium, and acceleration data processing apparatus for use with the same |
7774155, | Mar 10 2006 | NINTENDO CO , LTD | Accelerometer-based controller |
7839417, | Mar 10 2006 | University of Northern Iowa Research Foundation | Virtual coatings application system |
8094090, | Oct 19 2007 | Southwest Research Institute | Real-time self-visualization system |
8179604, | Jul 13 2011 | GOOGLE LLC | Wearable marker for passive interaction |
9323055, | May 26 2006 | Harris Corporation | System and method to display maintenance and operational instructions of an apparatus using augmented reality |
9324229, | Mar 08 2007 | Harris Corporation | System and method to display maintenance and operational instructions of an apparatus using augmented reality |
9682320, | Jul 27 2002 | SONY INTERACTIVE ENTERTAINMENT INC | Inertially trackable hand-held controller |
9805512, | Nov 13 2015 | META PLATFORMS TECHNOLOGIES, LLC | Stereo-based calibration apparatus |
9898091, | Jun 03 2015 | META PLATFORMS TECHNOLOGIES, LLC | Virtual reality system with head-mounted display, camera and hand-held controllers |
9987554, | Mar 14 2014 | SONY INTERACTIVE ENTERTAINMENT INC | Gaming device with volumetric sensing |
20060233389, | |||
20060264260, | |||
20060274911, | |||
20060284792, | |||
20070025562, | |||
20080261693, | |||
20100128568, | |||
20100285883, | |||
20180143292, | |||
20190187244, | |||
CN1308505, | |||
EP2040035, | |||
JP2014066529, | |||
WO180736, | |||
WO9953838, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Dec 26 2017 | HTC Corporation | (assignment on the face of the patent) | / | |||
Jan 04 2018 | CHEN, YUAN-TUNG | HTC Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 044624 | /0243 | |
Jan 04 2018 | TSAI, KUN-CHUN | HTC Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 044624 | /0243 |
Date | Maintenance Fee Events |
Dec 26 2017 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Aug 28 2024 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Date | Maintenance Schedule |
Mar 09 2024 | 4 years fee payment window open |
Sep 09 2024 | 6 months grace period start (w surcharge) |
Mar 09 2025 | patent expiry (for year 4) |
Mar 09 2027 | 2 years to revive unintentionally abandoned end. (for year 4) |
Mar 09 2028 | 8 years fee payment window open |
Sep 09 2028 | 6 months grace period start (w surcharge) |
Mar 09 2029 | patent expiry (for year 8) |
Mar 09 2031 | 2 years to revive unintentionally abandoned end. (for year 8) |
Mar 09 2032 | 12 years fee payment window open |
Sep 09 2032 | 6 months grace period start (w surcharge) |
Mar 09 2033 | patent expiry (for year 12) |
Mar 09 2035 | 2 years to revive unintentionally abandoned end. (for year 12) |