A system and method for determining the breathing rate of a patient using only an oscillometric device as the physiological sensor. Here, the oscillometric device is mounted on a patient's limb, and oscillometric pulse waveforms are obtained as the device's cuff deflates, thus obtaining pulse wave signals and artifact signals over multiple patient breaths. A computer processor analyzes these signals, and removes artifacts according to various algorithms. The resulting signal can be viewed as containing both an amplitude modulated envelope of pulse waves (AM signals) and a frequency modulated sequence of pulses at various time intervals (fm signals). The main harmonics of the AM and fm signals both contain breathing rate data, and system accuracy can be improved by comparing the AM harmonics with the fm harmonics. The final breathing rate data, often a function of the AM and fm harmonics, is output or stored in memory.
|
1. A method of automatically determining a breathing rate of a patient, said method comprising:
obtaining pulse waveforms from an oscillometric device mounted on a limb of said patient, said pulse waveforms thus being oscillometric type pulse waveforms;
analyzing said pulse waveforms, using at least one processor, and determining artifact-free regions of said pulse waveforms, thus obtaining edited pulse waveforms;
analyzing said edited pulse waveforms, using said at least one processor, and determining AM envelope signals and fm between-pulse-time signals of said edited pulse waveforms;
analyzing said AM envelope signals and said fm between-pulse-time signals using said at least one processor, and determining an AM envelope main harmonic of said AM envelope signals and an fm between-pulse-time main harmonic of said fm between-pulse-time signals;
in response to said AM envelope main harmonic and said fm between-pulse-time main harmonic being within a predetermined limit of each other, using said at least one processor to calculate a value from a function comprising said AM envelope main harmonic and said fm between-pulse-time main harmonic;
and record or output said value as said breathing rate of said patient.
10. A system for automatically determining a breathing rate of a patient, said system comprising:
an oscillometric device configured to be mounted on a limb of said patient, said oscillometric device comprising at least one processor, memory, pressure cuff, and pressure cuff sensor, said device configured to obtain pulse waveforms, said pulse waveforms thus being oscillometric type pulse waveforms;
said at least one processor configured to analyze said pulse waveforms, and determine artifact-free regions of said pulse waveforms, thus obtaining edited pulse waveforms;
said at least one processor further configured to analyze said edited pulse waveforms, and determine AM envelope signals and fm between-pulse-time signals of said edited pulse waveforms;
said at least one processor further configured to analyze said AM envelope signals and said fm between-pulse-time signals, and determine an AM envelope main harmonic of said AM envelope signals and an fm between-pulse-time main harmonic of said fm between-pulse-time signals;
said at least one processor configured to determine when said AM envelope main harmonic and said fm between-pulse-time main harmonic are within a predetermined limit of each other, and when within the predetermined limit of each other, to calculate a value from a function comprising said AM envelope main harmonic and said fm between-pulse-time main harmonic, and to record or output said value as said breathing rate of said patient.
2. The method of
3. The method of
a) analyzing areas where neighboring pulses exhibit below average cross-correlation;
b) obtaining any of tri-axial gyroscope signal or tri-axial accelerometer signals from said tri-axial accelerometer-gyroscope device and automatically deweighting those cuff deflation signals obtained during a time that said tri-axial accelerometer-gyroscope device detects motion above a preset threshold; and
c) analyzing said AM envelope signals of said edited pulse waveforms, and automatically deweighting pulse waveform data associated with envelope outliers above a preset threshold.
4. The method of
5. The method of
and wherein said at least one processor further uses said instantaneous pulse rates to determine said fm between-pulse-time signals.
6. The method of
7. The method of
8. The method of
9. The method of
11. The system of
12. The system of
a) analyzing areas where neighboring pulses exhibit below average cross-correlation;
b) obtaining any of tri-axial gyroscope signal or tri-axial accelerometer signals from said tri-axial accelerometer-gyroscope device and automatically deweighting those cuff deflation signals obtained during a time that said tri-axial accelerometer-gyroscope device detects motion above a preset threshold; and
c) analyzing said AM envelope signals of said edited pulse waveforms, and automatically deweighting pulse waveform data associated with envelope outliers above a preset threshold.
13. The system of
14. The system of
and wherein said at least one processor further uses said instantaneous pulse rates to determine said fm between-pulse-time signals.
15. The system of
16. The system of
17. The system of
18. The system of
|
This invention is in the field of breathing rate measurement and oscillometric measurement methods and technology.
Respiration rate (RR), also called “breathing rate”, typically expressed in breaths per minute, is an essential but underused vital sign. Jonsdottir et al., in “Nursing documentation prior to emergency admissions to the intensive care unit”, Nursing in Critical Care⋅June 2011” reports that although respiratory failures are the most common cause of emergency admissions to ICU, nonetheless respiratory rate is one of the least documented vital signs. This problem is due in part to lack of appropriate breathing rate monitoring equipment.
With the recent worldwide COVID-19 pandemic, adequate methods of assessing respiratory system status have become increasingly important. For example, Xu et al., in Risk factors for 2019 novel coronavirus disease (COVID-19) patients progressing to critical illness: a systematic review and meta-analysis, AGING 2020, Vol. 12, No. 12” reports that elderly male patients with a high respiratory rate (along with high body mass index, and other risk factors) are more likely to develop severe COVID-19 infections.
Although a significant amount of prior art exists covering various automated systems and methods for determining respiration rate, to date, as evidenced by the Jonsdottir study, such methods are still lacking. By contrast, consider oscillometric blood pressure monitors, which are now widely available on a low-cost basis. Oscillometric blood pressure monitors are widely available on a non-prescription basis and are in widespread use for home blood pressure monitoring.
Respiration does have an impact on blood pressure measurements. However, to date, efforts to harness oscillometric techniques for respiration rate monitoring purposes have generally been ineffective. Typically, data from multiple physiological sensors (pulse oximeters, multiple cuff devices, non-oscillometric sensors, ECG sensors) has been needed for such devices to function, and such proposals have generally not been met with commercial success. Thus, further advances in this area would be of significant medical importance.
Previous art on oscillometric monitors equipped with additional physiological sensors, such as ECG and pulse oximetry sensors, includes the work of Li, U.S. Pat. No. 10,022,053, the complete contents of which are incorporated herein by reference.
Other automated breathing sensor art includes Dekker, US 2003/0163054; Callahan U.S. Pat. No. 5,094,244; Aung U.S. Pat. No. 5,682,898; Knoll U.S. Pat. No. 10,349,849; Kawamoto 2017/027358, the complete contents of these are incorporated herein by reference.
Academic work in this area includes the work of Chen and Chen, “A method for extracting respiratory frequency during blood pressure measurement, from oscillometric cuff pressure pulses and Korotkoff sounds recorded during the measurement” 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)”; other academic work includes the work of Gui et. al., “Pulse interval modulation-based method to extract the respiratory rate from oscillometric cuff pressure waveform during blood pressure measurement” Computing in Cardiology (CinC) September 2017—ieeexplore.ieee.org.
Breathing causes relatively small changes in an individual's pulse waves, and oscillometric blood pressure monitoring devices can monitor such pulses. However, these breathing rate induced changes are relatively small, and are frequently confounded by noise and artifacts in the oscillometric data. The present invention was inspired, in part, by the insight that if a sufficient number of methods to remove artifacts from oscillometric blood pressure monitor data could be found, then it might be possible to employ more aggressive analytical methods to automatically distinguish the subtle breathing rate signals from the oscillometric pulse rate data.
The present invention was also inspired, in part, on the insight that if the faint breathing signal could be distinguished in different ways (e.g. through their impact on multiple characteristics or dimensions on the dominant pulse wave signal), then each different dimension could be used to verify the accuracy of the other dimension. In other words, if the impact of the patient's or user's respiratory rate could be found to impact multiple observable parameters of the underlying pulse rate signal, then the accuracy of the method would be improved. That is, when the different methods were in agreement, the breathing rate results would be more likely to be accurate. When the different rates were not in agreement, the system could report a warning or an error.
In some embodiments, the invention may be a system, device, and method for automatically determining a breathing rate of a patient. This method is based on analyzing pulse waveforms obtained from an oscillometric device mounted on the patient's limb (often on the patient's wrist). This oscillometric device will often comprise a processor (e.g. microprocessor), air pressure generating and release devices, a pressure sensor, and a built-in inflatable cuff configured to go around the patient's limb. The device will often further comprise a display and/or a wireless transceiver (such as a Bluetooth Low Energy transceiver) for displaying the results. The device may optionally also contain a tri-axial (e.g. three-axis) accelerometer. In some embodiments, a wrist-mounted oscillometric device is preferred.
In addition to operating as a standard oscillometric blood pressure monitor, the device also is configured to analyze the pulse waveforms and to determine artifact-free regions of these pulse waveforms. Here various methods may be used, and the artifact-free or at least artifact-reduced areas of the pulse waveforms may be termed edited pulse waveforms.
To obtain multiple dimensions of breathing rate data, the system makes use of the experimental observation that breathing impacts both the amplitude of the individual pulse waves, as well as the time duration between successive pulse waves (e.g., frequency). These show up as changes in the amplitude of the envelope of the pulse wave signals “AM envelope signals” as well as changes in the frequency of the pulses “FM between-pulse-time signals.” The invention determines these AM envelope signals and FM between-pulse-time signals and then determines their AM envelope primary harmonics and FM between-pulse-time main harmonics.
The invention then checks to be sure that the AM envelope primary (or main) harmonics and FM between-pulse-time main harmonic are consistent, and if not, may return a warning or error code. However, if the two results meet consistency criteria, the system will then calculate a weighted function of the AM envelope primary harmonics and FM between-pulse-time main harmonics. These results will then be output (or stored in memory) as the patient's breathing rate (respiratory rate). Alternatively, both AM envelope main harmonics and FM between-pulse-time main harmonics may be used.
The high-level mechanical and electrical architectures for the device are illustrated below in
The device's microprocessor also transmits information to the device's display (104), and if the display screen is a touch-sensitive display screen, it can also receive user input from the display. These parts are often at least partially enclosed in the plastic enclosure (102) shown in
The measurements shown in
Put alternatively, in some embodiments, the device is an oscillometric device that comprises at least one processor (200). This device can optionally further include a display (104) configured to display the user's breathing rate. Alternatively, the device's optional wireless transceivers such as the Bluetooth transceiver (206) (BLE Radio shown in
One of the reasons why there is little or no prior art on using oscillometric devices to obtain breathing data (at least in the absence of supplementary pulse oximeter data or ECG data) is that the impact of breathing on the oscillometric data is relatively subtle, and is often hidden or obscured by various noise sources. Thus, the present invention relies, in part, on various novel and experimentally determined systems and methods to reduce the noise to the point where the weaker breathing signal can be obtained from the oscillometric data.
System and Algorithm Development
The development of the present invention's system and method relied on clinical testing, and experimentation with alternative devices and alternative algorithms.
As one example of such clinical testing, consider one test which was conducted at Dalhousie Medicine New Brunswick in Saint John, NB, Canada. One test involved a total of 27 healthy participants (6 male, 21 females; aged 22-55, mean±SD=36.6±9.1 years). Experiments were conducted under human ethics approval and written informed consent was obtained from each participant before enrollment.
Auscultatory breathing rate measurements were made by two trained observers using a dual stethoscope, while the device made simultaneous breathing rate measurements during the deflation of the wrist cuff. For each participant, a total of six readings were collected: three non-paced readings (participant breathing naturally) and three paced readings (participant breathing at: 8 breaths/minute, 16 breaths/minute, and 24 breaths/minute). This raw data was then used to evaluate various algorithms. Other experimental tests were also conducted.
As a result of such experimental testing, various aspects of the work were determined on somewhat of a trial and error basis. Certain aspects of the invention, discussed below that were implemented as a result of this trial and error clinical testing include:
These experimentally determined systems and methods will be discussed in more detail in the following sections.
As previously discussed, in some embodiments, the invention may be a device, system, or method for automatically determining a breathing rate of a patient (or user). Expressing the invention in methods format, this method can comprise various steps. These steps can include obtaining pulse waveforms from an oscillometric device (100) mounted on a limb of the patient or user. These pulse waveforms are then analyzed, using at least one processor, and artifact-free regions of these pulse waveforms are automatically determined, thus obtaining edited (or alternatively weighted and deweighted) pulse waveforms.
The at least one processor (200) will then automatically analyze these edited pulse waveforms. The AM envelope signals and FM between-pulse-time signals of these edited pulse waveforms are then determined. These AM envelope and FM between-pulse-time signals will be defined in more detail shortly. The processor(s) will further analyze these AM envelope signals and FM between-pulse-time signals and determine their AM envelope main harmonics and FM between-pulse-time main harmonics. Then, at least when these AM envelope main harmonics and FM between-pulse-time main harmonics are consistent, the processor(s) will calculate a weighted function of these AM envelope main harmonics and FM between-pulse-time main harmonics, and output (e.g. to a display screen 104, or transmit to another device 240) the result of this weighted function as the breathing rate of the patient/user.
As will be discussed in more detail, to ensure a reliable respiration rate result and a robust algorithm, in a preferred embodiment, automatically edited (artifact-free, or at least artifact reduced) regions of the pulse waveform are used. Regions corrupted by various artifacts (discussed shortly) are typically ignored.
For example, if the level of device movement is significant (too high) such that it will impact the accuracy of the algorithm to an unacceptable extent, the microprocessor (200) is configured to not return a respiration rate result. Instead, it is configured to output an error message.
If, on the other hand, some movement is detected, but the microprocessor determines that movement can be safely ignored, the device may return a respiration rate result, possibly along with a movement warning message, so that the user can be aware that the reported results may have somewhat suboptimal accuracy.
Although, not all versions of the device may comprise a display (104), in a preferred embodiment, the device may utilize a display, such as a thin film transistor (TFT) color display, to provide dynamic user feedback for movement and heart level warnings and errors as well as a real-time visualization of the pulse waveform during reading acquisition.
Experimentally, we have found that the sensitivity of the artifact detection is variable in that it depends on the user's arm position during the reading (see
However, if the user's forearm is rested flat on a surface, then the pulse waveform is generally more prone to artifacts due to the motion of the user's wrist since the user's wrist movement has a higher chance of encountering resistance from the surface. Thus, in some embodiments, the sensitivity of the artifact detection may be made variable (e.g., the accelerometer/gyroscope can determine this wrist angle, and vary the motion compensation algorithm accordingly) to accommodate this effect.
Thus, in some preferred embodiments, the oscillometric device will further comprise a tri-axial accelerometer gyroscope device (202). This tri-axial accelerometer gyroscope device will typically report the movement of the oscillometric device to the microprocessor(s) (200). The microprocessor(s) can then use this movement to determine motion artifact-free regions of the user's pulse waveforms for further analysis.
In general, pulse waveform artifacts (and the corresponding artifact-free regions of these waveforms) may be determined by any combination of various techniques, which will shortly be described in more detail. These techniques include using the cuff pressure signal to analyze the waveforms obtained during the cuff deflation (e.g., the deflation curve) by using the cuff pressure sensor (126) signal. Other techniques also include analysis of pulse cross-correlations using the cuff pressure signal, analysis of envelope outliers using the cuff pressure signal, and analysis of the tri-axial accelerometer/gyroscope signal.
More specifically, in some embodiments, the artifact-free regions of the pulse waveforms can be automatically determined by obtaining oscillometric cuff deflation signals, and analyzing these cuff deflation signals for areas where neighboring pulses exhibit below average cross-correlation. Alternatively, or additionally the device can use the tri-axial accelerometer/gyroscopic signals from the sensor (202) to automatically de-weigh (e.g. remove, or deemphasize) those cuff deflation signals obtained during the time in which the tri-axial accelerometer/gyroscope detects motion above a preset threshold. As yet another option, the invention may edit the envelope of the pulse waveforms, and automatically de-weigh (e.g., remove or deemphasize) the pulse waveform data associated with envelope outliers above a preset threshold.
There are also intermediate frequency deviations, shown in the
Determining other types of motion through analysis of the deflation curve using the cuff pressure signal: As shown in
Unfortunately, the accelerometer/gyroscope signal cannot capture all types of hand motion artifacts. For example, the movement of the user's fingers may not always be captured by the accelerometer/gyroscope (202) because there is insufficient motion of the device (100) itself. However, we have found this type of patient/user finger movement can be detected because it creates predictable medium-scale artifacts in the deflation curve (see
To detect this type of patient/user type of finger movement, shown in the boxes in
A flowchart of this type of cuff pressure artifact detection algorithm is shown in
Detection of “subtle” artifacts by analysis of pulse cross-correlations using the cuff pressure signal: Unfortunately, some types of remaining artifacts are too subtle to be detected by either the accelerometer/gyroscope signal or by using the deflation curve to detect additional types of motion.
As shown in
Here, according to the invention, the processor(s) computes these correlations using a modified percent residual difference (PRD) formula. This modified PRD formula enables a more sensitive measure of comparison than the more conventional Pearson correlation coefficient. A flowchart showing one embodiment of the invention's pulse PRD based artifact detection algorithm is shown in
Regarding analysis of the tri-axial accelerometer/gyroscope signal: In a preferred embodiment, the device's optional accelerometer/gyroscope sensor (here a Bosch BMI160) provides three channels of motion (accelerometer) data and three channels of gyroscopic data) representing motion in and around the x, y, and z axes. Generally, either a three-axis accelerometer or a three-axis gyroscopic sensor can work. When there is no movement of the device (100) during a reading, these data are relatively passive, i.e., low amplitude and flat. This is shown in
According to the invention, at least some types of patient/user wrist movement during a breathing rate reading can be detected through the accelerometer/gyroscope data. This is shown in
Other error detection algorithms—analysis of envelope outliers using the cuff pressure signal: Other algorithms may also be used to detect certain types of errors. For example, as shown in
Thus, the invention uses multiple and redundant error detection methods to remove artifacts from the pulse wave signal. Due to this redundancy, although use of accelerometer/gyroscope sensor data to assist in error analysis is preferred, the system can also operate without use of the accelerometer/gyroscope sensor.
“AM” and “FM” Analysis Methods:
As previously discussed, according to the invention, in at least some embodiments, the processor(s) determines the previously discussed “AM envelope signals” and “FM between-pulse-time signals” by determining an oscillometric envelope of pulse peak amplitudes and times between individual pulses of the pulse waveforms. Here, we will discuss these techniques in more detail.
According to the invention, the “AM” signal is based on pulse peak amplitudes, that is, the oscillometric envelope of the pulse waveform.
By contrast, the “FM” signal is the instantaneous pulse rate signal (pulse rate per pulse), which is based on the timing of the individual pulse positions with respect to each other. These signals are extracted from the identification of pulses in the processed cuff pressure signal.
AM methods: Note that the envelope of the pulse waveform exhibits a gradual rise and fall as the cuff pressure deflates from above the systolic blood pressure to below the diastolic blood pressure (see
FM methods: As the user breathes, a natural phenomenon known as respiratory sinus arrhythmia impacts the pulse duration (e.g., time between neighboring pulses). This electrical influence of breathing causes an increase and decrease in the pulse frequency. This doesn't necessarily impact the amplitude of the oscillometric envelope, but does impact the time between successive pulse waves within the oscillometric envelope. This different effect has been named the “frequency modulation (FM)” breathing signal (see
Thus, in some embodiments, the processor(s) further determines the FM between-pulse-time signals by computing time differences between peak indices of the pulse waveforms and using these time differences to calculate instantaneous pulse rates of the patient/user. The processor can then use these instantaneous pulse rates to determine the FM between-pulse-time signals.
Further, in some embodiments, the processor determines the AM envelope main harmonics and FM between-pulse-time primary harmonics by computing a Fourier transform of the oscillometric envelope of the pulse waveform; and calculating a Fourier transform or power spectral density of the FM between-pulse-time signals (e.g., determine the primary/main harmonics by assessing an instantaneous pulse rate signal based on the pulse positions with respect to each other).
More specifically, the main harmonics of the AM and FM signals can be determined through frequency-domain analysis (such as, power spectral density). Here, the time-domain representations of the AM and FM signals are shown in
According to the invention, the patient's or user's respiration rate can be derived from the main harmonic of each of these waveforms. The main harmonic, which is an indication of the highest-amplitude frequency, can be determined by converting the time-domain waveforms to their frequency-domain representations. This can be done by various methods, including the Fourier transform, using a power spectral density (PSD) estimate via Welch's method, and other methods. Once this is done, the processor then automatically determines the frequency with maximum power in the range of interest (e.g., within physiological breathing rate ranges).
Error Detection Methods Based on Comparing the AM Signal Vs the FM Signal:
In some embodiments, processor(s) can determine if the AM envelope main harmonics and FM between-pulse-time main harmonics are consistent with each other. To do so, the processor(s) can compare the AM envelope main harmonics with the FM between-pulse-time main harmonics, and check if these are close in value within a predetermined limit.
Here, for example, the invention can determine a respiration rate average based on both signals. That is, there is one respiration rate for the AM signal, and another for the FM signal. The agreement of these results provides confidence in the respiration rate average. A significant disagreement of these results indicates a potential error condition.
Based on experimental studies, we have found that the AM signal should be given a higher weight than the FM signal for optimal accuracy (versus a reference respiration rate). However, when the calculation of the respiration rate from the AM signal differs from that calculated from the FM signal by a specific ratio of the AM result, then the accuracy performance of the final result is likely to be lower than desired. This may be a possible error condition, or at least a caution indication. The processor can be configured to report warnings or errors depending on these results.
Based on experimental studies, we have further found that to improve confidence in the final breathing rate result, the processor should preferably make a comparison between the result coming from the AM signal against that coming from the FM signal. For example, this can be done by determining the respiratory rate average RRA, where:
|RRAAM−RRAFM|>r*RRAAM.
In some embodiments, if this confidence check fails, then the processor is configured to return an error message rather than a breathing rate.
Further, in some embodiments, the final reported respiration rate may be determined to be a weighted combination of the AM result and the FM result.
For example, in some embodiments, the system may compute a weighted combination of the AM result and the FM result following the respiratory rate average (RRA) equation:
RRA=(a1*RRAAM)+(a2*RRAFM)+b.
Here, the weighting coefficients, a1 and a2, and offset, b, may be determined experimentally (e.g., through optimization of performance during algorithm calibration), and may then be stored in the device's memory for future use.
Morun, Cezar, Ross-Howe, Sara, Badee, Vesal, Haid, Josh, Amzil, Lamiaa, Shin, Bonghun
Patent | Priority | Assignee | Title |
11272859, | Aug 20 2020 | Cloud Dx, Inc.; CLOUD DX, INC , A CORPORATION OF DELAWARE | System and method of determining respiratory status from oscillometric data |
Patent | Priority | Assignee | Title |
10022053, | Feb 22 2013 | CLOUD DX, INC | Simultaneous multi-parameter physiological monitoring device with local and remote analytical capability |
10349849, | Jan 25 2013 | PHILIPS MEDIZIN SYSTEME BÖBLINGEN GMBH | Method, logic unit and system for determining a parameter representative for the patient's volume responsiveness |
5094244, | Aug 25 1989 | HEALTH MONITORS, INC , A CORP OF TN | Apparatus and process for determining systolic blood pressure, diastolic blood pressure, mean arterial blood pressure, pulse rate, pulse wave shape, respiratory pattern, and respiratory rate |
5682898, | Apr 19 1995 | Colin Medical Technology Corporation | Respiration rate measuring apparatus |
20030163054, | |||
20080167541, | |||
20090278728, | |||
20110054330, | |||
20120302900, | |||
20160183846, | |||
20160324488, | |||
20170156606, | |||
20170164850, | |||
20170273582, | |||
20180146926, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Aug 19 2020 | BADEE, VESAL | CLOUD DX, INC , A CORPORATION OF DELAWARE | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 053552 | /0732 | |
Aug 19 2020 | MORUN, CEZAR | CLOUD DX, INC , A CORPORATION OF DELAWARE | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 053552 | /0732 | |
Aug 19 2020 | SHIN, BONGHUN | CLOUD DX, INC , A CORPORATION OF DELAWARE | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 053552 | /0732 | |
Aug 20 2020 | Cloud Dx, Inc. | (assignment on the face of the patent) | / | |||
Aug 20 2020 | ROSS-HOWE, SARA | CLOUD DX, INC , A CORPORATION OF DELAWARE | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 053552 | /0732 | |
Aug 20 2020 | HAID, JOSH | CLOUD DX, INC , A CORPORATION OF DELAWARE | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 053552 | /0732 | |
Aug 20 2020 | AMZIL, LAMIAA | CLOUD DX, INC , A CORPORATION OF DELAWARE | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 053552 | /0732 |
Date | Maintenance Fee Events |
Aug 20 2020 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Aug 26 2020 | SMAL: Entity status set to Small. |
Date | Maintenance Schedule |
May 18 2024 | 4 years fee payment window open |
Nov 18 2024 | 6 months grace period start (w surcharge) |
May 18 2025 | patent expiry (for year 4) |
May 18 2027 | 2 years to revive unintentionally abandoned end. (for year 4) |
May 18 2028 | 8 years fee payment window open |
Nov 18 2028 | 6 months grace period start (w surcharge) |
May 18 2029 | patent expiry (for year 8) |
May 18 2031 | 2 years to revive unintentionally abandoned end. (for year 8) |
May 18 2032 | 12 years fee payment window open |
Nov 18 2032 | 6 months grace period start (w surcharge) |
May 18 2033 | patent expiry (for year 12) |
May 18 2035 | 2 years to revive unintentionally abandoned end. (for year 12) |