A multi-target vital sign detection system includes a transmitter, a receiver and a processor. The transmitter is configured to transmit a millimeter wave signal to a detection area, and the receiver is configured to receive a reflecting millimeter wave signal reflected by a plurality of targets in the detection area. The processor is configured to: generate signal strength versus distance data by analyzing the received reflecting millimeter wave signal; perform an extreme value reserving process to generate signal extreme value versus distance data; perform a peak search algorithm to obtain a peak list including a plurality of peak values and a plurality of corresponding peak distances; generate a distance array including a plurality of distance variables; and perform a vital sign detection algorithm to generate multiple sets of vital sign data.
|
11. A multi-target vital sign detection method includes:
configuring a transmitter to transmit a millimeter wave signal to a detection area;
configuring a receiver to receive a reflecting millimeter wave signal reflected by a plurality of targets in the detection area; and
configuring a processor to:
continuously analyze the received reflecting millimeter wave signal to generate multiple sets of signal strength versus distance data;
perform an extreme value reserving process on the multiple sets of signal strength versus distance data to generate at least one set of signal extreme value versus distance data;
perform a peak search algorithm on the at least one set of signal extreme value versus distance data to generate a peak list, wherein the peak list includes a plurality of peak values, and each of the plurality of peak values corresponds to one of a plurality of peak distances;
generate a distance array according to a number of targets to be detected and the plurality of peak distances, wherein the distance array includes a plurality of distance variables, and a number of the distance variables corresponds to the number of targets to be detected; and
perform a vital sign detection algorithm on the peak values corresponding to the distance variables to generate multiple sets of vital sign data of the plurality of targets.
1. A multi-target vital sign detection system comprising:
a transmitter configured to transmit a millimeter wave signal to a detection area;
a receiver configured to receive a reflecting millimeter wave signal reflected by a plurality of targets in the detection area; and
a processor coupled to the transmitter and the receiver, configured to:
generate multiple sets of signal strength versus distance data according to the received reflecting millimeter wave signal;
perform an extreme value reserving process on the multiple sets of signal strength versus distance data to generate at least one set of signal extreme value versus distance data;
perform a peak search algorithm on the at least one set of signal extreme value versus distance data to generate a peak list, wherein the peak list includes a plurality of peak values, and each of the plurality of peak values corresponds to one of a plurality of peak distances;
generate a distance array according to a number of targets to be detected and the plurality of peak distances, wherein the distance array includes a plurality of distance variables, and a number of the distance variables corresponds to the number of targets to be detected; and
perform a vital sign detection algorithm on the peak values corresponding to the distance variables to generate multiple sets of vital sign data of the plurality of targets.
2. The multi-target vital sign detection system according to
generate the multiple sets of signal strength versus distance data by a moving window,
wherein the at least one set of signal extreme value versus distance data is obtained by performing the extreme value reserving process on the multiple sets of signal strength versus distance data generated by the moving window.
3. The multi-target vital sign detection system according to
4. The multi-target vital sign detection system according to
5. The multi-target vital sign detection system according to
generate another peak list;
compare the distance array with the another peak list, and update the plurality of distance variables with the another peak list; and
perform the vital sign detection algorithm on the peak values corresponding to the updated distance variables of the distance array to generate multiple sets of updated vital sign data.
6. The multi-target vital sign detection system according to
wherein in a step that the processor is configured to compare the distance array with the another peak list and update the plurality of distance variables with the another peak list, the processor is further configured to:
check whether the flags of the peak list are marked as having been used to generate the multiple sets of vital sign data;
in response to the flags of the peak list being marked as having been used to generate the multiple sets of vital sign data, regenerate another set of signal extreme value versus distance data and perform the peak search algorithm to obtain yet another peak list; and
in response to the flags of the peak list being not marked as having been used to generate the multiple sets of vital sign data, successively check whether each of the plurality of distance variables is within a threshold range of one of the peak distances.
7. The multi-target vital sign detection system according to
8. The multi-target vital sign detection system according to
9. The multi-target vital sign detection system according to
10. The multi-target vital sign detection system according to
12. The multi-target vital sign detection method according to
generate the latest multiple sets of signal strength versus distance data by a moving window,
wherein the at least one set of signal extreme value versus distance data is obtained by performing the extreme value reserving process on the multiple sets of signal strength versus distance data generated by the moving window.
13. The multi-target vital sign detection method according to
14. The multi-target vital sign detection method according to
15. The multi-target vital sign detection method according to
generate another peak list;
compare the distance array with the another peak list, and update the plurality of distance variables with the another peak list; and
perform the vital sign detection algorithm on the peak values corresponding to the distance variables of the updated distance array to generate multiple sets of updated vital sign data.
16. The multi-target vital sign detection method according to
wherein in a step that the processor is configured to compare the distance array with the another peak list and update the plurality of distance variables with the another peak list, the processor is further configured to:
check whether the flags of the peak list are marked as having been used to generate the multiple sets of vital sign data;
in response to the flags of the peak list being marked as having been used to generate the multiple sets of vital sign data, regenerate another set of signal extreme value versus distance data and perform the peak search algorithm to obtain yet another peak list; and
in response to the flags of the peak list being not marked as having been used to generate the multiple sets of vital sign data, successively check whether each of the plurality of distance variables is within a threshold range of one of the peak distances.
17. The multi-target vital sign detection method according to
18. The multi-target vital sign detection method according to
19. The multi-target vital sign detection method according to
20. The multi-target vital sign detection method according to
|
This application claims the benefit of priority to Taiwan Patent Application No. 108106659, filed on Feb. 27, 2019. The entire content of the above identified application is incorporated herein by reference.
Some references, which may include patents, patent applications and various publications, may be cited and discussed in the description of this disclosure. The citation and/or discussion of such references is provided merely to clarify the description of the present disclosure and is not an admission that any such reference is “prior art” to the disclosure described herein. All references cited and discussed in this specification are incorporated herein by reference in their entireties and to the same extent as if each reference was individually incorporated by reference.
The present disclosure relates to a vital sign detection system and method, and more particularly to a multi-target vital sign detection system and method.
In a conventional vital sign detecting device, the Doppler phase shift caused by a displacement of the body of a target organism can be directly eliminated by transmitting a single signal through two antennas to opposite sides of the target organism, thereby achieving vital sign detection. In this architecture, only one radar device is needed, and the vital sign detection can be performed with toleration for large displacement of the organism body without a high linearity requirement for the radar device.
However, the existing technology for detecting respiratory and heart rate using radar are merely designed for close-range detection of a single target organism. Under this architecture, it is impossible to simultaneously detect the return signals of multi-target organisms at different distances.
In response to the above-referenced technical inadequacies, the present disclosure provides a multi-target vital sign detection system and method.
In one aspect, the present disclosure provides a multi-target vital sign detection system including a transmitter, a receiver and a processor. The transmitter is configured to transmit a millimeter wave signal to a detection area, and the receiver is configured to receive a reflecting millimeter wave signal reflected by a plurality of targets in the detection area. The processor is coupled to the transmitter and the receiver and configured to: generate multiple sets of signal strength versus distance data according to the received reflecting millimeter wave signal; perform an extreme value reserving process on the multiple sets of signal strength versus distance data to generate at least one set of signal extreme value versus distance data; perform a peak search algorithm on the at least one set of signal extreme value versus distance data to generate a peak list, in which the peak list includes a plurality of peak values, and each of the plurality of peak values corresponds to one of a plurality of peak distances; generate a distance array according to a number of targets to be detected and the plurality of peak distances, wherein the distance array includes a plurality of distance variables, and a number of the distance variables corresponds to the number of targets to be detected; and perform a vital sign detection algorithm on the peak values corresponding to the distance variables to generate multiple sets of vital sign data of the plurality of targets.
In one aspect, the present disclosure provides a multi-target vital sign detection method including: configuring a transmitter to transmit a millimeter wave signal to a detection area; configuring a receiver to receive a reflecting millimeter wave signal reflected by a plurality of targets in the detection area; and configuring a processor to: continuously analyze the received reflecting millimeter wave signal to generate multiple sets of signal strength versus distance data; perform an extreme value reserving process on the multiple sets of signal strength versus distance data to generate at least one set of signal extreme value versus distance data; perform a peak search algorithm on the at least one set of signal extreme value versus distance data to generate a peak list, in which the peak list includes a plurality of peak values, and each of the plurality of peak values corresponds to one of a plurality of peak distances; generate a distance array according to a number of targets to be detected and the plurality of peak distances, wherein the distance array includes a plurality of distance variables, and a number of the distance variables corresponds to the number of targets to be detected; and perform a vital sign detection algorithm on the peak values corresponding to the distance variables to generate multiple sets of vital sign data of the plurality of targets.
Therefore, detecting the return signals from different distances of several individuals at once by the aforementioned system and method of the present disclosure to observe and calculate the respiratory and heart rate of multiple target human bodies can be achieved.
These and other aspects of the present disclosure will become apparent from the following description of the embodiment taken in conjunction with the following drawings and their captions, although variations and modifications therein may be affected without departing from the spirit and scope of the novel concepts of the disclosure.
The present disclosure will become more fully understood from the following detailed description and accompanying drawings.
The present disclosure is more particularly described in the following examples that are intended as illustrative only since numerous modifications and variations therein will be apparent to those skilled in the art. Like numbers in the drawings indicate like components throughout the views. As used in the description herein and throughout the claims that follow, unless the context clearly dictates otherwise, the meaning of “a”, “an”, and “the” includes plural reference, and the meaning of “in” includes “in” and “on”. Titles or subtitles can be used herein for the convenience of a reader, which shall have no influence on the scope of the present disclosure.
The terms used herein generally have their ordinary meanings in the art. In the case of conflict, the present document, including any definitions given herein, will prevail. The same thing can be expressed in more than one way. Alternative language and synonyms can be used for any term(s) discussed herein, and no special significance is to be placed upon whether a term is elaborated or discussed herein. A recital of one or more synonyms does not exclude the use of other synonyms. The use of examples anywhere in this specification including examples of any terms is illustrative only, and in no way limits the scope and meaning of the present disclosure or of any exemplified term. Likewise, the present disclosure is not limited to various embodiments given herein. Numbering terms such as “first”, “second” or “third” can be used to describe various components, signals or the like, which are for distinguishing one component/signal from another one only, and are not intended to, nor should be construed to impose any substantive limitations on the components, signals or the like.
Reference is made to
Preferably, the transmitting antenna TX and the receiving antenna RX can be selected with a 77 GHz long distance millimeter wave radar antenna. Since the higher the frequency used by the radar, the shorter the wavelength, and the less the radar affected by the interference of light or the external environment, the resolution and accuracy will be higher. On the other hand, because the millimeter wave radar has a high operating frequency, it is suitable for detecting small distance variations, that is, the vital sign detection can be performed by detecting phase changes of reflected waves.
Furthermore, a Frequency Modulated Continuous Waveform (FMCW) signal is used as the millimeter wave signal in the present disclosure. The fundamental concept in radar systems is the transmission of an electromagnetic signal that objects reflect in its path. In the signal used in FMCW radars, the frequency increases linearly with time, and this type of signal is also called a chirp. In the present embodiment, a hardware system of the millimeter wave radar can use a common FMCW architecture. As shown in
The synthesizer SYN is used to generate a chirp, which is transmitted by the transmitting antenna TX. At this time, if an object is present in the detection area, the reflection of the chirp by the object generates a reflected chirp captured by the receiving antenna RX, which is the reflecting millimeter wave signal mentioned above. Next, the mixer MX is used to combine the signal of the transmitting antenna TX and the receiving antenna RX, and the mixer MX calculates a frequency difference between the transmitted wave and the received wave, and then down-converts and outputs intermediate frequency (IF) signals. An information of the detection target is further obtained through the IF circuit IF at a back end, and the signal is finally sent to the digital signal processor through the analog digital converter ADC for processing in the microprocessor MCU as shown.
The low noise amplifier LNA is electrically connected to the receiving antenna RX for making the reflected millimeter wave signal have greater gain and sensitivity, and the reflected millimeter wave signal having the greater gain is transmitted to the mixer MX.
In general, for adults, chest displacement due to breathing can be several millimeters. The displacement due to the heartbeat can be about several hundred microns. In order to measure these small displacements, it can use a phase of the FMCW signal at a distance of the target, and track the phase for a period of time.
Reference is made to
Step S100: Continuously analyzing the received reflecting millimeter wave signal to generate multiple sets of signal strength versus distance data.
It should be noted that the present disclosure is capable of detecting return signals of a plurality of individuals at different distances simultaneously by utilizing the detection algorithm to process and detect the return signals at specific distances, and then analyze small changes in the phase, thereby observing and calculating numbers of breaths and heartbeats. Therefore, frequency modulated continuous waveform (FMCW) emitted by the radar is utilized to detect vibration changes of multiple target objects. For example, small vibrations caused by breathing and heartbeat, which can be processed by the detection algorithm to simultaneously monitor multiple targets and separately determine relevant parameters of the small phase changes, and the numbers of heartbeats and breaths of the multiple target objects can be obtained.
Step S102: Performing an extreme value reserving process on the multiple sets of signal strength versus distance data to generate at least one set of signal extreme value versus distance data.
In detail, a moving window can be set to generate the newly obtained signal strength versus distance data, and the at least one set of signal extreme value versus distance data can be obtained by performing the extreme value reserving process on the multiple sets of signal strength versus distance data generated by the moving window.
Reference is made to
Step S104: Performing a peak search algorithm on the signal extreme value versus distance data to generate a peak list. The peak list includes a plurality of peak values, and each of the plurality of peak values corresponds to one of a plurality of peak distances. For example, the present embodiment searches three peaks pk1, pk2, and pk3 out, and their corresponding peak distances are 0.9, 1.7, and 2.2 meters, respectively. For example, the peak list can be named as peak list table in the vital sign detection algorithm, the peak list table stores the searched peaks and corresponding distances, which are collected in this table. It should be noted that the peaks in the peak list can be arranged according to the signal strengths.
Step S106: Generating a distance array according to a number of targets to be detected and the peak distances. In detail, the distance array includes a plurality of distance variables, and the user may set the number of targets to be detected to determine the number of the distance variables. For example, the distance array can be named as rangeBinIndex in the vital sign detection algorithm, and the target number of targets to be detected can be named as numVitalSigns. Therefore, an i-th element in the rangeBinIndex array can be rangeBinIndex[i], and i can be a value from 0 to numVitalSigns−1. For example, three peaks pk1, pk2, and pk3 are searched in
Step S108: Performing a vital sign detection algorithm on the peak values corresponding to the distance variables to generate multiple sets of vital sign data of the plurality of targets.
Reference is made to
Step S110: Generating another peak list in response to a predetermined time elapsed. Here, the predetermined time is an update time set by the user to determine whether positions of the targets have changed. For example, the predetermined time may be 6 seconds, and a frequency of generating the signal strength versus the distance data may be set by a number of frames, for example, 20 frames per second. The aforementioned moving window can be set as the newly generated 10 frame signal strength versus distance data. In other words, the another peak list is generated by repeatedly performing the foregoing steps S100 to S104, and the distances of the targets can be locked by setting the update time while determining whether the target leaves the detection area.
Step S112: Comparing the distance array with the another peak list, and updating the plurality of distance variables with the another peak list.
Step S114: Performing the vital sign detection algorithm on the peak values corresponding to the distance variables of the updated distance array to generate multiple sets of updated vital sign data.
In the present embodiment, any object having a heartbeat or breathing, such as a person or an animal, can be detected by the vital sign detection algorithm. In addition, the reflected signal transmitted back through the FMCW can further obtain volumes of the targets and identify profiles of the targets.
In addition, when the multi-target vital sign detecting system 1 of the present disclosure is provided with a single transmitting antenna TX and a single receiving antenna RX, positions of the objects at different distances can be distinguished, but the present disclosure is not limited thereto. The multi-target vital sign detection system 1 can also include a plurality of transmitting antennas TX and a plurality of receiving antennas RX, which can utilize a direction of arrival (DOA) estimation technique to distinguish the targets at the same distance but in different directions. Then, the positions of the targets can be locked through the method of detecting multiple target objects in the present disclosure, and the vital characteristics of the breathing and heartbeat are analyzed.
The multi-target vital sign detection method of the present disclosure and another embodiment of comparing the distance array with another peak list will be described hereinafter.
Reference is made to
Step S200: Configuring a transmitter to transmit a millimeter wave signal to a detection area.
Step S201: Configuring a receiver to receive a background reflecting millimeter wave signal generated from the detection area in a targetless state. Specifically, before the vital sign detection is performed, the system can be corrected by means that the FMCW signal received in the targetless state is statistically averaged for several times and calculated as the reference value, which is corrected data.
Step S202: Configuring the receiver to receive a reflecting millimeter wave signal reflected by a plurality of targets in the detection area.
Further, the processor is configured to perform the following steps:
Step S203: Subtracting the background reflected millimeter wave signal from the received reflecting millimeter wave signal and performing analysis to generate the multiple sets of signal strength versus distance data.
Step S204: Generating the latest multiple sets of signal strength versus distance data by a moving window. In detail, after a reference value is subtracted from the received FMCW signal, the moving window and the extreme value reserving process are then utilized to prevent unstable issues from occurring, in which the unstable issues are caused by the unstable signal generated by a moving human body, resulting in difficulties in locking and detecting.
Step S205: Performing the extreme value reserving process on the multiple sets of signal strength versus distance data generated by the moving window to generate a set of signal extreme value versus distance data.
Step S206: Performing a peak search algorithm to generate a peak list.
It should be noted that the peaks in the peak list can be arranged according to the signal strengths, the peak list further includes a plurality of flags corresponding to the peak values, respectively. The plurality of flags are used to indicate whether the peak values have been used to generate the vital signs data. If the aforementioned vital signs data have been generated, that is, the peak values have been used to analyze vital signs, the peak values are marked as having been used. If the aforementioned vital signs have not been generated, that is, the peak values have not been used to analyze vital signs, the peak values are marked as having not been used. For example, vital signs can be generated starting from the peak value having the strongest signal strength.
Step S207: Generating a distance array according to a number of targets to be detected and the plurality of the peak distances.
Step S208: Performing a vital sign detection algorithm on the peak values corresponding to the distance variables to generate multiple sets of vital sign data of the plurality of targets.
Step S209: Generating another peak list in response to a predetermined time elapsed.
Step S210: checking whether flags of another peak list are marked as having been used. If yes, the method proceeds to step S211: Regenerating another set of signal extreme value versus distance data and perform the peak search algorithm to obtain yet another peak list, and the method proceeds to step S212; if not, the method proceeds directly to step S212.
Step S212: Successively checking each of the distance variables. As shown in
Step S213: Determining whether the distance variable is within a threshold range of one of the peak distances. In other words, it is determined whether the distance variable is close to one of the peak distances. In response to the distance variable being within the threshold range of one of the peak distances, the method proceeds to step S214. Step S214: making the flag as having been used to generate the vital sign data, and updating the distance variable with the peak distance. The method proceeds to step S212, assuming i=i+1, and checking the next distance variable. In response to the distance variable being not within the threshold range of one of the peak distances, the method returns to step S212, assuming i=i+1, and checking the next distance variable.
After all of the distance variables are checked, the method proceeds to step S215: successively checking each of the distance variables. As shown in
Step S216: Checking whether the distance variables are repeated, and if the distance variables are repeated, deleting the repeated distance variables. For example, the distance variable is set to 0 as shown in
Step S217: Determining whether the distance variable is present in the latest peak list. If yes, the method proceeds to step S219. If not, the method proceeds to step S218. Step S218: updating the distance variable that does not present in the peak list with the peak distance having been not used. That is, the distance variable that does not present in the peak list is updated to the peak distance corresponding to the flag marked as not having been used in the peak list, and the method proceeds to step S219. In other words, the target corresponding to the distance variable may move in the detection area, so that the vital sign detection can be performed on the position of the unused peak value having the second strongest signal strength.
Step S219: Updating the distance variable that cannot generate the vital sign data when the vital sign detection algorithm is executed with the peak distance corresponding to the flag marked as not having been used in the latest peak list. The method then returns to step S216, assuming i=i+1 and checking the next distance variable.
When all of the distance variables are checked, the method proceeds to step S220: Performing the vital sign detection algorithm on the peak values corresponding to the distance variables of the updated distance array to generate multiple sets of updated vital sign data.
In conclusion, the multi-target vital sign detection system and method provided by the present disclosure can detect multiple target objects having vital signs. In addition, volumes of the multiple target objects can be obtained from the reflected signal transmitted back through the FMCW, thereby identifying profiles of the multiple target objects.
Furthermore, after a reference value is subtracted from the received FMCW signal, the moving window and the extreme value reserving process are then utilized to prevent unstable issues from occurring, in which the unstable issues are caused by the unstable signal generated by a moving human body, resulting difficulties in locking and detecting. On the other hand, a plurality of transmitting antennas TX and a plurality of receiving antennas RX can be provided, which can utilize the direction of arrival (DOA) estimation technique to distinguish the targets at the same distance but in different directions. Then, the positions of the targets can be locked through the method of detecting multiple target objects in the present disclosure, and the vital characteristics of the breathing and heartbeat are analyzed.
The foregoing description of the exemplary embodiments of the disclosure has been presented only for the purposes of illustration and description and is not intended to be exhaustive or to limit the disclosure to the precise forms disclosed. Many modifications and variations are possible in light of the above teaching.
The embodiments were chosen and described in order to explain the principles of the disclosure and their practical application so as to enable others skilled in the art to utilize the disclosure and various embodiments and with various modifications as are suited to the particular use contemplated. Alternative embodiments will become apparent to those skilled in the art to which the present disclosure pertains without departing from its spirit and scope.
Chen, Po-Yuan, Wu, Chao-Hsu, Wu, Chien-Yi, Wang, Tse-Hsuan
Patent | Priority | Assignee | Title |
11835618, | Oct 09 2019 | NATIONAL SUN YAT-SEN UNIVERSITY | Multiple-target vital sign detector and detection method using the same |
Patent | Priority | Assignee | Title |
20150369911, | |||
20180279884, | |||
20190216393, | |||
20200292688, | |||
20200300972, | |||
CN108577815, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Dec 18 2019 | WU, CHIEN-YI | PEGATRON CORPORATION | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 051344 | /0830 | |
Dec 18 2019 | WANG, TSE-HSUAN | PEGATRON CORPORATION | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 051344 | /0830 | |
Dec 18 2019 | CHEN, PO-YUAN | PEGATRON CORPORATION | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 051344 | /0830 | |
Dec 18 2019 | WU, CHAO-HSU | PEGATRON CORPORATION | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 051344 | /0830 | |
Dec 20 2019 | PEGATRON CORPORATION | (assignment on the face of the patent) | / |
Date | Maintenance Fee Events |
Dec 20 2019 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Date | Maintenance Schedule |
May 24 2025 | 4 years fee payment window open |
Nov 24 2025 | 6 months grace period start (w surcharge) |
May 24 2026 | patent expiry (for year 4) |
May 24 2028 | 2 years to revive unintentionally abandoned end. (for year 4) |
May 24 2029 | 8 years fee payment window open |
Nov 24 2029 | 6 months grace period start (w surcharge) |
May 24 2030 | patent expiry (for year 8) |
May 24 2032 | 2 years to revive unintentionally abandoned end. (for year 8) |
May 24 2033 | 12 years fee payment window open |
Nov 24 2033 | 6 months grace period start (w surcharge) |
May 24 2034 | patent expiry (for year 12) |
May 24 2036 | 2 years to revive unintentionally abandoned end. (for year 12) |