A method for discriminating between explosive events having their origins in High explosive or Chemical/Biological detonation employing multiresolution analysis provided by a discrete wavelet transform. Original signatures of explosive events are broken down into subband components thereby removing higher frequency noise features and creating two sets of coefficients at varying levels of decomposition. These coefficients are obtained each time the signal is passed through a lowpass and highpass filter bank whose impulse response is derived from Daubechies db5 wavelet. Distinct features are obtained through the process of isolating the details of the high oscillatory components of the signature. The ratio of energy contained within the details at varying levels of decomposition is sufficient to discriminate between explosive events such as High explosive and Chemical/Biological.
|
1. A method for discriminating between explosive events, said method comprising the steps of:
acquiring data from an explosive event;
extracting particular features from that event;
training a classifier with the extracted features; and
detecting, and subsequently acquiring, acoustic signature data from additional explosive event(s) using an arbitrary acoustic sensor/transducer situated a distance of at least 1 Km from the explosive event; and
discriminating among the additional explosive events through the use of the trained classifier.
2. A method for determining a type of explosive event, said method comprising the steps of:
detecting and subsequently acquiring acoustic signature data from training explosive event(s) using an arbitrary acoustic sensor/transducer;
recording, the acquired acoustic signature data into a pre-determined data structure format;
extracting, predominant features from the acoustic signature data stored in the pre-determined structure;
training, a feedforward neural network with a set of feature vectors derived from the extracted features; and
applying, random sets of vectors derived from acoustic signature data acquired from an explosive event to the trained, feedforward neural network;
wherein said trained feedforward neural network produces a set of desired outputs between 0 and 1, with 0 representing a first type of explosive event and 1 representing a second type of explosive event; and
wherein said arbitrary acoustic sensor/transducer is situated at a distance of at least 1 Km from the explosive event.
3. The method according to
detecting, with an acoustic transducer, acoustic signature information from the explosive event; and
recording, the acoustic signature information.
4. The method according to
performing a discrete wavelet transform using multiresolutional analysis on the acoustic signature information;
collecting a set of primitives comprising a set of detailed coefficients representing the oscillatory harmonics of the acoustic signature information;
collecting a set of primitives comprising a set of approximations coefficients representing baseband information of the acoustic signature information; and
combining, a feature space resulting from the approximations coefficients to form a single feature vector subspace.
5. The method according to
applying, a training data set comprising a feature vector subspace from arbitrarily chosen acoustic signatures to a multi-layer feedforward neural network; and
applying resulting weights to the classifier.
6. The method according to
collecting, unknown processed data representing acoustic signature information from the additional explosive event wherein said data has been processed in a manner substantially the same as data used to train the classifier;
applying, a decision making process to the output of the trained classifier such that the output of the classifier is a binary output wherein one of said binary outputs represents a CB explosive event and the other binary output represents a HE explosive event.
7. The method according to
creating, a p-tuple feature vector space.
8. The method according
applying a discrete wavelet transform to the acoustic signature data such that a set of details and a set of approximations and a set of primitives are produced.
9. The method according to
producing, a p-tuple, combined feature space by combining:
primitives derived from detail coefficients of the explosive event; and
primitives derived from the approximations coefficients of the explosive blast;
wherein said primitives derived from the detail coefficients describe a ratio of energy distribution before and after max-blast pressure of the high harmonic portion of the acoustic signature and said primitives derived from the approximations coefficients that integrates the area of the blast between start and stop times in a baseband.
|
This application claims benefit under 35 USC 199(e) of provisional application 60/593,063, filed Dec. 6, 2004, the entire file wrapper contents of which provisional application are herein incorporated by reference as though fully set forth at length.
This invention pertains generally to the detection and discrimination of explosive events. More particularly, it pertains to a method that uses acoustic sensors for discriminating between high-charge explosions and explosions from systems potentially deploying chemical and/or biological systems.
Currently employed chemical and biological detection systems rely upon direct contact with lethal chemical/biological agents in order to warn of the existence of such agents. Examples of these systems include detection mechanisms that incorporate chemically reactive materials that change color upon contact with a chemical agent.
Unfortunately, such chemically reactive systems are typically ineffective at detecting biological materials. And since they are only effective when in an already contaminated area, the do not provide any early warning to first responders or troops.
In recognition of the substantial deficiencies in the art and the urgent needs of contemporary society, we have developed a method for discriminating between explosive events that result from high-charge explosions and those explosions which may potentially distribute chemical/biological agents.
In operation, our inventive method employs an acoustic sensor used in conjunction with a novel algorithm to detect an airburst or other explosive event and subsequently determine whether that explosive event was a high explosive, or chemical/biological blast. Advantageously, our method and related algorithm are highly reliable, and permit sensor placement geographically remote from the explosive event and therefore out of harms way. Consequently, our inventive method and algorithm permit—for the first time—an early warning of explosively deployed, incoming chemical/biological agents.
According to our invention, a discrete wavelet transform is used to extract predominant components of particular characteristics of explosive events. Highly reliable discrimination is achieved with a feedforward neural network classifier trained on a feature space derived from the distribution of wavelet coefficients and higher frequency details found within different levels of the multiresolution analysis.
In implementing our inventive method and algorithm, we make use of wavelet analysis to identify distinct, disjoint feature sets that remain consistent for a given class of explosive event, and do not degrade dramatically with long-range propagation. With initial reference to
In particular, and with reference to
Finally,
In sharp contrast, and as we shall show, these non-stationary, transient and often oscillatory signals are efficiently represented according to our inventive teachings with wavelet bases that effectively capture the time-frequency distribution of such signal components. Toward this end, our inventive method employing wavelet transforms provides a scalable time-frequency representation of explosive blast signatures and uncovers details that are not readily found using conventional signal processing techniques.
As can now be appreciated, the wavelet analysis which will serve as the basis of our inventive method permits the efficient representation of non-stationary, transient and oscillatory signals. In addition, it exhibits desirable localization properties in both time and frequency that has appropriate decay in both properties. Finally, and particularly relevant to the instant invention, it provides a scalable time-frequency representation of a representative explosive event, for example, an artillery blast signature.
Importantly, our inventive method employing wavelet multiresolution analysis permits the isolation of noise and its removal from a baseband signal of interest—a process referred to as wavelet denoising. This wavelet denoising aspect of our inventive method attempts to remove noise components from signal components regardless of the frequency content of the signal, which turns out to be far more efficient that conventional filtering methods that retain baseband signal components and suppress high frequency noise.
Discrete Wavelet Transform and Multiresolutional Analysis
By way of some additional background, the Discrete Wavelet Transform (DWT) is derived from subband filters and is based on a multiresolution decomposition of a signal to give a coarser and coarser approximation to an original signal by removing high frequency detail at each level of decomposition. In other words, the wavelet transform is a multiresolution transform that maps low frequency information of signals into a coarsely sampled subspace and maps high frequency information into more finely sampled spaces. The DWT is defined by a scaling function:
and a wavelet function:
where hk and gk are analysis filters. As can be readily appreciated by those skilled in the art, choosing an appropriate wavelet filter is important in retaining the characteristics of the transient signals in question.
The quality of the wavelet decomposition depends largely on the ability to approximate the signal with wavelets, so the choice of the wavelet scaling function should have properties similar to the original signal. The output of the wavelet transform shows the correlation between the signal and the wavelet as a function of time.
Probably the easiest method for choosing a wavelet is to simply copy a signal's time-frequency behavior. Unfortunately however, most transient signals cannot be used as wavelet basis functions since they resemble exponentially damped sinusoids and do not possess a zero mean.
Accordingly, the wavelet basis we preferably use herein is a known, db5 wavelet defined by Daubechies that has the scaling function and translation function shown graphically in
With reference now to
The process of successive low pass and high pass filtering of an input signal to implement the DWT is oftentimes referred to as the Mallat algorithm. The resulting banks of dyadic multirate filters are used to split up the input signal's frequency components into different subbands at each decomposition level, each with a subset of frequencies spanning half of the original frequency band. If the original signal is sampled at a frequency of fs Hz, then the output of the first high pass filter which is the first detail coefficient D1, captures the band of frequencies between fs/2 and fs/4. This doubles the frequency resolution as the uncertainty in frequency is reduced by a factor of 2.
In the same fashion, the high pass filter in the second stage captures signal components with a bandwidth between fs/4 and fs/8, and so on. In this way, an arbitrary frequency resolution is obtained. Since the input signal at each stage of decomposition contains the highest frequency equivalent to twice that of the output stages, it can be sampled at half the original sampling frequency, thus discarding half of the samples with no loss of information. Advantageously, this decimatation by 2 halves the time resolution of the entire signal as the input signal is represented by half of the total number of samples and effectively doubles the scale.
Turning now to
Features such as the rise time for the blast wave and the low frequency content found within the acoustic signals is least attenuated over long propagation distances when compared to some of the predominant features initially identified for discrimination. From the signal plots of
Now, if we let tp denote the sample time where the maximum peak over pressure of a blast wave occurs, and let tp=α, β≦1 for tp>t0 and tf>t0 such that tp, t0, tfεl. We then define the energy distribution within the details just prior to the max peak pressure as:
Where N=tp−t0. We define the energy distribution at that point immediately after the max pressure as:
Where M=tF−tP. Since evaluations of equations (3) and (4)>0, we are able to define analytic features using the ratio of the normalized energy distributions within the details as:
Note that the first 3-tuple of the features space consists of xD5, xD4, xD3, which we believe are useful to characterize the explosive blasts of interest. A fourth feature is derived from the wavelet coefficient obtained at level 5. We integrate the magnitude of the area for the coefficients between the start and stop times defined for the details yields:
Neural Network Classifier
Turning now to a discussion of another important aspect of the present invention, we note that neural networks have become a powerful tool for solving difficult classification (mapping) problems with a proven ability to realize non-linear discriminant functions and complex decision regions that are often required to ensure separability between classes. The use of neural networks for classification is well documented and requirements for training are well known and understood by those skilled in the art.
With reference to
In general, the network contains Ni inputs, Nh hidden layer neurons and NO output layer neurons with no interconnections within a single layer as shown diagrammatically in
The input layer units or “neurons” propagate signals to the hidden layer but do not perform any computations. Neurons in the hidden layer and the output layer compute their response by taking a weighted sum signals from the previous layer plus a bias, and then passing the sum through an activation function.
For example, the output of the jth neuron in the hidden layer upon the presentation of the pth input pattern xP is given by outPj=f(netPj) where
and f is an activation function that was chosen to be the signed function:
The neural network classifier used to discriminate between High-Explosive and Chemical/Biological explosive blasts was trained using a generalized delta rule or back propagation algorithm. The algorithm sequentially adjusts the interconnection weights within the network, subsequent to the application of all patterns in a training set, a routine commonly referred to as an epoch.
In general, when an input pattern xP from a training set is presented to the network, it produces an output that is different from the target value, say dP. The error for this specific pattern is defined as the squared error
An uncontested nonlinear optimization is performed to minimize total error function of the network:
Through the incremental computation of the gradient of the error in equation (8), and successive adjustment of the interconnection weights so as to achieve the global minimum error corresponding to Ew=0.
Putting the Steps of Our Method Together
We may now describe a more specific set of steps which will permit our discrimination between types of explosive events. The flow charts we use for this purpose are meant to provide only an outline of the steps. And while we discuss our inventive method with respect to acoustic sensors detecting aerial disturbances, it should be explicitly understood that our method and algorithms would work equally well with ground-based seismic or underwater acoustic sensors.
With simultaneous reference to
This collected data may be compared with, for example, acoustic signature data of explosive events (block 140), This acoustic signature data is applied to a discrete wavelet transform (block 220) using a wavelet at level k, kεl, whose attributes lend themselves to the analysis of our acoustic signature data with a single wavelet. As can be appreciated, the wavelet decomposition provides greater resolution of the baseband signal and the higher-level oscillatory harmonics associated with the acoustic signature for further analysis.
The primitives collected after the multiresolutional analysis is performed are the detailed coefficients from multiple k level, kεl, decompositions representing the oscillatory harmonics of the acoustic signature data from the explosive blast that holds some unique traits of the blast (block 235). In addition, the primitives collected after the multiresolutional analysis is performed are the approximations coefficients from multiple k, kεl, decompositions representing baseband information of the acoustic signature from the explosive blast providing distinctive information of the signature (block 245).
The oscillatory harmonics are the detailed components of the explosive blast wave derived from multiresolutional analysis at k levels, kεl, of the signature. This information is a “picture” of the energy distribution of the signal at various resolutions. More specifically, the information just prior to the max pressure of the blast and immediately after the max pressure of the blast.
This information is summed into two elements prior to max pressure and after max pressure. The summed values are then associated with each other in the form of a ratio, with summation for prior to max pressure divided by the summation of the information just after the max pressure, the log of the ratio is taken and results in an n-tuple, nεl feature space for each blast as we perform this calculation for each level of interest (block 237).
The kth level, kεl baseband information is the approximation coefficients of the signal with a kth level, kεl resolution. Integrating the area under the energy of the baseband from the start and stop times, which are defined by the detail coefficients for the signature and the log of the resulting value of the integration is taken and provides an output that gives distinct information of the signal resulting in a m-tuple, mεl, feature space for each blast as we perform this calculation for each level of interest (block 247).
The n-tuple, nεl feature space resulting from the detail coefficients is combined with the m-tuple, mεl feature space resulting from the approximations (block 255) to form a single p-tuple, p=n+m feature vector subspace (block 260). The resulting processed signal information is stored for further analysis using a classifier.
Training data set (block 310) comprises taking p-tuple p=n+m, feature vector subspace from arbitrarily chosen acoustic signatures of explosive detonations to create a training data set of 50% HE blast events and 50% CB blast events creating a p×p, p=n+m, matrix of information to be used by the neural network.
Using a classifier—in this case a multi-layer, feedforward neural network—which takes in the primitive features extracted from acoustic signatures of the explosive blasts in the form of a p-tuple, p=n+m feature vector subspace describing the blast, a pre-determined desired output is also input as is the learning rate and number of hidden layers to train the neural network (blocks 315, 320).
At block 355, unknown processed data is defined as acoustic signature data of explosive events similar to the known training data. Applying the resulting weights from the training of the neural network results in a trained neural network (block 360). The unknown processed data is then tested against the trained neural network to produce an output for the sigmoid activation function. Applying a decision making process to the output of the trained classifier (block 365) results in a binary representation of an explosive event as either HE or CB allowing classification of the acoustic signature. The acoustic signature of the explosive blast is then determined to be either a HE in origin (block 375) or CB in origin (block 370)
As can now be appreciated and readily understood by those skilled in the art, our inventive method and algorithms may be summarized as follows. First, an arbitrary acoustic sensor/transducer detects an explosive event and records the data as a data structure with which subsequent processing may be performed.
Second, the data is processed in order to extract the predominant components of the unique characteristics and create a p-tuple feature vector space. Applying the discrete wavelet transform to the acoustic signature to perform wavelet decomposition, we produce a set of details and approximations at levels k, kεl, by parsing the data through a series of filters providing multiresolution analysis of the signature thereby creating a set of primitives.
The primitives collected describe a ratio of energy distribution before and after max blast pressure of the high harmonic portion of the signature described by detail coefficients of the blast at levels k, kεl. The other primitives used for the feature space are extracted from the approximation coefficients that integrates the area of the blast between start and stop times in the baseband. These elements together produce a p-tuple, p=n+m feature space that is stored as processed data that will be passed onto a classifier for further analysis.
Third, once the data is processed, the power of a multilayer feedforward neural network is used to process the characteristic feature space and classify the signature. The processed data has a set of p-tuple, p=n+m feature vector per signature. A set of these vectors are arbitrarily selected with no regard to the data and subsequently associated with a set of desired outputs between 0 and 1, where 0 is a high explosive blast and 1 is a chemical/biological blast. A sample set of p-tuple, p=n+m feature vectors are used to train the neural network and after training, a set of associated weights are produced.
Finally, with the classifier trained using a sample set of data, we apply random sets of vectors from the processed signature data sets classifying the data as either a high explosive event or a chemical/biological event. Advantageously—as a result of our inventive method—this discrimination comes with a high confidence.
In evaluating our inventive method, features were extracted from data sets using the DWT described previously and according to equations (5) and (6), we constructed a 4-tuple feature vector having the form:
xp=[xD5P,xD4P,xD3P,A5AREAP] (9)
Experiments were conducted to measure the separability of the feature space and benchmark the performance of the neural network classifier. The neural network architecture is shown schematically in
The neural network shown in that FIG. 12—having a single hidden layer neuron—was trained using 22 randomly selected vectors from a total of 461 signatures. The training set comprised 11 samples of Artillery Type A HE data and 11 samples of Artillery Type B CB data collected at several sensor sites. As can be appreciated, the goal of this training process was to obtain a neural network output equal to 0 when the sample features presented to the input layer corresponded to a HE explosive event and an output value of 1 when features from a CB explosive event are applied.
The network was trained such that the total error in Equation (8) was less than 5e−3 and a learning rate of 0.1 was used for the back propagation algorithm. When tested against the remaining 439 signatures, the network correctly classified 100% of the remaining 225 CB events and misclassified only 4 out of 214 (98.1%) of the remaining HE events. The resulting neural network classifier and resulting weights between layers are shown in
In a subsequent experiment, a neural network having 4 hidden layer neurons was then trained using the entire data set from an earlier test. A total of 236 Artillery Type B CB and 225 Artillery Type A HE signatures. The network was then tested against the data subsequently collected.
The network correctly classified 165 of the total 166 CB events and misclassified only 6 out of 57 HE events for a rate of 99.4% and 89.5% respectively. Neural networks having up to 3 hidden layer neurons could not match or surpass the classification performance provided with our experimental architecture having 4 hidden layer neurons. However, the same results were obtained when training a neural network having 5 or more hidden layer neurons. Once again, the explosive events were classified as CB when the output from the sigmoid activation function (7) produced a value greater than 2 and HE, otherwise.
As we have now shown, feature extraction methods based on discrete wavelet transform and multiresolution analysis facilitates the development of a robust classification method that affords reliable discrimination between HE and CB explosive events via acoustic signals produced during detonation. In sharp contrast to prior attempts which have been based on amplitude dependent features—which vary dramatically due to signal attenuation and distortion—our inventive method is not dependent upon such features and still provides remarkably high confidence. In addition, our inventive method provides such a high confidence at ranges exceeding 1 Km from a blast site!
Patent | Priority | Assignee | Title |
10741038, | Mar 05 2015 | Battelle Memorial Institute | System and method of detecting and analyzing a threat in a confined environment |
11423300, | Feb 09 2018 | DeepMind Technologies Limited | Selecting actions by reverting to previous learned action selection policies |
8511145, | Sep 03 2009 | The United States of America as represented by the Secretary of the Army | Explosive event discrimination |
9147101, | Feb 25 2011 | Technical University Of Gabrovo | Method of detecting and identifying substances or mixtures and determining their characteristics |
Patent | Priority | Assignee | Title |
7233936, | Jul 01 1999 | COMMISSARIAT A L ENERGIE ATOMIQUE | Artificial intelligence systems for classifying events, objects and situations |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Aug 22 2005 | The United States of America as represented by the Secretary of the Army | (assignment on the face of the patent) | / | |||
Aug 22 2005 | HOHIL, MYRON | US Government as Represented by the Secretary of the Army | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 016429 | /0532 | |
Aug 22 2005 | DESAI, SACHI V | US Government as Represented by the Secretary of the Army | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 016429 | /0532 |
Date | Maintenance Fee Events |
Mar 19 2012 | REM: Maintenance Fee Reminder Mailed. |
Mar 26 2012 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Mar 26 2012 | M1554: Surcharge for Late Payment, Large Entity. |
Mar 18 2016 | REM: Maintenance Fee Reminder Mailed. |
Aug 05 2016 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
Aug 05 2011 | 4 years fee payment window open |
Feb 05 2012 | 6 months grace period start (w surcharge) |
Aug 05 2012 | patent expiry (for year 4) |
Aug 05 2014 | 2 years to revive unintentionally abandoned end. (for year 4) |
Aug 05 2015 | 8 years fee payment window open |
Feb 05 2016 | 6 months grace period start (w surcharge) |
Aug 05 2016 | patent expiry (for year 8) |
Aug 05 2018 | 2 years to revive unintentionally abandoned end. (for year 8) |
Aug 05 2019 | 12 years fee payment window open |
Feb 05 2020 | 6 months grace period start (w surcharge) |
Aug 05 2020 | patent expiry (for year 12) |
Aug 05 2022 | 2 years to revive unintentionally abandoned end. (for year 12) |