A method and system is disclosed for tracking object clusters. The method comprises obtaining a first sensor image and a second sensor image. angular measurements between objects of the first sensor image are determined. angular measurements between objects of the second sensor image are also determined. angular measurements from the first sensor image are compared to angular measurements of the second image, and correlated object clusters are identified. The sensor system includes a command and decision unit that receives a first sensor image and a second sensor image. The command and decision unit determines angular measurements for the first sensor image, and determines angular measurements for the second sensor image. The command and decision unit compares the angular measurements for the first sensor image to the angular measurements for the second sensor image, and identifies correlated object clusters based on the comparison.
|
1. A method for tracking object clusters, the method comprising:
obtaining a first sensor image having a plurality of first sensor image objects;
obtaining a second sensor image having a plurality of second sensor image objects;
determining, by a computer processor, first sensor image tetrahedron angular measurements for the plurality of first sensor image objects;
determining, by the computer processor, second sensor image tetrahedron angular measurements for the plurality of second sensor image objects;
identifying, by the computer processor, correlated object clusters by comparing the first sensor image tetrahedron angular measurements to the second sensor image tetrahedron angular measurements.
13. A sensor system for tracking object clusters comprising:
a command and decision unit processor;
a memory, coupled to the command and decision unit processor, storing program instructions which, when executed by the command and decision unit processor, cause the command and decision unit processor to:
obtain a first sensor image having a plurality of first sensor image objects;
obtain a second sensor image having a plurality of second sensor image objects;
determine first sensor image tetrahedron angular measurements for first sensor image tetrahedrons defined by the plurality of first sensor image objects;
determine second sensor image tetrahedron angular measurements for second sensor image tetrahedrons; and
identify correlated object clusters by comparing the first sensor image tetrahedron angular measurements to the second sensor image tetrahedron angular measurements.
10. A method for tracking object clusters, the method comprising:
obtaining a first sensor image having a plurality of first sensor image objects;
obtaining a second sensor image having a plurality of second sensor image objects;
determining, by a computer processor, a plurality of first sensor image tetrahedron internal angular measurements for first sensor image tetrahedrons;
determining, by the computer processor, a plurality of second sensor image tetrahedron internal angular measurements for second sensor image tetrahedrons;
performing, by the computer processor, a chirality check when determining the plurality of first sensor image tetrahedron internal angles and the plurality of second sensor image tetrahedron internal angles; and
identifying, by the computer processor, correlated object clusters by comparing the plurality of first sensor image tetrahedron angular measurements to the plurality of second sensor image tetrahedron angular measurements.
12. A method for tracking object clusters, the method comprising:
obtaining a first sensor image having a plurality of first sensor image objects;
obtaining a second sensor image having a plurality of second sensor image objects;
determining, by a computer processor, first sensor image tetrahedron angular measurements for first sensor image tetrahedrons;
determining, by the computer processor, second sensor image tetrahedron angular measurements for second sensor image tetrahedrons; and
identifying, by the computer processor, correlated object clusters by comparing the first sensor image tetrahedron angular measurements to the second sensor image tetrahedron angular measurements;
wherein comparing the first sensor image tetrahedron angular measurements to the second sensor image tetrahedron angular measurements comprises:
selecting a selected first sensor image tetrahedron and selecting a selected first sensor image tetrahedron angular measurement of the selected first sensor image tetrahedron;
comparing the selected first sensor image tetrahedron angular measurement to the second sensor image tetrahedron angular measurements;
identifying second sensor image candidate tetrahedrons having a second sensor image tetrahedron angular measurement that matches the selected first sensor image tetrahedron angular measurement;
comparing selected first sensor image tetrahedron adjacent angular measurements to the second sensor image tetrahedron angular measurements of the second sensor image candidate tetrahedrons; and
designating second sensor image candidate tetrahedrons having second sensor image tetrahedron angular measurements matching the selected first sensor image tetrahedron adjacent angular measurements as correlated object clusters.
2. The method of
3. The method of
4. The method of
5. The method of
6. The method of
7. The method of
8. The method of
9. The method of
selecting a selected first sensor image tetrahedron from the first list and selecting a selected first sensor image tetrahedron angular measurement of the selected first sensor image tetrahedron;
comparing the selected first sensor image tetrahedron angular measurement to the second sensor image angular measurements in the second list;
identifying second sensor image candidate tetrahedrons in the second list having a second sensor image tetrahedron angular measurement that matches the selected first sensor image tetrahedron angular measurement;
selecting selected first sensor image tetrahedron adjacent angular measurements;
comparing selected first sensor image tetrahedron adjacent angular measurements to the second sensor image angular measurements of the second sensor image candidate tetrahedrons; and
designating second sensor image candidate tetrahedrons having second sensor image angular measurements matching the selected first sensor image tetrahedron adjacent angular measurements as correlated object clusters.
11. The method of
14. The sensor system of
15. The sensor system of
create a first list containing the first sensor image tetrahedron angular measurements for first sensor image tetrahedrons; and
create a second list containing second sensor image tetrahedron angular measurements for the second sensor image tetrahedrons;
wherein the memory storing program instructions which cause the command and decision unit processor to identify correlated object clusters comprises the memory storing program instructions which cause the command and decision unit processor to identify correlated object clusters by comparing the first sensor image tetrahedron angular measurements in the first list to the second sensor image tetrahedron angular measurements in the second list.
16. The sensor system of
17. The sensor system of
select a selected first sensor image tetrahedron and selecting a selected first sensor image tetrahedron angular measurement of the selected first sensor image tetrahedron;
compare the selected first sensor image tetrahedron angular measurement to the second sensor image tetrahedron angular measurements;
identify second sensor image candidate tetrahedrons having a second sensor image tetrahedron angular measurement that matches the selected first sensor image tetrahedron angular measurement;
compare selected first sensor image tetrahedron adjacent angular measurements to the second sensor image tetrahedron angular measurements of the second sensor image candidate tetrahedrons; and
designate second sensor image candidate tetrahedrons having second sensor image tetrahedron angular measurements matching the selected first sensor image tetrahedron adjacent angular measurements as correlated object clusters.
|
The invention relates to systems and methods for sensor tracking of objects, and more particularly to a system and method for correlating three dimensional points images across independent sensors.
Naval sensor systems often search space and track objects across independent sensors. If a cluster of objects is identified on a first sensor, when another cluster of objects is identified on a second sensor, there is a need to determine whether that cluster of objects on the second sensor is the same as the cluster of objects identified on the first sensor. In that way, the total number of threats can be accurately assessed and tracked.
In general, current methods are known for three-dimensional tracking of clusters of objects across different sensors. However, the known methods can be slow to implement because they require extensive calculation including isotropic scaling and conformal transformations such as Euclidean transformations. Thus, there is a need for a computationally simple technique for tracking clusters across independent sensors.
Naval search sensors often spot clusters of objects on different sensors. Cluster identification using isotropic scaling and conformal transformations has been avoided because of computational complexity as well as transformation error and bias. The disclosed method reduces the complexity of identifying clusters by comparing the clusters without coordinate transformation, which greatly simplifies the problem and allows a simple and easily calculated solution.
A method for tracking object clusters may comprise: obtaining a first sensor image having a plurality of first sensor image objects; obtaining a second sensor image having a plurality of second sensor image objects; determining first sensor image angular measurements for the plurality of first sensor image objects; determining second sensor image angular measurements for the plurality of second sensor image objects; identifying correlated object clusters by comparing the first sensor image angular measurements to the second sensor image angular measurements. Determining first sensor image angular measurements may comprise determining first sensor image tetrahedron angular measurements, and determining second sensor image angular measurements comprises determining second sensor image tetrahedron angular measurements. Determining first sensor image tetrahedron angular measurements may comprise determining a plurality of first sensor image tetrahedron internal angles for each first sensor image tetrahedron and determining second sensor image tetrahedron angular measurements may comprise determining a plurality of second sensor image tetrahedron internal angles for each second sensor image tetrahedron. In an embodiment, determining the plurality of first sensor image tetrahedron internal angles may comprise determining five first sensor image tetrahedron internal angles and wherein determining the plurality of second sensor image tetrahedron internal angles comprises determining five second sensor image tetrahedron internal angles.
The method for tracking object clusters may further comprise performing a chirality check when determining the plurality of first sensor image tetrahedron internal angles and the plurality of second sensor image tetrahedron internal angles. In an embodiment the method may also further comprise creating a first list containing the first sensor image tetrahedron angular measurements for first sensor image tetrahedrons. The method may also comprise creating a second list containing second sensor image tetrahedron angular measurements for the second sensor image tetrahedrons. Comparing the first sensor image angular measurements to the second sensor image angular measurements may comprise comparing the first sensor image tetrahedron angular measurements in the first list to the second sensor image tetrahedron angular measurements in the second list. In an embodiment, the first sensor image tetrahedrons and the second sensor image tetrahedrons having matching first sensor image tetrahedron angular measurements and second sensor image tetrahedron angular measurements are identified as correlated object clusters.
In an embodiment, comparing first sensor image tetrahedron angular measurements in the first list to second sensor image tetrahedron angular measurements in the second list comprises: selecting a selected first sensor image tetrahedron from the first list and selecting a selected first sensor image tetrahedron angular measurement of the selected first sensor image tetrahedron; comparing the selected first sensor image tetrahedron angular measurement to the second sensor image angular measurements in the second list; identifying second sensor image candidate tetrahedrons in the second list having a second sensor image tetrahedron angular measurement that matches the selected first sensor image tetrahedron angular measurement; selecting selected first sensor image tetrahedron adjacent angular measurements; comparing selected first sensor image tetrahedron adjacent angular measurements to the second sensor image angular measurements of the second sensor image candidate tetrahedrons; and designating second sensor image candidate tetrahedrons having second sensor image angular measurements matching the selected first sensor image tetrahedron adjacent angular measurements as correlated object clusters.
In an embodiment, a method for tracking object clusters may comprise: obtaining a first sensor image having a plurality of first sensor image objects; obtaining a second sensor image having a plurality of second sensor image objects; determining first sensor image tetrahedron angular measurements for first sensor image tetrahedrons; determining second sensor image tetrahedron angular measurements for second sensor image tetrahedrons; and identifying correlated object clusters by comparing the first sensor image tetrahedron angular measurements to the second sensor image tetrahedron angular measurements. Determining first sensor image tetrahedron angular measurements may comprise determining a plurality of first sensor image tetrahedron internal angles for each first sensor image tetrahedron and wherein determining second sensor image tetrahedron angular measurements comprises determining a plurality of second sensor image tetrahedron internal angles for each second sensor image tetrahedron. Determining the plurality of first sensor image tetrahedron internal angles may comprise determining five first sensor image tetrahedron internal angles and wherein determining the plurality of second sensor image tetrahedron internal angles comprises determining five second sensor image tetrahedron internal angles.
In an embodiment, the method for tracking object clusters may further comprise performing a chirality check when determining the plurality of first sensor image tetrahedron internal angles and the plurality of second sensor image tetrahedron internal angles. In an embodiment, comparing the first sensor image tetrahedron angular measurements to the second sensor image tetrahedron angular measurements may comprise: selecting a selected first sensor image tetrahedron and selecting a selected first sensor image tetrahedron angular measurement of the selected first sensor image tetrahedron; comparing the selected first sensor image tetrahedron angular measurement to the second sensor image tetrahedron angular measurements; identifying second sensor image candidate tetrahedrons having a second sensor image tetrahedron angular measurement that matches the selected first sensor image tetrahedron angular measurement; comparing selected first sensor image tetrahedron adjacent angular measurements to the second sensor image tetrahedron angular measurements of the second sensor image candidate tetrahedrons; and designating second sensor image candidate tetrahedrons having second sensor image tetrahedron angular measurements matching the selected first sensor image tetrahedron adjacent angular measurements as correlated object clusters.
A sensor system for tracking object clusters may comprise: a command and decision unit for: obtaining a first sensor image having a plurality of first sensor image objects; obtaining a second sensor image having a plurality of second sensor image objects; determining first sensor image tetrahedron angular measurements for first sensor image tetrahedrons defined by the plurality of first sensor image objects; determining second sensor image tetrahedron angular measurements for second sensor image tetrahedrons; and identifying correlated object clusters by comparing the first sensor image tetrahedron angular measurements to the second sensor image tetrahedron angular measurements. In an embodiment the system may further comprise a communications unit, and wherein obtaining the second sensor image comprises receiving the second sensor image from the communications unit.
The details of the invention, both as to its structure and operation, may be obtained by a review of the accompanying drawings, in which like reference numerals refer to like parts, and in which:
In
The first ship 14 of
In a tetrahedron, a pair of vectors with a common origin forms a plane. For example, the vector rjk is the unit vector from point k to point j, and vector rjm is the unit vector from point m to point j. The point j is a common origin for the vectors, and plane njkm=rjk×rjm can be determined from the vectors. An “inward” direction is defined for the three faces bounding an element of a solid angle, by multiplying any face njkm by the inner product njkm·rjn, where rjn is the third difference vector defining Ω and rjn is its norm. Notationally, if this inner product is negative then njkm→njmk results in all inward-pointing normals. The same normal also has various representations, i.e., njkm=nmjk=nkjm=−njmk. The three dihedral angles are defined by:
φjb,ac=cos−1(njab·njbc)
Where the first subscripted indices jb of the dihedral angle is the vertex of the planes, and the latter two indicate remaining points in the places. The solid angle is:
Ωjkmn=φjk,mn+φjm,nk+φjn,km−π
A fourth dihedral defines the shape of the volume, for example an additional plane can be found for rkm and rkn that has normal nkmn. This defines the shape, but not the size, of the volume through any one of the three remaining dihedrals, for example the four dihedral angles [φjk,mn, φjm,nk, φjn,km, φkm,jn].
The cross produce njkm is in the form of the sine of the internal angle αj,km hence each dihedral angle φjb,ac is dependent upon two internal angles αj,ab and αj,bc. An adjacent dihedral angle, for instance φja,bc, incorporates only one additional internal angle, in this case αj,ac.
As a result of the foregoing, a plurality of five internal angles with accompanying chirality checks (to avoid mirror images) are sufficient to define the shape of the tetrahedron, and the correlation of five such angles with corresponding chirality is sufficient to correlate the tetrahedron. Each of the five internal angles may be determined from the outer product:
αj,km=sin−1(rjk×rjm) (1)
Chirality checks may be performed to avoid mirror images that give rise to pseudo-correlations by using the outer product rather than the inner product to determine the internal angle. For example in the first sensor image of
As will be understood, while the calculations performed in relation to
The flowchart of
The flowchart of
In block 610, a first list L1 of the angular measurements for the unique tetrahedrons of the first sensor image is created, which has first sensor image tetrahedron angular measurements. A second list L2 of the angular measurements for the unique tetrahedrons of the second sensor image is created, which has the second sensor image tetrahedron angular measurements. In an embodiment, the first and second lists include an entry for each unique tetrahedron that is definable within the sensor image. For example, the tetrahedron formed by 4-point cluster (1, 2, 3, 4) is the same as the tetrahedron formed by the 4-point cluster (4, 3, 2, 1), so that would only be counted as one unique angle on the list. Each entry also includes the five internal tetrahedron angles that are specific to each tetrahedron. Accordingly, the entries in the first list L1 include five first sensor image tetrahedron internal angles for each entry while the entries in the second list L2 include five second sensor image tetrahedron internal angles for each entry.
After the lists are created, in block 620 the first tetrahedron in list L1 is selected (selected first sensor image tetrahedron) and one of the angles in that tetrahedron is selected for comparison (selected first sensor image tetrahedron angular measurement). In block 630, the selected angle is compared to the angles of the tetrahedrons in list L2, and “candidate” tetrahedrons in list L2 (second sensor image candidate tetrahedrons) are identified as those tetrahedrons that have an angle (second sensor image tetrahedron angular measurement) matching the selected first sensor image tetrahedron angular measurement. In block 640, an adjacent angle of the selected tetrahedron from list L1 is selected (selected first sensor image tetrahedron adjacent angular measurements). The selected adjacent angle is then compared to adjacent angles of the candidate tetrahedrons (second sensor image tetrahedron adjacent angular measurements) in block 650. The candidate tetrahedrons that have a matching adjacent angle remain candidate tetrahedrons, while those tetrahedrons without a matching adjacent angle are “de-identified” as a candidate. At block 660, a a determination is made as to whether there are additional internal angles to process. If there are, the process of comparing adjacent angles is continued at blocks 640-660 until all of the adjacent angles are considered. After all of the adjacent angles have been considered, any remaining “candidate” tetrahedrons in list L2 are designated or identified as “correlated” tetrahedrons at block 670. That is, remaining second sensor image candidate tetrahedrons will have angles that match (matching angles or matching angular measurements) the angles of the first tetrahedron. Ideally, a single candidate would result, but there may be smaller clusters that also correlate. Correlated tetrahedrons may also be identified as a correlated object clusters because a tetrahedron is one form of an object cluster. At block 680 a determination is made as to whether there are additional tetrahedrons in the first list to check and if so, the process continues and blocks 620-670 are repeated until there are no additional tetrahedrons in the first list to check. The process ends at block 690 if there are no additional tetrahedrons in the first list to check.
As will be understood by those skilled in the art, the angle measures of the tetrahedrons will have associated uncertainties and corresponding correlations will have associated probabilities. For simplicity, these uncertainties and probabilities are not shown. As is known in the art, these uncertainties and probabilities may be accounted for in the calculations, and other information may be available for each point to help discern the correct correlations.
Although the process of
The disclosed method described herein may be automated by, for example, tangibly embodying a program of instructions upon a computer readable storage media capable of being read by machine capable of executing the instructions. A general purpose computer is one example of such a machine, as are other known computing devices having processors, memory, hardware, software, and/or firmware. A non-limiting exemplary list of appropriate storage media well known in the art would include such devices as a readable or writeable CD, flash memory chips (e.g., thumb drives), various magnetic storage media, and the like.
The features of the method have been disclosed, and further variations will be apparent to persons skilled in the art. All such variations are considered to be within the scope of the appended claims. Reference should be made to the appended claims, rather than the foregoing specification, as indicating the true scope of the disclosed method.
The functions and process blocks herein may be performed automatically or wholly or partially in response to user command. An activity (including a step) performed automatically is performed in response to executable instruction or device operation without user direct initiation of the activity.
The systems and processes of
Furthermore, although the invention has been described in terms of exemplary embodiments, it is not limited thereto. Rather, the appended claims should be construed broadly, to include other variants and embodiments of the invention, which may be made by those skilled in the art without departing from the scope and range of equivalents of the invention.
Patent | Priority | Assignee | Title |
10048367, | Jul 29 2015 | AT&T MOBILITY II, LLC | Target tracking camera |
9292792, | Sep 27 2012 | Lockheed Martin Corporation | Classification systems and methods using convex hulls |
9482749, | Aug 09 2012 | Lockheed Martin Corporation | Signature detection in point images |
9600765, | Sep 27 2012 | Lockheed Martin Corporation | Classification systems and methods using convex hulls |
Patent | Priority | Assignee | Title |
7738008, | Nov 07 2005 | GLOBAL DIGITAL SOLUTIONS, INC | Infrared security system and method |
20040002642, | |||
20050213818, | |||
20070279494, | |||
20080123900, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Oct 10 2012 | Lockheed Martin Corporation | (assignment on the face of the patent) | / | |||
Oct 10 2012 | FRIESEL, MARK A | Lockheed Martin Corporation | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 029106 | /0250 |
Date | Maintenance Fee Events |
Mar 03 2015 | ASPN: Payor Number Assigned. |
Oct 15 2018 | M1551: Payment of Maintenance Fee, 4th Year, Large Entity. |
Dec 05 2022 | REM: Maintenance Fee Reminder Mailed. |
May 22 2023 | EXP: Patent Expired for Failure to Pay Maintenance Fees. |
Date | Maintenance Schedule |
Apr 14 2018 | 4 years fee payment window open |
Oct 14 2018 | 6 months grace period start (w surcharge) |
Apr 14 2019 | patent expiry (for year 4) |
Apr 14 2021 | 2 years to revive unintentionally abandoned end. (for year 4) |
Apr 14 2022 | 8 years fee payment window open |
Oct 14 2022 | 6 months grace period start (w surcharge) |
Apr 14 2023 | patent expiry (for year 8) |
Apr 14 2025 | 2 years to revive unintentionally abandoned end. (for year 8) |
Apr 14 2026 | 12 years fee payment window open |
Oct 14 2026 | 6 months grace period start (w surcharge) |
Apr 14 2027 | patent expiry (for year 12) |
Apr 14 2029 | 2 years to revive unintentionally abandoned end. (for year 12) |