A system for and a method of synchronous acquisition of pulsed source light performs monitoring of aircraft flight operation. Diode sources of illumination (18, 108, 208) are pulsed (16, 106, 206) at one-half the video frame rate of an imaging camera (36, 136, 236). Alternate frames view the world-scene with lights of interest pulsed on, and then off, respectively. Video differencing (34, 134, 234) eliminates the background scene, as well as all lights not of interest. Suitable threshholding over a resulting array of camera pixel-differences acquires the desired lights and represents them as point symbology on a display (40, 140, 240). In an enhanced vision landing system embodiment, the desired lights (symbols) overlay or are fused on a thermal image of the scene; alternatively, the symbols overlay a visible scene (TV) image.
|
1. A method of using an aircraft-borne system to accomplish early acquisition of landing zone illumination obscured from pilot view because of visible light extinguishing atmospheric conditions, comprising:
modulating the landing zone illumination being modulated at a modulation rate;, comprising:
using an imaging camera to acquire a sequence of image frames of a scene in which the modulated landing zone illumination is contained, the sequence of image frames being acquired at a rate that is synchronized with and is a known multiple of the modulation rate;
setting applying the known multiple to which a value is set that causes the sequence of image frames to include first and second sets of images representing, respectively, background scene information including the modulated landing zone illumination and background scene information not including the modulated landing zone illumination; and
processing the first and second sets of images to remove the background scene information from temporally corresponding images of the first and second sets and thereby provide processed image information from which acquisition of the modulated landing zone illumination can be performed.
16. A method of accomplishing early acquisition of light emitted by a target source located at a distance from an imaging camera to perform monitoring of aircraft flight operation, comprising:
modulating the target source light emission being modulated at a modulation rate;, comprising:
using the imaging camera to acquire a sequence of image frames of a scene in which the modulated target source light emission is contained, the sequence of image frames being acquired at a rate that is synchronized with and is a known multiple of the modulation rate;
setting applying the known multiple to which a value is set that causes the sequence of image frames to include first and second sets of images representing;, respectively, background scene information including the modulated target source light emission and background scene information not including the modulated target source light emission; and
processing the first and second sets of images to remove the background scene information from temporally corresponding images of the first and second sets and thereby provide processed image information from which acquisition of the modulated target source light emission can be performed to enable the monitoring of aircraft flight operation.
2. The method of
0. 3. The method of
4. The method of
0. 5. The method of
0. 6. The method of
7. The method of
pulsing the in which the modulated landing zone illumination is pulsed at a pulsing rate, and further comprising:
operating the imaging camera at an acquisition rate to acquire the sequence of image frames of a scene, the pulsing and the acquisition rates exceeding the frame rate of a conventional television camera;
performing the processing of the first and second sets of images by forming N number of pairs of temporally corresponding images of the first and second sets; and
integrating the N number of pairs at an integration rate that exceeds the frame rate of a conventional television camera to establish a signal-to-noise ratio that increases with an increasing integration rate.
8. The method of
9. The method of
0. 10. The method of
11. The method of
12. The method of
0. 13. A method of using an aircraft-borne system to accomplish early acquisition of landing zone illumination obscured from pilot view because of visible light extinguishing atmospheric conditions, comprising:
modulating the landing zone illumination at a modulation rate, the landing zone illumination emitting light in first and second wavelength ranges;
using first and second imaging cameras that are sensitive to light in the respective first and second wavelength ranges to acquire sequences of image frames of a scene in which the landing zone illumination is contained, the sequences of image frames being acquired at rates that are synchronized to the modulation rate, and each of the sequences of image frames including first and second sets of images representing, respectively, background scene information including the landing zone illumination and background scene information not including the landing zone illumination;
processing the first and second sets of images of each sequence to remove the background scene information from temporally corresponding images of the first and second sets and thereby provide processed image information; and
fusing the processed image information relating to each of the sequences and performing on the fused processed image information acquisition of the landing zone illumination.
0. 14. The method of
0. 15. The method of
17. The method of
18. The method of
19. The method of
20. The method of
21. The method of
22. The method of
23. The method of
24. The method of
25. The method of
26. The method of
27. The method of
0. 28. The method of claim 1, in which the loading zone illumination defines a suitable landing zone for rotary wing aircraft.
0. 29. The method of claim 7, in which the imaging camera is sensitive to visible light.
0. 30. The method of claim 29, in which the imaging camera is a CCD or CMOS sensor camera.
0. 31. The method of claim 7, in which the imaging camera is sensitive to SWIR light.
0. 32. The method of claim 31, in which the imaging camera is an InGaAs sensor camera.
0. 33. The method of claim 11, in which the submodulating of the modulated landing zone illumination is performed by pulse code modulation.
0. 34. The method of claim 16, in which the modulated target source of illumination defines a suitable landing zone for rotary wing aircraft.
0. 35. The method of claim 16, further comprising a vision processor which is responsive to the sequence of image frames acquired by the imaging camera and which relates to a database to produce database imagery that, in combination with real-time imagery produced from the sequence of image frames acquired by the imaging camera, provides a combined verified vision system.
0. 36. The method of claim 17, in which the ground system includes a GPS receiver and the aircraft-borne system includes a GPS receiver, and in which the GPS receivers receive GPS signals from which is derived the synchronization of the rate of acquisition of the sequence of image frames and the modulation rate.
0. 37. The method of claim 18, in which the ground system includes a GPS receiver and the aircraft-borne system includes a GPS receiver, and in which the GPS receivers receive GPS signals from which is derived the synchronization of the rate of acquisition of the sequence of image frames and the modulation rate.
0. 38. The method of claim 19, in which the first and second aircraft-borne systems include GPS receivers that receive GPS signals from which is derived the synchronization of the rate of acquisition of the sequence of image frames and the modulation rate.
0. 39. The method of claim 22, in which the submodulating of the modulated target source light emission is performed by pulse code modulation.
|
. atmospheric extinction would entail provision of a compound-diode emitter assembly on the target aircraft.
Synchronous timing of airborne source beacons 208 and gated imaging cameras 236 is derived from GPS signals. Since typical imaging camera integration times are on the order of milliseconds or greater, the finite speed of light does not create significant issues with respect to relative source-camera synchronization over 5—mile ranges. At extreme ranges beyond 5 miles, knowledge of relative positions may be used to correct for small time-of-flight differences between PWM timing and readout electronics timing.
The equipment specifications described above emphasize optimum implementation for automatic air-to-air sensing of an arbitrary aircraft, e.g., from a UAV. However, there exists the option of implementing the above scheme at visible wavelengths using LEDs as source illuminators and suitable television cameras. Although it provides automated acquisition beyond the ability of the human eye, particularly in the presence of background, the gated LED-camera combination alternative also provides direct pilot visibility of the target aircraft beacons on a display 240 of information delivered by EVS 238.
The applications and implementations presented above apply equally, irrespective of whether the diode emitter is an LED or a laser diode. LEDs are typically used in applications requiring one or both of maximum beacon and camera economy and direct eye visibility. SWIR and laser diodes are typically used for highest operational performance.
It will be obvious to those having skill in the art that many changes may be made to the details of the above-described embodiments without departing from the underlying principles of the invention. The scope of the present invention should, therefore, be determined only by the following claims.
Fossey, Michael E., Kerr, J. Richard, Zuro, Gregory A.
Patent | Priority | Assignee | Title |
10175030, | Mar 13 2017 | Sensors Unlimited, Inc.; SENSORS UNLIMITED, INC | Threat detection |
11263911, | Aug 09 2018 | Sensors Unlimited, Inc. | Systems and methods for identifying air traffic objects |
ER2812, |
Patent | Priority | Assignee | Title |
5303031, | May 08 1992 | UNITED STATES OF AMERICA, THE, AS REPRESENTED BY THE UNITED STATES AIR FORCE | All optical phase sensitive detector and image demultiplexer |
5654890, | May 31 1994 | Winged Systems Corporation | High resolution autonomous precision approach and landing system |
5684588, | Oct 04 1996 | United States of America as represented by the Secretary of the Air Force | Homodyne and hetrodyne imaging in a light scattering medium |
5859713, | Oct 07 1996 | The United States of America as represented by the Secretary of the Air | Imaging in a scattering medium using photon density waves |
6119055, | Jan 23 1998 | McDonnell Douglas Corporation | Real time imaging system and method for use in aiding a landing operation of an aircraft in obscured weather conditions |
6157876, | Oct 12 1999 | Honeywell International Inc | Method and apparatus for navigating an aircraft from an image of the runway |
6232602, | Mar 05 1999 | Teledyne FLIR, LLC | Enhanced vision system sensitive to infrared radiation |
6264135, | Feb 14 2000 | Inflight aircraft visual monitoring apparatus | |
6373055, | Mar 05 1999 | Teledyne FLIR, LLC | Enhanced vision system sensitive to infrared radiation |
6577339, | Jul 30 1997 | Pinotage, LLC | Aircraft monitoring and analysis system and method |
6806469, | Mar 05 1999 | Teledyne FLIR, LLC | Enhanced vision system sensitive to infrared radiation |
7045783, | Jun 05 2001 | UNIVERSITY OF FLORIDA RESEARCH FOUNDATION, INC | Device and method for object illumination and imaging using light pulses |
7225063, | Sep 20 2001 | Keith R, Tart | Aircraft control system |
DE3631321, | |||
GB2224613, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Aug 06 2008 | ZURO, GREGORY A | MAX-VIZ, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 051824 | /0861 | |
Aug 06 2008 | FOSSEY, MICHAEL E | MAX-VIZ, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 051824 | /0861 | |
Aug 08 2008 | KERR, J RICHARD | MAX-VIZ, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 051824 | /0861 | |
Nov 18 2013 | Max-Viz, Inc. | (assignment on the face of the patent) | / | |||
Dec 16 2019 | MAX-VIZ, INC | PECO, INC | MERGER SEE DOCUMENT FOR DETAILS | 051969 | /0469 | |
Jul 11 2024 | PECO, INC | HSBC BANK USA, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 068283 | /0900 | |
Jul 11 2024 | ASTRONICS CONNECTIVITY SYSTEMS & CERTIFICATION CORP | HSBC BANK USA, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 068283 | /0900 | |
Jul 11 2024 | LUMINESCENT SYTEMS, INC | HSBC BANK USA, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 068283 | /0900 | |
Jul 11 2024 | ASTRONIC TEST SYSTEMS INC | HSBC BANK USA, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 068283 | /0900 | |
Jul 11 2024 | ASTRONICS AEROSAT CORPORATION | HSBC BANK USA, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 068283 | /0900 | |
Jul 11 2024 | ASTRONICS ADVANCED ELECTRONIC SYSTEMS CORP | HSBC BANK USA, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 068283 | /0900 | |
Jul 11 2024 | Astronics Corporation | HSBC BANK USA, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 068283 | /0900 | |
Jul 11 2024 | DIAGNOSYS INC | HSBC BANK USA, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 068283 | /0900 |
Date | Maintenance Fee Events |
Oct 12 2017 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Oct 22 2021 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Apr 07 2018 | 4 years fee payment window open |
Oct 07 2018 | 6 months grace period start (w surcharge) |
Apr 07 2019 | patent expiry (for year 4) |
Apr 07 2021 | 2 years to revive unintentionally abandoned end. (for year 4) |
Apr 07 2022 | 8 years fee payment window open |
Oct 07 2022 | 6 months grace period start (w surcharge) |
Apr 07 2023 | patent expiry (for year 8) |
Apr 07 2025 | 2 years to revive unintentionally abandoned end. (for year 8) |
Apr 07 2026 | 12 years fee payment window open |
Oct 07 2026 | 6 months grace period start (w surcharge) |
Apr 07 2027 | patent expiry (for year 12) |
Apr 07 2029 | 2 years to revive unintentionally abandoned end. (for year 12) |