There is provided a system and method for detecting a distance to an object. The method comprises providing a lighting system having at least one pulse width modulated visible-light source for illumination of a field of view; emitting an illumination signal for illuminating the field of view for a duration of time y using the visible-light source at a time t; integrating a reflection energy for a first time period from a time t−x to a time t+x; determining a first integration value for the first time period; integrating the reflection energy for a second time period from a time t+y−x to a time t+y+x; determining a second integration value for the second time period; calculating a difference value between the first integration value and the second integration value; determining a propagation delay value proportional to the difference value; determining the distance to the object from the propagation delay value.

Patent
   RE49342
Priority
Dec 21 2007
Filed
Jun 19 2018
Issued
Dec 20 2022
Expiry
Dec 19 2028
Assg.orig
Entity
Small
0
258
currently ok
0. 4. A ranging system comprising:
a. a driver circuit configured to produce a driving signal for causing a light source to emit pulsed light toward a scene containing an object,
b. an optical detector configured to collect pulsed light emitted from the light source and back-scattered from the object and to produce an output signal conveying acquisitions of light pulses,
c. an adaptive signal processing system coupled to the optical detector, configured to perform an adaptive processing of the output signal, including:
(i) sampling the output signal to obtain sampled acquisitions of light pulses,
(ii) performing an accumulation of a number of the sampled acquisitions of light pulses to define an accumulated digital signal varying with time, the accumulation of the number of the sampled acquisitions of light pulses including performing integration over time of the number of sampled acquisitions of light pulses,
(iii) varying the number of accumulated sampled acquisitions of light pulses to obtain a modified accumulated digital signal, based on a parameter of the object,
(iv) obtaining a distance measurement from the modified accumulated digital signal.
0. 1. A method for detecting a distance to an object, comprising:
providing a lighting system having at least one pulse width modulated visible-light source for illumination of a field of view;
emitting an illumination signal for illuminating said field of view for a duration of time y using said visible-light source at a time t, said time t being a center of a transition from a non-illuminated state to an illuminated state of said field of view, for at least one pulse;
starting an optical sensor for integrating a reflection energy captured by said visible-light source, of a reflection of said illumination signal, for a first time period at a time t−x of a first one of said at least one pulse;
stopping said optical sensor for said first time period at a time t+x for said first one of said at least one pulse and determining a first integration value for said first time period;
starting said optical sensor for integrating said reflection energy captured by said visible-light source, of said reflection of said illumination signal, for a second time period at a time t+y−x for a second one of said at least one pulse, said second one being one of said first one and another one of said at least one pulse, y being greater than x;
stopping said optical sensor for said second time period at a time t+y+x for said second one of said at least one pulse and determining a second integration value for said second time period;
measuring a background integration value for non-negligible illumination background from other lighting sources during an integration time 2x when said visible-light source is not emitting;
subtracting from each said first integration value and said second integration value said background integration value to obtain background compensated first integration value and second integration value;
calculating a difference value between said background compensated first integration value and said background compensated second integration value;
determining a propagation delay value proportional to said difference value;
determining said distance to said object from said propagation delay value.
0. 2. A method as claimed in claim 1, further comprising:
providing a threshold distance to a pre-identified object;
comparing said distance to said object with said threshold distance;
determining said object to be said pre-identified object if said comparison is positive.
0. 3. A method as claimed in claim 1, further comprising, when said x is greater than said y, said integrating being larger than a width of the pulse,
switching a synchronisation of said illumination signal with said starting said optical sensor.
0. 5. The ranging system of claim 4, wherein the accumulated digital signal defines a signal trace with a pulse-shaped segment.
0. 6. The ranging system of claim 5, wherein the signal processing system is configured for adjusting an intensity of the driving signal based on the estimated distance to the object.
0. 7. The ranging system of claim 5, wherein the light is non-visible light.
0. 8. The ranging system of claim 4, wherein the parameter of the object includes a distance to the object, the processing of the output signal comprises increasing the number of accumulated sampled acquisitions of light pulses to obtain a distance measurement, with an increasing distance to the object.
0. 9. The ranging system of claim 4, wherein the parameter of the object includes a distance to the object, the processing of the output signal comprises decreasing the number of accumulated sampled acquisitions of light pulses to obtain a distance measurement, with a decreasing distance to the object.
0. 10. The ranging system as defined in claim 4, wherein the optical detector comprises an array of pixels, each pixel outputting a respective output signal.
0. 11. The ranging system as defined in claim 10, wherein the array is a 2D array.
0. 12. The ranging system as defined in claim 11, wherein the array is a 1D array.
0. 13. The ranging system as defined in claim 4, wherein the sampled acquisitions of light pulses include respective sets of j points, the accumulation of the number of sampled acquisitions of light pulses including adding the number of sets of j points, point by point to generate the accumulated digital signal.
0. 14. The ranging system as defined in claim 13, wherein the processing of the output signal includes phase-shifting the sampled acquisitions of light pulses.
12
where c represents the velocity of light, INT represents the integration time, P1 represents the integration value synchronized with the rising edge of the optical pulse and P2 represents the integration value synchronized on the falling edge of the optical pulse.

When an illumination background from other lighting sources is not negligible, measurement of the background B during an integration time INT when the optical source of the system is off can be made and subtracted from each integration value P1 and P2. The relationship with non negligible background is:
Distance=c×(INT/4)*((P2−B)−(P1−-B))/(P2+P1−2B),
where B is the integration value of the optical background level when the optical source of the system is off.

In the case where the integration time is larger than the width of the pulse of the optical source, the same technique can be used by switching the synchronisation of the signal of the optical source and the signal to the sensor integration time. The result becomes:
Distance=c×(INT/4)*(P1−P2)/(P2+P1),
where c represents the velocity of light, INT represents the integration time, P1 represents the integration value when optical pulse is synchronized with the rising edge of integration and P2 represents the integration value when the optical pulse is synchronized with the falling edge of integration.

When an illumination background from other lighting sources is not negligible, the relationship is:
Distance=c×(INT/4)*((P1−B)−(P2−B))/(P2+P1−2B).

Values from the signal integration are memorized. In the case of an array of sensors, each “pixel” is memorized. Several integrations can be performed and an averaging process can be done to improve signal to noise ratio. In the case of an array, we also can improve signal to noise ratio by using a groups of pixel and combining them to form a larger pixel (binning)

In summary, with reference to FIG. 17, the main steps of the method for acquiring a detected light optical signal and generating an accumulated digital trace are shown. The method comprises providing a light source with an optical detector for illumination of a field of view 1700; providing an analog-to-digital converter (ADC) 1702; emitting one pulse from the light source in the field of view 1704; detecting a reflection signal of the pulse by the optical detector 1706; acquiring j points for the detected reflection signal by the ADC 1708; storing, in a buffer, the digital signal waveform of j points 1710; introducing a phase shift of 2π/P 1712; repeating, P times 1714, the steps of emitting 1704, detecting 1706, acquiring 1708, storing 1710 and introducing 1712 to store 1710, in the buffer, an interleaved waveform of P×j points; accumulating 1716 M traces of interleaved P×j points for a total of N=M×P acquisition sets, N being a total number of pulses emitted; creating one combined trace of the reflected signal of j×P points by adding each point of the M traces 1718.

Additionally, the combined trace can be compared 1720 to a detected reference reflection signal of the pulse to determine 1722 a distance traveled by the pulse.

Alternatively, a timer can be triggered to calculate a time elapsed 1724 between the emission of the pulse and the detection of the reflection signal to determine a distance traveled 1722 by the pulse based on the time elapsed.

In summary, with reference to FIG. 18, the main steps of the method for detecting a distance to an object are shown. The method comprises providing a lighting system 1800 having at least one pulse width modulated visible-light source for illumination of a field of view; emitting an illumination signal 1802 for illuminating the field of view for a duration of time y using the visible-light source at a time t; integrating a reflection energy for a first time period from a time t−x to a time t+x 1808; determining a first integration value for the first time period 1810; integrating the reflection energy for a second time period from a time t+y−x to a time t+y+x 1812; determining a second integration value for the second time period 1814; calculating a difference value between the first integration value and the second integration value 1816; determining a propagation delay value proportional to the difference value 1818; determining the distance to the object from the propagation delay value 1820.

While illustrated in the block diagrams as groups of discrete components communicating with each other via distinct data signal connections, it will be understood by those skilled in the art that the illustrated embodiments may be provided by a combination of hardware and software components, with some components being implemented by a given function or operation of a hardware or software system, and many of the data paths illustrated being implemented by data communication within a computer application or operating system. The structure illustrated is thus provided for efficiency of teaching the described embodiment.

Mimeault, Yvan

Patent Priority Assignee Title
Patent Priority Assignee Title
3045231,
3680085,
3954335, Jun 19 1972 Siemens AG Method and apparatus for measuring range and speed of an object relative to a datum plane
4717862, Nov 19 1984 The United States Government as represented by the Secretary of the Navy Pulsed illumination projector
4808997, May 21 1987 BARKLEY ASSOCIATES, INC , A CORP OF IL Photoelectric vehicle position indicating device for use in parking and otherwise positioning vehicles
4891624, Jun 12 1987 Stanley Electric Co., Ltd. Rearward vehicle obstruction detector using modulated light from the brake light elements
4928232, Dec 16 1988 Laser Precision Corporation Signal averaging for optical time domain relectometers
4987832, Apr 28 1982 Eltro GmbH Method and apparatus for increasing the effectiveness of projectiles
5102218, Aug 15 1991 UNITED STATES OF AMERICA, THE, AS REPRESENTED BY THE SECRETARY OF THE AIR FORCE Target-aerosol discrimination by means of digital signal processing
5134393, Apr 02 1990 Traffic control system
5179286, Oct 05 1990 Mitsubishi Denki K.K. Distance measuring apparatus receiving echo light pulses
5298905, Jun 12 1992 GENERAL DYNAMICS C4 SYSTEMS, INC Visible light detection and ranging apparatus and method
5317311, Nov 14 1988 TRAFFICMASTER PLC, OF LUTON INTERNATIONAL AIRPORT Traffic congestion monitoring system
5357331, Jul 02 1991 Lockheed Martin Corp System for processing reflected energy signals
5381155, Dec 08 1993 Vehicle speeding detection and identification
5389921, May 17 1993 Parking lot apparatus and method
5396510, Sep 30 1993 Honeywell Inc. Laser sensor capable of measuring distance, velocity, and acceleration
5471215, Jun 28 1993 Nissan Motor Co., Ltd. Radar apparatus
5519209, Jun 15 1994 AlliedSignal Inc. High range resolution active imaging system using a high speed shutter and a light pulse having a sharp edge
5565870, Jun 28 1993 NISSAN MOTOR CO , LTD Radar apparatus with determination of presence of target reflections
5587908, Dec 22 1992 Mitsubishi Denki Kabushiki Kaisha Distance measurement device and vehicle velocity control device for maintaining inter-vehicular distance
5621518, Nov 26 1994 Keysight Technologies, Inc Optical time domain reflectometer (OTDR) with improved dynamic range and linearity
5633629, Feb 08 1995 Relume Technologies, Inc Traffic information system using light emitting diodes
5633801, Oct 11 1995 Fluke Corporation Pulse-based impedance measurement instrument
5633901, Apr 21 1995 KEPCO ENGINEERING & CONSTRUCTION COMPANY, INC Permanent pool cavity seal for nuclear reactor
5699151, Jun 28 1994 Mitsubishi Denki Kabushiki Kaisha Distance measurement device
5714754, Mar 04 1994 Remote zone operation of lighting systems for above-ground enclosed or semi-enclosed parking structures
5760686, Feb 14 1994 Assembly and method for detecting errant vehicles and warning work zone personnel thereof
5760887, Apr 30 1996 Raytheon Company Multi-pulse, multi-return, modal range processing for clutter rejection
5764163, Sep 21 1995 Electronics & Space Corporation Non-imaging electro-optic vehicle sensor apparatus utilizing variance in reflectance
5777564, Jun 06 1996 Traffic signal system and method
5805468, May 09 1995 Sick AG Method and apparatus for determining the light transit time over a measurement path arranged between a measuring apparatus and a reflecting object
5812249, Sep 26 1996 ENVIROTEST SYSTEMS HOLDINGS CORP Speed and acceleration monitoring device using visible laser beams
5828320, Sep 26 1997 TRIGG PROPERTIES, LLC Vehicle overheight detector device and method
5838116, Apr 15 1996 Technical Consumer Products, Inc Fluorescent light ballast with information transmission circuitry
5852491, May 20 1996 Olympus Optical Co., Ltd. Distance measuring apparatus
5889477, Mar 25 1996 Sirius XM Connected Vehicle Services Inc Process and system for ascertaining traffic conditions using stationary data collection devices
5896190, Nov 23 1992 WELLS FARGO BANK, NATIONAL ASSOCIATION, AS ADMINISTRATIVE AGENT Intelligent vehicle highway system sensor and method
5933225, Aug 12 1997 Mitsubishi Denki Kabushiki Kaisha Vehicular optical radar apparatus
5942753, Mar 12 1997 ENVIROTEST SYSTEMS HOLDINGS CORP Infrared remote sensing device and system for checking vehicle brake condition
5987395, Jun 17 1996 Bayerische Motoren Werke Aktiengesellschaft Process for measuring the distance between a motor vehicle and an object
5995900, Jan 24 1997 Northrop Grumman Systems Corporation Infrared traffic sensor with feature curve generation
6044336, Jul 13 1998 Northrop Grumman Systems Corporation Method and apparatus for situationally adaptive processing in echo-location systems operating in non-Gaussian environments
6094159, Feb 07 1998 ITT Manufacturing Enterprises, Inc Process for measuring distance with adaptive amplification
6100539, Jan 20 1997 Sick AG Light sensor with evaluation of the light transit time
6104314, Feb 10 1998 Automatic parking apparatus
6107942, Feb 03 1999 Premier Management Partners, Inc. Parking guidance and management system
6115112, Mar 07 1996 Spectra Precision AB Electronic distance measuring instrument
6115113, Dec 02 1998 Lockheed Martin Corporation Method for increasing single-pulse range resolution
6142702, Nov 25 1998 Parking space security and status indicator system
6147624, Jan 31 2000 Intel Corporation Method and apparatus for parking management system for locating available parking space
6166645, Jan 13 1999 Road surface friction detector and method for vehicles
6252655, Jul 07 1997 Nikon Corporation Distance measuring apparatus
6259515, Feb 07 1998 VALEO Schalter und Sensoren GmbH Evaluation concept for distance measuring processes
6259862, Apr 11 1995 Eastman Kodak Company Red-eye reduction using multiple function light source
6266609, Dec 02 1998 DDG Gesellschaft fur Verkehrsdaten mbH Parking space detection
6285297, May 03 1999 Determining the availability of parking spaces
6340935, Feb 05 1999 Computerized parking facility management system
6377167, Jul 22 1997 AUTOSENSE LLC Multi frequency photoelectric detection system
6404506, Mar 09 1998 Regents of the University of California, The Non-intrusive laser-based system for detecting objects moving across a planar surface
6411221, Feb 27 1997 Device and method to detect an object in a given area, especially vehicles, for the purpose of traffic control
6417783, Feb 05 1997 Siemens Aktiengesellschaft Motor vehicle detector
6426708, Jun 30 2001 Koninklijke Philips Electronics N.V. Smart parking advisor
6502011, Jul 30 1999 ROBOTIC PARKING, INC ; ROBOTIC TECHNOLOGY ADMINISTRATION, LLC Method and apparatus for presenting and managing information in an automated parking structure
6502053, Jun 12 2000 Larry, Hardin Combination passive and active speed detection system
6516286, Apr 04 2000 Leica Geosystems AG Method for measuring the distance to at least one target
6548967, Aug 26 1997 PHILIPS LIGHTING NORTH AMERICA CORPORATION Universal lighting network methods and systems
6556916, Sep 27 2001 ZIONS BANCORPORATION, N A DBA ZIONS FIRST NATIONAL BANK System and method for identification of traffic lane positions
6559776, Feb 15 2001 Parking status control system and method
6587185, Jun 30 1999 Minolta Co., Ltd. Distance measuring apparatus
6606054, Jun 07 2001 Mitsubishi Denki Kabushiki Kaisha Pulse radar apparatus
6642854, Jun 14 2000 Electronic car park management system
6650403, Apr 06 2001 Mitsubishi Denki Kabushiki Kaisha Distance measuring device for a vehicle
6657704, Jun 11 2001 Denso Corporation Distance measurement apparatus
6665057, Mar 27 2001 HELLA KG HUECK & CO Method for distance measurement for vehicles by measuring transit time of laser pulses
6665250, Oct 29 1999 Matsushita Electric Industrial Co., Ltd. Optical disc playback and playback method
6665621, Nov 28 2000 OMRON SCIENTIFIC TECHNOLOGIES, INC System and method for waveform processing
6710859,
6753766, Mar 07 2001 1138037 Ontario Ltd. ("Alirt") Detecting device and method of using same
6753950, Jan 26 2000 Instro Precision Limited Optical distance measurement
6765495, Jun 07 2000 HRL Laboratories, LLC Inter vehicle communication system
6771185, Feb 03 1999 Parking guidance and management system
6794831, Apr 14 1999 PHILIPS LIGHTING HOLDING B V Non-flickering illumination based communication
6825778, Oct 21 2002 International Road Dynamics Inc. Variable speed limit system
6829043, Apr 15 2002 Robert Bosch Company Limited Distance measurement device with short distance optics
6831576, Nov 13 2002 Robert Bosch GmbH A/D converter with improved resolution by sampling a superposed signal
6836317, May 19 1998 Method for optically measuring distance
6842231, Sep 30 2002 Raytheon Company Method for improved range accuracy in laser range finders
6850156, Nov 15 1999 Donnelly Corporation Anti-collision safety system for vehicle
6885311, Feb 07 2001 INTERCOMP, S P A Parking management systems
6885312, May 28 2002 Bellsouth Intellectual Property Corporation Method and system for mapping vehicle parking
6897465, Jun 22 2000 Ford Global Technologies, LLC System and method for determining a distance of an object using emitted light pulses
6917307, May 08 2003 COLIGEN CORP Management method and system for a parking lot
6927700, Jan 04 2000 Method and apparatus for detection and remote notification of vehicle parking space availability data
6946974, Aug 28 1999 OPEN PARKING, LLC Web-based systems and methods for internet communication of substantially real-time parking data
6989781, May 04 2002 Robert Bosch GmbH Short-range radar system with variable pulse duration
7023531, Aug 09 2002 Hilti Aktiengesellschaft; Jenoptik Laser, Optik, Systeme GmbH Laser distance measuring device with phase delay measurement
7026954, Jun 10 2003 Bellsouth Intellectual Property Corporation Automated parking director systems and related methods
7068214, Feb 19 2003 Fujitsu Ten Limited Radar
7081832, Apr 25 2003 INTERPARK LLC Method and apparatus for obtaining data regarding a parking location
7106214, Apr 06 2004 Apparatus and method of finding an unoccupied parking space in a parking lot
7116246, Oct 03 2001 Apparatus and method for sensing the occupancy status of parking spaces in a parking lot
7119674, May 22 2003 NEOLOGY, INC Automated site security, monitoring and access control system
7119715, Mar 31 2004 Honda Motor Co., Ltd. Parking lot attendant robot system
7123166, Oct 08 2004 Method for managing a parking lot
7135991, Jun 10 2003 BellSouth Intellectual Property Automated parking director systems and related methods
7148813, Mar 20 2003 Gentex Corporation Light emitting traffic sign having vehicle sensing capabilities
7177014, Jun 15 2004 Hokuyo Automatic Co., Ltd. Light wave distance measuring apparatus
7221271, Oct 31 2002 Device for controlling lighting for the interiors of automotive vehicles and method for controlling said device
7236102, Apr 15 2004 Denso Corporation Vehicle information system for a loop intersection
7250605, Mar 21 2005 Tyco Fire & Security GmbH Passive infra-red detectors
7253747, Sep 11 2003 LAPIS SEMICONDUCTOR CO , LTD Parking lot management system using wireless LAN system
7317384, May 07 2003 Peugeot Citroen Automobiles SA Optical exploration device and vehicle comprising said device
7321317, Nov 07 2003 Nattel Group, Inc. Method for intelligent parking/pollution and surveillance control system
7350945, Jan 09 2004 Valeo Vision System and method of detecting driving conditions for a motor vehicle
7352972, Jan 02 1997 CONVERGENCE WIRELESS, INC Method and apparatus for the zonal transmission of data using building lighting fixtures
7405676, Sep 10 2004 GATSOMETER B V Method and system for detecting with laser the passage by a vehicle of a point for monitoring on a road
7417718, Oct 28 2005 Sharp Kabushiki Kaisha Optical distance measuring apparatus
7426450, Jan 10 2003 ZIONS BANCORPORATION, N A DBA ZIONS FIRST NATIONAL BANK Systems and methods for monitoring speed
7486204, Feb 23 2005 Warning alert system and method for pedestrians
7573400, Oct 31 2005 ZIONS BANCORPORATION, N A DBA ZIONS FIRST NATIONAL BANK Systems and methods for configuring intersection detection zones
7957900, Feb 08 2008 Tracking vehicle locations in a parking lot for definitive display on a GUI
8310655, Dec 21 2007 LeddarTech inc. Detection and ranging methods and systems
8619241, Dec 21 2007 LEDDARTECH INC Distance detection method and system
20010024271,
20030154017,
20030189500,
20040035620,
20040083035,
20040135992,
20040233416,
20050046597,
20050117364,
20050187701,
20050225478,
20050231384,
20050269481,
20050270175,
20060033641,
20060072099,
20060145824,
20060147089,
20060149472,
20060180670,
20060192938,
20060274545,
20070018106,
20070024841,
20070061192,
20070091294,
20070096943,
20070097349,
20070187573,
20070205918,
20070222639,
20070228262,
20070255525,
20080006762,
20080046150,
20090059201,
20090102699,
20090119044,
20090251680,
20090299631,
20110134249,
20110301914,
CA2527895,
CA2710212,
DE102004035856,
DE102006025020,
DE102009013841,
DE19604338,
DE202008007078,
DE4133196,
EP318260,
EP424097,
EP476562,
EP494815,
EP612049,
EP779990,
EP784302,
EP789342,
EP798684,
EP838695,
EP866434,
EP912970,
EP935764,
EP988624,
EP1034522,
EP1048961,
EP1049064,
EP1188067,
EP1224632,
EP1296302,
EP1435036,
EP1521226,
EP1611458,
EP1832897,
EP1997090,
EP2136550,
FR2690519,
GB2264411,
GB2354898,
GB2431498,
GB2445767,
JP10170652,
JP10171497,
JP11101637,
JP2000149161,
JP2002059608,
JP2002181934,
JP2002372578,
JP2004102889,
JP2004538491,
JP2005170184,
JP2005300233,
JP2005331468,
JP2006172210,
JP2006226931,
JP2006521536,
JP2007121116,
JP2007132848,
JP2007248227,
JP2010538303,
JP2014194950,
JP2016121676,
JP4145390,
JP4145391,
JP4172285,
JP7280940,
JP7333339,
JP912723,
JP9178786,
JP9222476,
WO139153,
WO2057714,
WO215334,
WO3007269,
WO2004100103,
WO2005008271,
WO2006044758,
WO2006061572,
WO2006092659,
WO2007026779,
WO2007071032,
WO2007096814,
WO2008037049,
WO2008154737,
WO2009013739,
WO2009079789,
WO2009087536,
WO2009104955,
WO2009117197,
WO8705138,
WO9203808,
WO9634252,
WO2005008271,
WO9107672,
/////
Executed onAssignorAssigneeConveyanceFrameReelDoc
Dec 05 2012MIMEAULT, YVAN LEDDARTECH INC ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0526640651 pdf
Jun 19 2018LeddarTech inc.(assignment on the face of the patent)
Jan 23 2020LEDDARTECH INC FEDERATION DES CAISSES DESJARDINS DU QUEBECSECURITY CONFIRMATION AGREEMENT0539800942 pdf
Jan 30 2020LEDDARTECH INC INVESTISSEMENT QUÉBECSECURITY INTEREST SEE DOCUMENT FOR DETAILS 0517130622 pdf
Feb 05 2021LEDDARTECH INC INVESTISSEMENT QUÉBECSECURITY INTEREST SEE DOCUMENT FOR DETAILS 0552440208 pdf
Date Maintenance Fee Events
Jun 19 2018BIG: Entity status set to Undiscounted (note the period is included in the code).
Jun 26 2018SMAL: Entity status set to Small.


Date Maintenance Schedule
Dec 20 20254 years fee payment window open
Jun 20 20266 months grace period start (w surcharge)
Dec 20 2026patent expiry (for year 4)
Dec 20 20282 years to revive unintentionally abandoned end. (for year 4)
Dec 20 20298 years fee payment window open
Jun 20 20306 months grace period start (w surcharge)
Dec 20 2030patent expiry (for year 8)
Dec 20 20322 years to revive unintentionally abandoned end. (for year 8)
Dec 20 203312 years fee payment window open
Jun 20 20346 months grace period start (w surcharge)
Dec 20 2034patent expiry (for year 12)
Dec 20 20362 years to revive unintentionally abandoned end. (for year 12)