A method for detecting a narrow road includes calculating relative heights of points from a distance measuring sensor to a ground based on distance information. A left boundary point and a right boundary point, at which a difference in relative heights from adjacent points becomes maximal, are acquired. A road boundary line of a driving road is acquired based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle when a difference in relative heights at the left boundary point and the right boundary point is more than or equal to a reference value. A road width of the driving road is calculated based on the road boundary line. It is detected whether the driving road of the vehicle is a narrow road based on the road width.

Patent
   RE47834
Priority
Nov 22 2013
Filed
Jul 20 2017
Issued
Feb 04 2020
Expiry
Oct 20 2034
Assg.orig
Entity
Large
0
24
currently ok
0. 21. A method for detecting road boundaries, comprising:
receiving, from a distance measuring sensor, distance information of points on a ground line at which a vertical surface in a driving direction of a vehicle meets a ground;
calculating a relative height of the points from the distance measuring sensor to the ground based on the distance information;
acquiring a left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points becomes maximal; and
acquiring a road boundary line of a driving road of the vehicle based on the left boundary point and the right boundary point depending on a movement trajectory of the, vehicle when a difference in relative heights at the left boundary point and the right boundary point is more than or equal to a reference value,
wherein the left boundary point and the right boundary point are points that divides the driving road from a region out of the driving road,
wherein the reference value is a reference determining whether the driving road protrudes, and
wherein the acquiring of the road boundary line includes:
transforming coordinates of the left boundary point and the right boundary point in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle; and
generating the road boundary line by connecting the coordinates of the left boundary point and connecting the coordinates of the right boundary point in the global coordinate system.
0. 28. An apparatus for detecting a narrow road, comprising:
a processor; and
a memory in which at least one instruction to be executed by the processor is stored,
wherein, when the at least one instruction is executed by the processor, the processor is configured to:
calculate relative heights of points from a distance measuring sensor to a ground based on distance information of the points on a ground line at which a vertical surface in a driving direction of a vehicle received from the distance measuring sensor meets the ground;
acquire a left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points is maximal and determine whether the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to a reference value; and
acquire a road boundary line of a driving road of the vehicle based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle,
wherein the left boundary point and the right boundary point are points that divide the driving road from a region out of the driving road, and
wherein the reference value is a reference determining whether the driving road protrudes, and
wherein the processor is configured to transform coordinates of the left boundary point and the right boundary point in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle and generate the road boundary line in the global coordinate system.
1. A method for detecting a narrow road, comprising:
receiving, from a distance measuring sensor, distance information of points on a ground line at which a vertical surface in a driving direction of vehicle meets a ground;
calculating a relative height of the points from the distance measuring sensor to the ground based on the distance information;
acquiring a plurality of left boundary point points and a plurality of right boundary point points at which a difference in relative heights from adjacent points among the points becomes maximal;
acquiring a road boundary line lines of a driving road of the vehicle based on the left boundary point points and the right boundary point points depending on a movement trajectory of the vehicle when a difference in relative heights at one of the left boundary point points and one of the right boundary point points is more than or equal to a reference value;
calculating a road width of the driving road based on the acquired road boundary line lines of the driving road; and
determining that the driving road of the vehicle is a narrow road when the road width of the driving road is less than or equal to a reference road width,
wherein the acquiring of the road boundary lines includes:
transforming coordinates of the left boundary points and the right boundary points in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle; and
generating the road boundary lines by connecting the coordinates of the left boundary points and connecting the coordinates of the right boundary points in the global coordinate system.
0. 27. A non-transitory computer readable recording medium, comprising computer executable instructions which, when executed by a processor, cause the processor to perform a method comprising:
receiving, from a distance measuring sensor, distance information of points on a ground line at which a vertical surface in a driving direction of a vehicle meets a ground;
calculating a relative height of the points from the distance measuring sensor to the ground based on the distance information;
acquiring a left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points becomes maximal; and
acquiring a road boundary line of a driving road of the vehicle based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle when a difference in relative heights at the left boundary point and the right boundary point is more than or equal to a reference value,
wherein the left boundary point and the right boundary point are points that divides the driving road from a region out of the driving road, and
wherein the reference value is a reference determining whether the driving road protrudes,
wherein the acquiring of the road boundary line includes:
transforming coordinates of the left boundary point and the right boundary point in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle; and
generating the road boundary line by connecting the coordinates of the left boundary point and connecting the coordinates of the right boundary point in the global coordinate system.
10. An apparatus for detecting a narrow road, comprising:
a processor; and
a memory in which at least one instruction to be executed by the processor is stored,
wherein, when the at least one instruction is executed by the processor, the processor is configured to:
a relative height calculation unit configured to calculate relative heights of points from a distance measuring sensor to a ground based on distance information of the points on a ground line at which a vertical surface in a driving direction of a vehicle received from the distance measuring sensor meets the ground;
a protruding determination unit configured to acquire a left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points is maximal and determine whether the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to a reference value;
a road boundary line acquisition unit configured to acquire a road boundary line of a driving road of the vehicle based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle;
a road width calculation unit configured to calculate a road width of the driving road based on the acquired road boundary line of the driving road; and
a narrow road detection unit configured to determine whether the road width of the driving road is less than or equal to a reference road width and detect that the driving road of the vehicle is a narrow road when the road width of the driving road is less than or equal to the reference road width,
wherein the processor is further configured to transform coordinates of the left boundary point and the right boundary point in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle and generate the road boundary line in the global coordinate system.
2. The method of claim 1, further comprising:
receiving a moving speed of the vehicle and steering information of the vehicle; and
calculating the movement trajectory of the vehicle based on the moving speed of the vehicle and the steering information of the vehicle.
3. The method of claim 2, wherein the calculating of the movement trajectory of the vehicle includes:
acquiring a position and a heading angle of the vehicle over time, based on the moving speed of the vehicle and the steering information of the vehicle; and
calculating the movement trajectory of the vehicle based on the position and heading angle of the vehicle over time.
4. The method of claim 1, wherein the calculating of the relative height includes calculating the relative height of the points from the distance measuring sensor to the ground based on a mounting height and a mounting angle of the distance measuring sensor and the distance information.
0. 5. The method of claim 1, wherein the acquiring of the road boundary line includes:
transforming coordinates of the left boundary point and the right boundary point in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle; and
generating the road boundary line by connecting the coordinates of the left boundary point and connecting the coordinates of the right boundary point in the global coordinate system.
6. The method of claim 1, wherein the road width is a minimum distance between the a left boundary line and the a right boundary line of the road boundary line lines.
7. The method of claim 1, further comprising:
informing a driver of the vehicle that a driving section is a narrow road section, when the narrow road is detected.
8. The method of claim 1, further comprising:
displaying a road shape of the detected narrow driving road of the vehicle based on the road boundary line lines, when the driving road of the vehicle is determined as the narrow road is detected.
9. A non-transitory computer readable recording medium, comprising computer executable instructions which control, when exeucted by a processor, cause the processor to perform the a method of claim 1 comprising:
receiving, from a distance measuring sensor, distance information of points on a ground line at which a vertical surface in a driving direction of a vehicle meets a ground;
calculating a relative height of the points from the distance measuring sensor to the ground based on the distance information;
acquiring a plurality of left boundary points and a plurality of right boundary points at which a difference in relative heights from adjacent points among the points becomes maximal;
acquiring road boundary lines of a driving road of the vehicle based on the left boundary points and the right boundary points depending on a movement trajectory of the vehicle when a difference in relative heights at one of the left boundary points and one of the right boundary points is more than or equal to a reference value;
calculating a road width of the driving road based on the acquired road boundary lines of the driving road; and
determining that the driving road of the vehicle is a narrow road when the road width of the driving road is less than or equal to a reference road width,
wherein the acquiring of the road boundary lines includes:
transforming coordinates of the left boundary points and the right boundary points in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle; and
generating the road boundary lines by connecting the coordinates of the left boundary points and connecting the coordinates of the right boundary points in the global coordinate system.
11. The apparatus of claim 10, further comprising wherein the processor is further configured to:
a movement trajectory modeling unit configured to calculate the movement trajectory of the vehicle based on a moving speed of the vehicle and steering information of the vehicle, and
wherein the movement trajectory modeling unit calculates calculate the movement trajectory of the vehicle when the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to a reference value.
12. The apparatus of claim 11, wherein the movement trajectory modeling unit processor is further configured to receive the moving speed of the vehicle and the steering information of the vehicle from a speed detection apparatus and a steering information detection apparatus, acquire a position and a heading angle of the vehicle over time based on the moving speed and the steering information, and calculate the movement trajectory of the vehicle based on the position and heading angle of the vehicle over time.
13. The apparatus of claim 10, wherein the relative height calculation unit processor is further configured to calculate the relative height of the points from the distance measuring sensor to the ground based on a mounting height and a mounting angle of the distance measuring sensor and the distance information.
0. 14. The apparatus of claim 10, wherein the road boundary line acquisition unit is configured to transform coordinates of the left boundary point and the right boundary point in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle and generates the road boundary line in the global coordinate system.
15. The apparatus of claim 10, wherein the road width is a minimum distance between the a left boundary line and the a right boundary line of the road boundary line.
16. The apparatus of claim 10, wherein the narrow road detection unit processor is further configured to inform a driver of the vehicle that a driving section is a narrow road section when the narrow road is detected.
17. The apparatus of claim 10, wherein the narrow detection unit processor is further configured to display a road shape of the detected narrow road based on the road boundary line when the narrow road is detected.
0. 18. A system for detecting a narrow road, comprising:
a speed output apparatus configured to output a moving speed of a vehicle;
a steering information output apparatus configured to output steering information of the vehicle;
a distance measuring sensor configured to output distance information of points on a ground line at which a vertical surface in a driving direction of the vehicle meets a ground; and
an apparatus for detecting a narrow road configured to receive the distance information of the points from the distance measuring sensor, calculate relative heights of the points from the distance measuring sensor to the ground based on the distance information, acquire a left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points becomes maximal, acquire a road boundary line of a driving road of the vehicle based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle when the difference in relative heights at the left boundary point and the right boundary point is more than or equal to a reference value, calculate a road width of the driving road based on the acquired road boundary line of the driving road, and detect that the driving road of the vehicle is a narrow road when the road width of the driving road is less than or equal to a reference road width.
19. The method of claim 1, wherein the distance information includes a distance from the distance measuring sensor to the points on the ground line and an angle between a line segment connecting the distance measuring sensor and the points on the ground line and a reference line of the distance measuring sensor.
20. The apparatus of claim 10, wherein the distance information includes a distance from the distance measuring sensor to the points on the ground line and an angle between a line segment connecting the distance measuring sensor and the points on the ground line and a reference line of the distance measuring sensor.
0. 22. The method of claim 21, further comprising:
receiving a moving speed of the vehicle and steering information of the vehicle; and
calculating the movement trajectory of the vehicle based on the moving speed of the vehicle and the steering information of the vehicle.
0. 23. The method of claim 22, wherein the calculating of the movement trajectory of the vehicle includes:
acquiring a position and a heading angle of the vehicle over time, based on the moving speed of the vehicle and the steering information of the vehicle; and
calculating the movement trajectory of the vehicle based on the position and heading angle of the vehicle over time.
0. 24. The method of claim 21, wherein the calculating of the relative height includes calculating the relative height of the points from the distance measuring sensor to the ground based on a mounting height and a mounting angle of the distance measuring sensor and the distance information.
0. 25. The method of claim 21, wherein the reference value is a maximum height which allows a vehicle to go up and down without damaging the vehicle.
0. 26. The method of claim 21, wherein the reference value is calculated based on the heights of components of the vehicle.
0. 29. The apparatus of claim 28, wherein the processor is further configured to:
calculate the movement trajectory of the vehicle based on a moving speed of the vehicle and steering information of the vehicle, and
calculate the movement trajectory of the vehicle when the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to a reference value.
0. 30. The apparatus of claim 29, wherein the processor is further configured to receive the moving speed of the vehicle and the steering information of the vehicle from a speed detection apparatus and a steering information detection apparatus, acquire a position and a heading angle of the vehicle over time based on the moving speed and the steering information, and calculate the movement trajectory of the vehicle based on the position and heading angle of the vehicle over time.
0. 31. The apparatus of claim 28, wherein the processor is further configured to calculate the relative height of the points from the distance measuring sensor to the ground based on a mounting height and a mounting angle of the distance measuring sensor and the distance information.
0. 32. The apparatus of claim 28, wherein the reference value is a maximum height which allows a vehicle to go up and down without damaging the vehicle.
0. 33. The apparatus of claim 28, wherein the reference value is calculated based on the heights of components of the vehicle.

In the above Equation 1, hi represents the relative heights of the points on the ground detected by the distance measuring sensor 210, ri represents the distance from the distance measuring sensor 210 to the points on the ground line, θi represents an angle between the line segment connecting the distance measuring sensor 210 to the points on the ground line and the reference line of the distance measuring sensor 210, and α represents the mounting angle of the distance measuring sensor 210 which is mounted in the vehicle 10.

As described above, the relative height calculation unit 110 may calculate the relative height hi of the points on the ground line based on the distance information (ri, θi) of the points on the ground line detected by the distance measuring sensor 210.

FIGS. 4A and 4B are reference diagrams for describing an operation of acquiring the left boundary point and the right boundary point in the apparatus or the system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.

FIG. 4A represents the distance information of the points 31 on the ground line detected by the distance measuring sensor 210 of the vehicle in the narrow road and the relative heights of the points 31 on the ground line calculated by the relative height calculation unit 110. Referring to FIG. 4A, the distance information of the points on the ground line detected by the distance measuring sensor 210 of the vehicle may be represented by (rk+1, θk+1), (rk, θk), . . . , (ri, θi), . . . , (rj, θj), (rj+1, θj+1) . . . . .

Based on the distance information, the relative height calculation unit 110 may calculate the relative heights of the points on the ground line as hk+1, hk, . . . , hi, . . . , hj, hj+1 . . . . In this case, h0 represents the mounting height h0 of the distance measuring sensor 210.

FIG. 4B is a graph illustrating the difference in the relative heights from the adjacent points of the points 31 on the ground line. A horizontal axis 0 represents the angle between the line segment connecting the distance measuring sensor 210 to the points on the ground line and the reference line of the distance measuring sensor 210 and a vertical axis represents the relative heights.

Compared with the relative heights of the points on the ground line, the points may have a constant height in the driving road which is portion protruding as hk+1, hk, . . . , hi, . . . , hj, hj+1 . . . and the difference in relative heights of the adjacent points at the boundary point of hk+1 and hk and the boundary point of hj and hj+1 may become maximal. Therefore, the protruding determination unit 130 may acquire the left boundary point 41 and the right boundary point 42 at which the relative heights from the adjacent points among the points on the ground line become maximal.

The protruding determination unit 120 may determine whether the difference in the relative height at the left boundary point and the right boundary point is more than or equal to the reference value. That is, when the difference between the hk+1 and hk and the difference between hj and hj+1 are larger than the reference value hc, the apparatus 100 for detecting a narrow road continuously may detect the narrow road. On the other hand, when the difference between the hk+1 and hk and the difference between hj and hj+1 is less than the reference value hc, the apparatus 100 for detecting a narrow road may end the detection of the narrow road.

FIG. 5 is a reference diagram for describing an operation of calculating the road width of the driving road in the apparatus or the system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.

At t=k, the position of the vehicle may be represented by Xk=[Xk, Yk, θk] in the global coordinate system. At t=k+1, the position of the vehicle may be represented by Xk+1=[Xk+1, Yk+1, θk+1] in the global coordinate system. As such, the movement trajectory of the vehicle may be represented by the global coordinate system. However, the coordinates of the left boundary point 41 and the right boundary point 42 acquired by the distance measuring sensor 210 may be coordinates of the local coordinate system and therefore there is a need to transform the coordinates of the left boundary point 41 and the right boundary point 42 in the local coordinate system into coordinates in the global coordinate system depending on the movement trajectory of the vehicle.

Therefore, the road boundary line acquisition unit 130 may acquire the coordinates of the left boundary point 41 and the right boundary point 42 in the local coordinate system as (Xl, Yl)k, (Xr, Yr)k and (Xl, Yl)k+1, (Xr, Yr)k+1 which are coordinates in the global coordinate system, based on the movement trajectory of the vehicle.

The road boundary line acquisition unit 130 may transform the coordinates of the left boundary point 41 and the right boundary point 42 into coordinates in the global coordinate system based on the movement trajectory of the vehicle over time and as illustrated in FIG. 5, may generate the road boundary line connecting the coordinates of the left boundary point 41 and the right boundary point 42 in the global coordinate system as illustrated in FIG. 5.

The road width calculation unit 140 may calculate the road width of the driving road which is a minimum distance between a left boundary line 51 and a right boundary line 52 of the road boundary line, based on the road boundary line of the driving road.

FIG. 6 is a flow chart of a method for controlling a driving of a vehicle according to an exemplary embodiment of the present inventive concept. The flow chart illustrated in FIG. 6 may include steps which are processed in time series by the apparatuses 100 and 300 for detecting a narrow road or the systems 200 and 400 for detecting a narrow road illustrated in FIGS. 1 to 5. Therefore, even though omitted hereinafter, the contents described above regarding the apparatuses 100 and 300 for detecting a narrow road or the systems 200 and 400 for detecting a narrow road illustrated in FIGS. 1 to 5 may be applied to the flow chart illustrated in FIG. 6.

In step 610, the apparatus 100 for detecting a narrow road may receive from the distance measuring sensor 210 the distance information of the points on the ground line at which the vertical surface in the driving direction of the vehicle meets the ground. For example, the distance information may include the distance r from the distance measuring sensor 210 to the points on the ground line and the angle θ between the line segment connecting the distance measuring sensor 210 and the points on the ground line and the reference line of the distance measuring sensor 210.

In step 620, the relative height calculation unit 110 may calculate the relative heights of the points on the ground line based on the distance information. The relative height represents the distance from the distance measuring sensor 210 to the ground.

In step 630, the protruding determination unit 120 may acquire the left boundary point and the right boundary point at which the difference in the relative height from the adjacent points among the points on the ground line becomes maximal. In this case, the left boundary point and the right boundary point may be the boundary point which divides the driving road from the region out of the driving road.

In step 640, the protruding determination unit 120 may determine whether the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to the reference value. The reference value may be a value which is a reference determining whether a driving road protrudes and the reference value may be calculated based on the heights of components of a vehicle or may be acquired based on an experiment. For example, the reference value may be the maximum height which may allow a vehicle to go up and down without damaging the vehicle.

The protruding determination unit 120 may compare the difference in the relative heights at the left boundary point and the right boundary point with the reference value to proceed to step 650 when the difference in the relative heights is more than or equal to the reference value and end the detection of the narrow road when the difference in the relative heights is less than the reference value.

In step 650, the road boundary line acquisition unit 130 may acquire the road boundary line of the driving road of the vehicle based on the left boundary point and the right boundary point depending on the movement trajectory of the vehicle.

According to an exemplary embodiment of the present inventive concept, the movement trajectory of the vehicle may be received from external apparatuses. According to another exemplary embodiment of the present inventive concept, the movement trajectory of the vehicle may be calculated by the apparatus 100 for detecting a narrow road based on the position of the vehicle.

In step 660, the road width calculation unit 140 may calculate the road width of the driving road based on the road boundary line of the driving road. In this case, the road width may be the minimum distance between the left boundary line and the right boundary line of the road boundary line.

In step 670, the narrow road detection unit 150 may determine whether the road width of the driving road is less than or equal to the reference road width. The narrow road detection unit 150 may compare the road width of the driving road with the reference road width to proceed to step 680 when the road width of the driving road is less than or equal to the reference road width and end the detection of the narrow road when the road width of the driving road exceeds the reference road width.

In step 680, the narrow road detection unit 150 may detect that the driving road of the vehicle is the narrow road. According to an exemplary embodiment of the present inventive concept, when the narrow road is detected, the narrow road detection unit 150 may inform the driver of the vehicle that the driving section is the narrow road section. According to another exemplary embodiment of the present inventive concept, the narrow road detection unit 150 may further display a road shape of the detected narrow road while informing the narrow road section, when the narrow road is detected.

According to the method, apparatus, and system for detecting a narrow road according to exemplary embodiments of the present inventive concept, it is possible to detect the protruding narrow road by using the distance measuring sensor detecting the distance to the ground in front of the vehicle and assure the driver's safety and improve the driver's convenience by informing the narrow road of the user. Therefore, it is possible to reduce the risk of accidents due to the narrow road.

In the present disclosure, ‘one embodiment’ of principles of the present inventive concept and various changes of the expression means that specific features, structures, characteristics, and the like, associated with the embodiment are included in at lease one embodiment of the principle of the present inventive concept. Therefore, the expression ‘one embodiment’ and any other modification examples disclosed throughout the present disclosure do not necessarily mean the same embodiment.

All the embodiments and conditional examples disclosed in the present disclosure are described to help a person having ordinary skilled in the art to which the present inventive concept pertains to understand the principle and concept of the present inventive concept and those skilled in the art may be understood that the present inventive concept may be implemented in a modified form within a range which does not deviating from the essential characteristics of the present inventive concept. Therefore, the Examples described above should be considered in view of illustration rather than limitation. It should be interpreted that the scope of the present inventive concept is defined by the following claims rather than the above-mentioned detailed description and all of differences within a scope equivalent thereto are included in the appended claims of the present inventive concept.

Lee, Chang Jae, Shin, Ki Cheol, Jung, Ee Suk

Patent Priority Assignee Title
Patent Priority Assignee Title
5359666, Sep 28 1988 Honda Giken Kogyo Kabushiki Kaisha Driving way judging device and method
6819407, Feb 08 2002 Omron Corporation Distance measuring apparatus
8750567, Apr 09 2012 GM Global Technology Operations LLC Road structure detection and tracking
8825260, Jul 23 2013 GOOGLE LLC Object and ground segmentation from a sparse one-dimensional range data
9948853, Aug 03 2012 CLARION CO , LTD Camera parameter calculation device, navigation system and camera parameter calculation method
20110238252,
20110320163,
20130032421,
20130184976,
20150019119,
20150222813,
20150332500,
28150019119,
CN103140409,
JP1020130088987,
JP2005326963,
JP2007210458,
JP2011232230,
JP2012071832,
JP2012071833,
JP2012238230,
KR1020110080025,
KR1020130072542,
KR1020130088987,
////
Executed onAssignorAssigneeConveyanceFrameReelDoc
Jul 20 2017Hyundai Motor Company(assignment on the face of the patent)
Jul 20 2017Kia Motors Corporation(assignment on the face of the patent)
May 29 2018Hyundai Motor CompanyHyundai Motor CompanyASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0459400180 pdf
May 29 2018Hyundai Motor CompanyKia Motors CorporationASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS 0459400180 pdf
Date Maintenance Fee Events
Aug 21 2023M1552: Payment of Maintenance Fee, 8th Year, Large Entity.


Date Maintenance Schedule
Feb 04 20234 years fee payment window open
Aug 04 20236 months grace period start (w surcharge)
Feb 04 2024patent expiry (for year 4)
Feb 04 20262 years to revive unintentionally abandoned end. (for year 4)
Feb 04 20278 years fee payment window open
Aug 04 20276 months grace period start (w surcharge)
Feb 04 2028patent expiry (for year 8)
Feb 04 20302 years to revive unintentionally abandoned end. (for year 8)
Feb 04 203112 years fee payment window open
Aug 04 20316 months grace period start (w surcharge)
Feb 04 2032patent expiry (for year 12)
Feb 04 20342 years to revive unintentionally abandoned end. (for year 12)