A method of determining alignment characteristics of a tire and wheel assembly mounted on a vehicle comprises projecting a light plane onto the tire and wheel assembly to form a reference illumination line, receiving a reflected image of the reference illumination line with a photo electric device, and determining a reference distance from the reference illumination line to a noncontact wheel alignment sensor including the photo electric device. The method also includes projecting a plurality of light planes onto the tire and wheel assembly to form a plurality of generally parallel illumination lines, receiving a reflected image of at least some of the generally parallel illumination lines with the photo electric device, and identifying which generally parallel illumination lines are imaged at the receiving step using the reference distance, and determining the orientation of the tire and wheel assembly based on the reflected image of the generally parallel illumination lines.
|
13. A method of determining alignment characteristics of a tire and wheel assembly mounted on a vehicle, said method comprising:
projecting light planes onto a tire and wheel assembly to form a plurality of generally parallel illumination lines and an identifier on a tire of the tire and wheel assembly;
receiving a reflected image of at least some of said generally parallel illumination lines with a photo electric device, with said light planes being projected onto the tire and wheel assembly at a non-parallel angular orientation relative to said photo electric device;
identifying said generally parallel illumination lines imaged at said receiving a reflected image of at least some of said generally parallel illumination lines step based on said identifier; and
determining the orientation of the tire and wheel assembly based on said reflected image of at least some of said generally parallel illumination lines.
20. A method of determining alignment characteristics of a tire and wheel assembly mounted on a vehicle, said method comprising:
projecting a plurality of light planes onto a tire and wheel assembly to form a plurality of generally parallel illumination lines on a tire of the tire and wheel assembly including forming an identifiable gap between a pair of said generally parallel illumination lines;
receiving a reflected image of at least some of said generally parallel illumination lines with a photo electric device, said photo electric device receiving images of said generally parallel illumination lines reflected from the tire including said pair of said generally parallel illumination lines forming said identifiable gap;
resolving the identity of which said generally parallel illumination lines are imaged at said receiving a reflected image of at least some of said generally parallel illumination lines step based on said identifiable gap; and
determining the orientation of the tire and wheel assembly based on said reflected image of at least some of said generally parallel illumination lines.
1. A method of determining alignment characteristics of a tire and wheel assembly mounted on a vehicle, said method comprising:
projecting a light plane onto a tire and wheel assembly to form a reference illumination line on the tire of the tire and wheel assembly;
receiving a reflected image of said reference illumination line from the tire with a photo electric device;
determining a reference distance from said reference illumination line to a noncontact wheel alignment sensor including said photo electric device;
projecting a plurality of light planes onto the tire and wheel assembly to form a plurality of generally parallel illumination lines on the tire of the tire and wheel assembly;
receiving a reflected image of at least some of said generally parallel illumination lines with said photo electric device;
identifying which said generally parallel illumination lines are imaged at said receiving a reflected image of at least some of said generally parallel illumination lines step using said reference distance; and
determining the orientation of the tire and wheel assembly based on said reflected image of at least some of said generally parallel illumination lines.
21. A method of determining alignment characteristics of a tire and wheel assembly mounted on a vehicle, said method comprising:
projecting a plurality of light planes onto a tire and wheel assembly to form a plurality of generally parallel illumination lines on a tire of the tire and wheel assembly including forming one of said generally parallel illumination lines with a width that is different than others of said generally parallel illumination lines;
receiving a reflected image of at least some of said generally parallel illumination lines with a photo electric device, said photo electric device receiving images of said generally parallel illumination lines reflected from the tire including said generally parallel illumination line having a different width;
resolving the identity of which said generally parallel illumination lines are imaged at said receiving a reflected image of at least some of said generally parallel illumination lines step based on said generally parallel illumination line having a different width; and
determining the orientation of the tire and wheel assembly based on said reflected image of at least some of said generally parallel illumination lines.
9. A method of determining alignment characteristics of a tire and wheel assembly mounted on a vehicle, said method comprising:
providing a first sensor and a second sensor, said first sensor being positioned at a location spaced from said second sensor adjacent a wheel of a tire and wheel assembly, said first sensor and said second sensor each including a photo electric device;
projecting a light plane from said first sensor onto the tire and wheel assembly to form a reference illumination line on a first tire portion;
receiving a reflected image of said reference illumination line from said first tire portion with said photo electric device of said first sensor;
determining a first reference distance from said reference illumination line on said first tire portion to said first sensor;
projecting a plurality of light planes from said first sensor onto the tire and wheel assembly to form a plurality of generally parallel illumination lines on said first tire portion;
receiving a reflected image from said first tire portion of at least some of said generally parallel illumination lines with said photo electric device of said first sensor;
identifying which said generally parallel illumination lines on said first tire portion are imaged at said receiving a reflected image from said first tire portion step using said first reference distance;
projecting a light plane from said second sensor onto the tire and wheel assembly to form a reference illumination line on a second tire portion;
receiving a reflected image of said reference illumination line from said second tire portion with said photo electric device of said second sensor;
determining a second reference distance from said reference illumination line on said second tire portion to said second sensor;
projecting a plurality of light planes from said second sensor onto the tire and wheel assembly to form a plurality of generally parallel illumination lines on said second tire portion;
receiving a reflected image of at least some of said generally parallel illumination lines from said second tire portion with said photo electric device of said second sensor;
identifying which said generally parallel illumination lines on said second tire portion are imaged at said receiving a reflected image from said second tire portion step using said second reference distance;
determining the orientation of the tire and wheel assembly based on said reflected images of at least some of said generally parallel illumination lines from said first tire portion and said second tire portion.
2. The method of
3. The method of
4. The method of
5. The method of
6. The method of
7. The method of
8. The method of
10. The method of
11. The method of
wherein said projecting said plurality of light planes from said second sensor onto the tire and wheel assembly to form a plurality of generally parallel illumination lines on said second tire portion comprises divergently projecting said plurality of light planes from said second sensor.
12. The method of
14. The method of
15. The method of claim, wherein said identifier comprises forming one of said generally parallel illumination lines formed on the tire of the tire and wheel assembly with a width that is different than others of said generally parallel illumination lines.
16. The method of
17. The method of
18. The method of
19. The method of
22. The method of
|
The present application is a continuation of U.S. application Ser. No. 12/982,431, filed Dec. 30, 2010, which is a continuation of U.S. application Ser. No. 12/113,300, filed May 1, 2008, now U.S. Pat. No. 7,864,309 issued Jan. 4, 2011, which claims priority of U.S. provisional application Ser. No. 60/916,004 filed May 4, 2007, by De Sloovere et al. for NON CONTACT WHEEL ALIGNMENT SENSOR, which are all hereby incorporated herein by reference in their entireties.
This invention relates to a measurement apparatus for determining the orientation of a three-dimensional object with respect to a reference system, and more particularly, to a measurement system comprising one or more sensors especially adapted for use with vehicle wheels using light beams projected onto a tire and wheel assembly to define a plane of orientation of the wheel with respect to a predetermined orientation.
In the automotive industry, proper vehicle quality requires measurement and adjustment of wheel alignment settings, both during manufacture and subsequently during the useful life of the vehicle. Proper positioning and alignment of vehicle wheels, and especially steerable wheels such as the front wheels of a vehicle, requires the setting of toe, camber angle, and caster angle. Toe is the angle between the vehicle's longitudinal axis and a plane through the center of the wheel/tire and affects the straight-ahead running of the vehicle as well as steering. Camber angle is the inclination of the wheel axis toward the road surface in a vertical plane and is negative when the top of the wheel is inclined toward the center of the vehicle. Caster angle is the tilt of the steering axis parallel to the direction of the vehicle centerline. A tilt toward the rear of the vehicle results in a positive caster angle. During assembly and/or repair of vehicles, it is important to measure, adjust or audit, and set the toe as well as the camber and caster angles of vehicle wheels, and especially steerable wheels, so the vehicle will drive and steer properly.
In the past, various methods have been used to measure toe and camber of vehicle wheels including direct and indirect methods. Direct measurement methods require human operators or mechanisms to place measurement tools in contact with the vehicle and are subject to placement error and wear. Indirect measurement methods, sometimes referred to as noncontact methods, typically include the viewing or sensing of the image of light projected on a tire when mounted on a vehicle and the use of a computer to calculate the tire position from such images to provide the ultimate alignment information. The prior known direct measurement methods were cumbersome, time-consuming, often labor-intensive, and less accurate than desired. Prior non-contact or indirect methods involve projecting one or two light beams at discrete locations on a tire, and receiving and processing reflected images of the light beams from the tire to reconstruct the wheel/tire plane.
Therefore, a need was determined for an apparatus and method for measuring and determining the orientation of a vehicle wheel and, more broadly, any three-dimensional object, which would allow determination of the plane of the wheel or object in a more accurate and robust manner to indicate the position of the wheel/tire with respect to the vehicle center line for purposes of setting the toe and/or camber of the wheel/tire for alignment purposes.
Accordingly, the present invention provides an apparatus and method for determining the orientation of a three-dimensional object and, which in the preferred form is a tire and wheel assembly for which alignment characteristics are desired. The sensors project multiple light beams at a tire and wheel assembly to form multiple generally parallel and horizontal illumination images. Reflected images of some or all of the illumination lines are then received by the sensors. The multiple illumination lines that are projected onto the tire and the position of those lines in the acquired image enable the three dimensional spatial orientation or geometry of the wheel to be calculated.
According to an aspect of the present invention, a method of determining alignment characteristics of a tire and wheel assembly mounted on a vehicle comprises projecting a plurality of light planes from a first light projector onto a tire and wheel assembly to form a plurality of generally parallel illumination lines on a tire of the tire and wheel assembly, receiving a reflected image of at least some of the illumination lines with a photo electric device reflected from the tire at an angle relative to a projecting angle of the first light projector, and determining a plane defined by spatial coordinates from a selected point located on each illumination line imaged by the photo electric device, with the plane representing the orientation of the tire and wheel assembly.
The plurality of light planes projected from the first light projector may be divergently projected. Reflecting devices may be used to project the plurality of light planes and/or to direct the reflected images at the photo electric device. The plurality of light planes may be projected onto only one side of the tire relative to the wheel, or may be simultaneously projected about or on diametrically opposed portions of the tire about the wheel. The photo electric device may repeatedly image that portion of the reflected illumination lines while the tire and wheel assembly is rotating. In which case, for example, the plane may be recalculated for each frame and averaged, or the spatial coordinates of the selected point on each illumination line may be averaged over the repeated frame images to define the plane.
The method of determining alignment characteristics may also include projecting a single light plane from a second light projector onto the tire and wheel assembly to form a single reference illumination line on the tire of the tire and wheel assembly, receiving a reflected image of the reference illumination line from the tire with the photo electric device, and determining a reference distance from the reference illumination line to a noncontact wheel alignment sensor including the first and second light projectors and the photo electric device. With the method further comprising identifying which illumination lines are imaged at the step of receiving a reflected image using the reference distance. According to this aspect, the second light projector is angularly oriented relative to the first light projector.
The method of determining alignment characteristics may still further comprise resolving three dimensional spatial coordinates for multiple points located on each illumination line imaged by the photo electric device and deriving a best fit curve equation for each illumination line, including determining the plane as a best fit tangential plane to the derived curve equations. The method may further include determining a reference point on each illumination line that is closest to a reference plane and subsequently determining a first plane as a best fit plane to the reference points from each illumination line. The method further iteratively determines a plane by first determining the selected point located on each illumination line that is closest to the previously determined plane and then determining a new plane as a best fit plane to the selected point located on each illumination line that is closest to the newly determined plane.
Still further, the method may comprise projecting a plurality of light planes from another light projector onto the tire and wheel assembly to form a plurality of generally parallel second illumination lines on the tire. The illumination lines from the first light projector are spaced from the second illumination lines from the other light projector and a reflected image received by a photo electric device includes at least one illumination line formed by the first light projector and at least one illumination line formed by the other light projector.
According to another aspect of the present invention, a method of determining alignment characteristics of a tire and wheel assembly mounted on a vehicle comprises providing a first noncontact wheel alignment sensor and a second noncontact wheel alignment sensor positioned about a wheel of a tire and wheel assembly, each sensor including a multiline light projector and a camera device. Projecting a plurality of light planes from the multiline light projectors of the first and second sensor onto the tire and wheel assembly to form a plurality of generally parallel illumination lines on a first and a second tire portion, and receiving a reflected image of at least some of the illumination lines from the first tire portion with the camera device of the first sensor and receiving a reflected image of at least some of the illumination lines from the second tire portion with the camera device of the second sensor at angularly offset orientations relative to the multiline light projectors. The method further comprising determining a plane defined by spatial coordinates from a selected point located on each illumination line imaged by the camera devices of the first and second sensors, with the plane representing the orientation of the tire and wheel assembly.
The multiline light projectors of the first and second sensors may divergently project the light planes. Each sensor may also include a single line reference projector, with the method further comprising projecting a single light plane from both single line reference projectors onto the tire and wheel assembly to form a single reference illumination line on the first and second tire portions. The method further includes receiving a reflected image of the single reference illumination lines with the camera devices and determining a reference distance from the single reference illumination line on the first tire portion to the first sensor, and determining a reference distance from the single reference illumination line on the second tire portion to the second sensor. The method may further include repeatedly receiving reflected images with the camera devices of the first and second sensors while the tire and wheel assembly is rotating.
According to another aspect of the present invention, a noncontact wheel alignment sensor for determining alignment characteristics of a tire and wheel assembly mounted on a vehicle includes a first multiline light projector, a camera device, and a processor. The first multiline light projector projects a plurality of light planes onto the tire and wheel assembly to form generally parallel illumination lines on the tire. The camera device receives reflected images of at least some of the illumination lines reflected from the tire at an offset angle relative to a projecting angle of the first multiline light projector. The processor determines a plane defined by spatial coordinates from a selected point located on each illumination line imaged by the camera device, with the plane representing the orientation of the tire and wheel assembly.
According to an aspect of the invention, the multiline light projector may divergently project the plurality of light planes. The sensor may also include a single line reference light projector that projects a single light plane onto the tire and wheel assembly to form a reference illumination line on the tire, with the single line reference light projector being oriented to project at an angle offset from said first multiline light projector. The noncontact wheel alignment sensor may optionally include a second multiline light projector that projects a second plurality of light planes onto the tire and wheel assembly to form a second set of generally parallel illumination lines on the tire. The illumination lines formed by the first multiline light projector are selectively spaced on the tire from the second set of generally parallel illumination lines formed by the second multiline light projector. The sensor may also optionally include reflecting devices to project the light planes toward the tire and/or to reflect images toward the camera device.
The present invention provides significant advantages over prior known apparatus and methods for measuring and calculating the orientation of three dimensional objects such as vehicle wheels for alignment purposes. The non-contact sensors of the present invention project multiple illumination lines onto an object, such as a tire of a tire and wheel assembly, as well as receive reflected images of the illumination lines. From the reflected images, the sensors determine three dimensional spatial coordinates of selected points of the illumination lines on the tire and determine a plane through the determined three dimensional spatial coordinates, which plane represents the orientation of the tire and wheel assembly and from which toe and camber may be calculated, as well as other alignment characteristics. The projection of multiple illumination lines provides an increased number of measuring points and, thus, greater precision in determining the tire and wheel assembly orientation, as well as increases the working field over which the sensor may operate. The projection of multiple light planes also enables the projection angle of the light planes or the viewing angle of the illumination lines on the tire and wheel assembly by the sensor to be increased, which in turn enhances the sensitivity of the sensors. Tire and wheel assembly orientation may be calculated for each illumination line imaged by the sensor, thereby providing redundancy, robustness, and enabling noise reduction. Still further, due to the generally torid shape of tires and the associated determined high points of the illumination lines projected onto the tire sidewall surface, a single image may be used to calculate camber, toe angle, and wheel center position.
These and other objects, advantages, purposes and features of this invention will become apparent upon review of the following specification in conjunction with the drawings.
The present invention will now be described with reference to the accompanying figures, wherein the numbered elements in the following written description correspond to like-numbered elements in the figures. A measurement system or apparatus 50, which in the illustrated embodiment of
As described in more detail below, each sensor 52, with reference to
Sensor processors 68 (
Alternatively, processors 68 may determine three dimensional spatial coordinates for multiple points along each illumination line 64 within the field of view of sensor 52 and derive a curved line equation for each illumination line 64, such as by fitting curves to the illumination lines 64 based on the three dimensional spatial coordinates for each line. A plane tangential to the determined curved line equations represents the toe and camber orientation of the tire and wheel assembly 58 and intersects with the high points of the illumination lines 64. As such, processors 68 may also determine the three dimensional spatial coordinates of the high points of the viewed illumination lines 64 based on the intersection of the determined tangential plane with the determined curved line equations.
Pre-recorded calibration sets, such as described below, may be used to perform the transfer of curve parameters to three dimensional coordinates. Due to the necessarily concentric orientation of the three dimensional spatial high point coordinates, the determined high points define a circle in three dimensions representative of the tire mounted to the wheel. Processors 68 may then further determine the center of the wheel based on a determination of the center point of the determined circle defined by the three dimensional high points of the illumination lines 64. Based on the determined wheel center point further parameters, such as wheel axle geometry parameters may also then be determined. As understood from
The projection and receiving of multiple light planes 62 provides several advantages in the determination of wheel alignment characteristics, including adding greater precision and enlarging the possible working volume of sensor 52 with respect to the field of view and depth of sensor 52. For example, the projection of multiple illumination lines 64 over the left and right tire areas 66a, 66b provides a larger number of measuring points. In addition, the angles made between the projected illumination lines 64 and the sensor 52 view can be kept larger than with other methods that project fewer lines, such as a single line, and the sensitivity is therefore enhanced. Further, the wheel 58 positioning can be calculated for each of the projected illumination lines 64 seen by the sensor 52, thereby providing redundancy, and consequently robustness and noise reduction. Additionally, when the distance between the wheel 58 and sensor 52 is increased, some illumination lines 64 disappear from the field of view, but others enter, thereby keeping functionality over larger depths. Still further, the processing of a single image from sensor 52 can extract enough information to calculate camber angle. Moreover, albeit with lower accuracy, a single image also contains information to extract wheel center position, and toe angle.
Referring now to the embodiment of
Sensors 52 further include an image capture device or photo electric device or digital camera device 76 and a processor 68. Camera device 76 may comprise or include a charged coupled device (CCD) or complementary metal-oxide-semiconductor (CMOS) sensor for receiving the reflected images of illumination lines 64 and converting the images into pixels for analysis by processor 68. Camera device 76 may have a resolution of one megapixel, but may be greater or smaller as desired or required. Camera device 76 may also include a narrow band filter that only permits light to pass into camera 76 having wavelengths approximately equivalent to the wavelengths of light output by light projector 70 and reference light projector 72. Processor 68 is shown as a separate component in
As illustrated in
As understood from
Alternative arrangements for sensors may be employed within the scope of the present invention. For example, the camera device may be angled either upwardly or downwardly with respect to the sensor housing and/or tire and wheel assembly. In such an arrangement the camera may also view the tire and wheel assembly via a reflector or reflecting device, such as a mirror, that is angled to reflect images toward the camera. Similarly, the light projector and/or reference light projector may project images onto a mirror, which in turn projects or reflects the images onto the tire and wheel assembly.
An example of such an alternative sensor is illustrated as sensor 152 in
Sensor 152 includes a light projector 170, reference light projector 172, and camera device 176. Light projector 170 projects images generally vertically upward toward and off of light projector reflector or reflector device 171, which in the illustrated embodiment is formed as a mirror. Those images are, in turn, reflected out of window 180 of housing 178. Reference light projector 172, which is oriented in generally the same manner as reference light projector 72 of sensor 52 and projects out of window 184. Camera device 176 is directed generally vertically downwardly to receive images reflected from the tire and wheel assembly onto and upward from camera reflector or reflector device 177, which in the illustrated embodiment is also a mirror.
Referring now to
Sensor 252 of
A second reflector device 277 directs reflected images from the tire and wheel assembly of the illumination lines and reference illumination line produced by projector 270 and reference projector 272, respectively, at camera 276, with camera 276 being directed generally upward. As illustrated in
Sensor 352 of
Sensors 52, 152, 252, and/or 352 may be constructed by or include components provided by LMI Technologies, Inc., of Delta, British Columbia, Canada. Such components provided by LMI Technologies, Inc. may include light projectors, reference light projectors, camera devices, and processors, as well as software for processing images of reflected illumination lines received by such camera devices. Examples of technology developed, held, licensed, or used by LMI Technologies, Inc. providing dimensional determinations utilizing high speed camera based sensors are disclosed in the following U.S. Pat. Nos. 5,811,827; 5,510,625; 5,362,970, and; 5,164,579.
As illustrated in
The general operation of the sensors will now be described with reference to sensors 52. As noted, reflected images of illumination lines 64 on tire 66 are received by sensor 52. In operation, the images captured by camera device 76 are sent to processor 68 for image processing operations that search for the pixels in the image belonging to a particular illumination line 64. Thus, the processing groups or classifies the pixels per line. The manner in which a particular illumination line 64 is identified in the image is described more fully below. The curved shape of the illumination lines 64 are approximated by polynomials of minimum second order. Once the reflected illumination lines 64 have been identified in the image, their parameters are used to calculate three dimensional spatial coordinates for specific or selected points on the curved illumination lines 64 located on tire 66. In the illustrated embodiment, this processing is performed in the processor 68 of the sensor 52. It should be appreciated, however, that such processing may be done in an alternative system, such as a remote central computer or the like. As also described in detail below, pre-recorded calibration data sets relative to the sensor 52 may be used to perform the transfer of the imaged curve parameters to the three dimensional spatial coordinate system of the curved illumination lines 64 located on tire.
With reference to
A plane 57 may be calculated through the selected high points 55 produced by a single sensor 52 operating to project illumination lines 64 and receive the reflected images thereof on only one side of a tire 66 based on the non-linear, concentric orientation of the high points about the wheel center. However, the use of two sensors 52a, 52b symmetrically located on either side of the tire 66, as shown in
Alternatively, sensor processors 68 may additionally determine three dimensional spatial coordinates of multiple additional points along each illumination line 64 from the reflected image of the illumination line 64 received by the associated camera device 76, such as by triangulation and/or by comparison to pre-recorded calibration data sets relative to the sensor. For example, in addition to determining high points 55 on illumination lines 64, processors 68 may determine three dimensional spatial points on either side of high points 55 or even three dimensional spatial points along the entire illumination line 64, such as based on pixels in camera 76. Separate equations representing each curve in three dimensions may then be derived by fitting a curve to each illumination line 64 on tire 66 utilizing the multiple three dimensional spatial coordinates for each line 64. A determined plane 57 tangential to those curves thus represents the wheel toe and camber. The intersection points of the determined plane 57 with the calculated three dimensional curve equations are also determined by the processor, with the intersection points representing the high points 55 of the illumination lines 64. The high points 55 may be used as previously noted to determine the wheel center point 61 for calculating additional axle geometry including about the vehicle centerline using known techniques.
Operation of one particular embodiment in which multiple three dimensional spatial coordinates are obtained along illumination lines 64 will now be discussed with reference to
Notably, in the operation of
As previously noted, depending upon the position of a sensor 52 relative to a tire and wheel assembly 58, only certain of the illumination lines 64 projected onto the tire 66 will be reflected toward and received by the camera device 76 due to the projection angle 92 of light projector 70. It is necessary to determine which of the illumination lines 64 are imaged by the camera device 76 as this will impact the determination of the spatial location of the selected points of the illumination lines 64 on the tire 66. For example, if light projector 70 projected twenty illumination lines onto a tire 66, it should be appreciated that the distance between sensor 52 and tire 66 would be different depending on whether the first ten or the second ten illumination lines 64 are imaged by the camera device 76.
Further, due to the relatively close grouping or distance between illumination lines 64 on the tire 66, the pixilated image generated by the camera device 76 from the reflected images may create or experience instances in which a pixel associated with a vertically higher illumination line 64 on the tire 66 is imaged in the pixilated image generated by the camera device 76 at a lower position or orientation than pixels belonging to vertically lower illumination lines 64.
Thus, as an initial matter it is necessary to determine or identify which of the illumination lines 64 are being reflected and received by the camera device 76 and to identify groups of pixels associated with or belonging to a received image of the individual illumination lines 64. Non-contact sensor systems employing single lines at discreet locations do not encompass such challenges as there is only a single line to be viewed. Similarly, sensor systems projecting two lines that are sufficiently separated on an object also do not encompass such challenges due to the clear definition of pixel grouping based on the separation.
In embodiments such as that of
Initially, reference light projector 72 is activated such that reference illumination line 74 is generated on tire 66. The reflected image of reference illumination line 74 is received by camera device 76 and processor 68 performs an initial first distance estimation of the distance between sensor 52 and reference illumination line 74 on tire 66. The first distance estimation is performed based on a triangulation calculation at a specific X, Z position (see
In the illustrated embodiment, light planes 62 are projected to form generally uniform illumination lines 64 on tire 66. In an alternative embodiment, illumination lines may be projected to enable identification of the particular illumination lines that are reflected toward and received by a camera device without the use of a reference light projector and reference illumination line. For example, illumination lines may be projected omitting a middle light plane such that a central illumination line on the tire is missing, or two illumination lines may be generated which are in closer proximity to each other than the remaining illumination lines, or an illumination line may be generated which is thicker than the remaining illumination lines, or the like. In this manner a processor may readily discern the identity and the location of the various illumination lines that are reflected toward and received by a camera device using the non-uniformity or irregularity of the illumination lines as a reference. It should be appreciated that, in such an embodiment, a reference light projector may not be required.
In the sensor 352 of
Upon determining which of the illumination lines 64 are reflected toward and imaged by camera device 76, the image of the various reflected illumination lines 64 is scanned to classify the pixels belonging to each reflected image using techniques known in the art. Upon conditioning for noise reduction and filtering, the acquired image is scanned pixel by pixel such that each pixel may be classified or grouped as belonging to or associated with a particular illumination line 64, or alternatively not associated with a reference line, based on its illumination level and on its neighboring pixel. This classification procedure is performed on each image both during measurement, as well as during calibration described below.
Referring now to
During calibration, calibration block 96 is progressively moved away from the sensor 52 in the negative Y direction in accurately known steps. At each known Y position throughout the steps an image is taken of the illumination lines 64 projected onto calibration block 96 (such as shown in
Calculation of the X and Z three dimensional spatial coordinates may be accomplished by calibration in the X-Z direction. Such calibration may be performed, for example, using grid 98 of calibration block 96. As noted, grid 98 includes multiple vertical and horizontal lines or grooves, with grid 98 having a known spacing between the grooves. Calibration may be performed by deactivating light projector 70 and reference light projector 72 and shining an external light onto grid for improved contrast. Camera device 76 is then used to record an image of grid 98 at multiple known Y positions. Processor 68 then identifies the lines of grid 98 and their XZ coordinates in the image. The correspondence between the X and Z image distances of the imaged lines by camera device 76 and the actual known real distances or spacing of the lines on grid 98 is thus calibrated over several known Y positions.
Referring to
Calibration in the above manner of both the Y and X-Z directions thus enables the sensor 52 to output three dimensional spatial absolute XYZ coordinate values. This coordinate system is provided by the grid 98 (X-Z) and by the translation table (Y) used for positioning of calibration block 96. The determined sensor XYZ spatial coordinate system may then be translated or transferred to a vehicle coordinate system by use of, for example, master jigs. Specific measurements on the master jig, and calculations based on those measurements permit the translation or transfer of data from the sensor coordinate system (XYZ) to the vehicle coordinate system.
It should be appreciated that alternative calibration procedures may be employed within the scope of the present invention, including but not limited to use of alternative calibration blocks and mathematical or computational approaches.
The following will now provide a more detailed description of one possible measurement algorithm that may be used during operation of sensors 52 in determining the three dimensional tire and wheel assembly 58 orientation. It should be appreciated, however, that alternative approaches or algorithms may be employed within the scope of the present invention.
During the measurement process, once the illumination lines 64 reflected and received in the camera device 76 have been identified and parameterized in terms of a polynomial fit, any point belonging to the curve can be characterized by its three dimensional spatial absolute (XYZ) coordinates. For example, consider the point (X1,Z1). For each fitted XZ curve belonging to a single projected light plane 62 and for each calibrated Y position, the corresponding Z image coordinate may be calculated for X1. This is performed for every calibrated Y position and a series of YZ coordinates (X=X1) is obtained. A curve fitting, second or third order, is done through these points and a YZ polynomial curve equation is generated. The intersection point of this curve with the Z=Z1 plane may then be calculated, which gives a point with X=X1 and Z=Z1 from which the real Y coordinate is known, that being the distance to the sensor 52 in the Y direction. This point is calculated for each light plane 62 projected by light projector 70 and, correspondingly, each illumination line 64, with its corresponding Y calibration images. The resultant is a set of candidate X1YiZ1 points. Determination of the specific illumination line 64 and corresponding light plane 62 to which these points belong enables a precise determination of the correct measuring coordinate.
Referring back to reference light projector 70 and reference illumination line 74, the distance estimation previously described that is performed via the reference illumination line 74 enables a determination of the actual or real measuring point. Upon determining the correct Y coordinate for a given candidate point the illumination line 64 from which it is reflected may be determined. For that point the real XZ coordinates are calculated based on the XZ calibration. Then, for the other lines in the camera device 76 measuring image the particular illumination line 64 number and thus projected light plane 62 is then known. The process of taking a point X1, Z1 and calculating the X1Y1Z1 three dimensional spatial coordinates may then be repeated, with the projected light plane 62 to which it belongs being known such that there exists only one resulting candidate measuring point.
The distance estimation for the high point is only done once per image, for the high point of the reflected and received illumination line 64 that is the closest to the reflected and received reference illumination line 74 viewed in the camera device 76 image of the first estimation measurement. Once it is determined from which projected light plane 62 and illumination line 64 that point originates, it is known that the reflected and received illumination lines 64 above and below are from the illumination line 64 projections of the sequentially previous and following light planes 62. In this manner the high point of each reflected and received illumination line 64 in the camera device 76 image may be calculated and identified such that the three dimensional spatial coordinates of those points of the illumination lines 64 on the tire 66 can be calculated. Correspondingly, the determined three dimensional spatial high point coordinates allow calculating a best fit plane there through, with the angles of this plane in the vehicle coordinate system directly establishing the camber and toe angles 56, 54.
It should be appreciated that the located high point for a given two dimensional image of an illumination line 64 imaged by the camera device 76 may not necessarily be the physical high point of the tire 66 at the given illumination line 64, but rather may be the point of the tire 66 positioned closest to the camera device 76. For example, if the tire and wheel assembly 58 is substantially perpendicular to sensor 52, such that there is generally no toe angle, the located high point will be the physical high point of the tire 66. However, this will not be the case if a non-zero toe value is present. Therefore, the two dimensional image curves may be rotated over the initial estimated toe value with the resulting new high point of the illumination line 64 recalculated, resulting in a new toe value. After multiple iterations of this process stable toe values will be generated, which values may be considered the actual toe value.
An alternative method to compensate for the discrepancy between a located high point for a given two dimensional image of an illumination line 64 imaged by the camera device 76 and the physical high point of the tire 66 at the given illumination line 64 is by calculating the three dimensional spatial coordinates of multiple selected points belonging to an illumination line 64 and generating three dimensional curve equations. The tangential plane to the three dimensional curve equations may then be calculated, which directly represents the plane through the high points of the tire 66 and may directly yield camber and toe angles 56, 54.
The above provide two alternative techniques for compensating for the discrepancy between a located high point for a given two dimensional image of an illumination line 64 imaged by the camera device 76 and the physical high point of the tire 66 at the given illumination line 64. In the first approach, imaged illumination line 64 high points are determined in two dimensional coordinates, converted to three dimensional coordinates and a plane is calculated fitting through the three dimensional coordinates. In the second approach, the imaged illumination line 64 curves are initially converted to three dimensional coordinates and the tangential plane through them is directly calculated. The second approach does not involve the iterative process of toe estimation and curve rotation whereby an initial or estimated toe is not calculated prior to determining the final toe and camber values. It should be appreciated, however, that such compensation may not necessarily be required depending on the application or specified measurement parameters.
In the case of lasers as light projectors, it should be noted that as laser light is spread over larger areas fewer illumination lines may be projected with the same laser power to get the same light intensity of the laser lines, that is fewer lines may be projected under the same power if the lines are longer and desired to have comparable intensity as a greater number of shorter lines. The accuracy of this approach may, therefore, decrease due to the fewer lines and lower image resolution. However, this approach may be desirable in applications where lower accuracy is acceptable in view of potentially lower cost measuring apparatuses.
Still another alternative measuring apparatus arrangement would be to employ a third sensor oriented to project illumination lines and receive reflected images from the top of the tire, such as a generally twelve o'clock orientation. Such a third sensor may be positioned or arranged horizontally relative to sensors 52a, 52b shown in
Sensors may also employ internal compensation for drift, such as thermal drift, drift occurring as a result of stress relaxation, wavelength drift, or the like. Thermal drift may result as the ambient temperature changes and/or the sensor components generate heat. This thermal instability may influence the light projector, reference light projector, and/or the camera device and affect the measurement precision. One approach to thermal drift compensation is to calibrate the sensors, such as sensors 52, 152, 252, and/or 352, over multiple different temperatures such that the effects of temperature on the sensors over a given range is determined. Sensor temperature may then be monitored during normal operation of sensors in determining wheel alignment, with the temperature based calibration data being applied via interpolation to derive at temperature compensated alignment values.
Another approach to thermal drift compensation may be accomplished by identifying invariants in the illumination line light patterns. These are parameters that, with constant temperature, do not change in the image regardless of the object upon which the sensor is operating. For example, in place of illumination lines comprising a horizontal multi line pattern, an alternative multi line pattern of horizontal and vertical lines may be used, with the intersections of those lines forming the invariants in the system. In an aligned system these invariants are expected to move on a vertical line in the reflected image. A mathematical evaluation may be used to model the instability movement of those intersections via drift, such as thermal drift and permits estimation of the temperature changes causing the instability in this case. In turn, this enables compensation for thermal drift in the measuring apparatus.
An alternative compensation approach may be to deviate a portion of the reflected two dimensional illumination line pattern from one or more of the illumination lines and capture an image of the deviated portion on a reserved CCD element of the camera device. This may be accomplished through an optical system of mirrors and a lens to reflect and deviate the reflected illumination line directly to the camera device. As this optical system is by design fixed, any drift of the deviated illumination line on the CCD of camera device may be attributable to drift, such as thermal drift, of the light projector. The evolution of the deviated portion of the reflected illumination line in relation to the calibrated position is compared such that the drift of the sensor may be dynamically compensated for during the measurement process.
It should be appreciated that alternative arrangements and constructions of sensors from those described above may be employed and still function as intended within the scope of the present invention. For example, a sensor may be constructed whereby either the light projector and/or reference light projector are oriented generally perpendicularly to the tire and wheel assembly with the camera device angled with respect thereto. Further, a light projector and/or a reference light projector may be oriented to project upwards relative to a camera device. A reference light projector may also project more than one light plane or an alternatively shaped light and/or the light projector may project alternatively shaped light relative to the light planes illustrated.
Still further, as noted above, sensors 52 project light beams, which in the illustrated embodiment are light planes 62 forming illumination images disclosed as illumination lines 64. Alternatively, however, other forms of light beams may be projected to create alternative types or forms of illumination images. For example, light beams formed as rays creating dots or spots may be projected, or light beams disclosing geometrical shapes may be projected, such as circles, squares, crosses, ellipses, or the like.
Additionally, although in the above noted measuring system 50 each sensor 52 is disclosed as including a separate processor 68, it should be appreciated that processors may be alternatively arranged. For example, a single processor may be employed, which processor is either located internally of a sensor or externally, such as in a remote central computing system. Still further, a measuring system may be constructed with two light projectors and a single camera device, or a single light projector and two camera devices. In either of these arrangements, one or more reference light projectors may be used, or may even be omitted if the light projector or light projectors are constructed to project a non-regular pattern as described above.
Sensors 52 are described above as used for determining tire and wheel assembly 58 alignment characteristics. It should also be appreciated, however, that sensors 52 may be employed for measuring or determining alternative parameters in applications where, for example, lines projected on the measurement object generate a line profile that permits extraction of specific points via the reflected line such that the three dimensional spatial coordinates for these points may be determined. One example of such an alternative application is measuring vehicle fender height. The multiple projected and reflected illumination lines permit three dimensional spatial calculation of multiple points on the vehicle fender. Each projected and reflected illumination line will show a specific falloff point on the fender and the determined curve through those points describes the fender with the highest point of the curve equating to the height of the vehicle fender.
The non-contact sensors of the present measurement system invention project multiple illumination lines onto an object, such as a tire of a tire and wheel assembly, as well as receive reflected images of the illumination lines. From the reflected images, the sensors determine three dimensional spatial coordinates of selected points of the illumination lines on the tire and determine a plane through the determined three dimensional spatial coordinates, which plane represents the orientation of the tire and wheel assembly and from which toe and camber may be calculated, as well as other alignment characteristics. The projection of multiple illumination lines provides greater precision in determining the tire and wheel assembly orientation, such as by providing an increased number of measuring points, and increases the working field over which the sensor may operate. In addition, the projection of multiple light planes enables the projection angle of the light planes to be increased, which in turn enhances the sensitivity of the sensors. Tire and wheel assembly orientation may be calculated for each illumination line imaged by the sensor, thereby providing redundancy, robustness, and enabling noise reduction. Still further, due to the generally torid shape of tires and the associated determined high points of the illumination lines projected onto the tire sidewall surface, a single image may be used to calculate camber, toe angle, and wheel center position.
Changes and modifications in the specifically described embodiments can be carried out without departing from the principles of the present invention which is intended to be limited only by the scope of the appended claims, as interpreted according to the principles of patent law including the doctrine of equivalents.
Beghuin, Didier, De Sloovere, Kris, Verhaert, Koen
Patent | Priority | Assignee | Title |
10089738, | Aug 30 2016 | Microsoft Technology Licensing, LLC | Temperature compensation for structured light depth imaging system |
10435052, | Feb 22 2017 | TETRA TECH, INC | Broken wheel detection system |
10551180, | Sep 30 2016 | Burke E. Porter Marchinery Company | Wheel alignment measurement method and system for vehicle wheels |
10723373, | Feb 22 2017 | TETRA TECH, INC | Broken wheel detection system |
10803573, | Jun 16 2015 | South China University of Technology | Method for automated detection of defects in cast wheel products |
11142230, | Feb 22 2017 | TETRA TECH, INC. | Broken wheel detection system |
11243074, | Apr 30 2018 | BPG Sales and Technology Investments, LLC | Vehicle alignment and sensor calibration system |
11597091, | Apr 30 2018 | BPG Sales and Technology Investments, LLC | Robotic target alignment for vehicle sensor calibration |
11624608, | Apr 30 2018 | BPG Sales and Technology Investments, LLC | Vehicular alignment for sensor calibration |
11781860, | Apr 30 2018 | BPG Sales and Technology Investments, LLC | Mobile vehicular alignment for sensor calibration |
11835646, | Apr 30 2018 | BPG Sales and Technology Investments, LLC | Target alignment for vehicle sensor calibration |
11953315, | Sep 30 2019 | Mazda Motor Corporation | Vehicle wheel assembly position measurement method and apparatus thereof |
8490290, | Sep 28 2005 | Hunter Engineering Company | Vehicle service system optical target assembly calibration |
9665793, | Mar 15 2013 | Hunter Engineering Company | Method for determining parameters of a rotating object within a projected pattern |
Patent | Priority | Assignee | Title |
3630623, | |||
3918816, | |||
4639878, | Jun 04 1985 | FANUC ROBOTICS NORTH AMERICA, INC | Method and system for automatically determining the position and attitude of an object |
4647208, | Jul 22 1985 | Perceptron, Inc. | Method for spatial measurement of holes |
4690557, | Jun 28 1984 | Nicator AB | Arrangement for measuring wheel alignment and steering geometry in an automobile |
4724480, | May 02 1985 | Robotic Vision Systems, Inc. | Method for optical alignment of one object with respect to another |
4863266, | Oct 07 1986 | Iyasaka Seiki Limited | Method and apparatus for measuring vehicle wheel alignment |
4899218, | Feb 18 1987 | FORD GLOBAL TECHNOLOGIES, INC A MICHIGAN CORPORATION | Vehicle wheel alignment apparatus and method |
4931964, | Sep 07 1984 | Snap-On Incorporated | Vehicle wheel alignment apparatus and method |
5018853, | Jun 04 1990 | SPX Corporation | Angle sensor with CCD |
5044746, | Feb 15 1989 | BEISSBARTH GMBH HANAUER STRASSE 101 | Apparatus for measurement of wheel alignment data |
5048954, | Jul 07 1989 | Miradco | Laser-based wheel alignment system |
5054918, | Feb 02 1990 | Snap-On Incorporated | Light scanning system for measurement of orientation and physical features of a workpiece |
5177558, | Dec 26 1991 | AMMCO TOOLS TECHNOLOGY CORPORATION A CORP OF DELAWARE | Wheel alignment apparatus |
5198877, | Oct 15 1990 | BANK OF MONTREAL | Method and apparatus for three-dimensional non-contact shape sensing |
5249364, | May 25 1990 | Dana Heavy Vehicle Systems Group, LLC | Front axle toe-in inspection process and apparatus |
5268731, | Aug 04 1992 | Chuo Electronic Measurement Co., Ltd. | Wheel alignment measuring apparatus |
5274433, | Aug 09 1991 | MIRADCO, A NJ CORP | Laser-based wheel alignment system |
5291264, | Jan 16 1991 | Hofmann Werkstat-Technik GmbH | Method and apparatus for the optical measurement of an angle between positions of components relative to each other |
5519489, | Dec 02 1993 | Hunter Engineering Company | Vehicle alignment system |
5532816, | Mar 15 1994 | STELLAR INDUSTRIES, INC | Laser tracking wheel alignment measurement apparatus and method |
5583797, | Nov 03 1994 | FORD GLOBAL TECHNOLOGIES, INC A MICHIGAN CORPORATION | Method and apparatus for wheel alignment audit |
5675408, | Jan 21 1994 | Josam Lastbilteknik AB | Device and method for the measuring of wheel angles |
5703796, | Jul 11 1996 | Ford Global Technologies, Inc | Driveline alignment apparatus and method |
5724129, | Apr 23 1996 | SNAP-ON EQUIPMENT S R L | Method for determining vehicle wheel alignments |
5724743, | Sep 04 1992 | SNAP-ON TECHNOLOGIES, INC | Method and apparatus for determining the alignment of motor vehicle wheels |
5731870, | May 24 1995 | Fori Automation, Inc. | Intelligent sensor method and apparatus for an optical wheel alignment machine |
5781286, | Nov 14 1995 | Knestel Electronik GmbH | Method and apparatus for measurement of axle and wheel positions of motor vehicles |
5812256, | Aug 13 1996 | MERILAB, INC | Vision system for wheel alignment |
5815257, | Dec 30 1996 | Portable optical wheel alignment apparatus and method for race cars | |
5818574, | Sep 05 1995 | SUN ELECTRIC U K LIMITED | Method and apparatus for vehicle wheel alignment testing |
5870315, | Dec 28 1995 | Hunter Engineering Company | Apparatus and method for determining vehicle wheel alignment measurements from three dimensional wheel positions and orientations |
5930881, | Jun 25 1996 | Bridgestone Corporation | Method of adjusting vehicle wheel alignment |
5978077, | Oct 31 1996 | FORI AUTOMATION, INC | Non-contact method and apparatus for determining camber and caster of a vehicle wheel |
6100923, | Mar 20 1997 | The United States of America as represented by the Secretary of the Army | Method of infrared imaging |
6148528, | Sep 04 1992 | Snap-on Technologies, Inc. | Method and apparatus for determining the alignment of motor vehicle wheels |
6400451, | Feb 10 1999 | Anzen Motor Car Co., Ltd. | Non-contact wheel alignment measuring method and system |
6404486, | Dec 23 1997 | Robert Bosch GmbH | Device for determining the geometry of a wheel and/or axle in motor vehicles |
6412183, | Jun 14 1996 | Kabushiki Kaisha Saginomiya Seisakusho | Wheel alignment measuring instrument and wheel alignment measuring |
6424411, | Nov 20 1998 | FFB | Optical installation and process for determining the relative positions of at least two objects in space |
6456372, | Mar 31 2000 | GM Global Technology Operations LLC | Steering aligning apparatus and method |
6473978, | Jun 16 1998 | Schenck Final Assembly Products GmbH | Wheel alignment assembly and method |
6532673, | Mar 30 1999 | Siemens AG | Method and device for automatically adjusting the axle geometry of a suspended vehicle in a production line |
6545750, | Jan 11 2001 | VALMET TECHNOLOGIES, INC | System for determining the dynamic orientation of a vehicle wheel plane |
6559936, | May 19 1999 | CROSTA, GIANFRANCO | Measuring angles of wheels using transition points of reflected laser lines |
6657711, | Jun 25 1999 | ANZEN MOTOR CAR CO , LTD | Vehicle wheel alignment measuring apparatus |
6690456, | Sep 02 2000 | Beissbarth GmbH | Wheel alignment apparatus |
6707557, | Dec 30 1999 | Eastman Kodak Company | Method and system for estimating sensor dark current drift and sensor/illumination non-uniformities |
6714291, | May 11 2001 | SNAP-ON EQUIPMENT S R L | Process for identifying a specific light signal used in a linear optical sensor of goniometer from among other potentially disturbing light signals |
6731382, | Aug 14 2000 | SNAP-ON TECHNOLOGIES, INC | Self-calibrating 3D machine measuring system useful in motor vehicle wheel alignment |
6744497, | May 05 2000 | Hunter Engineering Company | Integrated circuit image sensor for wheel alignment systems |
6748796, | Nov 24 1999 | 3D SCANNERS LTD | Procedure for determining the dynamic behavior of a vehicle on a test bench |
6796035, | Mar 30 1999 | Siemens Aktiengesell Schaft | Method and device for measuring wheel alignment of a suspended vehicle in a production line |
6802130, | Sep 30 2002 | Bridgestone/Firestone North American Tire, LLC | Alignment device for rotating tire laser mapping machine |
6836970, | Dec 13 2000 | Honda Giken Kogyo Kabushiki Kaisha | Wheel alignment measuring method and apparatus |
6879403, | Sep 22 2000 | BARCLAYS BANK PLC, AS COLLATERAL AGENT | Three dimensional scanning camera |
7230694, | Aug 05 2003 | Siemens Aktiengesellschaft | Method for determining an axle geometry and sensor for its execution |
20090046279, | |||
DE1020090152074, | |||
DE2948573, | |||
EP593066, | |||
EP593067, | |||
EP994329, | |||
EP1221584, | |||
EP1505363, | |||
FR2808082, | |||
RE33144, | Nov 22 1982 | HUNTER ENGINEERING COMPANY, A CORP OFMO | Vehicle wheel alignment apparatus |
WO2010138543, | |||
WO2000071972, | |||
WO2008014783, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Apr 28 2008 | DE SLOOVERE, KRIS | BURKE E PORTER MACHINERY COMPANY | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 028766 | /0752 | |
Apr 30 2008 | VERHAERT, KOEN | BURKE E PORTER MACHINERY COMPANY | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 028766 | /0798 | |
Apr 30 2008 | VERHAERT, KOEN | Verhaert New Products & Services NV | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 028766 | /0798 | |
May 05 2008 | BEGHUIN, DIDIER | BURKE E PORTER MACHINERY COMPANY | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 028766 | /0752 | |
Dec 21 2011 | Burke E. Porter Machinery Company | (assignment on the face of the patent) | / | |||
Dec 21 2011 | Verhaert New Products & Services NV | (assignment on the face of the patent) | / | |||
Jul 29 2016 | BPG AMERICAS INC | JPMORGAN CHASE BANK, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 039463 | /0221 | |
Jul 29 2016 | BPG INTERNTIONAL ASIA LLC | JPMORGAN CHASE BANK, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 039463 | /0221 | |
Jul 29 2016 | X-L MACHINE CO, INC | JPMORGAN CHASE BANK, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 039463 | /0221 | |
Jul 29 2016 | EPIC EQUIPMENT & ENGINEERING, INC | JPMORGAN CHASE BANK, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 039463 | /0221 | |
Jul 29 2016 | BEPTECH, INC | JPMORGAN CHASE BANK, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 039463 | /0221 | |
Jul 29 2016 | BURKE E PORTER MACHINERY COMPANY | JPMORGAN CHASE BANK, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 039463 | /0221 | |
Jul 29 2016 | BPG INTERNATIONAL FINANCE CO LLC | JPMORGAN CHASE BANK, N A | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 039463 | /0221 | |
Jul 29 2022 | JPMORGAN CHASE BANK, N A | BPG INTERNATIONAL FINANCE CO LLC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 060671 | /0793 | |
Jul 29 2022 | BURKE E PORTER MACHINERY COMPANY | JPMORGAN CHASE BANK, N A , AS COLLATERAL AGENT | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 060667 | /0184 |
Date | Maintenance Fee Events |
Aug 26 2016 | M2551: Payment of Maintenance Fee, 4th Yr, Small Entity. |
Oct 12 2017 | BIG: Entity status set to Undiscounted (note the period is included in the code). |
Apr 16 2018 | M1559: Payment of Maintenance Fee under 1.28(c). |
Apr 16 2018 | PTGR: Petition Related to Maintenance Fees Granted. |
Aug 13 2020 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Sep 12 2024 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Mar 19 2016 | 4 years fee payment window open |
Sep 19 2016 | 6 months grace period start (w surcharge) |
Mar 19 2017 | patent expiry (for year 4) |
Mar 19 2019 | 2 years to revive unintentionally abandoned end. (for year 4) |
Mar 19 2020 | 8 years fee payment window open |
Sep 19 2020 | 6 months grace period start (w surcharge) |
Mar 19 2021 | patent expiry (for year 8) |
Mar 19 2023 | 2 years to revive unintentionally abandoned end. (for year 8) |
Mar 19 2024 | 12 years fee payment window open |
Sep 19 2024 | 6 months grace period start (w surcharge) |
Mar 19 2025 | patent expiry (for year 12) |
Mar 19 2027 | 2 years to revive unintentionally abandoned end. (for year 12) |