A vehicle control system having a controller and a spatial database adapted to provide spatial data to the controller at control speed. The spatial data provided from the spatial database to the controller includes images collected from an optical sensor subsystem in addition to other data collected by a variety of sensor types, including a GNSS or inertial measurement system. The spatial data received by the controller from the database forms at least part of the control inputs that the controller operates on to control the vehicle. The advantage provided by the present invention allows control system to “think” directly in terms of spatial location. A vehicle control system in accordance with one particular embodiment of the invention comprises a task path generator, a spatial database, at least one external spatial data receiver, a vehicle attitude compensation module, a position error generator, a controller, and actuators to control the vehicle.

Patent
   RE48527
Priority
Jan 05 2007
Filed
Jun 29 2016
Issued
Apr 20 2021
Expiry
Jan 05 2027
Assg.orig
Entity
Large
4
520
currently ok
0. 21. A method of controlling a vehicle having a single gimbal-mounted optical movement sensor mounted thereon or plural optical movement sensors mounted thereon in transversely-spaced relation, the method comprising:
converting position and attitude information from the single optical movement sensor or the plural optical movement sensors into a calculated position and attitude of the vehicle, wherein the calculated attitude defines a roll, yaw, and pitch of the vehicle;
steering the vehicle using the calculated position and attitude of the vehicle and spatial data corresponding to absolute positions in a region;
wherein the spatial data is from a database, and the method further comprises updating the database with updated spatial data as the vehicle traverses the region.
0. 18. An apparatus for controlling a vehicle, the apparatus comprising:
a spatial database containing spatial data corresponding to absolute positions in a region; and
a controller, in communication with a single gimbal-mounted optical movement sensor of the vehicle or plural optical movement sensors mounted on the vehicle in transversely-spaced relation, the controller configured to:
convert position and attitude information from the single optical movement sensor or the plural optical movement sensors into a calculated position and attitude of the vehicle, wherein the calculated attitude defines a roll, yaw, and pitch of the vehicle,
steer the vehicle using the calculated position and attitude of the vehicle and the spatial data from the spatial database, and
update the spatial database with updated spatial data as the vehicle traverses the region.
0. 1. A system for controlling a vehicle, the vehicle including an automatic steering system and roll, pitch and yaw axes, and the control system comprising:
a spatial database containing spatial data corresponding to GPS-defined positions in the region;
a controller mounted on said vehicle and adapted for computing guidance signals, to receive spatial data from the spatial database at control speed, and to control the steering of the vehicle;
a guidance subsystem mounted on said vehicle and connected to said controller, said guidance subsystem being adapted for receiving said guidance signals from said controller and utilizing said guidance signals for guiding said vehicle;
external spatial data sources mounted on said vehicle, comprising at least an optical movement sensor subsystem adapted for optically sensing movement of said vehicle relative to a surface over which said vehicle is traveling;
said optical movement sensor subsystem including an optical movement sensor connected to said controller and adapted for providing optically-sensed vehicle movement signals thereto corresponding to optically-sensed relative vehicle movement;
said optical movement sensor subsystem including an optical movement sensor and an optimal estimator providing a statistically optimal estimate of the position and attitude information received from the optical movement sensor;
said optimal estimator including algorithms that receive the position and attitude information from the optical movement sensor and converts said information into a calculated or determined position and attitude of said vehicle producing a statistically optimal estimate of the calculated or determined position and attitude of said vehicle;
said controller being adapted for computing said guidance signals utilizing said vehicle movement signals;
the controller correlating images from said optical movement sensor subsystem to obtain data relating to the vehicle's motion;
a vehicle reference point located at an intersection of the vehicle roll, pitch and yaw axes; and
the spatial database being adapted to receive updated spatial data from the controller and the external spatial data sources as the vehicle traverses the region.
0. 2. The system for controlling a vehicle according to claim 1, further comprising:
a global navigation satellite system (GNSS) positioning subsystem mounted on said vehicle and adapted for providing GNSS-derived position signals to said controller;
said controller using said GNSS-derived position signals for computing said guidance signals;
said GNSS positioning subsystem including a pair of antennas mounted on said vehicle; and
said antennas receiving GNSS ranging signals corresponding to their respective geo-reference locations.
0. 3. The system for controlling a vehicle according to claim 2, further comprising:
said processor being adapted for computing an attitude of said vehicle using ranging differences between the GNSS signals received by said antennas; and
said GNSS antennas being mounted on said vehicle in transversely-spaced relation.
0. 4. The system for controlling a vehicle according to claim 3, further comprising:
said vehicle including a motive component and an implement connected to said motive component;
a GNSS antenna mounted on said implement and connected to said GNSS receiver; and
said guidance subsystem being adapted for automatically steering said vehicle utilizing said positioning signals to accommodate an offset between said tractor and implement and correct relative positioning of said tractor and implement to maintain said implement on a guide path.
0. 5. The system for controlling a vehicle according to claim 4, further comprising:
said guidance subsystem including an hydraulic steering valve block connected to said controller and to a steering mechanism of said vehicle; and
said guidance subsystem including a graphic user interface (GUI) adapted for displaying a guide path of said vehicle.
0. 6. The system for controlling a vehicle according to claim 5, further comprising:
a GNSS base station including a radio transmitter and a radio receiver;
said vehicle including an RF receiver adapted to receive RF transmissions from said base station; and
a real-time kinematic (RTK) correction subsystem using carrier phase satellite transmissions with said vehicle in motion.
0. 7. The system for controlling a vehicle according to claim 1 wherein said optical movement sensor subsystem includes:
a pair of said optical movement sensors fixedly mounted in spaced relation on said vehicle.
0. 8. The system for controlling a vehicle according to claim 1, wherein said external spatial data sources mounted on the vehicle further comprise:
a GNSS system including an antenna and a receiver;
an inertial navigation system (INS) including a gyroscope and an accelerometer; and
a tilt sensor.
0. 9. A control system as claimed in claim 8, wherein the controller uses the GPS system, the inertial navigation system, the gyroscope, the accelerometer and the tilt sensor to generate a control signal for controlling the vehicle.
0. 10. A system for controlling an agricultural vehicle, the vehicle including an automatic steering system and roll, pitch and yaw axes, and the control system comprising:
a spatial database containing spatial data corresponding to GPS-defined positions in the region;
a controller mounted on said vehicle and adapted for computing guidance signals, to receive spatial data from the spatial database at control speed, and to control the steering of the vehicle;
a guidance subsystem mounted on said vehicle and connected to said controller, said guidance subsystem being adapted for receiving said guidance signals from said controller and utilizing said guidance signals for guiding said vehicle;
external spatial data sources mounted on said vehicle, comprising at least an optical movement sensor subsystem adapted for optically sensing movement of said vehicle relative to a surface over which said vehicle is traveling;
said optical movement sensor subsystem including an optical movement sensor connected to said controller and adapted for providing optically-sensed vehicle movement signals thereto corresponding to optically-sensed relative vehicle movement;
said optical movement sensor subsystem including an optical movement sensor and an optimal estimator providing a statistically optimal estimate of the position and attitude information received from the optical movement sensor;
said optimal estimator including algorithms that receive the position and attitude information from the optical movement sensor and converts said information into a calculated or determined position and attitude of said vehicle producing a statistically optimal estimate of the calculated or determined position and attitude of said vehicle;
said controller being adapted for computing said guidance signals utilizing said vehicle movement signals;
the controller correlating images from said optical movement sensor subsystem to obtain data relating to the vehicle's motion;
a vehicle reference point located at an intersection of the vehicle roll, pitch and yaw axes;
the spatial database being adapted to receive updated spatial data from the controller and the external spatial data sources as the vehicle traverses the region;
a global navigation satellite system (GNSS) positioning subsystem mounted on said vehicle and adapted for providing GNSS-derived position signals to said controller;
said controller using said GNSS-derived position signals for computing said guidance signals;
said GNSS positioning subsystem including a pair of antennas mounted on said vehicle;
said antennas receiving GNSS ranging signals corresponding to their respective geo-reference locations;
said processor being adapted for computing an attitude of said vehicle using ranging differences between the GNSS signals received by said antennas;
said GNSS antennas being mounted on said vehicle in transversely-spaced relation;
said vehicle including a motive component and an implement connected to said motive component;
a GNSS antenna mounted on said implement and connected to said GNSS receiver;
said guidance subsystem being adapted for automatically steering said vehicle utilizing said positioning signals to accommodate an offset between said tractor and implement and correct relative positioning of said tractor and implement to maintain said implement on a guide path;
said guidance subsystem including an hydraulic steering valve block connected to said controller and to a steering mechanism of said vehicle;
said guidance subsystem including a graphic user interface (GUI) adapted for displaying a guide path of said vehicle;
a GNSS base station including a radio transmitter and a radio receiver;
said vehicle including an RF receiver adapted to receive RF transmissions from said base station; and
a real-time kinematic (RTK) correction subsystem using carrier phase satellite transmissions with said vehicle in motion.
0. 11. A method for controlling a vehicle within a region to be traversed, the vehicle including an automatic steering system and roll, pitch and yaw axes, the method comprising the steps:
providing a spatial database;
populating said database with spatial data corresponding to GPS-defined positions in the region;
providing a position error generator;
providing a controller;
mounting said controller to said vehicle;
traversing the region with said vehicle;
receiving spatial data with said controller from the spatial database at control speed;
controlling the steering of the vehicle with the controller as the vehicle traverses the region;
providing the controller with a task path generator;
receiving data from the spatial database with the controller and controller task path generator;
providing the controller with a vehicle attitude compensation module;
mounting external spatial data sources, including at least an optical movement sensor subsystem, on said vehicle and optically sensing movement of said vehicle relative to a surface over which said vehicle is traveling;
said optical movement sensor subsystem including an optimal estimator providing a statistically optimal estimate of the position and attitude information received from the optical movement sensor;
providing said optimal estimator with algorithms that receive the position and attitude information from the optical movement sensor and convert said information into a calculated or determined position and attitude of said vehicle producing a statistically optimal estimate of the calculated or determined position and attitude of said vehicle;
populating said spatial database with ground images from said optical movement sensor subsystem;
inputting said ground images to the controller;
correlating the images with said controller to obtain data relating to the vehicle's motion;
designating and locating a vehicle reference point at an intersection of the vehicle roll, pitch, and yaw axes; and
updating said spatial database with spatial data from the controller and said external spatial data sources as the vehicle traverses the region.
0. 12. The method for controlling a vehicle according to claim 11, further comprising the steps:
providing a global navigation satellite system (GNSS) positioning subsystem mounted on said vehicle and providing GNSS-derived position signals to said controller;
providing said GNSS positioning subsystem with a pair of antennas mounted on said vehicle;
receiving with said antennas GNSS ranging signals corresponding to their respective geo-reference locations; and
computing with said processor an attitude of said vehicle using ranging differences between the GNSS signals received by said antennas.
0. 13. The method for controlling a vehicle according to claim 12, further comprising the steps:
mounting said GNSS antennas on said vehicle in transversely-spaced relation.
0. 14. The method for controlling a vehicle according to claim 12, further comprising the steps:
providing said vehicle with a motive component and an implement connected to said motive component;
mounting a GNSS antenna on said implement and connecting said implement-mounted GNSS antennas to said GNSS receiver; and
said guidance subsystem automatically steering said vehicle utilizing said positioning signals to accommodate an offset between said tractor and said implement and to maintain said implement on a guide path.
0. 15. The method according to claim 11, which includes the additional steps of:
providing said optical movement sensor subsystem with a pair of optical movement sensors; and
fixedly mounting said optical movement sensors in spaced relation on said vehicle.
0. 16. The method for controlling a vehicle according to claim 11, wherein said external spatial data sources mounted on the vehicle further comprise:
a GNSS system including an antenna and a receiver;
an inertial navigation system (INS) including a gyroscope and an accelerometer; and
a tilt sensor.
0. 17. The method for controlling a vehicle according to claim 16, wherein the controller uses the GPS system, the inertial navigation system, the gyroscope, the accelerometer and the tilt sensor to generate a control signal for controlling the vehicle.
0. 19. The apparatus of claim 18, further comprising an optimal estimator to calculate the calculated position and attitude of the vehicle by calculating a statistically optimal estimate of the position and attitude information received from the single optical movement sensor or the plural optical movement sensors.
0. 20. The apparatus of claim 19, wherein the optimal estimator includes algorithms that receive the position and attitude information from the single optical movement sensor or the plural optical movement sensors and convert the information into the calculated position and attitude of the vehicle by calculating the statistically optimal estimate.
0. 22. The method of claim 21, further comprising calculating a statistically optimal estimate of the position and attitude information received from the single optical movement sensor or the plural optical movement sensors.
0. 23. The method of claim 22, further comprising:
receiving the position and attitude information from the single optical movement sensor or the plural optical movement sensors; and
converting the received information into the calculated position and attitude of the vehicle by calculating the statistically optimal estimate.

This application LED(GNSS)138219 319
where n is the number of states.

In general, the mathematical model used to model the vehicle's motion and aspects of its operation will comprise a series of differential equations. The number of equations will be the same as the number of states. In some cases, the differential equations will be linear in terms of the states, whereas in other situations the equations may be nonlinear in which case they must generally be “linearized” about a point in the “state space”. Linearization techniques that may be used to do this will be well known to those skilled in this area.

Next, by noting that any jth order linear differential equations can be re-written equivalently as a set
where

Next, it will be noted that both the state equation and the measurement equation defined above are continuous functions of time. However, continuous time functions do not often lend themselves to easy digital implementation (such as will generally be required in implementing the present invention) because digital control systems generally operate as recursively repeating algorithms. Therefore, for the purpose of implementing the equations digitally, the continuous time equations may be converted into the following recursive discrete time equations by making the substitutions set out below and noting that (according to the principle of superposition) the overall response of a linear system is the sum of the free (unforced) response of that system and the responses of that system due to forcing/driving inputs. The recursive discrete time equations are:
Xk+1=FXk+GUk+1+Lwk+1
Yk+1=ZYk+JUk+1+Nwk+1
where

G U _ k + 1 = 0 Δ t e A ( Δ t - τ ) B U _ ( t k + 1 + τ ) d τ