The present invention is directed to a method for producing agricultural information on an area of interest, with the information based on raw, remote imaging data that is typically produced by a sensor associated with a satellite or aircraft. In one embodiment, the method includes processing raw, remote imaging data to produce reflectance factor data on the land of interest. The reflectance factor data is then used to produce agriculturally significant information. In one embodiment, a soil zone index map is produced for the land of interest. In another embodiment, the reflectance factor data is used to produce a green vegetation index map. In yet a further embodiment, the reflectance factor data at two points in time is used to produce a map for the land of interest that indicates the change in the green vegetation index over time.
|
30. A method for transporting agricultural information on an area of interest towards an interested entity comprising:
conveying, over a portion of a computer network, a map that provides agricultural information on the area of interest, the map including agricultural information that has been produced using reflectance factor data wherein a reflectance factor for a band b is denoted as RFb, where RFb=(Lb−Lpb)mb and mb=π/(Ebtsb cos θ+Eb,sky) t0b, and one of the following: data related to an agricultural scene-object, a formula for producing a green vegetation index (GVI), and a formula for producing soil zone index (SZI).
1. A method for producing agricultural information on an area of interest comprising:
receiving map information that defines an agricultural area of interest for which agricultural information is desired;
receiving remote imaging data on the agricultural area of interest;
processing, using data related to an agricultural scene-object, said remote imaging data on the agricultural area of interest to produce reflectance factor data on the agricultural area of interest, wherein a reflectance factor for a band b is denoted as RFb, where RFb=(Lb−Lpb)mb and mb=π/(Ebtsb cos θ+Eb,sky) t0b; and
using said reflectance factor data on the agricultural area of interest to produce a map for the agricultural area of interest that provides agricultural information.
25. A method for producing agricultural information on an area of interest comprising:
receiving map information that defines an agricultural area of interest for which agricultural information is desired;
receiving remote imaging data on the agricultural area of interest; and
using said remote imaging data on the agricultural area of interest to produce a green vegetation index (GVI) map for the agricultural area of interest according to the following:
GVI=(ID4*−ID3*)(1+L)F/(ID4*+ID3*+L) where
ID4*=ID4−b43;
ID3*=s43 ID3;
F is a scaling factor, L is a soil adjustment coefficient, and ID values are raw image data or radiance values.
29. A method for producing agricultural information on an area of interest comprising:
receiving map information that defines an agricultural area of interest for which agricultural information is desired;
receiving remote imaging data on the agricultural area of interest; and
using said remote imaging data on the agricultural area of interest to produce a soil zone index (SZI) map for the agricultural area of interest according to the following:
SZI=x[sqrt((ID3*+L/2)2+(ID4*+L/2)2)−0.35] where
ID4*=ID4−b43;
ID3*=s43 ID3;
L is a soil adjustment coefficient, x is a scaling constant, and ID values are raw image data or radiance values.
26. A method for producing agricultural information on an area of interest comprising:
receiving map information that defines an agricultural area of interest for which agricultural information is desired;
receiving remote imaging data on the agricultural area of interest;
calibrating said remote imaging data on the agricultural area of interest to produce calibrated data; and
using said calibrated data on the agricultural area of interest to produce a soil zone index (SZI) map for the agricultural area of interest according to the following:
SZI=x[sqrt((RF3*+L/2)2+(RF4*+L/2)2)−0.35] where
RF4*=RF4−b43;
RF3*=s43 RF3;
L is a soil adjustment coefficient and x is a scaling constant.
18. A method for producing agricultural information on an area of interest comprising:
receiving map information that defines an agricultural area of interest for which agricultural information is desired;
receiving remote imaging data on the agricultural area of interest;
calibrating said remote imaging data on the agricultural area of interest to produce calibrated data; and
using said calibrated data on the agricultural area of interest to produce a green vegetation index (GVI) map for the agricultural area of interest according to the following:
GVI=(RF4*−RF3*)(1+L)F/(RF4*+RF3*+L) where
RF4*=RF4−b43;
RF3*=s43 RF3;
F is a scaling factor, L is a soil adjustment coefficient, and RF stands for reflectance factor.
13. A method for producing agricultural information on an area of interest comprising:
receiving map information that defines an agricultural area of interest for which agricultural information is desired;
receiving remote imaging data on the agricultural area of interest;
processing, using data related to an agricultural scene-object, said remote imaging data on the agricultural area of interest to produce reflectance factor data on the agricultural area of interest; and
using said reflectance factor data on the agricultural area of interest to produce a soil zone index (SZI) map for the agricultural area of interest according to the following:
SZI=x[sqrt((RF3*+L/2)2+(RF4*+L/2)2)−0.35] where
RF4*=RF4−b43;
RF3*=s43 RF3;
L is a soil adjustment coefficient and x is a scaling constant.
10. A method for producing agricultural information on an area of interest comprising:
receiving map information that defines the agricultural area of interest for which agricultural information is desired;
receiving remote imaging data on the agricultural area of interest;
processing, using data related to an agricultural scene-object, said remote imaging data on the agricultural area of interest to produce reflectance factor data on the agricultural area of interest; and
using said reflectance factor data on the agricultural area of interest to produce a green vegetation index (GVI) map for the agricultural area of interest according to the following:
GVI=(RF4*−RF3*)(1+L)F/(RF4*+RF3*+L) where
RF4*=RF4−b43;
RF3*=s43 RF3;
F is a scaling factor, and L is a soil adjustment coefficient.
16. A method for producing agricultural information on an area of interest comprising:
receiving map information that defines an agricultural area of interest for which agricultural information is desired;
first receiving first remote imaging data on the agricultural area of interest for a first time;
first calibrating, using data related to an agricultural scene-object, said first remote imaging data on the agricultural area of interest to produce first reflectance factor data for said first time;
first using said first reflectance factor data to produce a first map according to a selected index;
second receiving second remote imaging data on the agricultural area of interest for a second time;
second calibrating, using data related to an agricultural scene-object, said second remote imaging data on the agricultural area of interest to produce second reflectance factor data for said second time;
second using said second reflectance factor data to produce a second map according to said selected index; and
using said first map and said second map to produce a change map that shows the change in the index between said first time and said second time;
wherein a reflectance factor for a band b is denoted as RFb, where RFb=(Lb−Lpb)mb and mb=π/(Ebtsb cos θ+Eb,sky) t0b.
2. A method, as claimed in
said step of using includes producing a green vegetation index (GVI) map for the agricultural area of interest according to the following:
GVI=(RF4*−RF3*)(1+L)F/(RF4*+RF3*+L) where
RF4*=RF4−b43;
RF3*=s43 RF3;
F is a scaling factor, and L is a soil adjustment coefficient.
3. A method, as claimed in
said step of using includes producing a change in GVI map based upon a first GVI map for a first time and a second GVI map for a second time that is different than said first time.
4. A method, as claimed in
said first time is within one week of said second time.
5. A method, as claimed in
said step of using includes using said reflectance factor data to produce a soil zone index (SZI) map for the agricultural area of interest according to the following:
SZI=x[sqrt((RF3*+L/2)2+(RF4*+L/2)2)−0.35] where
RF4*=RF4−b43;
RF3*=s43 RF3;
L is a soil adjustment coefficient and x is a scaling constant.
7. A method, as claimed in
said step of using includes producing a map for one of the following indexes: Difference green vegetation index (DGVI), Perpendicular green vegetation index (PGVI), Normalized Difference vegetation index (NDVI), Simple Ratio vegetation index (SRVI), Infrared Percentage vegetation index (IRPVI), soil Adjusted vegetation index (SAVI), Transformed soil Adjusted vegetation index (TSAVI), Modified SAVI (MSAVI), and MSAVI2.
8. A method, as claimed in
said step of using includes producing a change map based upon a first map for a selected one of said indexes for a first time and a second map for the selected one of said indexes for a second time that is different than said first time.
9. A method, as claimed in
conveying said map on the agricultural area of interest to an entity that is interested in agricultural information on the agricultural area of interest.
11. A method, as claimed in
identifying said GVI map as a first GVI map that relates to a first time; and
repeating said step of receiving, processing and using to produce a second GVI map for the agricultural area of interest that relates to a second time that is different than said first time.
12. A method, as claimed in
using said first GVI map and said second GVI map to produce a change in GVI map.
14. A method, as claimed in
using said reflectance factor data to produce a vegetation index map before using said reflectance data to produce said soil zone index map.
15. A method, as claimed in
said vegetation index map is a green vegetation index map.
17. A method, as claimed in
said selected index is a green vegetation index (GVI) in which pixel values are determined according to the following:
GVI=(RF4*−RF3*)(1+L)F/(RF4*+RF3*+L) where
RF4*=RF4−b43;
RF3*=s43 RF3;
F is a scaling factor, and L is a soil adjustment coefficient.
19. A method, as claimed in
said step of calibrating includes using a value associated with a pixel that corresponds to an agricultural scene-object.
20. A method, as claimed in
said agricultural scene object includes dense herbaceous green vegetation.
21. A method, as claimed in
said agricultural scene object includes dry, bare, agricultural soil.
22. A method, as claimed in
said step of calibrating does not include the use of a value associated with a pixel that corresponds to an agricultural scene-object.
23. A method, as claimed
said step of calibrating includes using a calibration target.
24. A method, as claimed in
said step of using includes producing a change map based upon differences between a first map for a first time and a second map for a second time that is different than said first time.
27. A method, as claimed in
said step of calibrating includes using a value associated with a pixel that corresponds to an agricultural scene-object.
28. A method, as claimed in
said step of calibrating does not include the use of a value associated with a pixel that corresponds to an agricultural scene-object.
|
The present invention is directed to a method for providing agriculture information on an area of interest, with the agricultural information being derived from the raw image data produced by a remote sensor associated with a remote sensing platform.
The profit margins associated with the production and marketing of many crops have been generally decreasing for a number of years. This decrease in profit margins has caused many of the producers in the industry to turn to technology for information that facilitates the management of the crop producing land to increase the yield and/or reduce losses due to disease, drought and the like.
Presently, one method for producing crop related information that allows the producers to manage crop producing land is to use remote sensing platforms (e.g., aircraft, satellites, and land vehicles) that are equipped with sensors that allow raw image data to be collected on the agricultural land of interest as the platform passes over the land. Typically, the raw image data is from one or more discrete bands in the electromagnetic spectrum that are capable of yielding agricultural information. For instance, an indication of the amount of chlorophyll in a plant may manifest itself in the “light” sensed from the land of interest in one or a combination of bands. This raw image data for the land of interest is subsequently processed to produce maps that provide the producers with information that can be utilized to manage crop production. For instance, a map that shows chlorophyll concentrations over the area of interest could be used by a producer to identify portions of the land that are under producing relative to other portions of the land and take appropriate action.
The present invention has recognized that much, if not all, of the agricultural information produced from the raw image data collected by remote sensing platforms is subject to sensor and/or atmospheric effects that lead to inconsistent data from one area of interest to another area or interest, from one sensor to another sensor, and/or from one time to the next time.
The present invention reduces the adverse effects of the sensor and/or atmosphere so that more consistent agricultural information is produced thereby rendering the information easier for producers and others in the agricultural industry to utilize. In other words, the invention produces more consistent agricultural information between different areas of interest. Consequently, if a producer has two different areas of land that are each planted with the same crop, a particular type of agricultural information produced by the invention on each of the two areas is substantially consistently represented, thereby facilitating the producers ability to compare the two crops to one another.
In one embodiment, the present invention includes the steps of receiving information that defines the area of interest of the recipient of the agricultural information and receiving remote imaging data on the area of interest. The remote imaging data or raw data, which is typically produced by a sensor associated with a satellite or aircraft, is processed to produce reflectance factor data on the area of interest. To elaborate, the raw data is subject to effects that skew information on the area of interest. For example, the atmosphere between the area of interest and the sensor, whether satellite or aircraft based, if not taken into account, skews the agricultural information on the area of interest. By processing the raw data to produce reflectance factor data, the effects of the atmosphere and/or other sources of skewing or error are significantly reduced. The method further involves using the reflectance factor data to produce agricultural information on the area of interest. In one embodiment, the reflectance factor data is produced using agricultural scene objects.
In one embodiment, the agricultural information is a green vegetation index (GVI) pixel map of the area of interest that provides an objective measure of the vegetation canopy. Each pixel on the map represents a particular portion of the area of interest. For instance, a pixel can represent a 5m by 5m area within the area of interest. In one embodiment, the pixel map utilizes colors to indicate the GVI for the portion of the area of interest represented by each pixel. For example, brown can represent no vegetation, dark green can represent the densest vegetation canopy, and other colors can be used to represent canopies between these two extremes.
In another embodiment of the invention, the agricultural information is a pixel map that indicates changes in the GVI from date to date. Each pixel in the map is capable of representing a negative change, positive change or no change. The changes or lack of change associated with the land that each pixel represents are, in one embodiment, represented by colors. For example, shades of yellows and red can be used to represent negative changes in the GVI between two dates, shades of blue and green can be used to represent positive changes in GVI between two dates, and white can be used to represent no change in GVI between two dates. In one embodiment, the dates on which GVI information is produced that can be utilized to produce the map are within a week of each other. Consequently, the entity requesting the map is able to monitor changes between GVI maps on at least a weekly basis and potentially on a more frequent basis, such as day to day.
In a further embodiment of the invention, the agricultural information is a vegetation index map other than a GVI map, such a map of the Difference Green Vegetation Index (DGVI), Perpendicular Green Vegetation Index (PGVI), Normalized Difference Vegetation Index (NDVI), Simple Ratio Vegetation Index (SRVI), Infrared Percentage Vegetation Index (IRPVI), Soil Adjusted Vegetation Index (SAVI), Transformed Soil Adjusted Vegetation Index (TSAVI), Modified SAVI (MSAVI), or MSAVI2. Another embodiment applies the reflectance factor data to produce two such maps that relate to different times and are used to generate a difference or change map.
In yet a further embodiment of the invention, the agricultural information is a soil zone index (SZI) pixel map that characterizes an agricultural area of interest in terms of relative soil properties. In one embodiment, the relative soil properties that are characterized are a combination of surface soil wetness, soil texture, and organic matter content. The SZI map is considered most applicable to bare or mostly bare fields and is most likely to be utilized in making decisions regarding crop planning and management.
In yet another embodiment of the invention, the agricultural information is a soil index map other than the SZI map, such as a map of the Soil Brightness Index.
Another aspect of the invention involves the conveyance of the agricultural information produced from the reflectance factor data. To elaborate, the pixel map is typically produced and stored in a digital format that can be transmitted to the entity that requested the agricultural information. In one embodiment, the map is transmitted to the requesting entity over the Internet. It is also feasible to record the map on a magnetic disk, CD, tape or other recording medium and then send the recorded medium to the requesting entity.
Generally, the present invention is directed to the production of agricultural information that is correlated to an area of interest (AOI), which is typically one or more fields. The process involved in producing the agricultural information includes receiving information that identifies the AOI, which is typically provided by the entity requesting the information. Also included in the process is receiving raw imaging data on the area of interest from which agricultural information on the AOI can be derived. The raw data is processed to produce reflectance factor data, thereby substantially reducing the skewing effects attributable to the atmosphere and the sensor used to produce the data. The reflectance factor data is further processed to produce agricultural information that is correlated to the AOI.
Having generally described the process for producing the agricultural information, an embodiment of the process is described in greater detail. To provide agricultural information on an AOI, the AOI is identified in a manner that allows the agricultural information that is to be subsequently produced to be correlated with the AOI. One way to identify the AOI is to have the requester specify the boundaries of the AOI in terms of latitude and longitude. Specifying the AOI in this manner may be cumbersome for a requester. Consequently, to facilitate the identification of the AOI, the requester is provided with tools that facilitate the identification of the AOI. Typically, the tools are in the form of software that a requester can load onto a computer system. For AOIs in the United States, the tools include a digital topographic map product that is in the form of a digital raster of the USGS map(s) that encompass the AOI. The USGS maps generally provide landmarks (roads, cities, waterways etc.) and township, range, and section information that is useful in identifying the AOI. An example of a topographic map product that encompasses an area of interest is shown in
The requester is also provided with an area polygon product for producing a vector data layer that allows the requester to delineate the AOI relative to the topographic map. Stated differently, the area polygon product allows the requester to create a polygon that defines the AOI relative to the topographic map by producing an overlay to the topographic map that delineates the AOI. An example of a topographic map with overlying polygon that delineates the boundaries of an AOI is shown in
Once an AOI is identified, the requester is further provided with a pan image product that is a panchromatic (black and white) image of the AOI. This image is typically utilized by the requester to facilitate the identification of fields within an AOI in the maps that are produced from the raw data and provide agricultural information on the AOI.
A sensor, typically associated with a satellite or aircraft, produces raw image data or raw image raster values (RVb) for each of the spectral bands that are needed to produce the agricultural information for the AOI. More specifically, the sensor produces a raw image raster value for each of the electromagnetic bands of interest for each pixel in the scene (i.e., the area being viewed by the sensor) that includes the AOI. In one embodiment, the sensor is capable of producing raw image raster values a blue light band, green light band, red light band and near infra-red band, which are also respectively referred to as band 1, band 2, band 3 and band 4. It should also be appreciated that raw image raster values for a greater or lesser number of spectral bands may be required to produce a particular type of agricultural information.
The raw image raster values for each band for each pixel that relates to the AOI is subjected to a sensor/radiance calibration step. For simplicity, the calibration is described with respect to the raw image raster value for a single pixel associated with a single band with the understanding that the production of certain agricultural information will require the processing of raw image raster values associates with multiple bands and multiple pixels. With reference to
RVb=Gb(x,y,t,Lb)Lb (1)
where RVb is the raw image raster value for a band b for a pixel, Gb is the gain of the sensor for band b and varies over the images extent (x,y), over time (t), and perhaps with respect to the level of the spectral radiance being sensed (Lb). Gb also includes the effects of other sensor parameters, such as instantaneous field of view, and modulation transfer function. For simplicity, the function Gb(x, y, t, Lb) is hereinafter referred to simply as Gb with the dependencies implied. Equation (1) can be rewritten as:
Lb=RVb/Gb (2)
Spectral radiance calibration of the RVb data is achieved by application of equation (2) to the RVb data, namely, dividing the RVb data by the value of Gb, which is known value for a given sensor. The application of equation (2) to each pixel of an image for a particular spectral band produces a radiance image.
The radiance image data is also commonly subject to positional or geometric skewing in terms of a given map coordinate system projection (mapping system and datum). Such skewing is or can be due to many factors (e.g., distortion in the camera system associated with the sensor, a tilt in the imaging system etc.). Correction involves the shifting of the pixels in the raster so that there is a substantially uniform distribution of pixels across the radiance image of the AOI in terms of the map coordinates of some selected mapping system and datum. If the data is subject to geometrical skewing, the data should be corrected so that the resulting map embodying the agricultural information conforms to the mapping system being utilized by the requester. Otherwise the resulting map may be very difficult for the requester to recognize as relating to the AOI. Such corrections to image data, such as radiance image data, are well-known in the art and, as a consequence, will not be elaborated upon further.
After the raw image raster values (RVb) for the pixels in an image of the AOI and for each relevant band have been subjected to sensor/radiance calibration and/or correction for geometric skewing, atmospheric correction/reflectance calibration is performed on the radiance data Lb. As shown in
Lb=Lpb+Lsb (3)
where Lb is the total spectral radiance measured by the sensor, Lpb is the spectral radiance attributable to the scattering of electromagnetic radiation by gases and other materials in the atmosphere between the sensor and the surface of the earth; and Lsb is the spectral radiance attributable to diffuse reflectance by surface materials, such as soils and crops. Equation (3) is rewritten to solve for the Lsb term, which relates to the soils and vegetation that are of interest, as follows:
Lsb=Lb−Lpb (4)
Equation (3) can be represented by the following equation:
where Eb is the spectral irradiance of the sun at the top of the atmosphere for band b; tsb is band transmittance (with the subscript s referring to the transmission loss between the sun and the surface of the earth); θ is solar zenith angle; Eb,sky is the diffuse sky irradiance; T0b is the transmittance of the atmosphere between the surface of the earth and the sensor; and RFb is the reflectance factor for band b. Equation (5) applies to surfaces with Lambertian reflectance characteristics. Agricultural surfaces, however, have been found to exhibit non-Lambertian reflectance characteristics. This anisotropic behavior is addressed by replacing RFb with a bidirectional reflectance factor BRFb. Alternatively, RFb and π can be replaced with the bidirectional reflectance distribution factor BRDFb. The term RFb is retained hereinafter with the understanding that it refers to BRFb. To solve for RFb, equation (5) is rewritten as follows:
Equation (6) can be simplified to the following:
RFb=(Lb−Lpb)mb (7A)
where mb=π/(Ebtsb cos θ+Eb,sky)t0b (7B)
It is unlikely that all of the atmospheric parameters associated with mb and embodied in equation (7B) would be known as a sensor surveys a particular scene. However, the linear nature of equation (7A) implies that only two independent items of information are needed about the surface reflectance within the scene to determine Lpb and mb. Specifically, if a dark object and a bright object can be found in the pixels of the radiance images with known reflectance factors, the two unknowns of equation (7A), Lpb and mb, can be determined and the equation solved for RFb. To elaborate, if the known reflectance factor of the bright object is RFb,bright and the known reflectance factor for the dark object is RFb,dark and the observed radiances for the bright object and dark object are respectively, Lb,bright and Lb,dark, then:
mb=(RFb,bright−RFb,dark)/(Lb,bright−Lb,dark) (8)
Lpb=Lb,dark−RFb,dark/mb (9)
However, the establishment of objects within every pixel image that have reliable, known reflectance factors, i.e., the establishment of calibration targets in an AOI, is time consuming and expensive.
The process utilizes the radiance image itself rather than any pre-established calibration targets in an AOI to determine mb and Lpb. To elaborate, with respect to determining Lpb, the radiance image produced according to equation (2) for an AOI almost always includes a pixel where the RFb is effectively zero or a feature with a known RFb at or about zero. Moreover, the smaller the resolution element (i.e., the smaller the area represented by a pixel), the greater the likelihood that there will be pixels with an RFb of effectively zero (shaded). The radiance image can be analyzed to identify a pixel or pixels that each have an RFb of effectively zero. Such analysis can be performed with a raster histogram tool in a GIS software package.
For the pixel of the radiance image that is identified as having an RFb of 0 or approximately 0, equation (9) simplifies to:
Lpb=Lb,dark (10)
At this point, the value for Lpb has been determined. Further, the value of Lpb is applicable to the bands of interest.
Rearranging equation (7A) yields an expression for mb of:
mb=RFb,bright/(Lb,bright−Lpb) (11)
Consequently, since Lpb is known from the radiance image (e.g. 296 in
To address the variable nature of the RFb for dry, bare, agricultural soil, a Line of Soils approach is employed. Specifically, there is a linear relationship between NIR reflectance factor of dry, bare, agricultural soils relative to red-light (RL) reflectance factor for the same soils that is expressed as:
RFnir,bas=bnir,r1+snir,r1RFr1,bas (12)
where the subscript bas refers to bare agricultural soil, bnir,r1 is the intercept of the Line of Soils (i.e., the value of RFnir where RFr1=0 in the NIR versus RL feature space plot), and Snir,r1 is the slope of the Line of Soils (in NIR versus R1 feature space).
The Line of Soils in each of the three 2-space plots involving band 4 (i.e., the NIR band) are as follows:
RF4,bas=b43+s43RF3,bas (13)
RF4,bas=b42+s42RF2,bas (14)
RF4,bas=b41+s41RF1,bas (15)
Once a pixel for bright, dry, bare, agricultural soil has been identified, the RF4,bas for the pixel is calculated using equation (7A). The calculation of the RF3,bas utilizes the following known values of b43 and s43:
b43=0.0; and (16)
s43=1.1521 (17)
These values may vary from one area to another. Further, these values vary based on the specific wavelengths and bandwidths of the NIR and RL bands employed. Consequently, these values are subject to modification. The values used for b42, s42, b41 and s41 are:
b42=0.0 (18)
s42=1.333 (19)
b41=0.0 (20)
s41=1.6667 (21)
These values are also subject to modification or refinement depending upon the situation. Based upon the substitution of the values for RF4,bas, b43 and s43 into equation (13), the value for RF3,bas is:
RF3,bas=RF4,bas/1.1521 (22)
The value of m3 (i.e., the value of m for the red light band) is then calculated as:
m3=RF3,bas/(L3,bas=Lp3) (23)
Similarly, the values for m2 and m1 are calculated. At this point, the values for Lpb and mb in equation (7A) have been determined for each band of interest. As a consequence, the values for RF for each pixel for each band in the radiance image of the AOI is determined to produce a reflectance factor image for each band.
If the RF for dense herbaceous green vegetation in a particular scene is not approximately 0.60, errors in the estimates of m for the bands may result. In such a case, the calibration parameters Lpb and mb may be determined by other methods. One method, involves the use of non-agricultural objects in a scene in which the reflectance of the object is substantially constant, such as airport runways, a flat roof on a building and the like. If the scene has been previously imaged, then a reflectance factor estimate exists that can be used in subsequent images to determine reflectance values if the RF for dense herbaceous green vegetation in the subsequent image is subject to question. Another method involves the use of calibration targets in the scene or other field measurements. Such an approach, in many cases, is not cost effective and care must be taken to use measurements at the same time that the raw image data is produced and to account for solar illumination angles, observation angles etc.
One or a combination of the reflectance factor images for the blue band (1), green band (2), red band (3) and NIR band (4) are used to produce an pixel map or image with agricultural information for the AOI. One type of pixel image or map that is produced from the reflectance factor images is a calibrated green vegetation index (GVI) map that is indicative of the vegetation canopy in the AOI. The equation for calculating the GVI based on RF values is:
GVI=(RF4*−RF3*)(1+L)F/(RF4*+RF3*+L) (24)
where RF4*=RF4−b43; (25)
RF3*=s43RF3; (26)
L=0.5; and (27)
F=136. (28)
The value of F is selected so that the value of GVI is about 100 when RF4 is 0.60 and RF3 is 0.03. The parameter L is the soil adjustment coefficient. This results in GVI having a range of values from 0 to 100. A different range of values is also feasible by changing the value of F. The value of L, if the need arises, can also be changed. The values in the relevant GVI range are mapped to a color palette. In one embodiment, the lower values in the range are mapped to shades of browns, the upper values in the range are mapped to greens, and values in between the two extremes are mapped to other colors. It should be appreciated that the map can be a print out of the values for each pixel. However, such maps are typically more difficult to read than a map that maps the values to color. It should be appreciated that raw image data values or radiance values could be applied to equation (24) if desired.
The GVI is believed to address certain deficiencies in the Normalized Difference Vegetation Index (NDVI) and Soil Adjusted Vegetation Index (SAVI). Namely, under the NDVI and SAVI approaches the index value is only zero if RF4 is equal to RF3. This wrongly implies that the Line of Soils in RF4 versus RF3 space runs from (0,0) along a linear diagonal line of that space. In addition, NDVI is undefined when both RF4 and RF3 are equal to zero. NDVI is also highly sensitive to errors in RF4 or RF3 when the values are near zero. The NDVI also reaches a maximum value or saturates when the green vegetation reaches 100% ground cover. As a consequence, the NDVI is largely incapable of giving any indication of the biomass that is produced after the vegetation reaches full cover. The Transformed SAVI (TSAVI) approach accounts for the fact that the actual Line of Soils in RF4 versus RF3 space is given by a straight line that has a slope and intercept like that of equation (13). The approach represented by equations (24), (25), (26), (27) and (28) is capable of accounting for the case in which the Line of Soils has a slope different than 1 and an intercept different than (0,0).
Another type of pixel image or map that is or can be produced is a GVI change map that reflects the changes in the GVI pixel images relating to two different times. Typically, the requester desires the GVI change map to show the changes in GVI between two consecutive times when raw image data was obtained and from which a GVI map could be generated. However, if desired, a GVI change map showing the change in GVI between two, non-consecutive times can also be produced (i.e., when there are one or more times on which raw image data was obtained that are between the two times of interest). It should be appreciated that a GVI change map can be generated at any time provided that GVI data is available or can be produced for two different times. Typically, the GVI change map reflects the change in GVI between two times that are within one week of one another and more typically within three or four days of one another. In one embodiment, the raw image data for producing GVI images that are spaced four days from one another is accomplished by the use of a constellation of satellites with the satellites having orbit that result in one of the satellite passing over a specific AOI every four days. If desired GVI change maps can be produced that use data for times that are more closely spaced in time. It should also be appreciated that images produced by other remote sensing platforms or combinations of such platforms are also feasible. It has been found that producing GVI change maps using GVI data that is three to four days apart and providing the GVI change map to the requester within a few days of the end of the three or four day period provides the requester, especially when the requester is a farmer, with sufficient notice of changes in GVI to take appropriate action. In one embodiment, the GVI change data is mapped according to a scale that extends from 0 to 200. A value of 100 indicates that there was no change in GVI between the two times that GVI pixel maps that are being used to generate the GVI change map were generated. A value of 200 reflects the maximum increase in GVI between the two times, and a value of 0 reflects the maximum decrease in GVI between the two times. The scale is, in turn mapped into a color palette. In one embodiment, GVI change values between 0 and 94 are mapped to shades of red and yellow; a GVI change value of 95–105 is mapped to white; and GVI change values between 106 and 200 are mapped to shades of blue and green.
Another type of pixel image or map that is or can be produced from the reflectance factor images is a soil zone index (SZI) map that is indicative of differences in soil properties. If the GVI pixel map is generated, the equation for determining the SZI is:
SZI=250[sqrt((RF3*+L/2)2+(RF4*+L/2)2)−0.35] (29)
In practice, the range of SZI extends from 0 to 100. Low values of SZI (0–16) are associated with dark areas that are in shadows; values of SZI near 17 are associated with wet soils, silty loam soils, and/or soils having high organic matters content; and values of SZI near 100 are indicative of dry soils with sandy textures and low in organic content. The SZI values are mapped to a color palette to produce a colorized SZI pixel map. A different scale is also feasible and can be realized by changing the multiplication constant in equation (29). It should be appreciated that the map can be a print out of the values for each pixel. However, such maps are typically more difficult to read than a map that maps the values to color. It should also be appreciated that raw image data values or radiance values can be applied to equation (29) if desired.
The reflectance factor data, while discussed hereinabove with respect to the production of a GVI map, is also capable of being applied to known vegetation indexes, such as the Difference Green Vegetation Index (DGVI), Perpendicular Green Vegetation Index (PGVI), Normalized Difference Vegetation Index (NDVI), Simple Ratio Vegetation Index (SRVI), Infrared Percentage Vegetation Index (IRPVI), Soil Adjusted Vegetation Index (SAVI), Transformed Soil Adjusted Vegetation Index (TSAVI), Modified SAVI (MASVI), and MSAVI2. Moreover, the reflectance factor data is capable of being used in the production of change maps for each of the indexes.
The reflectance factor date, while discussed hereinabove with respect to the production of an SZI map, is also capable of being applied to known soil indexes, such as the Soil Brightness Index (SBI).
Whatever agricultural information map is produced using the reflectance factor values is conveyed to the requester. In one embodiment, the map is transmitted to the requester by conveying the map over the Internet. Typically, the map is conveyed in a compressed format. Once received, the requester is able to produce an layered image of the AOI with the bottom most layer being the digital topographic map in which the AOI is located, the next layer being the vector polygon that defines the boundaries of the AOI, and the final layer being the agricultural information map that overlays the polygon defining the AOI. It is also possible to convey the agricultural information map to the requester in other ways. For instance, the agricultural information map can be recorded on a magnetic disk, CD, tape or other recording medium and mailed to the requester. If needed the recording medium can also include the digital topographic map and the vector polygon layers also. It is also possible to simply produce a hard copy of a composite map in which the agricultural information map overlays the relevant topographic map and vector polygon that defines the AOI and then mail the hardcopy the requester. The hard copy can also be faxed or otherwise electronically sent to the requester.
The embodiment of the invention described hereinabove is intended to explain the best mode known of practicing the invention and to enable others skilled in the art to utilize the invention.
Paris, Jack F., Knoblauch, Gregory E., Dinville, Andrew P.
Patent | Priority | Assignee | Title |
10096073, | May 13 2011 | CLIMATE LLC | Systems to prescribe and deliver fertilizer over agricultural fields and related methods |
10127457, | Mar 15 2013 | Remote Sensing Metrics, LLC | System and methods for generating quality, verified, and synthesized information |
10140758, | Jun 27 2013 | The Boeing Company | Texturing models of structures |
10154624, | Aug 08 2016 | CLIMATE LLC | Estimating nitrogen content using hyperspectral and multispectral images |
10248700, | Mar 15 2013 | Remote Sensing Metrics, LLC | System and methods for efficient selection and use of content |
10524409, | May 01 2017 | CNH Industrial America LLC | System and method for controlling agricultural product application based on residue coverage |
10527542, | Aug 10 2016 | FUZHOU UNIVERSITY | Method of calculating TAVI based on a band ratio model and solar altitude angle |
10600162, | Dec 29 2016 | Konica Minolta Laboratory U.S.A., Inc. | Method and system to compensate for bidirectional reflectance distribution function (BRDF) |
10609860, | Aug 08 2016 | CLIMATE LLC | Estimating nitrogen content using hyperspectral and multispectral images |
10628672, | Mar 08 2017 | ZERO GRAVITY DIGITAL, LLC | Method and system for aerial detection and mapping of aquatic species |
10664954, | Aug 27 2015 | Descartes Labs, Inc. | Observational data processing and analysis |
11122734, | Aug 08 2016 | CLIMATE LLC | Estimating nitrogen content using hyperspectral and multispectral images |
11266054, | Jan 24 2017 | INC , BLUE LEAF I | System and method for automatically estimating and adjusting crop residue parameters as a tillage operation is being performed |
11291172, | Jul 02 2017 | MANNA IRRIGATION LTD | Methods and systems for irrigation guidance |
11544296, | Sep 15 2016 | WINFIELD SOLUTIONS, LLC | Systems and methods for spatially-indexing agricultural content |
11730071, | Jan 24 2017 | BLUE LEAF I P , INC | System and method for automatically estimating and adjusting crop residue parameters as a tillage operation is being performed |
11953872, | Apr 12 2018 | MANNA IRRIGATION LTD ; Manna Irrigation Ltd. | Methods and systems for the management of precise agricultural irrigation |
12118625, | May 13 2011 | CLIMATE LLC | Systems to prescribe and deliver fertilizer over agricultural fields and related methods |
8135178, | Apr 10 2007 | Deere & Company | Process for normalizing images or other data layers |
8411903, | Jun 06 2008 | MONSANTO TECHNOLOGY LLC | Generating agricultural information products using remote sensing |
8411904, | Jun 06 2008 | MONSANTO TECHNOLOGY LLC | Generating agricultural information products using remote sensing |
8411905, | Jun 06 2008 | MONSANTO TECHNOLOGY LLC | Generating agricultural information products using remote sensing |
8712148, | Jun 06 2008 | MONSANTO TECHNOLOGY LLC | Generating agricultural information products using remote sensing |
8737694, | Feb 07 2011 | Southern Minnesota Beet Sugar Cooperative | Organic matter mapping using remotely sensed images |
9058560, | Feb 17 2011 | Superior Edge, Inc.; SUPERIOR EDGE, INC | Methods, apparatus and systems for generating, updating and executing an invasive species control plan |
9113590, | Aug 06 2012 | Superior Edge, Inc.; SUPERIOR EDGE, INC | Methods, apparatus, and systems for determining in-season crop status in an agricultural crop and alerting users |
9117140, | May 24 2010 | BOARD OF TRUSTEES OF THE UNIVERSITY OF ARKANSAS | System and method of in-season nitrogen measurement and fertilization of non-leguminous crops from digital image analysis |
9349211, | Jun 27 2013 | The Boeing Company | Texturing models of structures |
9401030, | Apr 25 2014 | Tazco Soil Service Co. | Image processing system for soil characterization |
9488630, | Nov 08 2013 | CORTEVA AGRISCIENCE LLC | Integrated remote aerial sensing system |
9489576, | Mar 26 2014 | AGLYTIX, INC | Crop stand analysis |
9542627, | Mar 15 2013 | Remote Sensing Metrics, LLC | System and methods for generating quality, verified, and synthesized information |
9638678, | Jan 30 2015 | AGRISIGHT, INC | System and method for crop health monitoring |
9652840, | Oct 30 2014 | AGRISIGHT, INC | System and method for remote nitrogen monitoring and prescription |
9734400, | Jan 30 2015 | AGRISIGHT, INC | System and method for field variance determination |
9756844, | May 13 2011 | CLIMATE LLC | Method and system to map biological pests in agricultural fields using remotely-sensed data for field scouting and targeted chemical application |
9813512, | Apr 20 2015 | AGVERDICT, INC | Systems and methods for efficiently generating a geospatial data map for use in agricultural operations |
9965528, | Jun 10 2013 | Remote Sensing Metrics, LLC | System and methods for generating quality, verified, synthesized, and coded information |
Patent | Priority | Assignee | Title |
5878356, | Jun 14 1995 | Agrometrics, Inc. | Aircraft based infrared mapping system for earth based resources |
6029106, | Nov 22 1996 | CNH America LLC; BLUE LEAF I P , INC | Global position correction for the electronic display of field maps |
6178253, | Oct 10 1997 | CNH America LLC; BLUE LEAF I P , INC | Method of determining and treating the health of a crop |
6236907, | May 30 1995 | AG-CHEM EQUIPMENT CO , INC | System and method for creating agricultural decision and application maps for automated agricultural machines |
6366681, | Apr 07 1999 | GEOEYE SOLUTIONS HOLDCO INC ; DIGITALGLOBE, INC | Analysis of multi-spectral data for extraction of chlorophyll content |
6421610, | Sep 15 2000 | Method of preparing and disseminating digitized geospatial data |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jan 15 2002 | DIGITALGLOBE, INC. | (assignment on the face of the patent) | / | |||
Mar 14 2002 | PARIS, JACK R PH D | EARTH WATCH INCORPORATED D B A DIGITAL GLOBE | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 012500 | /0854 | |
Mar 14 2002 | PARIS, JACK F | EARTHWATCH INCORPORATED D B A DIGITALGLOBE | RE-RECORD TO CORRECT THE NAME OF THE ASSIGNEE, PREVIOUSLY RECORDED ON REEL 012500 FRAME 0854, ASSIGNOR CONFIRMS THE ASSIGNMENT OF THE ENTIRE INTEREST | 012815 | /0530 | |
Mar 18 2002 | KNOBLAUCH, GREGORY E | EARTH WATCH INCORPORATED D B A DIGITAL GLOBE | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 012500 | /0854 | |
Mar 18 2002 | DINVILLE, ANDREW P | EARTH WATCH INCORPORATED D B A DIGITAL GLOBE | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 012500 | /0854 | |
Mar 18 2002 | KNOBLAUCH, GREGORY E | EARTHWATCH INCORPORATED D B A DIGITALGLOBE | RE-RECORD TO CORRECT THE NAME OF THE ASSIGNEE, PREVIOUSLY RECORDED ON REEL 012500 FRAME 0854, ASSIGNOR CONFIRMS THE ASSIGNMENT OF THE ENTIRE INTEREST | 012815 | /0530 | |
Mar 18 2002 | DINVILLE, ANDREW P | EARTHWATCH INCORPORATED D B A DIGITALGLOBE | RE-RECORD TO CORRECT THE NAME OF THE ASSIGNEE, PREVIOUSLY RECORDED ON REEL 012500 FRAME 0854, ASSIGNOR CONFIRMS THE ASSIGNMENT OF THE ENTIRE INTEREST | 012815 | /0530 | |
Aug 22 2002 | EARTHWATCH INCORPORATED | DIGITALGLOBE, INC | CHANGE OF NAME SEE DOCUMENT FOR DETAILS | 013351 | /0605 | |
Sep 10 2004 | DIGITALGLOBE, INC | PATRIARCH PARTNERS AGENCY SERVICES, LLC | PATENT COLLATERAL | 016172 | /0848 | |
Apr 18 2005 | PATRIARCH PARTNERS AGENCY SERVICES, LLC | DIGITALGLOBE, INC | TERMINATION & RELEASE OF SECURITY INTEREST | 016397 | /0654 | |
Apr 28 2009 | MORGAN STANLEY SENIOR FUNDING, INC | DIGITALGLOBE, INC | TERMINATION OF SECURITY INTEREST IN PATENTS | 022610 | /0803 | |
Apr 28 2009 | DIGITALGLOBE, INC | U S BANK NATIONAL ASSOCIATION | SECURITY AGREEMENT | 022619 | /0217 | |
Apr 28 2009 | DG CONSENTS SUB, INC | U S BANK NATIONAL ASSOCIATION | SECURITY AGREEMENT | 022619 | /0217 | |
Apr 28 2009 | DIGITALGLOBE INTERNATIONAL, INC | U S BANK NATIONAL ASSOCIATION | SECURITY AGREEMENT | 022619 | /0217 | |
Apr 28 2009 | DIGITALGLOBE, INC | U S BANK NATIONAL ASSOCIATION | RE-RECORDING OF PATENT SECURITY AGREEMENT ORIGINALLY FILED AT REEL 22619 FRAME 217 REFLECTING THE FOLLOWING REVISION TO SCHEDULE 1: THE HONG KONG PATENT NUMBER 08108619 6 HAS ISSUED AS OF 09 19 2008 | 022659 | /0084 | |
Apr 28 2009 | DG CONSENTS SUB, INC | U S BANK NATIONAL ASSOCIATION | RE-RECORDING OF PATENT SECURITY AGREEMENT ORIGINALLY FILED AT REEL 22619 FRAME 217 REFLECTING THE FOLLOWING REVISION TO SCHEDULE 1: THE HONG KONG PATENT NUMBER 08108619 6 HAS ISSUED AS OF 09 19 2008 | 022659 | /0084 | |
Apr 28 2009 | DIGITALGLOBE INTERNATIONAL, INC | U S BANK NATIONAL ASSOCIATION | RE-RECORDING OF PATENT SECURITY AGREEMENT ORIGINALLY FILED AT REEL 22619 FRAME 217 REFLECTING THE FOLLOWING REVISION TO SCHEDULE 1: THE HONG KONG PATENT NUMBER 08108619 6 HAS ISSUED AS OF 09 19 2008 | 022659 | /0084 | |
Oct 12 2011 | U S BANK, NATIONAL ASSOCIATION | JPMORGAN CHASE BANK, N A | CORRECTIVE ASSIGNMENT TO CORRECT THE 1 THE CONVEYING PARTY, AND 2 TO CORRECT THE PROPERTY LISTING BY ADDING PATENTS, AND 3 TO MODIFY THE NATURE OF CONVEYANCE PREVIOUSLY RECORDED ON REEL 027053 FRAME 0914 ASSIGNOR S HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF PATENT SECURITY AGREEMENT | 029709 | /0477 | |
Oct 12 2011 | DIGITALGLOBE, INC | JP MORGAN CHASE BANK, N A | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 027053 | /0914 | |
Jan 31 2013 | JPMORGAN CHASE BANK, N A | DIGITALGLOBE INTERNATIONAL, INC | RELEASE OF SECURITY INTEREST IN PATENTS | 029734 | /0393 | |
Jan 31 2013 | JPMORGAN CHASE BANK, N A | DIGITALGLOBE, INC | RELEASE OF SECURITY INTEREST IN PATENTS | 029734 | /0393 | |
Jan 31 2013 | JPMORGAN CHASE BANK, N A | DG CONSENTS SUB, INC | RELEASE OF SECURITY INTEREST IN PATENTS | 029734 | /0393 | |
Jan 31 2013 | DIGITALGLOBE, INC | JPMORGAN CHASE BANK, N A | PATENT SECURITY AGREEMENT | 029734 | /0427 | |
Jan 31 2013 | GEOEYE ANALYTICS INC | JPMORGAN CHASE BANK, N A | PATENT SECURITY AGREEMENT | 029734 | /0427 | |
Jan 31 2013 | GEOEYE, LLC | JPMORGAN CHASE BANK, N A | PATENT SECURITY AGREEMENT | 029734 | /0427 | |
Jan 31 2013 | GEOEYE SOLUTIONS INC | JPMORGAN CHASE BANK, N A | PATENT SECURITY AGREEMENT | 029734 | /0427 | |
Dec 22 2016 | JPMORGAN CHASE BANK, N A , AS COLLATERAL AGENT | GEOEYE ANALYTICS INC | RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL FRAME 029734 0427 | 041176 | /0066 | |
Dec 22 2016 | DIGITALGLOBE, INC | BARCLAYS BANK PLC, AS COLLATERAL AGENT | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 041069 | /0910 | |
Dec 22 2016 | JPMORGAN CHASE BANK, N A , AS COLLATERAL AGENT | GEOEYE SOLUTIONS INC | RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL FRAME 029734 0427 | 041176 | /0066 | |
Dec 22 2016 | JPMORGAN CHASE BANK, N A , AS COLLATERAL AGENT | DIGITALGLOBE INC | RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL FRAME 029734 0427 | 041176 | /0066 | |
Dec 22 2016 | JPMORGAN CHASE BANK, N A , AS COLLATERAL AGENT | GEOEYE, LLC | RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL FRAME 029734 0427 | 041176 | /0066 | |
Oct 05 2017 | MDA GEOSPATIAL SERVICES INC | ROYAL BANK OF CANADA, AS THE COLLATERAL AGENT | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 044167 | /0396 | |
Oct 05 2017 | DIGITALGLOBE, INC | ROYAL BANK OF CANADA, AS THE COLLATERAL AGENT | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 044167 | /0396 | |
Oct 05 2017 | BARCLAYS BANK PLC | DIGITALGLOBE, INC | RELEASE OF SECURITY INTEREST IN PATENTS FILED AT R F 041069 0910 | 044363 | /0524 | |
Oct 05 2017 | MDA INFORMATION SYSTEMS LLC | ROYAL BANK OF CANADA, AS THE COLLATERAL AGENT | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 044167 | /0396 | |
Oct 05 2017 | SPACE SYSTEMS LORAL, LLC | ROYAL BANK OF CANADA, AS THE COLLATERAL AGENT | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 044167 | /0396 | |
Oct 05 2017 | MACDONALD, DETTWILER AND ASSOCIATES LTD | ROYAL BANK OF CANADA, AS THE COLLATERAL AGENT | SECURITY INTEREST SEE DOCUMENT FOR DETAILS | 044167 | /0396 | |
Dec 11 2019 | Radiant Geospatial Solutions LLC | WILMINGTON TRUST, NATIONAL ASSOCIATION, - AS NOTES COLLATERAL AGENT | SECURITY AGREEMENT NOTES | 051262 | /0824 | |
Dec 11 2019 | DIGITALGLOBE, INC | ROYAL BANK OF CANADA, AS COLLATERAL AGENT | AMENDED AND RESTATED U S PATENT AND TRADEMARK SECURITY AGREEMENT | 051258 | /0465 | |
Dec 11 2019 | SPACE SYSTEMS LORAL, LLC F K A SPACE SYSTEMS LORAL INC | WILMINGTON TRUST, NATIONAL ASSOCIATION, - AS NOTES COLLATERAL AGENT | SECURITY AGREEMENT NOTES | 051262 | /0824 | |
Dec 11 2019 | DIGITALGLOBE, INC | WILMINGTON TRUST, NATIONAL ASSOCIATION, - AS NOTES COLLATERAL AGENT | SECURITY AGREEMENT NOTES | 051262 | /0824 | |
Sep 22 2020 | DIGITALGLOBE, INC | WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT | PATENT SECURITY AGREEMENT | 053866 | /0412 | |
Jun 14 2022 | WILMINGTON TRUST, NATIONAL ASSOCIATION | SPACE SYSTEMS LORAL, LLC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 060390 | /0282 | |
Jun 14 2022 | WILMINGTON TRUST, NATIONAL ASSOCIATION | Radiant Geospatial Solutions LLC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 060390 | /0282 | |
Jun 14 2022 | WILMINGTON TRUST, NATIONAL ASSOCIATION | DIGITALGLOBE, INC | RELEASE BY SECURED PARTY SEE DOCUMENT FOR DETAILS | 060390 | /0282 | |
May 03 2023 | ROYAL BANK OF CANADA, AS AGENT | MAXAR SPACE LLC | TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL FRAME 044167 0396 | 063543 | /0001 | |
May 03 2023 | WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT | MAXAR SPACE LLC | TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL FRAME 053866 0412 | 063544 | /0011 | |
May 03 2023 | WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT | MAXAR INTELLIGENCE INC | TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL FRAME 053866 0412 | 063544 | /0011 | |
May 03 2023 | ROYAL BANK OF CANADA, AS AGENT | MAXAR INTELLIGENCE INC | TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL FRAME 051258 0465 | 063542 | /0300 | |
May 03 2023 | ROYAL BANK OF CANADA, AS AGENT | MAXAR INTELLIGENCE INC | TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL FRAME 044167 0396 | 063543 | /0001 | |
May 03 2023 | MAXAR INTELLIGENCE INC F K A DIGITALGLOBE, INC | SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT | 063660 | /0138 | |
May 03 2023 | AURORA INSIGHT INC | SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT | 063660 | /0138 | |
May 03 2023 | MAXAR TECHNOLOGIES HOLDINGS INC | SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT | 063660 | /0138 | |
May 03 2023 | MAXAR MISSION SOLUTIONS INC F K A RADIANT MISSION SOLUTIONS INC F K A THE RADIANT GROUP, INC | SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT | 063660 | /0138 | |
May 03 2023 | MAXAR SPACE LLC F K A SPACE SYSTEMS LORAL, LLC | SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT | 063660 | /0138 | |
May 03 2023 | SPATIAL ENERGY, LLC | SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT | 063660 | /0138 | |
May 03 2023 | MAXAR SPACE ROBOTICS LLC F K A SSL ROBOTICS LLC F K A MDA US SYSTEMS LLC | SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT | INTELLECTUAL PROPERTY SECURITY AGREEMENT | 063660 | /0138 | |
May 03 2023 | ROYAL BANK OF CANADA, AS AGENT | MAXAR SPACE LLC | TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL FRAME 051258 0465 | 063542 | /0300 |
Date | Maintenance Fee Events |
Mar 03 2008 | ASPN: Payor Number Assigned. |
Dec 28 2009 | M2551: Payment of Maintenance Fee, 4th Yr, Small Entity. |
Oct 23 2013 | STOL: Pat Hldr no Longer Claims Small Ent Stat |
Nov 27 2013 | M1552: Payment of Maintenance Fee, 8th Year, Large Entity. |
Dec 14 2017 | M1553: Payment of Maintenance Fee, 12th Year, Large Entity. |
Date | Maintenance Schedule |
Jun 27 2009 | 4 years fee payment window open |
Dec 27 2009 | 6 months grace period start (w surcharge) |
Jun 27 2010 | patent expiry (for year 4) |
Jun 27 2012 | 2 years to revive unintentionally abandoned end. (for year 4) |
Jun 27 2013 | 8 years fee payment window open |
Dec 27 2013 | 6 months grace period start (w surcharge) |
Jun 27 2014 | patent expiry (for year 8) |
Jun 27 2016 | 2 years to revive unintentionally abandoned end. (for year 8) |
Jun 27 2017 | 12 years fee payment window open |
Dec 27 2017 | 6 months grace period start (w surcharge) |
Jun 27 2018 | patent expiry (for year 12) |
Jun 27 2020 | 2 years to revive unintentionally abandoned end. (for year 12) |