2018
Small Unmanned Aircraft Thermal Infrared Imaging System to Identify Soybean Drought Tolerant Varieties
Contributor/Checkoff:
Category:
Sustainable Production
Keywords:
GeneticsGenomics
Lead Principal Investigator:
Ajay Sharda, Kansas State University
Co-Principal Investigators:
Daniel Flippo, Kansas State University
William Schapaugh, Kansas State University
Deon van der Merwe, Kansas State University
+2 More
Project Code:
1879
Contributing Organization (Checkoff):
Institution Funded:
Brief Project Summary:

Recent decline in water availability and droughts are becoming critical factors impacting crop yields in the U.S. Sensing systems could identify lines with higher drought tolerance more accurately and rapidly to develop varieties with greater resilience. Thermal infrared (TIR) images can spatially map temperatures to measure subtle characteristics of soybean leaf dynamics. TIR imagery could allow researchers to conduct individual crop temperature profiling, sense crop health and develop correlation among crop canopy temperature, stomatal conductance, and leaf water potential. Objectives of this project are to record soybean canopy profiles using thermal infrared imaging system and evaluate the effectiveness of whole-plot thermal imaging for high-throughput phenotyping.

Key Benefactors:
farmers, agronomists, ag retailers

Information And Results
Project Deliverables

o achieve the overall goal, the proposed work consists of four major steps: 1) collecting aerial imagery using Small unmanned aircraft system (sUAS) platform on target plots for desired spatial resolution, image overlap, and altitude, 2) image analyzing using thermographic calibration curves compensating for environmental conditions during sensing campaigns, 3) image stitching (mosaicking) to create whole-plot spatial canopy temperature maps, and 4) measuring agronomic traits on a diverse range of soybean genotypes (including plant introductions and breeding lines). sUAS TIRIS has been developed at Biological and Agricultural Engineering department. It utilizes uncooled thermal camera and other required sensors for environmental compensation. Deployable temperature reference panels will be developed for in-flight accuracy assessment. These reference panels will be used to initialize and calibrate camera before, during, and after each flight. Multiple temperature reference panels will use thermistors connected to a data acquisition system (DAQ) to record real-time reference panel surface temperature while monitoring environmental parameters (i.e., air temperature, humidity, solar radiance, wind speed, and direction). As tested in full-season greenhouse corn studies last year, the TIRIS system will utilize calibration techniques using reference calibration images to quantify canopy temperatures from camera pixel intensity; corresponding transfer function from pixel intensity to surface temperatures along with camera sensor settings to accurately measure crop temperature profiles. In addition to thermal imaging, color infrared camera (CIR) mounted on the sUAS will be used to capture canopy reflectance. Ground reflectance reference panel will be used to calibrate CIR camera at the flying altitude.

TIRIS will be integrated with multi-rotor sUAS to collect aerial imagery. Test will be conducted at Kansas State University’s soybean breeding trials. A Certificate of Authorization (COA) for one year of flying sUAS for these locations will be obtained through K-State Saline Unmanned Aircraft Systems Program Office (USAPO). The research plots will consist of irrigated and dryland plots near Manhattan and Salina, Kansas. The target genotypes to be monitored will include lines that are under evaluation and development in the abiotic stress soybean breeding and genetics program pipeline. The sUAS with TIRIS will be flown at 15 and 25 m. Different heights are selected to understand and differentiate the effect of flying altitude on thermal imagery accuracy and image pixel degradation, dynamic accuracy of imaging system at different altitudes, pixel and canopy temperature resolution, assess productivity in terms acres covered per hour and assess economics of using this system. Nine airborne campaigns at each site will be conducted over the experimental plots to capture images around solar noon flight times to investigate the physiological status of the plant capturing the key flowering and seed-fill phases. In addition to aerial imagery, sampling regions will be randomly selected for ground truthing and; plant health and growth related data collected. Actual canopy temperature will be measured with leaf clip radiometers to validate aerial imagery results at selected sampling locations. Ground based evaluation of agronomic and physiological traits such as chlorophyll content using SPAD will be conducted for analysis and screening of drought resistant varieties. Plant material measurements will include seed yield, maturity, lodging, height and visual wilting scores. Potential effectiveness of this system to screen genotypes will be assessed by correlating thermal canopy profiles with relative seed yield, maturity and response to drought and heat stress.

Final Project Results

Update:

View uploaded report PDF file

Small Unmanned Aircraft Thermal Infrared Imaging System to Identify Soybean Drought Tolerant Varieties (1879)
Introduction: During the course of the project two major projects were undertaken 1) Assessment of sudden death syndrome in soybean through multispectral broadband remote sensing aboard small unmanned aerial systems; and 2) Remote thermal infrared imaging for rapid screening of sudden death syndrome in soybean.
M.S. Student Graduated: Nicholle Hatton
Publications:
1. Hatton, N.,* E. Menkeb, A. Sharda, D. Merwe and W. Schapaugh. 2019. Assessment of sudden death syndrome in soybean through multispectral broadband remote sensing aboard small unmanned aerial systems. Computers and Electronics in Agriculture. https://doi.org/10.1016/j.compag.2019.105094
2. Hatton, N.,* A. Sharda, W. Schapaugh and D. Merwe. 2020. Remote thermal infrared imaging for rapid screening of sudden death syndrome in soybean. Computers and Electronics in Agriculture. (Under 2nd Review)
Project 1: Assessment of sudden death syndrome in soybean through multispectral broadband remote sensing aboard small unmanned aerial systems
Sudden Death Syndrome (SDS) has spread from the US to other countries which are causing yield loss of 10% to 15% and 70% in extreme cases from infected plants. Currently, SDS impacts are scored by visual assessment of infection severity and percent of crop diseased. The quality of manually collected row-based coarse data collected over several hours can be impacted by assessment errors and changes in diurnal environmental conditions. Small unmanned aerial systems (sUAS) offer an alternative method to provide a more accurate and reliable measurement of crop disease. A platform designed to collect high throughput aerial imagery data to quantify SDS is proposed. A comparative evaluation of ground-based and aerial remote sensing methods for the scoring of SDS is proposed to evaluate efficacy. The purpose of this research was to (1) compare accuracy and benefits of ground-based and aerial remote sensing methods for the scoring of SDS, (2) determine if pigment index (PI) can be used for the assessment and quantification of SDS, and (3) assess if PI can be utilized for determination of maturity. A seven-acre field was selected as test plots to collect reflectance using both a ground-based spectrometer and sUAS aerial imagery using a broadband modified color infrared sensor over a two-year period. Aerial imagery was collected once in 2016 (FD1) and twice in 2017 (FD2 and FD3) using an sUAS late in the growing season and at maturity each year. PI values were compared to manual collected ground-based data. Results from check plots indicated that the PI derived using aerial imagery and the ground-based spectrometer data explained 80 and 78% of the variation in SDS scores, respectively. When analyzing only high instances of SDS (SDS score >25) in the check plots aerial data and ground-based data explained 84 and 71% of the variation in SDS scores, respectively. Correlations between SDS scores and different indices analyzed showed that only PI and Blue Normalized Difference Vegetation Index (BNDVI) were significantly correlated with SDS score, with PI showing significantly greater correlations (-0.79 (FD2) and -0.72 (FD3)) to SDS on field-scale than BNDVI (-0.36 (FD2) and -0.35 (FD3)). The PI derived from aerial imagery data showed strong correlations with SDS score, SDS severity, and plant maturity, indicating that PI can be used in field studies to quantify critical growth indicators in soybean plots.

Project 2: Assessment of sudden death syndrome in soybean through multispectral broadband remote sensing aboard small unmanned aerial systems
Sudden death syndrome (SDS), a fungal infection in soybean caused by Fusarium virguliforme, greatly affects the plant health and in some cases, can cause yield losses of more than 70%. Infected plants are scored by visual assessment based on the severity and extent of infection. This manual process is time-intensive and not practical for large acreages. Diseased and stress in plants show elevated canopy temperatures that can potentially lead to the identification of unhealthy plants without manual scoring. The infection decreases nutrient distribution causing stress that results in internal plant temperature to increase. Thermal infrared (TIR) sensors have the ability to measure the emitted radiation of an object in the infrared region of the electromagnetic spectrum to estimate canopy temperatures. However, TIR sensors have not yet been utilized to capture changes in canopy temperatures to detect SDS in soybean. Therefore, the goal of this study was to 1) use a TIR sensor to assess plant health and vitality, and 2) evaluate canopy temperatures over the growing season to quantify disease development. A thermal infrared camera was mounted on a small unmanned aerial system to capture aerial imagery over the growing season. The first flight was achieved once SDS foliar symptoms began initial development. The remaining three flights occurred before, during, and after full pod fill when symptoms had reached their apex. Results show increasing correlations over the four days. Elevated canopy temperature changes were observed on canopies at early SDS symptom development. Symptoms at the end of the growing season displayed strong correlations to the canopy temperature with ?= 0.7404. Disease severity showed the strongest correlation throughout the four flights with the last at ?= 0.7245. The four flights exhibit a decreasing trend with Spearman's rho (R2=0.86 for disease severity). Therefore, thermal imaging can be utilized to detect diseased plots. Future studies will be conducted to understand how to mitigate for SDS using thermal detection.

Future Vision
Previous studies showed that thermal assessment of disease was possible through aerial platforms. This case study demonstrated that an infield assessment of soybean SDS using a TIR camera and sUAS system was possible. Correlations with temperature difference and SDS score increased throughout the growing season. Correlations with disease incidence and severity also increased through the growing season with the largest correlations toward the end of the seed fill period Overall assessment of incidence displayed the highest relationship in correlation over the days flown while severity maintained a similar relationship. The severity of SDS infection is the most practical predictor of SDS for large application use because of its high correlation and easy application. This case study exhibits the potential use of TIR remote sensing for the detection of SDS in soybean. While correlations at the beginning of the flight period were moderate, they have the potential to act as predictors to SDS within a field and give preliminary indications of the disease before visual symptoms appear. Future studies will expand this research to assess disease over an entire field and determine when the earliest that definable SDS symptoms are present.

The United Soybean Research Retention policy will display final reports with the project once completed but working files will be purged after three years. And financial information after seven years. All pertinent information is in the final report or if you want more information, please contact the project lead at your state soybean organization or principal investigator listed on the project.