AN EVOLUTIONARY MULTI-OBJECTIVE APPROACH TO SUSTAINABLE AGRICULTURAL WATER AND NUTRIENT OPTIMIZATION By Ian Meyer Kropp A DISSERTATION Submitted to Michigan State University in partial fulfillment of the requirements for the degree of Biosystems Engineering – Master of Science 2018 ABSTRACT AN EVOLUTIONARY MULTI-OBJECTIVE APPROACH TO SUSTAINABLE AGRICULTURAL WATER AND NUTRIENT OPTIMIZATION By Ian Meyer Kropp One of the main problems that society is facing in the 21st century is that agricultural production must keep pace with a rapidly increasing global population in an environmentally sustainable manner. One of the solutions to this global problem is a system approach through the application of optimization techniques to manage farm operations. However, unlike existing agricultural optimization research, this work seeks to optimize multiple agricultural objectives at once via multi-objective optimization techniques. Specifically, the algorithm Unified Non-dominated Sorting Genetic Algorithm-III (U-NSGA-III) searched for irrigation and nutrient management practices that minimized combinations of environmental objectives (e.g., total irrigation applied, total nitrogen leached) while maximizing crop yield for maize. During optimization, the crop model named the Decision Support System for Agrotechnology Transfer (DSSAT) calculated the yield and nitrogen leaching for each given management practices. This study also developed a novel bi-level optimization framework to improve the performance of the optimization algorithm, employing U-NSGA-III on the upper level and Monte Carlo optimization on the lower level. The multi-objective optimization framework resulted in groups of equally optimal solutions that each offered a unique trade-off among the objectives. As a result, producers can choose the one that best addresses their needs among these groups of solutions, known as Pareto fronts. In addition, the bi-level optimization framework further improved the number, performance, and diversity of solutions within the Pareto fronts. Copyright by IAN MEYER KROPP 2018 To my family, to whom I owe where I am, and to my fiancé, who keeps me moving forward iv ACKNOWLEDGMENTS This work would not have been possible without my brilliant and dedicated professors, coworkers, friends and family. I stand on the shoulders of peers. In particular, I’d like to thank my major professor Dr. Pouyan Nejadhashemi for bringing together, mentoring, and efficiently running our diverse and prolific laboratory. Also, this research would not be possible without the pioneering research by Dr. Kalyanmoy Deb, as well as his patient teaching and mentoring. Finally, I thank Dr. Timothy Harrigan for keeping our research headed firmly toward practical real-world applications that improve our planet. This research also would not be possible without the direct contributions of Gerrit Hoogenboom, Mohammad Abouali, and Proteek Roy. Equally important to this research are the intellectual and emotional support from my lab mates: Sebastian Hernadez, Melissa Rojas-Downing, Matthew Herman, Mohammad Abouali, Umesh Adhikari, Yirigui, Babak Saravi, Nathan Anthony. Finally, I would not be where I am today if not for my friends, and family. In particular, my fiancée Kaitlyn, my siblings Julia and Emma and my parents are constant sources of inspiration and drive. Also, the members of an extremely long list of deep friends deserve significant credit. These include, but are not limited to, Andy Low, Barret Hoster, Emma Sanders, Levi Beach, Marisa Sandahl, and Mike Fox. v TABLE OF CONTENTS LIST OF TABLES ....................................................................................................................... viii LIST OF FIGURES ....................................................................................................................... ix LIST OF ALGORITHMS ............................................................................................................... x KEY TO ABBREVIATIONS ........................................................................................................ xi 1. INTRODUCTION ...................................................................................................................... 1 2. LITERATURE REVIEW ........................................................................................................... 2 2.1 Nutrient and Water Management in Agricultural Intensification .................................... 2 2.2 Optimization Objectives ................................................................................................... 4 2.2.1 Micro Agricultural Management Applications ......................................................... 5 2.2.2 Macro Agricultural Management Applications ........................................................ 5 2.3 Optimization Techniques ................................................................................................. 6 2.3.1 Classical and Evolutionary Single Objective Optimization Approaches ................. 6 2.3.2 Multi-Objective Optimization ................................................................................... 7 2.3.2.1 Classical Multi-Objective Approaches ............................................................... 8 2.3.2.2 Evolutionary Multi-Objective Optimization ....................................................... 9 2.3.2.2.1 Non-Dominated Sorting Evolutionary Multi-Objective Optimizations ....... 10 2.3.2.2.2 Other Evolutionary Multi-Objective Optimization Algorithms ................... 13 2.3.2.2.3 Many-Objective Optimization ...................................................................... 15 Literature gaps ................................................................................................................ 16 2.4 3.4 3. MATERIALS AND METHODS .............................................................................................. 17 3.1 Modeling process ........................................................................................................... 17 3.2 Study area ....................................................................................................................... 20 3.3 Optimization Platform .................................................................................................... 21 3.3.1 Objective Function .................................................................................................. 21 3.3.2 Optimization Algorithm Choice and Setup ............................................................. 23 3.3.3 Optimization Strategies and Configuration ............................................................ 25 Post-processing and visualizations ................................................................................. 28 4. RESULTS AND DISCUSSIONS ............................................................................................. 30 Single-level optimization results .................................................................................... 30 Strategy 1: Single Level Irrigation Minimization and Yield Maximization ........... 30 4.1.1 4.1.2 Strategy 2: Single Level Irrigation Minimization, Nitrogen Minimization, and Yield Maximization ......................................................................................................................... 33 4.1.3 Strategy 3: Single Level Irrigation Minimization, Nitrogen Minimization, Leaching Minimization and Yield Maximization ................................................................................. 38 4.2 Bi-level optimization results .......................................................................................... 41 Strategy 4: Bi-Level Irrigation Minimization and Yield Maximization ................. 41 4.2.1 4.2.2 Strategy 5: Bi-Level Irrigation Minimization, Nitrogen Minimization, and Yield Maximization ......................................................................................................................... 43 4.1 vi 4.2.3 Strategy 6: Bi-Level Single Level Irrigation Minimization, Nitrogen Minimization, Leaching Minimization and Yield Maximization ................................................................. 45 4.3 Application frequency analysis ...................................................................................... 46 5. CONCLUSIONS ....................................................................................................................... 50 6. CURRENT FINDINGS AND FUTURE RESEARCH ............................................................ 52 7. FUTURE APPLICATIONS ...................................................................................................... 53 APPENDIX ................................................................................................................................... 54 REFERENCES ............................................................................................................................. 56 vii Table 1. Summary of the optimization strategies ......................................................................... 27 LIST OF TABLES Table 2. Top five (ranked by yield) optimal results compared to best practices (Strategy 1) ...... 32 Table 3. Top five (ranked by yield) optimal irrigation and nitrogen results compared to best practices (Strategy 2). ................................................................................................................... 37 viii LIST OF FIGURES Figure 1. Example of non-dominated sorting in a two objective minimization problem ............. 11 Figure 2. Proposed integrated bi-level and DSSAT framework ................................................... 19 Figure 3. Location of the field of study ........................................................................................ 21 Figure 4. Pareto front for Strategy 1, which maximized yield and minimized irrigation amount 33 Figure 5. Pareto front for Strategy 2. A surface was passed through the solutions to better visualize the shape of the front. The color of the surface represents the yield for that given region of the front. .............................................................................................................................................. 38 Figure 6. Pareto front for Strategy 3, which maximized yield, minimized nitrogen application, minimized irrigation application, and minimized nitrogen leaching. The color of the surface represents the leaching of the solution .......................................................................................... 39 Figure 7. Strategy 1 results compared to Strategy 4 results .......................................................... 41 Figure 8. Strategy 2 versus Strategy 5 results. Non-dominated Strategy 5 results are the black circles and non-dominated Strategy 2 results are red stars ........................................................... 44 Figure 9. Non-dominated Strategy 6 results ................................................................................. 46 Figure 10. Application frequency analysis a) Histogram of irrigation application count among Strategy 4 solutions. Solutions are color-coded according to their respective yield cluster (see section 2.4). b) Box plots of the total irrigation applied in Strategy 4 solutions, divided by the number of applications applied along the x-axis. The data is further divided and color coded into the clusters as described in section 2.4. ........................................................................................ 47 Figure 11. a.) Histogram of irrigation application count among Strategy 5 solutions. b.) Histogram of nitrogen application count among Strategy 5 solutions. Solutions are color coded according to their respective yield cluster (see section 2.4). ............................................................................. 49 Figure A.1. Cluster analysis for a) Nitrogen application counts and b) irrigation application counts ....................................................................................................................................................... 55 ix LIST OF ALGORITHMS Algorithm 1: Bi-Level Optimization for Agricultural Optimization…………………………… 26 x BMP CSM DE DSSAT EA EMO GA GP MO KEY TO ABBREVIATIONS Best management practices crop simulation model Differential evolution Decision Support System for Agrotechnology Transfer Evolutionary Algorithms Evolutionary Multi-Objective Optimization Genetic algorithm Genetic programming Multi-Objective Optimization MOCPSO multi-objective chaos particle swarm optimization MOFLP Multi-objective Fuzzy Linear Programming NP-hard Non-deterministic Polynomial-time hard NSGA-II Non-dominated Sorting Genetic Algorithm II NSGA-III Non-dominated Sorting Genetic Algorithm III PSO SWAT UF Particle swarm optimization Soil and Water Assessment Tool University of Florida U-NSGA-III Unified Non-dominated Sorting Genetic Algorithm-III WSM Weighted Sum Method xi 1. INTRODUCTION One of the major challenges that the world is facing in the coming decades is how to meet growing food demand without compromising the integrity of our environment (Mueller et al., 2012). An estimate suggests that global food production needs to be increased by 60-110% between 2005 and 2050 (Pradhan et al., 2015). Even so, by closing the yield gaps, which is the difference between attainable yield and actual yield in a region, most countries are expected to meet food self- sufficiency or to improve their current food self-sufficiency levels (Pradhan et al., 2015). Water and nutrient availability are the major production limiting abiotic factors in the regions where the yield gaps are high (Hengsdijk and Langeveld, 2009) and thus effective water and nutrient management plays a crucial role in food security by closing the yield gaps. In addition, optimizing water and nutrient management not only improves crop yield, but also reduces production cost, conserves resources, and protects the environment. However, the presence of multiple conflicting criteria, expensive simulation routines, nonlinearities in objective functions, and constraints make the optimization of such a system very difficult. Here, we are proposing to evaluate the performance of evolutionary multi-objective optimization methods as an alternative approach for addressing these types of socio-economic problems. To test this hypothesis, this thesis seeks to address the following research objectives through the utilization of evolutionary multi-objective optimization methods: 1) identification of the best irrigation practices to achieve high crop yields at minimum water usage, 2) identification of the best irrigation and nutrient management practices to achieve high crop yields at lowest environmental cost, 3) evaluate the importance of the number, time, and amount of irrigation and fertilizer applications on crop yields. 1 2. LITERATURE REVIEW The application of optimization in agricultural intensification has a long and rich history. Researchers have applied classic single objective optimization techniques (e.g., linear programming, dynamic programming, and genetic algorithms) to a wide range of applications since the 1960s (Flinn and Musgrave, 1967). But within the last 25 years, agricultural engineers have embraced a new and powerful class of optimization algorithms know as multi-objective optimization (MO). This literature review seeks to aggregate and analyze the current state of the art applications of MO algorithms within the concept of agricultural intensification. In this literature review we first introduce nutrient and water management in Nutrient and Water Management in Agricultural Intensification, and then we summarize currently ubiquitous applications for MO algorithms in agricultural intensification in the Optimization Objectives section. In the following section Optimization Techniques, the literature review then describes and analyzes optimization techniques within the literature and covers case studies of algorithms and their applications in agricultural intensification. 2.1 Nutrient and Water Management in Agricultural Intensification As water and nutrients are the limiting abiotic factor in agricultural intensification, they are the decision variables in focus in this review. For water specifically, as the sustainability of agricultural water use is affected by competition from non-agricultural water use and climate change, there is an increasing interest in minimizing agricultural water use through improving water productivity (Morison et al., 2008). Water productivity is defined as crop yield per volume of water applied (Kijne et al., 2003). Water applied to the cropped fields can be lost either as a productive (transpiration) or as an unproductive (soil evaporation, infiltration, and runoff) water. Increasing water productivity entails increasing the productive water use while minimizing the 2 unproductive water losses. By optimizing the irrigation schedule and increasing the water productivity, more amount of crop can be harvested with the same amount of irrigation water. In dry areas where cultivated land is limited by the lack of sufficient water, optimizing water productivity at a farm scale would help bring more area under cultivation by increasing water availability. In addition, optimizing the operation of regional water systems (e.g., irrigation networks, reservoirs) can increase the area of land under cultivation by assuaging water shortages in arid regions and regions with non-agricultural competition. Similarly, fertilization is essential for increasing crop productivity; however, over-application or incorrect timing of fertilization may lead to contamination of surface and groundwater (Adesemoye et al., 2008). Focusing on a single nutrient, such as nitrogen, and its over-application causes nutrient imbalance, economic loss, and environmental pollution (Goulding et al., 2008), while under application leads to poor crop yield. Nutrient management involves managing the amount, source, timing and method of nutrient application to minimize nutrient loss and maximize plant uptake (Gaskin and Wilson, 2009). Nutrient management optimization synchronizes fertilization application with plant nutrient utilization, which maximizes crop yield and quality, increases profit, conserves resources and enhances soil quality and productivity. This is important to ensure long-term food security through a proper balance between increased food production, soil health and environmental quality (Lamessa, 2016). Furthermore, water and nutrient management together have an even greater impact on agricultural intensification. Under a limited water supply, plant nutrient plays an important role in enhancing water productivity (Waraich et al., 2011). Under normal water supply condition, transpiration rate is increased by fertilization; however, under dry condition, fertilization has been found to result in depressed plant growth and higher seedling mortality rate (Li et al., 2009; Rahimi et al., 2013). Effective water management improves nutrient availability and helps the transformation of 3 nutrients in the soil (Li et al., 2009). Hence, in the regions where both nutrient and water availability are constraints to crop yield, combined water and nutrient management is essential in increasing crop production. Therefore, optimizing nutrient and water management help improve food security by closing the yield gap, especially in the developing world. For example, for maize in Sub-Saharan Africa, closing the yield gap to 50% of the attainable yield can be achieved through nutrient management, but to close the yield gap to 75% of the attainable yield, simultaneous nutrient and water management is required (Mueller et al., 2012). To computationally optimize agricultural intensification, it is necessary to develop efficient computation models for these agricultural systems. The arrival of physiologically based crop growth models allowed researchers to simulate plant growth and yield under varying irrigation and fertilizer supply. Some of the widely used model such as GOSSYM (Baker et al., 1983), CROPGRO (Boote et al., 1998), CERES-Maize (Jones et al., 1986), CERES-Wheat (Ritchie, 1985), SOYGRO (Wilkerson et al., 1983), PNUTGRO (Boote et al., 1992), AquaCrop (Steduto et al., 2009) and CropWat (Smith, 1992) have been used and improved in the past few decades. Hydrological models such as SWAT (Arnold et al., 2012, Neitsch et al., 2011), TOPMODEL (Kirkby, 1975), and MIKE SHE (DHI, 2003) allow researchers to evaluate the environmental impact, agricultural productivity and economic productivity of agricultural practices on entire regions. 2.2 Optimization Objectives MO algorithms are currently applied to two broad categories: micro agricultural management and macro agricultural management. Micro agricultural management attempts to optimize the performance in a single agricultural unit (e.g., a single field or a single farm enterprise), where macro agricultural management attempts to optimize the performance multiple individual agricultural units at the watershed, county, or regional scales. 4 2.2.1 Micro Agricultural Management Applications The less ubiquitous micro agricultural management applications of MO include irrigation management (Akbari et al., 2018; García-Vila et al., 2009), and crop planning (Groot et al., 2012; Mello Jr et al., 2013; Sarker and Ray, 2009). Even at a smaller scale, agricultural intensification problems still pose multiple conflicting objectives at the micro agricultural management scale and are therefore are ideal for MO techniques. For example, trying to minimize the levels of nitrogen loss in a given field will conflict with the overall yield of the crop (Hengsdijk and Langeveld, 2009). 2.2.2 Macro Agricultural Management Applications There are abundant examples of MO being applied to macro agricultural management objectives, such nutrient tax policy (Whittaker et al., 2017), irrigation network operation (Ashofteh et al., 2015; Fernández García et al., 2014), land use (Groot et al., 2007), and regional crop planning (Sarker and Ray, 2009, 2005; Tan et al., 2017; Wang et al., 2012). MO is a popular choice in macro agricultural management because there are large numbers of conflicting objectives on a regional scale. For example, producers near a river may over apply nutrients to maximize their output, where regional governments may seek to minimize consequent algal blooms in a local reservoir. Or perhaps the consistent hydrologic head required for hydroelectric power generation is interrupted by high irrigation demands in the tropical dry season (Quinn et al., 2018). In addition to being multi-objective, macro agricultural management applications are ideal for evolutionary algorithms (section 2.3.1). Irrigation scheduling, for example, is an NP-hard problem (Anwar and Haq, 2013). The set of NP-hard problems is defined as the set of problems that have not been solved by algorithms in polynomial time, and are possibly be unsolvable in polynomial time (Cormen et al., 2009). The difficulty of such irrigation problems renders most simple brute force algorithms unrealistic, and evolutionary algorithms are therefore popular choices in the literature. 5 2.3 Optimization Techniques 2.3.1 Classical and Evolutionary Single Objective Optimization Approaches In general terms, optimization algorithms search for optimal solutions within a decision variable space. Decision variable space is the space containing all the possible choices that a decision- maker can implement. One example decision space in agriculture would contain all the possible combinations of irrigation dates and amounts (between 0 and 50 mm) for a 120-day growing season. With 51120 or 8.09∙10'() different solutions, this decision space is too large for a human to reasonably evaluate in its entirety. Under these types of conditions, optimization algorithms can be useful tools. Optimization problems are typically defined by one or more decision variables (e.g., when to irrigate) and by one or more objective functions that numerically define the performance of a given solution (e.g., the seasonal yield for a single irrigation scheme). Classical optimization techniques, for this paper, optimize only a single objective function and are fully deterministic (Deb, 2009). This class of algorithms typically has excellent performance with a certain subset of optimization problems (e.g., a differentiable, linear, or unimodal objective function), and includes, among others, Quasi-Newton, gradient descent, linear programming, and golden search section search (Deb, 2009). But outside their narrow scopes of high performance, classical optimization techniques struggle to search for optimal solutions in highly non-linear, non- differentiable, multi-modal, and/or multi-objective problems (Goldberg, 1989). Evolutionary optimization techniques offer a less specialized, and more flexible approach to optimization. Where classical methods solve problems deterministically, evolutionary algorithms traverse search spaces with stochastic heuristics inspired by the phenomenon of evolution. Genetic algorithms (GA), a widely used subset of evolutionary algorithms, mimic evolution by creating an initial random “population” of solutions that evolve towards more and more ideal solutions after each generation (Gen and Cheng, 2000). Each individual of a population has a set of “genes” that 6 represent the specific decision variables for that given solution, and each solution in a population is evaluated and ranked using a fitness function (i.e., objective function). The fittest solutions are paired with each other, and their genes are recombined into offspring solutions. Mutation operators create further diversity in the population. Ideally, the population as a whole will converge on an optimal solution, though there is no way to guarantee a solution is the true optimal solution. Similar to DNA, the genes can be coded as binary strings that can br crossed over with the genes of a mate solution (Holland, 1975). Alternatively, in real coded GA, genes can also be coded as arrays of real numbers and genes are crossed over using a process known as simulated binary crossover (Deb and Agrawal, 1995). 2.3.2 Multi-Objective Optimization What differentiates single objective algorithms and MO algorithms is the number of and nature of objectives. Single objective algorithms on the one hand search for a solution that satisfies a single objective, and MO algorithms on the other hand search for solutions that satisfy multiple conflicting objectives. Conflicting objectives are objectives that cannot be satisfied with a single solution. For example, a hypothetical producer wants to optimize his or her urea application practices to a) maximize crop yield and b) minimize nitrogen application totals. The ideal solution that maximized crop yield would require generous amounts of urea, while the ideal solution that minimized total urea applied would use no urea at all. Therefore, this example has at least two equally optimal solutions: a solution that maximizes yield and a solution that minimizes total urea application. In other words, an optimization problem with two conflicting objectives will have a two-dimensional set of equally optimal solutions, and an optimization problem with n conflicting objectives would have an n-dimensional set of equally optimal solutions (Goldberg, 1989). These sets of solutions are known as Pareto fronts, and each member of the Pareto front are known as a non-dominated solution (Tamaki et al., 1996). Non-dominated solutions are solutions in a 7 population that are not dominated by any other solution, where dominance is defined as outperforming a solution in every single objective. In summary, algorithms that can effectively search through multi-objective solution space are highly applicable to outstanding agricultural engineering problems with conflicting multiple objectives. 2.3.2.1 Classical Multi-Objective Approaches During the naissance of the MO field, algorithms resolved conflicting objectives by reducing multiple objectives to a single objective. Once reduced to a single objective, a single objective optimization technique will find the optimum. These “classical” MO algorithms reduce the search space into a smaller region of the Pareto front. Subsequently, MO algorithms often allow for search within different regions of the Pareto front. The family of classical MO algorithms includes weighted sum, Tchebyshev (Miettinen, 2012), Benson’s (Benson, 1978), and ε-constraint methods (Haimes, 1971). Several papers in the literature employ the weighted sum approach. In its most common form, the weighted sum approach multiplies an objective vector O of n objectives by a weight vector w, and then sums the items of the product vector together into a single objective. *+,-./00=2*343 356 7 With the multi-objective vector reduced to a single value, a classical single objective technique (e.g., GA or Linear Programming) will then use Ooverall as an objective function. The weight vector represents the importance given to each objective by a human decision-maker, and relatively higher weights endow a given objective more impact on the fitness of a solution. There are several applications of the weighted sum method (WSM) in agricultural engineering. Nixon et al. (2001) applied the WSM to solve off-farm irrigation channel delivery schedules. 8 Nixon’s framework maximizes “the number of orders that are scheduled to be delivered at the requested time” and minimizes “…variations in the channel flow rate.” Behind the WSM lies a single objective genetic algorithm. Tan et al. (2017) reduced a multi-objective problem to a single objective fuzzy-robust linear programming problem, using relative membership grades as the weights. Sarker and Ray (2009) also used the WSM to validate the results of an evolutionary multi- objective optimization (EMO) algorithm, the Non-dominated Sorting Genetic Algorithm II (NSGA-II), in a crop planning problem. Using WSM is a common validation tool in EMO research (Deb, 2009). The epsilon constraint method (Haimes, 1971) also converts a multi-objective problem into a single objective problem but instead uses constraints to reduce the number of objectives. In an n objective problem, (n – 1) of the objectives are constrained to a single value, and the remaining objective is solved using a single objective method. Consoli et al. (2008) translated a two objective problem down into a single objective non-linear programming problem. The researchers, trying to 1) minimize irrigation deficit and 2) maximize net economic benefits, constrained the second objective function while minimizing the first objective function. Sarker and Ray (2009) used the epsilon constraint method to validate their NSGA-II crop planning optimization. Other classical approaches include Genetic Programming, as used by Ashofteh et al. (2015) to minimize regional vulnerability to irrigation deficits and to maximize reservoir reliability. Two optimization scenarios, one in recent past and one in the near future, produced unique solutions to two unique climate scenarios. 2.3.2.2 Evolutionary Multi-Objective Optimization During the 1990s and 2000s, EMO techniques grew in popularity. Evolutionary algorithms (EA) are powerful tools for solving MO problems because EAs search for populations of optimal 9 solutions each generation. Therefore, a population-based approach allows an algorithm to search for an entire Pareto set of solutions. 2.3.2.2.1 Non-Dominated Sorting Evolutionary Multi-Objective Optimizations In MO problems, non-dominated sorting is an effective means of ranking solutions in a population based on their convergence. Suggested by David Goldberg (1989), non-dominated sorting groups solutions into increasingly better non-dominated fronts (Figure 1) in terms of convergence. A non- dominated front contains solutions that are all non-dominated (i.e., no solution in the set dominates another solution within the set). The process starts by finding all of the non-dominated solutions in a population. These solutions become the first and highest ranked non-dominated front. The front is then removed from the rest of the population, and the second highest ranked front is identified. The process is repeated until all solutions are categorized into ranked non-dominated fronts. Once so ranked, an algorithm can quickly identify the dominance relationship between members in a population. For example, all solutions in the third highest ranked non-dominated front would automatically be chosen for the next generation over a solution from the fourth highest ranked non-dominated front. 10 Figure 1. Example of non-dominated sorting in a two objective minimization problem Agricultural researchers have employed members of the NSGA-II family of algorithms consistently since the mid-2000s. NSGA-II is a powerful, quick, and simple EMO algorithm developed by Deb et al. (Deb et al., 2002), which uses a combination of non-dominated sorting (Goldberg, 1989) and crowding distance to rank the fitness of a population of solutions. The algorithm balances the goals of convergence through non-dominated ranking, and then population diversity through crowding distance ranking. NSGA-II performs best with one and two objectives, decently with three objectives, and poorly four or more (or “many”) objective problems. NSGA- II also implements the concept of elitism, in which the parents in one generation, instead of being removed from the population after their given generation, have the opportunity to be carried on to the following generation (Deb et al., 2002). 11 NSGA-II appears in a wide breadth of papers in the agricultural engineering literature. Its popularity mainly stems from its ease of use, simple parameters, and balance of population convergence and diversity. In two papers, Sarker and Ray (2009, 2005) developed and employed a variant on NSGA-II to optimize crop-planning practices. Both studies examined an agricultural region containing multiple farms and sought to assign crops to each farm optimally. In the first paper, the total economic investment in the region was minimized while the regional profit was maximized (Sarker and Ray, 2005). For the second paper, the total gross margin was maximized while the total cultivation cost was minimized (Sarker and Ray, 2009). Another research group, Darshana et al. (2012), attempted to maximize gross economic output and minimize water usage in a region in Ethiopia by changing the cultivars of three different farms in Ethiopia. NSGA-II optimized two objectives: an objective to maximize net benefits for farmers and an objective to minimize the water requirements from the crops. The research of Perea et al. (2016) optimizes pressurized irrigation, specifically sectoring operations. Using a customized version of NSGA-II, Perea et al. (2016) minimized the cost of running pumping stations while maximizing farmer’s profit in a region in Spain. In another application of NSGA-II, Lalehzari et al. (2016) studied the optimal allocation of groundwater and surface water for deficit irrigation. Lalehzari et al. (2016) aimed to minimize the total water allocated and maximize the profit relative to the production costs. The authors then ran the same multi-objective optimization problem using particle swarm optimization. Most recently, Whittaker et al. (2017) developed a unique bi-level optimization routine to determine the optimal fertilizer tax on a watershed. Inspired by the Stackelberg game (Von Stackelberg, 2010), they first optimized the spatial distribution of a proposed fertilizer tax from the perspective of a policymaker, using NSGA-II to maximize the agricultural output of the region and to minimize the environmental impact. This is the upper level of optimization. In the lower level of optimization, farmers react to the fertilizer tax and optimize their profits with linear 12 programming. The process then repeats with the upper level. A hybrid of chaos algorithm (Jiang and Weisun, 1998) and two MO algorithms (NSGA-II and MODE) appears in the work of Arunkumar and Jothiprakash (2017). They applied their modified algorithms to optimize crop planning in a multi-reservoir system spanning multiple basins and aim to maximize the net benefits and crop production. There are many examples that use other algorithms based off of non-dominated sorting. ε-NSGA- II, a modified version of NSGA-II developed by Kollat and Reed (2006), incorporated the concepts of ε-dominance archiving into the NSGA-II. The goal of ε-dominance archiving is to perform a more uniform and spread out search within the objective space (Laumanns et al., 2002). ε-NSGA- II searches for watershed best management practices (BMP) in Liu et al. (2013). The objectives of the run are to minimize the cost of the BMP while maximizing the reduction in phosphorus load. The Soil and Water Assessment Tool (SWAT) model predicted the phosphorus load for a given BMP practice (Arnold et al., 2012, Neitsch et al., 2011). Zhang et al. (2017) also employ ε-NSGA- II to minimize agricultural water shortages while simultaneously optimizing other competition water requirements in a watershed and minimizing environmental impact. The algorithm developed by Groot et al. (2012) incorporates Non-dominated sorting into differential evolution to optimize overall farm management. The objectives included minimizing nitrogen leached/denitrified and labor requirements, as well as maximizing economic benefit and organic matter balance. 2.3.2.2.2 Other Evolutionary Multi-Objective Optimization Algorithms There are other examples of EMOs applications in the agricultural intensification optimization literature. For example, differential evolution (DE) (Storn and Price, 1997) is a popular variant of evolutionary algorithms in the agricultural management optimization literature, and a multi- objective version of DE (Lampinen et al., 2000; Xue et al., 2003) appears in Groot et al. (2007). 13 The study by Groot et al. (2007) optimized land use and hedgerow placement with respects to area yield, biodiversity and nutrient loss. Some papers use swarm-intelligence-based algorithms. First coined by Beni and Wang (1993), swarm intelligence mimics the behavior of swarms of autonomous biological agents (e.g., birds, ants, wolves). Wang et al. (2012) employed a variant swarm intelligence technique known as particle swarm optimization (PSO), which searches optimal solutions with a “swarm” of particles that act like a flock of birds (Eberhart and Kennedy, 1995). With each iteration, each “individual” of the swarm moves to a new position based on its current velocity, its personal best location at that time, and a global best location of the entire swarm. However, the variant of PSO, multi- objective chaos particle swarm optimization (MOCPSO), incorporates a dynamic weighted sum optimization within each particle of the swarm to optimize crop planning and water resources in a region in China. The objectives included maximizing the regional agricultural output, total grain yield, environmental benefit, and water efficiency. Genetic Programming (GP) is another family of algorithms that follow evolutionary principles. Unlike GAs, which optimize binary strings representing possible solutions, GP optimizes computer programs (i.e., mathematical functions) in the form of parse trees (Koza, 1992). Ashofteh et al. (2015) employed a bi-objective MO version of GP to maximize the reliability of reservoir irrigation responses and minimize regional vulnerability to irrigation deficits. Melody Search (Ashrafi and Dariane, 2013), a variant of Harmony Search (Geem et al., 2007) appears in the work of Karami and Dariane (2018). Both Melody and Harmony Search attempts to mimic how musicians improvise melodies within a musical ensemble. In Karami and Dariane, a Melody Search framework simultaneously optimizes multiple climate scenarios with respects to maximizing municipal, instream requirement, agricultural and hydropower reliability. 14 2.3.2.2.3 Many-Objective Optimization Many objective problems are multi-objective algorithms that have more than three objectives. Many of the first generation of multi-objective algorithms perform poorly after three objectives, though a number of many objective algorithms have cropped up in the last ten years, such as MOEA/D (Zhang and Li, 2007), Borg (Hadka and Reed, 2013), and NSGA-III (Deb and Jain, 2014). Many-objective problems have not significantly appeared in the agricultural intensification optimization literature. Among the few are Gurav and Regulwar (2012), who used a Multi- objective Fuzzy Linear Programming algorithm (MOFLP) to solve a four objective irrigation planning problem. With MOFLP, irrigation planning in a region in India is optimized with respects to maximizing manure utilization, crop production, job creation, and the overall economic benefit. The research of Wang et al. (2012), mentioned earlier for their PSO algorithm MOCPSO, optimizes a four objective crop planning and water resource problem. In another publication, Karami and Dariane (2018) overcame the difficulties of many-objective optimization by combining Melody Search (Ashrafi and Dariane, 2013) with the concepts of social choice (Arrow, 1951; de Borda, 1781). With their hybrid optimization algorithm, Karami and Dariane (2018) simultaneously maximize reliability for regional municipalities, instream conditions, agricultural production, and hydropower operations under four different climate scenarios. Four NSGA-III runs, one for each climate scenario, is also used to optimize the aforementioned four objectives and to validate the results of the combined melody search and social choice algorithm. Zhang et al. (2017) employed ε-NSGA-II (Kollat and Reed, 2006) to solve a five objective regional water planning problem, which optimized against the water demands of businesses, agriculture, and the environment. 15 2.4 Literature gaps There are several gaps in the agricultural intensification optimization literature. Firstly, and to the best of our knowledge, there are no micro agricultural management applications that combine both nutrient and water management. As mentioned earlier, simultaneously optimizing nutrient management and water management outperforms optimizing each objective individually (Waraich et al., 2011). Therefore, micro-managing nutrient and irrigation applications on farms would move forward the use of state-of-the-art techniques in agricultural intensification. Furthermore, optimizing only irrigation and nutrient applications would ignore the basic requirement to make any management practice economically viable. Therefore, simultaneously optimizing irrigation management, nutrient management, and crop yield would balance three highly significant objectives in agricultural intensification. Finally, including an objective for environmental impact would add a powerful perspective on how certain agricultural practices affect the environment as a whole. Adding environmental objectives would determine whether or not a practice could be sustainably applied throughout regions. Also, there is a lack of good applications of many objective algorithms in the agricultural intensification optimization literature. Agriculture, with its many conflicting objectives, would be an excellent case study for many objective problems. Agricultural systems are highly complex and non-linear and could serve to better define the strengths and weakness of the current state of the art many objective algorithms. 16 3. MATERIALS AND METHODS 3.1 Modeling process To maximize crop yield and simultaneously optimize water and fertilizer use efficiency with limited environmental impacts, we needed to integrate a crop model with an optimization technique. The chosen crop model was the Decision Support System for Agrotechnology Transfer (DSSAT). DSSAT is a computer model capable of simulating crop growth for various cultivars and species. DSSAT considers the full cycle of soil-plant-atmosphere dynamics, irrigation scheduling, and nutrient management planning. The aforementioned characteristics along with the speed of the model (the whole growing season simulations taking few seconds) make this model ideal for this study. DSSAT can act as the evaluator within a bi-level evolutionary optimization framework. In the bi-level optimization, one optimization problem is embedded (nested) in another. The outer and inner optimization problems are commonly referred to as upper- and lower-level optimization problems, respectively. Consequently, the variables of these problems are referred to as upper- and lower-level variables. The decision variables include two time-independent and two sets of time- dependent variables. The time-independent variables (xi, 8∈{1,2}) represent the number of Irrigation Association and producers, respectively. The time-dependent variables (yj(t), 1≤?≤ ∑A3, 1