Designing Your On-Farm Research Comparison

Introduction : Everyday you see, read or hear about farming practices that hold promise for increasing the profitability of your farming operation. The question you typically have is, ?Will it work on my farm?? To answer this question you may need to experiment. The experimentation must be conducted in a manner that will produce credible information. Typically, there is much variation in crop performance within a field. Therefore, a side-by-side comparison of two practices does not give reliable information as we cannot know if yield differences or lack of differences are due to the different management practices or to different growing conditions in the two strips or parts of the field. There are some experimental procedures that should be applied to obtain reliable information on alternative practices on your farm. Following these procedures will insure that you, your neighbors, business associates, and others can rely on you will see the value in conducting scientifically based on-farm research. You can easily conduct valid, field-scale on-farm research using your equipment, on your land, employing your operation?s management practices. On-farm research has three basic components: formulating a hypothesis, testing the hypothesis with experimentation, and drawing a conclusion based on the data.

Objectives :
  • Learn to develop a useful on-farm research hypothesis (a question)
  • Learn to design a two-treatment paired comparison
  • Learn to design a randomized complete block comparison design with three or more treatments

Forming a Hypothesis

Simply develop a well-defined research question that can be answered with data that you can collect from the field.  Try to keep the question focused on one practice.  Will changing this practice, e.g. decreasing planter speed, affect crop performance and profitability?  Formulate this into a hypothesis, which needs to be tested.


Examples of hypothesis for on-farm research could be:

  • Strip tilling soil at or before planting field corn increases grain yield.
  • Treating Bean Leaf Beetles on early-planted soybeans reduces the incidence of Bean Pod Mottle Virus, and ultimately increases soybean yield.
  • Incorporating agricultural lime will increase soil pH and thus enhance corn and soybeans yields faster than non-incorporated lime applications.
  • Early April planted soybeans will have increased yields over May planted soybeans.
  • No-till corn and soybeans will yield better than conventional tilled crops on Lutton Clay in the Missouri River Bottom.

  • Testing the Hypothesis

    Here you decide what treatments to compare, design the field layout of the experiment, and determine what you will measure.  Two experimental layouts are typically used in on-farm research.  The proper design is determined by the number of treatments necessary to test the hypothesis.  Two-treatment experiments use the paired-comparison layout.   Experiments with additional treatments can be designed using the randomized complete block layout.

    Using the two layouts described above you can measure differences between treatments at a given level of probability.  Randomization and replication are important components of a well-designed on-farm research experiment.  Randomization ensures that favoritism is not given toward a treatment.  Replication reduces the possibility that results are due to chance rather than the treatment.  These two factors separate demonstration plots from on-farm research experiments, which can be used to make valid conclusions and ultimately wise business decisions.


    The Paired Comparison Layout

    Paired comparison layouts should have six to seven replications.  If you lose a pair or two due to pest infestations, weather damage, or other circumstances you will still have sufficient pairs (minimum of five) to analyze the experiment with confidence.  Two harvest weights are measured in each treatment area and then compared to the alternative treatments on either side. 

    Paired Comparison Design Image












    The Randomized Complete Block Layout

    The randomized complete block layout is used for on-farm comparisons that require three or more treatments.  At least five blocks are recommended (four minimum) to conduct reliable statistical analysis.  Treatments are randomized within each block to remove favoritism in the comparison.  

    RCB Design Image












    Measuring and Marking Comparison Area

    Information such as row, planter, combine, sprayer and fertilizer rig and other relevant implement widths must be known prior to the comparison design.  Incorporating this data into the experimental layout will improve the efficiency of managing the experiment as treatments are applied and harvest is conducted. 

    Be sure to mark the treatment locations well with field flags, wooden stakes, global positioning system equipment or a combination of these tools.  Draw a sketch of the experiment layout for reference at harvest time.  Buffer areas between treatments are typically important to ensure that treatments do to not influence each other.  Including a field border/buffer is important to eliminate influence from compacted end rows, fence line grasses, field roads, etc.


    Collecting Data

    Harvest weights may be collected using a properly calibrated weigh-wagon or yield monitor.  Moisture and test weights should be collected for each grain yield treatment measured.  The worksheet following this article can be used to record harvest data and calculate crop yields. 

    In addition to crop yield, grain moisture and test weight you may want to collect additional data relevant to your on-farm research experiment hypothesis.  Examples of this data include soil fertility, plant height, insect thresholds, weed densities, planting and harvest populations, grain protein analysis, etc.  This data can be statistically analyzed if collected using the same procedure used for harvest. 

    Keeping a diary of crop and weather conditions throughout the growing season is an invaluable resource when the time comes to draw conclusions from the experiment.  A photographic record of observed differences during the growing season may also be useful. 


    Drawing Conclusions

    Data collected from a scientifically designed on-farm research experiment can be statistically analyzed and interpreted to determine whether or not real differences are present among treatments.  It’s difficult to draw conclusions by simply looking at the raw data.  Statistical analysis determines probabilities that the differences were caused by treatments versus chance (random variation or error).

    Various confidence levels are used to analyze agricultural data.  University researchers generally select a minimum confidence level of 95%, which means that there is a 95% probability that experimental differences measured are due to the treatments rather than to chance.  There is a 5% possibility that the treatment differences are due to chance.  Many farmers readily accept a confidence of 90% depending on the nature of the experiment.  There is always a 10%, 5%, 1 % or even .0001 percent chance of error.  However, by following the experimental guidelines suggested here the odds of making a scientifically based decision are in your favor.

    Once yield and/or other treatment differences are determined you should focus on economics.  What is the cost:benefit ratio?  Is the advantage of a given treatment worth the cost difference between the treatments?  Non-tangible benefits such as improved soil quality, environmental improvement, and efficiency should also be considered.   Conclusions should generally be drawn from comparisons repeated in more than one location and/or year.


    Summary

    On-farm research is a powerful decision-making tool for farmers.  The time and effort required to design, implement and analyze a sound on-farm research comparison is worth the confidence that you and other agriculturalists will have in the results.  Results should be taken a step farther by analyzing the economics of the comparison.  A yield difference is important, but perhaps not relevant if the cost of the yield increase is more that than the return on investment.  Contact your local Cooperative Extension Educator today to plan your on-farm research agenda.


    Resources

    Penas, E.J., Ferguson, R.B., Herger, G.W., Shapiro, C.A. and G.D. Binford.  Procedures for Field Demonstrations of Nitrogen Management Practices.  1993.  University of Nebraska Cooperative Extension EC 93-126.

    Rzewnicki, Phil, On-farm Trials for Farmers Using the Randomized Complete Block Design. 1992.  University of Nebraska Cooperative Extension EC 92-125.