

Designing Your On-Farm Research Comparison
- Learn to develop a useful on-farm research hypothesis (a question)
- Learn to design a two-treatment paired comparison
- Learn to design a randomized complete block comparison design with three or more treatments
Simply develop a well-defined research question that can be answered with data that you can collect from the field. Try to keep the question focused on one practice. Will changing this practice, e.g. decreasing planter speed, affect crop performance and profitability? Formulate this into a hypothesis, which needs to be tested.
Examples of hypothesis for on-farm research could be:
Here you decide what treatments to compare, design the field layout of the experiment, and determine what you will measure. Two experimental layouts are typically used in on-farm research. The proper design is determined by the number of treatments necessary to test the hypothesis. Two-treatment experiments use the paired-comparison layout. Experiments with additional treatments can be designed using the randomized complete block layout.
Using the two layouts described above you can measure differences between treatments at a given level of probability. Randomization and replication are important components of a well-designed on-farm research experiment. Randomization ensures that favoritism is not given toward a treatment. Replication reduces the possibility that results are due to chance rather than the treatment. These two factors separate demonstration plots from on-farm research experiments, which can be used to make valid conclusions and ultimately wise business decisions.
Paired comparison layouts should have six to seven replications. If you lose a pair or two due to pest infestations, weather damage, or other circumstances you will still have sufficient pairs (minimum of five) to analyze the experiment with confidence. Two harvest weights are measured in each treatment area and then compared to the alternative treatments on either side.
The randomized complete block layout is used for on-farm comparisons that require three or more treatments. At least five blocks are recommended (four minimum) to conduct reliable statistical analysis. Treatments are randomized within each block to remove favoritism in the comparison.
Information such as row, planter, combine, sprayer and fertilizer rig and other relevant implement widths must be known prior to the comparison design. Incorporating this data into the experimental layout will improve the efficiency of managing the experiment as treatments are applied and harvest is conducted.
Be sure to mark the treatment locations well with field flags, wooden stakes, global positioning system equipment or a combination of these tools. Draw a sketch of the experiment layout for reference at harvest time. Buffer areas between treatments are typically important to ensure that treatments do to not influence each other. Including a field border/buffer is important to eliminate influence from compacted end rows, fence line grasses, field roads, etc.
Harvest weights may be collected using a properly calibrated weigh-wagon or yield monitor. Moisture and test weights should be collected for each grain yield treatment measured. The worksheet following this article can be used to record harvest data and calculate crop yields.
In addition to crop yield, grain moisture and test weight you may want to collect additional data relevant to your on-farm research experiment hypothesis. Examples of this data include soil fertility, plant height, insect thresholds, weed densities, planting and harvest populations, grain protein analysis, etc. This data can be statistically analyzed if collected using the same procedure used for harvest.
Keeping a diary of crop and weather conditions throughout the growing season is an invaluable resource when the time comes to draw conclusions from the experiment. A photographic record of observed differences during the growing season may also be useful.
Data collected from a scientifically designed on-farm research experiment can be statistically analyzed and interpreted to determine whether or not real differences are present among treatments. It’s difficult to draw conclusions by simply looking at the raw data. Statistical analysis determines probabilities that the differences were caused by treatments versus chance (random variation or error).
Various confidence levels are used to analyze agricultural data. University researchers generally select a minimum confidence level of 95%, which means that there is a 95% probability that experimental differences measured are due to the treatments rather than to chance. There is a 5% possibility that the treatment differences are due to chance. Many farmers readily accept a confidence of 90% depending on the nature of the experiment. There is always a 10%, 5%, 1 % or even .0001 percent chance of error. However, by following the experimental guidelines suggested here the odds of making a scientifically based decision are in your favor.
Once yield and/or other treatment differences are determined you should focus on economics. What is the cost:benefit ratio? Is the advantage of a given treatment worth the cost difference between the treatments? Non-tangible benefits such as improved soil quality, environmental improvement, and efficiency should also be considered. Conclusions should generally be drawn from comparisons repeated in more than one location and/or year.
On-farm research is a powerful decision-making tool for farmers. The time and effort required to design, implement and analyze a sound on-farm research comparison is worth the confidence that you and other agriculturalists will have in the results. Results should be taken a step farther by analyzing the economics of the comparison. A yield difference is important, but perhaps not relevant if the cost of the yield increase is more that than the return on investment. Contact your local Cooperative Extension Educator today to plan your on-farm research agenda.
Penas, E.J., Ferguson, R.B., Herger, G.W., Shapiro, C.A. and G.D. Binford. Procedures for Field Demonstrations of Nitrogen Management Practices. 1993. University of Nebraska Cooperative Extension EC 93-126.
Rzewnicki, Phil, On-farm Trials for Farmers Using the Randomized Complete Block Design. 1992. University of Nebraska Cooperative Extension EC 92-125.