News

Breaking down big data

A Smaller Approach to Big Data

Posted on

Big data is one of the most buzzed-about concepts in our industry. Rarely do we read a newsletter, attend a conference, or make it through our Twitter feed without encountering the topic of big data.

It seems there’s no shortage of the amount of data and the type of data that can be collected. One of the biggest challenges with big data is how to get value from it. Growers are inundated with data and, for many, it’s too overwhelming for its own good. The benefits that data can provide will go unused if growers aren’t sure what to do with it – or worse, even how to start looking at it.

The most important thing to keep in mind when beginning to farm for data is that big data is nothing more than a collection of small datasets – and, the process is nothing new. 

Background on Big Data
Believe it or not, the approach to using big data in crop production today more closely compares to horse-drawn plows and hand seeding than it does to the great era of mechanized agriculture. The very decision-making process growers got away from in the interest of covering more acres via motorized farm machinery has actually come back around as we enter the digital age, and now it’s important to get it back on track.

Consider all the decisions that go into planting a field today. Using a variety of new technologies, growers can manipulate the weight displacement and down pressure of the planter, the planting depth, the spacing, and the fertilizer being applied (both in its rates and in its placement) to give each seed the ideal situation to maximize its potential. Not only that, growers can even vary the method by which the seed makes its initial contact with the soil, via a host of motorized delivery components.

In addition to all of these mechanical manipulations, there is still the decision of which hybrid or variety gets planted in the first place – and that can be varied as well. Our ancestors followed the exact same methodology as they perfectly placed their seeds in the furrow, one at a time.

Converting this process to the digital age takes nothing more than simply logging what was done and evaluating what took place – but this is also where the big data problems begin for growers.

Why Big Becomes Too Big
Imagine making a single spreadsheet entry, recording everything taking place with a planter every time a seed went into the ground, and think of how big that would become – how each small observation exponentially grows into a large, invaluable dataset.

Taking it a step further, think about just the seed variety variable alone. If there are two different varieties intended to plant within a single field, the dataset on an 80-acre soybean field, planted at a rate of 140,000 seeds per acre, would feature 11.2 million rows of data. A simple “Variety A, Variety B” variable alone may seem pretty elementary when it comes to statistics, but it sure adds up in a hurry, especially when the other variables are added.

Of course, in the real-world, growers don’t have time to make 11 million decisions and most have more than just 80 acres to focus on. Likewise, one perfect selection of a given variety planted at the same depth at a uniform down pressure may give the average grower a positive return on investment across the farm, or field, in the majority of situations.

In both of these cases, it’s easy to see why the adoption of big data on the farm can become both daunting and seemingly lacking in value.

Data Usage Missteps
So how has the experience with big data gone so wrong? In many cases, it is because the grower is being encouraged to convert an entire farming operation over at once, leading to a poor experience. Nobody warns them about the intense amount of background effort that is required to ensure that every layer of data is synched up to perfectly harmonize the operation.

For the big data collective as a whole, the false advertisement that a large dataset is the only way to go and that all users will find its value collectively has led many to the feeling of leaving a buffet with a full belly, but less than satisfied. Rather than breaking things down into smaller, bite-sized pieces that are easily digested, the majority have learned to over-indulge in data, quickly leading all to become bloated with un-actionable results.

This is related to another problem: the fact that most have been trained to believe that every morsel of data has value, and to not collect it is a sin. This is simply not true. Not every record in that yield monitor will lead to the promise of 400-bushel corn, and certainly not if it is only preserved in printed form.

So where do we go from here?

Making Big Data Actionable by Taking It Small
Rather than thinking about big data as only being a part of some collective pool or aggregate that’s easy to become lost in, re-engage in the process of collecting and using farm data by starting in small doses, then scale up from there.

Use the information gleaned from one field or even one zone. Take it one parcel or zone at a time, where success and failure can be more easily measured and tracked, and where a failure or error does not put the entire operation at risk. Also, try breaking field operations into separate, smaller job files to reduce risk in losing an entire dataset.

Big data has the potential to change the entire horizon of agriculture in the future, but don’t become too wrapped up in the “big” picture. Remember, the concept is nothing new, just the mechanization and digitization are. Step back to see the value in collecting good datasets, no matter how small they may seem, because small datasets can yield great results.

--

About the Author

Jacob Maurer is an Agronomist for RDO Equipment Co. based in Moorhead, MN. Connect with him on Twitter @RDOJacobM.

Interested in more about precision agriculture? Read our latest precision agriculture article about a new partnership between John Deere and Pessl Instruments.

To learn more about precision agriculture offerings from RDO Equipment Co., visit your local RDO Equipment Co. store.