This is how the Time-of-Flight camera perceives a sugar beet. The yellow parts of the plant are closer to the camera lens than the blue ones. (Photo: ASETA project)
The field robots are fitted with a highly accurate camera called SwissRanger SR4000 TOF Camera. The camera can recognise the shape of a blade and thereby determine whether or not the plant is a utility plant. (Photo: ASETA project)
Karl Damkjær Hansen is making adjustments to one of the field robots. Under the lid is a laptop, which serves as the robot’s ‘brain’. (Photo: ASETA project)
The ASETA team. The development of the robotic system is a collaboration between Aalborg and Copenhagen Universities and R&D company NBR Nordic Beet Research. (Photo: ASETA project)
Karl Damkjær Hansen pictured next to a field robot. The researchers are hoping that within a couple of years the robot will replace the tractor in the background. (Photo: ASETA project)
The two types of robots. The helicopter can monitor the field from above, enabling it to effectively control the field robot. (Photo: ASETA project)
The research team is testing two types of helicopter. Pictured here is a modified Maxi Joker-3. It is battery-driven and weighs 11 kg. (Photo: ASETA project)
An autonomous helicopter just before take-off. The helicopter can be compared to the drones we know from modern warfare, and according to many researchers they will be used in agriculture within a couple of years. (Photo: ASETA project)
One of the field robots. It weighs 140 kg and runs on batteries. Its job is to remove weeds and measure the crop growth stage and the soil nitrate content. (Photo: ASETA project)

Robots will soon replace the tractor

Drone-like helicopters and field robots that can automatically detect weeds are only a couple of years away, say researchers.

Published

It sounds like technology from a science fiction movie: robots that automatically take care of a farmer’s crops. But according to Danish researchers, it won’t be long before this is a reality.

”We’re in the process of developing a fully automatic robotic system that can automatically detect weeds and spray them. The system works by means of small unmanned helicopters and small ground vehicles,” says PhD fellow Karl Damkjær Hansen, of Aalborg University’s Department of Electronic Systems Automation & Control.

“The helicopter takes aerial photographs which reveal the sections of a field that are particularly plagued by weeds. A ground vehicle then automatically drives to those sections, where it identifies the individual weeds and removes them.”

Multitasking robots

The researchers behind the new system believe it can perform several task at once. In addition to removing weeds, the robots are also designed to measure the crop growth stage as well as the soil nitrate content.

The helicopter takes aerial photographs which reveal the sections of a field that are particularly plagued by weeds. A ground vehicle then automatically drives to those sections, where it identifies the individual weeds and removes them.

Karl Damkjær Hansen

All the data collected by the robots is then stored in a map of the field, so the farmer can make informed decisions about harvest time, crop rotation and the like.

Hansen’s role in the development of the robotic system is to get the robots to plan the most effective route and to co-ordinate their movements.

”It’s a great challenge to get a computer program to automatically figure out the optimal route,” he says.

“It may not sound all that difficult if you have just a single robotic lawnmower. But when you have five helicopters and ten field robots and everything has to harmonise, it soon becomes incredibly complex.”

Similar to Xbox technology

We’ve come a long way in terms of training the system to recognise weeds. It works a bit like an Xbox Kinect system – but our cameras are a lot more accurate.

Karl Damkjær Hansen

While Hansen is working on optimising the robots’ movements, his colleagues are working on other parts of the system, including programming the system to distinguish weeds from crops.

”We’ve come a long way in terms of training the system to recognise weeds. It works a bit like an Xbox Kinect system – but our cameras are a lot more accurate,” says Hansen.

Whereas the Kinect sensor is designed to recognise and distinguish people’s movements, the cameras on the robots recognise plants and can distinguish between them.

”We’re using two types of cameras. A so-called Time-of-Flight (TOF) camera, which detects the three-dimensional form of objects. This camera can capture the shape of a leaf and determine whether it’s a sugar beet or a thistle. We’re also using ‘regular’ cameras to analyse the colours of the plants and determine whether or not they are utility plants.”

Robots can calibrate themselves

The development of the comprehensive robotic system started two years ago as part of a project called ASETA (Adaptive Surveying and Early treatment of crops with a Team of Autonomous vehicles).

The robots are usually quite adept at solving the various tasks in the lab, but when they’re let loose in the fields, they tend to struggle.

“Reality is complex,” says Hansen. ”For instance, sunlight and shadow make it hard to use colours to determine whether a plant belongs to one group or another.”

Automating the entire robotic system so that it can figure out by itself where and how much to spray is a big challenge. But the researchers are adamant that the system should be able to control and calibrate itself – even without the farmer having to know anything about the technology.

“The robotic system is designed to solve the tasks independently. The farmer should only need to press a button and the whole thing will run automatically.”

Farming drones only a few years away

Weeds have always been a major concern for farmers. Weeds compete with crops for sunlight, water and nutrients. On a global scale, uncontrolled weeds cause an average production loss of 34 percent.

So far in the development of the robotic system, the researchers have only focused on sugar beets and thistles. They are, however, planning to make a system which is capable of looking after all types of crops, for instance oats or barley. In other words, there is a lot of refinement work left to do.

”It may take ten years before you’ll be seeing complete robotic systems like ours,” says Hansen.

But certain parts of the technology will soon be seen in modern agriculture.

Farmers have already started using aerial photography to gain knowledge about crops and weeds. These photos are currently being taken from planes, which is both expensive and troublesome. But this will soon change, says the researcher:

A Time-of-Flight camera emits infrared light and measures the time it takes for the light to be reflected from an object to when it returns to the camera.

This enables the camera to capture the three-dimensional shape of the surroundings.

“I believe that within the next two years we’ll be seeing drones hovering over the fields.”

----------------------------------

Read the Danish version of this article at videnskab.dk

Translated by: Dann Vinther

Scientific links

External links

Related content
Powered by Labrador CMS