New AI and Image Recognition Software Can Detect How Animals are Feeling

A new artificial intelligence algorithm could provide unprecedented insight into complex animal societies.

The ability for machine learning algorithms to analyse huge amounts of information are making them indispensable tools for conservation research.

Autor*in Mark Newton, 07.11.22

Translation Sarah-Indra Jungblut:

The confluence of image recognition software and machine learning has the potential to provide huge boons to research of all kinds, especially in the field of biodiversity. The technology has already been used in various projects to spot and identify animals in the wild, but a new process looks to take the concept even further.

Researchers at ETH Zurich have developed a new image analysis algorithm which not only identifies individual animals, but can even make estimations about how they are feeling, and even what they are thinking.

The researchers trained the machine learning algorithm on mice and macaques in a zoo environment. Through analysing the movements and actions of the animals, the algorithm can suggest if a particular animal is ill, or feeling fear, curiosity or even happiness. It also has the potential to unlock some of the complex secrets of animal society, such as the hierarchy of primate groupings and the role of grooming. Markus Marks, Professor of Neurotechnology at ETH Zurich, suggested the technology was particularly applicable to our nearest primate cousins:

“There is a lot of interest, especially among primate researchers. A group researching wild chimpanzees in Uganda uses our technology… Compared to previous behaviour analysis algorithms based on machine learning, our method has great advantages, especially when it comes to analysing social behaviour in complex settings.”

This is not the only project to understand the potential of facial and image recognition software. For example, finFindR uses machine learning to identify individual dolphins from their dorsal fins, while FishFace is another marine application using facial recognition technology to better log commercial fishing data.

On land, Google’s facial recognition software has been applied to rhinos – and their poachers – while the concept is not limited to visual images. Rainforest Connection uses microphones and artificial intelligence to listen in on jungles, tracking endangered parrots and detecting illegal logging.

However, in theory the same approach could be applied to practically any animal species. To this end, the team has made their technology available on a public platform, allowing it to be used across the world. Not only does this provide new tools, but also ensures researchers in different projects on different continents are using the same standard. This makes their work easily comparable, aiding collaboration and peer reviewing.

The advantage of these kinds of artificial intelligence applications is not only the insights they provide, but also the time and effort they save researchers. Previously, human researchers would be required to watch hours upon hours of footage to gain an understanding of animal behaviour. For example, the team highlights a recent study in which researchers had to manually watch hours of footage of elephants sleeping to develop a deeper understanding of the process. Such a task is likely to test the endurance of even the most enthusiastic elephant lover, and likely result in missed observations. The machine learning algorithm on the other hand can analyse huge amounts of information at the push of a button.

Not only does this save on time, labour and ultimately money, but a computer can maintain its level of performance throughout. This means the algorithm is likely better at detecting subtle changes in behaviour that develop slowly or over a longer period of time.

Currently, the team is exploring ways the technology could be applied to animal husbandry and conservation. For example, the algorithm could be used to monitor animals around the clock, automatically detecting abnormal behaviour and potentially catching illness at an earlier stage. It could also be used in the medical field to monitor test animals in an non-invasive way, reducing stress and the number of animals needed.

Your Smartphone’s Face Recognition Software Is Now Being Used to Identify Dolphins

Algorithms based on Google's face recognition software are now able to identify individual dolphins based on only their dorsal fins - boosting conservation efforts.

Google’s Facial Recognition AI Helps Identify Endangered Species in the Wild – and Their Poachers

Facial recognition tech is the latest tool in the fight against poaching, with London Zoo embarking on a new trial which could drastically improve conservation efforts.A new project, developed in collaboration with Google, will use machine learning and image recognition software to identify and catalogue animals snapped by remote motion-sensitive camera traps.

How Satellite Collars for Elephants Are Helping Tanzanian Rangers Get a Technological Edge Over Poachers

A new satellite collaring initiative aims to bolster the dwindling elephant numbers in Tanzania’s national game reserves.

A DNA Barcode Scanner Helps Tackle Illegal Wildlife Trade

Startup Conservation X Labs is developing a DNA scanner to help those on the front lines of conservation identify endangered species and tackle the illegal trafficking of wildlife.

AI Listening Devices Help Sumatra’s Rangers Topple Illegal Loggers

The conservationists and rangers of Sumatra's diverse rainforests have gained an AI ally in their fight against illegal logging.

Air Shepherd: Leading Rhinos and Elephants to Safety – With the Help of Drones

Air Shepherd flies drones to stop poaching. To date, they’ve piloted over 4,000 missions to stop rhino and elephant poachers. In their own words, their work is “reversing the march of extinction”. Here’s how.

How AI Can Advance Sustainable Logging and Cut Back on Deforestation

Trees are essential to our environment, but they're also a much needed building material. A German team is looking to use AI and data to create more sustainable forestry.

“Bio-logging” During Covid-19 May Provide a Unique Opportunity for the World’s Wildlife Trackers

In the absence of humans, are animals really reclaiming nature? Researchers issue a rallying call for global collaboration on high-tech wildlife tracking.