Innovative research looking at the timing and sequence of bird calls could provide new insight into the social interaction that goes on between birds. It will also help teach machines to differentiate between man-made and natural sounds and to understand the world around them.
The work is being led by Dr Dan Stowell, a research fellow in machine listening at Queen Mary University of London (QMUL). It is supported through an Early Career Fellowship from the Engineering and Physical Sciences Research Council (EPSRC). An audio slide-show Deciphering the dawn chorus on this research is available on YouTube with examples of the bird recordings.
In August 2015, Dr Stowell's technology was released to the public in a smartphone app called Warblr. Users record the sound of a bird on their mobile device and the app analyses the sound, matches it with patterns of bird calls in its dataset and provides a list of possible species that the recording matches.
Dr Stowell is now building on this work to take the computer analysis of the sounds that birds make to a new level, to discover more about what messages are being communicated and who is dominating the conversations that are going on. "Traditionally you would take explicit measures of things like how long is this sound, what frequency is that sound?" says Dr Stowell. "To go beyond this we use modern machine-learning methods where you don't necessarily know how a computer has made a decision about a particular sound, but by training it, which means showing it lots of previous examples, we can encourage a computer algorithm to generalise from those."
At the University's laboratory aviary, female zebra finches provide Dr Stowell with plenty of audio examples for his work.
"We have put the timing of the calls together with acoustic analysis of the content of the call, for instance whether it is a short or long call. We examine factors such as does the probability of one bird calling increase or decrease after another bird calls or is there a more subtle interaction going on? Working out how strongly each bird influences another helps us to build a picture of the communication network that is going on in that group of birds."
In the longer term Dr Stowell's work could be used in a variety of areas, from deciphering the dawn chorus to how climate change is affecting bird migration patterns. It could be used to identify what is happening in historic birdsong recordings kept in places such as the British Library. It will also improve our understanding of the way other animal groups are socially organised and how human language evolved.
"In addition, we actually have quite a lot of applications in which machines are going to need to understand the world around them through sound as well as through vision," says Dr Stowell. "Whether it's self-driving cars, mobile phones or monitoring CCTV, what this work can feed into is a wider-ranging understanding and analysis of an ordinary sound environment."
The Great British public are also playing an important role in Dr Stowell's research. Since its launch, the Warblr app has led to the collection of more than 25,000 recordings from across the UK. But there is an element of unpredictability as a quarter of these recordings are not of actual birds but are instead people imitating the birdsong they have heard. These human imitations of birds are being used to teach computers not only how to distinguish between authentic and imitation bird song, but also how to separate them out from other types of sound, ranging from the ringing of a phone to the crying of a baby.
"This Big Data/Citizen Science aspect will contribute to the machine learning work, to help a computer analyse whether a particular sound is or is not made by a bird," adds Dr Stowell. "There are people creating projects right now where they have unattended microphone systems in a forest, that are recording and trying to identify which birds occur where. In order to be able to do that in any sort of scaleable way we're going to need algorithms that can say 'yes that is a bird' or 'no that is just a tree creaking in the wind'."
###
For more information contact Dr Dan Stowell, email: dan.stowell@qmul.ac.uk
For media enquiries contact: EPSRC Press Office, Tel: 01793 444 404, e-mail: pressoffice@epsrc.ac.uk
You can also find out more about Dr Stowell's EPSRC supported research at http://gtr.rcuk.ac.uk/projects?ref=EP%2FL020505%2F1
Notes for Editors:
The Engineering and Physical Sciences Research Council (EPSRC)
As the main funding agency for engineering and physical sciences research, our vision is for the UK to be the best place in the world to Research, Discover and Innovate.
By investing £800 million a year in research and postgraduate training, we are building the knowledge and skills base needed to address the scientific and technological challenges facing the nation. Our portfolio covers a vast range of fields from healthcare technologies to structural engineering, manufacturing to mathematics, advanced materials to chemistry. The research we fund has impact across all sectors. It provides a platform for future economic development in the UK and improvements for everyone's health, lifestyle and culture.
We work collectively with our partners and other Research Councils on issues of common concern via Research Councils UK. http://www.epsrc.ac.uk
Queen Mary University of London (QMUL) is one of the UK's leading universities with 23,120 students representing more than 160 nationalities.
A member of the Russell Group, we work across the humanities and social sciences, medicine and dentistry, and science and engineering, with inspirational teaching directly informed by our research. In the most recent national assessment of the quality of research, we were placed ninth in the UK amongst multi-faculty universities (Research Excellence Framework 2014).
As well as our main site at Mile End - which is home to one of the largest self-contained residential campuses in London - we have campuses at Whitechapel, Charterhouse Square, and West Smithfield dedicated to the study of medicine and dentistry, and a base for legal studies at Lincoln's Inn Fields.
Queen Mary began life as the People's Palace, a Victorian philanthropic project designed to bring culture, recreation and education to the people of the East End. We also have roots in Westfield College, one of the first colleges to provide higher education to women; St Bartholomew's Hospital, one of the first public hospitals in Europe; and The London, one of England's first medical schools.
Today, as well as retaining these close connections to our local community, we are known for our international collaborations in both teaching and research. QMUL has an income of £400m and a research income worth £137m (2015/16) and generates employment and output worth in excess of £700m to the UK economy each year.