Zenph Studios, a software company based in Raleigh, has found a way to take a music recording and convert it into a live concert played on real instruments. The concert will be a completely faithful rendition of the original pianists' work.
Zenph resurrected a scratchy mono recording of Bach's Goldberg Variations, made by the Canadian pianist Glenn Gould in 1955 and a recording of a Chopin prelude by Alfred Cortot in 1928. Cortot died in 1962, Gould in 1982.
The breakthrough that Zenph has achieved is to extract the sounds from audio recordings and convert them into a high-resolution version of MIDI, the standard way of coding music for computers. To do so they had to tackle the problem of polyphonic transcription- distinguishing several notes played simultaneously. While researchers have been trying to achieve this for years, previous attempts have managed to identify at best 80 to 90 per cent of notes correctly- with about 10 per cent missing and another 10 per cent wrong (New Scientist, 22 December 2001, p 50).
Zenph now says it has found a way to do this, although for commercial reasons it won't release the details. But the company is confident enough to have organised the concert, at which a Disklavier Pro piano, one of a handful of concert grands that can record and play back high-definition Midi files, will replay Gould and Cortot's work. The piano will replicate every note struck, down to the velocity of the hammer and position of the key when it was played.
"We have only begun seeing excellent results in the past few weeks," says John Walker, president of Zenph Studios. "The results are note perfect." Walker has an impressive track record. Before founding Zenph in 2002, he was a leading developer of VoIP, the system that allows phone calls to be carried on the internet.
Walker says that the precise timing of notes is almost as important as identifying the correct notes. One of Zenph's final checks is to play back the conversion on the Disklavier and to make an audio recording of it. The engineers then play back a stereo version of the music: one channel has the original recording, the other has the recording of the conversion. "If they're different by even a few milliseconds, the ear immediately identifies that something's wrong- there's a slight echo effect," Walker says.
"The project at Zenph is definitely very, very interesting," says Anssi Klapuri of the Tampere University of Technology, Finland, who is one of the world's leading experts on polyphonic transcription.
The company is now working on a recording made at a private party by the jazz giant Art Tatum two years before his death in 1956. There are many recordings that have never been released because of some flaw, such as background noise or an out-of-tune piano. Zenph hopes that recording companies will use the new technology to make recordings from this type of material, or to clean up noisy recordings.
PLEASE MENTION NEW SCIENTIST AS THE SOURCE OF THIS STORY AND, IF PUBLISHING ONLINE, PLEASE CARRY A HYPERLINK TO: http://www.newscientist.com
THIS ARTICLE APPEARS IN NEW SCIENTIST MAGAZINE ISSUE: 23 APRIL 2005
Author: Mick Hamer
"This article is posted on this site to give advance access to other authorised media who may wish to quote extracts as part of fair dealing with this copyrighted material. Full attribution is required, and if publishing online a link to www.newscientist.com is also required. The story below is the EXACT text used in New Scientist, therefore advance permission is required before any and every reproduction of each article in full. Please contact celia.thomas@rbi.co.uk. Please note that all material is copyright of Reed Business Information Limited and we reserve the right to take such action as we consider appropriate to protect such copyright."