Office of the Vice President for Global Communications

Wednesday, December 2, 2009

iPhones are musical instruments in new course, ensemble

More online

• Learn more about the Michigan Mobile Phone Ensemble.
• Watch a video of a practice performance.

A new course at U-M uses iPhones as musical instruments. The students — who design, build and play instruments on their smartphones — will perform at a public concert Dec. 9.

Building a Mobile Phone Ensemble, believed to be the first such course in the world, is taught by Georg Essl, a computer scientist and musician who has been driving the development of mobile phones as musical instruments.

Several years ago, Essl and his colleagues were the first to use the microphone as a wind sensor — a tactic that enables popular iPhone apps such as the Ocarina. Ocarina essentially turns the phone into an ancient type of flute. Essl is an assistant professor in the Department of Electrical Engineering and Computer Science and the School of Music, Theatre & Dance.

“The mobile phone is a very nice platform for exploring new forms of musical performance,” Essl says. “We’re not tethered to the physics of traditional instruments. We can do interesting, weird, unusual things.

“This kind of technology is in its infancy, but it’s a hot and growing area to use iPhones for artistic expression.”

To build an instrument on an iPhone, users program the device to play back as sound information it receives from one if its multitude of sensors. The touch-screen, microphone, GPS, compass, wireless sensor and accelerometer can all be transformed so that when people run a finger across the display, blow air into the microphone, tilt or shake the phone, for example, different sounds emanate.

The class demands creativity and technological savvy.

“In order to come up with a creative piece you have to engage with the technology, but in order to make technology interesting, you also have to engage with the musicality. These are really hard to separate. We’re trying to teach both,” Essl says.

The Michigan Mobile Phone Ensemble concert is at 8 p.m. Dec. 9 in Britton Recital Hall in the Moore Building at the School of Music, Theatre & Dance. The Moore Building is at 1100 Baits Dr. on North Campus.

The ensemble will continue to play and experiment with sound next semester.