Read the article here.

“The project, known as the Vocal Joystick, is designed to allow someone to control a computer cursor using nothing more than their voice … Malkin demonstrated the software in real-time, showing how it is used in conjunction with a simple game where a player controls a fish swimming around trying to catch other fish. He proceeded to sound out vowel after vowel, and sure enough, on-screen, his fish moved around dexterously, chomping up snack after snack. The Gnomedex crowd went wild.”

Vocal Joystick is a collaboration between UW Electrical Engineering and Computer Science & Engineering.