Technology promises control of smartphones through hand gestures


The Computer Science & Engineering Department at the University of Washington has made a name for itself as an innovator and is further cementing that reputation with its latest development, AllSee, which allows users to control devices with hand gestures, even when the devices are out of sight. 

Say you want to mute the song that’s playing on your smartphone. Simply flick your finger in the air and it’s done — even with the phone hidden away in your pocket. AllSee uses wireless signals to detect motion, then translates changes in the signals to create a specific command. It also harvests existing TV signals as a power source, eliminating the need for a battery. Consisting of nothing more than a wire and a processor, it can be assembled for less than a dollar.

The entire project came together in less than a year. Vamsi Talla, who created the AllSee prototype with fellow graduate student Bryce Kellogg, says, “It has a lot of potential in mobile phones, especially issuing commands without a camera. Moving forward, the main reason AllSee is attractive is because of its low power consumption.” Existing gesture-recognition systems require a lot of power and computational resources.

AllSee is already garnering attention from the tech world. Assistant Professor Shyam Gollakota says the technology has many potential applications that attract would-be investors, but mainly it’s the gesture-recognition technology that doesn’t need a camera or direct line of sight to operate. “Your phone can be in your pocket or in your bag and you can actually interact with it,” Gollakota says.

While the team hasn’t aimed its sights at the likes of Microsoft’s Kinect technology, it’s not hard to imagine AllSee being taken to levels that may rival the camera-dependent Kinect. Smartphone technology may be the first step, since the implications for consumer household electronics — controlling the thermostat and appliances, for instance — are enormous. 

To watch a video about AllSee, please visit

Related Content

Juno Therapeutics has recruited former Genentech researcher Sunil Agarwal to head up a revamped research organization, according to an article in Endpoints, a biotech newsletter.

Ever since his school days on Mercer Island, Jake Rubin has dreamed of creating a holodeck like the one on the Star Trek television series — a virtual reality experience so immersive that it is perceived as real.

Seattle-based Convoy has been busy since it launched — with a splashy roster of investors — an online service linking shippers and truck-freight carriers in October 2015.

Textio uses a machine-learning engine to tailor job postings so companies get more candidates who are better suited to job openings.