We have seen the potential of Xbox’s “Project Natal” a revolution in controller-less gaming. Being able to “talk with your hands” has its obvious advantages, but how can this technology prove useful in the real world? Unfortunately Xbox’s system is bound by an add-on peripheral that isn’t exactly portable. Luckily there are geniuses out there like MIT student Pranav Mistry, who can take this technology to the next level. He started out building his own gesture controllers out of mice, (the computer kind) and what he ended up with was a completely portable and versatile computer system that can interact with almost everything in your everyday life. The Sixth Sense technology has so many functions and possibilities that it is hard to describe in words, you need to watch the video to really understand.

Essentially this technology is composed of just a mini projector coupled with a camera and a cell phone. All of the information is stored on the web, but displayed through the projector. You can use any wall or object as a display, and just like Xbox’s project Natal, the controllers are replaced by your own hands. The camera picks up your gestures and uses them like a mouse. That is only the beginning of the potential that this system has. Unlike a normal computer system today, the only display you get is the screen in front of you. The Sixth Sense technology has unlimited possibilities by recognizing objects in front of you and using them as the display. Want to know if your flight is delayed? Just hold up your boarding pass and the information will be projected on it. The camera recognizes the object and sends the information to the internet where it is matched up; then, depending on its function, the projector will provide a visual aid. Is it the next big thing in technology? Probably.
The functions of this system are limitless. For example, if you want to take a picture, just use your hands as the viewfinder, and make a square with your fingers. Want to know what time it is? Just draw a circle on your wrist and a watch will appear. In a sense, you’re not actually removing the controller from the scenario, but you’re using everything around you as a controller. Pick up a book you might like and before you know it a projection of the rating will be on the cover, and then you can use the cover of the book just like a touch screen monitor if you need more information. Think about newspapers or paintings, the Sixth Sense system can project a real-time video in place of where a picture might be, and you don’t even need magic from Harry Potter!
-John Symonds