Sixth Sense Technology

What is Sixth Sense Technology?

Sixth Sense Technology integrates digital information into the physical world and its objects, making the entire world your computer. It can turn any surface into a touch-screen for computing, controlled by simple hand gestures. It is not a technology which is aimed at changing human habits but causing computers and other machines to adapt to human needs. It also supports multi user and multi touch provisions. Sixth Sense device is a mini-projector coupled with a camera and a cell phone-which acts as the computer and your connection to the Cloud, all the information stored on the web. The current prototype costs around $350. The Sixth Sense prototype is used to implement several applications that have shown the usefulness, viability and flexibility of the system

Introduction of Sixth Sense Technology

'Sixth Sense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information the hardware components are coupled in a pendant like mobile wearable device. The Sixth Sense prototype is comprised of a pocket projector, a mirror, coloured marker and a camera. The camera, mirror and projector is connected wirelessly to a blue tooth smart phone device that can easily fit into the user's pocket, Software then processes the data that is collected by the capturing device and produces analysis. The software that is used in sixth sense device is open source type.

The Sixth Sense prototype contains a number of demonstration applications.

• The map application lets the user navigate a map displayed on a nearby surface using hand gestures to zoom and pan
• The drawing application lets the user draw on any surface by tracking the fingertip movements of the user’s index finger.
• Sixth Sense also implements augmented reality projecting information onto objects the user interacts with. For example a paper newspaper can be augmented with projected dynamic live information.

The system recognizes a user's free hand gestures as well as icons/symbols drawn in the air with the index finger, for example:

• A 'framing' gesture takes a picture of the scene. The user can stop by any surface or wall and flick through the photos he/she has taken.
• Drawing a magnifying glass symbol takes the user to the map application while a ‘@’ symbol lets the user check his mail.
• The gesture of drawing a circle on the user’s wrist projects an analog watch

Gesture Recognition 

It is a technology which is aimed at interpreting human gestures with the help of mathematical algorithms. Gesture recognition technique basically focuses on the emotion recognition from the face and hand gesture recognition. Gender recognition technique enables humans to interact with computers in a more direct way without using any external interfacing devices. It can provide a much better alternative to text user interfaces and graphical user interface which requires the need of a keyboard or mouse to interact with the computer. An interface which solely depends on the gestures requires precise hand pose tracking. In the early versions of gesture recognition process special type of hand gloves which provide information about hand position orientation and flux of the fingers. In the Sixth Sense devices coloured bands are used for this purpose. Once hand pose has been captured the gestures can be recognized using different techniques. Neural network approaches or statistical templates are the commonly used techniques used for the recognition purposes. This technique has an high accuracy usually showing accuracy of more than 95%. Time dependent neural network will also be used for real time recognition of the gestures

APPLICATION 

The sixth sense technology finds a lot of application in the modern world. The sixth sense devices bridge the gap by bringing the digital world into the real world and in that process allowing the users to interact with the information without the help of any machine interfaces. Prototypes of the sixth sense device have demonstrated viability, usefulness and flexibility of this new technology. According to the words of its developers the extend of use of this new device is only limited by the imagination of human beings

 

The sixth sense recognizes the objects around us and displays the information relating to those objects in a real time environment. The sixth sense technology allows the user to interact the information through hand gestures. This is a quiet efficient way compared to the text and graphic based user interface. It has the potential to form the transparent user interface for accessing the information around us.

# BitSprint Team