Microsoft PixelSense is the most revolutionizing technology over which can not only recognize touch but real objects as well. It is basically a combination of software and hardware which provides a natural user interface for better interaction with the device.

Microsoft PixelSense was initially launched as Microsoft Surface. Both the hardware and software were provided by Microsoft. The current version of PixelSense is Samsung SUR40 for Microsoft PixelSense which is a partnered product by Microsoft and Samsung.

The technology is designed especially for businesses that come across a lot of public interaction. It allows the businesses to provide their customers with a better shopping experience. The customers can interact with the products by using direct touch interactions and placing objects on the screen. The system is capable of identifying objects of different sizes, shapes and patterns. Based on the object identified, the system invokes a command to the processing unit.

The biggest advantage of PixelSense is that it does not require the use of traditional input devices like mouse, keyboard and camera etc. It is designed to accommodate several numbers of users at the same time. It can sense up to 52 touches simultaneously taking the device usage to next level, much ahead of the limitations of single-user devices.

How does it work?

Microsoft PixelSense is capable of identifying fingers, hands and objects placed on the display device. It enables vision-based interaction without the need of using a camera. Every individual pixel of the device is capable of identify activities like touch and objects placed on the screen and pass on the input received to the processing unit. The processing unit interprets the input received very quickly and throws out the desired output faster than the blink of the eyes. According to the official site of Microsoft PixelSense, this technology works in following steps:

The display device identifies a contact whether it is touch or an object
An IR light source located at the back provides light which passes through optical sheets, LCD and protection glass and ultimately hits the contact
The IR rays are reflected from the contact and are identified by the integrated sensors
The sensors convert the IR signals into electrical signals
A large number of such pixels work together to create a picture of what is placed on the display
The picture is analyzed using the image processing techniques
The output is sent to the PC. It includes the corrected sensor image and various contact types (fingers/blobs/tags)