SIXTH SENSE TECHNOLOGY

BY D.D.DIXIT

NRI INST OF TECH

BRANCH ELECTRONICS ANDCOMMUNICATION ENGG

THE TWO WORLDS

An introduction to the digital world and the real world

The Digital world

Why do we need the digital world ?
For computation For information Etc

Are we interested in computing or are we

interested in information?
As a common man we are interested in information

But on the go the vast information in the digital

world is confined to a small rectangular area, The monitor

The Real World

We are not evolved to work as machines sitting on in

front of other machines(computers).

We interact with the real world

objects around us.

We interact with objects using

gestures. They can be

used in isolation or involve external objects

GESTURES
The use of gestures in our every day world

Gestures
we utilize a broad range of gesture in

communication
The gestures vary greatly among contexts and

cultures yet we have a broad range of gestures that are almost universal

The categorizations
Cadoz
(using a function group)
Semiotic

Rime and Schiaratura (based on functionality)

Symbolic

to communicate meaningful information.

gestures that, within each culture, have come to have a single meaning.

Deictic

Gestures directing the listeners attention to specific objects in the environment.

Ergotic
manipulate the physical world and

Iconic

create artifacts.
Epistemic
learn from the environment

gestures used to convey information about the size, shape or orientation of the object of discourse.

Pantomimic

gestures typically used in showing the use of movement of some invisible tool or object in the speakers hand

THE INTEGRATION
How can we integrate digital world and real world?

Use Tracking Technologies

A Motion sensors such as a Nitendo Wii controller

Use real world objects in digital world

Microsoft Surface is the best example

The Gesture only approach

Diamond Touch by Circle Twelve technologies

THE EVOLUTION
The phases of development of sixth sense technology

Initial Phases
The idea

The head mounted object

The present phase

THE WORKING
Components and their interaction with each other

The peripherals
Camera:
A webcam captures an object in view and tracks the user's hand

gestures. It sends the data to the smart phone.

Colored Markers
Marking the user's fingers with red, yellow, green, and blue tape

helps the webcam recognize gestures.

Projector, Mirror
A tiny LED projector displays data sent from the smart phone on

any surface in view--object, wall, or person.

Smart Phone
A Web-enabled smart phone in the user's pocket processes the

video data, using vision algorithms to identify the object

The Design
Sixth Sense is a mini-projector coupled with a camera and a

cell phone
Sixth Sense can also obey hand gestures

The true power of Sixth Sense lies on its potential to

connect the real world with the Internet, and overlaying the information on the world itself
The key here is that Sixth Sense recognizes the objects

around you, displaying information automatically and letting you access it in the simplest way possible

PRESENT CAPABILITIES
The potential of the present sixth sense technology

Make a call Call up a map Take pictures Create multimedia reading experiences Get f light updates Check the time Get product information Feed you information on people

CONCLUSION
This wearable device with a projector paves the way for profound

interaction with our environment.

It will actually help us not to end up as machine sitting in front

of another machine.
Open source software will be available soon so that people

around the world can build their own wearable Sixth Sense
The research is still going on to develop the device where the

projector and the entire device can be fitted to shirt button which probably costs as an iPhone.

THE END

THANK YOU