Académique Documents
Professionnel Documents
Culture Documents
Denis Perevalov
perevalovds@gmail.com
video: www.youtube.com/perevalovds#g/u
lections: www.uralvision.blogspot.com
Institute of Mathematics and Mechanics, Ural Branch of Russian Academy of Sciences
http://www.instablogsimages.com/images/2008/01/04/aperture-interactive-display_48.jpg
Contents
1. What is controller
2. Computer vision as universal controller
3. Video cameras for computer vision
4. Controllers based on computer vision I
5. Controllers based on computer vision II
6. Programming technologies
7. The prospects
1. What is controller
Definition of controller
Controller is any sensor, any source of data, which can be converted into digital
signal.
Proximity sensor
Standard musical controllers
Standard instruments
Midi track control Breath controller with MIDI output
Actually, these are musical instruments or tools for intruments, which output digidal data
about the sound instead of sound.
Controllers of human motion
Multitouch
Motion Capture
Biosensors
http://neurocenter.unige.ch/groups/pun.php
Controllers of physical phenomenas
Analysis of motion
Segmentation
(optical flow)
What is computer vision
http://armi.kaist.ac.kr/korean/UserFiles/File/MMPC.JPG
Computer vision as universal controller
1. Resolution
http://www.mtlru.com/images/klubnik1.jpg
Number of frame per second
http://www.youtube.com/watch?v=7iEvQIvbn8o
Type of output data
Data type:
visible light,
IR (you need to remove IR-filter)
Price: 50$.
USB, CCD
Examples
Point Grey Flea3
648 x 488 : 120 FPS
Data type:
- visible light,
- IR (?)
Price: 600$.
Model FL3-FW-03S1C-C
IEEE 1394b, CCD
Examples
Microsoft Kinect
640 x 480 : 30 FPS
Data type:
color image + depth
Price: 150$.
(depth is received using special IR pattern,
so will not work in direct sunlight)
USB, CMOS
Examples
Point Grey BumbleBee2
640 x 480 : 48 FPS
Data type:
color image + depth
Price: 2000$.
http://www.touchuserinterface.com/2010/02/lcd-multi-touch-using-inverted-ftir.html
http://sites.google.com/site/ideolabsdocumentation/images/multitouchdiagram.png
Virtual reality gloves
Color gloves using one webcamera only, in MIT (prototype)
http://www.csail.mit.edu/videoarchive/research/gv/hand-tracking
Motion Capture
http://susiemander.files.wordpress.com/2010/10/facial-expression.jpg