IBM Smart Surveillance System

ECCV 2006 Demonstration proposal

Andrew Senior, Arun Hampapur, Chiao-Fe Shu, Ying-Li Tian, Lisa Brown, Max Lu

Contact:
Andrew Senior. IBM T.J. Watson Research Center
aws@us.ibm.com Exploratory Computer Vision Group,
Phone: +1(914) 784 7217 PO Box 704, Yorktown Heights, NY 10598-0218
Fax : +1(914) 784 7455 http://www.research.ibm.com/people/a/aws

We propose to demonstrate the IBM Smart Surveillance System.

http://www.research.ibm.com/peoplevision/
This provides an end-to-end system for surveillance analytics, data management, search
and visualization. We would demonstrate the web-based interface to a live surveillance
database at our site, demonstrating searches and surveillance data visualization. At the
same time we would demonstrate the video analytics used to generate the database
content: moving object tracking and classification, face detection and tracking, together
with the automatic instant alerts that the system is capable of producing (virtual tripwire,
directional motion, abandoned object, object removal) and some more advanced analytics
(people counting, automatic calibration for scale normalization, automatic PTZ camera
control, video privacy protection).

The demonstration would consist of a laptop (need a broadband internet connection for
live demo, otherwise would demo with stored content on the laptop) and a poster with
written explanation. We would like a table for the laptop.

Different components of the system have been described in various publications

including those listed below.

# Enabling Video Privacy through Computer Vision

A. Senior, S. Pankanti, A. Hampapur, L. Brown, Y.-L. Tian, A. Ekin, J. Connell, C.-F. Shu, M.Lu
IEEE Security & Privacy V. 3 No.5 May/June 2005.

# Smart Video Surveillance

A. Hampapur, L. Brown, J. Connell, A. Ekin, N. Haas, M. Lu, H. Merkl, S. Pankanti, A. Senior, C.-
F. Shu, Y.-L. Tian
In IEEE Transactions on Signal Processing Volume 22, No. 2 March 2005

# Appearance Models for Occlusion Handling

A. Senior, A. Hampapur, Y.-L. Tian, L. Brown, S. Pankanti, R. Bolle
To appear in Journal of Image and Vision Computing

# Distributed Active Multi-camera Networks

A. Senior, A. Hampapur, L. Brown, Y.-L. Tian, C.-F. Shu and S. Pankanti
in Ambient Intelligence ed. P.Remagnino. G.L. Foresti and T.Ellis. Kluwer Publishing 2004.
# IBM Smart Surveillance System (S3): A Open And Extensible Framework For Event Based
Surveillance
L. Brown, J. Connell, A. Hampapur, M. Lu, A. Senior, C.-F. Shu, Y. Tian
In Proceedings of the International Conference on Advanced Video- and Signal-based
Surveillance September 2005.

# A Joint System For Person Tracking and Face Detection

Z. Zhang, G. Potamianos, A. Senior, S. Chu and T. Huang
In Proceedings of HCI workshop, ICCV 2005.

# Acquiring Multi-Scale Images by Pan-Tilt-Zoom Control and Automatic Multi-Camera

Calibration
A. Senior, A. Hampapur
In Workshop on Applications of Computer Vision Jan. 2005.

# Performance Evaluation of Surveillance Systems Under Varying Conditions

Lisa M. Brown, Andrew W. Senior, Ying-li Tian, Jonathan Connell, Arun Hampapur, Chiao-fe Shu,
Hans Merkl, and Max Lu
In IEEE Int'l Workshop on Performance Evaluation of Tracking and Surveillance Jan. 2005.