Organization

Lecture
Lecture takes place fortnightly on Tuesday, 09:30 12:45
Lecture dates: 24.4. 8.5. 22.5. 12.6. 26.6. 10.7.

Multimedia Systems

Exercises

Lehrstuhl fr Informatik 4 RWTH Aachen

Prof. Dr. Otto Spaniol Dr. rer. nat. Dirk Thien

Exercise takes place fortnightly on Tuesday, 10:00 12:00 Frontal exercise Exact dates depend upon the lecture dates Exercise sheets are provided on the web page two weeks before an exercise date

Organization
Slide Copies
Copies to the lecture slides as well as exercise sheets are placed on the web page to the lecture:
http://www-i4.informatik.rwth-aachen.de/content/teaching/lectures/sub/mms/mmsSS07/index-bonn.html

Literature

Written Exam
At the end of summer term

Books Steinmetz, R,; Nahrstedt, K.: Media Coding and Content Processing. Prentice Hall, 2002 Steinmetz, R.; Nahrstedt, K.: Multimedia Systems. Springer Verlag, 2004 Steinmetz, R.; Nahrstedt, K.: Multimedia Applications. Springer Verlag, 2004 Halsall, F.: Multimedia Communications. Addison-Wesley, 2001 Magazines Multimedia Systems, ACM/Springer Multimedia Magazine, IEEE

Contact Information for questions regarding lecture/exercises

Prof. Dr. Otto Spaniol, Dr. Dirk Thien Lehrstuhl fr Informatik 4, RWTH Aachen Ahornstrae 55, 52074 Aachen Phone: 0241 / 80 21400/21450 eMail: {spaniol, thissen}@informatik.rwth-aachen.de

4 egaP

2 egaP

emetsyS etlietrev dnu noitakinummoK 4 kitamrofnI rf lhutsrheL

emetsyS etlietrev dnu noitakinummoK 4 kitamrofnI rf lhutsrheL

Exercise dates: 15.5. 5.6. 19.6. 3.7.

noitcudortnI :1 retpahC

noitcudortnI :1 retpahC

3 egaP

1 egaP

emetsyS etlietrev dnu noitakinummoK 4 kitamrofnI rf lhutsrheL emetsyS etlietrev dnu noitakinummoK 4 kitamrofnI rf lhutsrheL noitcudortnI :1 retpahC noitcudortnI :1 retpahC

What is Multimedia?

Facets of Medium
1. Perception Medium - How do humans perceive information in a computer environment? (by seeing, by hearing, by haptic interfaces...) 2. Representation Medium - How is the information encoded in the computer? (ASCII, PCM, MPEG, ...) 3. Presentation Medium - Which medium is used to output information from the computer or to bring it into the computer? Output: paper, loudspeaker, monitor,... Input: keyboard, microphone, camera, ... 4. Storage Medium - Where is the information stored? 5. Transmission Medium - Which kind of medium is used to transmit the information? (copper cable, radio, ...) 6. Information Exchange Medium (combination of storage and transmission media) Which information carrier will be used for information exchange between different locations?

Simple definition of Multimedia:

Multi - Media

Any kind of system that supports more than one kind of medium Is Television Multimedia?

Definition: Multimedia means the integration of continuous media (e.g., audio, video) and discrete media (e.g., text, graphics, images) through which the digital information can be conveyed to the user in an appropriate way. Multi: Medium: many, much, multiple A means to distribute and represent information

Classification of Media
Each medium defines Representation values Representation space Representation values determine the information representation of different media: continuous representation values (e.g. electro-magnetic waves) discrete representation values (e.g. characters of a text in digital form) Representation space determines the technique to output the media information, usually visually (e.g., paper, slideshow) or acoustically (e.g., speakers) Spatial dimensions: Two dimensional (2D graphics) Three dimensional (holography) Temporal dimensions: Time independent (document) - discrete media (e.g. text of a book) Time dependent (movie) - continuous media (e.g. sound, video)

Classification of Media: Data Streams

When transmitted or played out, continuous media need a changing set of data in terms of time, i.e. data streams. How to deal with such streams? Asynchronous Transmission Suitable for communication with no time restrictions (discrete media) No coordination between sender and receiver Synchronous Transmission Beginning of transmission may only take place at well-defined times A clock signal runs the synchronization between a sender and a receiver Isochronous Transmission Periodic transmissions, time separation between subsequent transmissions is a multiple of a certain unit interval A maximum and a minimum end-to-end delay for each packet of a data stream (limited jitter) is required An end-to-end network connection is isochronous if it has a guaranteed bit rate and if the jitter also is guaranteed and small

8 egaP

6 egaP

emetsyS etlietrev dnu noitakinummoK 4 kitamrofnI rf lhutsrheL

emetsyS etlietrev dnu noitakinummoK 4 kitamrofnI rf lhutsrheL noitcudortnI :1 retpahC noitcudortnI :1 retpahC 7 egaP 5 egaP

emetsyS etlietrev dnu noitakinummoK 4 kitamrofnI rf lhutsrheL emetsyS etlietrev dnu noitakinummoK 4 kitamrofnI rf lhutsrheL noitcudortnI :1 retpahC noitcudortnI :1 retpahC

Data Stream Characteristics

Strongly periodic data streams Identical intervals T No jitter (optimally) Example: uncompressed audio Weakly periodic data streams Periodic intervals T Timing variations in the intervals Example: segmented transmission Aperiodic data streams Arbitrary intervals Example: transmission of mouse control signals

Data Stream Characteristics

Strongly regular data streams Quantity remains constant during the entire lifetime of the stream Typical for uncompressed video/audio Weakly regular data streams Quantity varies periodically Can result from some compression techniques E.g. videos coded with MPEG Irregular data streams Quantity is neither constant nor periodically changing Typical for compressed audio/video Harder to transmit/process
T D1 D1 D1 D1 D1 t

t T

t T1 T2 T T3 T1 T2 T T3

t T1 T2 T3 T4 T5 T6

Fields of the Lecture

Applications Usage Learning Design User Interfaces Group Communication

Content
Chapter 2: Representation of Multimedia Data Audio Technology Images and Graphics Video Technology Chapter 3: Multimedia Systems - Communication Aspects and Services Voice over IP, Video conferencing Group Communication, Synchronization Quality of Service and Resource Management Chapter 4: Multimedia Systems Storage Aspects Optical storage media Multimedia file systems

Services

Content Analysis

Documents

Security

Synchronization

Databases Systems Media Server Optical Storage

Programming Communication Networks

Operating Systems Quality of Service Compression

Basics

Computer Architecture

Graphics & Images

Animation

Video

Audio

21 egaP

01 egaP

emetsyS etlietrev dnu noitakinummoK 4 kitamrofnI rf lhutsrheL

emetsyS etlietrev dnu noitakinummoK 4 kitamrofnI rf lhutsrheL

T D1 D2 D3 D1 D2 D3 t D1 D2 D3

noitcudortnI :1 retpahC

noitcudortnI :1 retpahC

11 egaP

9 egaP

emetsyS etlietrev dnu noitakinummoK 4 kitamrofnI rf lhutsrheL emetsyS etlietrev dnu noitakinummoK 4 kitamrofnI rf lhutsrheL noitcudortnI :1 retpahC noitcudortnI :1 retpahC

...

Dn t