Vous êtes sur la page 1sur 66

Multimedia Communication Systems

Tien Pham Van Hanoi University of Technology

Agenda Concept of stream IP-based TV Video Conferencing Wireless Multimedia: IMS

A short list of Embedded Systems


Auto focus cameras ATMs Avionic systems Automatic transmission Battery Chargers Camcorders Cell phones Cordless Phones Digital Cameras DVD players Electronic Toys/Games Fax machines Medical Equipment Microwave ovens Modems
and many more .

Network cards Pagers PDAs Photocopiers Portable Video games Pont of Sales terminals Printers Scanners Satellite phones Teleconferencing systems Televisions Set-top boxes VCRs Video phones Washers and dryers

What is mobile device?

camera

camcorder

TV

radio

game

PDA

makeup device?

army knife?

Data Streams
Distributed multimedia communication systems
data of discrete and continuous media are broken into individual units (packets) and transmitted.

Data Stream
sequence of individual packets that are transmitted in a time-dependant fashion. transmission of information carrying different media leads to data streams with varying features
Asynchronous Synchronous Isochronous
5

Networking requirements of multimedia data


Quality of Service (QoS) QoS can be parameterized from an end-to-end point of view: - Bandwidth Required - Delay - Delay Jitter (Variation of a delay) - Reliability (Error rate) There are 2 categories of QoS services: - Resource reservation: network resources are allocated according to requests and the QoS management policy. - Prioritization: the network allocates more resources to packets that have a higher priority.

Layered Code in Multimedia Systems


SENDER Sampling/Encoding Streaming Application Real-time Transport Protocol (RTP) (Packetization) UDP RECEIVER Decoding/Playout Streaming Application Real-time Transport Protocol (De-Packetization UDP

IP Ethernet

IP Ethernet

Real-Time Transport Protocol (RTP)

IPTV

IPTV applications
Homeowner entertainment Digital television On-demand video Business TV on desktop Distance learning Corporate communications Mobile phone television Video chat

M hnh IPTV

IPTV qua m ng Mobile Device Wifi / wimax ADSL Computer

Network ADSL Hybrid fibre coax Set-top Box

Cable Set-top Box

Protocols - http - rtsp - igmp

Software
Microsofts Windows Media Player Apple Computers QuickTime Real Networks RealPlayer Macromedias Flash Player VLC Media Player

Video Conferencing Systems

What is video conference?


Video phone: Video conference (also known as a video teleconference -VTC)
A set of interactive telecommunication technologies which allow two or more locations to interact via two-way video and audio transmission simultaneously Designed to serve a conference rather than individuals

Traditional components
Endpoints Infrastructure products
Gateways Gatekeepers Border controllers MCUs

Other required components


The other components required for a VTC system include: Video input : video camera or webcam Video output: computer monitor , television or projector Audio input: microphones Audio output: usually loudspeakers associated with the display device or telephone Data transfer: analog or digital telephone network, LAN or Internet

What is endpoint?
Endpoint of the video architecture = the hardware components through which user send and receive video. Requirements:
Should share a common user interface Work on a wide variety of networks and protocols : IP,ISDN,V.35,SIP,SCCP and 3G. Quality, reliability and the ability to integrate with other communication systems (for example: instant message, web conferencing , existing video and audio feeds, IP telephony etc)

Endpoint category
Endpoint can be grouped into:
Personal systems. Group systems: Industry-or application-specific systems:

Examples of endpoint

Infrastructure products
Infrastructure products = components through which video are routed, merged and/or converted to other protocols in order for each endpoint to reach its destination. Category:
Gatekeeper Border controller Gateway MCU

Gatekeeper
Gatekeeper provides critical functionality to enable IP video communication. Include:
Alias Zone management Call management Authentication

TANDBERG Gatekeeper

Border controller
Allows H.323 traffic to traverse the firewall Create a specific rule for H.323 video Requirement:
Should be non-intrusive in regards to existing network design, allowing for easy deployment.
TANDBERG Border Controller

Multipoint control units (MCU)

Enables video conferences between three or more persons. Like a bridge that interconnects calls from several sources Key feature:
Include non-blocking design, transcoding, rate matching, continuous presence and highest level encryption technologies

Development trend
Complicated functions are implemented in software to increase flexibility Highly distributed protocols, particularly SIP and its variants, tend to replace high-complexity and less scalable H.323 and the like P2P streaming emerges as a promising protocol architecture
Highly scalable since less centralization Mobilizing better resources of participants Disadvantages in: session discontinuity, dynamic connectivity, end-toend latency (due to e.g. swarming), security

IMS

Overview of the IP Multimedia Subsystem


Specified by the Third Generation Partnership Project (3GPP) Technology intended to merge the Internet with the cellular world IMS architecture enables and enhances IPbased integrated multimedia services Services available everywhere in an heterogeneous network environment (UMTS, WiFi, WiMAX, etc.)

The main new protocols used are SIP and DIAMETER

IMS Core Network Overview


Community Messaging

Service Layer
Online Games IPTV Voice

Service Layer Group Mgmt

IMS Core
Fixed Broadband Access Mobile Access network

Residential Network
CSCF=Call Session Control Function

Basic Core Functionalities


IMS only deals with the signalling/control plane Based on IP technology, the main nodes are:
P-CSCF (Proxy Call Session Control Function): UEs entry point I-CSCF (Interrogate Call Session Control Function): at the edge of an administrative domain, location management S-CSCF (Serving Call Session Control Function): Session management and SIP message routing services MGW (Media Gateway) MGCF (Media Gateway Control Function) HSS (Home Subscriber Server) BCGF (Breakout Gateway Control Function)

What is the Service Layer?


Service Layer
Messaging Community On/line Games IPTV

Service Layer Group Mgmt


Authentication Authorization

Voice

QoS Control

IMS Core
Fixed Broadband Access Mobile Access network

Residential Network

FMC and Converged Services


Fixed Mobile Convergence (FMC) aims at providing both services with a single phone, which could switch between networks (e.g. DECT and UMTS). Converged services:
A converged service uses a combination of multiple service access points, such as SIP and HTTP. The HTTP interface can be used to configure the service and retrieve service status information. A Click-to-dial service allows you to click on a hyperlink on a web page which invokes a SIP service

NGN Backbone

UMTS

PSTN

DECT

Multimedia Communications over Wireless Multihop Networks

Ad hoc wireless network

Formed by nodes that: are heterogeneous mobile devices communicate solely over wireless links join and leave the network frequently Suitable for field applications no communication infrastructure needed possibly deploy real-time applications such as multimedia

Field applications Rescuing Activities Fire, accidental crashes Natural disasters: storms, earthquakes, flooding Collaborative Activities Working groups over the fields Environment protection Public events (festivals, sports, etc) Building blocks for other potential applications Inter-vehicle multimedia communications

Challenges Limitation in communication/computation resource (CPU, memory, bandwidth, etc) energy: nodes rely on battery Network connections are unstable erroneous Multimedia traffic heavy and bursty time-sensitive

Research themes
Redundant transmission significant overhead
Node 1
pa th

Node 0

Video source

Path diversity supported by routing protocols Path diversity supported by routing protocols

Pri ma ry

Node 3
ath Ex ten de dp

Node 2

Proactive intermediate node architecture video-cooperative forwarder Optimal scheduling (e.g. CoDiO) high complexity
Receiver Node 5

Node 4

MULTIPATH MULTIMEDIA TRANSPORT ARCHITECTURE OVERVIEW At the sender, raw video is first compressed by a video encoder into M streams. We call the coder a multistream coder. Then the streams are partitioned and assigned to K paths by a traffic allocator. These paths are maintained by a multipath routing protocol. When the flows arrive at the receiver, they are first put into a resequencing buffer to restore the original order. Finally, the video data is extracted from the resequencing buffer to be decode and display decoded displayed.

70

The general architecture for the multipath transport of real-time multimedia applications:

point to point video communications

71

The general architecture for the multipath transport of realtime multimedia applications:

concurrent streaming

multicast using two trees

72

LC with ARQ

the two-path layered video transmission model with selective ARQ for base layer packets

73

Cross-Layer Design for Real-Time Media


Loss-resilient source coding and packetization Application layer

Throughput
Congestion-distortion optimized scheduling Congestion-distortion optimized routing Capacity assignment

Packet deadlines Rate-distortion preamble


Transport layer

Traffic flows

Network layer

Link capacities
MAC layer

Adaptive link layer techniques

Link layer

Loss Rate vs. Playout Deadline

Loss rate

Bit-rate [kbps] Playout deadline [ms]

Video Quality vs. Playout Deadline

0.5 dB

PSNR [dB]

2 dB

Playout deadline [ms]

conventional forwarding...

Simply forward frames

ending host

relaying node

relaying node

ending host

relaying nodes simply forward packets as they arrive packets are treated equally regardless of their semantics only the sender can retransmit lost packets

proactive forwarding

Each relaying node transiently and proactively caches video packets retransmission can be made from the intermediate node instead of the sender each relaying node smartly selects packets to forward if the channel cannot accommodate all useless packets can be detected and removed to save energy and bandwidth

RtME at relaying node

RtME
Rx

RtME
NACK Handler
cache-hit response queue

RtME: Real-time Media Engine

Warehouse
Upstream side NACK message cache-miss fresh packets

Tx

fresh queue downstream side cache-hit packets fresh packets NACK message

cross-layer communication

Lower layers

discarding packets

...
Node 0 Node h-1 Node h

...
Node n

Drop an I or P frame

time

NACK NACK
Locate and drop all dep. packets Id. of discarded frame

NACK

Tx

NACK: Negative Acknowledgment

Rx

distortion

Adhoc Testbed

Multimedia Communications over Broadband Wireless: WiMAX as an Example

Introduction
Mobile WiMAX (802.16e) operation
Wireless mobile TV WiMAX defines only MAC/PHY of wireless link

Broadcast TV requires multi-BS operation


Synchronization issues

Current
MBS to BS (base stations)
transport protocol - RTP / UDP / IP

83

Introduction (2)
Areas for improvement

Smoothen quality
during MSS movement during handoff in Multi-BS environment
Channel switching time Synchronization

Capacity improvements
Spectrum efficiency (number of TV channels)

Increased coverage area Power efficiency improvement


84

Introduction (3) Viable end-to-end solution proposed


From MBS Controller Through BS To MSS (mobile subscriber stations)

85

Overview of WiMAX / MBS


WiMAX / MBS is used as a baseline
Multiple Base Stations (BS) Multiple ASN GW (access service network gateways)

MBS constructs H.264/AVC frame MBS to BS


H.264/AVC over RTP / UDP / IP transport

OFDMA frame used


BS to MSS (wireless) broadcast payload placed in DL (downlink) sub-frame of OFDMA frame OFDMA time division duplex used (TDD)
86

87

OFDMA frame structure


MBS payload contained in DL sub-frame Multiple MBS zones supported DL MAP contains multiple MBS_MAP_IE (info elements) MBS_MAP_IE allows support for multiple channels / multiple layers

88

Baseline System

H.264 / AVC

RTP/UDP/IP transport

RTP/UDP/IP transport

89

MSS operation (baseline)


MSS reads DL-MAP to determine;
MBS MAPS MBS Zones MBS MAPS point to subsequent MBS MAPS

90

Issue #1 Synchronization
Difficult to achieve
OFDMA Frame synchronization problems because;
Each BS makes its own scheduling decision Each BS independently constructs its own OFDMA frame

OFDMA frames need to be the same across multiBSs in same geographic zone
Macro-diversity Reduced interference Smooth hand-off

91

Issue #2 Error Protection


No outer coding in baseline system
video frame errors not handled access unit errors not handled

No unequal error protection


Reduced video quality (during interference or fading) More important to preserve video base layer

MAC/PHY error handling only


Required, but result is low spectral efficiency
92

Issue #3 BS buffer overflow


BS may have to drop video packets
Buffer overflow Packet drop is random

Random drop is undesirable


Reduced quality Varied quality

Preferred to drop packets of lower importance first


93

Issue #4 Energy efficiency


Burst transmission is not utilized Burst transmission
Used for wireless links to conserve energy The aggregation of multiple MAC PDUs for simultaneous transmission MSS placed in idle state when ever possible

Aggregation possible within single channel


Some / with caution

Ideal for multiple TV channel aggregation


Simultaneous TV channel broadcast
94

Issue #5 Packet overhead


Significant packet overhead
between MBS and BS RTP, UDP, IP Approximately 40 bytes per packet Header compression
Significant RTP/UDP/IP header reduction is possible

95

Open issues
Application architectures
multimedia communication applications: video conference, IPTV, IMS, network gaming, 3D, etc middleware for software development (e.g. javabased)

Protocol design
cross-layer communication network resource utilization channel adaptive transmission error protection
96

Open issues
Wireless multimedia communications
QoS provisioning and architectures resource optimization joint source-channel coding

Innovative multimedia systems


multimedia over wireless sensor networks distributed real-time multimedia database systems

97

Open issues
Packet scheduling
resource-constraint/exploitation scalable multimedia streaming quality-resource optimization

Receiver enhancement
buffer management, feedback reporting error concealment techniques

98

Vous aimerez peut-être aussi