Rack Power

Intelligent Power Distribution in the

Data Center

Agenda

Data Centre Power

UPS

UPS
Power Distribution
Rack Mount PDUs

Power problems
Configuration
Capacity

Power Distribution

Types of Distribution
Pros and Cons
Efficiency

Agenda Cont

Power Density in Cabinet

Importance of PDU Design

Single vs. Three Phase

120V vs. 208V vs. 400V
High Density Applications (Blades, Switches)
Temperature Inside Cabinets

Dimensions, Flexibility, Venting, Interface Location

Cord Retention, Obstruction
Alternate Designs

Power Monitoring Software and Interface

How to save money with intelligent PDUs

Out of the box software
Integration to BMS and UPS Software (PDU doesnt dictate what software to use)
PDU level and outlet level information, PUE Level 2 / 3, Accuracy
Switched PDUs turn off servers, turn off outlets

Power Components in the Data

Center

UPS
Floor Mount PDU
Distribution
Rack Mount PDU

What is a UPS?
An uninterruptible power supply / source (UPS) or
battery/flywheel backup
backup, is an electrical apparatus
that provides emergency power to a load when the
input power source,
source typically mains power
power, fails.
fails
A UPS is typically used to protect computers,
computers data
centers, telecommunication equipment or other
electrical equipment where an unexpected power
disruption could cause injuries, fatalities, serious
business disruption or data loss
loss.

Most Important UPS Features

High Efficiency
Service/Warranty
/
y
Battery Management
Scalable Design
Redundancy Options
Remote Monitoring
p
and Weight
g
Reduced Footprint

9 Electrical Power Disturbances

Voltage/Capacity

120V Single
Si l Ph
Phase 300VA - 3kVA
240V Single Phase 1500VA - 18kVA
208V Three Phase 5kVA - 225kVA
480V Three Phase 30kVA - 1MW
600V Three Phase 30kVA - 1MW

UPS Style
Th
Three
b
basic
i UPS models
d l
1) Off-line UPS
2) Line Interactive UPS
3) Double Online Conversion

UPS Power Solutions

Power Failure
Power Sag
Power Surges
Undervoltage
Overvoltage
g
Electrical Line Noise
Frequency Variation
Switching Transient
Harmonic Distortion
CLEAN POWER

(3)

(5)Line-

(9)True

Off-line

Interactive

YES

YES

YES

YES

YES

YES

YES

YES

YES

NO

YES

YES

NO

YES

YES

NO

NO

YES

NO

NO

YES

NO

NO

YES

NO

NO

YES

???

???

YES

On-Line

OFF-LINE UPS
NORMAL MODE
Utility
Power
Surge
Suppression
EMI/RFI
Filters

Battery
Charger

Inverter

Battery

Power flows through the UPS

Battery & Inverter are OFF-LINE
OFF LINE

UPS Load
Outlets

LINE-INTERACTIVE UPS
NORMAL MODE
Utility
Power

BUCK
Surge
Suppression
EMI/RFI Fillters

NORMAL
BOOST

Battery
Charger

Inverter

Battery

Power flows through the UPS

Battery & Inverter are OFF LINE

UPS Load
Outlets

ON-LINE UPS DOUBLE CONVERSION

NORMAL MODE
Utility
Power

Bypass
Surge
Suppression
EMI/RFI
Filters

Inverter

Rectifier

DC Link

Output
To Load
UPS Load
Outlets

Battery

Power is converted to DC and reinverted to AC

Continuous Clean, Filtered,
Regulated power to the load

What is Distribution?
How power gets
H
t from
f
th
the UPS tto th
the critical
iti l lload
d
Consists of:
Floor mount PDU
Breaker outputs to individual cabinets
Rack/Cabinet mount PDUs

Floor Distribution
TTraditional
diti
l style
t l power whips
hi ffrom a panell
board, run overhead or under floor to the
cabinets.
bi t
Benefits
power can be routed to exactly where it is needed.

Cons
Expensive
Long
ong cable runs
Limited flexibility (adds moves changes)

Floor Mount PDU/RPP

Close coupled system usually end of row distribution
PDU transforms voltage from 600
600, 480 to 208/120V
Usable distribution voltage to the cabinet
Built in panel boards for distribution to a specific area in the DC

RPP End of row distribution panel

Usable distribution voltage to the cabinet
Built in panel boards for distribution to a specific area in the DC

Benefits
Shorter cable runs
runs, to cabinets
Moderate flexibility

Cons
Expensive, need an electrician for adds moves changes

Overhead Power Busway: Pros /

Cons
PROS
Lower voltage drop per feet
(improved efficiency)
40% fewer man hours to install
vs. cabling
Does not require panelboards
Feed directly from large floor
PDUs (300-500kVA)
Delivers high density power
(400A 3phase)
Cleaner look, doesnt block
cooling better appearance
cooling,
Most beneficial for relocation,
pods, containerized solutions

CONS
More expensive
p
material upfront
p
Requires plenty of space above racks
for installation (not always available)
Becomes costly if too many turn
components are used (i.e.
( tees,
crosses, elbows)
Monitoring can be challenging, but
vendors are becomingg creative and
relying more on PDU
Once a vendor is chosen, system is not
compatible with other busway in the
market
k t (commitment
(
it
t tto single
i l vendor)
d )

WHAT IS A PDU SUPPOSED TO

DO?
Power servers reliably (last piece of the chain)
Provide
P id accurate
t / easy tto understand
d t d monitoring
it i
information
Assist with capacity planning
planning, load balancing and PUE
Work effectively under high density loads
WHAT IS NOT SUPPOSED TO DO?
Obstruct air flow and equipment access
Fail under high temperature environment
Difficult to install and configure
g

Where is all this power going to?

Lower power density racks

(< 5kW) can be powered by
Si l Ph
Single
Phase PDU
PDUs

For load densities > 5kW,

customers should be
looking at Three Phase
power to cabinets

Three Phase power is a

must to power Blades,
provide long term room for
growth and allow for
virtualization

415V can dramatically

increase power density

Choosing the Right Voltage

120/208V Three Phase
Most available power (up to
28kW)
Single 3PH circuit reduces
cabling
bli costs
t

230V Single Phase

120V Single
g Phase
Limited at 20A
30A impractical &
expensive
Widely available and
preferred by small business

Higher power capacity (up to

5kW)
Less current draw
Lower losses
More efficient
More security since requires
208V equipment
Locking input plugs
Most servers accept 1200
240V

Metered PDUs facilitate load

balancing
LLower number
b off circuits
i it
improves airflow
Provides scalability for growth
g g down power
p
without bringing
Support 120V & 208V
Allows for Blades,
Virtualization and Cloud
Computing

Maximizing Panel and Busway Power Usage

with Three Phase 30A PDUs
3PH 30A PDUs
B
Bestt balance
b l
b
between
t
power capacity
it
and number of circuits
98% power capacity from a 400A feed
93% usage of poles or power drops
available
il bl

Delivers 8.7kW
Meets the need for most server racks
(up to 2 Blades)
Does NOT require exotic cooling
solutions
Lower cabling costs
Local breakers provide additional
protection

400/415V PDU

Increase Data Center efficiency and deliver more power

Reduce power losses and number of transformations
Proven power distribution worldwide
Becoming a new standard in many Data Centers
208V Three Phase 415V Three Phase
Power @ 30A (kW)
Output Voltage
Input Connection
Input Plug
Efficiency Gains

8.6

17.2

208V

240V

Line to Line

Line to Neutral

L15 / L21 / IEC

L22 / IEC

None

6-8%

Powering Blade Servers /

Switches
2 PDUs per cabinet
Min 12 C19s or L6-20s
per PDU
p
Each Blade requires 4-6
outlets each
Load Balancing is a must
since each outlet can
have a different power
p
requirement
4 Blades = >20kW

5-6kW
5 6kW per chassis
h i
6 power supplies (3+3 redundancy )

Overall Approach
PDUs designed to support Blade Servers and Switches
Switches, ii.e.
e Cisco
Catalyst 6500 and Nexus 7000
Vertical and Horizontal PDUs can be used
Low / Mid / High Power Densities, depending on:
Style of server/switch
Number of servers/switches
/
Propose 2 PDUs per rack or cabinet offering for redundancy
Locking C19 and C13s are used to replace L6
L6-20
20

Recommendation
60-80A 208V Three
h
Phase
h
PDU ((up to 4 bl
blades/switches)
d /
h )
Input cord or Terminal Block
6 x 20A circuit Breakers
2-3 outlets per Breaker
oca and
a d Remote
e ote load
oad monitoring
o to g
Local
Horizontals or Verticals
Depends on type of cabinet, air constraints and mounting preference

Sample PDUs for Blades/Switches

2U Horizontals

0U Verticals

Inputs
I
t
30A Single Phase
30A and 60A Three Phase

Outputs
L6-30
Locking C13 and C19s

Functionality
Locall and
d Remote Monitoring
i i

Form
Horizontal OR Vertical

PDU DESIGN
Keys to a good PDU design
Low profile
Flexible mounting
Interface location and accessibility
Cord retention features
High temperature operation
Outlet distribution and density
Input
I
t cord
d fl
flexibility
ibilit
Chassis consistency
Custom Designs

Branch Breaker Area

2.8

Low Profile UL489 Breaker Doghouse

Molded to Number of Breakers
Clearly Labeled & Defined
Reduce Obstruction Inside Cabinet

Cord Retention Feature

Cord Retention Mechanism
Individual outlet retention
system
Eliminates need for cable bar
Built-in anchors on the PDU
Locking tethers attach to PDU
anchor points
Tie wraps are required to
attach tethers to plugs
Tethers can be removed and
reused

Locking C19 / C13 Outlets

Release Button

- Same electrical property as standard C13/C19 outlets

- No special input cord needed
- Built-in button must be pressed to release cord
- Prevents accidental OR intentional cord removal
- Alternative to locking NEMA L6-20 outlets and other cable retention options
- Saves installation time and provides cord security in high density cabinets

Higher Operational Temperature

Venting System

IImprove convection
i cooling
li and
d
airflow through vents positioned at
the end and sides of the PDU
Allows for higher temp
environments (65C or 149F)
Reduces failure due to component
overheating
Increasing server exhaust
temperature(45-50C)
Containment solutions generate
more heat

Hot aisle containment

Vertical Exhaust Duct

C20 Input & Input Cord Retention

IEC C20 is an international input

p for PDUs
which gives the customer the flexibility to
plug in multiple power cords from 110-240V
Power Cords
110V Nema: 5-15, 5-20, L5-15, L5-20
240V Nema: 6-15, 6-20, L6-15, L6-20
240V IEC: C20, IEC 16A
240V (others): German, British, Italian
plugs
Double Cord Retention system is provided to
k
keep
input
i
t cords
d ffrom coming
i lloose

Alternative Designs
Hardwired Terminal Block inputs
Permanent connection
Cost savings by not having to purchase mating connectors

Dual Input PDU

2 PDUs in 1 redundancy
Space saving

Horizontals
1U or 2U designs
Customers that cannot install vertical units

Half Height
Mount up to 4 PDUs in cabinet
Obstruct
Ob t t only
l partt off th
the cabinet
bi t

Power Monitoring Software and

Interface
How to save money with intelligent PDUs

Informed capacity decisions

Load balancing of phases / breakers
Reduce risks of overloading and outages
Daisy chaining

Out of the box software

Integration
I t
ti tto BMS and
d UPS SSoftware
ft
PDU usually doesnt dictate what software to be used

PDU level and outlet level information for most

accurate PUE calculation
Switched
S i h d PDU
PDUs turn off
ff servers, turn off
ff
outlets, save power, increase security

PDU Local Interface Features

Reset

Digital Local Display

Power, Amps, Voltage, PF

Status LED

Ethernet Port

Large LCD
Display

IP Setup

Easy to Navigate
Soft Buttons

PDU Linking
Ports

Environmental
Sensor Port

Per Breaker or Phase

Buttons for Easy On-screen Menu

Navigation
Temp/Humidity Sensors
Ethernet & Serial Communication
Ports
IP Consolidation Feature
Connect up to 20 PDUs

USB Port
US
ot
FW update & Data Download

USB Port

Serial
Communication
Port

Rotates 180 to be viewed from

either direction

Product Metering Benefits

Avoid outlet / breaker overloading
Avoid tripping breakers at PDU or upstream
Make informed capacity planning decisions
Balance loads across breakers or phases
p
resources
Efficientlyy utilize power
Measure IT equipment power consumption to save
power and money
Calculate Green Grids PUE Level 2 and Level 3
Drive ggreen data center initiatives

IP Consolidation
Setup, Control and Monitor
multiple
lti l PDU
PDUs iin your d
data
t
center with a Single IP Port
PDU Linking Feature allows you
to reduce the number of IP
connections in your data center,
thus saving you time and money
Link up to 30 PDUs
Only Master PDU requires
network connection
Linked units are connected
through
h
h serial
i l RS485
Auto PDU detection
PDU cloning feature

Why link multiple PDUs?

Save Money
Deploy fewer IP addresses
IN
Reduce installation time
Reduce Ethernet cable length
Enjoy the following features
Outlet grouping across multiple PDUs (A/B)
Unified access to all linked PDUs
Be
B able
bl to clone
l
settings
i
ffrom one PDU to another
h
Manage every PDU in the chain from a single screen

OUT

PDU Outlet Power Control

Remotely Control Individual Outlets
On/Off,
/ , Cycle
y
Via https or SNMP
Local status LED
Group Outlets from Single or Multiple PDUs
Control and Manage all of them as ONE
Sequence
S
O
Outlets
tl t
In rush current mitigation on power up
Outlet Level Scheduling
Shut Off outlets to increase security or reduce power usage

Accuracy & Billing

Billing
Billi G
Grade
d
Data Centers can report and charge customers based
on power consumption
ti

PDU must have:

+/- 1% Accuracy
Real Time Metering
Outlet Level Monitoring

Built-in Web Interface

Single
g Monitoringg Interface

HTTP / SNMP v2/v3

IP v4 / v6
Fi
Firmware
U
Upgrade
d
Alarm Settings
PDU / Outlet / Temperature
Outlet Grouping
Data Logging & Exporting
Email Notification
Admin and User Levels
Radius / LDAP Authentication

PUE Accuracy Categories

PUE Category
g y0

PUE Category
g y1

PUE Category
g y2

PUE Category
g y3

IT Energy
Measurement
Location

UPS output

UPS output

Floor PDU output

IT equipment input
(Rack PDU output)

Definition of IT
Energy

Peak IT electric
demand

IT annual energy

IT annual energy

IT annual energy

Definition of Total
Energy

Peak Total Electric

demand (kW)

Total annual energy

(kWh)

Total annual energy

(kWh)

Total annual energy

(kWh)

Accuracy Level

Basic

Intermediate

High

Highest

The closer to loads, the more accurate PUE calculations become

Energy (kWh) is also more accurate than Power (kW) alone
Annual measurement vs. peak demand increases accuracy

Main Takeaways
y
U
Understand
d t d power d
density
it and
d redundancy
d d
with
ith
three phase and high voltage PDUs
Importance of PDU design installation time
time,
equipment / air obstruction and increase mounting
flexibility
How to save money and improve power monitoring
and control with intelligent
g
PDUs.

Questions?
Thank You!