Transcript
Mission Critical Power Review Understanding concepts of mission critical power designs Chris Loeffler,
[email protected] Ed Spears,
[email protected] Power Quality Global HQ, Raleigh, NC
Did you know? • Eaton is the #2 UPS manufacturer worldwide for single phase systems. • Eaton is the #1 UPS manufacturer worldwide for UPS systems > 5kVA. • Eaton is the leading IT Sector OEM UPS Manufacturer
2
2
Three-Phase Product Lineup Covering 10-1100 kVA with single systems Providing paralleled capacity up to 8.8 MVA
3
3
Eaton Solutions Are Different, They Are Designed To Deliver Efficient Uptime Eaton Backup Power solutions solve many of the challenges seen in other backups. Eaton solutions are designed to deliver:
4
4
Today's agenda • UPS designs • Reliability and Availability • Types of redundancy • Improving redundancy • Options for power distribution flexibility • Energy efficient designs • Additional considerations • Closing 5
5
Do you find yourself asking: • What makes the best sense for me? • How much redundancy do I need? • What is the best approach to save money? • How much is this going to cost?
6
6
UPS Designs • Standby • Eaton 3105
• Line Interactive • Eaton 5130 • Eaton 5PX
• Double Conversion • Eaton 9130 • Eaton 9355
• Multi-mode • Eaton BladeUPS • Eaton 9395 7
7
Reliability vs. Availability • Reliability is many times expressed as the products expected operational time before it quits operating properly • MTBF – Mean Time Before Failure • MIL-HDBK-217F • Telcordia (Bellcore) SR-332
• MTBF is NOT a good measure of performance • “Availability” is a better measure Availability =
MTBF
Availability is usually expressed by the
MTBF + MTTR MTTR = Mean time to repair
“number of 9’s” 8
8
Types of redundancy - improving availability • No redundancy • Subsystem redundancy • Parallel redundancy • (N+1) redundancy • (2N) redundancy • (2N+1) redundancy
9
9
No Redundancy Power System INPUT
Subsystem A
Subsystem B
Subsystem C
Subsystem D
λ1
λ2
λ3
λ4
OUTPUT
• All devices are serially connected • A fault in any device causes downtime
10
10
Power Architectures Tier I
Tier level definitions per the Uptime Institute
11
11
How to increase “availability” • Batteries are typically a UPS systems weakest point
UPS System
Parallel connected
Series connected Battery
Battery
Battery
Battery
Battery
Battery
Battery
Battery
Battery
Battery
• For additional reliability add an external battery monitor 12
12
How to increase “availability” • Add a maintenance bypass in case of a system fault, or you need to work on the UPS/battery.
Utility AC
Maintenance Bypass (Manual)
13
13
Eaton 9390 Parallel Battery Cabinet
Battery Cabinet
UPS
Maintenance Bypass/Distribution
14
14
Eaton 5130 Maintenance Bypass
UPS with internal battery
Second Parallel Battery Module
15
15
Power Architectures Tier II
Tier level definitions per the Uptime Institute
16
16
Subsystem redundancy • Redundancy in electronics • Some designs may include some redundant internal components, but still contain a number of sub systems that are “common”. Subsystem B
λ2 INPUT
Subsystem A
Subsystem B
Subsystem C
Subsystem D
λ1
λ2
λ3
λ4
OUTPUT
Subsystem B
λ2
17
17
Parallel redundancy • Parallel Redundant systems. • The highest level of redundancy, because there are no, or very simple redundant components, which have a minimal impact to overall reliability. These systems should also have “peer to peer” control capability, as then a control issue in one system will not impact another. Subsystem A
λ1 INPUT
Subsystem A
λ1
OUTPUT
Subsystem A
λ1 18
18
Increasing power infrastructure “availability” N+1 systems 30 kVA
30 kVA
30 kVA
30 kVA
Any single UPS can be taken off line for maintenance or repair
Load 90 kVA total 19
19
Which is more reliable? System “A”
Maximum
None Redundancy Scale
System “B”
Maximum
None Redundancy Scale
20
20
Product examples of subsystem vs. parallel redundancy System “A”
Competitors products
System “B”
Eaton products BladeUPS
9355 9155
9390
9395
9E
21
21
Redundant components in a BladeUPS 60 kW (N+1) system Battery system
Battery breaker
Static Bypass Switch
Logic Control
Maintenance Bypass Switch Rectifier and Inverter
UPS 1
UPS 2
UPS 3
UPS 4
UPS 5
UPS 6
Maint Bypass
Static Bypass
22
22
Maintaining a parallel rack system design In a BladeUPS system, all parts can be replaced by end user or any other service provider. Failure of chassis
Failure of power module Power in
Battery end of life
Power out
23
23
Power system integrated into the IT space Modular power and power distribution • Using the Eaton RPM (rack power module) a small initial UPS deployment can be easily expanded over time.
RPM “ePDU”
Total load
+12kW 24kW
12kW
+24kW 48kW
Po we r E d g e 2 9 5 0
• All power distribution in the racks • Extra battery capacity can go in any cabinet • Reduced need for electrical contractors
3
6
4
7
3
6
4
7
Po we r E d g e 2 9 5 0
0
1
Powe rVault 2 10S
Po we r E d g e 2 9 5 0
P o we r E d g e 2 9 5 0
Powe rVault 2 10S
0
48k
• 12kW power distribution building blocks
0
1
3
1
6
4
0
7
3
1
6
4
7
Po we r E d g e 2 9 5 0
P o we r E d g e 2 9 5 0
0
3
6
1
4
7
0
3
6
1
4
7
PowerVault 530F
Powe rVault 2 10S
Po werVa ult 210 S
PowerVault 530F
Powe rVault 2 10S
12kW N+1 24k
• 12kW power building blocks
Redundant UPS Power
•
Po werVa ult 210 S
PowerVault 530F
PowerVault 530F
PowerVaul t 530F
• Increase power and distribution on the fly • Customers can change out power distribution
24
24
Standalone “horizontal” parallel system
25
25
4 x 80kVA (320) or 240kVA N+1 parallel system
If total system is redundant (N+1), failure of any one system does not effect critical bus
Protected AC from inverters 26
26
Power Architectures Tier III
Tier level definitions per the Uptime Institute
27
27
Increasing power infrastructure “availability” Adding power supply redundancy at the server
UPS 1 Power panel 1
Tier III deployment, one power source can be off-line for service or repair
“A” side power
Power panel 2
“B” side power 28
28
Increasing power infrastructure “availability” 2N systems
UPS 2
UPS 1 Power panel 1
2N deployment, one power source can be off-line for service or repair
“A” side power
Power panel 2
“B” side power
29
29
Power Architectures Tier IV
Tier level definitions per the Uptime Institute
30
30
Maximum power infrastructure “availability” 2N+1 systems
Rack Transfer switch (ATS)
UPS 1C
UPS 1B
UPS 2A
UPS 1A
UPS 2B
UPS 2C
Power panel 2
Power panel 1
31
31
Today - Modular approach to IT
UPS
RPP
UPS
RPP
32 AC Unit
AC Unit
32
Modular building block concepts • High density small footprint:
42
42
PowerVault 530F
41
40
39
39
38
38
37
36
35
35
34
33
Po we r Ed g e 2 9 5 0
32
32
31
0
3
6
1
4
7
3
6
4
7
31
Po we r Ed g e 2 9 5 0
30
30
0
29
1
29
Po we r Ed g e 2 9 5 0
28
28
0
3
6
1
4
7
27
26
26
25
25
24
24
23
23
22
21
20
19
18
17
16
15
14
13
• Build a 12 to 60 kW N+1 system in 1 cabinet with up to 6 modules connected in one 42U cabinet.
60kW
34
Power Vault 210S
33
27
• Each 6U system can be a single system in a standard IT cabinet, supporting up to 12 kW
37
Power Vault 210S
36
12
11
10
9
8
IT load equipment
• Each 12 kW BladeUPS system is 6U and includes battery with automated maintenance bypass.
60kW N+1
41
40
22
21
48kW 36kW
20
19
18
17
24kW
16
15
14
13
12
11
10
12kW
9
8
7
7
6
6
5
5
4
4
3
Compute expansion needed
3
2
2
1
1
12kW
Single BladeUPS
Scalable BladeUPS
33
33
Flexible, Scalable, Upgradeable
On-site upgrade
275 kVA Redundant!
On-site upgrade
550 kVA Redundant!
• Add another 275 kVA in the field for redundancy, or for capacity • Simply choose an ISBM sized for future growth • Leave space on the left side
• Enables flexibility for future changes in load demands, and new requirements for higher reliability 34
34
Project BlueGrass – sites (Louisville, KY) Blue Site •
20.7 acres
•
Expandable to support 6 data halls @ 10K sq. ft.
•
Max power density of 180 w/sq. ft.
•
14 miles from Red Site
Red Site •
30 acres
•
Expandable to support 6 data halls @ 10K sq. ft.
•
Max power density of 180 w/sq. ft.
•
14 miles from Blue Site
35
35
Blue Grass Design Blue and Red Facilities are identical • Overall facility – 102,000 sq. ft. • Office space – 10,000 sq. ft. • Gray space: Electrical infrastructure – 35,000 sq. ft. Mechanical infrastructure – 14,000 sq. ft.
• White space: Two data halls @ 10,000 sq. ft. each Power density 90 w/sq. ft. (day one) Upgrade steps at 120 and 180 w/sq. ft.
• All electrical and mechanical infrastructure components are redundant (n+1)
36
36
Out of UPS power (1500 sq ft floor) 150kVA PDU
300 kVA UPS
150kVA PDU
300kVA
UPS room AC Unit
AC Unit
AC Unit
Existing UPS will not support additional equipment Need to add 10 racks of Blade Servers, replacing two full rows of ~4kW per rack equipment Would like 2(N+1) UPS protection for Blades 37
37
Modular concept in existing space 150kVA PDU
Modular UPS
150kVA PDU
6U Rack PDU
6U Rack PDU
6U Rack PDU
6U Rack PDU
6U Rack PDU
6U Rack PDU
6U Rack PDU
6U Rack PDU
6U Rack PDU
6U Rack PDU
Modular UPS
300 kVA UPS
Modular UPS
300kVA
150 kVA XFMR
Modular UPS
150 kVA XFMR AC Unit
AC Unit
AC Unit
Standard density – standard availability N only power level Area that could have density increased to 15 kW per rack High density – high availability compute 2(N+1) power 38
38
What are other considerations: What size module is the right size?
What is the price I will pay for additional reliability?
39
39
The Value of Eaton Eaton Three-Phase UPSs provide the greatest combination of benefits, delivering tangible benefits for specifying engineers, consultants and end users » Lowest Total Cost of Ownership industry-wide » Superior Performance and efficiency » Real-time Information and Control » World-class Support and Service
Eaton 9390 40
40
Low TCO
Low TCO Improving the bottom line
Eaton UPSs deliver low TCO from advances in several product facets » » » » » »
400V Site Design High Power Density – small system footprints Reduced weight and transportation costs Low installation and Leading Efficiency – Quantifiable Benefits Maintenance Scalability 41
41
UPS Efficiency over time
42
42
Low TCO – Leading Efficiency Two complementary Eaton-proprietary technologies, maximizing UPS efficiency under any condition! Variable Module Management System (VMMS) » Maximized efficiency in double conversion mode » Both in single- and multi-UPS systems applications
Energy Saver Systems (ESS) » The ultimate savings: 99% efficiency » Automatic fast transfer to double conversion mode when needed (in less than 2 ms)
Energy Advantage Architecture Higher System Efficiency No Compromise On Reliability
43
43
Low TCO – Leading Efficiency Energy costs are overwhelming equipment costs in data centers. » UPS electrical losses account for 5-10% of the overall electrical expenditure.*
Eaton’s Energy Saver System drives these losses down to nearly zero. The energy savings recovers the cost of the UPS in less than 5 years.
* Underlying figures from The Invisible Crisis in the Data Center: The Economic Meltdown of Moore’s Law, Uptime Institute, 2007
44
44
Low TCO – Leading Efficiency
ESS Efficiency 99% – across the complete operating range 45
45
Low TCO – Leading Efficiency
The energy savings from ESS typically recovers 100% of the UPS cost over a 3-5 year period » At 250kW of critical load, the savings is equivalent to $4000 per year per point of efficiency gain.
Backing up your 250kW load with an ESS UPS is equivalent to pulling 29 cars off the road.
46
46
Low TCO – Leading Efficiency How to maximize efficiency with lighter loads in double conversion mode, especially in multi-UPS and redundant system configurations? Solution #1: Concentrate load on certain UPS’s to maximize UPS load level and overall system efficiency » Some energy savings • Limited to multiple-UPS systems (with several UPS in parallel) • Still not optimal
Solution #2: Eaton 9395 and its Variable Module Management System » Automatically optimize efficiency at UPM level • Concentrate the load on certain UPM’s to maximize overall system efficiency
» Only possible thanks to modularity of Eaton 9395 UPS • Not limited to multiple-UPS systems • Achieve even higher optimization thanks to UPM’s modularity
47
47
Low TCO – Leading Efficiency Example with same load applied to different multi-UPS configurations
48
48
Low TCO – Leading Efficiency 9395 UPS Efficiency 96 94 92
Eaton 9395 1100kVA UPS Efficiency %
90
Eaton 9395 825kVA UPS 88
93951100kVA 550kVA 9395 with VMMSand andN+0 N+0configuration* configuration* Eaton 9395 550kVA UPS 9395 825kVA with VMMS 86
Eaton 9395 275kVA UPS
82
Typical Operations Range 80
0
5
82 88 5 930 9 5 1090 1145 00
77
0
71
0
5
66
60
55
5 49
5
0 44
38
0 33
5 27
0 22
5 16
11
0
78 .5 55
up to N+0 VMMS efficiency curve
84
27
VMMS allows to shift to higher efficiency curves (according (accordingtoto system’sredundancy redundancy system’s requirements) requirements)
Load kVA 9395 275kVA 9395 550kVA 9395 825kVA 9395 1100kVA 9395 VMMS N+0
Notes: - Scaled drawing - VMMS and N+0 curves using VMMS default max UPM % load level @ 80% (*) 49
49
Low TCO – 400V Site Design 480V AC » Losses through the UPS, isolation transformer/PDU, and server equipment » End-to-end efficiency of approximately 76%
50
50
Low TCO – 400V Site Design 600V AC » » » »
Used primarily in Canada Can provide small savings in equipment costs, and utilizes lower currents Requires multiple isolation transformer-based PDUs End-to-end efficiency of approximately 76%
51
51
Low TCO – 400V Site Design 400V AC » Commonly used throughout the world » PDU isolation transformers eliminated » End-to-end efficiency of approximately 80%
52
52
Options to increase flexibility • Maintenance bypass, PDUs, RPPs, paralleling cabinets, ATS 9155 & 9355 switches, BladeUPS & 9355 rack 9155 & 9355 bypass w/receptacle options
power distribution
paralleling cabinets
Rack ATS switches
Data Center Bus Way
Static Switch
Remote Power Panel
PDU
Power Distribution Rack
DC Systems 53
53
Real-time Information and Control
Real-time Information and Control • Keeping data centers and facilities online requires real-time information and control capabilities. •
Eaton UPSs offer flexible options to interface with multiple systems and give customers the best control. 54
54
Power Xpert and IPM Software Power Management
Cooling
IT and Networks
Ice Business Processes
IT Monitoring
Facility Monitoring
H2O
Utility Monitoring
Tower
Compute • Main Frames • Volume Servers • Blade Servers
Pumps Chiller
Utility Substation and Metering
pu om
te
k or C tw e N g e, lin o ag r r o o we & C St Po w ro In-
Parallel or Transfer Equipment
Precision Cooling
Storage • SATA Disk • Tape • Blended
Network • Corporate Networks • VoIP • Integrated Blade/Switch Power Distribution Units
Static Auto-Tie Central UPS
Generator Medium Voltage >600VAC Eqpt CHP Fuel Cell or MicroTurbine
Power
Low Voltage 600VAC Eqpt
Raised Floor
In-Row Power and Cooling • Modular UPS • Rack Mount PDUs • In Row Cooling • Rear Door Heat Exchanger • Liquid Cooling Racks
DC Power
Eaton Software IPM, IPP, vCenter Power Xpert Software, Reporting 55 & Foreseer
55
Software Offerings IPM –
PX –
Intelligent Power Manager
Power Xpert
56
56
Power Xpert Built in User View Templates - Geographical Layout Example Data Data Center Center LIVE LIVE Webcam video Webcam video stream stream embedded into embedded into PXS PXS
Local Local Weather Weather LIVE LIVE webpage webpage embedded embedded
Events Events bubble bubble up up and and change change City-label colors accordingly City-label colors accordingly
http://10.222.50.187/powerxpertsoftware 57
57
Layout Manager - Design the GUI to your liking Review Review and and acknowledge acknowledge critical and critical and cautionary cautionary alarms alarms at-a-glance at-a-glance
Custom Custom layouts layouts can can be be created created for for any any supported supported devices devices
Custom Custom bitmaps bitmaps and and graphical graphical elements elements can can be be easily easily imported imported
Indicators Indicators can can appear appear animated and change animated and change color color on on status status changes changes 33rdrd party party devices devices can can be be integrated into custom integrated into custom layouts layouts easily. easily. Custom Custom mathematical mathematical formulas formulas are are supported supported to to create calculations create calculations based based on on multiple multiple variables variables e.g. e.g. PUE, DCiE PUE, DCiE
The The user user can can choose choose from from aa variety of available gauges variety of available gauges
Links Links to to other other custom custom layout layout web web pages pages can can be be easily easily embedded embedded for for drilling drilling up up or or down for more information down for more information The Power Xpert Layout Manager provides the user a library of powerful design tools for the creation of custom Human-Machine Interface (HMI) graphical layouts. Objects can be easily animated, various gauges can be selected and custom bitmaps can be imported with little effort. The Layout Manager software module is included with Power Xpert Software as standard! 58
58
Trend Viewer - Understand where things are heading •
High performance, easy to use, Web based trending
•
Three ways to interact • •
Select attributes for a device from the Grid View Select attributes from multiple devices from Trend Viewer page • Can save Trend Groups for easy future access
•
•
Check attribute boxes on a User View
Trend Display •
Chart or Data option • Mix and match
• • • •
Multiple trends at one time Multiple axis supported Fixed or custom time frames Export results to Excel 59
59
Monitoring points to understand efficiency
60
60
Summary • Energy efficiency is peaking in interest • Use this opportunity to push high efficiency platforms
• IT Virtualization is hot • Requires highly reliable power infrastructure • Eaton’s software integration into VM’s is leading edge
• IT budgets are still recovering • Customers are looking for modular “build as you grow”, and some level of increasing availability without a lot of extra cost
• Complete solutions are preferred • Reductions in staff require simpler to purchase, deploy and manage solutions, and delivering flexible options means additional $ 61
61
62
62
