Transcript
FLASH FOR THE REAL WORLD SEPARATE HYPE FROM REALITY
WEBTECH EDUCATIONAL SERIES FLASH FOR THE REAL WORLD – SEPARATE HYPE FROM REALITY Join us for a live webcast and hear Hu Yoshida, chief technology officer of Hitachi Data Systems, discuss the real-world criteria for making an effective decision when evaluating flash storage. With all the noise in the market it can be difficult to separate fact from fiction in order to evaluate the performance, efficiency, and economic trade-offs for flash storage Specifically, you’ll learn how to determine if flash storage will help you Actually achieve the performance you need as you compare technology options Realize efficiency gains that extend beyond the promise of flash performance Make the economic case for real-world business decisions before taking the leap After attending this webcast, you will be able to
Understand the important differences between commodity flash storage and storage designed for flash Maximize the return on your flash storage to exceed the abilities of flash appliances Identify potential efficiencies, beyond performance improvement, that your company might gain by employing flash storage
HYPE OR REALITY?
Flash storage is nonvolatile
Flash can replace DRAM for cache and memory Flash SSDs are built for enterprise storage Flash storage is 10 times more expensive than HDD Flash storage will replace hard disk drives All-flash arrays will outperform hybrid flash arrays
STORAGE MEDIA TECHNOLOGY TRENDS
Hard disk technology is slowing down – end of 50-year trend MLC flash will approach price of high-performance hard drives Optical disk and tape continue price trend A hybrid pool of flash and hard drives will be required to reduce cost and increase performance
($/GB) 100.00
ReRAM
PRAM
SLC Flash SSD
10.00
MLCFlash SSD
1.00
SAS HDD
0.10 Random Read Performance
0.01 MLC SSD： 70K IOPS
Tape Optical Disk
SAS HDD： 0.3K IOPS
0.001 CY05
CY10
CY15
CY20
Storage Media Bit Cost Forecast MLC: Multi-level cell, SLC: Single-level cell, SAS: Serial attached SCSI, PRAM: Phase change RAM, ReRAM: Resistance RAM
FLASH NAND TECHNOLOGY Pages can only be written to formatted blocks
Thin Oxide Insulation Layer Drain
When pages are updated, old pages are marked invalid
Pages have to be refreshed periodically since electrons are leaking with every read and over time
Source
Floating Gate
N＋
Formatting is only done on a block level This limitation causes write amplification and takes processor cycles for garbage collection
Control Gate
Substrate
Block A Page 0 Invalid
Block B Page 1 Invalid
Page 2 LBA:10
Page 1 Invalid
Page 2 LBA:10 →Invalid
Block A Page 0 Invalid
Page 0 Free
Page 1 Free
Page 2 Free
Page 1 Free
Page 2 Free
Page 1 Free
Page 2 Free
Block B
Block A Page 0 Free
N＋
Page 0 LBA:10
Block B Page 1 Free
Page 2 Free
Page 0 LBA:10
Every write degrades the insulation layer until the cell is no longer usable
COMPARISON OF STORAGE TECHNOLOGIES
Technology
Read
Write
Endurance Cycle
Nonvolatile
DRAM
<10ns
<10ns
1016
No
SLC Flash
25μs
200μs/1.5ms (Program/Erase)
105
Yes*
MLC Flash
200μs
440μs/2.5ms (Program/Erase)
103
Yes*
15K HDD
5.7ms
5.7ms
1018
Yes
2013 IEEE NAND Flash SIM: M. Jung et al
* Nonvolatility degrades with writes, formats, reads, and time
SSD CONTROLLERS ARE NOT DESIGNED FOR ENTERPRISE STORAGE SSD DESIGNED FOR PCS IS OPTIMIZED FOR MANUFACTURING COST, NOT PERFORMANCE
Units (M)
Single core Limited memory Mapping table resident in flash Bandwidth limits capacity ‒ 400GB modules “Write Cliff” − I/O performance is blocked during garbage collection Limited system integration options No encryption − no shredding
200 160 120
80
Entry-Level PC Mainstream PC Enterprise Server Enterprise Storage
2012
Industrial
40 0 2011
2012
2013
2014
2015
2016
Source: Gartner, June 2012 “Forecast Analysis: NAND, Worldwide, 2011-2016, 2Q12 Update”
FLASH NEEDS TO BE BUILT FROM THE GROUND UP FOR ENTERPRISE STORAGE CONSUMER DESKTOP AND LAPTOP
DATA CENTER ENTERPRISE SERVER AND STORAGE
LOWEST UNIT COST
HIGHEST PERFORMANCE AND AVAILABILITY
EMBEDDED CONTROLLER: A HIGH-PERFORMANCE FLASH TRANSLATION LAYER HIGHLY PARALLEL
Eight lanes of PCIe PCIe
PCIe root complex Multicore processor
X8 PCIe PHYs PCIe Root Complex
Integrated DDR-3 interface
Integrated flash controller logic supports 32 paths to the flash array Uses 128 flash memory chips Housekeeping is taken out of the I/O path – no write cliff
Core
Core
DDR3
To/From DDR
Core
Core
Misc.. Interfaces
UART, UI2C, Ethernet
X16 Flash Controllers X32 Flash PHYs Flash Memory interface
EMBEDDED CONTROLLER INLINE COMPRESSION FEATURE Compress in real time any data stream of “0” or “1” by up to 94% Perform inline encoding of any data chunk of “0” or “1” ‒ Chunk size: 128KB
Algorithm remaps data with a pointer and saves “LA/LRC (data check code)”
VSP Formatted Data
Written on Flash
Chunk Size (128KB)
Data: Data: All “0” “1” All
LA/ LA/ LRC LRC
Data: Data: All “0” “1” All
LA/ LRC
Compression Data (8KB)
Data: “1” All “0”
LA/ LRC
Inline Write Compression
Ptn: LA/ LA/ LA/ LA/ Ptn: “1” LRC LRC LRC LRC “0”
LA/ LA/ LRC LRC
EMBEDDED CONTROLLER FORMATTING COMPARISON WITH SSD Format Execution Time (22.4TB) 280 min.
60 min.
SSD 400GB x 8 (7D+1P) PARITY GROUP
Hitachi Accelerated Flash (HAF) 1.6TB x 2 (7D+1P) PARITY GROUP
EMBEDDED CONTROLLER ERROR CHECK AND CORRECTION (ECC) Hitachi Accelerated Flash ECC is added to each LA/LRC, resulting in the ability to correct 48b/1.4KB of data
Increasing ECC size extends the ability to read data as the cells leak electrons, and reduces the need to rewrite pages Host data
Generated Data by VSP
512
8 LA/LRC
Logical partitioning
1384
1388
1388
1388
1388
1384
A unit of data That generates ECC
Flash data format
1384 Page#
1388
1388
1388
1388
ECC（Size Varies by Flash Chip Type, 52-84 Bytes）
1384 CRC
HAF RANDOM PERFORMANCE AND BIT COST ADVANTAGES COMPARED TO MLC SSD 8K IOPS (64/36 R/W Ratio) Per Drive 60,000
55,000
55,000
50,000 40,000
30,000 20,000
14,000
14,000
11,000
11,000
10,000 196
196
141
141
78
600GB HDD 10K
900GB HDD 10K
3TB HDD 7.2K
0 200GB SLC 400GB SLC SSD SSD
200GB MLC SSD
400GB MLC SSD
146GB Tomahawk Tomahawk 300GB HAF HAF HDD 15K 1.6TB 3.2TB HDD 15K
NORMALIZED BIT PRICE COMPARED TOvs 146GB 15K RPM HDD AND MLC SSD Relative Bit Cost 146GB 15K 9.00
8.11
8.06
8.00 7.00
6.38
6.00
6.00 5.00
4.00
4.00
3.60
3.00
2.00
1.00
1.00
0.89
0.28
0.28
0.10
600GB HDD 10K
900GB HDD 10K
3TB HDD 7.2K
0.00 200GB SLC 400GB SLC SSD SSD
200GB MLC SSD
400GB MLC SSD
146GB Tomahawk Tomahawk 300GB HAF HAF HDD 15K 1.6TB 3.2TB HDD 15K
HITACHI ACCELERATED FLASH POWER-PER-TERABYTE ADVANTAGES
Power per TB (incl. Drive and Chassis) (Watts) 400 342
350 300 250
39%
less power
200 150 100 50
167
77
60
30
51
45 23
28
19
14
0 200GB SLC 400GB SLC 200GB SSD SSD MLC SSD
400GB MLC SSD
146GB HAFS FMD HAFS FMD 300GB HDD 15K 1.6TB 3.2TB HDD 15K
600GB HDD 10K
900GB HDD 10K
3TB HDD 7.2K
HITACHI ACCELERATED FLASH STORAGE 4X THE CAPACITY OF SOLID STATE DRIVES, 2X THE DENSITY PER RACK UNIT
1.6TB
19.2TB in 2U
4X 2X
400GB
9.6TB in 2U
STORAGE ARRAY − FLASH ACCELERATION OPTIMIZE HITACHI UNIFIED STORAGE VM (HUS VM) AND HITACHI VIRTUAL STORAGE PLATFORM (VSP) SYSTEM SOFTWARE TO EXPLOIT FLASH
30+ fundamental software changes to turbocharge performance with flash
Hitachi Storage
‒ New “express” I/O processing ‒ New cache slot allocation method
‒ Reduced ucode overhead and path length Significant performance impacts ‒ Up to 65% reduction in response time
‒ Up to 4x random I/O scalability Nondisruptive installation and transparent to current applications
HUS VM and VSP Optimized for Flash Today
VSP WITH HAF COMPARED TO EQUIVALENTPERFORMANCE 15K HDD VSP CONFIGURATION Greater productivity: Sustain up to 223% more transactions
Controller
Controller
Increased efficiency and application performance: Up to 88% reduction in application response times, allowing support for more users and applications Lower environmental cost: Up to 98% reduction in drive footprint
Hitachi Accelerated Flash storage and VSP flash acceleration
Lower price/performance: Up to 65% lower price/performance Flash Chassis
Controller
www.storageperformance.org/results/benc hmark_results_spc1#a00135
SCALE TO MANAGE DATA GROWTH STORAGE ARRAY CONTROLLER PROVIDES SCALABILITY
Global cache internal switch architecture for scale-up performance Dynamically tier virtualized storage for application data growth
Grow block volumes and file systems dynamically and without concern for size Easily provision block and file capacity for VMs Select HAF and/or hard drive options to balance capacity or performance
SCALE TO EXTERNAL STORAGE
HIGHER DENSITY HAF and HDD PROVIDE LARGER FILE SPACE MANAGE LARGER POOLS
STORAGE CONTROLLER PROVIDES DYNAMIC TIERING POOL A
Dynamic tiering -
Automates the movement of pages in a volume between tiers of storage
EFD/Flash FLASH
Last Referenced
SAS Fast SAS
Flash -
Provides performance for the hot pages
Hard drive -
Provides capacity for lessactive pages
Optimizes performance, capacity, and cost with automation
Last Referenced
NL SAS
MIGRATE DATA WITH LESS EFFORT DATA MOBILITY
90% Less Refresh Effort
Lowest-risk data migration Speed technology refresh Minimize outage window Eliminate application downtime
PROTECT APPLICATION DATA LOCAL DATA REPLICATION FOR INTERNAL USE
Data protection independent of operating system, application, or device Application aware for Microsoft® Exchange and Microsoft SQL Server® for complete data recovery High-speed object-based replication over wide area network Most space-efficient writable snapshots available
SHARE ANY DATA ANY TIME ANYWHERE REMOTE DATA REPLICATION
Move data from any storage system across any distance Automate recovery to resume business in minutes, not hours or days
Deploy locally and remotely for disaster recovery with no interruption in service Replicate data from Hitachi or other virtualized storage
IMPROVE QUALITY OF SERVICE DESIGNED FOR RESILIENCE AND THE HIGHEST AVAILABILITY
100% Data Availability Guarantee
Hitachi HiTrack Monitor Service Online Service and Microcode Updates
100% data availability Ensure uninterrupted access to data Automatic diagnostics with call-home service Update without service interruption
Mirrored Write Cache Active–Active Clustered File Services Shared Resource Block Controllers
HITACHI VSP ACCELERATED FLASH STORAGE STRUCTURE UP TO 4 FLASH CHASSIS PER VSP – MORE THAN 600TB OF FLASH
Drive chassis Hitachi Flash Controller
Flash chassis
Controller
HITACHI ACCELERATED FLASH STORAGE FOR HITACHI UNIFIED STORAGE VM 1.6TB per flash module
12 modules per 2U enclosure – 19.2TB
Up to 8 flash enclosures per system – maximum 154TB 5U controller with 16 cores, 256 GB cache and 36 FC paths
FLASH ECONOMICS Hitachi Accelerated Flash with VSP or HUS VM
3 x Better $/IO Than Solid State Drives
7 x Better $/IO Than Hard Disk Drives
500,000 IOPS
500,000 IOPS
240,000 IOPS
8 drives
80 drives
768 drives
9U
13U
69U
$1 per I/O
$3 per I/O
$7 per I/O
COMPETITIVE PRICE/PERFORMANCE
HUS VM ALL FLASH VS LEADING ALL-FLASH ARRAY
500,000 IOPS < 1ms response $1 per I/O
HUS VM FLASH VS. COMPETITIVE ALL-FLASH ARRAYS
1,000,000 HYBRID ARRAYS
IBM® XIV
HP 3PAR
EMC VNX
ALL-FLASH ARRAYS
HUS VM
Violin Memory
IBM Pure EMC Flash Storage XtremIO System
RANDOM IOPS
COMPETITIVE FLASH STORAGE FEATURES ONLY HITACHI DATA SYSTEMS DELIVERS FULL-FEATURED UNIFIED STORAGE WITH FLASH ACCELERATION AND TIERING ACROSS INTERNAL AND EXTERNAL STORAGE
ACCELERATED HDS FLASH
EXTERNAL VIRTUALIZATION
ONLY HITACHI DATA SYSTEMS DELIVERS DURABLE HIGHPERFORMANCE FLASH MODULES DESIGNED FOR ENTERPRISE STORAGE
HDS, EMC, IBM®, NETAPP
THIN PROVISIONING AUTOMATED TIERING
HDS, EMC, HP, IBM
REMOTE AND LOCAL REPLICATION
HDS, EMC, HP, IBM, NETAPP
UNIFIED
HDS, EMC, HP, IBM, NETAPP, NIMBUS
FLASH STORAGE
HDS, EMC, HP, IBM, NETAPP, VIOLIN, NIMBUS, PURE, ETC.
HUS VM ALL-FLASH STORAGE ARRAY 145 PATENTS FILED FOR HAF AND FLASH ACCELERATION 1,000,000 Up to 154TB IOPS, <1ms flash storage response
Unified and virtualized capacity
Best storage optimization for flash
Best flash form factor and durability
More flexible than all flash systems
Hitachi flash acceleration software
Hitachi Accelerated Flash
Hitachi Command Suite
HYPE OR REALITY?
Flash storage is nonvolatile
Flash can replace DRAM for cache and memory Flash SSDs are built for enterprise storage Flash storage is 10 times more expensive than hard disk drives Flash storage will replace hard disk drives All-flash arrays will outperform hybrid flash arrays
QUESTIONS AND DISCUSSION Questions will be posted to: http://community.hds.com/groups/webtech
UPCOMING WEBTECHS Maximize IT WebTechs ‒ Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration, August 14, 9 a.m. PT, 12 p.m. (noon) ET
‒ Comprehensive and Simplified Management for VMware vSphere Environments – Now, Even Better!, September 11, 9 a.m. PT, 12 p.m. (noon) ET ‒ Easily Deploy Microsoft® Private Cloud and Microsoft SQL Server® 2012 Data Warehouse on Hitachi Converged Solutions, Sept 25, 9 a.m. PT, 12 p.m. (noon) ET
Check www.hds.com/webtech for Links to the recording, the presentation, and Q&A (available next week) Schedule and registration for upcoming WebTech sessions Questions will be posted in the HDS Community:
http://community.hds.com/groups/webtech
THANK YOU
