Preview only show first 10 pages with watermark. For full document please download

Gsez-ds8000 Update V1

   EMBED


Share

Transcript

IBM DS8000 Enterprise Storage Roger G. Hathorn IBM Systems USA 02/11/2016 Session DK © 2016 IBM Corporation IBM Systems Agenda DS8880 storage family current features – release 8.1 DS8880 release 8.2 announcement © 2016 IBM Corporation IBM Systems 2 DS8880 Release 8.1 (2Q+ 2016) § DS8888 All Flash Array - Model 982 and 98F Expansion Unit − § § § § Three phase power option DS8000 Copy Services Manager (CSM) feature on the HMC RAID 10 support for fully populated High Performance Flash Enclosures (HPFE) New drive capacity options for DS8870, DS8884 and DS8886 − − § Up to 2.5M IOPS and ~200 microsecond latency for typical workloads 1.8 TB 10K rpm drive sets 6 TB 7.2K rpm drive sets Functional enhancements − − − − − − − − − Small Extents Thin Provisioning for CKD devices SuperPAV DB2 Castout Accelerator User interfaces for PE package and statesave offload Media error recovery enhancements for PPRC secondary devices Native LDAP support via CSM SSD Home tier and Warm Promote for Easy Tier Key Management Interoperability Protocol (KMIP) as an alternative encryption key manager © 2016 IBM Corporation IBM Systems 3 The DS8880 family DS8888 DS8884 Fast Hybrid-Flash Block Storage Lowest entry cost for midrange enterprises §Hybrid Flash starting §256 GB Cache (DRAM) §64 Ports §768 HDD/SDD + 120 flash cards §19” Rack §Single phase DS8886 Faster Hybrid-Flash Block Storage §High performance for large enterprises §Hybrid Flash §2 TB Cache (DRAM) §128 Ports §1536 HDD/SDD’s + 240 flash cards §19” Rack §Single / three phase Fastest All-Flash Block Storage §Industry’s fastest T1 Subsystem §All-flash §2 TB Cache (DRAM) §128 Ports §480 Flash cards §19” Rack §Three phase IBM introduced a member to the DS8880 family, a new business-critical all-flash data system to offer a wide range of price points. The family is powered by the next generation of IBM's proven DS8000 platform and delivers critical application acceleration, uncompromising availability and industry-leading capabilities. © 2016 IBM Corporation IBM Systems 4 DS8880 Power § The DS8888 will support three phase power § A new three phase power option will be available for the DS8886 − This will take more space in the DS8000 rack so number of drives on initial frames will be reduced § The DS8884 will remain as single phase only © 2016 IBM Corporation IBM Systems 5 SuperPAVs § Today Alias devices can be used within LSS which means that the number of aliases must be sized individually for each LSS. § SuperPAVs will enable alias devices to be shared among multiple LSS so long as − The devices are assigned to the same DS8000 server (odd/even LSS) − The devices share a path group on the z/OS system § Using SuperPAVs will provide benefits especially with a large number of LPARs or many LSS sharing a path group − Any existing IOSQ peaks should reduce as a larger pool of aliases are available − Existing LSS can have more capacity added without increasing the number of aliases − New LSS can be planned to have a larger amount of capacity per alias § There is still a need for at least one base device per LSS so with this release it is not possible to define an alias only LSS 6 © 2016 IBM Corporation IBM Systems DB2 Castout Accelerator § DB2 writes long chains of writes when it performs castout processing which typically contain multiple locate record domains. Today each IO in the chain will be synchronised individually affecting both simplex and Metro Mirror performance. The syncs cause performance delays (>150us per page) that are not required. § Other applications such as ZFS that do long chains of scattered writes can also benefit from this enhancement § Media manager can tell us that there is a "single logical locate record domain", even though there are multiple imbedded locate records. The data hardening requirements for the entire IO are as if this was a single LR domain so one PPRC sync is done for the entire chain. § zHPF only § Prototype code results showed a 49% improvement in performance with Metro Mirror for typical write chains similar to DB2 castout and 70% for simplex devices. 7 © 2016 IBM Corporation IBM Systems Media Error Recovery on PPRC secondary § For environments with multiple site replication environments media errors or other data loss events can occur on any of the replicated copies. HyperSwap protects against events on the production copy but manual actions are currently needed if there is an event such as a RAID rebuild failure on other copies of data. § When a media error occurs on the secondary the DS8000 will log the track range lost and suspend the pair showing suspend reason x’11’ which will result in a GDPS freeze. Reason code x’3B’ will also be provided on the event notification for the suspend − For Global Copy and Global Mirror auto unsuspend will add the track range to the OOS and the tracks will be recovered on resync. − For Metro Mirror resynchronisation will add the track range to the OOS and the tracks will be recovered on resync. § In the initial release only a subset of data loss events will be covered by this functionality. − Only media error events will be covered (ESCs 4910 and 4920) − Only up to 500,000 tracks will be able to be handled − Failover/failback conditions can cause the information about lost tracks to be lost − Call Home events will notify support and the user about status and if there are data loss conditions not handled by this functionality 8 © 2016 IBM Corporation IBM Systems Create & Offload PE Package & Statesave § Out Of Band generation & offload of Statesaves, ODD dumps, PE Package, PE Package by Area § Performed via DS-CLI or ReSTful API − Default is offload last available − Can list and select any available Examples: dscli>offloadfile -dev IBM.2107-1300861 –pepackage dscli>offloadfile -dev IBM.2107-1300861 -statesave § Automation opportunities previously discussed as part of Restoring Storage Resilience • GDPS HyperSwap occurs • Issue commands to offload PEPkg/SS automatically • Data for Analysis is available far sooner / Problem Resolved sooner / Swap Back sooner © 2016 IBM Corporation IBM Systems 9 Small extent size §Reduce extent size on DS8000 from 1GB to 16MB (1113 cyls to 21 cyls for ECKD) –Larger memory sizes on next generation systems allow for smaller extent allocation without performance penalties –z/OS allocation unit for EAV devices is 21 cyls so dataset allocation will match extent boundary §Improves efficiency of tiering functionality, copy services as well as providing more efficient capacity usage §Improves balance among rank resources even at very short time intervals significantly improving performance stability even for very bursty workloads 1 2 7 8 1 4 5 8 11 4 5 6 9 2 3 6 9 10 §Allows for use of Space Efficient FlashCopy with Global Mirror with improved performance compared to the current Track Space Efficient FlashCopy –Significant reduction in cost for high performance Global Mirror environments 10 © 2016 IBM Corporation IBM Systems Small Extents with Flash Copy § ESE Flash Copy with Small Extents replaces TSE Flash Copy – more space efficient than ESE with large extents – better performance than TSE Flash Copy § Pool with small extents supported for Flash Copy Target volumes § Supported for Global Mirror Journal Volumes § For optimal performance include 10% Flash in the small extent pool © 2016 IBM Corporation IBM Systems 11 Easy Tier enhancements § SSD Home Tier − As the price of Flash/SSD reduces clients are configuring larger percentages of Flash in tiered environments. Given a larger percentage of Flash the initial allocation of extents on flash makes better sense − SSD Home tier will change Easy Tier behaviour in the following ways • Extent allocation will be performed on tier0 then tier1 then tier2 • Cold Demotion will be performed from tier0 to tier1 • Additional space will be reserved on tier0 for thin provisioned volume allocations (currently 24 extents) − SSD Home Tier will be an optional switch provided at the DS8000 box level § Warm Promote − − − 12 Environments using Nearline drives have occasionally seen problems where there is a significant amount of data on Nearline that suddenly becomes active. The same could also apply with larger Enterprise drives Warm Promote will act in a similar way to Warm Demote and if the 5 minute average performance shows a Nearline (or Enterprise) rank is overloaded will immediately start to promote extents until the condition is relieved. As the Nearline performance profile is somewhat conservative this is quite likely to occur if there is any significant activity on Nearline ranks but for Enterprise ranks is less likely © 2016 IBM Corporation IBM Systems Thin Provisioning for ECKD in DS8880 § § Once allocated provides the same performance as fully provisioned devices for both random and sequential workloads − Allocating writes require metadata updates as each extent is allocated Unallocated extents do not have to be copied with replication functionality or migrated with Easy Tier A001 DB1234 1 2 3 4 5 6 1 A002 Storage Pool SPARE1 1 § § Simplify configuration by standardizing device sizes without wasting space − Unused/unallocated devices can be included in replication configuration avoiding frequent changes Allow for sharing of spare storage capacity across sysplexes or between storage groups SSD drives 2 1 5 3 4 300GB drives 300GB drives 6 3TB drives © 2016 IBM Corporation IBM Systems 13 IBM® DS8880 Roger Hathorn STSM IBM Systems IBM DS8880 Release 8.2 Release Announcement Summary © 2016 IBM Corporation IBM Systems 14 DS8880 R8.2 Announcement Summary § § § HPFE Gen 2 Flash overview and history HPFE Gen2 hardware and benefits § CKD Thin Provisioning enhancements − Extent level space release − PPRC from Full to ESE § Enhanced FICON IU pacing − For better performance with higher speed links at distance. § Miscellaneous items of interest − DSCLI support for z/OS – can run under UNIX system services − RAID Options and New Model Numbers © 2016 IBM Corporation IBM Systems 15 NAND Flash technology is used across the IBM Systems Flash Storage Portfolio NAND Flash comes in many types Flash Memory provides important advantages over tradition Hard Disk Drives: üFaster read and write operations üNon-volatile üLess prone to damage üPhysically small üLow power consumption üInherently rugged ü Single-level cell (SLC) - Highest performance ü Multilevel cell (MLC) - Good balance between performance and cost ü Triple-level cell (TLC) - Lower cost for read intensive workloads MLC1 NAND Technology is used across the IBM Systems Flash Storage portfolio 1Enterprise MLC (eMLC) or IBM enhanced MLC © 2016 IBM Corporation IBM Systems 16 Flash technology can be used in many forms … IBM Systems Flash Storage Offerings • All-flash arrays are storage solutions that only use flash media (CFH or SSDs) designed to deliver maximum performance for application and workload where speed is critical. • Hybrid-flash arrays Hybrid-flash array (HFA) Mixed (HDD/SSD/CFH) All-flash array (AFA) All-SSD All-Custom Flash Hardware (CFH) SSD refers to a flash media based storage device that is accessed and managed as a logical disk drive, consisting of a standard disk drive interface (such as SAS or SATA). Their sizes are 1.8 and 2.5 inches Source: IDC's Worldwide Flash in the Datacenter Taxonomy, 2016 © 2016 IBM Corporation are storage solutions that support a mix of HDDs, SSDs and CFH designed to provide a balance between performance, capacity and cost for a variety of workloads CFH defines an architecture that uses optimized flash modules to provide better performance and lower latency than SSDs. Examples of CFH are: • • High-Performance Flash Enclosure Gen2 FlashSystem MicroLatency Module The DS8880 Family offers All-flash and Hybrid-flash with CFH, SSD and HDD configurations designed to satisfy a wide range of business needs from superior performance to cost efficient requirements IBM Systems 17 Flash brings real benefits that justify the investment by far … Besides the performance benefits, there are additional compelling advantages when adopting Flash technology 1.Meet or exceed the performance level agreements with far fewer devices 4. Fewer servers require less spending on software licenses 2.Flash requires lower energy and less floor space consumption 5. Lower operating and administrative costs 3.Fewer servers are required due to better CPU utilization 6. Better reliability since flash is based on electronic rather than mechanical media Source: Justifying Investment in All-Flash Arrays. IDC August 2016 © 2016 IBM Corporation IBM Systems 18 Future view of the All-flash and Hybrid-flash market … 74.5% of the business revenue will be flash-based (AFA and HFA) by 2020 All Hard Disk Drive Hybrid Flash 42.11% 41.70% 42.64% 43.85% 44.66% 45.63% 45.25% 5.64% 11.20% 16.28% 20.38% 24.05% 27.38% 29.28% All Flash Source: Worldwide External Enterprise Storage Systems Forecast, 2016–2020, Publication Date: IDC Jul , 2016 © 2016 IBM Corporation IBM Systems 19 IBM DS8880 R8.2 Announcement Summary 1.- High-Performance Flash Enclosure Gen2 ü Enables faster decision making with up to 2x performance improvement per enclosure1 on real-time analytics, cognitive computing and traditional IO intensive workloads ü Manages business data growth with up to 6 times more capacity per enclosure for storage consolidation and high-data-volume workloads2 ü Improves data protection for superior business continuity where integrity is critical by using RAID 6 as default High-Performance Flash Enclosure Gen2 2.- Thin Provisioning space release for z System volumes ü Provides better synergy with z Systems by enabling space release functionality for Count Key Data (CKD) volumes ü Improves storage efficiency by releasing free extents and making them available for reuse 1Two times more performance per enclosure compared with the previous generation of High-Performance Flash Enclosures. The performance is 2.5M IOPS per DS8880 system 2 Six times more capacity per enclosure considering the previous generation of High-Performance Flash Enclosures with 30 x 800 GB Flash Cards ( 24 TB) and the new generation of flash enclosures with 48 x 3.2 TB Flash Cards ( 153.6 TB) © 2016 IBM Corporation IBM Systems 20 IBM DS8880 R8.2 Announcement Summary 3.- Improved DS8000 Storage Manager Graphical User Interface Automatic creation based on unassigned host ports ü Helps organizations in accelerating the storage deployment process by simplifying the definition and configuration of new host servers ü Provides advanced collaborative tools to storage administrators in order to work more efficiently with support, enabling problem determination in a fraction of the time 4.- Enhanced FICON at extended distances on long read and write operations1 ü Improves customer satisfaction and business continuity by increasing the throughput up to 4 times on z/OS Global Mirror (zGM) initial copy or resynchronization, as well as improving performance of DFSMSdss, DB2 Utilities and other software using long FICON chains especially in in multi-site parallel sysplex environments 1 Applies only to 16Gb FC Host Adapters © 2016 IBM Corporation IBM Systems 21 CKD Thin Provisioning specifics § Space Release − DFSMSdss SPACEREL utility to release dataset extents for volumes or storage groups − Protected by RACF FACILITY Class profile, STGADMIN.ADR.SPACEREL − Supported on Metro Mirror primaries (or simplex devices) only at this time § PPRC from standard to ESE volumes for migration − Secondary volume becomes fully provisioned (if the same size) − SPACEREL after relationship termination © 2016 IBM Corporation IBM Systems 22 High-Performance Flash Enclosure Gen2 is a breakthrough in technology 1 to 1 High-Performance Flash Enclosure High-Performance Flash Enclosure Gen2 1U 4U Size Flash card options Number of supported flash cards Max raw capacity RAID protection 16, 32 or 48 (2.5”) 24 TB1 153.6 TB2 Over 6x 5 / 10 5 / 6 /10 Two PCIe Gen 2 Install groups 2 install groups of 16 Flash drive and 14 Flash Drives (4 array sites) • Two PCIe Gen 3 for attachment to the IO / Micro Bay • Eight SAS 6Gb for attachment to the Gen2 enclosure 3 install groups of 16 Flash drive each (6 array sites) Performance 2 400 / 800 / 1600 / 3200 GB Attachment Increments 1 400 / 800 GB 16 or 30 (1.8”) Populate in increments of a single High-Performance Flash Enclosure IOPS Throughput Populate in increments of a single storage group consisting of: One HighPerformance Flash Enclosure Gen2 + Two IO / Micro Bays IOPS Throughput Read 340,000 3.8 GB/s Read 650,000 +90% 8 GB/s + 110% Write 200,000 2.7 GB/s Write 300,000 +50% 5 GB/s + 85% 30 flash cards x 800 GB 48 flash cards x 3.2 TB © 2016 IBM Corporation IBM Systems 23 Total raw flash capacity comparison between the previous and the new DS8884 and DS8886 models 700000 614400 Over 3 times the flash capacity of the previous models 600000 500000 TB 400000 307200 300000 192000 200000 100000 96000 0 DS8884 DS8886 HPFE DS8884 DS8886 HPFE Gen2 HPFE 96000 192000 © 2016 IBM Corporation HPFE Gen2 307200 614400 IBM Systems 24 DS8888 Performance – zHPF © 2016 IBM Corporation IBM Systems 25 DS8888 Performance – All Flash © 2016 IBM Corporation IBM Systems 26 RAID 6 for mission-critical protection Drive media is rapidly increasing in capacity to 10TB and more. The greater density provides real cost advantages but requires changes in the types of RAID protection used S P Q 5 4 3 2 1 S ü Performs better than RAID 6 ü Provides more usable capacity P 6 5 4 3 2 1 Traditionally RAID 5 has been used over RAID 6 for Enterprise and Flash media because: RAID 5 RAID 6 RAID 5 uses one parity drive whereas RAID 6 uses two However as the drive capacity increases , RAID 5 exposes enterprises to increased risks, since higher capacity drives are more vulnerable to storage media errors during array rebuild ü Data will be lost, if a second drive fails while the first failed drive is being rebuilt ü Media errors experienced on a drive during rebuild result in a portion of the data being non-recoverable © 2016 IBM Corporation IBM Systems 27 The DS8880 family takes the increased risks posed by high capacity drives very seriously In order to improve data availability, IBM moves protection to the next level by enabling RAID 6 as default in the GUI for all drive types RAID 6 ensures business continuity for mission-critical applications because: ü Data is still protected event if a second drive fails while the first failed drive is being rebuilt ü Information placed in unreadable regions in a specific drive can be detected, isolated and recovered from the remaining drives ü RAID 6 provides a 1000x improvement over RAID5 for impact risk The use of RAID6 rather than RAID5 can dramatically reduce the probability of drive failures providing increased protection for workloads where data integrity is critical © 2016 IBM Corporation IBM Systems 28 IBM DS8880 Family: All-flash and Hybrid-flash Made for Business-Critical Workloads Enterprise Class Business Class DS8884 Model Cache FC/FICON ports Media Max raw capacity DS8886 Analytic Class DS8888 Affordable hybrid-flash block storage solution for midrange enterprises Faster hybrid-flash block storage for large enterprises designed to support a wide variety of application workloads Fastest all-flash block storage with superior performance designed to address the most demanding business workloads 984 985 (Single Phase) 986 (Three Phase) 982 256GB 2TB 2TB 64 128 128 768 HDD/SSD 96 flash cards 1536 HDD/SSD 192 flash cards 480 Flash cards 2.6 PB 5.2 PB 384 TB IBM DS8880 is the business-critical storage family designed to offer a wide range of price points. This enterprise storage data systems are powered by the next generation of IBM's proven DS8000 platform and deliver critical application acceleration, uncompromising availability and industry-leading capabilities © 2016 IBM Corporation IBM Systems 29 Efficiently consolidate all your business-critical applications Only the IBM DS8880 family provides the deepest integration with IBM® z Systems™ while supporting IBM Power Systems, and Distributed Systems under a single management point Enable your business to efficiently address the widest variety of workloads: Cognitive: All-flash and hybrid configurations to support operational decisions and optimize business processes in real-time Cloud: RESTful and OpenStack APIs to enable critical workloads applications in private and public cloud environments Business Analytics: Superior performance and unparalleled availability for analytics applications and real-time decision making I/O-intensive: Improved data speed access for databases, enterprise resource planning systems, online transaction processing systems and data warehouse applications © 2016 IBM Corporation IBM Systems 30 Workloads and Use Cases: IBM DS8000 family Cognitive Cloud A Health institution turns its IT department into an affiliate company that offers specialized IT services to other health insurers and adds USD 5 million in income. This institution uses IBM z/OS and IBM System Storage DS8000 to develop a solution with a market-leading interface powered by IBM Watson Explorer Enterprise Edition cognitive search. This solution learns from A Health institution successfully opens its first clinic by an aggressive deadline and gains a reliable IT infrastructure for its clinical applications and facilitates smooth operation of the new clinic by designing and building a storage infrastructure based on IBM SmartCloud Control Desk and IBM System Storage DS8000 searches over time, refining results based on the success of past interactions Cognitive Analytics Business Analytics An energy corporation accelerates audits by 98 percent, gains insights into customer behavior and eliminate the manual reporting tasks integrating SAP, ERP, SAP for utilities and SAP Business Warehouse software by connecting the servers to multiple IBM System Storage DS8000 solutions Cloud © 2016 IBM Corporation I/Ointensive I/O-intensive A restoration services company in Germany improved the performance for most mission critical SAP applications and the underlying DB2 database by up to 50 percent and decreased backup times from 3.5 hours to two minutes, a 99 percent reduction. All of this using the IBM Systems Storage DS8000 IBM Systems 31 Notices and Disclaimers Copyright © 2016 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM. U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM. Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT OR LOSS OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided. IBM products are manufactured from new parts or new and used parts. In some cases, a product may not be new and may have been previously installed. Regardless, our warranty terms apply.” Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice. Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary. References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business. Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation. It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law © 2016 IBM Corporation IBM Systems 32 Notices and Disclaimers Con’t. Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right. IBM, the IBM logo, ibm.com, Aspera®, Bluemix, Blueworks Live, CICS, Clearcase, Cognos®, DOORS®, Emptoris®, Enterprise Document Management System™, FASP®, FileNet®, Global Business Services ®, Global Technology Services ®, IBM ExperienceOne™, IBM SmartCloud®, IBM Social Business®, Information on Demand, ILOG, Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™, PureApplication®, pureCluster™, PureCoverage®, PureData®, PureExperience®, PureFlex®, pureQuery®, pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, Smarter Commerce®, SoDA, SPSS, Sterling Commerce®, StoredIQ, Tealeaf®, Tivoli®, Trusteer®, Unica®, urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml. © 2016 IBM Corporation IBM Systems 33 Session feedback § Please submit your feedback at http://conferences.gse.org.uk/2016/feedback/dk § Session is DK © 2016 IBM Corporation IBM Systems 34