Transcript
EMC Disk Library for Mainframe August 2012
EMC DISK LIBRARY FOR MAINFRAME A complete suite of solutions to meet any mainframe tape requirement Carlo Dioos
BRS EMEA TC
[email protected]
© Copyright 2012 EMC Corporation. All rights reserved.
1
EMC Mainframe Solutions in the News
© Copyright 2012 EMC Corporation. All rights reserved.
2
1
EMC Disk Library for Mainframe August 2012
Typical Mainframe Tape Challenges • Performance of tape applications • Service level agreements • Batch and backup windows • CPU consumption • 100% disaster recovery compliance • Lost or stolen tapes • Operating costs (tapes, power, etc.) • Data loss (multiple tapes) • Personnel inefficiencies
© Copyright 2012 EMC Corporation. All rights reserved.
3
EMC Disk Library For Mainframe (DLm) Tape Replacement For Mainframe Environments Scalable Capacity 13 TB – 4.0 PB
Storage Efficiency Supports Regular & Deduplication Storage
Flexible Deployment Single Solution For All Mainframe Tape Workloads Including Backup, HSM, Archiving & Work Tapes
Simplified Operations Managed From z/OS Console
Tape & DASD Consistency Tape Data Consistency with DASD at primary and DR site(s) with DLm8000 and SRDF/S
© Copyright 2012 EMC Corporation. All rights reserved.
4
2
EMC Disk Library for Mainframe August 2012
DLm8000: Ultra-high Resiliency Evolution of DLm for mainframe tape March 2008 DLm4020 & DLm4080 debut as “tapeless” MF tape & superior DR
1st
Sept. 2009 DLm120 & DLm960 Gen-2 with highly scalable storage and GR v2
June 2010 DLm960 with Data Domain dedupe option
Generation
Aug. 2011 DLm6000 Gen-3 with massive scale, integrated dedupe and GR v3
Aug. 2012 DLm8000 Gen-3 based on EMC VMAX, SRDF, and Consistency Groups
2nd Generation
3rd Generation
© Copyright 2012 EMC Corporation. All rights reserved.
5
Disk Library for Mainframe Components Virtual Tape Emulation Controller (VTEC) – Emulates IBM 3480/3490/3590 tape drives
VTE VTE VTE VTE VTE VTE
▪ ▪ ▪
– – – – –
VTEC
256 tape drives per VTE (DLm2000, DLm6000 & DLm8000) 32 or 128 per VTE (DLm1000) Stateless
FICON connectivity Virtual cartridge size up to 16 TB HW compression per VTE engine Supports deduplication >=2VTE : HA, NDU
Back-end storage Back-end storage
EMC Disk Library for mainframe
– – – – – – –
Stores all tape images as files Shares all tape volumes among all VTEs Disk consumption is based on data written Supports Symmetrix VMAX storage Supports VNX NFS storage Supports Data Domain deduplication storage Supports VNX and DD concurrently (DLm6000 only)
© Copyright 2012 EMC Corporation. All rights reserved.
7
3
EMC Disk Library for Mainframe August 2012
EMC Mainframe VTL Architecture Tape on Disk
Virtual Tape Engine 340 MB/s – 256 dev
Dedup and/or Non-dedup backend storage
Virtual Tape Engine 340 MB/s – 256 dev Virtual Tape Engine 340 MB/s – 256 dev Virtual Tape Engine 340 MB/s – 256 dev Virtual Tape Engine 340 MB/s – 256 dev
Mainframe Web Console zOS Console
Virtual Tape Engine 340 MB/s – 256 dev Virtual Tape Engine 340 MB/s – 256 dev Virtual Tape Engine 340 MB/s – 256 dev (340 ) 680 - 2700 MB/s Up to 2048 devices
Up to 2.5 PB usable disk Up to 5.7 PB logical Dedupe
© Copyright 2012 EMC Corporation. All rights reserved.
8
Remote Replication Single Remote Site
Compression or Deduplication yields less data
WAN/IP
– Less bandwidth needed for replication
Bi-directional replication Source
Reduce current tape RPO/RTO
Target
– From days to hours or minutes Multiple Remote Sites
No performance penalty on mainframe host Back-end storage replication – On DD, only changes are replicated
Target 1
Flexible replication configurations
Source
– Prioritize data for replication – Replicate to one or two sites Target 2
© Copyright 2012 EMC Corporation. All rights reserved.
9
4
EMC Disk Library for Mainframe August 2012
Typical Mainframe Tape Solutions IBM z/OS mainframe WORK TAPES
DATA ARCHIVE
Physical tape
HSM MIGRATION
Virtual tape
BACKUP
Deduplication
Two or three different tape platforms (and code bases) would be needed to satisfy the requirements of all use cases
© Copyright 2012 EMC Corporation. All rights reserved.
11
EMC Mainframe Tape Solution IBM z/OS mainframe WORK TAPES
DATA ARCHIVE
HSM MIGRATION
BACKUP
EMC Disk Library for mainframe
EMC satisfies the needs of all use cases in a single, manageable solution
© Copyright 2012 EMC Corporation. All rights reserved.
12
5
EMC Disk Library for Mainframe August 2012
Data Domain Infrastructure and Ecosystem VMware Microsoft SQL Microsoft Exchange Application Server IBM i (aka AS400) Others...
Backup Clients
Archive
NAS, SAN, DAS
Primary Storage
Mainframe z/OS , VM, VSE Unisys OS2200
Archive Apps
Backup Application NetWorker NetBackup Backup Exec
DLm1000
LAN
Replication
Protocol : CIFS/NFS, DD-BOOST: Ethernet VTL / Fibre Channel FICON DLm EMC Data Domain Deduplication Storage
Disaster Recovery
Data Domain
FC (X)GbE
© Copyright 2012 EMC Corporation. All rights reserved.
13
Mainframe Tape Requirements Solution classes to meet recoverability requirements Traditional
Backup Data dedupe for efficient storage utilization Mixed support for mainframe, IBM-i and open systems Incremental delta guaranteed replication (async)
Batch, HSM, Archive, Backup Traditional virtual tape environment Large SYSPLEX, multiple LPARs Guaranteed replication (sync)
SME
Dedupe
Data Domain DLm1000, DLm6000
Ent
Critical operational tape data (HSM) Very short RTO Synchronous/Asynch replication Consistency between primary and tape data Automated recovery
LRG Ent
Standard
VNX DLm2000, DLm6000
© Copyright 2012 EMC Corporation. All rights reserved.
Mission-Critical
Ultra HA
VMAX DLm8000
14
6
EMC Disk Library for Mainframe August 2012
DLm8000 Value Propositions • Single solution for all tape needs • Excellent performance – Elimination of latencies with tape robotics, load and seek times – Reduce batch windows
• Extremely reliable – “Tape” volumes inherit RAS characteristics of RAID disk
• Operation efficiencies – Eliminate tape handling and errors (lost tapes, etc.)
• Optimal for Disaster Recovery – SRDF/S and Guaranteed replication
© Copyright 2012 EMC Corporation. All rights reserved.
15
DLm8000 Features Integrates Symmetrix VMAX storage
Enterprise manageability – EMC z/OS Storage Manager (EzSM)
EMC Symmetrix Remote Data Facility (SRDF/S) replication
z/OS console support Selective replication
Consistency of tape data at production and disaster recovery sites
– Set replication at file system level
Increased performance – Up to 2.7 GB/s throughput
Increased scalability – Scales up to 6 PB of logical capacity
© Copyright 2012 EMC Corporation. All rights reserved.
16
7
EMC Disk Library for Mainframe August 2012
EMC’s Mainframe Virtual Tape Solutions EMC Disk Library for mainframe Enterprise solution (DLm8000) – – –
Highest availability for critical tape recovery Leverages Symmetrix VMAX storage and SRDF/S replication Data consistency between production and recovery sites
Enterprise solution (DLm6000): – –
Scalability and flexibility Both deduplication and non-deduplication storage
IBM mainframe
EMC DLm8000/6000/2000
DLm1000
Commercial solution (DLm2000): – –
Enterprise performance Primary storage only
Gateway solution (DLm1000): – –
Connecting Data Domain storage to the mainframe Shared mainframe/open systems
EMC DLm1000
© Copyright 2012 EMC Corporation. All rights reserved.
17
DLm6000 Features Integrates both VNX7500 and/or DD890 storage systems
Selective replication – Set replication at file system level
– In a single, manageable platform
Support for RSA Data Protection Manager
Increased performance – Up to 2 GB/s throughput
Write once, read many (WORM) tape
Increased scalability
– Enterprise – Compliance
– Scales from 40 TB to 5.7 PB of logical capacity
z/OS console support
Enhanced guaranteed replication
– Centralizes Disk Library for mainframe operations at z/OS console
– File remains mounted until file data is replicated to target site
© Copyright 2012 EMC Corporation. All rights reserved.
18
8
EMC Disk Library for Mainframe August 2012
DLm2000 Features Integrates VNX storage systems
Selective replication – Set replication at file system level
Increased performance – Up to 680 MB/s throughput
Write once, read many (WORM) tape
Increased scalability – Scales from 13 TB to 143 TB of usable capacity
– Enterprise – Compliance
z/OS console support
Enhanced guaranteed replication
– Centralizes Disk Library for mainframe operations at z/OS console
– File remains mounted until file data is replicated to target site
© Copyright 2012 EMC Corporation. All rights reserved.
19
DLm1000 Features Available in two models
z/OS console support
– DLm1010 w/single FICON and 32 drives – DLm1020 w/dual FICON and 128 drives – Flexibility to meet specific customer requirements
– Centralizes Disk Library for mainframe operations at z/OS console
Deduplication reduces storage and replication costs Flexible RPO and RTO
Integrates with Data Domain storage systems
Supports z/OS, z/VM and z/VSE operating systems
– DD630, DD640, DD670, DD860, DD880, DD890 or DD990
Data Domain storage can be shared with open system servers, including IBM i
© Copyright 2012 EMC Corporation. All rights reserved.
20
9
EMC Disk Library for Mainframe August 2012
DLm Family DLm8000
DLm6000
DLm2000
DLm1000
Number of VTEs
2-8
2-6
1 or 2
1/2
Connectivity
FICON
FICON
FICON
FICON
Number of channels to host
4-16
4-12
2 or 4
1/2
Number of virtual tape drives
Up to 2,048
Up to 1,536
Up to 512
Up 32/128
40 TB -2.4 PB
14.5 TB – 159.5 TB
Depends on DD
Maximum capacity (usable non-dedupe)
56 TB -1.792 PB
Performance
Up to 2.7 GB/s
Up to 2.0 GB/s
Up to 700 MB/s
174/340 MB/s
Deduplication storage
N/A
Yes – DD890 (2)
N/A
Yes – current DD
Deduplication capacity
N/A
Up to 5.7PB(a)
N/A
Up to 2.8(b)
Number of Cabinets
3-13
2-16
1
N/A
Replication
Yes (SRDF)
Yes
Yes
Yes
(a) – assuming a DD890 and 10:1 compression (b) – assuming a DD670 and 10:1 compression
© Copyright 2012 EMC Corporation. All rights reserved.
21
Customer Validation (EMC World 2012) Measured 1 Year Later after Replicated DLm960 Implementation (same 30 day period)
HSM Migrations 32% reduction in CPU usage 9% more data
Daily Backup 55% reduction in clock time 27% reduction in CPU usage
HSM Recycles Migration Data 58% reduction in CPU usage 38% reduction in clock time
HSM Recalls 2,000 recalls per day From 120 sec. to <1 sec. 27% reduction in CPU usage
HSM Recycles Backup Data 53% reduction in CPU usage 41% reduction in clock time
© Copyright 2012 EMC Corporation. All rights reserved.
22
10
EMC Disk Library for Mainframe August 2012
Why EMC Virtual Tape for Mainframe? Eliminates all issues related to traditional tape handling –
Eliminates manual intervention, physical movement of tape cartridges, robotic issues, and single points of failure
Works seamlessly with existing applications –
No Job Control Language (JCL) changes are required and works with your existing tape management system
Significantly improves performance –
Reallocates all of the data to disk and uses smart I/O buffering, allowing potentially significant reductions in batch windows
Extends disaster recovery capabilities to the tape workload –
Utilizes array-based replication process over IP to seamlessly move tapes offsite
Enhanced data protection with encryption and RSA Data Protection Manager –
For data at rest or during transmission
Easily scales as the workload increases –
Add throughput performance and storage capacity as needed
© Copyright 2012 EMC Corporation. All rights reserved.
23
Technical Features The following optional slides show the technical detail of: • • • • • • • • • • •
“WORM” tape RSA Data Protection Manager Guaranteed replication Mapping the DLm to the mainframe High performance High availability HSM migration Disaster recovery vaulting and testing Management reporting Professional services Support
© Copyright 2012 EMC Corporation. All rights reserved.
24
11
EMC Disk Library for Mainframe August 2012
WORM Tape Enterprise Provides for retention periods per file Enables adherence to good business practices – Tamper-proof clock – Activity logging
Compliance Meets SEC Rule 17a-4(f) compliance requirements – Prevents file system deletions with locked files – “Hard” default retention periods – Data verification to validate committed content
Retention periods cannot be modified File systems can only be deleted when retention period has expired Third-party compliance validation paper
© Copyright 2012 EMC Corporation. All rights reserved.
25
RSA Key Management RSA Key Server
VTEs will always include the RSA client RSA Data Protection Manager requires a separately licensed RSA server
Corporate network
Access Control Point
Individual drives will be configured for encryption (as they are today) When a new tape is written to a drive configured for encryption, a call to the RSA Data Protection Manager is made
RSA Client with Software Encryption
The Data Protection Manager returns two keys: a clear key and an encryption key RSA Client with Software Encryption
VTE RSA Client with Software Encryption
RSA client uses the encryption key to store the clear key on the volume Support for DLm6000 with VNX7500 storage only
RSA Client with Software Encryption
© Copyright 2012 EMC Corporation. All rights reserved.
26
12
EMC Disk Library for Mainframe August 2012
Guaranteed Replication 2:00 AM
2:12 AM
2:30 AM
2:35 AM
DLm replication starts based on RPO
2:40 AM
Production Site
Remote Site
Backup job starts – Backing up 100 GB dataset (will create a 30 GB tape)
Next DLm replication cycle starts based on RPO – Backup tape is being replicated – First 25 GB of tape are replicated
Backup job ends – “Rewind unload” command is sent to the DLm – DLm forces replication – Last 5 GB of the backup tape are replicated
Replication is complete – Return control to the mainframe host to finish the backup job
© Copyright 2012 EMC Corporation. All rights reserved.
27
Testing the Disaster Recovery Environment Two ways to conduct disaster recovery testing from copy of production data Production Site
Remote Site
WAN/IP R/W
Mainframe
Bi-directional replication
Disk Library for mainframe
Read-only mounts • Disk arrays allow instant “read-only” copies • Confirm that tapes can be mounted and all required data can be accessed • No incremental storage capacity required
R/O R/W
Disk Library for mainframe
Mainframe
Snapshots • Disk arrays allow creation of “readwrite” snapshot • Confirm operation at the disaster recovery site • Some incremental storage capacity required
Remote replication is uninterrupted © Copyright 2012 EMC Corporation. All rights reserved.
28
13
EMC Disk Library for Mainframe August 2012
How DLm6000 Maps to Mainframe Host The mainframe host views Disk Library for mainframe as tape drives Data for different use cases is directed to the appropriate storage type IBM z/OS mainframe
Drives are managed as mainframe tape libraries (MTLs) under System Managed Storage (SMS)
EMC DLm6000
VNX storage Batch HSM Fixed content
Data Domain storage Backup Archive
Tape administrator will map specific range of tape drives to a specific VTE Each VTE can access any tape dataset in the library Each tape VOLSER is kept on disk as a file – No wasted media
© Copyright 2012 EMC Corporation. All rights reserved.
29
Disk Library for Mainframe Performance vs. Tape Physical tape Mount
Seek
Stage
5 Sec
5 Sec
3 Sec
Batch processing
Time to first byte: 13 seconds
Disk Library for mainframe
Job completion
Provides… Faster time to first byte – One second mount time on average
Mount
Batch processing at disk speed Job completion
Faster batch processing – Over 300 MB/s per VTE – Up to six VTEs
Disk Library for mainframe
© Copyright 2012 EMC Corporation. All rights reserved.
30
14
EMC Disk Library for Mainframe August 2012
Improved Response Time File name = Tape VOLSER
Fast locate provides additional performance benefits – Response times drop from 15–40 seconds to less than one second on average – Improves service level agreements – Immediate major benefit to fixed content applications such as:
AWSTAPE
▪ IBM ImagePlus ▪ ASG-ViewDirect
Index
When Disk Library for mainframe writes to tape, it builds an index for fast locate
• Tape mark locations
– Index is stored at the end of the volume’s disk file – Contains a pointer to:
• 5 MB block boundaries
▪ Each tape mark location ▪ Each 5 MB block boundary
Tape image on disk
– On read, the VTE can go directly to any tape mark
© Copyright 2012 EMC Corporation. All rights reserved.
31
No Single Point of Failure IBM mainframe
EMC Disk Library for mainframe
All VTEs can see all tape volumes If a VTE fails… – Job will fail with tape error (same as with regular tapes) – Tape volumes are still available through alternate VTE – VTE does not contain metadata
Disk drives are RAID 6 protected – 8 + 2 protection – (Global) Hot spare drives Parity
Hot Spare
Any VTE can access any tape volume in the library
© Copyright 2012 EMC Corporation. All rights reserved.
32
15
EMC Disk Library for Mainframe August 2012
Tape Drive Sharing External software required for tape sharing across LPARs
Up to 2,048 emulated tape drives Eliminates the need for automated tape device sharing software VTE provides full multiple image support
Disk Library for mainframe individual tapes across LPARs
– Devices dynamically learn paths to attaching to up to 64 LPARs
Support for Autoswitch Support for cascading directors
© Copyright 2012 EMC Corporation. All rights reserved.
33
Reduce HSM CPU Cycles Reduce/eliminate DFHSM ML1 – Move directly from L0 to ML2 – Save the mainframe CPU compression cycles – ML2 information is compressed and kept on disk in the DLm – Recalls at disk speed
ML0
ML2
Disk Library for mainframe
Production DASD
DFHSM recycle time optimized
Virtual tape reclaimed on disk
– DFHSM will continue to perform tape recycling ▪ Recycling at disk speed ▪ User-settable virtual cartridge size ▪ No contention for tape drives
– Hours of savings potential
© Copyright 2012 EMC Corporation. All rights reserved.
34
16
EMC Disk Library for Mainframe August 2012
Management Reporting (Batch or Console) Easy to manage the Disk Library for mainframe from the mainframe host Retrieve the following information: – – – – – – – – –
//COMMAND EXEC PGM=DLMCMD //STEPLIB DD DISP=SHR,DSN=user.apf.loadlib //DLMCTRL DD UNIT=/xxxx,DISP=SHR,LABEL=(,SL), // DSN=DLM.CMDPASS.EXAMPLE,VOL=(,RETAIN,SER=zzzzzz) //SYSUDUMP DD SYSOUT=* //DLMLOG DD SYSOUT=* //DLMCMD DD * RUNWAIT (600) 501 'DLm command' 'output destination path' 'output file' /*
Space Compression Configuration Paths Paths assigned Channel adapters Rejected paths Performance information Slowest mounts
© Copyright 2012 EMC Corporation. All rights reserved.
35
Discover and View Configuration of DLm Systems (EzSM) 1
1
Discover and Monitor DLm Devices •Import and Export Tapes
2 2
Set Configuration Options •Display Configuration Information
© Copyright 2012 EMC Corporation. All rights reserved.
36
17
EMC Disk Library for Mainframe August 2012
EMC Mainframe Global Services •
Plan, deploy and optimize EMC Technology into Mainframe environments
•
Proven Mainframe expertise and services
•
Best practices, proven delivery and project management methodologies
•
Access to proven reference architectures and interoperability results
Assessment Design and Implementation Optimization and Validation Integration Migration
© Copyright 2012 EMC Corporation. All rights reserved.
38
Disk Library for Mainframe Support EMC Secure Remote Services and ConnectEMC EMC Internal
EMC
Internet
Customer
Customer Internal
Enterprise Site 1 Access servers Database (primary) Enterprise servers
Web servers Registration authority Gateway 1
Enterprise Site 2
Policy manager
Access servers Database (backup) Future access server islands
Enterprise servers
EMC Disk Library for mainframe
Web servers
Enterprise Site 3
Registration authority Gateway 2
Enterprise Site 4 Enterprise Site 5
EMC Disk Library for mainframe
EMC Support Support Analyst website
© Copyright 2012 EMC Corporation. All rights reserved.
39
18
EMC Disk Library for Mainframe August 2012
Why EMC for Mainframe Tape? Tiered Product Offerings – One size and technology does not fit all – Leveraged platforms: Data Domain, VMAX, and VNX
Breakthrough Disaster Recovery – VMAX using SRDF and SRDF/A – VNX with Guaranteed Replication
Best TCO – Better performance and recoverability with lower TCO – Reduced power, cooling, datacenter footprint
Demonstrated Commitment – Continued investment in mainframe – Strategic partnerships © Copyright 2012 EMC Corporation. All rights reserved.
40
19