Transcript
VMware Virtual SAN Bo Bolander, Sr. Systems Engineer
© 2014 VMware Inc. All rights reserved.
VMware Software-Defined Storage Bringing the Efficient Operational Model of Virtualization to Storage and Availability VMware Software-Defined Storage
Storage Policy-Based MgmtPolicy-Based Mgmt Storage
vSphere
vSphere Virtual Volumes
Virtual SAN Virtual Datastore Virtual Datastore
SAN / NAS
6
Storage Policy-Based Management App-centric Control Plane That Across Storage Tiers
Capacity Reserve thick 10 GB
Performance Availability
Flash Read Cache 10 %
2 Failures to tolerate
Storage Policy-Based Mgmt
vSphere
• Intelligent storage placement at scale • Dynamic adjustments in real time • Automated policy enforcement
Virtual SAN
7
Virtual SAN Puts The App In Charge VM-centric Service Levels for Simpler and Automated Storage Management Through App-centric Approach
Today
Virtual SAN Storage Policy
✖ Hardware-centric, vendorspecific management
LUN LUN
✖ Slow provisioning, rigid storage constructs (LUNs, Volumes) ✖ Data services aligned to storage container, not directly with VM needs ✖ Frequent data migrations
1. Define storage policy
Capacity Performance
Virtual SAN
2. Apply policy at VM creation
Availability
Virtual SAN Datastore
Fast, VM-centric provisioning No need to manage LUNs, Vols. Resources and data service are
automatically provisioned and maintained Easy to change without data migration 8
VMware Virtual SAN: Hybrid Radically Simple Hypervisor-Converged Storage Software
Virtual SAN • Software-defined storage built into vSphere • Runs on any standard x86 server
• Pools flash-based devices into a shared datastore
vSphere + Virtual SAN …
• Managed through per-VM storage policies SSD
Hard disks
SSD
Hard disks
SSD
Hard disks
• Delivers High performance through flash acceleration • 2x more IOPS with VSAN Hybrid • Up to 40K IOPS/host • Highly resilient - zero data loss in the event of hardware failures
Virtual SAN Datastore
• Deeply integrated with the VMware stack 9
VMware Virtual SAN : All-Flash
NEW in 6.0
Extremely High Performance with Predictability
Virtual SAN All-Flash • Flash-based devices used for caching as well as persistence
vSphere + Virtual SAN
• Cost-effective all-flash 2-tier model:
…
SSDs
SSDs
o Cache is 100% write: using write-intensive, higher grade flash-based devices SSDs
o Persistent storage: can leverage lower cost readintensive flash-based devices
• Very high IOPS: up to 90K(1) IOPS/Host
• Consistent performance with submillisecond latencies Virtual SAN All-Flash Datastore (1) All performance numbers are subject to final benchmarking results. Please refer to guidance published at GA
10
Enhancements in 6.0
Enterprise-Class Scale and Performance Virtual SAN 5.5
Virtual SAN 6.0 Hybrid
Virtual SAN 6.0 All-Flash
32
64
64
IOPS / Host
20K
40K
90K
VMs / Host
100
200
200
3200
6400
6400
Hosts / Cluster
VMs / Cluster
Note: All performance numbers are subject to final benchmarking results. Please refer to guidance published at GA 11
Virtual SAN 6.0 Now Ready For Business-Critical Apps
Best storage for VMs
Virtual Infrastructure Optimized for Virtual Infrastructure
Enterprise-class Business Critical Apps
VDI
DR
Test/Dev
Ready for business critical apps
12
Virtual SAN Hardware
Hardware Requirements
SAS/SATA//PCIe SSD
Any Server on the VMware Compatibility Guide
At least 1 of each (Except All-Flash) SAS/NL-SAS/SATA HDD
1Gb/10Gb NIC SAS/SATA Controllers (RAID Controllers must work in “pass-through” or RAID0” mode)
4GB to 8GB USB, SD Cards
All flash-based devices, and storage controllers MUST be listed on the VMware Compatibility Guide for VSAN 14
Flash Based Devices In Virtual SAN hybrid ALL read and write operations always go directly to the Flash tier. Flash based devices serve two purposes in Virtual SAN hybrid architecture 1.
Non-volatile Write Buffer (30%) – Writes are acknowledged when they enter prepare stage on the flash-based devices. – Reduces latency for writes
2.
Read Cache (70%) – Cache hits reduces read latency – Cache miss – retrieve data from the magnetic devices
Choice of hardware is the #1 performance differentiator between Virtual SAN configurations.
15
Flash Based Devices In Virtual SAN all-flash read and write operations always go directly to the Flash devices. Flash based devices serve two purposes in Virtual SAN All Flash: 1.
Cache Tier (write buffer) – High endurance flash devices. – Listed on VCG
2.
Capacity Tier – Low endurance flash devices – Listed on VCG
Choice of hardware is the #1 performance differentiator between Virtual SAN configurations.
16
Network • 1Gb / 10Gb supported for hybrid architecture – 10Gb shared with NetIOC for QoS is recommended for most environments – If 1GB then recommend dedicated links for Virtual SAN
• 10Gb only supported for all-flash architecture – 10Gb shared with NIOC for QoS will support most environment
• Jumbo Frames will provide nominal performance increase – Enable for greenfield deployments – Enable in large deployments to reduce CPU overhead
• Virtual SAN supports both VSS & VDS – NetIOC requires VDS
• Network bandwidth performance has more impact on host evacuation, rebuild times than on
workload performance 17
VMware Virtual SAN: One Destination SDDC & SDS, Three Paths Software + Hardware Component Based
Virtual SAN Ready Node
Choose individual components …
40+ OEM validated server configurations ready for Virtual SAN deployment (2)
Any Server on vSphere Hardware Compatibility List
Hyper-Converged Infrastructure VMware EVO:RAIL A Hyper-Converged Infrastructure Appliance (HCIA) for the SDDC
SSD or PCIe SAS/NL-SAS/ SATA HDDs HBA/RAID Controller
…using the VMware Virtual SAN Compatibility Guide (VCG) (1)
Maximum Flexibility
Each EVO:RAIL HCIA is pre-built on a qualified and optimized 2U/4 Node server platform. Sold via a single SKU by VMware Qualified EVO:RAIL Partners (QEPs) (3)
Maximum Ease of Use
Note: 1) Components must be chosen from Virtual SAN HCL, using any other components is unsupported – see Virtual SAN VMware Compatibility Guide Page 2) VMware continues to update/add list of the available Ready Nodes, please refer to Virtual SAN VMware Compatibility Guide Page for latest list 3) Product availability varies by countries. Please contact your local VMware partners for details, pricing and availability – click here
18
VMware Virtual SAN – VCG and Ready Nodes www.vmware.com/go/virtualsan-hcl 1 Virtual SAN Hardware Quick Reference Guide • 5 Ready Node profile guidelines • Sizing assumptions • Design considerations 1 2 3
2 Virtual SAN Ready Nodes • •
List components and quantity that make up each Ready Node Info on how to quote/order the Ready Node
3 Always use certified components! • • • •
Drivers and firmware Supportability Increase customer satisfaction Reduce rework and time-tomarket 19
There are 5 VSAN Ready Node Profiles – Server Workload Virtual SAN Hybrid - Server Server Low Profile
Server Medium Profile
Virtual SAN All Flash - Server
Server High Profile
Server Medium Profile
Server High Profile
•
Up to 30VMs
•
Up to 60VMs
•
Up to 120VMs
•
Up to 60VMs
•
Up to 120VMs
•
Up to 4K IOPs
•
Up to 24K IOPs
•
Up to 40K IOPs
•
Up to 60K IOPs
•
Up to 80K IOPs
•
5TB raw capacity
•
8TB raw capacity
•
14.4TB raw capacity
•
8TB raw capacity
•
12TB raw capacity
•
Capacity
8x1TB SSD
•
Capacity
12x1TB SSD
•
Caching
•
Caching
2x400GB SSD
2x200GB SSD
For complete details on the sizing assumptions and design considerations of the Ready Node profiles, please refer to the “Virtual SAN Hardware Quick Reference Guide” on the Virtual SAN VMware Compatibility Guide Page
There are 4 VSAN Ready Node Profiles – VDI Workload Virtual SAN Hybrid - VDI VDI Linked Clones Profile
Virtual SAN All Flash - VDI VDI Linked Clones Profile
VDI Full Clones Profile
VDI Full Clones Profile
•
Up to 100 desktops
•
Up to 100 desktops
•
Up to 200 desktops
•
Up to 200 desktops
•
Up to 10K IOPs
•
Up to 10K IOPs
•
1.6TB raw capacity
•
9.6TB raw capacity
•
1.2TB raw capacity
•
10.8TB raw capacity
•
Capacity
4x400GB SSD
•
Capacity
12x800GB SSD
•
Caching
1x400GB SSD
•
Caching
2x400GB SSD
For complete details on the sizing assumptions and design considerations of the Ready Node profiles, please refer to the “Virtual SAN Hardware Quick Reference Guide” on the Virtual SAN VMware Compatibility Guide Page VMWARE FIELD & PARTNER USE ONLY - CONFIDENTIAL
Virtual SAN Performance and Scale Improvements 2x VMs per host
• Larger Consolidation Ratios • Due to increase of supported components per hosts • 9000 Components per Host
62TB Virtual Disks
• Greater capacity allocations per VMDK • VMDK >2TB are supported
Snapshots and Clone
• Larger supported capacity of snapshots and clones per VMs
• 32 per Virtual Machine
Host Scalability
• Cluster support raised to match vSphere • Up to 64 nodes per cluster in vSphere • VSAN can scale up to 64 nodes.
22
Virtual SAN 6.0 New Features Disk Format VMFS-L
VSAN 5.5 to 6.0
Disk Serviceability Functions
VSAN Platform
VSAN FS
• New On-Disk Format • New delta-disk type vsanSparse • Performance Based snapshots and clones
• In-Place modular rolling upgrade
• Seamless In-place Upgrade • Seamless Upgrade Rollback Supported • Upgrade performed from RVC CLI • PowerCLI integration for automation and management
• Ability to manage flashbased and magnetic devices. • Storage consumption models for policy definition • Default Storage Policies • Resync Status dashboard in UI • VM capacity consumption per VMDK • Disk/Disk group evacuation
• New Caching Architecture for all-flash VSAN • Virtual SAN Health Services • Proactive Rebalance • Fault domains support
• High Density Storage Systems with Direct Attached Storage • File Services via 3rd party • Limited support hardware encryption and checksum
23
VMware Virtual SAN 6.0 Data Services Platform Data Services
• VSAN 6.0 currently offers the following data services and capabilities
– Performance based snapshots and clones – High Availability – Replication Services – Data Protection – Read / Write Caching – Hardware Checksum (via VSAN Ready Node) – Hardware Encryption (via VSAN Ready Node) – File Services (via 3rd party) – NexentaConnect delivers the following file shares on top of VSAN:
– SMB – NFS – Data services are unique to VSAN or made available through vSphere integration
24
Virtual SAN 6.0 Enables Both Hybrid or All-Flash Architectures
New!
All-Flash
Hybrid
Caching SSD, PCIe, Ultra DIMM etc. Read cache / Write buffer
SSD, PCIe, Ultra DIMM etc. Write-only buffer
Data Persistence Magnetic Disks
40K IOPS/Host
Flash Devices
90K IOPS/Host predictable sub-millisecond latency 25
New On-Disk Format • Virtual SAN 6.0 introduces a new on-disk
format. • The new on-disk format enables: – Higher performance characteristics
VMFS-L
VSAN FS
– Efficient and scalable high performance snapshots
and clones – Online migration to new (RVC only)
namespace • The object store will continue to mount the volumes
from all hosts in a cluster and presents them as a single shared datastore.
VSAN 5.5
VSAN 6.0
• The upgrade to the new on-disk format is optional; the
on-disk format for Virtual SAN 5.5 will continue to be supported
31
Performance Snapshots and Clones • Virtual SAN 6.0 new on-disk format introduces
VSAN FS
a new VMDK type – Virtual SAN 5.5 snapshots were based on
vmfsSparse (redo logs)
• vsanSparse based snapshots are expected to
deliver performance comparable to native SAN snapshots. – vsanSparse takes advantage of the new on-disk
format writing and extended caching capabilities to deliver efficient performance.
snapshots
clones
Virtual SAN Interoperability
vRealize Automation • vRealize Automation Advanced
complements VMware Virtual SAN simplified operating and storage consumption models by: – Delivering a dynamic storage
service level allocation on top of Virtual SAN. – Leveraging Storage Policy
Based Management (SPBM) and underlying Virtual SAN storage technologies.
vRealize Operations •
Day to Day Operations Management –
Enable Alerting & Notification for troubleshooting VSAN related failures and performance issues
–
Provide a single pane of glass for simplified and automated operations management for VSAN by means of exploratory dashboards, heat maps etc
•
Analytics and Future Capacity Planning –
Analyze Health, Risk and Efficiency of Virtual SAN cluster around performance, capacity and availability
–
Enable use of advanced analytics, reporting and planning capabilities for physical infrastructure supporting Virtual SAN
PowerCLI •
PowerCLI 6.0 delivers a set of Virtual SAN related cmdlets (no longer a fling) for managing Virtual SAN. – Some of the existing cmdlets were altered to work with Virtual SAN.
•
Here is some of the new cmdlets: – Export-SpbmStoragePolicy
– New-SpbmRuleSet
– Get-SpbmCapability
– New-SpbmStoragePolicy
– Get-SpbmCompatibleStorage
– New-VsanDisk
– Get-SpbmEntityConfiguration
– New-VsanDiskGroup
– Get-SpbmStoragePolicy
– Remove-SpbmStoragePolicy
– Get-VSANDisk
– Remove-VsanDisk
– Get-VsanDiskGroup
– Remove-VsanDiskGroup
– Import-SpbmStoragePolicy
– Set-SpbmEntityConfiguration
– New-SpbmRule
– Set-SpbmStoragePolicy
Disaster Recovery For The Software-Defined Data Center vCloud Air Disaster Recovery
vSphere Replication
• DR as a Service to vCloud Air shifts DR investments from CapEx to OpEx
vSphere Replication
• Fully delivered and supported by VMware
• VM-centric, storage-independent replication simplifies protection
• Flexible storage topologies (External to Virtual SAN or vCloud Air)
Site Recovery Manager Production Site
Recovery Site
Site Recovery Manager
Site Recovery Manager
• DR workflow automation reduces OpEx on DR management
vSphere Replication
vSphere
vSphere
vSphere Data Protection Advanced
• WAN-efficient backup data replication enables basic DR
VDPA
• Storage-efficient dedupe reduces storage investments
Virtual SAN
External Storage
Virtual SAN • Server side economics lower storage costs
Virtual SAN VDPA backup replication
Backup datastore
• Centralized recovery plans enables DR scale for thousands of VMs
Backup datastore
• Hyper-convergence on x86 platform reduces DR footprint
Questions?
Thank You
