IBM雙活數(shù)據(jù)中心方案介紹及探討姜玉明Jiangyum@Tel程業(yè)務連續(xù)性的發(fā)展趨勢IBM對雙活數(shù)據(jù)中心的理解IBM的雙活數(shù)據(jù)中心方案介紹220120721北京暴雨您想到的32012年存儲趨勢

存儲虛擬化成為領跑者；容災、業(yè)務連續(xù)性高高在上；重復數(shù)據(jù)刪除在2012年趕上；4是什么驅使提高容災的能力？宕機成本；提高關鍵業(yè)務系統(tǒng)的可用性；需要7x24小時的業(yè)務；5日程業(yè)務連續(xù)性的發(fā)展趨勢IBM對雙活數(shù)據(jù)中心的理解IBM的雙活數(shù)據(jù)中心方案介紹6業(yè)務連續(xù)性－－需要前瞻的規(guī)劃和策略數(shù)據(jù)中心大集中主備中心生產(chǎn)-查詢中心（主輔中心）雙活中心數(shù)據(jù)同步能力建設數(shù)據(jù)服務能力建設負載均衡能力建設數(shù)據(jù)復制技術切換/回切能力實現(xiàn)后備數(shù)據(jù)抽取與生產(chǎn)中心數(shù)據(jù)存在一定差異全局負載均衡技術中心間數(shù)據(jù)保持同步交易復制能力自動化管理削減數(shù)據(jù)中心數(shù)量，實現(xiàn)數(shù)據(jù)、業(yè)務處理集中化降低基礎架構復雜度加強數(shù)據(jù)中心統(tǒng)一管理降低數(shù)據(jù)中心管理人員數(shù)量要求降低維護成本災難備份系統(tǒng)建設專用后備系統(tǒng)用于緊急狀態(tài)下的恢復降低災難風險對業(yè)務的影響加強安全生產(chǎn)等級利用后備數(shù)據(jù)及系統(tǒng)用于部分生產(chǎn)用途分擔生產(chǎn)系統(tǒng)壓力提高生產(chǎn)系統(tǒng)響應能力后備中心有限生產(chǎn)能力無縫業(yè)務切換能力消除應用停機時間數(shù)據(jù)中心間實現(xiàn)負載均衡任何一個中心具備100%生產(chǎn)支持能力72/5/20237FootergoeshereAPPMWDBCD1CD1LoadBalancerTransactionsReplicationControllerAPPMWCD1CD13.跨中心的數(shù)據(jù)同步機制交易關聯(lián)能力-Transactionstickiness,數(shù)據(jù)同步差異–Datareplicationgap數(shù)據(jù)恢復方法-RecoveryApproach,數(shù)據(jù)延遲-DataLatency1.網(wǎng)絡接入-全局服務負載均衡4build“identical”systemenvironment服務器虛擬化技術Provisioning5.SeamlessProcessingtorolloutchangewithoutplannedoutage運營一體化配置流程-configurationmanagement變更管理-changemanagement人員部署-Role&Responsibility6.應用改造和支持DB2.Session同步機制雙活方案的關鍵技術8開放系統(tǒng)業(yè)務連續(xù)性趨勢應用相互關聯(lián)度2000’s策略同城數(shù)據(jù)及容災流程組織結構1990’s災難恢復設備科技1970’s備份需求1980’s高可靠性同機房容災2010’s應用級容災2012雙活數(shù)據(jù)中心遠程異地三站點9靈活、高效的業(yè)務系統(tǒng)數(shù)據(jù)中心運營模式數(shù)據(jù)遷移業(yè)務邏輯運維人員組織架構公司戰(zhàn)略10日程業(yè)務連續(xù)性的發(fā)展趨勢IBM對雙活數(shù)據(jù)中心的理解IBM的雙活數(shù)據(jù)中心方案介紹11IBM的雙活數(shù)據(jù)中心方案介紹概覽Openhyperswap雙活解決方案概覽GPFS＋Vmware雙活解決方案IBMSVC+vmware雙活解決方案IBMSVC解決方案分析12IBMOpenActive-ActiveSolutionOfferingsActive-QueryorAsymmetricWorkloadActive-ActiveforSymmetricWorkloadPrimarySite(Production)SecondarySite(WarmStandby)PrimarySite(Production)SecondarySite(QueryWorkload)ProductionSite1ProductionSite2Active-QueryorAsymmetricWorkloadInfrastructureBaseSolutionAIXHyperSwapVirtualizedStorageSolutionSVCStretchClusterSoftwareBaseSolutionDB2HA-DR/ReplicationInfrastructureBaseSolutionAIXHyperSwap+FlashcopyVirtualizedStorageSolutionSVCStretchClusterSoftwareBaseSolutionDB2HA-DR/ReplicationInfrastructureBaseSolutionAIXHyperSwap+ParallelDB*VirtualizedStorageSolutionSVCStretchCluster+ParallelDB*SVCVDM+StretchCluster+VmwareSoftwareBaseSolutionDB2GeographicallyDispersedPureScaleClusters(GDPC)GeographicallyDispersedGPFSCluster+ParallelDB2012New2012Enhanced2012DB2Version102012New2012Enhanced2012DB2Version10LocallyTested*NeedfurthervalidationprocessActive-StandbyforFastTakeover1314AIXHyperSwapReferenceArchitecture

Pre-GATestcouldbeofferedtoclientnominatedinJun,2012IBMTargetGADate:Nov,2012MetroMirrorDS8K(PrimaryStorage)DS8K(SecondaryStorage)PowerAIXPowerHADBPowerAIXPowerHALANNetworkPrimarySiteSecondarySite15AIXHyperSwapTakeoverScenarioMetroMirrorDS8K(PrimaryStorage)DS8K(SecondaryStorage)PowerAIXPowerHADBPowerAIXPowerHALANNetworkDS8K(PrimaryStorage)DS8K(SecondaryStorage)Power780AIXPowerHADBPower780AIXPowerHADBDS8K(PrimaryStorage)DS8K(SecondaryStorage)Power780AIXPowerHADBPower780AIXPowerHADS8K(PrimaryStorage)DS8K(SecondaryStorage)Power780AIXPowerHADBPower780AIXPowerHADBScenario1:DiskFailureDS8KFailedHyperswapRTO=secondsNoApplicationinterruptionNoDatabaseRollbackScenario2:ServerFailureServerFailedPowerHAServerTakeoverDB/ApplicationRestartRTO=minutesApplicationdisrruptionDatabaseRollbackScenario3:SiteFailureSiteFailedPowerHAServerTakeover

(DiskQuorumMaintained)DB/ApplicationRestartRTO=minutesApplicationdisrruptionDatabaseRollbackPrimarySiteSecondarySiteNOTE:QuorumControl,Routers,DWDMdevice&Heartbeatnotshowninthediagramforsimplicityillustration16Why?TietogethermultiplesetsofdataintoasinglenamespaceAllowmultipleapplicationgroupstoshareportionsoralldataSecure,availableandhighperformancedatasharingGPFS雙活解決方案

LANSANSANGPFSLANSANSANGPFSNSDProtocolCreateanenterprise-wide

Globalnamespace17操作系統(tǒng)及應用支持情況OperatingsystemsAIXLinuxRedHatSLESVMwareESXServerWindows2008ServerIndependentsoftwarevendor

supportincludes:DB2Oracle,OracleRacSAP/BusinessObjectsSASAbInitioInformaticaSAFVmwareAndothersIBM與VMware的合作全球聯(lián)盟合作伙伴VMware與IBM提供全面的虛擬化、業(yè)務連續(xù)性和云計算解決方案，允許客戶簡化IT基礎架構并且改進可管理性。

部署在IBM平臺上的VMware虛擬化技術能夠降低成本，節(jié)省數(shù)據(jù)中心的能源和空間，并且提高IT部門滿足業(yè)務需求的能力。

通過高彈性平臺，公司可虛擬化他們的關鍵任務工作負載。基于VMwarevSphere的解決方案包括IBMSystemx和BladeCenter服務器、IBMSystemStorage、服務和軟件。長期承諾VMware與IBM將繼續(xù)通過合作來設計、開發(fā)和測試能夠重新定義業(yè)界標準的、值得客戶信賴的虛擬化解決方案。IBM是VMware授權的全球培訓中心/solutions/partners/alliances/ibm-home.html1819SVC支持VMwarevStorageAPIsforArrayIntegration(VAAI)功能集成vStorageAPI，在一個虛擬機的環(huán)境下使得VMware控制存儲操作：OptimizedVMprovisioning(WriteSame)

AvoidszeroregionsforoptimizeddatatransferBlocklocking(AtomicTest&Set)

ImprovedperformancewithlessreservationconflictsFastcopy(optimizedcloning,XCOPY)

Storage-sidevolumetovolumecloningVMwareStorageStackVMFSNFSVMwareLVMDataMoverNFS

ClientNetworkStackvStorageAPI

forMulti-

PathingNFSHBADriversNICvStorageAPIsProvisioning/Cloning價值在管理和部署虛擬卷時改進了性能和有效性降低生產(chǎn)虛擬機上I/O負載，改進應用的性能SANVolumeControllerZero-administrationHAforVMwareusingSVCsinglelogicalinstancemobilizedVMsnoStorage-VMotionAppliancefunctionality,notsoftware-based,nolicense1…100km

Protectsnon-IBMsystemsbasedonSVC'stretchedcluster'

Xen+HyperVSVCSVCPrereqs:SVC,directfibreconnection,tie-breaker'quorum'LUNinbunkerlocation20Details:Symmetricdiskmirroring,stretchedSVCVMHostVMHostSVC1nodeASVC1nodeBHighavailability+protection

forvirtualmachinesVMVMLUN1LUN1'max.100kmrecommendedmax.300kmsupportedOnestoragesystem.Twolocations.VMVMVMVM21VMware虛機的存儲高可用解決方案SVCClusterVMFSSVC

VDISK消除存儲單點故障風險，業(yè)務持續(xù)運行SVC用于企業(yè)級復雜環(huán)境的存儲高可用解決方案SVCVDisk卷鏡像，任一存儲故障不影響業(yè)務運行；存儲無切換中斷時間，應用無需重啟；零數(shù)據(jù)丟失；不占用服務器資源，不影響服務器性能；優(yōu)化中低端存儲性能；ODM管理對象和鏡像前一樣（1X）輕松實在跨存儲盤陣的快照。成本：中，SVC/V7000成本，但VDM免費/support/techdocs/atsmastr.nsf/WebIndex/WP101923SiteRecoveryManagerisnotneeded)SVCCluster存儲跨域雙活三中心解決方案SAN

VolumeControllerSVCCluster城市A－1生產(chǎn)中心城市A－2生產(chǎn)中心城市B災備中心23***HowtoopentheDoor***AIXArchitectureOverviewIBMPowerHA

ClusterPowerVMLPARLPARLPARVIOPowerVMVIOLPARLPARTSMforERPTSMforERPTSMServerFCMFCMFlashCopyFlashCopyIBMSystemStorage24SVCstretchedcluster24***HowtoopentheDoor***VMwareArchitectureOverviewVMwareSRM

ClusterTSMforVETSMforVETSMServerFCMVEFCMVEFlashCopyFlashCopyESXserverVMVMVMESXserverVMVMVMDKIBMSystemStorageIBMSVCSVCstretchedcluster2525***HowtoopentheDoor***MSHyperVArchitectureOverviewMSCluster

ServiceTSMforMSSQLTSMforMSSQLTSMServerFCMFCMFlashCopyFlashCopyIBMSystemStorageIBMSVCMSHyperVVMVMVMIOVMMSHyperVVMVMIOVMSVCstretchedcluster2626NAS/NFSFibreChannelFibreChanneliSCSIFCoEiSCSIDS3300DS5000V7000DS8000NSeriesSONASDS3400TS3100TS3310TS3200TS3500TS7650ATS7560GBackupSVC/V7000VMware虛擬機存儲架構IBM具有簡單易用的存儲解決方案用于整合并擴展VMWare的高級軟件功能

(VMotion,VMHA,DRS,StorageVMotion,&SRM).IBM在VMWare虛擬環(huán)境下的存儲解決方案包括

iSCSI,FC,FCoE,andNFS等所有VMWare支持的存儲接口.經(jīng)過驗證的包括并行擴展、高可用、容災復制等多種存儲解決方案.VMWare虛擬環(huán)境下獨特的IBM存儲解決方案27存儲共享，您關心的I/O共享問題WhatYouSeeNowWhatYouShouldSeedatastoreonlinestoredataminingMicrosoft

ExchangedatastoreonlinestoredataminingMicrosoft

Exchange28IBMSVC解決方案分析用戶界面在線壓縮（收費）任意的快照（收費）FC/FCoE/iSCSI存儲分層在線遷移(NVM)本地高可用支持同步、異步容災（收費）設備的使用效率（thinandeasytier）簡化管理性能可靠性安全性擴展性在線維護能力故障監(jiān)控及預警廣泛的兼容性產(chǎn)品成熟、擁有大量的案例29StoragePoolSVC協(xié)助建立了一個十分靈活的存儲架構SANHDSDS8000Virtual

DiskVirtual

DiskVirtual

DiskVirtual

DiskSANVolumeControllerDS4000HPEMC把不同存儲陣列的存儲容量組成一個統(tǒng)一的存儲池AdvancedCopyServices在存儲池上應用統(tǒng)一的拷貝服務功能通過中心控制點進行集中管理存儲設備發(fā)生改變時，主機應用不會被迫中斷30第31頁友好的界面－－操作流程標準化實時收集系統(tǒng)級性能參數(shù)(CPU利用率;port利用率和I/O速率;卷和MDiskI/O速率，帶寬，延遲），采集時間間隔為5秒先進的存儲軟件，擁有蘋果界面存儲供應流程的標準化31在線壓縮功能GUIDisplaysCompressionSavingsonaVolume,PoolandSystembasis:32SVC完備的快照FlashCopy?功能33一個源卷多達256份快照Vol3

FlashCopy

targetofVol1Vol0

SourceMap1Map2Map3Map4Vol1

FlashCopy

targetofVol0Vol2

FlashCopy

targetofVol1Vol4

FlashCopy

targetofVol3靈活的快照組合模式建立增量快照Datacopied

asnormal應用改變了部分數(shù)據(jù)Later…新時間點快照僅拷貝變化了的數(shù)據(jù)支持永久增量快照模式Vol0

Source快照卷ThinProvisioning卷ThinProvisioning快照CreatediskbackupcopiesSourceLater…2.ReverseFlashCopyoperationOR1.PreservedamageddataBackuptotapecancontinueunaffectedTargetSourceSourceTargetTarget支持快照瞬間恢復跨陣列任意快照Upto256應用系統(tǒng)快照保護FlashCopyAVAILABILITYCreateinstantapplicationcopiesforbackuporapplicationtesting.Makebetteruseofspacewithincremental(onlychangedblocks)orspace-efficient(thinprovisioned)snapshots.Integrated,instantcopyforcritical

applicationsVirtuallyeliminatebackupwindowsRapidlycreateclonesforapplicationtestingViewinventoryofapplicationcopiesandinstantlyrestoreFlashCopyManagerUpto25634SVCGUI快照的管理FlashCopyGUIpanelnowdisplaystimestampshowingwhenmappingwasstarted3536SVC支持iSCSI和FCoESANStorageZonesLANHostserverswithFCoEHBAsFibre-attachedhostsExternalFibre-attachedstorage(optional)StorwizeV7000Hostserverswith10GigabitiSCSIHBAsSANZonesNew存儲分層自動存儲分層根據(jù)工作負載特性自動將活動數(shù)據(jù)在不同存儲層次間重新分布降低IO響應時間用戶可以選擇自動或者半自動的數(shù)據(jù)塊放置和遷移管理方式Whyitmatters?SSD提供比磁介質(zhì)更好的吞吐量和IO響應時間.將整個vdisk卷全部遷移到SSD通常情況下并不是最佳方案。將熱點數(shù)據(jù)塊自動遷移到高性能存儲上，少量的SSD就可以極大的提高整個系統(tǒng)的性能。SVCClusterExternalSSDRAIDArray(s)FC/SASRAIDArray(s)SATARAIDArray(s)ApplicationVirtualDisk37在線遷移數(shù)據(jù)Efficientlymanagetechnologyupgradesandleaseterminationsbytransparentlymovingapplicationdatafromlegacydiskarraystothenewsystem.MIGRATIONTransparentdatamovementVDSLegacyNetworkApplication

server38在線跨I/OGroup遷移I/Ogroup12.Volume

MoveHostI/O

SVCnodeSVCnodeSVCnodeSVCnodeI/Ogroup01.Multi-pathI/OtoVolumes3.ActivepathstorelocatedVolumes39本地高可用LocalMirrorAVAILABILITYForultra-highavailabilityapplications,synchronouslymirrorapplicationdatabetweentwoseparatediskenclosuresattachedtothesamesystem.40容災復制:業(yè)務連續(xù)性Mirrordataoff-siteSynchronouslyoverMetrodistances.AsynchronouslyoverGlobaldistances.Application-levelconsistencygroups.PracticerecoveryproceduresForcriticalapplicationconsistencygroups,freezetheMirrorandtakeaconsistentFlashCopy.PracticeapplicationrecoveryproceduresfromtheFlashCopy.AutomaticallyrespondtodisastersDetectmirroringfailureandautomatefailovertoRecoveryvolume.Executepracticedapplicationrecovery

procedures.Automatefail-backafterrepair.BUSINESSCONTINUANCENetworkRecoverypracticevolumeNetworkNetworkRecoveryvolume41提升存儲使用效率ThinprovisioningMoreproductiveuseofavailablestorage.Acrossallsupportedhostplatforms.PerformanceoptimizationEFFICIENCYWithoutthinprovisioning,pre-allocatedspaceisreservedwhethertheapplicationusesitornot.Withthinprovisioning,applicationscangrowdynamically,butonlyconsumespacetheyareactuallyusing.Dynamic

growthAnalyzesystemperformanceandthroughput.Transparentlyrearrangethedatatoeliminatehot-spotsandbalanceutilizationofallcomponents.Hot-spotsduetopoordatalayout.Optimizedperformanceandthroughput.Transparent

reorganization42精簡配置和熱點遷移IBMSVC解決方案分析用戶界面在線壓縮（收費）任意的快照（收費）FCoE/iSCSI存儲分層在線遷移(NVM)本地高可用支持同步、異步容災（收費）設備的使用效率（thinandeasytier）簡化管理性能可靠性安全性擴展性在線維護能力故障監(jiān)控及預警廣泛的兼容性產(chǎn)品成熟、擁有大量的案例43第44頁簡化管理－－改善存儲資源的部署計劃傳統(tǒng)磁盤陣列部署考慮：容量，磁盤容量/數(shù)量，RAID模式性能磁盤數(shù)量，磁盤轉速，緩存，IOPs，系統(tǒng)吞吐能力，RAID模式可靠性，冗余控制器，RAID模式，數(shù)據(jù)備份功能性，分區(qū)，快照，遠程數(shù)據(jù)復制兼容性，硬件平臺，操作系統(tǒng)平臺虛擬化后存儲供應考慮：容量，多少容量能滿足？功能性，根據(jù)需求，靈活選擇存儲池，快照，遠程數(shù)據(jù)復制ControllersBlock-levelaccessApplicationServerApplicationServerApplicationServerSwitch項目上線前會議討論！虛擬化后，變的很輕松44第45頁簡化管理－－簡化存儲的部署流程虛擬化前DiskRaidLUNHostgroupLUNmappingZoningMulti-PathPVVGPPLPLV虛擬化后一次性的劃分存儲池虛擬磁盤一次性的劃分通用的多通路軟件標準過程好處后續(xù)磁盤進行基本的硬件更換即可，比方說磁盤故障！友好的界面標準的流程實時的性能在線的遷移標準化的劃分辦法主機多通路管理軟件統(tǒng)一化統(tǒng)一類型的磁盤，操作過程標準化45SVC性能最新SPC測試結果顯示SVC性能領跑所有存儲6節(jié)點的SVCSPC-1值達380,000

4節(jié)點的SVCSPC-1值達300,0008節(jié)點的SVCSPC-1達到520,000*相對應的HPXP24000最高性能值為200,000左右/results/benchmark_results_spc1/#spc1SVCSPC-2值高達7,080GBPS（8節(jié)點）TheintelligenceofthecachingalgorithmsTheamountofcacheTheuseofdifferentstoragetierswithSolidStateDiskTheabilitytohandletaggedcommandqueuingoperationsThepatternofaccessasitrelatestolocalityofreferencewhichaffectsthecachehitratiosThesizeofthedatablocktransferredDiskMagicSizingtools46可靠性－SVC虛擬化平臺的高可靠性設計StorageNetworkManagedDisksVirtualDisksVirtualDisksVirtualDisksVirtualDisksNodeNodeNodeNodeNodeDesignedtobearedundant,modular,scalable,solutionVirtualdisksaresharedbetweenapairofnodesNodeNodeNodeEachnodeisanxSeries?eServer?with24GBofRead/WritecachethatismirroredacrossthepairThepoolofmanageddisksiscontrolledbyaclusterofmanagednodes(upto4pairs,scalinghigherinthefuture)SVC提供99.999%的高可靠性可以通過SVC實現(xiàn)不停機的數(shù)據(jù)遷移可以通過SVC實現(xiàn)不停機的微碼（firmware）升級，及磁盤陣列的硬件維護StorageNetworkManagedDisksVirtualDisksVirtualDisksVirtualDisksVirtualDisksNodeNodeNodeNodeNodeDesignedtobearedundant,modular,scalable,solutionVirtualdisksaresharedbetweenapairofnodesNodeNodeNodeEachnodeisanxSeries?eServer?with24GBofRead/WritecachethatismirroredacrossthepairThepoolofmanageddisksiscontrolledbyaclusterofmanagednodes(upto4pairs,scalinghigherinthefuture)Redundant,hot-swappablecontrolnodesMirroredWritecachewithbatterybackupClusterconfigurationbackupandrestorecapabilityRedundancyofactivecomponentsincludingfansandpowersuppliesNon-disruptivesoftwareupgradestonodesDualaccesstoallfront-endandback-endportsRedundantpathsfromcontrolnodestointernaldisksoverSAS.RemotecallhomeErrornotificationandlogging47安全性－－訪問和用戶管理SSHprotocolcommunication;Differentusergroup;48…performanceForperformancesensitiveapplications,dynamicallyaddmoreperformancetoyourexistingcapacitybyaddingcontrollerpairs.…ormixwithadditionalcapacity……capacityForhighcapacityapplicationssuchasarchive,dynamicallyaddcapacitybyaddingdiskenclosures.…ormixwithadditionalperformance……featuresManyfeaturesareincluded.Softwareispreinstalledinthesystemandmanagementconsoleforeasysetup.Premiumfeaturesarealreadyinstalled.Enabledwithonlyalicensefile.PracticeDRrecoveryAutomatedfailover/fail-backThinProvisioningPerformanceoptimizationVirtualizationFlashCopySANVisualizationPerformancemanagementMetroMirrorGlobalMirrorSCALABILITY擴展性－－動態(tài)可擴展…49在線維護能力－－SVC節(jié)點在線替換SVC集群中任何一個節(jié)點失效，可以在不中斷生產(chǎn)的條件下在線更換不需要改變SAN環(huán)境的配置不影響主機生產(chǎn)應用不影響SVC集群生產(chǎn)替換操作時間短—整個過程約30分鐘50故障監(jiān)控及預警－－系統(tǒng)管理SNMPSysLogEmail5152SVC兼容環(huán)境8GbpsSANfabricHP

MA,EMAMSA,EVA,XP,P9500,

3ParHitachi

LightningThunderTagmaStoreAMS,WMS,USP,USP-VVSPEMCCLARiiONCX4,Symmetrix,DMX,VMAX,VNX,VNXeMicrosoft

WindowsHyper-VIBMPower7IBMAIXIBMi6.1(VIOS)Sun

Solaris8/9/10HP-UX11iTru64OpenVMSCitrixXenServerIBM

BladeCenterSANContinuousCopyMetro/GlobalMirrorMultipleClusterMirrorVMwareESX3.5,vSphere4,5Point-in-timeCopyFullvolume,Copyonwrite

256targets,

Incremental,