1、系統(tǒng)環(huán)境

1.1＞硬件環(huán)境

效勞器：vmware10,新建2個虛擬機主機名分別為racl和rac2,每個虛擬機分配40G磁盤空

間，添加兩個網(wǎng)絡(luò)適配器。其中第二個適配器網(wǎng)絡(luò)連接調(diào)整為自定義，且兩個節(jié)點保持一致。

送項

設(shè)備狀態(tài)

設(shè)備摘要

W已連接(C)

W內(nèi)存2GB

囪自動時連按(。)

口處理器1

口硬盤(SCSI)40GB

網(wǎng)絡(luò)連接

氈網(wǎng)絡(luò)適配器帶接模式(自動)「橋接模式(E)：直接連接物理網(wǎng)絡(luò)

窗網(wǎng)絡(luò)適配器2自定義(VMnetO)

復制物理網(wǎng)絡(luò)連接狀態(tài)

?irn(P)

⑦)聲卡自動檢刎ONAT板式(N):用于共享主機的IP地址

日打EIM%

。僅主機模式(H)：與主機共享的吉用網(wǎng)絡(luò)

■顯示器自動檢刑

您自定義(U)：特定虛似網(wǎng)絡(luò)

VMnetOv

OLAN區(qū)段(L):

SN區(qū)段(S)...高級(V)…

Widonws本機ip：192.168.6.1

1.2、軟件環(huán)境

數(shù)據(jù)庫：oraclell.2.0.4database-x86-64

GRID：oraclell.2.0.4grid-x86-64

操作系統(tǒng)：rhel-server-6.3-x86_64采用最小化安裝

1.3、網(wǎng)絡(luò)環(huán)境

ip地址規(guī)劃分配為

IP名稱子網(wǎng)掩碼IP地址

Raci-public255.255.255.0192.168.6.11

Rac2-public255.255.255.0192.168.6.12

Raci-private255.255.255.02.2.2.2

Rac2-private255.255.255.02.2.2.3

Rael-vip255.255.255.0192.168.6.13

Rac2-vip255.255.255.0192.168.6.14

SCAN255.255.255.0192.168.6.15

1.4、共享磁盤分區(qū)

方案創(chuàng)立四個共享磁盤sdb、sdc、sdd、sde,每個磁盤方案分三個分區(qū)

sdasda2sdblsdb3sdclsdc3sddlsdd3sdelsde3

sdalsdbsdb2sdcsdc2sddsdd2sdesde2

2、前期環(huán)境準備

2.1配置靜態(tài)IP地址

vi/etc/sysconfig/network-scripts/ifcfg-ethO

修改ip地址。每個虛擬機ethO網(wǎng)卡為public,

DEVICE="ethOw

BOOTPROTO="static"

HWADDR=w00：0C：29：Dl：4E：A6w

NM_CONTROLLED=wyesw

ONBOOT="yesff

TYPE="Ethernetn*

UUID=Be59cb6a0-deb0-4164-a2b0-8b4dcc0cb027”

IPADDR=192.168.6.11

NETMASK=255.255.255.0

GATEWAY=192.168.6.1

vi/etc/sysconfig/network-scripts/ifcfg-ethl

修改ip地址。每個虛擬機ethl網(wǎng)卡位private

DEVICE="ethr

B00TPR0T0=wstaticn

HWADDR=n00：0C：29：Dl：4E：A6B

NM_CONTROLLED=nyesR

0NB00T="yesff

TYPE="Ethernet"?

UUID="e59cb6a0-deb0-4164-a2b0-8b4dcc0cb027”

IPADDR=2.2.2.2

NETMASK=255.255.255.0

修改完成后執(zhí)行

servicenetworkrestart

2.2在racl和rac2上分別關(guān)閉防火墻

serviceiptablesstop一停止防火墻

chkconfigiptablesoff-禁用防火墻

2.3在racl和rac2上分別修改主機名

vi/etc/sysconfig/network重啟生效，一個racl,另一個rac2

net.core.rmem_default=262144

net.core.rmemmax=4194304

net.core.wniiemdefault=262144

net.core,wmcm_max=1048586

使修改參數(shù)立即生效：

sysctl-p

2.6在racl和rac2上分別執(zhí)行修改limits

vi/etc/security/limits.conf

參加以下信息

gridsoftnproc2047

gridhardnproc16384

gridsoftno

gridhardno

oraclesoftnproc2047

oraclehardnproc16384

oraclesoftno

oraclehardno

2.7在racl和rac2上分別修改/etc/pam.d/login

vi/etc/pam.d/login

參加以下信息

sessionrequired/lib/security/pamlimits,so

sessionrequiredpam_limits.so

2.8在racl和rac2上分別執(zhí)行修改/etc/profile

vi/etc/profile

參加以下信息

if[$USER="oracle"]|[$USER="grid"]；then

if[$SHELL="/bin/ksh"]；then

ulimit-p16384

u'imit-n65536

e_se

ulimit-u16384-n65536

fi

unask022

fi

2.9在racl和rac2上分別執(zhí)行禁用selinux

vi/etc/selinux/config

修改SELINUX值

SELINUX=disabled

2.10在racl和rac2上分別執(zhí)行停止ntp效勞

servicentpdstop

chkconfigntpdoff

mv/etc/ntp.conf/etc/ntp.conf,bak

2.11在racl和rac2上分別處理/dev/shm共享內(nèi)存缺乏的處理

df-h查看tmpfs分區(qū)是否大于1G,如果過小需增加。

vi/etc/fstab

默認的：trnpfs/dev/shmtmpfsdefaults00

改成：

tmpfs/dev/shmtmpfsdefaults,size=1024m00

mount-oremount/dev/shm

2.12在racl和rac2上分別檢查軟件是否全部安裝

rpm-qagrepbinutils-

rpm-qagrepcompat-1ibstdc++-

rpm-qagrepelfutils-libelf-

rpm-qagrepelfutils-libelf-devel-

rpm-qagrepglibc-

rpm-qagrepglibc-common-

rpm-qagrepglibc-devel-

rpm-qagrepgcc-

rpm-qagrepgcc-c++-

rpm-qagreplibaio-

rpm-qagreplibaio-devel-

rpm-qagreplibgcc-

rpm-qagreplibstdc++-

rpm-qagreplibstdc++-devel-

rpm-qagrepmake-

rpm-qagrepsysstat-

rpm-qagrepunixODBC-

rpm-qagrepunixODBC-devel-

2.13在racl和rac22分別將未安裝的包通過yum安裝

mkdir/yum

mount/dev/cdrom/yum

vi/etc/yum.repos,d/chenbin.repo

添加以下內(nèi)容

[rhel-chenbin]

name=RedHatEnterpriseLinux$releasever-$basearch-Debug

baseurl=

enabled=l

gpgcheck=l

gpgkey=RPM-GPG-KEY-redhar-re1ease

yumlist一查看可用包

yum-yinstallbinutils*compat-*elfutils-libelf*gcc-*gcc-*kernel-*ksh-*libaio-*

libgcc-*libgomp-*libstdc++-*make-*numactl-devel-*sysstat-*unixODBC-*pdksh*

2.14在oradbl和rac2上分別關(guān)閉不需要的效勞

chkconfigautofsoff

chkconfigacpidoff

chkconfigsendmailoff

chkconfigcups-config-daenonoff

chkconfigcpusoff

chkconfigxfsoff

chkconfiglm_sensorsoff

chkconfiggpmoff

chkconfigopenibdoff

chkconfigpcmciaoff

chkconfigcpuspeedoff

chkconfignfslockoff

chkconfigip6tablesoff

chkconfigrpcidmapdoff

chkconfigapmdoff

chkconfigsendmailoff

chkconfigarptables_jfoff

chkconifgmicrocode_ctloff

chkconfigrpcgssdoff

chkconfigntpdoff

3、添加組和用戶

3.1在racl和rac2上分別添加oracle和grid用戶和組

groupadd-g501oinstall

groupadd-g502dba

groupadd-g503oper

groupadd-g504asmadmin

groupadd-g505asmoper

groupadd-g506asmdba

useradd-goinstall-Gdba,asmdba,operoracle

useradd-goinstall-Gasmadmin,asmdba,asmoper,oper,dbagrid

3.2在racl和rac2上分別為oracle和grid用戶設(shè)密碼

passwdoracle

passwdgrid

3.3在racl和rac2上分別創(chuàng)立目錄grid和oracle用戶的

mkdir-p/u01/app/oracle

mkdir-p/u01/app/grid

mkdir-p/uOl/app/11.2.O/grid

chown-Rgrid：oinstall/uOl/app/grid

chown-Rgrid：oinstall/uOl/app/11.2.0

chown-Roracle：oinstall/uOl/app/oracle

chmod-R775/uOl

mkdir-p/uOl/app/oralnventory

chown-Rgrid：oinstall/uOl/app/oralnventory

chmod-R775/uOl/app/oralnventory

3.4在racl和rac2上分別修改oracle用戶的.bash_profile文件

vi/home/orac1e/.bash_profile

exportORACLE_STD=racl

exportORACLE_BASE=/uO1/app/orac1e

exportORACLEJIOME=$ORACLE_BASE/product/11.2.0/dbhome_l

exportLD_LIBRARY_PATH=$ORACLE_HOME/lib

exportNLS_DATE_FORMAT=Myyyy-mm-dd111124：Ml：SSH

exportTMP=/tmp

exportTMPDIR=$TMP

exportPATH=$PATH：SORACLE_HOME/bin

3.5在racl和rac2上分別修改grid用戶的.bash_profile文件

vi/home/grid/.bash_profile

exportORACLE_SID=+ASM1

exportORACLE_BASE=/uO1/app/grid

exportORACLE_HOME=/uO1/app/11.2.O/grid

exportLD_LIBRARY_PATH=$ORACLE_HOME/1ib

exportNLS_DATE_1'ORMAT=Hyyyy-mm-dd111124：Ml：SS"

exportPATH=$ORACLE_HOME/bin：$PATH

注意另外一臺數(shù)據(jù)庫實例名須做相應修改:

Oracle：export0RACLE_SID=rac2

grid：exportORACLE_SID=-ASM2

3.6建立ssh等效性（可不配置）

Root用戶等效性可不用配置，配置了僅管理效勞器方便，gird用戶和oracle的ssh等效性由

安裝程序配置，

mkdir~/?ssh

chmod755~/?ssh

ssh-keygen-trsa

ssh-keygen-tdsa

catV.ssh/id_rsa.pub?V.ssh/authorized_keys

catV.ssh/id_dsa.pub?V.ssh/authorized_keys

在racl上執(zhí)行

sshrac2catV.ssh/id_rsa.pub?^/.ssh/authorized_keys

sshrac2catV.ssh/id_dsa.pub?^/.ssh/authorized_keys

在rac2上執(zhí)行

sshraclcatV.ssh/id_rsa.pub?V.ssh/authorized_keys

sshraclcatV.ssh/id_dsa.pub?V.ssh/authorized_keys

在兩臺效勞器上驗證是否可以正常訪問對方，執(zhí)行時不再提示輸入密碼，則表示SSH對等性配

置成功

sshracldate

sshrac2date

sshracl-privdate

sshrac2-privdate

4、添加共享磁盤(VM)

4.1在本機上創(chuàng)立共享磁盤

生產(chǎn)環(huán)境使用共享存儲，直接略過

在windows的cn】d中進入VMwareWorkstation安裝目錄，執(zhí)行命令創(chuàng)立磁盤：注意創(chuàng)立共

享磁盤的路徑及文件大小，例如我的VM裝在c盤，

cdc：\ProgramFiles(x86)\VMware\VMwareWorkstation

vmware-vdiskmanager.exe-c-s5g-aIsilogic-t2nF：\shdisk\vot.vmdkn

Vmware-vdiskmanager.exe-c-s2g-aIsilogic-t2WF：\shdisk\fra.vmdkw

vmware-vdiskmanager.exe一c-s5g-aIsilogic-t2"F：\shdisk\data.vmdk"

vmware-vdiskmanager.exe-c-s5g-aIsilogic-t2"F：\shdisk\datal.vmdk"

4.2將共享磁盤掛到兩臺虛擬機

關(guān)閉兩臺虛擬機并退出VM,分別用記事本翻開虛擬機安裝位置中虛擬機名字.vmx,

添加以下內(nèi)容

disk.EnableUUID=wTRUEH

disk,locking="FALSE”

scsil.shared="TRUE"

diskLib.dataCacheMaxSize="0"

diskLib.dataCacheMaxReadAheadSize="0"

diskLib.dataCacheMinReadAheadSize="0"

diskLib.dataCachePageSize="4096"

diskLib.maxUnsyncedWrites="0

scsil.present="TRUE"

scsil.virtualDev="Isilogic”

scsil.sharedBus="VIRTUALn

scsil：0.present="TRUE"

scsil：0.mode=*'independent-persistent

scsil：0.="F:\shdisk\vot.vmdk”

scsil：0.deviceType="disk"

scsi1：0.redo=

scsil：1.present="TRUE"

scsil：1.mode=Hindependent-persistent

scsil：1.="F：\shdisk\fra.vmdkH

scsil：1.deviceType="disk"

scsil：1.redo=

scsil：2.present="TRUE"

scsil：2.mode=Mindependent-persistent

scsil：2.="F：\shdisk\data.vmdkM

scsi1：2.deviceType="disk"

scsil：2.redo=

scsil：3.present="TRUE"

scsil：3.mode=Mindependent-persistent

scsil：3.="F:\shdisk\datal.vmdk"

scsil：3.deviceType="disk"

scsil：3.redo="”

4.3兩個虛擬機開機，格式化硬盤，確認是否共享成功。

在racl上執(zhí)行

fdsik-1一確認看以正常看到sdb,sbc,sdd,sde

按前期規(guī)劃創(chuàng)立分區(qū)，分區(qū)完成后在rac2中執(zhí)行fdisk-1查詢是否同步

4.4在racl和rac2上分別將裸設(shè)備文件和分區(qū)設(shè)備文件進行綁定

vi/etc/udev/rules.d/60-raw.rules

根據(jù)磁盤情況修改下面信息參加到文件中

ACTION=='add\KERNEL二二"sdbl",RUN+=Vbin/raw/dev/raw/rawl%N'

ACTION==',add\KERNEl尸"sdb2",RUN+=Vbin/raw/dev/raw/raw2%N'

ACTION=='adcl\KERNEL=="sdb3",RUN+=Vbin/raw/dev/raw/raw3%N'

ACTION==nadd\KERNEL=="sdcl\RUN+="/bin/raw/dev/raw/raw4%N'

ACTI0、=="add",KERNEL=="sdc2",RUN+=,'/bin/raw/dev/raw/raw5%N'

ACTION=='add\KERNEL=="sdc3",RUN+="/bin/raw/dev/raw/raw6%N'

ACTION=='add\KERNEL=="sddl\RUN+="/bin/raw/dev/raw/raw7%N'

ACTION==,radd\KERNEL=="sdd2\RUN+=7bin/raw/dev/raw/raw8%N'

ACTIOM==',add\KERNEL=="sdd3",RUN+="/bin/raw/dcv/raw/raw9%N'

KERNEL二二"rawOWNER="grid',GROUP="asmadmin",MODE="0660'

此處1、KERNEL=="raw[O-9]〃10以必須單獨指定，否則無效

2、MODE="0666"和GROUP="oinstaHz，的設(shè)置，在后面的check會報waring

應改為：MODE="0660GROUP="asmadmin"

執(zhí)行：start_udev命令，此處建議重啟虛擬機

執(zhí)行raw-qa查看綁定狀態(tài)：確保兩個節(jié)點看以看到相同的內(nèi)容

[root@oradblrules.d]:raw-qa

/dev/raw/rawl:boundtomajor8,minor17

/dev/raw/raw2:boundtomajor8,minor18

/dev/raw/raw3:boundtomajor8,minor19

/dev/raw/raw4:boundtomajor8,minor20

/dev/raw/raw5:boundtomajor8,minor33

/dev/raw/raw6:boundtomajor8,minor49

/dev/raw/raw7:boundtomajor8,minor65

/dev/raw/raw8:boundtomajor8,minor81

/dev/raw/raw9:boundtomajor8,minor97

/dev/raw/rawl0:boundtomajor8,minor113

/dev/raw/rawl1:boundtomajor8,minor129

/dev/raw/rawl2:boundtomajor8,minor145

/dev/raw/rawl3:boundtomajor8,minor161

執(zhí)行Is-1/dev/raw/查看裸設(shè)備歸屬權(quán)限:

5、安裝Grid

5.1在racl和rac2上分別安裝cvuqdisk包

在兩個OracleRAC節(jié)點上安裝操作系統(tǒng)程序包cvuqdiskocvuqdiskRPM包含在OracleGrid

Infrastructure安裝介質(zhì)上的rpm目錄中。

rpm-ivhcvuqdisk-1.0.7~1.rpm

5.2檢查CRS的安裝環(huán)境

只需要在其中一個節(jié)點的gird用戶執(zhí)行.執(zhí)行需提前設(shè)置好grid、oracle用戶ssh等效性,

本次不檢查

./runcluvfy.shstage-precrsinst-nracl,rac2-verbose

天檢測通過的顯示為failed,根據(jù)情況修復一下即可：rcsolv.conf不一致的DNS問題可以忽

略

5.3安裝GridInfrastructure軟件

5.3.1開始安裝

exportDISPLAY=192.168.6.18:0.0

./runinstaller

OracleGridInfrastructure-SettingupGridInfrastructure-Step3of9.□

ORACLEqqg

SelectInstallationType

DATABASE

TlypicilInstailaiion

午Performafull9ndinfrastructureinstallationthbasicconfiguration.

TImtalMionT>peQJAdvancedinn^ivion

AllowsaesadconfigurationoptionssuchaHematzenor￥jechokes,idd?ionilnetvborting

TClusierCorrfiaumton

flexibility,intecrvionIPMl,mdmoreroleallocxionofOracleAutomaticStorageManagement

午systemprwHeg”

丫

丫

丫

、<Jack[H；]Cvicel

5.3.2語言支持中文

OracleGridInfrastructure-SettingupGridInfrastructure-Step4of

SelectProductLanguagesORACUe-

DATABASE

T

下AvailU)leLanauMer_2eleaedLanguages

陛MHT一

午

InstallavonTYPEKorem

UtinAmericanSpanish

TProductUngu4get

YLatvian

OoeratmaCrouD，Lnhuam&n

Md?y

TinnviMionLocation

TMexicanSpanish

Pr<rt(|ui$heChecksNorwegian

TPolish

Suamary

YPortuguese

VInstillAroductftominian

㈤5________

—

Slovak

Slovemw

Spvttsh

Swedish

Thai

TraditionalChinese

Turtish

UkraniM

[Vietnamese

5.3.3配置Scanname與host文件一致

T

T

T

T

T

T

丫

午

丫

T

Y

T

丫

丫

丫

Cancel?

此處的SCAN一NAME與/etc/hosts文件中的scan地址保持一致

vi/etc/hosts

添加對應的m信息

#public

192.168.6.11racl

192.168.6.12rac2

#private

2.2.2.2racl-priv

2.2.2.3rac2-priv

#virtual

192.168.6.13racl-vip

192.168.6.14rac2-vip

#scan

192.168.6.15Icluster-scan

IHOracleGridInfrastructure-SettingupGridInfrastructure-Step6of.ox

ClusterNodeInformationORACLE

DATABASE

Providethehst“code八obemanagedbyOracleCridinfrwtructureMhtheirPublicHostnameand

VirtualHostname

IfOracleGridNvningService(CNS)hasbeenselectedandDHCPisenabled,thentheVirtualHostnamei5

automaticalhrconfiguredforeachPublicNode.

PublicHonnimeVirtu%!Hostnime

|riS|r>c].v?p

CrePluaandPI4Y

ClosterNodeInformsionAddClusterNodeInform

Ny^orV;ImerfaceIBaae

SpecifythehweforthepublKIPaddressIfyouwvntoconfflutethe

vinuaJhonnaniemanudly,insteadofallMngrttobeconfigured

asomaticVM,thenyoubepromptedforthevinu^JIPaddress

Publictjostname:rac2

yinuilHostnune:憶2*ip]

-K|Cancel:

￡onnea*viryU$cClusterConfigurMionPile

<fiackjH；x<>JCancel

5.3.4Grid用戶等效性配置

F"OracleGridInfrastructure-SettingupGridInfrastructure-Step6of16

ClusterNodeInformation

IDoxnnloadSoftwareUpdatesProvidethelistofnodestobemanagedbyOracleCridlnfra$tructurevUththeirPublicHostnameand

VirtualHostname

instdJlotionOptionIfOracleCridNamingService(CNS)hasbeenselectedandDHCPiserabled,thentheVinualHostnameis

不automatical^configuredforeachPublicNode.

午tallationType

Y^oductLanguages

ICridPiuaandPlay

TClutterNodeInformalkm

YNetworkimerfaceusaae

Y

平VotingDiskStorage

YderatingSystemCroi

午istallationLocal

YPrerequisiteChecks

Y;tallProduct

2YPnlsh

I±ptallCancel

點擊setup

OracleGridInfrastructure-SettingupGridInfrastructure-Step6of16

ClusterNodeInformationORACLe,

ProvidethelistofnodestobemanagedbyOracleCrldInfrastructurevuththeirPublicHostnameand

VirtualHostname.

IfOracleGridNamingService(GNS)hasbeenselectedandDHCPIserabled,thentheVirtualHostnameIs

automaxicalfyconfiguredforeachPublicNode.

XInstallationType

PublicHostnameVirtualHostname

:oradbloradbl-vip

CndPluqandPlayoradb2adb2-vip

I一CusterNodeliifo?iv*

NzsorklEcGceUsOracleGridInfrastructure

PasswordlessSSHconnectivitybetweentheselectednodesalready

established

||皿1??Remove

IretaliationLocation1鄴|

PrerequisiteChecks

Userhomeissharedbytheselectednodes

Reusepnvateandpublicteysexistingintheuserhome

[?Setufi

FHIsh

<Back[Rexi>]

HeP出現(xiàn)提示安裝成

功。Next

<OracleGridInfrostructure?SettingupGridInfrastructure?Step6of17

SpecifyNetworkInterfaceUsageORACLe*

DATABASE

Tidentifytheplannedusefore^chglobalinterfaceshovmintheboxbelowasPublic,Pnvme.orDoNot

TUsePriviteinterfKtsveusedbyOracleCridinfranructureforinternodetriffle

Y?fthereismorethinonesubnetassociatedaninterface,thenchangetheinterface'sattnbutesto

TassoctxetheWe&cenvnewiththeaddmendsubnets

T

T

TNetworkInferfaceIMaoe

TSmaeQ6,on

T

T

Y

^

I

T

Y

Y

.Y

I眄」<fiickNext>[CMC"]

5.3.5創(chuàng)立OCR磁盤組

T

Y午

YRedundancyCM*flhONonn.*l?External

Add

丫

(f)CandidateDisksQftllDijks

丫NetworkinteffaceUsage

個$，oraaeOption

wQeMeASMDiskGroup

—

午AMIPWtMd

—FaiureUolVion

丫OperatingSysitwCroup

午InstallationLocation

丫Cretteinventory

丫PrerequisiteChecks

丫SummvY

(ChwgeDiscoverygith

丫Setup

)Finish

<gckHext>jCancelj

OracleGridInfrastructure-SettingupGridInfrastructure-Step9of15

SpecifyASMPasswordORACLE

DATABASE

中ThentwAutomMicStongeMMniffemem(ASM)instancerequ?rt$?$o*n$Y$u$mh$Y$A$M

prwalegcsfor^d?inl$tritionOraclertcoeRneMsthatyoucreateas”pnvikgedASMSNMPuserwith

午SYSDBAprtvilexestomonitortheASMihstance