RedHat 7.7 平台安装19c(19.3) RAC 详细操作过程
作者:吴伟龙(PrudentWoo)
一、 RAC架构规划
1.1. 网络架构规划
项目 | RAC节点一 | RAC节点二 |
主机名 | ora19crac1 | ora19crac2 |
Private IP地址 (ens32) | 90.90.90.1 | 90.90.90.2 |
Public IP地址 (ens33) | 192.168.84.91 | 192.168.84.92 |
Public-vip地址(ens33) | 192.168.84.93 | 192.168.84.94 |
SCAN_IP (ens33) | 192.168.90.15 | |
SCAN_NAME | scan-ora19racdb |
1.2. 存储规划
共享磁盘路径 | ASM磁盘名称 | ASM磁盘组名称 | 大小 | 冗余 |
/dev/sdb1 | asm_ocr_1 | OCR_VOT_GP1 | 1GB | Normal |
/dev/sdc1 | asm_ocr_2 | 1GB | ||
/dev/sdd1 | asm_ocr_3 | 1GB | ||
/dev/sde1 | asm_data1 | DATA_GP01 | 5GB | External |
/dev/sdf1 | asm_fra01 | FRA_GP01 | 3GB | external |
备注:19c中MGMT是可选项,经过过12c的摧残,我相信大部分人和企业都不愿意使用,在安装GI的时候选择No即可。
1.3. 软件规划
虚拟机软件 | VMware Workstation 15.5.1 pro |
操作系统 | Red Hat Enterprise Linux Server release 7.7 (Maipo) |
集群软件 | Oracle Clusterware 19.3.0 |
数据库软件 | Oracle Database EnterPrise 19.3.0 |
二、 虚拟机配置
2.1. 修改vmware配置文件以支持共享磁盘:
在节点一添加硬盘à选择scsi—>立即分配,按磁盘规划表格共添加五块磁盘,节点二选择使用现有虚拟磁盘,找到相应的五个磁盘文件,都添加好后关闭VMware Workstation软件,打开所有节点的.vmx文件添加如下内容,完成共享磁盘的配置。
disk.locking = "FALSE"
diskLib.dataCacheMaxSize = "0"
diskLib.dataCacheMaxReadAheadSize = "0"
diskLib.dataCacheMinReadAheadSize = "0"
diskLib.dataCachePageSize = "4096"
diskLib.maxUnsyncedWrites = "0"
unity.wasCapable = "TRUE"
scsi0:5.fileName = "D:\vmware\ora19cRAC\share_disk\datadg01.vmdk"
scsi0:5.present = "TRUE"
scsi0:1.fileName = "D:\vmware\ora19cRAC\share_disk\ocrvot01.vmdk"
scsi0:1.present = "TRUE"
scsi0:2.fileName = "D:\vmware\ora19cRAC\share_disk\ocrvot02.vmdk"
scsi0:2.present = "TRUE"
scsi0:3.fileName = "D:\vmware\ora19cRAC\share_disk\ocrvot03.vmdk"
scsi0:3.present = "TRUE"
scsi0:4.fileName = "D:\vmware\ora19cRAC\share_disk\mgmt.vmdk"
scsi0:4.present = "TRUE"
scsi0:4.redo = ""
scsi0:3.redo = ""
scsi0:2.redo = ""
scsi0:1.redo = ""
scsi0:5.redo = ""
scsi0:0.redo = ""
scsi0:1.mode = "independent-persistent"
scsi0:1.deviceType = "disk"
scsi0:2.mode = "independent-persistent"
scsi0:2.deviceType = "disk"
scsi0:3.mode = "independent-persistent"
scsi0:3.deviceType = "disk"
scsi0:4.mode = "independent-persistent"
scsi0:4.deviceType = "disk"
scsi0:5.mode = "independent-persistent"
scsi0:4.deviceType = "disk"
修改主机名,配置IP地址
# ora19crac1:
[root@localhost ~]# cat /etc/hostname
ora19crac1
[root@localhost ~]# cat /etc/sysconfig/network-scripts/ifcfg-ens32
TYPE=Ethernet
BOOTPROTO=none
NAME=ens32
DEVICE=ens32
ONBOOT=yes
IPADDR=90.90.90.1
NETMASK=255.255.255.0
ARPCHECK=no
[root@localhost ~]# cat /etc/sysconfig/network-scripts/ifcfg-ens33
TYPE=Ethernet
BOOTPROTO=none
NAME=ens33
DEVICE=ens33
ONBOOT=yes
IPADDR=192.168.84.91
NETMASK=255.255.255.0
GATEWAY=192.168.84.1
ARPCHECK=no
三、 安装环境准备
备注:该过程均在两台主机上同时操作
3.1. 修改主机名和IP地址
# ora19crac1
# 修改主机名
[root@localhost ~]# vi /etc/hostsname
[root@localhost ~]# cat /etc/hostname
ora19crac1
# 修改私网IP地址
[root@localhost ~]# cat /etc/sysconfig/network-scripts/ifcfg-ens32
TYPE=Ethernet
BOOTPROTO=none
NAME=ens32
DEVICE=ens32
ONBOOT=yes
IPADDR=90.90.90.1
NETMASK=255.255.255.0
# 修改公网IP地址
[root@localhost ~]# cat /etc/sysconfig/network-scripts/ifcfg-ens33
TYPE=Ethernet
BOOTPROTO=none
NAME=ens33
DEVICE=ens33
ONBOOT=yes
IPADDR=192.168.84.91
NETMASK=255.255.255.0
GATEWAY=192.168.84.1
3.2. 关闭时间同步服务
[root@ora19crac1 ~]# systemctl stop chronyd
[root@ora19crac1 ~]# systemctl disable chronyd
[root@ora19crac1 ~]# mv /etc/chrony.conf /etc/chrony.conf.bak
3.3. 关闭防火墙和SELinux
[root@ora11grac1 ~]# chkconfig iptables off
[root@ora11grac1 ~]# chkconfig ip6tables off
[root@ora11grac1 ~]# setenforce Permissive
[root@ora11grac1 ~]# setenforce 0
[root@ora11grac1 ~]#sed -i "/^SELINUX=/s#enforcing#disabled#" /etc/selinux/config
[root@ora11grac1 ~]# vi /etc/selinux/config
SELINUX=disabled
[root@ora11grac1 ~]# service iptables stop
iptables: Setting chains to policy ACCEPT: filter [ OK ]
iptables: Flushing firewall rules: [ OK ]
iptables: Unloading modules: [ OK ]
[root@ora11grac1 ~]# service ip6tables stop
ip6tables: Setting chains to policy ACCEPT: filter [ OK ]
ip6tables: Flushing firewall rules: [ OK ]
ip6tables: Unloading modules: [ OK ]
3.4. RHEL 7禁用防火墙
[root@ora19crac1 ~]# systemctl list-unit-files|grep firewalld
firewalld.service enabled
[root@ora19crac1 ~]# systemctl stop firewalld.service
[root@ora19crac1 ~]# systemctl disable firewalld.service
Removed symlink /etc/systemd/system/multi-user.target.wants/firewalld.service.
Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service.
3.5. 配置本地YUM:
[root@ora19crac1 ~]# mount /dev/sr0 /mnt/
mount: /dev/sr0 is write-protected, mounting read-only
[root@ora19crac1 ~]# cat > /etc/yum.repos.d/local.repo <<EOF
> [base]
> name=base
> baseurl=file:///mnt
> enabled=1
> gpgcheck=0
> multilib_policy=all
> EOF
[root@ora19crac1 ~]# yum clean all
Loaded plugins: product-id, search-disabled-repos, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager to register.
Cleaning repos: base
[root@ora19crac1 ~]# yum makecache
Loaded plugins: product-id, search-disabled-repos, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager to register.
base | 2.8 kB 00:00:00
(1/5): base/group_gz | 103 kB 00:00:00
(2/5): base/primary | 2.0 MB 00:00:00
(3/5): base/filelists | 3.1 MB 00:00:00
(4/5): base/other | 1.1 MB 00:00:00
(5/5): base/productid | 1.6 kB 00:00:00
base 5229/5229
base 5229/5229
base 5229/5229
Metadata Cache Created
3.6. 安装桌面
[root@ora19crac1 ~]# yum groupinstall -y "Server with GUI"
[root@ora19crac1 ~]# cd /etc/systemd/system/
[root@ora19crac1 system]# ln -sf /lib/systemd/system/graphical.target /etc/systemd/system/default.target
[root@ora19crac1 system]# reboot
3.7. 创建用户和组
# 检查并创建用户组
[root@ora19crac1 ~]# grep 54[4,3] /etc/group
[root@ora19crac1 ~]# groupadd -g 54421 oinstall
[root@ora19crac1 ~]# groupadd -g 54322 dba
[root@ora19crac1 ~]# groupadd -g 54323 oper
[root@ora19crac1 ~]# groupadd -g 54324 backupdba
[root@ora19crac1 ~]# groupadd -g 54325 dgdba
[root@ora19crac1 ~]# groupadd -g 54326 kmdba
[root@ora19crac1 ~]# groupadd -g 54327 asmdba
[root@ora19crac1 ~]# groupadd -g 54328 asmoper
[root@ora19crac1 ~]# groupadd -g 54329 asmadmin
[root@ora19crac1 ~]# groupadd -g 54330 racdba
[root@ora19crac1 ~]# grep 54[4,3] /etc/group
oinstall:x:54421:
dba:x:54322:
oper:x:54323:
backupdba:x:54324:
dgdba:x:54325:
kmdba:x:54326:
asmdba:x:54327:
asmoper:x:54328:
asmadmin:x:54329:
racdba:x:54330:
# 检查并创建用户
[root@ora19crac1 ~]# grep oracle /etc/passwd
[root@ora19crac1 ~]# grep grid /etc/passwd
[root@ora19crac1 ~]# /usr/sbin/useradd -u 54322 -g oinstall -G asmadmin,asmdba,asmoper,racdba grid
[root@ora19crac1 ~]# /usr/sbin/useradd -g oinstall -G dba,asmdba,backupdba,dgdba,kmdba,racdba,oper oracle
# 配置用户密码
[root@ora19crac1 ~]# echo "oracle" | passwd --stdin oracle
[root@ora19crac1 ~]#echo "oracle" | passwd --stdin grid
# 检查创建完成之后的用户信息
[root@ora19crac1 ~]# grep oracle /etc/passwd
oracle:x:54323:54421::/home/oracle:/bin/bash
[root@ora19crac1 ~]# grep grid /etc/passwd
grid:x:54322:54421::/home/grid:/bin/bash
[root@ora19crac1 ~]# id grid
uid=54322(grid) gid=54421(oinstall) groups=54421(oinstall),54327(asmdba),54329(asmadmin),54330(racdba)
[root@ora19crac1 ~]# id oracle
uid=54323(oracle) gid=54421(oinstall) groups=54421(oinstall),54322(dba),54323(oper),54324(backupdba),54325(dgdba),54326(kmdba),54327(asmdba),54330(racdba)
3.8. 创建目录
[root@ora19crac1 ~]# mkdir -p /u01/app/19.0.0/grid
[root@ora19crac1 ~]# mkdir -p /u01/app/grid
[root@ora19crac1 ~]# mkdir -p /u01/app/oracle
3.9. 给数据库安装目录授权
[root@ora19crac1 ~]# chown -R grid:oinstall /u01
[root@ora19crac1 ~]# chown oracle:oinstall /u01/app/oracle
[root@ora19crac1 ~]# chmod -R 775 /u01/
3.10. 安装软件包
# 需要安装的软件包信息
setarch binutils compat-libstdc++-33 compat-db compat-libstdc++ compat-gcc elfutils-libelf elfutils-libelf-devel gcc gcc-c++ glibc glibc-common glibc-devel libaio libaio-devel libgcc libstdc++ libstdc++-devel make ksh numactl sysstat libXp unixODBC unixODBC-devel udev
# 挂载光盘安装软件
[root@ora19crac1 ~]# mount /dev/sr0 /mnt/
mount: /dev/sr0 is write-protected, mounting read-only
[root@ora19crac1 ~]# yum install -y bc binutils compat-libcap1 compat-libstdc++ elfutils-libelf elfutils-libelf-devel fontconfig-devel glibc glibc-devel ksh libaio libaio-devel libXrender libXrender-devel libX11 libXau libXi libXtst libgcc libstdc++ libstdc++-devel libxcb make net-tools targetcli smartmontools sysstat gcc gcc-c++ gcc-info gcc-locale gcc48 gcc48-info gcc48-locale gcc48-c++
Loaded plugins: langpacks, product-id, search-disabled-repos, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager to register.
base | 2.8 kB 00:00:00
Package bc-1.06.95-13.el7.x86_64 already installed and latest version
Package binutils-2.27-41.base.el7.x86_64 already installed and latest version
No package compat-libstdc++ available.
Package elfutils-libelf-0.176-2.el7.x86_64 already installed and latest version
Package glibc-2.17-292.el7.x86_64 already installed and latest version
Package libaio-0.3.109-13.el7.x86_64 already installed and latest version
Package libXrender-0.9.10-1.el7.x86_64 already installed and latest version
Package libX11-1.6.7-2.el7.x86_64 already installed and latest version
Package libXau-1.0.8-2.1.el7.x86_64 already installed and latest version
Package libXi-1.7.9-1.el7.x86_64 already installed and latest version
Package libXtst-1.2.3-1.el7.x86_64 already installed and latest version
Package libgcc-4.8.5-39.el7.x86_64 already installed and latest version
Package libstdc++-4.8.5-39.el7.x86_64 already installed and latest version
Package libxcb-1.13-1.el7.x86_64 already installed and latest version
Package 1:make-3.82-24.el7.x86_64 already installed and latest version
Package net-tools-2.0-0.25.20131004git.el7.x86_64 already installed and latest version
Package 1:smartmontools-7.0-1.el7.x86_64 already installed and latest version
Package sysstat-10.1.5-18.el7.x86_64 already installed and latest version
No package gcc-info available.
No package gcc-locale available.
No package gcc48 available.
No package gcc48-info available.
No package gcc48-locale available.
No package gcc48-c++ available.
Resolving Dependencies
--> Running transaction check
---> Package compat-libcap1.x86_64 0:1.10-7.el7 will be installed
---> Package elfutils-libelf-devel.x86_64 0:0.176-2.el7 will be installed
--> Processing Dependency: pkgconfig(zlib) for package: elfutils-libelf-devel-0.176-2.el7.x86_64
---> Package fontconfig-devel.x86_64 0:2.13.0-4.3.el7 will be installed
--> Processing Dependency: pkgconfig(freetype2) >= 20.0.14 for package: fontconfig-devel-2.13.0-4.3.el7.x86_64
--> Processing Dependency: freetype-devel >= 2.8-7 for package: fontconfig-devel-2.13.0-4.3.el7.x86_64
--> Processing Dependency: pkgconfig(uuid) for package: fontconfig-devel-2.13.0-4.3.el7.x86_64
--> Processing Dependency: pkgconfig(expat) for package: fontconfig-devel-2.13.0-4.3.el7.x86_64
---> Package gcc.x86_64 0:4.8.5-39.el7 will be installed
--> Processing Dependency: cpp = 4.8.5-39.el7 for package: gcc-4.8.5-39.el7.x86_64
---> Package gcc-c++.x86_64 0:4.8.5-39.el7 will be installed
---> Package glibc-devel.x86_64 0:2.17-292.el7 will be installed
--> Processing Dependency: glibc-headers = 2.17-292.el7 for package: glibc-devel-2.17-292.el7.x86_64
--> Processing Dependency: glibc-headers for package: glibc-devel-2.17-292.el7.x86_64
---> Package ksh.x86_64 0:20120801-139.el7 will be installed
---> Package libXrender-devel.x86_64 0:0.9.10-1.el7 will be installed
---> Package libaio-devel.x86_64 0:0.3.109-13.el7 will be installed
---> Package libstdc++-devel.x86_64 0:4.8.5-39.el7 will be installed
---> Package targetcli.noarch 0:2.1.fb49-1.el7 will be installed
--> Processing Dependency: python-rtslib >= 2.1.fb41 for package: targetcli-2.1.fb49-1.el7.noarch
--> Processing Dependency: python-configshell for package: targetcli-2.1.fb49-1.el7.noarch
--> Running transaction check
---> Package cpp.x86_64 0:4.8.5-39.el7 will be installed
---> Package expat-devel.x86_64 0:2.1.0-10.el7_3 will be installed
---> Package freetype-devel.x86_64 0:2.8-14.el7 will be installed
--> Processing Dependency: pkgconfig(libpng) for package: freetype-devel-2.8-14.el7.x86_64
---> Package glibc-headers.x86_64 0:2.17-292.el7 will be installed
--> Processing Dependency: kernel-headers >= 2.2.1 for package: glibc-headers-2.17-292.el7.x86_64
--> Processing Dependency: kernel-headers for package: glibc-headers-2.17-292.el7.x86_64
---> Package libuuid-devel.x86_64 0:2.23.2-61.el7 will be installed
---> Package python-configshell.noarch 1:1.1.fb25-1.el7 will be installed
--> Processing Dependency: python-urwid for package: 1:python-configshell-1.1.fb25-1.el7.noarch
--> Processing Dependency: pyparsing for package: 1:python-configshell-1.1.fb25-1.el7.noarch
---> Package python-rtslib.noarch 0:2.1.fb69-3.el7 will be installed
--> Processing Dependency: python-kmod for package: python-rtslib-2.1.fb69-3.el7.noarch
---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed
--> Running transaction check
---> Package kernel-headers.x86_64 0:3.10.0-1062.el7 will be installed
---> Package libpng-devel.x86_64 2:1.5.13-7.el7_2 will be installed
---> Package pyparsing.noarch 0:1.5.6-9.el7 will be installed
---> Package python-kmod.x86_64 0:0.9-4.el7 will be installed
---> Package python-urwid.x86_64 0:1.1.1-3.el7 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
===============================================================================================================================
Package Arch Version Repository Size
===============================================================================================================================
Installing:
compat-libcap1 x86_64 1.10-7.el7 base 19 k
elfutils-libelf-devel x86_64 0.176-2.el7 base 39 k
fontconfig-devel x86_64 2.13.0-4.3.el7 base 138 k
gcc x86_64 4.8.5-39.el7 base 16 M
gcc-c++ x86_64 4.8.5-39.el7 base 7.2 M
glibc-devel x86_64 2.17-292.el7 base 1.1 M
ksh x86_64 20120801-139.el7 base 885 k
libXrender-devel x86_64 0.9.10-1.el7 base 17 k
libaio-devel x86_64 0.3.109-13.el7 base 13 k
libstdc++-devel x86_64 4.8.5-39.el7 base 1.5 M
targetcli noarch 2.1.fb49-1.el7 base 68 k
Installing for dependencies:
cpp x86_64 4.8.5-39.el7 base 6.0 M
expat-devel x86_64 2.1.0-10.el7_3 base 57 k
freetype-devel x86_64 2.8-14.el7 base 447 k
glibc-headers x86_64 2.17-292.el7 base 687 k
kernel-headers x86_64 3.10.0-1062.el7 base 8.7 M
libpng-devel x86_64 2:1.5.13-7.el7_2 base 122 k
libuuid-devel x86_64 2.23.2-61.el7 base 92 k
pyparsing noarch 1.5.6-9.el7 base 94 k
python-configshell noarch 1:1.1.fb25-1.el7 base 68 k
python-kmod x86_64 0.9-4.el7 base 57 k
python-rtslib noarch 2.1.fb69-3.el7 base 102 k
python-urwid x86_64 1.1.1-3.el7 base 654 k
zlib-devel x86_64 1.2.7-18.el7 base 50 k
Transaction Summary
===============================================================================================================================
Install 11 Packages (+13 Dependent packages)
Total download size: 44 M
Installed size: 95 M
Downloading packages:
-------------------------------------------------------------------------------------------------------------------------------
Total 82 MB/s | 44 MB 00:00:00
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Installing : zlib-devel-1.2.7-18.el7.x86_64 1/24
Installing : 2:libpng-devel-1.5.13-7.el7_2.x86_64 2/24
Installing : freetype-devel-2.8-14.el7.x86_64 3/24
Installing : cpp-4.8.5-39.el7.x86_64 4/24
Installing : python-kmod-0.9-4.el7.x86_64 5/24
Installing : python-rtslib-2.1.fb69-3.el7.noarch 6/24
Installing : python-urwid-1.1.1-3.el7.x86_64 7/24
Installing : libstdc++-devel-4.8.5-39.el7.x86_64 8/24
Installing : expat-devel-2.1.0-10.el7_3.x86_64 9/24
Installing : pyparsing-1.5.6-9.el7.noarch 10/24
Installing : 1:python-configshell-1.1.fb25-1.el7.noarch 11/24
Installing : kernel-headers-3.10.0-1062.el7.x86_64 12/24
Installing : glibc-headers-2.17-292.el7.x86_64 13/24
Installing : glibc-devel-2.17-292.el7.x86_64 14/24
Installing : gcc-4.8.5-39.el7.x86_64 15/24
Installing : libuuid-devel-2.23.2-61.el7.x86_64 16/24
Installing : fontconfig-devel-2.13.0-4.3.el7.x86_64 17/24
Installing : gcc-c++-4.8.5-39.el7.x86_64 18/24
Installing : targetcli-2.1.fb49-1.el7.noarch 19/24
Installing : elfutils-libelf-devel-0.176-2.el7.x86_64 20/24
Installing : libaio-devel-0.3.109-13.el7.x86_64 21/24
Installing : compat-libcap1-1.10-7.el7.x86_64 22/24
Installing : ksh-20120801-139.el7.x86_64 23/24
Installing : libXrender-devel-0.9.10-1.el7.x86_64 24/24
Verifying : 2:libpng-devel-1.5.13-7.el7_2.x86_64 1/24
Verifying : libuuid-devel-2.23.2-61.el7.x86_64 2/24
Verifying : kernel-headers-3.10.0-1062.el7.x86_64 3/24
Verifying : gcc-4.8.5-39.el7.x86_64 4/24
Verifying : pyparsing-1.5.6-9.el7.noarch 5/24
Verifying : expat-devel-2.1.0-10.el7_3.x86_64 6/24
Verifying : fontconfig-devel-2.13.0-4.3.el7.x86_64 7/24
Verifying : zlib-devel-1.2.7-18.el7.x86_64 8/24
Verifying : targetcli-2.1.fb49-1.el7.noarch 9/24
Verifying : freetype-devel-2.8-14.el7.x86_64 10/24
Verifying : libstdc++-devel-4.8.5-39.el7.x86_64 11/24
Verifying : libXrender-devel-0.9.10-1.el7.x86_64 12/24
Verifying : python-urwid-1.1.1-3.el7.x86_64 13/24
Verifying : ksh-20120801-139.el7.x86_64 14/24
Verifying : gcc-c++-4.8.5-39.el7.x86_64 15/24
Verifying : elfutils-libelf-devel-0.176-2.el7.x86_64 16/24
Verifying : compat-libcap1-1.10-7.el7.x86_64 17/24
Verifying : libaio-devel-0.3.109-13.el7.x86_64 18/24
Verifying : 1:python-configshell-1.1.fb25-1.el7.noarch 19/24
Verifying : python-kmod-0.9-4.el7.x86_64 20/24
Verifying : glibc-devel-2.17-292.el7.x86_64 21/24
Verifying : cpp-4.8.5-39.el7.x86_64 22/24
Verifying : python-rtslib-2.1.fb69-3.el7.noarch 23/24
Verifying : glibc-headers-2.17-292.el7.x86_64 24/24
Installed:
compat-libcap1.x86_64 0:1.10-7.el7 elfutils-libelf-devel.x86_64 0:0.176-2.el7 fontconfig-devel.x86_64 0:2.13.0-4.3.el7
gcc.x86_64 0:4.8.5-39.el7 gcc-c++.x86_64 0:4.8.5-39.el7 glibc-devel.x86_64 0:2.17-292.el7
ksh.x86_64 0:20120801-139.el7 libXrender-devel.x86_64 0:0.9.10-1.el7 libaio-devel.x86_64 0:0.3.109-13.el7
libstdc++-devel.x86_64 0:4.8.5-39.el7 targetcli.noarch 0:2.1.fb49-1.el7
Dependency Installed:
cpp.x86_64 0:4.8.5-39.el7 expat-devel.x86_64 0:2.1.0-10.el7_3 freetype-devel.x86_64 0:2.8-14.el7
glibc-headers.x86_64 0:2.17-292.el7 kernel-headers.x86_64 0:3.10.0-1062.el7 libpng-devel.x86_64 2:1.5.13-7.el7_2
libuuid-devel.x86_64 0:2.23.2-61.el7 pyparsing.noarch 0:1.5.6-9.el7 python-configshell.noarch 1:1.1.fb25-1.el7
python-kmod.x86_64 0:0.9-4.el7 python-rtslib.noarch 0:2.1.fb69-3.el7 python-urwid.x86_64 0:1.1.1-3.el7
zlib-devel.x86_64 0:1.2.7-18.el7
Complete!
3.11. 单独手工安装compat-libstdc++
[root@ora19crac2 ~]# ls
compat-libstdc++-33-3.2.3-69.el6.x86_64.rpm
[root@ora19crac2 ~]# rpm -ivh compat-libstdc++-33-3.2.3-69.el6.x86_64.rpm
warning: compat-libstdc++-33-3.2.3-69.el6.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEY
Preparing... ################################# [100%]
Updating / installing...
1:compat-libstdc++-33-3.2.3-69.el6 ################################# [100%]
[root@ora19crac1 ~]# rpm -ivh compat-libstdc++-33-3.2.3-69.el6.x86_64.rpm
warning: compat-libstdc++-33-3.2.3-69.el6.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEY
Preparing... ################################# [100%]
Updating / installing...
1:compat-libstdc++-33-3.2.3-69.el6 ################################# [100%]
3.12. 检查已安装的软件包
[root@ora19crac1 ~]# rpm -qa bc binutils compat-libcap1 compat-libstdc++ elfutils-libelf elfutils-libelf-devel fontconfig-devel glibc glibc-devel ksh libaio libaio-devel libXrender libXrender-devel libX11 libXau libXi libXtst libgcc libstdc++ libstdc++-devel libxcb make net-tools targetcli smartmontools sysstat gcc gcc-c++ gcc-info gcc-locale gcc48 gcc48-info gcc48-locale gcc48-c++
libXtst-1.2.3-1.el7.x86_64
net-tools-2.0-0.25.20131004git.el7.x86_64
targetcli-2.1.fb49-1.el7.noarch
binutils-2.27-41.base.el7.x86_64
libaio-0.3.109-13.el7.x86_64
libXrender-0.9.10-1.el7.x86_64
libstdc++-devel-4.8.5-39.el7.x86_64
libXau-1.0.8-2.1.el7.x86_64
libXrender-devel-0.9.10-1.el7.x86_64
glibc-2.17-292.el7.x86_64
elfutils-libelf-0.176-2.el7.x86_64
libxcb-1.13-1.el7.x86_64
libX11-1.6.7-2.el7.x86_64
libXi-1.7.9-1.el7.x86_64
fontconfig-devel-2.13.0-4.3.el7.x86_64
libaio-devel-0.3.109-13.el7.x86_64
libgcc-4.8.5-39.el7.x86_64
libstdc++-4.8.5-39.el7.x86_64
bc-1.06.95-13.el7.x86_64
glibc-devel-2.17-292.el7.x86_64
gcc-c++-4.8.5-39.el7.x86_64
compat-libcap1-1.10-7.el7.x86_64
sysstat-10.1.5-18.el7.x86_64
make-3.82-24.el7.x86_64
gcc-4.8.5-39.el7.x86_64
ksh-20120801-139.el7.x86_64
smartmontools-7.0-1.el7.x86_64
elfutils-libelf-devel-0.176-2.el7.x86_64
[root@ora19crac1 ~]# rpm -qa --queryformat "%{NAME}-%{VERSION}-%{RELEASE} (%{ARCH})\n" bc binutils compat-libcap1 compat-libstdc++ elfutils-libelf elfutils-libelf-devel fontconfig-devel glibc glibc-devel ksh libaio libaio-devel libXrender libXrender-devel libX11 libXau libXi libXtst libgcc libstdc++ libstdc++-devel libxcb make net-tools targetcli smartmontools sysstat gcc gcc-c++ gcc-info gcc-locale gcc48 gcc48-info gcc48-locale gcc48-c++
libXtst-1.2.3-1.el7 (x86_64)
net-tools-2.0-0.25.20131004git.el7 (x86_64)
targetcli-2.1.fb49-1.el7 (noarch)
binutils-2.27-41.base.el7 (x86_64)
libaio-0.3.109-13.el7 (x86_64)
libXrender-0.9.10-1.el7 (x86_64)
libstdc++-devel-4.8.5-39.el7 (x86_64)
libXau-1.0.8-2.1.el7 (x86_64)
libXrender-devel-0.9.10-1.el7 (x86_64)
glibc-2.17-292.el7 (x86_64)
elfutils-libelf-0.176-2.el7 (x86_64)
libxcb-1.13-1.el7 (x86_64)
libX11-1.6.7-2.el7 (x86_64)
libXi-1.7.9-1.el7 (x86_64)
fontconfig-devel-2.13.0-4.3.el7 (x86_64)
libaio-devel-0.3.109-13.el7 (x86_64)
libgcc-4.8.5-39.el7 (x86_64)
libstdc++-4.8.5-39.el7 (x86_64)
bc-1.06.95-13.el7 (x86_64)
glibc-devel-2.17-292.el7 (x86_64)
gcc-c++-4.8.5-39.el7 (x86_64)
compat-libcap1-1.10-7.el7 (x86_64)
sysstat-10.1.5-18.el7 (x86_64)
make-3.82-24.el7 (x86_64)
gcc-4.8.5-39.el7 (x86_64)
ksh-20120801-139.el7 (x86_64)
smartmontools-7.0-1.el7 (x86_64)
elfutils-libelf-devel-0.176-2.el7 (x86_64)
3.13. 编辑hosts文件
cat >> /etc/hosts <<EOF
#public
192.168.84.91 ora19crac1
192.168.84.92 ora19crac2
#public-vip
192.168.84.93 ora19crac1-vip
192.168.84.94 ora19crac2-vip
#prive-ip
90.90.90.1 ora19crac1-priv
90.90.90.2 ora19crac2-priv
#scan-ip
192.168.90.15 scan-ora19cracdb
EOF
3.14. 配置ZEROCONF
cat "NOZEROCONF=yes" >> /etc/sysconfig/network
3.15. 修改系统内核参数
[root@ora19crac1 ~]# cat >> /etc/sysctl.conf <<EOF
> kernel.shmall = 4294967296
> kernel.sem = 510 65280 510 128
> kernel.shmmni = 4096
> kernel.shmmax = 137438953472
> net.ipv4.ip_local_port_range = 9000 65500
> net.core.rmem_default = 1048576
> net.core.rmem_max = 4194304
> net.core.wmem_default = 262144
> net.core.wmem_max = 1048576
> fs.file-max = 6815744
> fs.aio-max-nr = 1048576
> vm.swappiness = 0
> vm.dirty_background_ratio = 3
> vm.dirty_ratio = 80
> vm.dirty_expire_centisecs = 500
> vm.dirty_writeback_centisecs = 100
> net.ipv4.tcp_sack = 0
> net.ipv4.tcp_timestamps = 0
> net.ipv4.conf.default.rp_filter = 0
> net.ipv4.tcp_wmem = 262144
> net.ipv4.tcp_rmem = 4194304
> EOF
3.16. 配置LIMITS限制参数
[root@ora19crac1 ~]# cat >> /etc/security/limits.conf <<EOF
> oracle soft nproc 2047
> oracle hard nproc 16384
> oracle soft nofile 65536
> oracle hard nofile 65536
> oracle soft memlock 3145728
> oracle hard memlock 3145728
> oracle soft stack 10240
> oracle hard stack 32768
> grid soft nproc 2047
> grid hard nproc 16384
> grid soft nofile 65536
> grid hard nofile 65536
> grid soft memlock 3145728
> grid hard memlock 3145728
> grid soft stack 10240
> grid hard stack 32768
> #signaturelevin
> EOF
3.17. 配置系统环境变量
[root@ora19crac1 ~]# cat >> /etc/profile <<EOF
if [ \$USER = "oracle" ]||[ \$USER = "grid" ] ; then
if [ \$SHELL = "/bin/ksh" ]; then
ulimit -p 16384
ulimit -n 65536
else
ulimit -u 16384 -n 65536
fi
fi
EOF
3.18. 配置root用户环境变量
cat >> /root/.bash_profile <<EOF
export
export CVUQDISK_GRP=oinstall
EOF
source .bash_profile
3.19. 配置grid用户环境变量
cat >> /home/grid/.bash_profile <<EOF
export TMP=/tmp
export TMPDIR=\$TMP
export EDIT=vi
alias vi=vim
export ORACLE_SID=+ASM1
export ORACLE_BASE=/u01/app/grid
export ORACLE_HOME=/u01/app/19.3.0/grid
export PATH=\$ORACLE_HOME/bin:\$PATH
export NLS_LANG=AMERICAN_AMERICA AL32UTF16
umask 022
EOF
3.20. 配置oracle用户环境变量
cat >> /home/oracle/.bash_profile <<EOF
export TMP=/tmp
export TMPDIR=\$TMP
export EDIT=vi
alias vi=vim
export ORACLE_HOSTNAME=$HOSTNAME
export ORACLE_UNQNAME=woo19c
export ORACLE_BASE=/u01/app/oracle/
export ORACLE_HOME=\$ORACLE_BASE/product/19.3.0/dbhome_1
export ORACLE_SID=woo19c1
export ORACLE_TERM=xterm
export PATH=/usr/sbin:\$PATH
export PATH=\$ORACLE_HOME/bin:\$PATH
export LD_LIBRARY_PATH=\$ORACLE_HOME/lib:/lib:/usr/lib
export CLASSPATH=\$ORACLE_HOME/JRE:\$ORACLE_HOME/jlib:\$ORACLE_HOME/rdbms/jlib
export NLS_LANG=AMERICAN_AMERICA AL32UTF16
umask 022
EOF
3.21. 关闭THP和NUMA
[root@ora19crac1 ~]# echo "transparent_hugepage=never numa=off" >> /etc/default/grub
[root@ora19crac1 ~]# grub2-mkconfig -o /boot/grub2/grub.cfg
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-3.10.0-1062.el7.x86_64
Found initrd image: /boot/initramfs-3.10.0-1062.el7.x86_64.img
Found linux image: /boot/vmlinuz-0-rescue-7f68dbd79736467598cec06d8045a487
Found initrd image: /boot/initramfs-0-rescue-7f68dbd79736467598cec06d8045a487.img
done
[root@ora19crac1 ~]# grub2-mkconfig -o /boot/efi/EFI/redhat/grub.cfg
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-3.10.0-1062.el7.x86_64
Found initrd image: /boot/initramfs-3.10.0-1062.el7.x86_64.img
Found linux image: /boot/vmlinuz-0-rescue-7f68dbd79736467598cec06d8045a487
Found initrd image: /boot/initramfs-0-rescue-7f68dbd79736467598cec06d8045a487.img
done
3.22. 禁用avahi
[root@ora19crac1 ~]# systemctl stop avahi-dnsconfd
[root@ora19crac1 ~]# systemctl stop avahi-daemon
[root@ora19crac1 ~]# systemctl disable avahi-dnsconfd
[root@ora19crac1 ~]# systemctl disable avahi-daemon
3.23. 磁盘规划
3.23.1. 创建分区
[root@ora19crac1 ~]# echo -e "n\np\n1\n\n\nw" | fdisk /dev/sdb
[root@ora19crac1 ~]# echo -e "n\np\n1\n\n\nw" | fdisk /dev/sdc
[root@ora19crac1 ~]# echo -e "n\np\n1\n\n\nw" | fdisk /dev/sdd
[root@ora19crac1 ~]# echo -e "n\np\n1\n\n\nw" | fdisk /dev/sde
[root@ora19crac1 ~]# fdisk -l |grep "/dev/sd" |grep -v sda |sort
/dev/sdb1 2048 2097151 1047552 83 Linux
/dev/sdc1 2048 2097151 1047552 83 Linux
/dev/sdd1 2048 2097151 1047552 83 Linux
/dev/sde1 2048 6291455 3144704 83 Linux
/dev/sdf1 2048 10485759 5241856 83 Linux
Disk /dev/sdb: 1073 MB, 1073741824 bytes, 2097152 sectors
Disk /dev/sdc: 1073 MB, 1073741824 bytes, 2097152 sectors
Disk /dev/sdd: 1073 MB, 1073741824 bytes, 2097152 sectors
Disk /dev/sde: 3221 MB, 3221225472 bytes, 6291456 sectors
Disk /dev/sdf: 5368 MB, 5368709120 bytes, 10485760 sectors
[root@ora19crac2 ~]# fdisk -l |grep "/dev/sd" |grep -v sda |sort
/dev/sdb1 2048 2097151 1047552 83 Linux
/dev/sdc1 2048 2097151 1047552 83 Linux
/dev/sdd1 2048 2097151 1047552 83 Linux
/dev/sde1 2048 6291455 3144704 83 Linux
/dev/sdf1 2048 10485759 5241856 83 Linux
Disk /dev/sdb: 1073 MB, 1073741824 bytes, 2097152 sectors
Disk /dev/sdc: 1073 MB, 1073741824 bytes, 2097152 sectors
Disk /dev/sdd: 1073 MB, 1073741824 bytes, 2097152 sectors
Disk /dev/sde: 3221 MB, 3221225472 bytes, 6291456 sectors
Disk /dev/sdf: 5368 MB, 5368709120 bytes, 10485760 sectors
3.23.2. UDEV RedHat 6手工方法(通用):
cat >> /etc/udev/rules.d/99-oracle-asmdevices.rules <<EOF
KERNEL=="sdb1", NAME="asm_ocr_1", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sdc1", NAME="asm_ocr_2", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sdd1", NAME="asm_ocr_3", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sde1", NAME="asm_mgmt", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sdf1", NAME="asm_data01", OWNER="grid", GROUP="asmadmin", MODE="0660"
EOF
cat >> /etc/udev/rules.d/99-oracle-asmdevices.rules <<EOF
> KERNEL=="sdb1", NAME="asm_ocr_1", OWNER="grid", GROUP="asmadmin", MODE="0660"
> KERNEL=="sdc1", NAME="asm_ocr_2", OWNER="grid", GROUP="asmadmin", MODE="0660"
> KERNEL=="sdd1", NAME="asm_ocr_3", OWNER="grid", GROUP="asmadmin", MODE="0660"
> KERNEL=="sde1", NAME="asm_mgmt", OWNER="grid", GROUP="asmadmin", MODE="0660"
> KERNEL=="sdf1", NAME="asm_data01", OWNER="grid", GROUP="asmadmin", MODE="0660"
> EOF
[root@ora11grac1 ~]# start_udev
Starting udev: [ OK ]
3.23.3. UDEV RedHat 7手工方法
[root@ora19crac1 ~]# cat >> /etc/udev/rules.d/99-oracle-asmdevices.rules <<EOF
KERNEL=="sdb1", SYMLINK+="asm_ocr_1", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sdc1", SYMLINK+="asm_ocr_2", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sdd1", SYMLINK+="asm_ocr_3", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sde1", SYMLINK+="asm_mgmt", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sdf1", SYMLINK+="asm_data01", OWNER="grid", GROUP="asmadmin", MODE="0660"
EOF
[root@ora19crac1 ~]# cat >> /etc/udev/rules.d/99-oracle-asmdevices.rules <<EOF
KERNEL=="sdb1", SYMLINK+="asm_ocr_1", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sdc1", SYMLINK+="asm_ocr_2", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sdd1", SYMLINK+="asm_ocr_3", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sde1", SYMLINK+="asm_mgmt", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sdf1", SYMLINK+="asm_data01", OWNER="grid", GROUP="asmadmin", MODE="0660"
EOF
[root@ora19crac1 ~]# /sbin/udevadm trigger --type=devices --action=change
[root@ora19crac1 ~]# /sbin/udevadm control --reload-rules
[root@ora19crac1 ~]# systemctl enable systemd-udevd.service
[root@ora19crac1 ~]# systemctl restart systemd-udevd.service
[root@ora19crac1 ~]# systemctl status systemd-udevd.service
* systemd-udevd.service - udev Kernel Device Manager
Loaded: loaded (/usr/lib/systemd/system/systemd-udevd.service; static; vendor preset: disabled)
Active: active (running) since Fri 2020-02-28 01:32:10 CST; 9s ago
Docs: man:systemd-udevd.service(8)
man:udev(7)
Main PID: 2414 (systemd-udevd)
Status: "Processing with 16 children at max"
Tasks: 1
CGroup: /system.slice/systemd-udevd.service
`-2414 /usr/lib/systemd/systemd-udevd
Feb 28 01:32:10 ora19crac1 systemd[1]: Starting udev Kernel Device Manager...
Feb 28 01:32:10 ora19crac1 systemd-udevd[2414]: starting version 219
Feb 28 01:32:10 ora19crac1 systemd[1]: Started udev Kernel Device Manager.
[root@ora19crac1 ~]# ls -rtl /dev/asm_* |sort
lrwxrwxrwx 1 root root 4 Feb 28 01:16 /dev/asm_data01 -> sdf1
lrwxrwxrwx 1 root root 4 Feb 28 01:16 /dev/asm_mgmt -> sde1
lrwxrwxrwx 1 root root 4 Feb 28 01:16 /dev/asm_ocr_1 -> sdb1
lrwxrwxrwx 1 root root 4 Feb 28 01:16 /dev/asm_ocr_2 -> sdc1
lrwxrwxrwx 1 root root 4 Feb 28 01:16 /dev/asm_ocr_3 -> sdd1
[root@ora19crac1 ~]# ls -rtl /dev/sd[b,c,d,e,f]1 |sort
brw-rw---- 1 grid asmadmin 8, 17 Feb 28 01:29 /dev/sdb1
brw-rw---- 1 grid asmadmin 8, 33 Feb 28 01:29 /dev/sdc1
brw-rw---- 1 grid asmadmin 8, 49 Feb 28 01:29 /dev/sdd1
brw-rw---- 1 grid asmadmin 8, 65 Feb 28 01:29 /dev/sde1
brw-rw---- 1 grid asmadmin 8, 81 Feb 28 01:29 /dev/sdf
3.23.4. UDEV 配置脚本,RedHat 5及之前版本
for i in b c d e f g h i j k ;
do
echo "KERNEL==\"sd*\", BUS==\"scsi\", PROGRAM==\"/sbin/scsi_id -g -u -s %p\", RESULT==\"`scsi_id -g -u -s /block/sd$i`\", NAME=\"asm-disk$i\", OWNER=\"grid\", GROUP=\"asmadmin\", MODE=\"0660\""
done
以上脚本在Linux 5上都是通用的, 但是有人反映在redhat/Oracle Linux 6以上版本中该脚本失效了。
这是因为:
在OEL6或者RHEL6中,这一切都有所变化。
主要的变化是:
1. scsi_id的命令语法发生了变化,scsi_id -g -u -s这样的命令不再有效。
2. udevtest命令已经没有了,整合到了udevadm中。
How to use udev for Oracle ASM in Oracle Linux 6
下面我提供改良后的脚本,可以在redhat/Oracle Linux 6上生成正确的udev rule 规则文件:
3.23.5. RedHat 6环境配置
echo "options=--whitelisted --replace-whitespace" >> /etc/scsi_id.config
for i in b c d e f ;
do
echo "KERNEL==\"sd*\", BUS==\"scsi\", PROGRAM==\"/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/\$name\", RESULT==\"`/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/sd$i`\", NAME=\"asm-disk$i\", OWNER=\"grid\", GROUP=\"asmadmin\", MODE=\"0660\"" >> /etc/udev/rules.d/99-oracle-asmdevices.rules
done
或
for i in b c d e f ;
do
echo "KERNEL==\"sd*\", BUS==\"scsi\", PROGRAM==\"/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/\$name\", RESULT==\"`/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/sd$i`\", NAME=\"asm-disk$i\", OWNER=\"grid\", GROUP=\"asmadmin\", MODE=\"0660\"" >> /etc/udev/rules.d/99-oracle-asmdevices.rules
done
3.23.6. IBM 多路径的配置
for i in b c d e f g h i j k ;
do
echo "ENV{DM_NAME}=="mpath$i\", OWNER:=\"grid\", GROUP:=\"asmadmin\", MODE:=\"0660\",SYMLINK+=\"iscsi/asm-$env{DM-NAME}\"" >> /etc/udev/rules.d/12-dm-permissions.rules
done
3.23.7. EMC多路径的配置
for i in c d e f g h i
do
echo "KERNEL==\"emcpower*\", BUS==\"scsi\", PROGRAM==\"/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/\$name\", RESULT==\"`/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/emcpower$i`\", NAME=\"asm-disk$i\", OWNER=\"grid\", GROUP=\"asmadmin\", MODE=\"0660\""
done
3.23.8. 让UDEV配置生效:
RedHat 5 and RedHat 6
[root@ora11grac1 ~]# start_udev
Starting udev: [ OK ]
RedHat 7
[root@ora19crac2 ~]# /sbin/udevadm trigger --type=devices --action=change
[root@ora19crac2 ~]# /sbin/udevadm control --reload
[root@ora19crac2 ~]# ls -rtl /dev/asm*
3.24. 配置DHCP
[root@adg19c ~]# yum install -y dhcp
Loaded plugins: product-id, search-disabled-repos, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager to register.
Resolving Dependencies
--> Running transaction check
---> Package dhcp.x86_64 12:4.2.5-77.el7 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
============================================================================================================================
Package Arch Version Repository Size
============================================================================================================================
Installing:
dhcp x86_64 12:4.2.5-77.el7 base 515 k
Transaction Summary
============================================================================================================================
Install 1 Package
Total download size: 515 k
Installed size: 1.4 M
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Installing : 12:dhcp-4.2.5-77.el7.x86_64 1/1
Verifying : 12:dhcp-4.2.5-77.el7.x86_64 1/1
Installed:
dhcp.x86_64 12:4.2.5-77.el7
Complete!
编辑/etc/dhcp/dhcpd.conf配置文件,添加如下内容:
[root@adg19c ~]# cat /etc/dhcp/dhcpd.conf
#
# DHCP Server Configuration file.
# see /usr/share/doc/dhcp*/dhcpd.conf.example
# see dhcpd.conf(5) man page
#
ddns-update-stylenone;
ignoreclient-updates;
subnet 192.168.84.0 netmask 255.255.255.0 {
range 192.168.84.100 192.168.84.110;
option subnet-mask 255.255.255.0;
option routers 192.168.10.1;
default-lease-time 21600;
max-lease-time 43200;
}
[root@adg19c ~]# systemctl enable dhcpd
[root@adg19c ~]# systemctl start dhcpd
[root@adg19c ~]# systemctl status dhcpd
* dhcpd.service - DHCPv4 Server Daemon
Loaded: loaded (/usr/lib/systemd/system/dhcpd.service; enabled; vendor preset: disabled)
Active: active (running) since Fri 2020-02-28 06:21:20 CST; 3min 49s ago
Docs: man:dhcpd(8)
man:dhcpd.conf(5)
Main PID: 2099 (dhcpd)
Status: "Dispatching packets..."
CGroup: /system.slice/dhcpd.service
`-2099 /usr/sbin/dhcpd -f -cf /etc/dhcp/dhcpd.conf -user dhcpd -group dhcpd --no-pid
Feb 28 06:21:20 adg19c dhcpd[2099]: Internet Systems Consortium DHCP Server 4.2.5
Feb 28 06:21:20 adg19c dhcpd[2099]: Copyright 2004-2013 Internet Systems Consortium.
Feb 28 06:21:20 adg19c dhcpd[2099]: All rights reserved.
Feb 28 06:21:20 adg19c dhcpd[2099]: For info, please visit https://www.isc.org/software/dhcp/
Feb 28 06:21:20 adg19c dhcpd[2099]: Not searching LDAP since ldap-server, ldap-port and ldap-base-dn were not specified in ...ig file
Feb 28 06:21:20 adg19c dhcpd[2099]: Wrote 0 leases to leases file.
Feb 28 06:21:20 adg19c dhcpd[2099]: Listening on LPF/ens32/00:0c:29:3d:67:76/192.168.84.0/24
Feb 28 06:21:20 adg19c dhcpd[2099]: Sending on LPF/ens32/00:0c:29:3d:67:76/192.168.84.0/24
Feb 28 06:21:20 adg19c dhcpd[2099]: Sending on Socket/fallback/fallback-net
Feb 28 06:21:20 adg19c systemd[1]: Started DHCPv4 Server Daemon.
Hint: Some lines were ellipsized, use -l to show in full.
3.25. 配置DNS
参考文档:
3.25.1. 安装DNS包
[root@adg19c ~]# yum list|grep bind-chroot
bind-chroot.x86_64 32:9.11.4-9.P2.el7 base
[root@adg19c ~]# yum install -y bind-chroot
Loaded plugins: product-id, search-disabled-repos, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager to register.
Resolving Dependencies
--> Running transaction check
---> Package bind-chroot.x86_64 32:9.11.4-9.P2.el7 will be installed
--> Processing Dependency: bind(x86-64) = 32:9.11.4-9.P2.el7 for package: 32:bind-chroot-9.11.4-9.P2.el7.x86_64
--> Running transaction check
---> Package bind.x86_64 32:9.11.4-9.P2.el7 will be installed
--> Processing Dependency: bind-libs-lite(x86-64) = 32:9.11.4-9.P2.el7 for package: 32:bind-9.11.4-9.P2.el7.x86_64
--> Processing Dependency: bind-libs(x86-64) = 32:9.11.4-9.P2.el7 for package: 32:bind-9.11.4-9.P2.el7.x86_64
--> Processing Dependency: python-ply for package: 32:bind-9.11.4-9.P2.el7.x86_64
--> Processing Dependency: policycoreutils-python for package: 32:bind-9.11.4-9.P2.el7.x86_64
--> Processing Dependency: policycoreutils-python for package: 32:bind-9.11.4-9.P2.el7.x86_64
--> Processing Dependency: liblwres.so.160()(64bit) for package: 32:bind-9.11.4-9.P2.el7.x86_64
--> Processing Dependency: libisccfg.so.160()(64bit) for package: 32:bind-9.11.4-9.P2.el7.x86_64
--> Processing Dependency: libisccc.so.160()(64bit) for package: 32:bind-9.11.4-9.P2.el7.x86_64
--> Processing Dependency: libisc.so.169()(64bit) for package: 32:bind-9.11.4-9.P2.el7.x86_64
--> Processing Dependency: libdns.so.1102()(64bit) for package: 32:bind-9.11.4-9.P2.el7.x86_64
--> Processing Dependency: libbind9.so.160()(64bit) for package: 32:bind-9.11.4-9.P2.el7.x86_64
--> Processing Dependency: libGeoIP.so.1()(64bit) for package: 32:bind-9.11.4-9.P2.el7.x86_64
--> Running transaction check
---> Package GeoIP.x86_64 0:1.5.0-14.el7 will be installed
--> Processing Dependency: geoipupdate for package: GeoIP-1.5.0-14.el7.x86_64
---> Package bind-libs.x86_64 32:9.11.4-9.P2.el7 will be installed
--> Processing Dependency: bind-license = 32:9.11.4-9.P2.el7 for package: 32:bind-libs-9.11.4-9.P2.el7.x86_64
---> Package bind-libs-lite.x86_64 32:9.11.4-9.P2.el7 will be installed
---> Package policycoreutils-python.x86_64 0:2.5-33.el7 will be installed
--> Processing Dependency: setools-libs >= 3.3.8-4 for package: policycoreutils-python-2.5-33.el7.x86_64
--> Processing Dependency: libsemanage-python >= 2.5-14 for package: policycoreutils-python-2.5-33.el7.x86_64
--> Processing Dependency: audit-libs-python >= 2.1.3-4 for package: policycoreutils-python-2.5-33.el7.x86_64
--> Processing Dependency: python-IPy for package: policycoreutils-python-2.5-33.el7.x86_64
--> Processing Dependency: libqpol.so.1(VERS_1.4)(64bit) for package: policycoreutils-python-2.5-33.el7.x86_64
--> Processing Dependency: libqpol.so.1(VERS_1.2)(64bit) for package: policycoreutils-python-2.5-33.el7.x86_64
--> Processing Dependency: libcgroup for package: policycoreutils-python-2.5-33.el7.x86_64
--> Processing Dependency: libapol.so.4(VERS_4.0)(64bit) for package: policycoreutils-python-2.5-33.el7.x86_64
--> Processing Dependency: checkpolicy for package: policycoreutils-python-2.5-33.el7.x86_64
--> Processing Dependency: libqpol.so.1()(64bit) for package: policycoreutils-python-2.5-33.el7.x86_64
--> Processing Dependency: libapol.so.4()(64bit) for package: policycoreutils-python-2.5-33.el7.x86_64
---> Package python-ply.noarch 0:3.4-11.el7 will be installed
--> Running transaction check
---> Package audit-libs-python.x86_64 0:2.8.5-4.el7 will be installed
---> Package bind-license.noarch 32:9.11.4-9.P2.el7 will be installed
---> Package checkpolicy.x86_64 0:2.5-8.el7 will be installed
---> Package geoipupdate.x86_64 0:2.5.0-1.el7 will be installed
---> Package libcgroup.x86_64 0:0.41-21.el7 will be installed
---> Package libsemanage-python.x86_64 0:2.5-14.el7 will be installed
---> Package python-IPy.noarch 0:0.75-6.el7 will be installed
---> Package setools-libs.x86_64 0:3.3.8-4.el7 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
=====================================================================================================================================
Package Arch Version Repository Size
=====================================================================================================================================
Installing:
bind-chroot x86_64 32:9.11.4-9.P2.el7 base 90 k
Installing for dependencies:
GeoIP x86_64 1.5.0-14.el7 base 1.5 M
audit-libs-python x86_64 2.8.5-4.el7 base 77 k
bind x86_64 32:9.11.4-9.P2.el7 base 2.3 M
bind-libs x86_64 32:9.11.4-9.P2.el7 base 154 k
bind-libs-lite x86_64 32:9.11.4-9.P2.el7 base 1.1 M
bind-license noarch 32:9.11.4-9.P2.el7 base 88 k
checkpolicy x86_64 2.5-8.el7 base 295 k
geoipupdate x86_64 2.5.0-1.el7 base 35 k
libcgroup x86_64 0.41-21.el7 base 66 k
libsemanage-python x86_64 2.5-14.el7 base 113 k
policycoreutils-python x86_64 2.5-33.el7 base 457 k
python-IPy noarch 0.75-6.el7 base 32 k
python-ply noarch 3.4-11.el7 base 123 k
setools-libs x86_64 3.3.8-4.el7 base 620 k
Transaction Summary
=====================================================================================================================================
Install 1 Package (+14 Dependent packages)
Total download size: 7.0 M
Installed size: 18 M
Downloading packages:
-------------------------------------------------------------------------------------------------------------------------------------
Total 113 MB/s | 7.0 MB 00:00:00
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Installing : 32:bind-license-9.11.4-9.P2.el7.noarch 1/15
Installing : setools-libs-3.3.8-4.el7.x86_64 2/15
Installing : libcgroup-0.41-21.el7.x86_64 3/15
Installing : audit-libs-python-2.8.5-4.el7.x86_64 4/15
Installing : checkpolicy-2.5-8.el7.x86_64 5/15
Installing : python-IPy-0.75-6.el7.noarch 6/15
Installing : libsemanage-python-2.5-14.el7.x86_64 7/15
Installing : policycoreutils-python-2.5-33.el7.x86_64 8/15
Installing : geoipupdate-2.5.0-1.el7.x86_64 9/15
Installing : GeoIP-1.5.0-14.el7.x86_64 10/15
Installing : 32:bind-libs-lite-9.11.4-9.P2.el7.x86_64 11/15
Installing : 32:bind-libs-9.11.4-9.P2.el7.x86_64 12/15
Installing : python-ply-3.4-11.el7.noarch 13/15
Installing : 32:bind-9.11.4-9.P2.el7.x86_64 14/15
Installing : 32:bind-chroot-9.11.4-9.P2.el7.x86_64 15/15
Verifying : GeoIP-1.5.0-14.el7.x86_64 1/15
Verifying : python-ply-3.4-11.el7.noarch 2/15
Verifying : policycoreutils-python-2.5-33.el7.x86_64 3/15
Verifying : geoipupdate-2.5.0-1.el7.x86_64 4/15
Verifying : 32:bind-chroot-9.11.4-9.P2.el7.x86_64 5/15
Verifying : libsemanage-python-2.5-14.el7.x86_64 6/15
Verifying : 32:bind-license-9.11.4-9.P2.el7.noarch 7/15
Verifying : python-IPy-0.75-6.el7.noarch 8/15
Verifying : checkpolicy-2.5-8.el7.x86_64 9/15
Verifying : 32:bind-libs-9.11.4-9.P2.el7.x86_64 10/15
Verifying : 32:bind-libs-lite-9.11.4-9.P2.el7.x86_64 11/15
Verifying : audit-libs-python-2.8.5-4.el7.x86_64 12/15
Verifying : libcgroup-0.41-21.el7.x86_64 13/15
Verifying : 32:bind-9.11.4-9.P2.el7.x86_64 14/15
Verifying : setools-libs-3.3.8-4.el7.x86_64 15/15
Installed:
bind-chroot.x86_64 32:9.11.4-9.P2.el7
Dependency Installed:
GeoIP.x86_64 0:1.5.0-14.el7 audit-libs-python.x86_64 0:2.8.5-4.el7 bind.x86_64 32:9.11.4-9.P2.el7
bind-libs.x86_64 32:9.11.4-9.P2.el7 bind-libs-lite.x86_64 32:9.11.4-9.P2.el7 bind-license.noarch 32:9.11.4-9.P2.el7
checkpolicy.x86_64 0:2.5-8.el7 geoipupdate.x86_64 0:2.5.0-1.el7 libcgroup.x86_64 0:0.41-21.el7
libsemanage-python.x86_64 0:2.5-14.el7 policycoreutils-python.x86_64 0:2.5-33.el7 python-IPy.noarch 0:0.75-6.el7
python-ply.noarch 0:3.4-11.el7 setools-libs.x86_64 0:3.3.8-4.el7
Complete!
[root@adg19c ~]# rpm -qa|grep bind
bind-license-9.11.4-9.P2.el7.noarch
bind-export-libs-9.11.4-9.P2.el7.x86_64
bind-libs-9.11.4-9.P2.el7.x86_64
bind-9.11.4-9.P2.el7.x86_64
bind-libs-lite-9.11.4-9.P2.el7.x86_64
bind-chroot-9.11.4-9.P2.el7.x86_64
3.25.2. 配置named.conf文件
[root@adg19c named]# cat > /etc/named.conf <<EOF
options {
listen-on port 53 { any; };
listen-on-v6 port 53 { any; };
directory "/var/named";
dump-file "/var/named/data/cache_dump.db";
statistics-file "/var/named/data/named_stats.txt";
memstatistics-file "/var/named/data/named_mem_stats.txt";
recursion yes;
dnssec-enable yes;
dnssec-validation yes;
/* Path to ISC DLV key */
bindkeys-file "/etc/named.root.key";
managed-keys-directory "/var/named/dynamic";
pid-file "/run/named/named.pid";
session-keyfile "/run/named/session.key";
allow-query { any; };
allow-query-cache { any; };
};
logging {
channel default_debug {
file "data/named.run";
severity dynamic;
};
};
zone "." IN {
type hint;
file "named.ca";
};
include "/etc/named.rfc1912.zones";;
include "/etc/named.root.key";
EOF
3.25.3. 配置rfc1912.zone文件
[root@adg19c named]# cat >>/etc/named.rfc1912.zones <<EOF
zone "woo.cn" IN{
type master;
file "woo.cn.zone";
allow-update { none; };
};
zone "84.168.192.in-addr.arpa" IN{
type master;
file "84.168.192.zone";
allow-update { none; };
}
EOF
3.25.4. 编辑正向区域文件
[root@adg19c named]# cat /var/named/woo.cn.zone
$TTL 86400
@ IN SOA dns.woo.cn. root.woo.cn. (
42 ; serial (d,adams)
3H ; refresh
15M ; retry
1W ; expiry
1D) ; minimum
IN NS dns.woo.cn.
cluster-scan IN A 192.168.84.95
cluster-scan IN A 192.168.84.96
cluster-scan IN A 192.168.84.97
dns.woo.cn. IN A 192.168.84.99
3.25.5. 编辑反向区域文件
[root@adg19c named]# cat /var/named/84.168.192.zone
$TTL 86400
@ IN SOA dns.woo.cn. root.woo.cn. (
1997022700 ; Serial
28800 ; Refresh
14400 ; Retry
3600000 ; Expire
86400) ; Minimum
IN NS dns.woo.cn.
95 IN PTR cluster-scan.
96 IN PTR cluster-scan.
97 IN PTR cluster-scan.
3.25.6. 禁用DNS 解析IPv6
[root@adg19c named]# cat >> /etc/sysconfig/named <<EOF
> OPTIONS="-4"
> EOF
3.25.7. RAC各节点配置DNS客户端
[root@ora19crac1 ~]# cat >> /etc/resolv.conf <<EOF
> search woo.cn
> nameserver 192.168.84.99
> EOF
[root@ora19crac2 ~]# cat >> /etc/resolv.conf <<EOF
> search woo.cn
> nameserver 192.168.84.99
> EOF
3.25.8. 验证DNS有效性
[root@ora19crac1 ~]# nslookup cluster-scan.woo.cn
Server: 192.168.84.99
Address: 192.168.84.99#53
Name: cluster-scan.woo.cn
Address: 192.168.84.97
Name: cluster-scan.woo.cn
Address: 192.168.84.96
Name: cluster-scan.woo.cn
Address: 192.168.84.95
[root@ora19crac1 ~]# nslookup cluster-scan.woo.cn
Server: 192.168.84.99
Address: 192.168.84.99#53
Name: cluster-scan.woo.cn
Address: 192.168.84.96
Name: cluster-scan.woo.cn
Address: 192.168.84.97
Name: cluster-scan.woo.cn
Address: 192.168.84.95
3.26. 配置SSH
[root@ora19crac1 ~]# cat >> /etc/ssh/sshd_config <<EOF
UseDNS no
LoginGraceTime 0
TCPKeepAlive yes
EOF
[root@ora19crac1 ~]# systemctl restart sshd
四、 安装集群软件
4.1. 解压grid软件
[root@ ora19crac1 ~]$ su – grid
[grid@ora19crac1 ~]$ ls
LINUX.X64_193000_grid_home.zip
[grid@ora19crac1 ~]$ unzip -q LINUX.X64_193000_grid_home.zip -d $ORACLE_HOME
4.2. 安装CVU
[root@ora19crac1 ~]# export CVUQDISK_GRP=oinstall;
[root@ora19crac1 ~]# rpm -ivh /u01/app/19.3.0/grid/cv/rpm/cvuqdisk-1.0.10-1.rpm
Preparing... ################################# [100%]
Using default group oinstall to install package
Updating / installing...
1:cvuqdisk-1.0.10-1 ################################# [100%]
[root@ora19crac1 ~]# scp /u01/app/19.3.0/grid/cv/rpm/cvuqdisk-1.0.10-1.rpm ora19crac2:~
The authenticity of host 'ora19crac2 (192.168.84.92)' can't be established.
ECDSA key fingerprint is SHA256:uROvAVicwRVvUmvP5M7/PBlCRSaXy6ZsoV1kRhqDPuw.
ECDSA key fingerprint is MD5:04:9a:af:8c:da:5b:bb:3c:8a:31:30:cb:0c:52:2c:6e.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'ora19crac2,192.168.84.92' (ECDSA) to the list of known hosts.
root@ora19crac2's password:
cvuqdisk-1.0.10-1.rpm 100% 11KB 7.8MB/s 00:00
[root@ora19crac1 ~]# export CVUQDISK_GRP=oinstall;
[root@ora19crac2 ~]# rpm -ivh cvuqdisk-1.0.10-1.rpm
Preparing... ################################# [100%]
Using default group oinstall to install package
Updating / installing...
1:cvuqdisk-1.0.10-1 ################################# [100%]
4.3. 配置SSH信任
# grid users:
[root@ora19crac1 ~]# /u01/app/19.3.0/grid/oui/prov/resources/scripts/sshUserSetup.sh -user grid -hosts "ora19crac1 ora19crac2" -advanced exverify
# oracle users:
[root@ora19crac1 ~]# /u01/app/19.3.0/grid/oui/prov/resources/scripts/sshUserSetup.sh -user oracle -hosts "ora19crac1 ora19crac2" -advanced exverify -confirm
4.4. 验证SSH有效性
# ora19crac1
[root@ora19crac1 ~]# su - oracle
Last login: Fri Feb 28 18:57:27 CST 2020 on pts/1
[oracle@ora19crac1 ~]$ ssh ora19crac2 date
Sat Feb 29 19:58:14 CST 2020
[oracle@ora19crac1 ~]$ exit
Logout
[root@ora19crac1 ~]# su - grid
Last login: Sat Feb 29 19:57:48 CST 2020 on pts/0
[grid@ora19crac1 ~]$ ssh ora19crac2 date
Sat Feb 29 19:58:21 CST 2020
# ora19crac2
[root@ora19crac2 ~]# su - oracle
Last login: Fri Feb 28 18:50:26 CST 2020 on pts/0
[oracle@ora19crac2 ~]$ ssh ora19crac1 date
Sat Feb 29 19:59:02 CST 2020
[oracle@ora19crac2 ~]$ exit
Logout
[root@ora19crac2 ~]# su - grid
Last login: Fri Feb 28 18:50:06 CST 2020 on pts/0
[grid@ora19crac2 ~]$
[grid@ora19crac2 ~]$ ssh ora19crac1 date
Sat Feb 29 19:59:12 CST 2020
4.5. 安装前环境检查GI
[grid@ora19crac1 ~]$ $ORACLE_HOME/runcluvfy.sh stage -pre crsinst -n "ora19crac1,ora19crac2" -fixup -verbose
……
PRVF-5636 : The DNS response time for an unreachable node exceeded "15000" ms on following nodes: ora11grac2,ora11grac1
File "/etc/resolv.conf" is not consistent across nodes
Check: Time zone consistency
Result: Time zone consistency check passed
Fixup information has been generated for following node(s):
ora11grac1,ora11grac2
Please run the following script on each node as "root" user to execute the fixups:
'/tmp/CVU_19.0.0_grid/runfixup.sh'
Pre-check for cluster services setup was unsuccessful on all the nodes.
4.6. 根据提示修复检查的问题
[grid@ora19crac1 ~]$ /tmp/CVU_11.2.0.4.0_grid/runfixup.sh
Response file being used is :/tmp/CVU_11.2.0.4.0_grid/fixup.response
Enable file being used is :/tmp/CVU_11.2.0.4.0_grid/fixup.enable
Log file location: /tmp/CVU_11.2.0.4.0_grid/orarun.log
uid=510(grid) gid=501(oinstall) groups=501(oinstall),502(dba),503(asmadmin),504(asmdba),505(asmoper)
4.7. 开始安装GI
[grid@ora19crac1 ~]$ cd $ORACLE_HOME
[grid@ora19crac1 grid]$ gridSetup.sh
4.8. 节点一 执行root脚本
[root@ora19crac1 ~]# /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.
Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.
[root@ora19crac1 ~]# /u01/app/19.3.0/grid/root.sh
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /u01/app/19.3.0/grid
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/19.3.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
/u01/app/grid/crsdata/ora19crac1/crsconfig/rootcrs_ora19crac1_2020-03-01_00-27-15AM.log
2020/03/01 00:27:27 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2020/03/01 00:27:27 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2020/03/01 00:27:27 CLSRSC-363: User ignored prerequisites during installation
2020/03/01 00:27:27 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2020/03/01 00:27:32 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2020/03/01 00:27:33 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.
2020/03/01 00:27:33 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.
2020/03/01 00:27:34 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.
2020/03/01 00:28:11 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.
2020/03/01 00:28:12 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2020/03/01 00:28:16 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2020/03/01 00:28:31 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2020/03/01 00:28:31 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2020/03/01 00:28:37 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2020/03/01 00:28:37 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2020/03/01 00:30:02 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2020/03/01 00:31:08 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2020/03/01 00:32:18 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2020/03/01 00:32:24 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
[INFO] [DBT-30161] Disk label(s) created successfully. Check /u01/app/grid/cfgtoollogs/asmca/asmca-200301AM123258.log for details.
2020/03/01 00:39:40 CLSRSC-482: Running command: '/u01/app/19.3.0/grid/bin/ocrconfig -upgrade grid oinstall'
CRS-4256: Updating the profile
Successful addition of voting disk cbcea46f7b764fccbfd884da8c453995.
Successful addition of voting disk e8c22109d62c4fb9bfd3f3e3e36413c8.
Successful addition of voting disk 67f8dc6671954fe9bf7b802eeb63f8ca.
Successfully replaced voting disk group with +OCR_VOT_GP1.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE cbcea46f7b764fccbfd884da8c453995 (AFD:OCR_VOT_GP11) [OCR_VOT_GP1]
2. ONLINE e8c22109d62c4fb9bfd3f3e3e36413c8 (AFD:OCR_VOT_GP12) [OCR_VOT_GP1]
3. ONLINE 67f8dc6671954fe9bf7b802eeb63f8ca (AFD:OCR_VOT_GP13) [OCR_VOT_GP1]
Located 3 voting disk(s).
2020/03/01 00:41:33 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
2020/03/01 00:47:10 CLSRSC-343: Successfully started Oracle Clusterware stack
2020/03/01 00:47:10 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
2020/03/01 01:11:14 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2020/03/01 01:12:47 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
4.9. 节点二执行root脚本
[root@ora19crac2 ~]# /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.
Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.
[root@ora19crac1 ~]# /u01/app/19.3.0/grid/root.sh
[root@ora19crac2 ~]# /u01/app/19.3.0/grid/root.sh
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /u01/app/19.3.0/grid
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/19.3.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
/u01/app/grid/crsdata/ora19crac2/crsconfig/rootcrs_ora19crac2_2020-03-01_01-17-59AM.log
2020/03/01 01:18:05 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2020/03/01 01:18:05 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2020/03/01 01:18:05 CLSRSC-363: User ignored prerequisites during installation
2020/03/01 01:18:05 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2020/03/01 01:18:08 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2020/03/01 01:18:08 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.
2020/03/01 01:18:08 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.
2020/03/01 01:18:09 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.
2020/03/01 01:18:12 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.
2020/03/01 01:18:12 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2020/03/01 01:18:23 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2020/03/01 01:18:24 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2020/03/01 01:18:27 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2020/03/01 01:18:28 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2020/03/01 01:18:44 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2020/03/01 01:19:54 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2020/03/01 01:20:57 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2020/03/01 01:22:23 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2020/03/01 01:22:25 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
2020/03/01 01:22:36 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
2020/03/01 01:23:45 CLSRSC-343: Successfully started Oracle Clusterware stack
2020/03/01 01:23:45 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
2020/03/01 01:24:21 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2020/03/01 01:25:03 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
Error 4 opening dom ASM/Self in 0xb2ac810
Domain name to open is ASM/Self
Error 4 opening dom ASM/Self in 0xb2ac810
4.10. 创建ASM磁盘组
五、 安装数据库软件
5.1. 解压 DB
[root@ora19crac1 grid]# su - oracle
Last login: Fri Feb 28 18:46:58 CST 2020 on pts/0
[oracle@ora19crac1 ~]$ ls
LINUX.X64_193000_db_home.zip
[oracle@ora19crac1 ~]$ unzip -q LINUX.X64_193000_db_home.zip -d $ORACLE_HOME
checkdir: cannot create extraction directory: /u01/app/oracle//product/19.3.0/dbhome_1
No such file or directory
[oracle@ora19crac2 ~]$ mkdir -p /u01/app/oracle//product/19.3.0/dbhome_1
[oracle@ora19crac1 ~]$ unzip -q LINUX.X64_193000_db_home.zip -d $ORACLE_HOME
5.2. 安装数据库
[oracle@ora19crac1 ~]$ cd $ORACLE_HOME/
[oracle@ora19crac1 dbhome_1]$ ./runInstaller
5.3. 执行root.sh脚本
[root@ora19crac1 ~]# /u01/app/oracle/product/19.3.0/dbhome_1/root.sh
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/app/oracle/product/19.3.0/dbhome_1
Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
[root@ora19crac2 ~]# /u01/app/oracle/product/19.3.0/dbhome_1/root.sh
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/app/oracle/product/19.3.0/dbhome_1
Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
六、 创建数据库
七、 完成安装
7.1. 检查集群状态
[grid@ora19crac1 ~]$ crsctl status res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE ora19crac1 STABLE
ONLINE ONLINE ora19crac2 STABLE
ora.chad
ONLINE ONLINE ora19crac1 STABLE
ONLINE ONLINE ora19crac2 STABLE
ora.net1.network
ONLINE ONLINE ora19crac1 STABLE
ONLINE ONLINE ora19crac2 STABLE
ora.ons
ONLINE ONLINE ora19crac1 STABLE
ONLINE ONLINE ora19crac2 STABLE
ora.proxy_advm
OFFLINE OFFLINE ora19crac1 STABLE
OFFLINE OFFLINE ora19crac2 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
3 ONLINE OFFLINE STABLE
ora.DATA_GP01.dg(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
3 OFFLINE OFFLINE STABLE
ora.FRA_GP01.dg(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
3 OFFLINE OFFLINE STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE ora19crac1 STABLE
ora.OCR_VOT_GP1.dg(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
3 OFFLINE OFFLINE STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 Started,STABLE
2 ONLINE ONLINE ora19crac2 Started,STABLE
3 OFFLINE OFFLINE STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
3 OFFLINE OFFLINE STABLE
ora.cvu
1 ONLINE ONLINE ora19crac1 STABLE
ora.ora19crac1.vip
1 ONLINE ONLINE ora19crac1 STABLE
ora.ora19crac2.vip
1 ONLINE ONLINE ora19crac2 STABLE
ora.qosmserver
1 ONLINE ONLINE ora19crac1 STABLE
ora.scan1.vip
1 ONLINE ONLINE ora19crac1 STABLE
ora.woo.db
1 ONLINE ONLINE ora19crac1 Open,HOME=/u01/app/o
racle/product/19.3.0
/dbhome_1,STABLE
2 ONLINE ONLINE ora19crac2 Open,HOME=/u01/app/o
racle/product/19.3.0
/dbhome_1,STABLE
--------------------------------------------------------------------------------