ODA X7-2 HA19.7默认安装行为

郑全 · 发表于 2020-7-1 21:27:11

1.操作系统版本
  [root@ythpt2 bin]# cat /etc/oracle-release
Oracle Linux Server release 7.8

2.关闭了防火墙
[root@ythpt2 bin]# systemctl status firewalld.service
● firewalld.service - firewalld - dynamic firewall daemon
Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled; vendor preset: enabled)
Active: inactive (dead)
   Docs: man:firewalld(1)

3.关闭了SELINUX
  [root@ythpt2 bin]# cat /etc/selinux/config |grep '^SELINUX='
SELINUX=disabled
[root@ythpt2 bin]# getenforce
Disabled

4.默认没有开NTP
  [root@ythpt2 bin]# systemctl status chronyd
● chronyd.service - NTP client/server
Loaded: loaded (/usr/lib/systemd/system/chronyd.service; disabled; vendor preset: enabled)
Active: inactive (dead)
   Docs: man:chronyd(8)
         man:chrony.conf(5)
Jul 01 18:51:09 oak1 systemd[1]: Starting NTP client/server...
Jul 01 18:51:09 oak1 chronyd[2314]: chronyd version 3.4 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +...+DEBUG)
Jul 01 18:51:09 oak1 chronyd[2314]: Could not open IPv6 command socket : Address family not supported by protocol
Jul 01 18:51:09 oak1 chronyd[2314]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift
Jul 01 18:51:09 oak1 systemd[1]: Started NTP client/server.
Jul 01 19:54:26 ythpt2 chronyd[2314]: chronyd exiting
Jul 01 19:54:26 ythpt2 systemd[1]: Stopping NTP client/server...
Jul 01 19:54:26 ythpt2 systemd[1]: Stopped NTP client/server.
Hint: Some lines were ellipsized, use -l to show in full.
[root@ythpt2 bin]#

  但这个可以在WEB界面配置

5.关闭了透明大页
  [root@ythpt2 bin]# cat /sys/kernel/mm/transparent_hugepage/enabled
always madvise [never]

6.没有单独配置MGMT库
  [root@ythpt2 bin]# ./crsctl stat res -t
--------------------------------------------------------------------------------
Name          Target  State       Server                State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA.COMMONSTORE.advm
            ONLINE  ONLINE    ythpt1                STABLE
            ONLINE  ONLINE    ythpt2                STABLE
ora.LISTENER.lsnr
            ONLINE  ONLINE    ythpt1                STABLE
            ONLINE  ONLINE    ythpt2                STABLE
ora.chad
            ONLINE  ONLINE    ythpt1                STABLE
            ONLINE  ONLINE    ythpt2                STABLE
ora.data.commonstore.acfs
            ONLINE  ONLINE    ythpt1                mounted on /opt/orac
                                                         le/dcs/commonstore,S
                                                         TABLE
            ONLINE  ONLINE    ythpt2                mounted on /opt/orac
                                                         le/dcs/commonstore,S
                                                         TABLE
ora.net1.network
            ONLINE  ONLINE    ythpt1                STABLE
            ONLINE  ONLINE    ythpt2                STABLE
ora.ons
            ONLINE  ONLINE    ythpt1                STABLE
            ONLINE  ONLINE    ythpt2                STABLE
ora.proxy_advm
            ONLINE  ONLINE    ythpt1                STABLE
            ONLINE  ONLINE    ythpt2                STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
   1       ONLINE  ONLINE    ythpt1                STABLE
   2       ONLINE  ONLINE    ythpt2                STABLE
ora.DATA.dg(ora.asmgroup)
   1       ONLINE  ONLINE    ythpt1                STABLE
   2       ONLINE  ONLINE    ythpt2                STABLE
ora.LISTENER_SCAN1.lsnr
   1       ONLINE  ONLINE    ythpt2                STABLE
ora.RECO.dg(ora.asmgroup)
   1       ONLINE  ONLINE    ythpt1                STABLE
   2       ONLINE  ONLINE    ythpt2                STABLE
ora.REDO.dg(ora.asmgroup)
   1       ONLINE  ONLINE    ythpt1                STABLE
   2       ONLINE  ONLINE    ythpt2                STABLE
ora.asm(ora.asmgroup)
   1       ONLINE  ONLINE    ythpt1                Started,STABLE
   2       ONLINE  ONLINE    ythpt2                Started,STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
   1       ONLINE  ONLINE    ythpt1                STABLE
   2       ONLINE  ONLINE    ythpt2                STABLE
ora.cvu
   1       ONLINE  ONLINE    ythpt2                STABLE
ora.qosmserver
   1       ONLINE  ONLINE    ythpt2                STABLE
ora.scan1.vip
   1       ONLINE  ONLINE    ythpt2                STABLE
ora.ythpt1.vip
   1       ONLINE  ONLINE    ythpt1                STABLE
ora.ythpt2.vip
   1       ONLINE  ONLINE    ythpt2                STABLE
ora.ythptdb.db
   1       ONLINE  ONLINE    ythpt1                Open,HOME=/u01/app/o
                                                         racle/product/19.0.0
                                                         .0/dbhome_1,STABLE
   2       ONLINE  ONLINE    ythpt2                Open,HOME=/u01/app/o
                                                         racle/product/19.0.0
                                                         .0/dbhome_1,STABLE
--------------------------------------------------------------------------------

7.系统内核参数
  [root@ythpt2 bin]# cat /etc/sysctl.conf
# sysctl settings are defined through files in
# /usr/lib/sysctl.d/, /run/sysctl.d/, and /etc/sysctl.d/.
#
# Vendors settings live in /usr/lib/sysctl.d/.
# To override a whole file, create a new file with the same in
# /etc/sysctl.d/ and put new settings there. To override
# only specific settings, add a file with a lexically later
# name in /etc/sysctl.d/ and put new settings there.
#
# For more information, see sysctl.conf(5) and sysctl.d(5).
# oracle-rdbms-server-12cR1-preinstall setting for fs.file-max is 6815744
fs.file-max = 6815744
# oracle-rdbms-server-12cR1-preinstall setting for kernel.sem is '250 32000 100 128'
kernel.sem = 250 32000 100 128
# oracle-rdbms-server-12cR1-preinstall setting for kernel.shmmni is 4096
kernel.shmmni = 4096
# oracle-rdbms-server-12cR1-preinstall setting for kernel.shmall is 1073741824 on x86_64
kernel.shmall = 1073741824
# oracle-rdbms-server-12cR1-preinstall setting for kernel.shmmax is 4398046511104 on x86_64
kernel.shmmax = 4398046511104
# oracle-rdbms-server-12cR1-preinstall setting for kernel.panic_on_oops is 1 per Orabug 19212317
kernel.panic_on_oops = 1
# oracle-rdbms-server-12cR1-preinstall setting for net.core.rmem_default is 262144
net.core.rmem_default = 262144

# oracle-rdbms-server-12cR1-preinstall setting for net.core.wmem_default is 262144
net.core.wmem_default = 262144

# oracle-rdbms-server-12cR1-preinstall setting for net.ipv4.conf.all.rp_filter is 2
net.ipv4.conf.all.rp_filter = 2
# oracle-rdbms-server-12cR1-preinstall setting for net.ipv4.conf.default.rp_filter=2
net.ipv4.conf.default.rp_filter=2
# oracle-rdbms-server-12cR1-preinstall setting for fs.aio-max-nr is 1048576
fs.aio-max-nr = 1048576
# oracle-rdbms-server-12cR1-preinstall setting for net.ipv4.ip_local_port_range is 9000 65500
net.ipv4.ip_local_port_range = 9000 65500
fs.suid_dumpable=1
kernel.core_pattern=core.%e.%p
net.ipv4.conf.all.arp_announce=2
net.ipv4.conf.all.arp_ignore=1
net.ipv4.conf.all.arp_filter=1
net.core.rmem_max=134217728
net.core.wmem_max=134217728
net.ipv4.tcp_rmem=4096 87380 134217728
net.ipv4.tcp_wmem=4096 65536 134217728
net.core.netdev_max_backlog=300000
net.ipv4.tcp_moderate_rcvbuf=1
net.ipv6.conf.all.disable_ipv6 = 1
net.ipv6.conf.default.disable_ipv6 = 1
# Added by ODA Development. Do not Remove fix_control=19265077
vm.nr_hugepages=101231
vm.min_free_kbytes=524288
net.ipv4.conf.all.accept_redirects = 0
net.ipv4.conf.default.accept_redirects = 0
kernel.pid_max = 99999
[root@ythpt2 bin]#

8.系统限制
[root@ythpt2 bin]# cat /etc/security/limits.conf

grid soft nofile 131072
grid soft nproc 131072
grid hard nofile 131072
grid hard nproc 131072
grid soft core unlimited
grid hard core unlimited
grid soft memlock 295995207
grid hard memlock 295995207
oracle soft nofile 131072
oracle soft nproc 131072
oracle hard nofile 131072
oracle hard nproc 131072
oracle soft core unlimited
oracle hard core unlimited
oracle soft memlock 295995207
oracle hard memlock 295995207
oracle soft stack 10240
oracle hard stack 32768
root soft memlock unlimited
root hard memlock unlimited
[root@ythpt2 bin]#

9.开启了大页内存
[root@ythpt2 bin]# cat /proc/meminfo |grep '^HugePages'
HugePages_Total: 101231
HugePages_Free: 84891
HugePages_Rsvd:    46
HugePages_Surp:       0
[root@ythpt2 bin]#

10.oratab里面没有写入内容
  [root@ythpt2 bin]# cat /etc/oratab
#

# This file is used by ORACLE utilities.  It is created by root.sh
# and updated by either Database Configuration Assistant while creating
# a database or ASM Configuration Assistant while creating ASM instance.
# A colon, ':', is used as the field terminator.  A new line terminates
# the entry.  Lines beginning with a pound sign, '#', are comments.
#
# Entries are of the form:
# $ORACLE_SID:$ORACLE_HOME:<N|Y>:
#
# The first and second fields are the system identifier and home
# directory of the database respectively.  The third field indicates
# to the dbstart utility that the database should , "Y", or should not,
# "N", be brought up at system boot time.
#
# Multiple entries with the same $ORACLE_SID are not allowed.
#
#
[root@ythpt2 bin]#
没有任何内容

11.ORACLE用户没有设置用户环境变量
[root@ythpt2 bin]# su - oracle
Last login: Wed Jul  1 20:57:34 CST 2020
[oracle@ythpt2 ~]$ cat .bash_profile
# .bash_profile
# Get the aliases and functions
if [ -f ~/.bashrc ]; then
      . ~/.bashrc
fi
# User specific environment and startup programs
PATH=$PATH:$HOME/.local/bin:$HOME/bin
export PATH
umask 022
[oracle@ythpt2 ~]$

[oracle@ythpt1 ~]$ cat .bash_profile
# .bash_profile
# Get the aliases and functions
if [ -f ~/.bashrc ]; then
      . ~/.bashrc
fi
# User specific environment and startup programs
PATH=$PATH:$HOME/.local/bin:$HOME/bin
export PATH
umask 022
[oracle@ythpt1 ~]$ cat .bashrc
# .bashrc
# Source global definitions
if [ -f /etc/bashrc ]; then
      . /etc/bashrc
fi
# Uncomment the following line if you don't like systemctl's auto-paging feature:
# export SYSTEMD_PAGER=
# User specific aliases and functions
[oracle@ythpt1 ~]$ echo $ORACLE_SID
[oracle@ythpt1 ~]$

  数据库用户没有设置对应的环境变量，需要手工去添加

12.grid用户环境变量设置情况是在 .bashrc里面设置的

[root@oak0 tmp]# su - grid
Last login: Wed Jul  1 21:16:52 CST 2020 on pts/0
[grid@ythpt1 ~]$ ls -al
total 44
drwx------  6 grid oinstall 4096 Jul  1 20:44 .
drwxr-xr-x. 4 root root    4096 Jul  1 19:54 ..
-rw-------  1 grid oinstall  722 Jul  1 21:18 .bash_history
-rw-r--r--  1 grid oinstall 18 Nov 22  2019 .bash_logout
-rw-r--r--  1 grid oinstall  203 Jul  1 19:54 .bash_profile
-rw-r--r--  1 grid oinstall  443 Jul  1 20:20 .bashrc
drwxr-xr-x  3 grid oinstall 4096 Jul  1 20:07 .cache
drwxr-xr-x  3 grid oinstall 4096 Jul  1 20:07 .config
-rw-r--r--  1 grid oinstall  172 Apr  1 17:51 .kshrc
drwxr-xr-x  2 grid oinstall 4096 Jul  1 19:54 perl5
drwxr-xr-x  2 grid oinstall 4096 Jul  1 20:57 .ssh
[grid@ythpt1 ~]$ cat .bash_profile
# .bash_profile
# Get the aliases and functions
if [ -f ~/.bashrc ]; then
      . ~/.bashrc
fi
# User specific environment and startup programs
PATH=$PATH:$HOME/.local/bin:$HOME/bin
export PATH
umask 022
[grid@ythpt1 ~]$
[grid@ythpt1 ~]$
[grid@ythpt1 ~]$ cat .bashrc
# .bashrc
# Source global definitions
if [ -f /etc/bashrc ]; then
      . /etc/bashrc
fi
# Uncomment the following line if you don't like systemctl's auto-paging feature:
# export SYSTEMD_PAGER=
# User specific aliases and functions
ORACLE_HOME=/u01/app/19.0.0.0/grid; export ORACLE_HOME
PATH=$PATH:/u01/app/19.0.0.0/grid/bin; export PATH
LD_LIBRARY_PATH=/u01/app/19.0.0.0/grid/lib; export LD_LIBRARY_PATH
ORACLE_SID=+ASM1; export ORACLE_SID

13.磁盘组情况
SQL> select name,total_mb,free_mb,TYPE from v$asm_diskgroup;
NAME                            TOTAL_MB FREE_MB TYPE
------------------------------ ---------- ---------- ------
DATA                            12209920 12187976 HIGH
RECO                            3051520 3050152 HIGH
REDO                            3051520 2952532 HIGH

SQL> select name from v$datafile;
NAME
--------------------------------------------------------------------------------
+DATA/YTHPTDB/DATAFILE/system.261.1044650869
+DATA/YTHPTDB/DATAFILE/users.267.1044651359
+DATA/YTHPTDB/DATAFILE/sysaux.262.1044650893
+DATA/YTHPTDB/DATAFILE/undotbs1.263.1044650909
+DATA/YTHPTDB/DATAFILE/undotbs2.265.1044651017
SQL> select name from v$controlfile;
NAME
--------------------------------------------------------------------------------
+REDO/YTHPTDB/CONTROLFILE/current.256.1044650967
SQL> select member from v$logfile;
MEMBER
--------------------------------------------------------------------------------
+REDO/YTHPTDB/ONLINELOG/group_2.258.1044650969
+REDO/YTHPTDB/ONLINELOG/group_1.257.1044650969
+REDO/YTHPTDB/ONLINELOG/group_3.259.1044651115
+REDO/YTHPTDB/ONLINELOG/group_4.260.1044651119
SQL> archive log list;
Database log mode             Archive Mode
Automatic archival          Enabled
Archive destination          USE_DB_RECOVERY_FILE_DEST
Oldest online log sequence    1
Next log sequence to archive 2
Current log sequence          2
SQL> show parameter reco
NAME                               TYPE       VALUE
------------------------------------ ----------- ------------------------------
control_file_record_keep_time       integer    7
db_recovery_file_dest             string    +RECO
db_recovery_file_dest_size          big integer 200G
db_unrecoverable_scn_tracking       boolean    TRUE
recovery_parallelism                integer    0
remote_recovery_file_dest          string
SQL>

数据文件在 DATA
联机日志文件，控制文件在 REDO
快速恢复区在: RECO

郑全 · 发表于 2020-7-1 21:33:14

14.做了磁盘多路劲绑定
[root@oak0 tmp]# multipath -ll
SSD_E0_S22_2181088020 (35000cca08200c314) dm-11 HGST ,HBCAC2DH4SUN800G
size=745G features='0' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
  |- 1:0:7:0  sdj          8:144 active ready running
  `- 10:0:7:0 sds          65:32 active ready running
SSD_E0_S20_2181087984 (35000cca08200c2f0) dm-9 HGST ,HBCAC2DH4SUN800G
size=745G features='0' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
  |- 1:0:5:0  sdh          8:112 active ready running
  `- 10:0:5:0 sdq          65:0  active ready running
SSD_E0_S01_2348927716 (35000cca08c01cae4) dm-5 HGST ,HBCAC2DH2SUN3.2T
size=2.9T features='0' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
  |- 1:0:1:0  sdd          8:48  active ready running
  `- 10:0:1:0 sdm          8:192 active ready running
SSD_E0_S23_2181084636 (35000cca08200b5dc) dm-12 HGST ,HBCAC2DH4SUN800G
size=745G features='0' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
  |- 1:0:8:0  sdk          8:160 active ready running
  `- 10:0:8:0 sdt          65:48 active ready running
SSD_E0_S03_2348914256 (35000cca08c019650) dm-7 HGST ,HBCAC2DH2SUN3.2T
size=2.9T features='0' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
  |- 1:0:3:0  sdf          8:80  active ready running
  `- 10:0:3:0 sdo          8:224 active ready running
SSD_E0_S04_2348920060 (35000cca08c01acfc) dm-8 HGST ,HBCAC2DH2SUN3.2T
size=2.9T features='0' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
  |- 1:0:4:0  sdg          8:96  active ready running
  `- 10:0:4:0 sdp          8:240 active ready running
SSD_E0_S00_2348929460 (35000cca08c01d1b4) dm-4 HGST ,HBCAC2DH2SUN3.2T
size=2.9T features='0' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
  |- 1:0:0:0  sdc          8:32  active ready running
  `- 10:0:0:0 sdl          8:176 active ready running
SSD_E0_S02_2348930656 (35000cca08c01d660) dm-6 HGST ,HBCAC2DH2SUN3.2T
size=2.9T features='0' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
  |- 1:0:2:0  sde          8:64  active ready running
  `- 10:0:2:0 sdn          8:208 active ready running
SSD_E0_S21_2181088872 (35000cca08200c668) dm-10 HGST ,HBCAC2DH4SUN800G
size=745G features='0' hwhandler='0' wp=rw
`-+- policy='service-time 0' prio=1 status=active
  |- 1:0:6:0  sdi          8:128 active ready running
  `- 10:0:6:0 sdr          65:16 active ready running
Jul 01 21:29:24 | multipath device maps are present, but 'multipathd' service is not running
Jul 01 21:29:24 | IO failover/failback will not work without 'multipathd' service running

15.用了网卡绑定，但没有用 NetworkManager

[root@oak0 tmp]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
   valid_lft forever preferred_lft forever
2: em2: <NO-CARRIER,BROADCAST,MULTICAST,SLAVE,UP> mtu 1500 qdisc mq master btbond1 state DOWN group default qlen 1000
link/ether 00:10:e0:d8:34:35 brd ff:ff:ff:ff:ff:ff
3: em3: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master btbond1 state UP group default qlen 1000
link/ether 00:10:e0:d8:34:35 brd ff:ff:ff:ff:ff:ff
4: p1p1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master icbond0 state UP group default qlen 1000
link/ether 00:0a:f7:ce:32:00 brd ff:ff:ff:ff:ff:ff
5: p1p2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master icbond0 state UP group default qlen 1000
link/ether 00:0a:f7:ce:32:00 brd ff:ff:ff:ff:ff:ff
6: em1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
link/ether 00:10:e0:d8:34:34 brd ff:ff:ff:ff:ff:ff
7: bond0: <BROADCAST,MULTICAST,MASTER> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether 36:aa:69:68:a8:be brd ff:ff:ff:ff:ff:ff
8: btbond1: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 00:10:e0:d8:34:35 brd ff:ff:ff:ff:ff:ff
inet 192.168.1.26/24 brd 192.168.1.255 scope global btbond1
   valid_lft forever preferred_lft forever
inet 192.168.1.28/24 brd 192.168.1.255 scope global secondary btbond1:1
   valid_lft forever preferred_lft forever
9: icbond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether 00:0a:f7:ce:32:00 brd ff:ff:ff:ff:ff:ff
inet 192.168.16.24/24 brd 192.168.16.255 scope global icbond0
   valid_lft forever preferred_lft forever
10: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
link/ether 52:54:00:5e:da:d3 brd ff:ff:ff:ff:ff:ff
inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
   valid_lft forever preferred_lft forever
11: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN group default qlen 1000
link/ether 52:54:00:5e:da:d3 brd ff:ff:ff:ff:ff:ff
[root@oak0 tmp]# nmcli con
NAME UUID                               TYPE DEVICE
virbr0  7aeb57f6-67bf-4b0b-98b4-64bd0c19a326  bridge  virbr0

郑全 · 发表于 2020-7-1 21:38:40

郑全发表于 2020-7-1 21:33
14.做了磁盘多路劲绑定
[root@oak0 tmp]# multipath -ll
SSD_E0_S22_2181088020 (35000cca08200c314) ...

15.默认的路径
GI的ORACLE_HOME
/u01/app/19.0.0.0/grid

GI的ORACLE_BASE
/u01/app/grid

DB 的ORACLE_BASE
/u01/app/oracle

DB的ORACLE_HOME
/u01/app/oracle/product/19.0.0.0/dbhome_1

帐号		自动登录	找回密码
密码			注册

[Oracle] ODA X7-2 HA19.7默认安装行为