Redhat7.3下重新配置节点2信息，集群依旧起不来

jiawang

报错信息：
[root@db2 install]# ./roothas.pl -deconfig -force -verbose
Can't locate Env.pm in @INC (@INC contains: /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 . .) at crsconfig_lib.pm line 710.
BEGIN failed--compilation aborted at crsconfig_lib.pm line 710.
Compilation failed in require at ./roothas.pl line 171.
BEGIN failed--compilation aborted at ./roothas.pl line 171.


解决办法：从节点1拷贝一份
[root@db1 ~]# cp /u01/app/11.2.0/grid/perl/lib/5.10.0/Env.pm /usr/lib64/perl5/vendor_perl/

在执行
[root@db2 install]# ./roothas.pl -deconfig -force -verbose
Using configuration parameter file: ./crsconfig_params
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Stop failed, or completed with errors.
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Delete failed, or completed with errors.
CRS-4544: Unable to connect to OHAS
CRS-4000: Command Stop failed, or completed with errors.
ACFS-9459: ADVM/ACFS is not supported on this OS version: '3.10.0-514.el7.x86_64'
Unable to uninstall ADVM/ACFS
[root@db2 install]#
重新执行root.sh脚本
[root@db2 ~]# /u01/app/11.2.0/grid/root.sh
Performing root user operation for Oracle 11g

The following environment variables are set as:
    ORACLE_OWNER= grid
    ORACLE_HOME=  /u01/app/11.2.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:

The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.

Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
User ignored Prerequisites during installation
Installing Trace File Analyzer

Configure Oracle Grid Infrastructure for a Cluster ... succeeded

但是集群依旧起不来
[grid@db2 ~]$ crsctl stat res -t -init
CRS-4639: Could not contact Oracle High Availability Services
CRS-4000: Command Status failed, or completed with errors.
[grid@db2 ~]$ crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon.


报错日志：
[grid@db2 ~]$ tail -200 $ORACLE_HOME/log/db2/crsd/crsd.log
2018-12-05 09:50:41.342: [UiServer][3785279232]{2:44864:161} Done for ctx=0x7f9ddc055200
2018-12-05 09:50:41.375: [UiServer][3783177984] CS(0x7f9df0198fe0)set Properties ( oracle,0x7f9df4181de0)
2018-12-05 09:50:41.386: [UiServer][3785279232]{2:44864:162} Sending message to PE. ctx= 0x7f9ddc055200, Client PID: 7294
2018-12-05 09:50:41.392: [UiServer][3785279232]{2:44864:162} Done for ctx=0x7f9ddc055200
2018-12-05 09:50:41.643: [UiServer][3783177984] CS(0x7f9df0198fe0)set Properties ( oracle,0x7f9df4181de0)
2018-12-05 09:50:41.654: [UiServer][3785279232]{2:44864:163} Sending message to PE. ctx= 0x7f9ddc055220, Client PID: 7230
2018-12-05 09:50:41.660: [UiServer][3785279232]{2:44864:163} Done for ctx=0x7f9ddc055220
2018-12-05 09:50:41.677: [UiServer][3783177984] CS(0x7f9df0198fe0)set Properties ( oracle,0x7f9df4181de0)
2018-12-05 09:50:41.688: [UiServer][3785279232]{2:44864:164} Sending message to PE. ctx= 0x7f9ddc055820, Client PID: 7230
2018-12-05 09:50:41.693: [UiServer][3785279232]{2:44864:164} Done for ctx=0x7f9ddc055820
2018-12-05 09:50:46.709: [    AGFW][3797886720]{0:7:3} Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:47
2018-12-05 09:50:46.709: [    AGFW][3797886720]{0:7:3} Verifying msg rid = ora.orcl.db 2 1
2018-12-05 09:50:46.709: [    AGFW][3797886720]{0:7:3} Received state LABEL change for ora.orcl.db 2 1 [old label  = Dismounted,Mount Initiated, new label = Mounted (Closed)]
2018-12-05 09:50:46.709: [    AGFW][3797886720]{0:7:3} Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Invalid|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:638:Ver:2]
2018-12-05 09:50:46.709: [    AGFW][3797886720]{0:7:3} Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:47
2018-12-05 09:50:46.716: [    AGFW][3797886720]{0:7:3} Agfw Proxy Server received the message: CMD_COMPLETED[Proxy] ID 20482:1999
2018-12-05 09:50:46.716: [    AGFW][3797886720]{0:7:3} Agfw Proxy Server replying to the message: CMD_COMPLETED[Proxy] ID 20482:1999
2018-12-05 09:50:46.728: [    AGFW][3797886720]{0:7:3} Agfw received reply from PE for resource state change for ora.orcl.db 2 1
2018-12-05 09:51:04.732: [    AGFW][3797886720]{0:7:4} Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:102
2018-12-05 09:51:04.732: [    AGFW][3797886720]{0:7:4} Verifying msg rid = ora.orcl.db 2 1
2018-12-05 09:51:04.732: [    AGFW][3797886720]{0:7:4} Received state LABEL change for ora.orcl.db 2 1 [old label  = Mounted (Closed), new label = Mounted (Closed),Open Initiated]
2018-12-05 09:51:04.732: [    AGFW][3797886720]{0:7:4} Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Invalid|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:646:Ver:2]
2018-12-05 09:51:04.733: [    AGFW][3797886720]{0:7:4} Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:102
2018-12-05 09:51:04.746: [    AGFW][3797886720]{0:7:4} Agfw Proxy Server received the message: CMD_COMPLETED[Proxy] ID 20482:2017
2018-12-05 09:51:04.747: [    AGFW][3797886720]{0:7:4} Agfw Proxy Server replying to the message: CMD_COMPLETED[Proxy] ID 20482:2017
2018-12-05 09:51:04.747: [    AGFW][3797886720]{0:7:4} Agfw received reply from PE for resource state change for ora.orcl.db 2 1
2018-12-05 09:51:13.876: [    AGFW][3797886720]{0:7:7} Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:132
2018-12-05 09:51:13.876: [    AGFW][3797886720]{0:7:7} Verifying msg rid = ora.orcl.db 2 1
2018-12-05 09:51:13.877: [    AGFW][3797886720]{0:7:7} Received state change for ora.orcl.db 2 1 [old state = PARTIAL, new state = ONLINE]
2018-12-05 09:51:13.877: [    AGFW][3797886720]{0:7:7} Received state LABEL change for ora.orcl.db 2 1 [old label  = Mounted (Closed),Open Initiated, new label = Open]
2018-12-05 09:51:13.877: [    AGFW][3797886720]{0:7:7} Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Invalid|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:650:Ver:2]
2018-12-05 09:51:13.877: [    AGFW][3797886720]{0:7:7} Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:132
2018-12-05 09:51:13.898: [    AGFW][3797886720]{0:7:7} Agfw Proxy Server received the message: CMD_COMPLETED[Proxy] ID 20482:2027
2018-12-05 09:51:13.898: [    AGFW][3797886720]{0:7:7} Agfw Proxy Server replying to the message: CMD_COMPLETED[Proxy] ID 20482:2027
2018-12-05 09:51:13.901: [    AGFW][3797886720]{0:7:7} Agfw received reply from PE for resource state change for ora.orcl.db 2 1


[grid@db2 ~]$  ps -ef|grep evmd.bin
grid      32449  10645  0 15:46 pts/1    00:00:00 grep --color=auto evmd.bin
[grid@db2 ~]$ ps -ef|grep crsd.bin
grid      32619  10645  0 15:46 pts/1    00:00:00 grep --color=auto crsd.bin

[grid@db2 ~]$ ps -ef|grep ocssd.bin
grid      40387  40327  0 16:10 pts/1    00:00:00 grep --color=auto ocssd.bin


集群依旧起不来
[grid@db2 ~]$ crsctl start crs
CRS-4563: Insufficient user privileges.
CRS-4000: Command Start failed, or completed with errors.
[grid@db2 ~]$ crsctl stat res -t
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.
[grid@db2 ~]$