RAC下删除一个节点

王硕 · 发表于 2015-12-6 10:52:51

接前文：
双节点RAC系统，添加一个新节点概括
http://bbs.cqsztech.com/forum.ph ... 654&fromuid=482
(出处: 重庆思庄Oracle论坛)

1.对rac1，rac2打好补丁，查看数据库，已经升级到11.2.0.4.7

SQL> select * from v$instance;

INSTANCE_NUMBER INSTANCE_NAME HOST_NAME
--------------- ---------------- -----------------------------------------------
            3 ORCL3          rac3

SQL> select * from v$version;

BANNER
--------------------------------------------------------------------------------
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
PL/SQL Release 11.2.0.4.0 - Production
CORE 11.2.0.4.0    Production
TNS for Linux: Version 11.2.0.4.0 - Production
NLSRTL Version 11.2.0.4.0 - Production

SQL> select * from dba_registry_history;
rows will be truncated

rows will be truncated

rows will be truncated

rows will be truncated

rows will be truncated

ACTION_TIME                                                                ACTI
--------------------------------------------------------------------------- ----
24-AUG-13 12.03.45.119862 PM                                              APPL
03-DEC-15 08.51.41.048893 AM                                              APPL
04-DEC-15 03.32.47.729909 AM                                              APPL

SQL> set wrap on
SQL> r
  1* select * from dba_registry_history

ACTION_TIME
---------------------------------------------------------------------------
ACTION                      NAMESPACE
------------------------------ ------------------------------
VERSION                               ID BUNDLE_SERIES
------------------------------ ---------- ------------------------------
COMMENTS
--------------------------------------------------------------------------------
24-AUG-13 12.03.45.119862 PM
APPLY                         SERVER
11.2.0.4                               0 PSU
Patchset 11.2.0.2.0

ACTION_TIME
---------------------------------------------------------------------------
ACTION                      NAMESPACE
------------------------------ ------------------------------
VERSION                               ID BUNDLE_SERIES
------------------------------ ---------- ------------------------------
COMMENTS
--------------------------------------------------------------------------------
03-DEC-15 08.51.41.048893 AM
APPLY                         SERVER
11.2.0.4                               0 PSU
Patchset 11.2.0.2.0

ACTION_TIME
---------------------------------------------------------------------------
ACTION                      NAMESPACE
------------------------------ ------------------------------
VERSION                               ID BUNDLE_SERIES
------------------------------ ---------- ------------------------------
COMMENTS
--------------------------------------------------------------------------------
04-DEC-15 03.32.47.729909 AM
APPLY                         SERVER
11.2.0.4                               7 PSU
PSU 11.2.0.4.7

SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options

王硕 · 发表于 2015-12-6 10:53:09

2.删除rac3：停止监听
oracle@rac3:/u01/app/oracle/product/11.2.0/db1/OPatch> su - grid
Password:
grid@rac3:~> srvctl disable listener -n rac3

grid@rac3:~> srvctl stop listener -n rac3
grid@rac3:~> crsctl status res -t
--------------------------------------------------------------------------------
NAME          TARGET  STATE       SERVER                STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.FRA.dg
            ONLINE  ONLINE    rac1
            ONLINE  ONLINE    rac2
            ONLINE  ONLINE    rac3
ora.LISTENER.lsnr
            ONLINE  ONLINE    rac1
            ONLINE  ONLINE    rac2
            OFFLINE OFFLINE    rac3
ora.OCR1.dg
            ONLINE  ONLINE    rac1
            ONLINE  ONLINE    rac2
            ONLINE  ONLINE    rac3
ora.asm
            ONLINE  ONLINE    rac1                   Started
            ONLINE  ONLINE    rac2                   Started
            ONLINE  ONLINE    rac3                   Started
ora.gsd
            OFFLINE OFFLINE    rac1
            OFFLINE OFFLINE    rac2
            OFFLINE OFFLINE    rac3
ora.net1.network
            ONLINE  ONLINE    rac1
            ONLINE  ONLINE    rac2
            ONLINE  ONLINE    rac3
ora.ons
            ONLINE  ONLINE    rac1
            ONLINE  ONLINE    rac2
            ONLINE  ONLINE    rac3
ora.registry.acfs
            ONLINE  ONLINE    rac1
            ONLINE  ONLINE    rac2
            ONLINE  ONLINE    rac3
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
   1       ONLINE  ONLINE    rac2
ora.cvu
   1       ONLINE  ONLINE    rac2
ora.oc4j
   1       ONLINE  ONLINE    rac2
ora.orcl.db
   1       ONLINE  ONLINE    rac1                   Open
   2       ONLINE  ONLINE    rac2                   Open
   3       ONLINE  ONLINE    rac3                   Open
ora.rac1.vip
   1       ONLINE  ONLINE    rac1
ora.rac2.vip
   1       ONLINE  ONLINE    rac2
ora.rac3.vip
   1       ONLINE  ONLINE    rac3
ora.scan1.vip
   1       ONLINE  ONLINE    rac2

王硕 · 发表于 2015-12-6 10:53:30

3.清理清单：
grid@rac3:~>  cd /u01/app/11.2.0/grid/oui/bin/
grid@rac3:/u01/app/11.2.0/grid/oui/bin> ./runInstaller -updateNodelist -noClusterEnabled -local ORACLE_HOME=/u01/app/11.2.0/grid "CLUSTER_NODE=rac3"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB. Actual 2654 MB Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /u01/app/oraInventory
'UpdateNodeList' was successful.

grid@rac3:/u01/app/11.2.0/grid/oui/bin> olsnodes -s -t
rac1 Active  Unpinned
rac2 Active  Unpinned
rac3 Active  Unpinned
grid@rac3:/u01/app/11.2.0/grid/oui/bin> crs_stat -t
Name          Type          Target State    Host
------------------------------------------------------------
ora.FRA.dg    ora....up.type ONLINE ONLINE rac1
ora....ER.lsnr ora....er.type ONLINE ONLINE rac1
ora....N1.lsnr ora....er.type ONLINE ONLINE rac2
ora.OCR1.dg ora....up.type ONLINE ONLINE rac1
ora.asm       ora.asm.type ONLINE ONLINE rac1
ora.cvu       ora.cvu.type ONLINE ONLINE rac2
ora.gsd       ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE rac1
ora.oc4j    ora.oc4j.type  ONLINE ONLINE rac2
ora.ons       ora.ons.type ONLINE ONLINE rac1
ora.orcl.db ora....se.type ONLINE ONLINE rac1
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application OFFLINE OFFLINE
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip ora....t1.type ONLINE ONLINE rac1
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE ONLINE rac2
ora.rac2.gsd application OFFLINE OFFLINE
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip ora....t1.type ONLINE ONLINE rac2
ora....SM3.asm application ONLINE ONLINE rac3
ora....C3.lsnr application OFFLINE OFFLINE
ora.rac3.gsd application OFFLINE OFFLINE
ora.rac3.ons application ONLINE ONLINE rac3
ora.rac3.vip ora....t1.type ONLINE ONLINE rac3
ora....ry.acfs ora....fs.type ONLINE ONLINE rac1
ora.scan1.vip  ora....ip.type ONLINE ONLINE rac2

王硕 · 发表于 2015-12-6 10:53:50

4.删除vip
grid@rac3:/u01/app/11.2.0/grid/oui/bin> srvctl stop vip -i rac3-vip
grid@rac3:/u01/app/11.2.0/grid/oui/bin> crs_stat -t
Name          Type          Target State    Host
------------------------------------------------------------
ora.FRA.dg    ora....up.type ONLINE ONLINE rac1
ora....ER.lsnr ora....er.type ONLINE ONLINE rac1
ora....N1.lsnr ora....er.type ONLINE ONLINE rac2
ora.OCR1.dg ora....up.type ONLINE ONLINE rac1
ora.asm       ora.asm.type ONLINE ONLINE rac1
ora.cvu       ora.cvu.type ONLINE ONLINE rac2
ora.gsd       ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE rac1
ora.oc4j    ora.oc4j.type  ONLINE ONLINE rac2
ora.ons       ora.ons.type ONLINE ONLINE rac1
ora.orcl.db ora....se.type ONLINE ONLINE rac1
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application OFFLINE OFFLINE
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip ora....t1.type ONLINE ONLINE rac1
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE ONLINE rac2
ora.rac2.gsd application OFFLINE OFFLINE
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip ora....t1.type ONLINE ONLINE rac2
ora....SM3.asm application ONLINE ONLINE rac3
ora....C3.lsnr application OFFLINE OFFLINE
ora.rac3.gsd application OFFLINE OFFLINE
ora.rac3.ons application ONLINE ONLINE rac3
ora.rac3.vip ora....t1.type OFFLINE OFFLINE
ora....ry.acfs ora....fs.type ONLINE ONLINE rac1
ora.scan1.vip  ora....ip.type ONLINE ONLINE rac2
grid@rac3:/u01/app/11.2.0/grid/oui/bin> srvctl remove vip -i rac3-vip
Please confirm that you intend to remove the VIPs rac3-vip (y/[n]) y
PRKO-2381 : VIP rac3-vip is not removed successfully:
PRCN-2018 : Current user grid is not a privileged user
grid@rac3:/u01/app/11.2.0/grid/oui/bin> su -
Password:

rac3:~ # cd /u01/app/11.2.0/grid/oui/bin/
rac3:/u01/app/11.2.0/grid/oui/bin # ./srvctl remove vip -i rac3-vip
-bash: ./srvctl: No such file or directory
rac3:/u01/app/11.2.0/grid/oui/bin # cd
rac3:~ # cd /u01/app/11.2.0/grid/bin/

rac3:/u01/app/11.2.0/grid/bin # ./srvctl  remove vip -i rac3-vip
Please confirm that you intend to remove the VIPs rac3-vip (y/[n]) y

王硕 · 发表于 2015-12-6 10:54:24

5.删除节点服务(root)

rac3:/u01/app/11.2.0/grid/bin # ./crsctl delete node -n rac3
CRS-4658: The clusterware stack on node rac3 is not completely down.
CRS-4000: Command Delete failed, or completed with errors.
rac3:/u01/app/11.2.0/grid/bin # ./crsctl stop crs
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac3'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac3'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac3'
CRS-2673: Attempting to stop 'ora.OCR1.dg' on 'rac3'
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'rac3'
CRS-2673: Attempting to stop 'ora.orcl.db' on 'rac3'
CRS-2677: Stop of 'ora.registry.acfs' on 'rac3' succeeded
CRS-2677: Stop of 'ora.orcl.db' on 'rac3' succeeded
CRS-2673: Attempting to stop 'ora.FRA.dg' on 'rac3'
CRS-2677: Stop of 'ora.FRA.dg' on 'rac3' succeeded
CRS-2677: Stop of 'ora.OCR1.dg' on 'rac3' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac3'
CRS-2677: Stop of 'ora.asm' on 'rac3' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'rac3'
CRS-2677: Stop of 'ora.ons' on 'rac3' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac3'
CRS-2677: Stop of 'ora.net1.network' on 'rac3' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac3' has completed
CRS-2677: Stop of 'ora.crsd' on 'rac3' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac3'
CRS-2673: Attempting to stop 'ora.crf' on 'rac3'
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac3'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac3'
CRS-2673: Attempting to stop 'ora.asm' on 'rac3'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'rac3'
CRS-2677: Stop of 'ora.crf' on 'rac3' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac3' succeeded
CRS-2677: Stop of 'ora.evmd' on 'rac3' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'rac3' succeeded
CRS-2677: Stop of 'ora.drivers.acfs' on 'rac3' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac3' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac3'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac3' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac3'
CRS-2677: Stop of 'ora.cssd' on 'rac3' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac3'
CRS-2677: Stop of 'ora.gipcd' on 'rac3' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac3'
CRS-2677: Stop of 'ora.gpnpd' on 'rac3' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac3' has completed
CRS-4133: Oracle High Availability Services has been stopped.
rac3:/u01/app/11.2.0/grid/bin # cd /u01/app/11.2.0/grid/crs/install/
rac3:/u01/app/11.2.0/grid/crs/install # ./rootcrs.pl -deconfig -force
Using configuration parameter file: ./crsconfig_params
PRCR-1119 : Failed to look up CRS resources of ora.cluster_vip_net1.type type
PRCR-1068 : Failed to query resources
Cannot communicate with crsd
PRCR-1070 : Failed to check if resource ora.gsd is registered
Cannot communicate with crsd
PRCR-1070 : Failed to check if resource ora.ons is registered
Cannot communicate with crsd

CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Stop failed, or completed with errors.
CRS-4544: Unable to connect to OHAS
CRS-4000: Command Stop failed, or completed with errors.
Removing Trace File Analyzer
Successfully deconfigured Oracle clusterware stack on this node

王硕 · 发表于 2015-12-6 10:55:08

6.清理rac1 ，rac2 清单

节点1操作：rac1
grid@rac1:~> cd /u01/app/11.2.0/grid/oui/bin
grid@rac1:/u01/app/11.2.0/grid/oui/bin>./runInstaller -updateNodeList ORACLE_HOME=/u01/app/11.2.0/grid/oui/bin CLUSTER_NODES={rac1} CRS=TRUE
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB. Actual 7016 MB Passed
The inventory pointer is located at /var/opt/oracle/oraInst.loc
The inventory is located at /oracle/app/oraInventory
'UpdateNodeList' was successful.

grid@rac1:/u01/app/11.2.0/grid/oui/bin> crsctl stat res -t
--------------------------------------------------------------------------------
NAME          TARGET  STATE       SERVER                STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.FRA.dg
            ONLINE  ONLINE    rac1
            ONLINE  ONLINE    rac2
ora.LISTENER.lsnr
            ONLINE  ONLINE    rac1
            ONLINE  ONLINE    rac2
ora.OCR1.dg
            ONLINE  ONLINE    rac1
            ONLINE  ONLINE    rac2
ora.asm
            ONLINE  ONLINE    rac1                   Started
            ONLINE  ONLINE    rac2                   Started
ora.gsd
            OFFLINE OFFLINE    rac1
            OFFLINE OFFLINE    rac2
ora.net1.network
            ONLINE  ONLINE    rac1
            ONLINE  ONLINE    rac2
ora.ons
            ONLINE  ONLINE    rac1
            ONLINE  ONLINE    rac2
ora.registry.acfs
            ONLINE  ONLINE    rac1
            ONLINE  ONLINE    rac2
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
   1       ONLINE  ONLINE    rac2
ora.cvu
   1       ONLINE  ONLINE    rac2
ora.oc4j
   1       ONLINE  ONLINE    rac2
ora.orcl.db
   1       ONLINE  ONLINE    rac1                   Open
   2       ONLINE  ONLINE    rac2                   Open

ora.rac1.vip
   1       ONLINE  ONLINE    rac1
ora.rac2.vip
   1       ONLINE  ONLINE    rac2
ora.scan1.vip
   1       ONLINE  ONLINE    rac2

王硕 · 发表于 2015-12-6 10:56:23

7.rac1 下
dbca删除节点

帐号		自动登录	找回密码
密码			注册

[安装] RAC下删除一个节点