db_delete: BDB grown beyond user desired limits disabling loggerd

刘泽宇

现象：
11gR2 GI oclumon command fails:

$ oclumon manage -get reppath
CRS-9011-Error manage: Failed to initialize connection to the Cluster Logger Service

But "status & target" of resource ora.crf is online on all the node :

crsctl stat res ora.crf -init
NAME=ora.crf
TYPE=ora.crf.type
TARGET=ONLINE
STATE=ONLINE on dibarac01

The following error is reported in the <GI_HOME>/log/<node>/crflogd/crflogd.log file

[ clsdmc][1818209888]Fail to connect (ADDRESS=(PROTOCOL=ipc)(KEY=dibarac01DBG_LOGD)) with status 9
[ clsdmt][1826756928]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=<hostname>DBG_LOGD))
2013-07-09 16:14:14.404: [ clsdmt][1826756928]PID for the Process [19534], connkey 6
2013-07-09 16:14:14.404: [ clsdmt][1826756928]Creating PID [19534] file for home <GI_HOME> host <hostname> bin ologgerd to <GI_HOME>/ologgerd/init/
2013-07-09 16:14:14.404: [ clsdmt][1826756928]Writing PID [19534] to the file <GI_HOME>/ologgerd/init/<hostname>.pid]
2013-07-09 16:14:14.478: [CRFLDREP][1818209888]BDB space utilization will be 219925728
2013-07-09 16:14:14.522: [CRFLDREP][1835854144]db_delete: BDB grown beyond user desired limits disabling loggerd
2013-07-09 16:14:14.522: [ CRFM][1818209888]crfm_listeninit: couldn't create endp(ret:20), conaddr tcp://192.xxx.xxx.1:61021.
2013-07-09 16:14:14.522: [ CRFLOGD][1843370304]Thread ldbwrite running
[ CLWAL][1818209888]clsw_Initialize: OLR initlevel [70000]
2013-07-09 16:14:29.177: [ CRFLOGD][2482564704]Master coming up...
2013-07-09 16:14:29.381: [ COMMCRS][2491111744]clsc_connect: (0x6f2bca0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=<hostname>DBG_LOGD))



原因：
The issue was investigated in multiple bugs:

BUG 17238613 - LNX64-11204-CHM:OLOGGERD WAS DISABLED BECAUSE BDB GROWN BEYOND DESIRED LIMITS
BUG 20439706 - DB_KEYEXIST: KEY/DATA PAIR ALREADY EXISTS ERROR IN CRFLOGD.LOG
BUG 18447164 - CRFCLUST.BDB GROW HUGE SIZE
BUG 19692024 - EXADATA: CRFCLUST.BDB IS GROWING TO 40 GB
BUG 20127477 - CRFCLUST.BDB HAS GROWN UNEXPECTEDLY
BUG 20127477 - CRFCLUST.BDB HAS GROWN UNEXPECTEDLY
BUG 20316849 - HUGE REPSIZE RESULTING IN GI HOME DIRECTORY FILLING UP
BUG 20351845 - RETENTION FOR CHM DATA IS SET TO 34YRS.

All of those are closed as duplicate of the following:

BUG 20186278 - TAG OCR: GET ID FAILED AND CHM DB SIZE 24 GB



处理方法：
Request/apply the patch or use the following workaround:

1. On all nodes, issue "crsctl stop res ora.crf -init" as root user
2. On all nodes, remove the value of BDBSIZE tag entry (set it to blank) in <GI_HOME>/crf/admin/crf<node>.ora, do not delete the BDBSIZE tag
3. On all nodes, issue "crsctl start res ora.crf -init" as root user