Sun Aug 19 14:32:00 CST 2012
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 eth1 192.168.17.0 configured from OCR for use as a cluster interconnect
WARNING 192.168.17.0 could not be translated to a network address error 1    ------这边的警告说明又是心跳的问题了,
Interface type 1 bond0 192.168.17.0 configured from OCR for use as a cluster interconnect
Interface type 1 eth0 10.0.0.0 configured from OCR for use as  a public interface
Picked latch-free SCN scheme 3
LICENSE_MAX_USERS = 0
SYS auditing is disabled

--服务器重启后,服务器上的心跳网络因为是用2个网卡做了软件bonding,所以服务器刚起来的时候,bonding的网卡需要延迟一些时间才能正式可用


--node重启后,rac就需要重组了:
GCS shadows cancelled, 2 closed
GCS shadows traversed,4001 replayed

--down node:
Sun Aug 19 14:40:46 CST 2012
Reconfiguration started (old inc 92, new inc 94)
List of nodes:
 0 1 2
 Global Resource Directory frozen
 * dead instance detected - domain 0 invalid = TRUE
 Communication channels reestablished
 * domain 0 valid = 0 according to instance 0
Sun Aug 19 14:40:47 CST 2012
 Master broadcasted resource hash value bitmaps
 Non-local Process blocks cleaned out
Sun Aug 19 14:40:47 CST 2012
 LMS 1: 54 GCS shadows cancelled, 2 closed
Sun Aug 19 14:40:47 CST 2012
 LMS 0: 61 GCS shadows cancelled, 2 closed
Sun Aug 19 14:40:47 CST 2012
 LMS 2: 59 GCS shadows cancelled, 1 closed
Sun Aug 19 14:40:47 CST 2012
 LMS 3: 64 GCS shadows cancelled, 0 closed
Sun Aug 19 14:40:47 CST 2012
 LMS 4: 53 GCS shadows cancelled, 1 closed
Sun Aug 19 14:40:47 CST 2012
 LMS 5: 31 GCS shadows cancelled, 1 closed
 Set master node info
 Submitted all remote-enqueue requests
 Dwn-cvts replayed, VALBLKs dubious
 All grantable enqueues granted
Sun Aug 19 14:40:48 CST 2012
 LMS 5: 23946 GCS shadows traversed, 4001 replayed
Sun Aug 19 14:40:48 CST 2012
 LMS 0: 24009 GCS shadows traversed, 4001 replayed
Sun Aug 19 14:40:48 CST 2012
 LMS 3: 22240 GCS shadows traversed, 4001 replayed
Sun Aug 19 14:40:48 CST 2012
 LMS 2: 22875 GCS shadows traversed, 4001 replayed
Sun Aug 19 14:40:48 CST 2012
 LMS 4: 24268 GCS shadows traversed, 4001 replayed
Sun Aug 19 14:40:48 CST 2012
 LMS 1: 23934 GCS shadows traversed, 4001 replayed


--one not down节点:
Sun Aug 19 14:40:39 CST 2012
 LMS 3: 12088 GCS shadows traversed, 2103 replayed
Sun Aug 19 14:40:39 CST 2012
 LMS 2: 23413 GCS shadows traversed, 4001 replayed
Sun Aug 19 14:40:39 CST 2012
 LMS 1: 24807 GCS shadows traversed, 4001 replayed
Sun Aug 19 14:40:39 CST 2012
 LMS 2: 9439 GCS shadows traversed, 1489 replayed
Sun Aug 19 14:40:39 CST 2012
 LMS 5: 23827 GCS shadows traversed, 4001 replayed
Sun Aug 19 14:40:39 CST 2012
 LMS 1: 20195 GCS shadows traversed, 3422 replayed
Sun Aug 19 14:40:39 CST 2012
 LMS 5: 4382 GCS shadows traversed, 733 replayed
Sun Aug 19 14:40:39 CST 2012
 LMS 0: 24574 GCS shadows traversed, 4001 replayed
 LMS 0: 23353 GCS shadows traversed, 4001 replayed
 LMS 0: 25006 GCS shadows traversed, 4001 replayed
 LMS 0: 23495 GCS shadows traversed, 4001 replayed
 LMS 0: 24385 GCS shadows traversed, 4001 replayed
 LMS 0: 24434 GCS shadows traversed, 4001 replayed
 LMS 0: 23231 GCS shadows traversed, 4001 replayed
 LMS 0: 18019 GCS shadows traversed, 2915 replayed
Sun Aug 19 14:40:39 CST 2012
 Submitted all GCS remote-cache requests
 Fix write in gcs resources
Reconfiguration complete
Sun Aug 19 14:40:46 CST 2012
 parallel recovery started with 16 processes
Sun Aug 19 14:40:46 CST 2012
Started redo scan
Sun Aug 19 14:40:46 CST 2012
Completed redo scan
 8068 redo blocks read, 1516 data blocks need recovery
Sun Aug 19 14:40:47 CST 2012
Started redo application at
 Thread 5: logseq 10297, block 19287
Sun Aug 19 14:40:47 CST 2012
Recovery of Online Redo Log: Thread 5 Group 36 Seq 10297 Reading mem 0
  Mem# 0: +DATA/pri/onlinelog/group_36.259.754358563


--another not down node3

Sun Aug 19 14:47:50 CST 2012
Reconfiguration started (old inc 94, new inc 96)
List of nodes:
 0 1 2 4
 Global Resource Directory frozen
 Communication channels reestablished
 * domain 0 valid = 1 according to instance 0
Sun Aug 19 14:47:51 CST 2012
 Master broadcasted resource hash value bitmaps
 Non-local Process blocks cleaned out
Sun Aug 19 14:47:51 CST 2012
 LMS 1: 0 GCS shadows cancelled, 0 closed
 
--master node:
--at alert_xx.log中 Master broadcasted resource hash value bitmaps


关于隐含参数 _imr_splitbrain_res_wait

[oracle@racdg2 ~]$ ora params _imr_splitbrain_res_wait

NAME                                          VALUE                DESCRIPTION
--------------------------------------------- -------------------- ----------------------------------------------------------------------
_imr_splitbrain_res_wait                      600                  Maximum wait for split-brain resolution (seconds)