2008/04/09 17:02:52.900834 [ 5405]: server/ctdb_recover.c:520 Recovery mode set to NORMAL 2008/04/09 17:02:52.901343 [ 5653]: ctdb_recovery_lock: Got recovery lock on '/clusterfs/ctdb.lock' 2008/04/09 17:02:52.901450 [ 5653]: ERROR: recovery lock file /clusterfs/ctdb.lock not locked when recovering! 2008/04/09 17:02:54.966316 [ 5408]: Recmaster node 1 no longer available. Force reelection 2008/04/09 17:02:55.073225 [ 5405]: Recovery has started 2008/04/09 17:02:55.409332 [ 5405]: Recovery has finished 2008/04/09 17:02:55.586628 [ 5405]: No such service 2008/04/09 17:02:55.588893 [ 5405]: No such service 2008/04/09 17:02:55.656761 [ 5405]: server/ctdb_recover.c:520 Recovery mode set to NORMAL 2008/04/09 17:02:55.657245 [ 5685]: ctdb_recovery_lock: Got recovery lock on '/clusterfs/ctdb.lock' 2008/04/09 17:02:55.657351 [ 5685]: ERROR: recovery lock file /clusterfs/ctdb.lock not locked when recovering! 2008/04/09 17:02:59.669484 [ 5405]: Recovery has started 2008/04/09 17:03:00.011186 [ 5405]: Recovery has finished 2008/04/09 17:03:00.188638 [ 5405]: No such service 2008/04/09 17:03:00.191274 [ 5405]: No such service 2008/04/09 17:03:00.255801 [ 5405]: server/ctdb_recover.c:520 Recovery mode set to NORMAL 2008/04/09 17:03:00.256304 [ 5717]: ctdb_recovery_lock: Got recovery lock on '/clusterfs/ctdb.lock' 2008/04/09 17:03:00.256411 [ 5717]: ERROR: recovery lock file /clusterfs/ctdb.lock not locked when recovering! 2008/04/09 17:03:01.261831 [ 5405]: Recovery has started 2008/04/09 17:03:01.582008 [ 5405]: Recovery has finished 2008/04/09 17:03:01.759059 [ 5405]: No such service 2008/04/09 17:03:01.761400 [ 5405]: No such service 2008/04/09 17:03:01.822642 [ 5405]: server/ctdb_recover.c:520 Recovery mode set to NORMAL