Sep 21 05:40:30 CEST 2026 [debug] FH: Start fault handler. Sep 21 05:40:30 CEST 2026 [debug] HB: HB domain is updated [hbdomain = (dm1)]. Sep 21 05:40:30 CEST 2026 [debug] FH: HB/SF state has become stable. Sep 21 05:40:30 CEST 2026 [debug] FH: weight value [1] is committed. Sep 21 05:40:33 CEST 2026 [debug] FH: waiting for consistent view... Sep 21 05:41:33 CEST 2026 [warn] Host (-1) and the local host do not agree on the view to the pool membership. Sep 21 05:41:33 CEST 2026 [warn] local HB domain = (011) Sep 21 05:41:33 CEST 2026 [warn] local SF domain = (111) Sep 21 05:41:33 CEST 2026 [warn] remote HB domain = (101) Sep 21 05:41:33 CEST 2026 [warn] remote SF domain = (111) Sep 21 05:41:33 CEST 2026 [warn] remote HB domain on SF = (101) Sep 21 05:41:33 CEST 2026 [warn] remote SF domain on HB = (111) Sep 21 05:41:33 CEST 2026 [warn] other HB domain = (101) Sep 21 05:41:33 CEST 2026 [warn] other SF domain = (111) Sep 21 05:41:33 CEST 2026 [warn] other HB domain on SF = (101) Sep 21 05:41:33 CEST 2026 [warn] other SF domain on HB = (111) Sep 21 05:41:33 CEST 2026 [warn] other HB domain = (011) Sep 21 05:41:33 CEST 2026 [warn] other SF domain = (111) Sep 21 05:41:33 CEST 2026 [warn] other HB domain on SF = (011) Sep 21 05:41:33 CEST 2026 [warn] other SF domain on HB = (111) Sep 21 05:41:33 CEST 2026 [warn] other HB domain = (111) Sep 21 05:41:33 CEST 2026 [warn] other SF domain = (111) Sep 21 05:41:33 CEST 2026 [warn] other HB domain on SF = (111) Sep 21 05:41:33 CEST 2026 [warn] other SF domain on HB = (111) Sep 21 05:41:33 CEST 2026 [warn] weight[0] = 1 Sep 21 05:41:33 CEST 2026 [warn] weight[1] = 1 Sep 21 05:41:33 CEST 2026 [warn] weight[2] = 1 Sep 21 05:41:33 CEST 2026 [warn] after merger: -1 Sep 21 05:41:33 CEST 2026 [warn] other HB domain = (101) Sep 21 05:41:33 CEST 2026 [warn] other SF domain = (111) Sep 21 05:41:33 CEST 2026 [warn] other HB domain on SF = (101) Sep 21 05:41:33 CEST 2026 [warn] other SF domain on HB = (111) Sep 21 05:41:33 CEST 2026 [warn] other HB domain = (011) Sep 21 05:41:33 CEST 2026 [warn] other SF domain = (111) Sep 21 05:41:33 CEST 2026 [warn] other HB domain on SF = (000) Sep 21 05:41:33 CEST 2026 [warn] other SF domain on HB = (111) Sep 21 05:41:33 CEST 2026 [warn] other HB domain = (111) Sep 21 05:41:33 CEST 2026 [warn] other SF domain = (111) Sep 21 05:41:33 CEST 2026 [warn] other HB domain on SF = (101) Sep 21 05:41:33 CEST 2026 [warn] other SF domain on HB = (111) Sep 21 05:41:33 CEST 2026 [warn] weight[0] = 1 Sep 21 05:41:33 CEST 2026 [warn] weight[1] = 1 Sep 21 05:41:33 CEST 2026 [warn] weight[2] = 1 Sep 21 05:41:33 CEST 2026 [warn] merged HB domain = (000) Sep 21 05:41:33 CEST 2026 [warn] merged SF domain = (111) Sep 21 05:41:33 CEST 2026 [debug] FH: All hosts now have consistent view to the pool membership. Sep 21 05:41:36 CEST 2026 [warn] SM: partition_size[0] = 2 2 Sep 21 05:41:36 CEST 2026 [warn] SM: partition_size[1] = 0 0 Sep 21 05:41:36 CEST 2026 [warn] SM: partition_size[2] = 2 2 Sep 21 05:41:36 CEST 2026 [warn] SM: winner_index = 0 Sep 21 05:41:36 CEST 2026 [debug] FH: I have lost. Sep 21 05:41:36 CEST 2026 [err] Survival rule failed (1905) FH: Survival Rule is not met for the local host. - Self-Fence. Sep 21 05:41:36 CEST 2026 [info] watchdog_selffence. Sep 21 05:44:57 CEST 2026 [notice] HA daemon started - built at Nov 13 09:32:08 UTC 2025 - Sep 21 05:44:57 CEST 2026 [info] CONF: my_index=1 num_host=3 t1=3 T1=60 t2=3 T2=60 Wh=60 Ws=75 Tboot=120 Tenable=120 tXapi=60 TXapi=120 RestartXapi=1 TRestartXapi=300 Tlicence=30 Sep 21 05:44:57 CEST 2026 [info] LOG: logmask = 100000 Sep 21 05:44:57 CEST 2026 [info] LOG: OFF:18(DUMPPACKET) Sep 21 05:44:57 CEST 2026 [info] LOG: OFF:19(TRACE) Sep 21 05:44:57 CEST 2026 [info] LOG: ON :20(FH_TRACE) Sep 21 05:44:57 CEST 2026 [info] LOG: OFF:21(LM_TRACE) Sep 21 05:44:57 CEST 2026 [info] LOG: OFF:22(SCRIPT) Sep 21 05:44:57 CEST 2026 [info] LOG: OFF:23(SC_WARNING) Sep 21 05:44:57 CEST 2026 [info] LOG: OFF:24(SYSLOG) Sep 21 05:44:57 CEST 2026 [debug] HA daemon set scheduler policy=2 priority=48 Sep 21 05:44:57 CEST 2026 [debug] pthread_attr_setinheritsched successfully. Sep 21 05:44:57 CEST 2026 [info] COM: com_initialize(0). Sep 21 05:44:57 CEST 2026 [info] SF: phase 0 initialization... Sep 21 05:44:57 CEST 2026 [info] LM: lm_initialize(0). Sep 21 05:44:57 CEST 2026 [info] BM: bm_initialize(0). Sep 21 05:44:57 CEST 2026 [info] HB: hb_initialize(0). Sep 21 05:44:57 CEST 2026 [info] Xapimon: xapimon_initialize(0). Sep 21 05:44:57 CEST 2026 [info] SC: script_initialize(0). Sep 21 05:44:57 CEST 2026 [info] SC: hostweight_initialize(0). Sep 21 05:44:57 CEST 2026 [info] SM: sm_initialize(0). Sep 21 05:44:57 CEST 2026 [info] COM: com_initialize(1). Sep 21 05:44:57 CEST 2026 [info] SF: phase 1 initialization... Sep 21 05:44:57 CEST 2026 [info] WD: watchdog mode = HYPERVISOR. Sep 21 05:44:57 CEST 2026 [info] WD: (watchdog_create) success label=statefile id=1. Sep 21 05:44:57 CEST 2026 [debug] WD: watchdog id file /var/run/xhad.wd.id is updated. Sep 21 05:44:57 CEST 2026 [info] LM: lm_initialize(1). Sep 21 05:44:57 CEST 2026 [info] SF: Thread ID = 3105 Sep 21 05:44:57 CEST 2026 [info] BM: bm_initialize(1). Sep 21 05:44:57 CEST 2026 [info] LM: Thread ID = 3106 Sep 21 05:44:57 CEST 2026 [info] HB: hb_initialize(1). Sep 21 05:44:57 CEST 2026 [info] BM: Thread ID = 3107 Sep 21 05:44:57 CEST 2026 [info] WD: (watchdog_create) success label=heartbeat id=2. Sep 21 05:44:57 CEST 2026 [debug] WD: watchdog id file /var/run/xhad.wd.id is updated. Sep 21 05:44:57 CEST 2026 [info] HB_receive: Thread ID = 3108 Sep 21 05:44:57 CEST 2026 [info] HB_send: Thread ID = 3109 Sep 21 05:44:57 CEST 2026 [info] Xapimon: xapimon_initialize(1). Sep 21 05:44:57 CEST 2026 [info] SC: script_initialize(1). Sep 21 05:44:57 CEST 2026 [info] Xapimon: Thread ID = 3110 Sep 21 05:44:57 CEST 2026 [info] SC: Thread ID = 3111 Sep 21 05:44:57 CEST 2026 [info] SC: Thread ID = 3112 Sep 21 05:44:57 CEST 2026 [info] SC: hostweight_initialize(1). Sep 21 05:44:57 CEST 2026 [info] SC: Thread ID = 3113 Sep 21 05:44:57 CEST 2026 [info] SC: host weight has changed from 0 to 1 Sep 21 05:44:57 CEST 2026 [info] SC: builtinclass=native weight=1 Sep 21 05:44:57 CEST 2026 [info] SM: sm_initialize(1). Sep 21 05:44:57 CEST 2026 [info] SM: Thread ID = 3114 Sep 21 05:44:57 CEST 2026 [info] SM_Worker: Thread ID = 3115 Sep 21 05:44:57 CEST 2026 [info] Initial weight = 1. Sep 21 05:44:57 CEST 2026 [info] State File read/write enabled. Sep 21 05:44:57 CEST 2026 [info] Heartbeat send/receive enabled. Sep 21 05:44:57 CEST 2026 [debug] HB: HB domain is updated [hbdomain = (0m@)]. Sep 21 05:44:57 CEST 2026 [debug] HB: HB domain is updated [hbdomain = (@m1)]. Sep 21 05:44:57 CEST 2026 [debug] SM: heartbeat is ready Sep 21 05:45:00 CEST 2026 [notice] HA daemon successfuly started acceesing the State-File. Sep 21 05:45:03 CEST 2026 [debug] SM: SF domain is updated [sfdomain = (@0@)]. Sep 21 05:45:06 CEST 2026 [debug] SM: SF domain is updated [sfdomain = (1@1)]. Sep 21 05:45:06 CEST 2026 [debug] SM: statefile is ready Sep 21 05:45:06 CEST 2026 [debug] SM: other hosts are ready Sep 21 05:45:06 CEST 2026 [info] Start Criteria: pool state=ACTIVE; excluded=FALSE; liveset=EXIST Sep 21 05:45:06 CEST 2026 [info] Start Criteria: Joining the existing liveset. Sep 21 05:45:06 CEST 2026 [info] Start Criteria: current_liveset = (101) Sep 21 05:45:06 CEST 2026 [info] Start Criteria: proposed_liveset = (101) Sep 21 05:45:06 CEST 2026 [info] Start Criteria has been met for the local host. Sep 21 05:45:06 CEST 2026 [debug] Join: trying to join [proposed_liveset = (111)]. Sep 21 05:45:07 CEST 2026 [warn] BM: cannot open bonding status file (/proc/net/bonding/bond0). (2) Sep 21 05:45:07 CEST 2026 [info] BM: this is not bonded. Terminating bonding thread. Sep 21 05:45:09 CEST 2026 [info] Join: joined successfully [new liveset = (111)]. Sep 21 05:45:09 CEST 2026 [info] Joined. Sep 21 05:45:09 CEST 2026 [info] Xapi monitor started. Sep 21 05:45:09 CEST 2026 [info] Fencing is armed. Sep 21 05:45:09 CEST 2026 [notice] The local host has transitioned to online state. Sep 21 05:45:09 CEST 2026 [debug] HA daemon mlockall succeeded Sep 21 11:16:58 CEST 2026 [debug] FH: Start fault handler. Sep 21 11:17:25 CEST 2026 [debug] FH: HB/SF state has become stable. Sep 21 11:17:25 CEST 2026 [debug] FH: weight value [1] is committed. Sep 21 11:17:28 CEST 2026 [debug] FH: waiting for consistent view... Sep 21 11:18:28 CEST 2026 [warn] Host (-1) and the local host do not agree on the view to the pool membership. Sep 21 11:18:28 CEST 2026 [warn] local HB domain = (111) Sep 21 11:18:28 CEST 2026 [warn] local SF domain = (111) Sep 21 11:18:28 CEST 2026 [warn] remote HB domain = (110) Sep 21 11:18:28 CEST 2026 [warn] remote SF domain = (111) Sep 21 11:18:28 CEST 2026 [warn] remote HB domain on SF = (110) Sep 21 11:18:28 CEST 2026 [warn] remote SF domain on HB = (111) Sep 21 11:18:28 CEST 2026 [warn] other HB domain = (110) Sep 21 11:18:28 CEST 2026 [warn] other SF domain = (111) Sep 21 11:18:28 CEST 2026 [warn] other HB domain on SF = (110) Sep 21 11:18:28 CEST 2026 [warn] other SF domain on HB = (111) Sep 21 11:18:28 CEST 2026 [warn] other HB domain = (111) Sep 21 11:18:28 CEST 2026 [warn] other SF domain = (111) Sep 21 11:18:28 CEST 2026 [warn] other HB domain on SF = (111) Sep 21 11:18:28 CEST 2026 [warn] other SF domain on HB = (111) Sep 21 11:18:28 CEST 2026 [warn] other HB domain = (011) Sep 21 11:18:28 CEST 2026 [warn] other SF domain = (111) Sep 21 11:18:28 CEST 2026 [warn] other HB domain on SF = (011) Sep 21 11:18:28 CEST 2026 [warn] other SF domain on HB = (111) Sep 21 11:18:28 CEST 2026 [warn] weight[0] = 1 Sep 21 11:18:28 CEST 2026 [warn] weight[1] = 1 Sep 21 11:18:28 CEST 2026 [warn] weight[2] = 1 Sep 21 11:18:28 CEST 2026 [warn] after merger: -1 Sep 21 11:18:28 CEST 2026 [warn] other HB domain = (110) Sep 21 11:18:28 CEST 2026 [warn] other SF domain = (111) Sep 21 11:18:28 CEST 2026 [warn] other HB domain on SF = (110) Sep 21 11:18:28 CEST 2026 [warn] other SF domain on HB = (111) Sep 21 11:18:28 CEST 2026 [warn] other HB domain = (111) Sep 21 11:18:28 CEST 2026 [warn] other SF domain = (111) Sep 21 11:18:28 CEST 2026 [warn] other HB domain on SF = (110) Sep 21 11:18:28 CEST 2026 [warn] other SF domain on HB = (111) Sep 21 11:18:28 CEST 2026 [warn] other HB domain = (011) Sep 21 11:18:28 CEST 2026 [warn] other SF domain = (111) Sep 21 11:18:28 CEST 2026 [warn] other HB domain on SF = (000) Sep 21 11:18:28 CEST 2026 [warn] other SF domain on HB = (111) Sep 21 11:18:28 CEST 2026 [warn] weight[0] = 1 Sep 21 11:18:28 CEST 2026 [warn] weight[1] = 1 Sep 21 11:18:28 CEST 2026 [warn] weight[2] = 1 Sep 21 11:18:28 CEST 2026 [warn] merged HB domain = (110) Sep 21 11:18:28 CEST 2026 [warn] merged SF domain = (111) Sep 21 11:18:28 CEST 2026 [debug] FH: All hosts now have consistent view to the pool membership. Sep 21 11:18:29 CEST 2026 [warn] SM: partition_size[0] = 2 2 Sep 21 11:18:29 CEST 2026 [warn] SM: partition_size[1] = 2 2 Sep 21 11:18:29 CEST 2026 [warn] SM: partition_size[2] = 0 0 Sep 21 11:18:29 CEST 2026 [warn] SM: winner_index = 0 Sep 21 11:18:29 CEST 2026 [debug] SM: I have won by the result of weight caluculation. Sep 21 11:18:29 CEST 2026 [debug] FH: I have won. Sep 21 11:18:29 CEST 2026 [debug] SM: Node (2) will be removed from liveset. Sep 21 11:18:29 CEST 2026 [debug] SM: HB domain is updated = (110) Sep 21 11:18:29 CEST 2026 [debug] SM: SF domain is updated = (110) Sep 21 11:19:07 CEST 2026 [warn] SC: (script_service_do_query_liveset) reporting "heartbeat approaching timeout". host[2].time_since_last_hb=37785. Sep 21 11:19:07 CEST 2026 [warn] SC: (script_service_do_query_liveset) reporting "State-File approaching timeout". host[2].time_since_last_update_on_sf=36448. Sep 21 11:19:47 CEST 2026 [notice] Liveset has been updated. new liveset = (110) Sep 21 11:19:47 CEST 2026 [debug] FH: End fault handler. Sep 21 11:20:07 CEST 2026 [info] SC: (script_service_do_query_liveset) "Heartbeat approaching timeout" turned FALSE Sep 21 11:20:07 CEST 2026 [info] SC: (script_service_do_query_liveset) "State-file approaching timeout" turned FALSE Sep 21 11:21:58 CEST 2026 [debug] HB: HB domain is updated [hbdomain = (1m@)]. Sep 21 11:22:05 CEST 2026 [debug] SM: SF domain is updated [sfdomain = (11@)]. Sep 21 11:22:05 CEST 2026 [debug] Join Agent: Send ack to join request from host (2). Sep 21 11:22:07 CEST 2026 [info] Join Agent: Join request from host (2) is accepted by the local host. Sep 21 11:22:07 CEST 2026 [notice] Liveset has been updated. new liveset = (111) Sep 21 11:22:07 CEST 2026 [info] Join Agent: proposed_liveset = (111) Sep 21 13:12:23 CEST 2026 [err] Invalid pool state (1906). Sep 21 13:12:23 CEST 2026 [notice] HA daemon started shutdown process. Sep 21 13:12:23 CEST 2026 [info] SM: sm_initialize(-1). Sep 21 13:12:23 CEST 2026 [info] SC: hostweight_initialize(-1). Sep 21 13:12:23 CEST 2026 [info] SC: script_initialize(-1). Sep 21 13:12:23 CEST 2026 [info] Xapimon: xapimon_initialize(-1). Sep 21 13:12:23 CEST 2026 [info] HB: hb_initialize(-1). Sep 21 13:12:25 CEST 2026 [info] WD: (watchdog_close) label=heartbeat stopping watchdog timer. Sep 21 13:12:25 CEST 2026 [info] WD: (watchdog_close) label=heartbeat watchdog timer has been stopped successfully. Sep 21 13:12:25 CEST 2026 [debug] WD: watchdog id file /var/run/xhad.wd.id is updated. Sep 21 13:12:25 CEST 2026 [info] BM: bm_initialize(-1). Sep 21 13:12:25 CEST 2026 [info] LM: lm_initialize(-1). Sep 21 13:12:25 CEST 2026 [info] WD: (watchdog_close) label=statefile stopping watchdog timer. Sep 21 13:12:25 CEST 2026 [info] WD: (watchdog_close) label=statefile watchdog timer has been stopped successfully. Sep 21 13:12:25 CEST 2026 [debug] WD: watchdog id file /var/run/xhad.wd.id is deleted. Sep 21 13:12:25 CEST 2026 [info] COM: com_initialize(-1). Sep 21 13:12:25 CEST 2026 [notice] HA daemon completed shutdown process.