2024-03-13T11:00:00.847Z In(166) Hostd[2099295]: [Originator@6876 sub=Vimsvc.HaSessionManager opID=0d9fd859 sid=52d47178] Accepted password for user root from xosrc01 - session=52d47178-d461-081b-f75d-31f363e65dd3 2024-03-13T11:00:00.847Z Wa(164) Hostd[2099295]: [Originator@6876 sub=Vimsvc opID=0d9fd859 sid=52d47178] Refresh function is not configured.User data can't be added to scheduler.User name: root 2024-03-13T11:00:00.847Z In(166) Hostd[2099295]: [Originator@6876 sub=Vimsvc.ha-eventmgr opID=0d9fd859 sid=52d47178] Event 14030 : User root@xosrc01 logged in as node-soap/1.0.0 2024-03-13T11:00:01.320Z Wa(164) Hostd[2099288]: [Originator@6876 sub=IO.Http] Unknown token type in Authorization header; Basic, from: xosrc01 2024-03-13T11:00:01.336Z In(166) Hostd[2099288]: [Originator@6876 sub=Vimsvc.HaSessionManager] Accepted password for user root from xosrc01 - session=520ca038-96f0-a086-5c3c-98f3ec64b583 2024-03-13T11:00:01.336Z Wa(164) Hostd[2099288]: [Originator@6876 sub=Vimsvc] Refresh function is not configured.User data can't be added to scheduler.User name: root 2024-03-13T11:00:01.337Z In(166) Hostd[2099288]: [Originator@6876 sub=Vimsvc.ha-eventmgr] Event 14031 : User root@xosrc01 logged in as node-fetch 2024-03-13T11:00:01.337Z In(166) Hostd[2099288]: [Originator@6876 sub=HTTP server /folder req=000000221134adb0 user=root] Got HTTP GET request for /folder/cfw12-opnsense/cfw12-opnsense.vmx?dcPath=ha-datacenter&dsName=SAN7_Vol04 2024-03-13T11:00:01.338Z In(166) Hostd[2099295]: [Originator@6876 sub=Vimsvc.TaskManager opID=req=000000221134adb0-d864 sid=520ca038 user=root] Task Created : haTask--vim.SearchIndex.findByInventoryPath-99289449 2024-03-13T11:00:01.339Z In(166) Hostd[2099301]: [Originator@6876 sub=Vimsvc.TaskManager opID=req=000000221134adb0-d864 sid=520ca038 user=root] Task Completed : haTask--vim.SearchIndex.findByInventoryPath-99289449 Status success 2024-03-13T11:00:01.342Z In(166) Hostd[2099296]: [Originator@6876 sub=DatastoreBrowser opID=req=000000221134adb0-d867 sid=520ca038 user=root] DatastoreBrowserImpl::SearchInt MoId:64d4d99b-9c610fc9-b337-5c6f69872e80-datastorebrowser dsPath:[SAN7_Vol04]cfw12-opnsense recursive:false 2024-03-13T11:00:01.348Z In(166) Hostd[2099302]: [Originator@6876 sub=HTTP server /folder req=000000221134adb0] Sent OK response for GET /folder/cfw12-opnsense/cfw12-opnsense.vmx?dcPath=ha-datacenter&dsName=SAN7_Vol04 2024-03-13T11:00:01.348Z In(166) Hostd[2099302]: [Originator@6876 sub=Vimsvc.ha-eventmgr] Event 14032 : File download from path '[SAN7_Vol04]cfw12-opnsense/cfw12-opnsense.vmx' was initiated from 'node-fetch@xosrc01' and completed with status '' 2024-03-13T11:00:01.385Z In(166) Hostd[2099282]: [Originator@6876 sub=HTTP server /folder req=0000002211500030 user=root] Got HTTP GET request for /folder/cfw12-opnsense/cfw12-opnsense.vmdk?dcPath=ha-datacenter&dsName=SAN7_Vol04 2024-03-13T11:00:01.386Z In(166) Hostd[2099285]: [Originator@6876 sub=Vimsvc.TaskManager opID=req=0000002211500030-d87d sid=520ca038 user=root] Task Created : haTask--vim.SearchIndex.findByInventoryPath-99289455 2024-03-13T11:00:01.387Z In(166) Hostd[2099284]: [Originator@6876 sub=Vimsvc.TaskManager opID=req=0000002211500030-d87d sid=520ca038 user=root] Task Completed : haTask--vim.SearchIndex.findByInventoryPath-99289455 Status success 2024-03-13T11:00:01.389Z In(166) Hostd[2099298]: [Originator@6876 sub=DatastoreBrowser opID=req=0000002211500030-d87f sid=520ca038 user=root] DatastoreBrowserImpl::SearchInt MoId:64d4d99b-9c610fc9-b337-5c6f69872e80-datastorebrowser dsPath:[SAN7_Vol04]cfw12-opnsense recursive:false 2024-03-13T11:00:01.402Z In(166) Hostd[2099281]: [Originator@6876 sub=HTTP server /folder req=0000002211500030] Sent OK response for GET /folder/cfw12-opnsense/cfw12-opnsense.vmdk?dcPath=ha-datacenter&dsName=SAN7_Vol04 2024-03-13T11:00:01.402Z In(166) Hostd[2099281]: [Originator@6876 sub=Vimsvc.ha-eventmgr] Event 14033 : File download from path '[SAN7_Vol04]cfw12-opnsense/cfw12-opnsense.vmdk' was initiated from 'node-fetch@xosrc01' and completed with status '' 2024-03-13T11:00:01.404Z In(166) Hostd[2099278]: [Originator@6876 sub=HTTP server /folder req=00000022106e0670 user=root] Got HTTP GET request for /folder/cfw12-opnsense/cfw12-opnsense.vmsd?dcPath=ha-datacenter&dsName=SAN7_Vol04 2024-03-13T11:00:01.404Z In(166) Hostd[2099288]: [Originator@6876 sub=Vimsvc.TaskManager opID=req=00000022106e0670-d88c sid=520ca038 user=root] Task Created : haTask--vim.SearchIndex.findByInventoryPath-99289458 2024-03-13T11:00:01.405Z In(166) Hostd[2099302]: [Originator@6876 sub=Vimsvc.TaskManager opID=req=00000022106e0670-d88c sid=520ca038 user=root] Task Completed : haTask--vim.SearchIndex.findByInventoryPath-99289458 Status success 2024-03-13T11:00:01.407Z In(166) Hostd[2099303]: [Originator@6876 sub=DatastoreBrowser opID=req=00000022106e0670-d890 sid=520ca038 user=root] DatastoreBrowserImpl::SearchInt MoId:64d4d99b-9c610fc9-b337-5c6f69872e80-datastorebrowser dsPath:[SAN7_Vol04]cfw12-opnsense recursive:false 2024-03-13T11:00:01.416Z In(166) Hostd[2099307]: [Originator@6876 sub=HTTP server /folder req=00000022106e0670] Sent OK response for GET /folder/cfw12-opnsense/cfw12-opnsense.vmsd?dcPath=ha-datacenter&dsName=SAN7_Vol04 2024-03-13T11:00:01.417Z In(166) Hostd[2099307]: [Originator@6876 sub=Vimsvc.ha-eventmgr] Event 14034 : File download from path '[SAN7_Vol04]cfw12-opnsense/cfw12-opnsense.vmsd' was initiated from 'node-fetch@xosrc01' and completed with status '' 2024-03-13T11:00:01.507Z Wa(164) Hostd[2099305]: [Originator@6876 sub=PropertyCollector opID=esxui-ff6e-d8c2 sid=5231d26a user=root] Session 5231d26a-802d-6498-c430-2eaeafb89fe5 has issued 2 concurrent blocking calls to the property collector. This is almost certainly an error in the logic of the client application. 2024-03-13T11:00:04.539Z Wa(164) Hostd[2099295]: [Originator@6876 sub=PropertyCollector opID=esxui-a366-d8f4 sid=5231d26a user=root] Session 5231d26a-802d-6498-c430-2eaeafb89fe5 has issued 2 concurrent blocking calls to the property collector. This is almost certainly an error in the logic of the client application. 2024-03-13T11:00:04.767Z In(166) Hostd[2099292]: [Originator@6876 sub=Vimsvc.TaskManager opID=0d9fd8f5 sid=52d47178 user=root] Task Created : haTask-2334-vim.VirtualMachine.powerOff-99289504 2024-03-13T11:00:04.768Z Db(167) Hostd[2099299]: [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx opID=0d9fd8f5 sid=52d47178 user=root] Power off request received 2024-03-13T11:00:04.768Z In(166) Hostd[2099299]: [Originator@6876 sub=Vimsvc.ha-eventmgr opID=0d9fd8f5 sid=52d47178 user=root] Event 14035 : cfw12-opnsense on esx32.blueops.local in ha-datacenter is stopping 2024-03-13T11:00:04.768Z In(166) Hostd[2099299]: [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx opID=0d9fd8f5 sid=52d47178 user=root] State Transition (VM_STATE_ON -> VM_STATE_POWERING_OFF) 2024-03-13T11:00:04.769Z Db(167) Hostd[2099299]: [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx opID=0d9fd8f5 sid=52d47178 user=root] PowerOff request queued 2024-03-13T11:00:04.870Z Wa(164) Hostd[2099284]: [Originator@6876 sub=Libs] VigorOnlineStatusCb: Failed to find RPC Request in pending list for sequence -1 2024-03-13T11:00:04.870Z In(166) Hostd[2099301]: [Originator@6876 sub=Libs] SOCKET 144 (164) recv detected remote shutdown 2024-03-13T11:00:04.870Z In(166) Hostd[2099301]: [Originator@6876 sub=Libs] VigorTransportClientProcessError: Remote disconnected 2024-03-13T11:00:04.870Z In(166) Hostd[2099301]: [Originator@6876 sub=Libs] VigorTransportDrainRecv: draining read. 2024-03-13T11:00:04.870Z In(166) Hostd[2099301]: [Originator@6876 sub=Libs] SOCKET 144 (164) recv detected remote shutdown 2024-03-13T11:00:04.870Z In(166) Hostd[2099301]: [Originator@6876 sub=Libs] VigorTransportClientProcessError: closing connection. 2024-03-13T11:00:04.870Z In(166) Hostd[2099301]: [Originator@6876 sub=Libs] VigorTransportClientManageConnection: connection closed; will attempt to reconnect in case it is an FSR 2024-03-13T11:00:04.871Z In(166) Hostd[2099279]: [Originator@6876 sub=Libs] CnxUtil_ConnectLocal: Failed to find socket vmx-vigor-fd 2024-03-13T11:00:04.871Z In(166) Hostd[2099279]: [Originator@6876 sub=Libs] VigorTransportReconnect: VM /vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx does not appear to be running 2024-03-13T11:00:04.876Z Db(167) Hostd[2099279]: [Originator@6876 sub=Vigor.Vmsvc.vm:/vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx] Vigor client state callback OFFLINE reason Failed to establish transport connection. 2024-03-13T11:00:04.876Z Db(167) Hostd[2099224]: --> Remote disconnected 2024-03-13T11:00:04.876Z Db(167) Hostd[2099224]: --> 2024-03-13T11:00:04.876Z In(166) Hostd[2099279]: [Originator@6876 sub=Libs] VigorOnlineDisconnectCb: connection closed (is final). 2024-03-13T11:00:04.876Z Db(167) Hostd[2099279]: [Originator@6876 sub=Vigor.Vmsvc.vm:/vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx] Get vigor fields VigorCpp::Devices::MiscOpts::Shared translated error to vim.fault.InvalidState 2024-03-13T11:00:04.876Z Db(167) Hostd[2099279]: [Originator@6876 sub=Vigor.Vmsvc.vm:/vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx] Get vigor fields VigorCpp::Devices::MiscOpts::Shared message: Disconnected from virtual machine. 2024-03-13T11:00:04.876Z Db(167) Hostd[2099224]: --> Failed to establish transport connection. 2024-03-13T11:00:04.876Z Db(167) Hostd[2099224]: --> Remote disconnected 2024-03-13T11:00:04.876Z Db(167) Hostd[2099224]: --> 2024-03-13T11:00:04.876Z Db(167) Hostd[2099279]: [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx] Issue ticket message: Disconnected from virtual machine. 2024-03-13T11:00:04.876Z Db(167) Hostd[2099224]: --> Failed to establish transport connection. 2024-03-13T11:00:04.876Z Db(167) Hostd[2099224]: --> Remote disconnected 2024-03-13T11:00:04.876Z Db(167) Hostd[2099224]: --> 2024-03-13T11:00:04.880Z In(166) Hostd[2099289]: [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx] Upgrade is required for virtual machine, version: 19 2024-03-13T11:00:04.880Z Db(167) Hostd[2099289]: [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx] guest operations are not ready 2024-03-13T11:00:04.880Z Db(167) Hostd[2099289]: [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx] Tools are not operations ready 2024-03-13T11:00:04.881Z Db(167) Hostd[2099289]: [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx] Notifying: [N5Vmsvc10VmToolsMsgE:0x000000220b5963a0]: TimeStamp=5453100445354, MOId=2334, WID=0, VMConfigPath='/vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx' toolsRunning=false 2024-03-13T11:00:04.883Z Db(167) Hostd[2099287]: [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx] Security domain 259 will be cleaned up at vmx exit 2024-03-13T11:00:04.883Z Db(167) Hostd[2099287]: [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/64d4d99b-9c610fc9-b337-5c6f69872e80/cfw12-opnsense/cfw12-opnsense.vmx] Created power off monitor: security domain=259; verify=true; needsPowerOn=false; task=haTask-2334-vim.VirtualMachine.powerOff-99289504.