XCP-NG host crashing, what logs should I check?

jensolsson.se

Hi

One of our xcp-ng hosts is crashing from time to time, just cannot see it from XO any more and all the hosts seem to be gone. A restart with the power button fixes the issue.

What logs should I check to troubleshoot?

Kind regards
Jens

olivierlambert

kern.log might be interesting, or check if you have a crashdump dir

jensolsson.se

Will check that as soon as I have physical access next time, now it is crashed again...

The machine seem to be semi active though.
I can ping it and it is quick to respond:

Jens-Home-iMac:~ deadlock$ ping 10.0.10.222
PING 10.0.10.222 (10.0.10.222): 56 data bytes
64 bytes from 10.0.10.222: icmp_seq=0 ttl=62 time=9.646 ms
64 bytes from 10.0.10.222: icmp_seq=1 ttl=62 time=14.683 ms
64 bytes from 10.0.10.222: icmp_seq=2 ttl=62 time=10.372 ms
64 bytes from 10.0.10.222: icmp_seq=3 ttl=62 time=9.476 ms

However if I try nmap I see that just a few of the ports are open
There are port 22, 443 and 32773

Jens-Home-iMac:~ deadlock$ nmap 10.0.10.222 -Pn
Starting Nmap 7.92 ( https://nmap.org ) at 2021-11-20 00:38 CET

Nmap scan report for 10.0.10.222
Host is up (0.011s latency).
Not shown: 997 closed tcp ports (conn-refused)
PORT      STATE    SERVICE
22/tcp    open     ssh
443/tcp   open     https
32773/tcp filtered sometimes-rpc9

But if I try to connect to ssh for example using telnet, I would expect to get a version identifier, like for example "SSH-2.0-OpenSSH_7.4" but when I do it just immediately closes the connection.

Jens-Home-iMac:~ deadlock$ telnet 10.0.10.222 22
Trying 10.0.10.222...
Connected to 10.0.10.222.
Escape character is '^]'.
Connection closed by foreign host.

If I try to browse using https, it just sais that the page cannot be opened. If I instead try to open an ssl connection to port 443 there is for sure some negotiations.

Jens-Home-iMac:~ deadlock$ openssl s_client -connect 10.0.10.222:443
CONNECTED(00000003)
depth=0 CN = localhost
verify error:num=18:self signed certificate
verify return:1
depth=0 CN = localhost
verify return:1
---
Certificate chain
 0 s:/CN=localhost
   i:/CN=localhost
---
Server certificate
-----BEGIN CERTIFICATE-----
MIICwzCCAaugAwIBAgIJAJDM2eXYwF2CMA0GCSqGSIb3DQEBCwUAMBQxEjAQBgNV
BAMMCWxvY2FsaG9zdDAeFw0yMDEyMDQwNzM0NTNaFw0zMDEyMDIwNzM0NTNaMBQx
EjAQBgNVBAMMCWxvY2FsaG9zdDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoC
ggEBAM+mSEy+uCAzMGKvhKAgexFc8gzo99WTnwUkmfEmvr4A/dviouXeGesouX2L
IStN2PODizA32pRloc6opSPBHTn61OcIKhk2C/hWAkGMaMu0D5X8Qn8YG9ocd1BQ
fPkh2jqVt6T+gZPf7dlPbbB3KpnmuMpmziCqDGYOETbXWBNUh+yQTXGqPaFb5zpw
ePKLKxfJa1oExWtqrxg2S2Pwa4LxKEy1SgyE7wTMtetLZs/LzsW0UmwiSaUB8DTh
T1JrzzJRjSYNnVBcAtADLju/O+DBYpXG5gUWpBaRhWkET+VTqOihQKkaNEi88F0i
7vjDv/UR0PGiMYMGvYyfc0RVh/UCAwEAAaMYMBYwFAYDVR0RBA0wC4IJbG9jYWxo
b3N0MA0GCSqGSIb3DQEBCwUAA4IBAQDDqmCMQmmx+e5343ciITcT9TnkVprXJxBD
R6onc1X+0CGE1MCB82HOFek/u0qSM4PgcOoLXIgnpEbwtKqwVrQxygEI+TYqxnSf
Ht9Tg0v3E6wIsaLLkhV2Bu8A0doR7x5and1yCvWSJyVtjUOC3DIGYEG8qlrVxBHR
61mu6rOY0sPqkbDtoes2gLmuuBWAWV59u6px2o/NArxMIDbybRVYnGL1f7AiaaI1
e3JNDLkA7KtyL0uDRz7D4Iw5BqbWiexJxpVq7zKBn6sxuZKh7cGB4WpceG8+1N/d
fUMKcEl/Nk+VyksVACtuMJki2nOIkDU5TwuhhOffQ76uhukFRlOh
-----END CERTIFICATE-----
subject=/CN=localhost
issuer=/CN=localhost
---
No client certificate CA names sent
Server Temp Key: ECDH, P-384, 384 bits
---
SSL handshake has read 1469 bytes and written 410 bytes
---
New, TLSv1/SSLv3, Cipher is ECDHE-RSA-AES256-SHA384
Server public key is 2048 bit
Secure Renegotiation IS supported
Compression: NONE
Expansion: NONE
No ALPN negotiated
SSL-Session:
    Protocol  : TLSv1.2
    Cipher    : ECDHE-RSA-AES256-SHA384
    Session-ID: 7A8C7350B53BCDA7279FCECF97DBEBD587629671FA63A51B7834BFFB5058BBB4
    Session-ID-ctx: 
    Master-Key: 813FFAC994AC095D12C064B86AD9F8A2570A196F324342C2D349028D7169637787E6C836BD003FA525B70D7655F32506
    TLS session ticket lifetime hint: 300 (seconds)
    TLS session ticket:
    0000 - e6 cd 65 2f 57 f7 6b 34-c9 08 dd 9b ee 1b 2c 59   ..e/W.k4......,Y
    0010 - 88 8f c0 fe 63 ad 70 23-40 b0 51 0f ae 68 6e be   ....c.p#@.Q..hn.
    0020 - ad a3 81 86 2a 9a f6 2d-53 c6 96 c7 53 32 87 f7   ....*..-S...S2..
    0030 - 56 84 fe ba 09 1d 7b 43-df 16 0e 31 40 b6 0c c4   V.....{C...1@...
    0040 - be 7a 58 d7 a2 98 a5 8b-fa 79 76 b3 66 95 64 56   .zX......yv.f.dV
    0050 - 65 5f 53 37 eb 41 fa ed-50 a7 72 72 15 85 42 3c   e_S7.A..P.rr..B<
    0060 - 47 77 f5 95 73 26 85 7d-22 2c b1 88 b9 dd 88 0f   Gw..s&.}",......
    0070 - e3 40 c4 72 0c 99 ab b7-37 f7 1a 30 26 fb ea f9   .@.r....7..0&...
    0080 - 92 9f 1a 19 c0 75 95 6b-d6 df 92 92 c8 af 63 f4   .....u.k......c.
    0090 - 1c 4c 69 e9 5a 1b d3 e6-f8 72 a1 00 55 de 94 1c   .Li.Z....r..U...
    00a0 - 13 87 8d aa c8 20 9d 70-9c eb 5f f7 ce f5 35 14   ..... .p.._...5.

    Start Time: 1637449739
    Timeout   : 7200 (sec)
    Verify return code: 18 (self signed certificate)
---
read:errno=54

jensolsson.se

@olivierlambert Now I went by the office and restarted the machine.

Here is kern.log for when it happened. I do not see anything suspicious. I beieve I lost contact in the evening nov 20. Most likely later than the last row of log. I did not find any crashlogs so far.

kern.log.1.txt

jensolsson.se

Here is also the last rows from daemon.log

daemon.log.txt

jensolsson.se

Here is last rows of user.log

Nov 20 15:30:35 xcp-ng-2 xsconsole: Entering sleep due to inactivity - xsconsole is now blocked waiting for a keypress
Nov 20 15:37:31 xcp-ng-2 tapback: tapback.c:601 Identified blktap2 device major = 254
Nov 20 15:37:31 xcp-ng-2 tapback: tapback.c:655 only serving domain 6
Nov 20 15:37:31 xcp-ng-2 scripts-block: backend/vbd3/6/768: add params="/dev/sm/backend/339841b9-29aa-26be-cddb-4a9eb0efc823/698f7af5-97d6-4027-ae41-40b830b881a4"
Nov 20 15:37:31 xcp-ng-2 scripts-block: backend/vbd3/6/768: physical-device=fe:5
Nov 20 15:37:31 xcp-ng-2 scripts-block: backend/vbd3/6/768: writing physical-device=fe:5
Nov 20 15:37:31 xcp-ng-2 scripts-block: backend/vbd3/6/5632: add params=""
Nov 20 15:37:31 xcp-ng-2 scripts-block: backend/vbd3/6/5632: physical-device=
Nov 20 15:37:31 xcp-ng-2 scripts-block: backend/vbd3/6/5632: writing physical-device=
Nov 20 15:37:31 xcp-ng-2 vif-real: Called as: /usr/libexec/xenopsd/vif-real vif 6 0 add
Nov 20 15:37:31 xcp-ng-2 scripts-vif: Called as "vif 6 0 add" domid:6 devid:0 mode:openvswitch
Nov 20 15:37:31 xcp-ng-2 vif-real: Called as: /usr/libexec/xenopsd/vif-real vif 6 0 online
Nov 20 15:37:31 xcp-ng-2 scripts-vif: Called as "vif 6 0 online" domid:6 devid:0 mode:openvswitch
Nov 20 15:37:31 xcp-ng-2 scripts-vif: Setting vif6.0 MTU 1500
Nov 20 15:37:31 xcp-ng-2 scripts-vif: Failed to read backend/vif/6/0/bridge from xenstore. Trying /xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/private/vif/0/bridge
Nov 20 15:37:31 xcp-ng-2 scripts-vif: Adding vif6.0 to xenbr0 with address fe:ff:ff:ff:ff:ff
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19735] - common.py: Detected network backend as: 'openvswitch'
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19735] - Called with interface=vif6.0, uuid=e6e93d04-4447-3f52-7170-3981bd1baa4e, devid=0, network_mode=openvswitch, action=filter
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19735] - ['/sbin/ip', 'link', 'set', 'vif6.0', 'down']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19735] - ['ovs-vsctl', 'get', 'interface', 'vif6.0', 'ofport']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19735] - ['/usr/bin/xenstore-read', '/xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/private/vif/0/pvs-interface']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19735] - ['/usr/bin/xenstore-rm', '/xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/hotplug/6/vif/0/vif-ofport']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19735] - ['ovs-vsctl', '--timeout=30', '--', '--if-exists', 'del-port', 'vif6.0']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19735] - Got locking config: {'ipv4_allowed': [], 'mac': u'26:3e:64:60:71:3e', 'ipv6_allowed': [], 'locking_mode': u'unlocked'}
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19735] - ['/usr/bin/xenstore-read', '/vm/e6e93d04-4447-3f52-7170-3981bd1baa4e/final-uuid']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19735] - ['ovs-vsctl', '--timeout=30', 'add-port', u'xenbr0', 'vif6.0', '--', 'set', 'interface', 'vif6.0', u'external-ids:"xs-network-uuid"="eba52398-0f6d-1184-7c4d-9a173c397a67"', '--', 'set', 'interface', 'vif6.0', u'external-ids:"attached-mac"="26:3e:64:60:71:3e"', '--', 'set', 'interface', 'vif6.0', u'external-ids:"xs-vif-uuid"="614ae45e-53fb-ebfa-d5f0-566b1c45bb19"', '--', 'set', 'interface', 'vif6.0', 'external-ids:"xs-vm-uuid"="e6e93d04-4447-3f52-7170-3981bd1baa4e"']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19735] - ['ovs-vsctl', 'get', 'interface', 'vif6.0', 'ofport']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19735] - ['/usr/bin/xenstore-write', '/xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/hotplug/6/vif/0/vif-ofport', '12']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19735] - ['/usr/bin/xenstore-read', '/xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/private/vif/0/pvs-interface']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19735] - ['/sbin/ip', 'link', 'set', 'vif6.0', 'up']
Nov 20 15:37:31 xcp-ng-2 scripts-vif: vif6.0: writing backend/vif/6/0/hotplug-status=connected
Nov 20 15:37:31 xcp-ng-2 vif-real: Called as: /usr/libexec/xenopsd/vif-real vif 6 0 bind
Nov 20 15:37:31 xcp-ng-2 vif-real: Called as: /usr/libexec/xenopsd/vif-real tap 6 0 add
Nov 20 15:37:31 xcp-ng-2 scripts-vif: Called as "vif 6 0 bind" domid:6 devid:0 mode:openvswitch
Nov 20 15:37:31 xcp-ng-2 scripts-vif: Called as "tap 6 0 add" domid:6 devid:0 mode:openvswitch
Nov 20 15:37:31 xcp-ng-2 scripts-vif: Setting tap6.0 MTU 1500
Nov 20 15:37:31 xcp-ng-2 scripts-vif: Failed to read backend/vif/6/0/bridge from xenstore. Trying /xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/private/vif/0/bridge
Nov 20 15:37:31 xcp-ng-2 scripts-vif: Adding tap6.0 to xenbr0 with address fe:ff:ff:ff:ff:ff
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19840] - common.py: Detected network backend as: 'openvswitch'
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19840] - Called with interface=tap6.0, uuid=e6e93d04-4447-3f52-7170-3981bd1baa4e, devid=0, network_mode=openvswitch, action=filter
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19840] - ['/sbin/ip', 'link', 'set', 'tap6.0', 'down']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19840] - ['ovs-vsctl', 'get', 'interface', 'tap6.0', 'ofport']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19840] - ['/usr/bin/xenstore-read', '/xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/private/vif/0/pvs-interface']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19840] - ['/usr/bin/xenstore-rm', '/xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/hotplug/6/vif/0/tap-ofport']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19840] - ['ovs-vsctl', '--timeout=30', '--', '--if-exists', 'del-port', 'tap6.0']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19840] - Got locking config: {'ipv4_allowed': [], 'mac': u'26:3e:64:60:71:3e', 'ipv6_allowed': [], 'locking_mode': u'unlocked'}
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19840] - ['/usr/bin/xenstore-read', '/vm/e6e93d04-4447-3f52-7170-3981bd1baa4e/final-uuid']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19840] - ['ovs-vsctl', '--timeout=30', 'add-port', u'xenbr0', 'tap6.0', '--', 'set', 'interface', 'tap6.0', u'external-ids:"xs-network-uuid"="eba52398-0f6d-1184-7c4d-9a173c397a67"', '--', 'set', 'interface', 'tap6.0', u'external-ids:"attached-mac"="26:3e:64:60:71:3e"', '--', 'set', 'interface', 'tap6.0', u'external-ids:"xs-vif-uuid"="614ae45e-53fb-ebfa-d5f0-566b1c45bb19"', '--', 'set', 'interface', 'tap6.0', 'external-ids:"xs-vm-uuid"="e6e93d04-4447-3f52-7170-3981bd1baa4e"']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19840] - ['ovs-vsctl', 'get', 'interface', 'tap6.0', 'ofport']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19840] - ['/usr/bin/xenstore-write', '/xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/hotplug/6/vif/0/tap-ofport', '13']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19840] - ['/usr/bin/xenstore-read', '/xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/private/vif/0/pvs-interface']
Nov 20 15:37:31 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[19840] - ['/sbin/ip', 'link', 'set', 'tap6.0', 'up']
Nov 20 15:37:42 xcp-ng-2 vif-real: Called as: /usr/libexec/xenopsd/vif-real tap 6 0 remove
Nov 20 15:37:42 xcp-ng-2 scripts-vif: Called as "tap 6 0 remove" domid:6 devid:0 mode:openvswitch
Nov 20 15:37:42 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20136] - common.py: Detected network backend as: 'openvswitch'
Nov 20 15:37:42 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20136] - Called with interface=tap6.0, uuid=e6e93d04-4447-3f52-7170-3981bd1baa4e, devid=0, network_mode=openvswitch, action=clear
Nov 20 15:37:42 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20136] - ['/sbin/ip', 'link', 'set', 'tap6.0', 'down']
Nov 20 15:37:43 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20136] - ['ovs-vsctl', 'get', 'interface', 'tap6.0', 'ofport']
Nov 20 15:37:43 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20136] - ['ovs-vsctl', 'iface-to-br', 'tap6.0']
Nov 20 15:37:43 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20136] - ['ovs-vsctl', 'br-to-parent', 'xenbr0']
Nov 20 15:37:43 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20136] - ['ovs-ofctl', 'del-flows', 'xenbr0', 'in_port=-1,cookie=1/-1']
Nov 20 15:37:43 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20136] - ['/usr/bin/xenstore-read', '/xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/private/vif/0/pvs-interface']
Nov 20 15:37:43 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20136] - ['/usr/bin/xenstore-rm', '/xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/hotplug/6/vif/0/tap-ofport']
Nov 20 15:37:43 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20136] - ['ovs-vsctl', '--timeout=30', '--', '--if-exists', 'del-port', 'tap6.0']
Nov 20 15:37:43 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20136] - ['/sbin/ip', 'link', 'set', 'tap6.0', 'up']
Nov 20 15:37:43 xcp-ng-2 scripts-vif: tap6.0 has been removed
Nov 20 15:38:25 xcp-ng-2 scripts-block: backend/vbd3/6/5632: remove
Nov 20 15:38:25 xcp-ng-2 scripts-block: backend/vbd3/6/768: remove
Nov 20 15:38:26 xcp-ng-2 vif-real: Called as: /usr/libexec/xenopsd/vif-real vif 6 0 offline
Nov 20 15:38:26 xcp-ng-2 scripts-vif: Called as "vif 6 0 offline" domid:6 devid:0 mode:openvswitch
Nov 20 15:38:26 xcp-ng-2 vif-real: Called as: /usr/libexec/xenopsd/vif-real vif 6 0 unbind
Nov 20 15:38:26 xcp-ng-2 scripts-vif: Called as "vif 6 0 unbind" domid:6 devid:0 mode:openvswitch
Nov 20 15:38:26 xcp-ng-2 vif-real: Called as: /usr/libexec/xenopsd/vif-real vif 6 0 remove
Nov 20 15:38:26 xcp-ng-2 scripts-vif: Called as "vif 6 0 remove" domid:6 devid:0 mode:openvswitch
Nov 20 15:38:26 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20773] - common.py: Detected network backend as: 'openvswitch'
Nov 20 15:38:26 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20773] - Called with interface=vif6.0, uuid=e6e93d04-4447-3f52-7170-3981bd1baa4e, devid=0, network_mode=openvswitch, action=clear
Nov 20 15:38:26 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20773] - ['/sbin/ip', 'link', 'set', 'vif6.0', 'down']
Nov 20 15:38:26 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20773] - ['ovs-vsctl', 'get', 'interface', 'vif6.0', 'ofport']
Nov 20 15:38:26 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20773] - ['ovs-vsctl', 'iface-to-br', 'vif6.0']
Nov 20 15:38:26 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20773] - ['ovs-vsctl', 'br-to-parent', 'xenbr0']
Nov 20 15:38:26 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20773] - ['ovs-ofctl', 'del-flows', 'xenbr0', 'in_port=-1,cookie=1/-1']
Nov 20 15:38:26 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20773] - ['/usr/bin/xenstore-read', '/xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/private/vif/0/pvs-interface']
Nov 20 15:38:26 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20773] - ['/usr/bin/xenstore-rm', '/xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/hotplug/6/vif/0/vif-ofport']
Nov 20 15:38:26 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20773] - ['ovs-vsctl', '--timeout=30', '--', '--if-exists', 'del-port', 'vif6.0']
Nov 20 15:38:26 xcp-ng-2 setup-vif-rules: /usr/libexec/xenopsd/setup-vif-rules[20773] - ['/sbin/ip', 'link', 'set', 'vif6.0', 'up']
Nov 20 15:38:26 xcp-ng-2 scripts-vif: vif6.0: removing backend/vif/6/0/hotplug-status
Nov 20 15:38:26 xcp-ng-2 scripts-vif: vif6.0: removing /xapi/e6e93d04-4447-3f52-7170-3981bd1baa4e/hotplug/6/vif/0/hotplug
Nov 20 15:38:26 xcp-ng-2 scripts-vif: vif6.0 has been removed

stormi

There may be crash logs in /var/crash. See https://xcp-ng.org/docs/troubleshooting.html#kernel-crash-logs

jensolsson.se

@stormi Thanks, I found 2 crashes there, unfortunately these are much older than the latest crashes, so something else must be happening as well.

crash.txt

I had to rename a .tgz to .txt, could not upload otherwise.

Kind regards
Jens

jensolsson.se

Went into BIOS today and found some settings on maximum cpu. I set it to maximum efficiency. I read somewhere that some cpu throttling functions in bios could cause issues.

So far so good, recent days it crashed in the evening every day, and now it is soon midnight so fingers crossed.

jensolsson.se

Still running. Must have been the change I did in the BIOS.