@olivierlambert shoutout to @danp that did a takeover of the incident ticket
he headed me the right way to resolution of the problem, my production pool is back up & running with its VMs.
there was indeed a diff between what was seen by "xl list"/"xenops-cli list" and what was seen by XOA in the web ui.
a couple "xl destroy pid" to destroy zombie VMs, and toolstack restarts later, all is now up.
I don't know how the hell a simple RPU did get me in this situation though...
currently having heavy issues with a production cluster of 3 hosts
RPU launched, all VMs except one did evacuate the Master. we managed to shutdown this VM/restart it on another host
we had 
Master patch & reboot proceeded
Then RPU tried to evacuate a slave host and all VM are now locked we can't shutdown/hard shutdown them,
we have a critical VM on this host that is still running, we tried to snapshot it in case of need of hard reboot of the host, but OPERATION NOT SUPPORTED DURING AN UPGRADE
we manually install patches on the host without reboot and then snapshot proceeded
I hope this VM is secured by this snapshot...
ticket is open with pro support but quite stalled for now... no news since yesterday Ticket#7751752
@gduperrey we had the XOA update alert, upgraded to XOA 6.1.0
but no sign of XCP hosts updates ?
When patches are available, it usually pops up on its own, is there something to do on cli now ?
EDIT : my bad, we had a DNS resolution problem... I now see a bunch of updates available...
@olivierlambert planning to give RustFS a try, i'll report back (currently full minio)
@DRWhite85 as said earlier, you can.
select whatever template. and then modify ALL the params you want. templates are just ... templates... presets...
@DRWhite85 templates are just pre sets for your VM, you can modify everything and build your VM as you wish ?
@ditzy-olive what bugs me is that error is happening 15h after the start 
1.6Tb disks in total, you could detach disks, migrate VM+system, then migrate secondary disks and re attach them ?
or try offline migrating ? perhaps this VM is too i/o intensive and fills up its snapshots ?
source and destination SRs are thin or thick ?
@ditzy-olive Hi,
What are the type of SRs (Source and destination ?) NFS . iSCSI ? local or shared ?
What is the free space on both, before launching the migration ?
@olivierlambert 3 hours now without outages.
I think something was in the way (from where we are, sooooo many thnigs can get in the way of submarine cables)
@Danp if no one else complains, I have a problem
ping OK, no TCP 443. strange.
does https://status.vates.tech/status/default take into account XOA accessibility to xen-orchestra.com ?
ping is 100% responding, but TCP 443 gets the outages.
Hi,
I don't know if anyone else is impacted, but we have several outages of xen-orchestra.com
it goes and come back.
other internet sites are OK... witnessed on different FAI from here
are those outages from Vates ? or global outage of something in the way between me and them ?
@iamsumeshks as said on reddit, it seems that you are good to go
monitor your nics bandwidth in hosts stats to ensure it goes on the good pif.
PREFNIC is the one where DRBD works i guess
@Bastien-Nollet said in backup mail report says INTERRUPTED but it's not ?:
Ok so 1s is slightly not enough, thanks for the update.
Reply
still had issues with 2 sec delay.
it has now been 2 days with 3 sec delay, and no more. could be the sweet spot
@Bastien-Nollet another interrupted today.
I'll add one second by one second till I see it disappear.
just modified to 2s delay.
@Bastien-Nollet oopsy.
sadly, INTERRUPTED is back....
this is what I see in the backup report (a backup job of 12VMs to same S3 remote, only 1 interrupted...)
backup JOB in XOA is all green :
26 backups in a row without interruption, spanning 2 days
And i'm on the 1 second fix
guess it is enough...
@Bastien-Nollet said in backup mail report says INTERRUPTED but it's not ?:
I've done some more testing and looked at the code, and I wasn't able to reproduce this behaviour once. It's also unclear to me why it can happen.
I didn't tell but my Remotes are S3 Remotes... could it be because of that ?
@dcskinner make it a user préférence, and we get the best of both worlds 
