XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login
    1. Home
    2. Forza
    Offline
    • Profile
    • Following 1
    • Followers 0
    • Topics 91
    • Posts 438
    • Groups 0

    Forza

    @Forza

    103
    Reputation
    105
    Profile views
    438
    Posts
    0
    Followers
    1
    Following
    Joined
    Last Online
    Website wiki.tnonline.net

    Forza Unfollow Follow

    Best posts made by Forza

    • RE: [WARNING] XCP-ng Center shows wrong CITRIX updates for XCP-ng Servers - DO NOT APPLY - Fix released

      @Biggen At the moment, xcp-ng center provides some better views and overviews not yet available in XO.. Hoping next major version fixes this 🙂

      posted in News
      ForzaF
      Forza
    • RE: Best CPU performance settings for HP DL325/AMD EPYC servers?

      Sorry for spamming the thread. 🙂

      I have two identical servers (srv01 and srv02) with AMD EPYC 7402P 24 Core CPUs. On srv02 I enabled the LLC as NUMA Node.

      I've done some quick benchmarks with Sysbench on Ubuntu 20.10 with 12 assigned cores. Command line: sysbench cpu run --threads=12

      It would seem that in this test the NUMA option is much faster, 194187 events vs 103769 events. Perhaps I am misunderstanding how sysbench works?

      b65ec3da-4b1d-430e-b90d-02542fe59552-image.png

      With 7-zip the gain is much less, but still meaningful. A little slower in single-threaded performance but quite a bit faster in multi-threaded mode.
      f9592ee9-d327-4ce1-9e34-0ee86280d9e9-image.png

      posted in Compute
      ForzaF
      Forza
    • RE: Host stuck in booting state.

      Problem was a stale connection with the NFS server. A reboot of the NFS server fixed the issue.

      posted in Compute
      ForzaF
      Forza
    • RE: Restoring a downed host ISNT easy

      @xcprocks said in Restoring a downed host ISNT easy:

      So, we had a host go down (OS drive failure). No big deal right? According to instructions, just reinstall XCP on a new drive, jump over into XOA and do a metadata restore.

      Well, not quite.

      First during installation, you really really must not select any of the disks to create an SR as you could potentially wipe out an SR.

      Second, you have to do the sr-probe and sr-introduce and pbd-create and pbd-plug to get the SRs back.

      Third, you then have to use XOA to restore the metadata which according to the directions is pretty simple looking. According to: https://xen-orchestra.com/docs/metadata_backup.html#performing-a-restore

      "To restore one, simply click the blue restore arrow, choose a backup date to restore, and click OK:"

      But this isn't quite true. When we did it, the restore threw an error:

      "message": "no such object d7b6f090-cd68-9dec-2e00-803fc90c3593",
      "name": "XoError",

      Panic mode sets in... It can't find the metadata? We try an earlier backup. Same error. We check the backup NFS share--no its there alright.

      After a couple of hours scouring the internet and not finding anything, it dawns on us... The object XOA is looking for is the OLD server not a backup directory. It is looking for the server that died and no longer exists. The problem is, when you install the new server, it gets a new ID. But the restore program is looking for the ID of the dead server.

      But how do you tell XOA, to copy the metadata over to the new server? It assumes that you want to restore it over an existing server. It does not provide a drop down list to pick where to deploy it.

      In an act of desperation, we copied the backup directory to a new location and named it with the ID number of the newly recreated server. Now XOA could restore the metadata and we were able to recover the VMs in the SRs without issue.

      This long story is really just a way to highlight the need for better host backup in three ways:

      A) The first idea would be to create better instructions. It ain't nowhere as easy as the documentation says it is and it's easy to mess up the first step so bad that you can wipe out the contents of an SR. The documentation should spell this out.

      B) The second idea is to add to the metadata backup something that reads the states of SR to PBD mappings and provides/saves a script to restore them. This would ease a lot of the difficulty in the actual restoring of a failed OS after a new OS can be installed.

      C) The third idea is provide a dropdown during the restoration of the metadata that allows the user to target a particular machine for the restore operation instead of blindly assuming you want to restore it over a machine that is dead and gone.

      I hope this helps out the next person trying to bring a host back from the dead, and I hope it also helps make XOA a better product.

      Thanks for a good description of the restore process.

      I was wary of the metadata-backup option. It sounds simple and good to have, but as you said it is in no way a comprehensive restore of a pool.

      I'd like to add my own oppinion here. A full pool restore, including network, re-attaching SRs and everything else that is needed to quickly get back up and running. Also a restore pool backup should be available on the boot media. It could look for a NFS/CIFS mount or a USB disk with the backup files on. This would avoid things like issues with bonded networks not working.

      posted in Xen Orchestra
      ForzaF
      Forza
    • RE: Remove VUSB as part of job

      Might a different solution be to use a USB network bridge instead of direct attached USB? Something like this https://www.seh-technology.com/products/usb-deviceserver/utnserver-pro.html (There are different options available)... We use my-utn-50a with hardware USB keys and it has shown to be very reliable over the years.

      posted in Xen Orchestra
      ForzaF
      Forza
    • RE: Citrix or XCP-ng drivers for Windows Server 2022

      @dinhngtu Thank you. I think it is clear for me now.

      The docs at https://xcp-ng.org/docs/guests.html#windows could be improved to cover all three options but also to be a little more concise to make it easier to read.

      posted in XCP-ng
      ForzaF
      Forza
    • RE: I/O errors on file restore

      I re-checked again but the issue is unfortunately not resolved. It does not happen on all VMs and files, so maybe there is something wrong somehow in the VDI?

      posted in Backup
      ForzaF
      Forza
    • RE: ZFS for a backup server

      @McHenry

      Looks like you want disaster recovery option. It creates a ready-to-use VM on a separate XCP-ng server. If your main server fails you can start the vm directly off the second server.

      In any case, backups can be restored with XO to any server and storage available in XCP-ng.

      posted in Backup
      ForzaF
      Forza
    • RE: Need some advice on retention

      @rtjdamen you could simply make two backup jobs, one for daily backups and one for monthly backups.

      posted in Backup
      ForzaF
      Forza
    • RE: All NFS remotes started to timeout during backup but worked fine a few days ago

      Since the nfs shares can be mounted on other hosts, I'd guess a fsid/clientid mismatch.

      In the share, always specify fsid export option. If you do not use it, the nfs server tries to determine a suitable id from the underlying mounts. It may not always be reliable, for example after an upgrade or other changes. Now, if you combine this with a client that uses hard mount option and the fsid changes, it will not be possible to recover the mount as the client keeps asking for the old id.

      Nfs3 uses rpcbind and nfs4 doesn't, though this shouldn't matter if your nfs server supports both protocols. With nfs4 you should not export the same directory twice. That is do not export the root directory /mnt/datavol if /mnt/datavol/dir1 and /mnt/datavol/dir2 are exported.

      So to fix this, you can adjust your exports (fsid, nesting) and the nfs mount option (to soft) , reboot the nfs server and client and see if it works.

      posted in Backup
      ForzaF
      Forza

    Latest posts made by Forza

    • RE: Epyc VM to VM networking slow

      OK, thanks for the update. I would be interesting to hear what AMD said about this issue.

      posted in Compute
      ForzaF
      Forza
    • RE: Epyc VM to VM networking slow

      @TeddyAstie Unfortunately not. This is a production pool on 8.2.1 so I do not want to try too experimental things.

      Do we know if the issue happens on plain Xen on a modern (6.12-15) dom0 kernel?

      posted in Compute
      ForzaF
      Forza
    • RE: Epyc VM to VM networking slow

      @olivierlambert said in Epyc VM to VM networking slow:

      If we become partners officially, we'll be able to have more advanced accesses with their teams. I still have hope, it's just that the pace isn't on me.

      Hi, is there anything new to report on this? We have very powerful machines, but unfortunately limited by this stubborn issue.

      posted in Compute
      ForzaF
      Forza
    • RE: Custom Netdata configuration to send metrics to an InfluxDB

      @etlweather isnt netdata just monitoring dom0 cpu, not xen hypervisor itswlf.

      posted in Management
      ForzaF
      Forza
    • RE: Retention for log files and audit logs

      @Bastien-Nollet Thanks for checking. At least I know it is set to 20000 entries at the moment. Thank you.

      posted in Xen Orchestra
      ForzaF
      Forza
    • RE: Retention for log files and audit logs

      @olivierlambert thanks! Logrotate seems easy enough to understand and adjust if needed. It's the audit and XOA logs that I need help understanding.

      posted in Xen Orchestra
      ForzaF
      Forza
    • Retention for log files and audit logs

      Is there a way to define the maximum retention on audit logs (the audit plugin in XOA) and the general XOA and XCP-ng application logs?

      posted in Xen Orchestra
      ForzaF
      Forza
    • RE: Xen ERMS Patch - Call for performance testing

      Would be very interesting to see the performance on EPYC systems.

      posted in Development
      ForzaF
      Forza
    • RE: Live Migration Very Slow

      @olivierlambert aha, I misinderstood. Should I open another topic or perhaps a support ticket?

      posted in Management
      ForzaF
      Forza
    • RE: ACPI Error: SMBus/IPMI/GenericSerialBus

      @dinhngtu Yes, looks like it. I stopped Netdata and the problem went away. But it is strange it started after the latest set of updates.

      posted in XCP-ng
      ForzaF
      Forza