It is, if you don't use ZFS. ZFS is a memory hog.

@mohammadm Could you share information about your configuration. What system do you use on guest VM? What drivers you are using on guest VM? On VM you are using bios or uefi? I am trying to get to the point where VM can detect GPU but I have some problems. Recreating your guest configuration can simplify things.

@olivierlambert said in Hailo-8L AI accellerator PCI passthrough causes xcp-ng hypervisor infinite boot-loop: Hmm could the module causing the crash if the device isn't accessible? A quick google found this thread on a proxmox forum - according to that user it causes a hotplug event when it initializes. https://forum.proxmox.com/threads/hailo-8-ai-m-2-card-crashes-server-when-using-passthrough.166428/ Seems these AI cards are a bit of a pain - remembering the continuing issue with Google Coral pcie cards

Understood, thank you.

@DustinB Hmm - just got done running mem86+ - 4 passes -- all 14 tests. No RAM errors. I wonder the what would cause this error? I'll probably just save config and reinstall. So strange.

@splastunov said in Intel x710-t2l Problems: xe vif-param-set uuid=VIFUUID other-config:ethtool-tx="off" xe vif-param-set uuid=VIFUUID other-config:ethtool-rx="off" Hi! Thanks for your input. I set the vif parameters as suggested and am still unable to ping the gateway.

Excellent news!

Ok just to close the loop here. Problem persisted with Intel Arc (the only thing I forgot to do was disable REBAR, but I don't think this is a related issue). Upon installing Radeon RX 6400, pass through worked without any issue. Of note, on the Arc I got two separately numbered PCI devices 0000:0b and 0000:0a where as with the AMD it was 0000.08.01 and .02. I'm not sure if that helps hint at the issue --something to do with grouping and not grouping? This is way above my head but I noticed the difference. I'm still having issues with pass through into Linux but that is a separate topic. Looks like we have a good discussion of this issue on the other post and so I will stay on that one going forward. Thank you!

@Danp UEFI

@olivierlambert While VDI is maybe not as vital as it once was...I'm experimenting with multimedia work in XCP-ng. Having a VM with GPU off-loading of CODEC encoding would be nice. It's a pretty big CPU hit to make that go.

@Forza said in MegaCLI and StorCLI lastest version for 8.3 LTS: @jangar don't they have a statically linked version of storcli that can be downloaded? latest version is for min RHEL 8x i have older version https://docs.broadcom.com/docs-and-downloads/raid-controllers/raid-controllers-common-files/8-07-14_MegaCLI.zip and https://docs.broadcom.com/docs-and-downloads/007.2705.0000.0000_storcli_rel.zip i've installed them and seem work, but i'm not sure other command thank check raid status work tomorrow. wget https://docs.broadcom.com/docs-and-downloads/raid-controllers/raid-controllers-common-files/8-07-14_MegaCLI.zip unzip 8-07-14_MegaCLI.zip rpm -ivh Linux/MegaCli-8.07.14-1.noarch.rpm alternatives --install '/usr/bin/MegaCli64' 'MegaCli64' '/opt/MegaRAID/MegaCli/MegaCli64' 1 alternatives --install '/usr/bin/MegaCli' 'MegaCli' '/opt/MegaRAID/MegaCli/MegaCli64' 1 alternatives --install '/usr/bin/megacli' 'megacli' '/opt/MegaRAID/MegaCli/MegaCli64' 1 wget https://docs.broadcom.com/docs-and-downloads/007.2705.0000.0000_storcli_rel.zip unzip 007.2705.0000.0000_storcli_rel.zip cd storcli_rel unzip Unified_storcli_all_os.zip rpm -ivh Unified_storcli_all_os/Linux/storcli-007.2705.0000.0000-1.noarch.rpm alternatives --install '/usr/bin/StorCli64' 'StorCli64' '/opt/MegaRAID/storcli/storcli64' 1 alternatives --install '/usr/bin/StorCli' 'StorCli' '/opt/MegaRAID/storcli/storcli64' 1 alternatives --install '/usr/bin/storcli' 'storcli' '/opt/MegaRAID/storcli/storcli64' 1

@olivierlambert Thank you for bringing this to the attention of other folks

The initial reason we've chosen to create an "all-in-one" ISO image was to simplify further configuration of an automated installation with PXE / Answerfile. We tried driver disks before, though in our special case of mellanox-mlnxen-alt and hardware without any other NICs, I believe it always ends up requiring manual intervention. I haven't found a way to load the driver disk in the installer that is not connected to the network. I think, even though my approach requires a bit more effort, it can still prove useful in some cases.

@flakpyro i try to find a new version but site and search only found 3.3.0. When try to search again in a proxmon forum found the repo xD

Hi @qwkcroc, Unfortunately there are no packages available for XCP-ng right now. The current work for Q35 support takes place on top of upstream versions of Xen and Qemu that are more recent than the ones ran by XCP-ng. Once upstreamed it will be possible to backport it (and we will do so of course) but it's not yet planned. Also, additionally to Xen and Qemu, there will be work needed on the XCP-ng toolstack before being able to enable Q35 support and PCIe device passthhroug. My work trees are available for both Xen and Qemu so if you feel adventurous enough you can give it a try. I was able to passthough an NVMe device to a VM using this kind of setup (with some hacks in Qemu though...). Regards, Thierry

@gb.123 In XO on the "Advanced" tab for the VM I added the GPU devices by first adding them both as "Attached PCIs" near the bottom of the page. I also disabled the "VGA" option under "Xen Settings" and clicked the "+" next to "GPUs" and added the vGPU type "passthrough () 0x0" which was available on the drop-down list. I don't know if it matters or not, but I also set the "Static Max", "Dynamic Min", and "Dynamic Max" memory limits under "VM limits" to the total RAM size I allocated the VM.

Ahh excellent news! Thanks for keeping us posted

@dmz0001 In theory, XCP-ng 8.3 is mostly on par with XenServer 8.4, it's only a naming thing that they did as their previous naming was confusing some of their customers. Long story short, XCP-ng ~= XenServer 8.4. So what you see in the compatibility list of XenServer 8.4 is the right reference for XCP-ng 8.3. Unfortunately we do not have much feedback on Zen 5 at this time on our side.

@TeddyAstie Thanks for the input. This is what I was afraid of somehow In the meantime (a few months ago) I have done some tests with the machine. Installed opnsense as described in the opening post and directly to the device without xcp-ng just to see if there is any issue. The result is the same (i have used in both cases the same settings and same spoofed mac) the spoofing did work without xcp-ng, this is why I was hoping that something can be done via xcp. @olivierlambert said in NIC Passthrough with mac spoofing: Out of curiosity, what about SRIOV in that case? Regarding SRIOV right now its not possible for me to check if thats enabled/supported in the bios but its a good point, thanks Will take about 3-4 weeks to check.