@RobWhalley I think in the beginning i had that option enabled in my backup jobs, but found it was a hassle to move VMs between hosts with it on so i turned it off for all backups. Might be why my jobs worked because i had already done that switch in the past.

marcoi
@marcoi
Regular IT Guy with a passion for hardware and all things tech.
Best posts made by marcoi
-
RE: XO Community edition backups dont work as of build 6b263
-
RE: XO Community edition backups dont work as of build 6b263
posted in the other thread as well but Xen Orchestra, commit 1a7b5 backups are working again. I tested configure and vm backups. They are being backup to NFS share.
-
RE: Backups started to fail again (overall status: failure, but both snapshot and transfer returns success)
try downgrading your nfs to use version 3. I think version 4.x has performance issues.
in you settings-->remote, you can edit the nfs mount for backups and add in the -o options section.I dont know the exact command but you can try using nfsvers=3 and see if that helps.
-
RE: XO Community edition backups dont work as of build 6b263
scratch that prior comment. My backups are all setup as delta backup with schedule 2nd run that forces full backup. So i believe both are working correctly.
if you can also try deleting all the backup snapshots of the VMs in the backup and running full backup then the delta backup jobs.
-
RE: XO (self build) tasks spamming
looks good
Xen Orchestra, commit 384bb
Master, commit 384bbthanks for quick fix
Latest posts made by marcoi
-
Bash script to work with pci passthrough on host
I wrote a simple script to help those of us who want to do pci passthrough and running into xe limits.
Not responsible for issues/use/etc... use at own risk.
Feel free to github/maintain it, i wont be planning on doing any more on it.
I did this to work with pci passthrough and issues i been having while testing a new build. I found out that adding new devices while enabled pci for devices showing in xe can lead to issues and having to do pci hide reset. So i added that. I also added a enable pci device that is on xe so you can do it via app on host or still do it on gui using XO. Finally added a menu to add non xe pci device directly to vm.
Vm list is my list so you need to update that with what you want to enable.Hope this helps someone else
So grab the code, save it to /root/pcishare.sh and chmod +x it to run it.
This is on the host directly.#!/bin/bash # pcieDevices[x] is the name of the device # pcieDevicesID[x] is the id of the device from lspci # pcieDevicesUUID[x] is uuid from xe list if available ######## Add Devices to check and make passthrough ######################### #format pcieDevices[x]='' #make sure to use single quotes are special chars will mess up. ############################################################################## pcieDevices[0]='USB controller: ASMedia Technology Inc. ASM2142/ASM3142 USB 3.1 Host Controller' pcieDevices[1]='VGA compatible controller: NVIDIA Corporation GK208 [GeForce GT 720] (rev a1)' pcieDevices[2]='Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1)' pcieDevices[3]='SATA controller: JMicron Technology Corp. JMB58x AHCI SATA controller' ############################################################################### #Startup pcieCount=${#pcieDevices[@]} #load lspci into array lspciDevices##### mapfile -t lspciDevices < <(lspci) ##################################################################################### #function to request a reboot function rebootPC { read -n 1 -p "Need to reboot host. Y/N to reboot?: " doReboot case $doReboot in y|Y ) reboot;; *|n|N ) clear; echo "please reboot"; exit;; esac } ###################################################################################### # remove old hide list / request reboot function resetDOMPCIE { echo "" echo " Clearing out xen-pciback list " /opt/xensource/libexec/xen-cmdline --delete-dom0 xen-pciback.hide echo "Completed" rebootPC } ###################################################################################### # List variables to confirm which pcie the script is working with function confirmPCIList { clear echo "" echo "***************************************" for (( j=0; j<${#pcieDevices[@]}; j++ )); do echo "*${pcieDevices[$j]}" done echo "***************************************" exit } ###################################################################################### function enablePCI { clear echo "**************************************************" echo "* Please select Index to enable pci passthrough *" echo "**************************************************" echo "" for (( j=0; j<${#pcieDevices[@]}; j++ )); do if [ -n "${pcieDevicesUUID[$j]}" ]; then echo "Index $j: ${pcieDevicesUUID[$j]}-${pcieDevicesID[$j]}:${pcieDevices[$j]}" fi done echo "" echo "" read -n 1 -p "Please make a selection or (E)xit: " menuEnablePCIEchoice; case $menuEnablePCIEchoice in [0-99] ) echo "" xe pci-disable-dom0-access uuid=${pcieDevicesUUID[$menuEnablePCIEchoice]} echo "" rebootPC ;; e|E ) exit;; * ) exit ;; esac } ####################################################################################### function addPCIEVM { clear echo "********************************************************" echo "* Please select Index to enable pci passthrough on VM *" echo "********************************************************" echo "" for (( j=0; j<${#pcieDevices[@]}; j++ )); do if [ -z "${pcieDevicesUUID[$j]}" ]; then echo "Index $j: ${pcieDevicesUUID[$j]}-${pcieDevicesID[$j]}:${pcieDevices[$j]}" fi done echo "" echo "" read -n 1 -p "Please make a selection or (E)xit: " menuAddPCIEchoice; case $menuAddPCIEchoice in [0-99] ) echo "" read -p "Please provide the VM UUID: " vmID; echo "" xe vm-param-set other-config:pci=0/0000:${pcieDevicesID[$menuAddPCIEchoice]} uuid=$vmID echo "" ;; e|E ) exit;; * ) exit ;; esac } ###################################################################################### function setPCIE { ######################################### # Fill in pci ID into pcieDevicesID/UUID # Offer to toggle devices and add non xe device to VM ######################################### clear # build list for (( i=0; i<"${#lspciDevices[@]}"; i++ )); do for (( j=0; j<${#pcieDevices[@]}; j++ )); do if [[ ${lspciDevices[$i]} == *"${pcieDevices[$j]}"* ]]; then pcieDevicesID[$j]="${lspciDevices[$i]%% *}" tempUUID="" tempUUID=$(xe pci-list |grep -B 3 ${pcieDevicesID[$j]} |head -n 1| cut -d ':' -f2 | tr -d ' ') if [ -z "$tempUUID" ]; then echo "Index $j UUID not found for Device: ${pcieDevicesID[$j]} - ${pcieDevices[$j]}" else pcieDevicesUUID[$j]="$tempUUID" echo "Index $j Device:${pcieDevicesUUID[$j]}: ${pcieDevicesID[$j]} - ${pcieDevices[$j]} " fi fi done done echo "**************************************************" echo "* Would you like to: *" echo "* (E)nable pcie device for passthrough *" echo "* (A)dd pcie directly to VM for non UUID *" echo "* (Q)uit *" echo "**************************************************" read -n 1 -p "Please make a selection: " menuPCIEchoice; case $menuPCIEchoice in e|E ) enablePCI;; a|A ) addPCIEVM;; q|Q ) exit ;; * ) exit ;; esac } ################################################## # Menu - App choices below ################################################# clear echo "****************************************" echo "* Please make sure to add your devices *" echo "* to the varible list before running *" echo "* *" echo "* Menu *" echo "* Select options below to continue *" echo "* 1. Reset PCIE hide list and DOM *" echo "* 2. Show PCIE variable list *" echo "* 3. Set pci devices *" echo "* Any other key to exit *" echo "****************************************" read -n 1 -p "Please make a selection: " menuChoice; case $menuChoice in 1 ) resetDOMPCIE;; 2 ) confirmPCIList;; 3 ) setPCIE ;; 4 ) echo "" ;; * ) clear ; exit ;; esac
-
RE: XO (self build) tasks spamming
looks good
Xen Orchestra, commit 384bb
Master, commit 384bbthanks for quick fix
-
RE: PCI device doesn't show in XO or xe pci-list
xe vm-param-set other-config:pci=0/0000:c6:00.0 uuid=45d0f537-9076-b395-1fbd-850d2cc0cf68
This command worked. I was able to pass through the usb and also pcie devices i can get to using XO.
windows host showing usb drive plugged into usb3 card and graphics card.
-
RE: PCI device doesn't show in XO or xe pci-list
@olivierlambert to confirm the steps
i can skip this step since it isnt showing up anyways- xe pci-disable-dom0-access uuid=<pci uuid>
then use
- xe vm-param-set other-config:pci=0/0000:04:01.0 uuid=<vm uuid> to add it to vm
-
RE: PCI device doesn't show in XO or xe pci-list
@olivierlambert thanks for the update.
and just to confirm, if a device is not showing up in xe list with uuid, there is no way to pass it to a VM correct? -
RE: PCI device doesn't show in XO or xe pci-list
@andriy.sultanov is there a way to allow all devices (even if we blow up the system lol)
For example in the docs there a usb filter list you can edit
/etc/xensource/usb-policy.confanything similar for pcie? Can something be added with disclaimer you break it on you etc?
Maybe make it a command line option to disable the pci device filters for users that want to pass through special devices. -
RE: XO (self build) tasks spamming
@olivierlambert
Okay i got it I am running
Xen Orchestra, commit 09f67
Master, commit 35428I will watch it and see how the tasks issue goes
Update 2: been about 20 mins and nothing showing up in the task list.
-
RE: XO (self build) tasks spamming
is this in the latest build or do i need to download a separate branch etc? I'm using a script someone made to build my XO so not sure how to do a separate branch but if the change made it into main build i can download an update and test as well.
-
RE: PCI device doesn't show in XO or xe pci-list
here my list - items c6, c8, c9 are not showing up.
00:00.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1507]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1507]" 00:00.2 "IOMMU [0806]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1508]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1508]" 00:01.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" "" 00:01.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150a]" "" "" 00:01.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150a]" "" "" 00:02.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" "" 00:02.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" "" 00:02.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" "" 00:02.4 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" "" 00:02.5 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" "" 00:03.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" "" 00:03.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" "" 00:03.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" "" 00:08.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" "" 00:08.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150c]" "" "" 00:08.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150c]" "" "" 00:08.3 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150c]" "" "" 00:14.0 "SMBus [0c05]" "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH SMBus Controller [790b]" -r71 "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH SMBus Controller [790b]" 00:14.3 "ISA bridge [0601]" "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH LPC Bridge [790e]" -r51 "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH LPC Bridge [790e]" 00:18.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16f8]" "" "" 00:18.1 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16f9]" "" "" 00:18.2 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fa]" "" "" 00:18.3 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fb]" "" "" 00:18.4 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fc]" "" "" 00:18.5 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fd]" "" "" 00:18.6 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fe]" "" "" 00:18.7 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16ff]" "" "" c1:00.0 "SATA controller [0106]" "JMicron Technology Corp. [197b]" "JMB58x AHCI SATA controller [0585]" -p01 "JMicron Technology Corp. [197b]" "Device [0000]" c2:00.0 "Non-Volatile memory controller [0108]" "Samsung Electronics Co Ltd [144d]" "NVMe SSD Controller SM961/PM961/SM963 [a804]" -p02 "Samsung Electronics Co Ltd [144d]" "SM963 2.5\" NVMe PCIe SSD [a801]" c3:00.0 "Ethernet controller [0200]" "Aquantia Corp. [1d6a]" "AQtion AQC113 NBase-T/IEEE 802.3an Ethernet Controller [Antigua 10G] [04c0]" -r03 "Aquantia Corp. [1d6a]" "Device [0001]" c4:00.0 "Ethernet controller [0200]" "Realtek Semiconductor Co., Ltd. [10ec]" "Device [8126]" -r01 "Realtek Semiconductor Co., Ltd. [10ec]" "Device [0123]" c5:00.0 "VGA compatible controller [0300]" "NVIDIA Corporation [10de]" "GK208 [GeForce GT 720] [1286]" -ra1 "NVIDIA Corporation [10de]" "Device [1087]" c5:00.1 "Audio device [0403]" "NVIDIA Corporation [10de]" "GK208 HDMI/DP Audio Controller [0e0f]" -ra1 "NVIDIA Corporation [10de]" "Device [1087]" c6:00.0 "USB controller [0c03]" "Etron Technology, Inc. [1b6f]" "EJ168 USB 3.0 Host Controller [7023]" -r01 -p30 "Unknown vendor [7023]" "Device [1b6f]" c7:00.0 "Display controller [0380]" "Advanced Micro Devices, Inc. [AMD/ATI] [1002]" "Device [150e]" -rd1 "Unknown vendor [1f4c]" "Device [b020]" c7:00.1 "Audio device [0403]" "Advanced Micro Devices, Inc. [AMD/ATI] [1002]" "Rembrandt Radeon High Definition Audio Controller [1640]" "Unknown vendor [1f4c]" "Device [b020]" c7:00.2 "Encryption controller [1080]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17e0]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17e0]" c7:00.4 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151e]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [15b9]" c7:00.6 "Audio device [0403]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Family 17h/19h HD Audio Controller [15e3]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [d808]" c7:00.7 "Signal processing controller [1180]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [164a]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [164a]" c8:00.0 "Non-Essential Instrumentation [1300]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150d]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150d]" c8:00.1 "Signal processing controller [1180]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17f0]" -r10 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17f0]" c9:00.0 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151f]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [15b9]" c9:00.3 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151a]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151a]" c9:00.4 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151b]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151b]" c9:00.5 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151c]" -p40 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151c]" c9:00.6 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151d]" -p40 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151d]"
-
RE: PCI device doesn't show in XO or xe pci-list
Just to add details about my box. Seems lspci is showing 20 items and xe/xo is only showing 12.
I left the device name in the second list to help show whats not showing up in xe vs lscpiXE/XO list
pci-id ( RO): 0000:c1:00.0 pci-id ( RO): 0000:c2:00.0 pci-id ( RO): 0000:c3:00.0 pci-id ( RO): 0000:c4:00.0 pci-id ( RO): 0000:c5:00.0 pci-id ( RO): 0000:c5:00.1 pci-id ( RO): 0000:c7:00.0 pci-id ( RO): 0000:c7:00.1 pci-id ( RO): 0000:c7:00.2 pci-id ( RO): 0000:c7:00.4 pci-id ( RO): 0000:c7:00.6 pci-id ( RO): 0000:c7:00.7
VS lspci list
c1:00.0 SATA controller: JMicron Technology Corp. JMB58x AHCI SATA controller c2:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961/SM963 c3:00.0 Ethernet controller: Aquantia Corp. AQtion AQC113 NBase-T/IEEE 802.3an Ethernet Controller [Antigua 10G] (rev 03) c4:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. Device 8126 (rev 01) c5:00.0 VGA compatible controller: NVIDIA Corporation GK208 [GeForce GT 720] (rev a1) c5:00.1 Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1) c6:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller (rev 01) c7:00.0 Display controller: Advanced Micro Devices, Inc. [AMD/ATI] Device 150e (rev d1) c7:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller c7:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Device 17e0 c7:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Device 151e c7:00.6 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller c7:00.7 Signal processing controller: Advanced Micro Devices, Inc. [AMD] Device 164a c8:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 150d c8:00.1 Signal processing controller: Advanced Micro Devices, Inc. [AMD] Device 17f0 (rev 10) c9:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 151f c9:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Device 151a c9:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Device 151b c9:00.5 USB controller: Advanced Micro Devices, Inc. [AMD] Device 151c c9:00.6 USB controller: Advanced Micro Devices, Inc. [AMD] Device 151d