Posts made by marcoi | XCP-ng and XO forum

marcoi

@tc-atwork thanks for post, i wasnt able to get xo6 setup as i havent had time to play with it. I look forward to when it released. For now I just keep using xo-lite to open the console window.

marcoi

@olivierlambert

I will have to figure out how to get XO 6 up and running.

marcoi

just for reference. Under console tab in XO you have all the extra around the display

which is fine for quick access to do something but becomes a hassle when trying to work with the vm display.

XO lite open in a new tab is clean interface. And it expands with the broswer.

PS looking forward to the copy/paste feature being implemented.

marcoi

@probain I tried that just now, not really doing anything in XO. I am under console tab on a VM.

On a side note, seem like the url for the new tab function in xo lite is

https://MasterHostIP/#/vm/5de057e5-97a0-937f-15d6-ef8793c54331/console?ui=0
Maybe because of the IP being the host and not XO it may be harder to implement as a button on XO?

marcoi

I found under XO lite the open console in new tab an awesome feature. Its better then remote desktop especially for linux based VMs. I would like a button to provide the same feature in XO if possible.

Maybe somewhere in this group of buttons.

marcoi

Mine seems to work okay.

Xen Orchestra, commit 1c01f
Master, commit 1c01f

marcoi

updated on my three servers no issues.

marcoi

so it seems like when i make the igpu pass through, i see the starting lines of xcp-ng but it never gets to the console screen. which is what i expect.
When I add the pcie devices (igpu/hdmi audio) to a vm and start it up, I get and update to the screen and it shows a red number counting which is part of the console.
So it seems that when the VM re-initializes the igpu, dom/xcp retakes it over.
I confirmed that by using the keyboard to move around and it reshowing the console and filling the missing details as i move around.
So why is the dom/xcp retaking the video device over again when it should be blocked from accessing it?

marcoi

is there anyway to block igpu from being used by xcp-ng during boot? I have it setup for pass through but it fails under the VM. I think it because xcp-ng still displaying the console screen and does not want to give it up.

marcoi

I wrote a simple script to help those of us who want to do pci passthrough and running into xe limits.
Not responsible for issues/use/etc... use at own risk.
Feel free to github/maintain it, i wont be planning on doing any more on it.
I did this to work with pci passthrough and issues i been having while testing a new build. I found out that adding new devices while enabled pci for devices showing in xe can lead to issues and having to do pci hide reset. So i added that. I also added a enable pci device that is on xe so you can do it via app on host or still do it on gui using XO. Finally added a menu to add non xe pci device directly to vm.
Vm list is my list so you need to update that with what you want to enable.

Hope this helps someone else

So grab the code, save it to /root/pcishare.sh and chmod +x it to run it.
This is on the host directly.

#!/bin/bash

# pcieDevices[x] is the name of the  device
# pcieDevicesID[x] is the id of the device from lspci
# pcieDevicesUUID[x] is uuid from xe list if available

######## Add Devices to check and make passthrough #########################
#format pcieDevices[x]='' #make sure to use single quotes are special chars will mess up.
##############################################################################
pcieDevices[0]='USB controller: ASMedia Technology Inc. ASM2142/ASM3142 USB 3.1 Host Controller'
pcieDevices[1]='VGA compatible controller: NVIDIA Corporation GK208 [GeForce GT 720] (rev a1)'
pcieDevices[2]='Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1)'
pcieDevices[3]='SATA controller: JMicron Technology Corp. JMB58x AHCI SATA controller'
###############################################################################

#Startup
pcieCount=${#pcieDevices[@]}

#load lspci into array lspciDevices#####
mapfile -t lspciDevices < <(lspci)

#####################################################################################
#function to request a reboot
function rebootPC
{
  read -n 1 -p "Need to reboot host. Y/N to reboot?: " doReboot
  case $doReboot in
        y|Y ) reboot;;
        *|n|N ) clear; echo "please reboot"; exit;;
  esac
}

######################################################################################
# remove old hide list / request reboot
function resetDOMPCIE 
{
  echo ""  
  echo " Clearing out xen-pciback list "

  /opt/xensource/libexec/xen-cmdline --delete-dom0 xen-pciback.hide
  
  echo "Completed"
  rebootPC

}
######################################################################################
# List variables to confirm which pcie the script is working with
function confirmPCIList
{
  clear
  echo ""
  echo "***************************************"
  for (( j=0; j<${#pcieDevices[@]}; j++ )); do
    echo "*${pcieDevices[$j]}"
  done
  echo "***************************************"
exit
}
######################################################################################
function enablePCI
{
clear
echo "**************************************************"
echo "* Please select Index to enable pci passthrough  *"
echo "**************************************************"
echo ""

for (( j=0; j<${#pcieDevices[@]}; j++ )); do
  if [ -n "${pcieDevicesUUID[$j]}" ]; then
    echo "Index $j: ${pcieDevicesUUID[$j]}-${pcieDevicesID[$j]}:${pcieDevices[$j]}"
  fi
done
echo ""
echo ""
read -n 1 -p  "Please make a selection or (E)xit: " menuEnablePCIEchoice;

case $menuEnablePCIEchoice in
 [0-99] ) 
     echo ""
     xe pci-disable-dom0-access uuid=${pcieDevicesUUID[$menuEnablePCIEchoice]}
     echo ""
     
     rebootPC
 ;; 
 e|E ) exit;;
 * )  exit ;;
esac
}
#######################################################################################
function addPCIEVM
{
clear
echo "********************************************************"
echo "* Please select Index to enable pci passthrough on VM  *"
echo "********************************************************"
echo ""

for (( j=0; j<${#pcieDevices[@]}; j++ )); do
  if [ -z "${pcieDevicesUUID[$j]}" ]; then
    echo "Index $j: ${pcieDevicesUUID[$j]}-${pcieDevicesID[$j]}:${pcieDevices[$j]}"
  fi
done
echo ""
echo ""
read -n 1 -p  "Please make a selection or (E)xit: " menuAddPCIEchoice;

case $menuAddPCIEchoice in
 [0-99] )
     echo ""
     read -p  "Please provide the VM UUID: " vmID;
     echo ""
     xe vm-param-set other-config:pci=0/0000:${pcieDevicesID[$menuAddPCIEchoice]} uuid=$vmID
     echo ""
 ;;
 e|E ) exit;;
 * )  exit ;;
esac
}
######################################################################################
function setPCIE
{
#########################################
# Fill in pci ID into pcieDevicesID/UUID
# Offer to toggle devices and add non xe device to VM
#########################################

clear

# build list
for (( i=0; i<"${#lspciDevices[@]}"; i++ )); do
 for (( j=0; j<${#pcieDevices[@]}; j++ )); do
  if [[ ${lspciDevices[$i]} ==  *"${pcieDevices[$j]}"*  ]]; then
   pcieDevicesID[$j]="${lspciDevices[$i]%% *}"
   tempUUID=""
   tempUUID=$(xe pci-list |grep -B 3 ${pcieDevicesID[$j]} |head -n 1| cut -d ':' -f2 | tr -d ' ')

   if [ -z "$tempUUID" ]; then
       echo "Index $j UUID not found for Device: ${pcieDevicesID[$j]} - ${pcieDevices[$j]}"
   else
      pcieDevicesUUID[$j]="$tempUUID"
      echo "Index $j Device:${pcieDevicesUUID[$j]}: ${pcieDevicesID[$j]} - ${pcieDevices[$j]} "
   fi
  fi
 done
done

echo "**************************************************"
echo "* Would you like to:                             *"
echo "* (E)nable pcie device for passthrough           *"
echo "* (A)dd pcie directly to VM for non UUID         *"
echo "* (Q)uit                                         *"
echo "**************************************************"

read -n 1 -p  "Please make a selection: " menuPCIEchoice;

case $menuPCIEchoice in
 e|E ) enablePCI;;
 a|A ) addPCIEVM;;
 q|Q ) exit ;;
 * )  exit ;;
esac
}
##################################################
# Menu - App choices below
#################################################
clear
echo "****************************************"
echo "* Please make sure to add your devices *"
echo "* to the varible list before running   *"
echo "*                                      *"
echo "*             Menu                     *"
echo "* Select options below to continue     *"
echo "* 1. Reset PCIE hide list and DOM      *"
echo "* 2. Show PCIE variable list           *"
echo "* 3. Set pci devices                   *"
echo "* Any other key to exit                *"
echo "****************************************"

read -n 1 -p  "Please make a selection: " menuChoice;

case $menuChoice in
 1 ) resetDOMPCIE;;
 2 ) confirmPCIList;;
 3 ) setPCIE ;;
 4 ) echo "" ;;
 * ) clear ; exit ;;
esac

marcoi

looks good
Xen Orchestra, commit 384bb
Master, commit 384bb

thanks for quick fix

marcoi

@olivierlambert

xe vm-param-set other-config:pci=0/0000:c6:00.0 uuid=45d0f537-9076-b395-1fbd-850d2cc0cf68

This command worked. I was able to pass through the usb and also pcie devices i can get to using XO.

windows host showing usb drive plugged into usb3 card and graphics card.

marcoi

@olivierlambert to confirm the steps
i can skip this step since it isnt showing up anyways

xe pci-disable-dom0-access uuid=<pci uuid>

then use

xe vm-param-set other-config:pci=0/0000:04:01.0 uuid=<vm uuid> to add it to vm

marcoi

@olivierlambert thanks for the update.
and just to confirm, if a device is not showing up in xe list with uuid, there is no way to pass it to a VM correct?

marcoi

@andriy.sultanov is there a way to allow all devices (even if we blow up the system lol)

For example in the docs there a usb filter list you can edit
/etc/xensource/usb-policy.conf

anything similar for pcie? Can something be added with disclaimer you break it on you etc?
Maybe make it a command line option to disable the pci device filters for users that want to pass through special devices.

marcoi

@olivierlambert
Okay i got it I am running
Xen Orchestra, commit 09f67
Master, commit 35428

I will watch it and see how the tasks issue goes

Update 2: been about 20 mins and nothing showing up in the task list.

marcoi

is this in the latest build or do i need to download a separate branch etc? I'm using a script someone made to build my XO so not sure how to do a separate branch but if the change made it into main build i can download an update and test as well.

marcoi

here my list - items c6, c8, c9 are not showing up.

00:00.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1507]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1507]"
00:00.2 "IOMMU [0806]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1508]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1508]"
00:01.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" ""
00:01.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150a]" "" ""
00:01.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150a]" "" ""
00:02.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" ""
00:02.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
00:02.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
00:02.4 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
00:02.5 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
00:03.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" ""
00:03.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
00:03.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
00:08.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" ""
00:08.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150c]" "" ""
00:08.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150c]" "" ""
00:08.3 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150c]" "" ""
00:14.0 "SMBus [0c05]" "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH SMBus Controller [790b]" -r71 "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH SMBus Controller [790b]"
00:14.3 "ISA bridge [0601]" "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH LPC Bridge [790e]" -r51 "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH LPC Bridge [790e]"
00:18.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16f8]" "" ""
00:18.1 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16f9]" "" ""
00:18.2 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fa]" "" ""
00:18.3 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fb]" "" ""
00:18.4 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fc]" "" ""
00:18.5 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fd]" "" ""
00:18.6 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fe]" "" ""
00:18.7 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16ff]" "" ""
c1:00.0 "SATA controller [0106]" "JMicron Technology Corp. [197b]" "JMB58x AHCI SATA controller [0585]" -p01 "JMicron Technology Corp. [197b]" "Device [0000]"
c2:00.0 "Non-Volatile memory controller [0108]" "Samsung Electronics Co Ltd [144d]" "NVMe SSD Controller SM961/PM961/SM963 [a804]" -p02 "Samsung Electronics Co Ltd [144d]" "SM963 2.5\" NVMe PCIe SSD [a801]"
c3:00.0 "Ethernet controller [0200]" "Aquantia Corp. [1d6a]" "AQtion AQC113 NBase-T/IEEE 802.3an Ethernet Controller [Antigua 10G] [04c0]" -r03 "Aquantia Corp. [1d6a]" "Device [0001]"
c4:00.0 "Ethernet controller [0200]" "Realtek Semiconductor Co., Ltd. [10ec]" "Device [8126]" -r01 "Realtek Semiconductor Co., Ltd. [10ec]" "Device [0123]"
c5:00.0 "VGA compatible controller [0300]" "NVIDIA Corporation [10de]" "GK208 [GeForce GT 720] [1286]" -ra1 "NVIDIA Corporation [10de]" "Device [1087]"
c5:00.1 "Audio device [0403]" "NVIDIA Corporation [10de]" "GK208 HDMI/DP Audio Controller [0e0f]" -ra1 "NVIDIA Corporation [10de]" "Device [1087]"
c6:00.0 "USB controller [0c03]" "Etron Technology, Inc. [1b6f]" "EJ168 USB 3.0 Host Controller [7023]" -r01 -p30 "Unknown vendor [7023]" "Device [1b6f]"
c7:00.0 "Display controller [0380]" "Advanced Micro Devices, Inc. [AMD/ATI] [1002]" "Device [150e]" -rd1 "Unknown vendor [1f4c]" "Device [b020]"
c7:00.1 "Audio device [0403]" "Advanced Micro Devices, Inc. [AMD/ATI] [1002]" "Rembrandt Radeon High Definition Audio Controller [1640]" "Unknown vendor [1f4c]" "Device [b020]"
c7:00.2 "Encryption controller [1080]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17e0]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17e0]"
c7:00.4 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151e]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [15b9]"
c7:00.6 "Audio device [0403]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Family 17h/19h HD Audio Controller [15e3]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [d808]"
c7:00.7 "Signal processing controller [1180]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [164a]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [164a]"
c8:00.0 "Non-Essential Instrumentation [1300]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150d]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150d]"
c8:00.1 "Signal processing controller [1180]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17f0]" -r10 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17f0]"
c9:00.0 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151f]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [15b9]"
c9:00.3 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151a]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151a]"
c9:00.4 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151b]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151b]"
c9:00.5 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151c]" -p40 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151c]"
c9:00.6 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151d]" -p40 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151d]"

marcoi

Just to add details about my box. Seems lspci is showing 20 items and xe/xo is only showing 12.
I left the device name in the second list to help show whats not showing up in xe vs lscpi

XE/XO list

 pci-id ( RO): 0000:c1:00.0
 pci-id ( RO): 0000:c2:00.0
 pci-id ( RO): 0000:c3:00.0
 pci-id ( RO): 0000:c4:00.0
 pci-id ( RO): 0000:c5:00.0
 pci-id ( RO): 0000:c5:00.1
 pci-id ( RO): 0000:c7:00.0
 pci-id ( RO): 0000:c7:00.1
 pci-id ( RO): 0000:c7:00.2
 pci-id ( RO): 0000:c7:00.4
 pci-id ( RO): 0000:c7:00.6
 pci-id ( RO): 0000:c7:00.7

VS lspci list

c1:00.0	SATA controller: JMicron Technology Corp. JMB58x AHCI SATA controller
c2:00.0	Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961/SM963
c3:00.0	Ethernet controller: Aquantia Corp. AQtion AQC113 NBase-T/IEEE 802.3an Ethernet Controller [Antigua 10G] (rev 03)
c4:00.0	Ethernet controller: Realtek Semiconductor Co., Ltd. Device 8126 (rev 01)
c5:00.0	VGA compatible controller: NVIDIA Corporation GK208 [GeForce GT 720] (rev a1)
c5:00.1	Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1)
c6:00.0	USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller (rev 01)
c7:00.0	Display controller: Advanced Micro Devices, Inc. [AMD/ATI] Device 150e (rev d1)
c7:00.1	Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller
c7:00.2	Encryption controller: Advanced Micro Devices, Inc. [AMD] Device 17e0
c7:00.4	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151e
c7:00.6	Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller
c7:00.7	Signal processing controller: Advanced Micro Devices, Inc. [AMD] Device 164a
c8:00.0	Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 150d
c8:00.1	Signal processing controller: Advanced Micro Devices, Inc. [AMD] Device 17f0 (rev 10)
c9:00.0	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151f
c9:00.3	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151a
c9:00.4	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151b
c9:00.5	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151c
c9:00.6	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151d

marcoi

@flakpyro I went back a few versions to Xen Orchestra, commit 70d59 and no longer seeing the task spamming.
Guess I will disable the nightly update schedule for now. @Danp let me know if you need me to go to this version to test something or try a new version. etc..