Posts made by rraines | XCP-ng and XO forum

rraines

@julien-f said in Reverse Proxy with Apache:

@rraines said in Reverse Proxy with Apache:

RewriteRule api/(.*) ws://192.168.1.6:80/api/$1 [L,P]

Why isn't there a leading slash to api/ like is shown on the documentation?

The reason I tried that was because in the dev console I saw the the request was to "api/", I was surprised it worked, but my thought was that if "api/" was being sent then "/api/" would never match. I understand the basics but I am more of an assembly language/system library guy.

rraines

@julien-f

This works for specific paths, the api strings can be left there for the "/" path as well. The extra RewriteRule will allow home.lab/xoa or home.lab/xoa/.

<VirtualHost *:80>

ServerName home.lab
ProxyRequests Off

RewriteEngine On
RewriteCond %{HTTP:Upgrade} websocket [NC]
RewriteCond %{HTTP:Connection} upgrade [NC]
RewriteRule api/(.*) ws://192.168.1.6:80/api/$1 [L,P]

RewriteRule ^/xoa$ xoa/ [L,R=301]
ProxyPass /xoa/  http://192.168.1.6:80/
ProxyPassReverse /xoa/  http://192.168.1.6:80/


</VirtualHost>

rraines

@julien-f said in Reverse Proxy with Apache:

ProxyRequests Off

Because the Apache 2.4 documentation, https://httpd.apache.org/docs/2.4/mod/mod_proxy.html, for that directive states "In a typical reverse proxy or gateway configuration, this option should be set to Off."

rraines

@julien-f

This is what is in the Docs and it works aas long as the path is "/"

RewriteEngine On
RewriteCond %{HTTP:upgrade} websocket [NC]
RewriteRule /(.*) ws://192.168.1.6:80/$1 [L,P]

ProxyPass / http://192.168.1.6:80/
ProxyPassReverse / http://192.168.1.6:80/

A different path like "/xoa/" does not work,

RewriteEngine On
RewriteCond %{HTTP:upgrade} websocket [NC]
RewriteRule /xoa/(.*) ws://192.168.1.6:80/$1 [L,P]

ProxyPass /xoa/ http://192.168.1.6:80/
ProxyPassReverse /xoa/ http://192.168.1.6:80/

In the logs I get what is below. The 404 error shows that the xoa is stripped out.

192.168.1.100 - - [08/Feb/2021:16:15:10 -0600] "GET /xoa/ HTTP/1.1" 302 58 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.87 Safari/537.36"
192.168.1.100 - - [08/Feb/2021:16:15:10 -0600] "GET /signin HTTP/1.1" 404 196 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.87 Safari/537.36"

When I look at the dev console I notice that the websockets use the path "/api/". If that is true, should the path in the RewriteRule be api or xoa? Or would a ProxyPass /api/ ws://192.168.1.6:80/api/ be sufficient? I will be able to try later when I can get to the lab.

rraines

This did not work completely, not sure where to go from here. This is what I have now, updates do not work and consoles are missing in the GUI

<VirtualHost *:80>

ServerName home.lab
RemoteIPHeader X-Forwarded-For
ProxyRequests Off
ProxyPreserveHost On
RewriteEngine On

RewriteCond %{HTTP:upgrade} websocket [NC]
RewriteCond %{HTTP:Connection} upgrade [NC]
RewriteRule /(.*) ws://192.168.1.6:80/$1 [L,P]
#RewriteRule .* ws://192.168.1.6:80%{REQUEST_URI} [P]


ProxyPass /xoa/ http://192.168.1.6:80/
<Location /xoa/ >
    ProxyPassReverse /
</Location>



</VirtualHost>

rraines

@olivierlambert

This site has a solution:
https://www.askapache.com/hosting/reverse-proxy-apache/

My config now looks like this:

<VirtualHost *:80>

ServerName home.lab

#ProxyRequests Off
ProxyPreserveHost On
RewriteEngine On

RewriteCond %{HTTP:upgrade} websocket [NC]
RewriteRule /xoa/(.*) ws://192.168.1.6:80/$1 [L,P]

ProxyPass /xoa/ http://192.168.1.6:80/
<location /xoa/>
    ProxyPassReverse /
</location>

</VirtualHost>

rraines

I followed the instructions here, https://xen-orchestra.com/docs/configuration.html#reverse-proxy, to setup a reverse proxy. The config works if my path is "/" but does not work for any other path like "/xoa" or /xoa/".

Has anyone had any luck with this? I am not an Apache wizard so it could be a directive I am missing.

<VirtualHost *:80>

ServerName home.lab

ProxyRequests Off
ProxyPreserveHost On
RewriteEngine On

RewriteCond %{HTTP:upgrade} websocket [NC]
RewriteRule /xoa/(.*) ws://192.168.1.6:80/$1 [L,P]

ProxyPass /xoa/ http://192.168.1.6:80/
ProxyPassReverse /xoa/ http://192.168.1.6:80/

</VirtualHost>

The error I get is:

192.168.1.100 - - [08/Feb/2021:16:15:10 -0600] "GET /xoa/ HTTP/1.1" 302 58 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.87 Safari/537.36"
192.168.1.100 - - [08/Feb/2021:16:15:10 -0600] "GET /signin HTTP/1.1" 404 196 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.87 Safari/537.36"

That 404 error should be "GET xoa/signin" and not an error, I am not sure why the ProxyPassReverse does not add the path.

rraines

@olivierlambert

That socket issue was not what was causing the problem, I went through setting by setting and if I choose 2GB of memory for a VM I get constant reboots when using XOA. I was able to repeat the issue with a number of OSs not just RHEL 8 (and variants). I havent went through and compared the differences between XOA and XenCenter yet.

rraines

It appears the default in XOA is zero cores per socket? I changed this to a positive value and things seem to be working. This seems to be a bug, why would XOA allow aVM with an impossible CPU to be created?

Feb  6 17:11:28 virt xenguest-11-build[7843]: vcpu/number:1 vcpu/weight:256 vcpu/cap:0
Feb  6 17:11:28 virt xenguest-11-build[7843]: nx: 1, pae 1, cores-per-socket 0, x86-fip-width 0, nested 0

rraines

Here is some sweet logs of the event, I am not sure if I cshould include any other, just started testing this software

Feb  6 17:09:22 virt squeezed[24058]: [-4980.14] watch /data/updated <- Sat Feb  6 18:07:59 2021
Feb  6 17:09:22 virt squeezed: [debug||4 ||xenops] watch /data/updated <- Sat Feb  6 18:07:59 2021
Feb  6 17:10:01 virt systemd[1]: Started Session c18 of user root.
Feb  6 17:10:01 virt systemd[1]: Starting Session c18 of user root.
Feb  6 17:10:22 virt squeezed[24058]: [-4919.96] watch /data/updated <- Sat Feb  6 18:08:59 2021
Feb  6 17:10:22 virt squeezed: [debug||4 ||xenops] watch /data/updated <- Sat Feb  6 18:08:59 2021
Feb  6 17:11:22 virt squeezed[24058]: [-4859.78] watch /data/updated <- Sat Feb  6 18:09:59 2021
Feb  6 17:11:22 virt squeezed: [debug||4 ||xenops] watch /data/updated <- Sat Feb  6 18:09:59 2021
Feb  6 17:11:27 virt squeezed[24058]: [-4855.25] Removing watches for domid: 10
Feb  6 17:11:27 virt squeezed: [debug||4 ||xenops] Removing watches for domid: 10
Feb  6 17:11:27 virt qemu-dm-10[6753]: qemu-dm-10: terminating on signal 15 from pid 24264 (<unknown process>)
Feb  6 17:11:27 virt tapdisk[6465]: received 'sring disconnect' message (uuid = 0)
Feb  6 17:11:27 virt tapdisk[6465]: disconnecting domid=10, devid=768
Feb  6 17:11:27 virt tapdisk[6465]: sending 'sring disconnect rsp' message (uuid = 0)
Feb  6 17:11:27 virt /opt/xensource/libexec/xcp-clipboardd[6750]: poll failed because revents=0x11 (qemu socket)
Feb  6 17:11:27 virt tapdisk[6550]: received 'close' message (uuid = 2)
Feb  6 17:11:27 virt tapdisk[6550]: nbd: NBD server pause(0xf38440)
Feb  6 17:11:27 virt tapdisk[6550]: nbd: NBD server free(0xf38440)
Feb  6 17:11:27 virt tapdisk[6550]: closed image /ISO/AlmaLinux-8.3-beta-1-x86_64-minimal.iso (0 users, state: 0x00000002, type: 0)
Feb  6 17:11:27 virt tapdisk[6550]: sending 'close response' message (uuid = 2)
Feb  6 17:11:27 virt tapdisk[6465]: received 'close' message (uuid = 1)
Feb  6 17:11:27 virt tapdisk[6465]: nbd: NBD server pause(0x2398610)
Feb  6 17:11:27 virt tapdisk[6550]: received 'detach' message (uuid = 2)
Feb  6 17:11:27 virt tapdisk[6550]: sending 'detach response' message (uuid = 2)
Feb  6 17:11:27 virt tapdisk[6550]: tapdisk-log: closing after 0 errors
Feb  6 17:11:27 virt tapdisk[6550]: tapdisk-syslog: 19 messages, 1550 bytes, xmits: 20, failed: 0, dropped: 0
Feb  6 17:11:27 virt tapdisk[6550]: tapdisk-control: draining 1 connections
Feb  6 17:11:27 virt tapdisk[6550]: tapdisk-control: done
Feb  6 17:11:27 virt tapdisk[6465]: nbd: NBD server free(0x2398610)
Feb  6 17:11:27 virt tapdisk[6465]: gaps written/skipped: 2/0
Feb  6 17:11:27 virt tapdisk[6465]: /var/run/sr-mount/507a9a28-2e7c-89be-6960-d1ed9d93674b/7803a287-a875-472d-af32-5f1555cbc44f.vhd: b: 4096, a: 22, f: 8, n: 90320
Feb  6 17:11:27 virt tapdisk[6465]: closed image /var/run/sr-mount/507a9a28-2e7c-89be-6960-d1ed9d93674b/7803a287-a875-472d-af32-5f1555cbc44f.vhd (0 users, state: 0x00000000, type: 4)
Feb  6 17:11:27 virt tapdisk[6465]: sending 'close response' message (uuid = 1)
Feb  6 17:11:27 virt tapdisk[6465]: received 'detach' message (uuid = 1)
Feb  6 17:11:27 virt tapdisk[6465]: sending 'detach response' message (uuid = 1)
Feb  6 17:11:27 virt tapdisk[6465]: tapdisk-log: closing after 0 errors
Feb  6 17:11:27 virt tapdisk[6465]: tapdisk-syslog: 23 messages, 1929 bytes, xmits: 24, failed: 0, dropped: 0
Feb  6 17:11:27 virt tapdisk[6465]: tapdisk-control: draining 1 connections
Feb  6 17:11:27 virt tapdisk[6465]: tapdisk-control: done
Feb  6 17:11:28 virt ovs-ofctl: ovs|00001|ofp_util|WARN|Negative value -1 is not a valid port number.
Feb  6 17:11:28 virt ovs-vsctl: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=30 -- --if-exists del-port vif10.0
Feb  6 17:11:28 virt tapback[6476]: backend.c:1124 domain removed, exit
Feb  6 17:11:28 virt squeezed[24058]: [-4853.94] total_range = 0 gamma = 1.000000 gamma' = inf
Feb  6 17:11:28 virt squeezed: [debug||40 ||xenops] total_range = 0 gamma = 1.000000 gamma' = inf
Feb  6 17:11:28 virt squeezed[24058]: [-4853.94] Total additional memory over dynamic_min = 122533956 KiB; will set gamma = 1.00 (leaving unallocated 0 KiB)
Feb  6 17:11:28 virt squeezed: [debug||40 ||xenops] Total additional memory over dynamic_min = 122533956 KiB; will set gamma = 1.00 (leaving unallocated 0 KiB)
Feb  6 17:11:28 virt squeezed[24058]: [-4853.94] free_memory_range ideal target = 2132992
Feb  6 17:11:28 virt squeezed: [debug||40 ||xenops] free_memory_range ideal target = 2132992
Feb  6 17:11:28 virt squeezed[24058]: [-4853.94] change_host_free_memory required_mem = 2142208 KiB target_mem = 9216 KiB free_mem = 122543172 KiB
Feb  6 17:11:28 virt squeezed: [debug||40 ||xenops] change_host_free_memory required_mem = 2142208 KiB target_mem = 9216 KiB free_mem = 122543172 KiB
Feb  6 17:11:28 virt squeezed[24058]: [-4853.94] change_host_free_memory all VM target meet true
Feb  6 17:11:28 virt squeezed: [debug||40 ||xenops] change_host_free_memory all VM target meet true
Feb  6 17:11:28 virt squeezed: [debug||40 ||memory] reserved 2132992 kib for reservation fcf62886-4ab7-4b0e-80d6-ebec67c82d89
Feb  6 17:11:28 virt squeezed[24058]: [-4853.93] Xenctrl.domain_setmaxmem domid=11 max=2134016 (was=0)
Feb  6 17:11:28 virt squeezed: [debug||41 ||xenops] Xenctrl.domain_setmaxmem domid=11 max=2134016 (was=0)
Feb  6 17:11:28 virt xenguest-11-build[7843]: Command line: -controloutfd 7 -controlinfd 8 -mode hvm_build -image /usr/libexec/xen/boot/hvmloader -domid 11 -store_port 2 -store_domid 0 -console_port 3 -console_domid 0 -mem_max_mib 4088 -mem_start_mib 2040
Feb  6 17:11:28 virt xenguest-11-build[7843]: Domain Properties: Type HVM, hap 1
Feb  6 17:11:28 virt xenguest-11-build[7843]: Determined the following parameters from xenstore:
Feb  6 17:11:28 virt xenguest-11-build[7843]: vcpu/number:1 vcpu/weight:256 vcpu/cap:0
Feb  6 17:11:28 virt xenguest-11-build[7843]: nx: 1, pae 1, cores-per-socket 0, x86-fip-width 0, nested 0
Feb  6 17:11:28 virt xenguest-11-build[7843]: apic: 1 acpi: 1 acpi_s4: 0 acpi_s3: 0 tsc_mode: 0 hpet: 1
Feb  6 17:11:28 virt xenguest-11-build[7843]: nomigrate 0, timeoffset -83
Feb  6 17:11:28 virt xenguest-11-build[7843]: viridian: 0, time_ref_count: 0, reference_tsc: 0 hcall_remote_tlb_flush: 0 apic_assist: 0 crash_ctl: 0 stimer: 0 hcall_ipi: 0
Feb  6 17:11:28 virt xenguest-11-build[7843]: vcpu/0/affinity:11111111111111111111111111111111
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_allocate: cmdline="", features=""
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_kernel_file: filename="/usr/libexec/xen/boot/hvmloader"
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_malloc_filemap    : 633 kB
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_module_file: filename="/usr/share/ipxe/ipxe.bin"
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_malloc_filemap    : 132 kB
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_boot_xen_init: ver 4.13, caps xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_parse_image: called
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loader ...
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: loader probe failed
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_find_loader: trying HVM-generic loader ...
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: loader probe OK
Feb  6 17:11:28 virt xenguest-11-build[7843]: xc: detail: ELF: phdr: paddr=0x100000 memsz=0x5d184
Feb  6 17:11:28 virt xenguest-11-build[7843]: xc: detail: ELF: memory: 0x100000 -> 0x15d184
Feb  6 17:11:28 virt xenguest-11-build[7843]: Calculated provisional MMIO hole size as 0x10000000
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_mem_init: mem 4088 MB, pages 0xff800 pages, 4k each
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_mem_init: 0xff800 pages
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_boot_mem_init: called
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: range: start=0x0 end=0xf0000000
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: range: start=0x100000000 end=0x10f800000
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_malloc            : 8688 kB
Feb  6 17:11:28 virt xenguest-11-build[7843]: xc: detail: PHYSICAL MEMORY ALLOCATION:
Feb  6 17:11:28 virt xenguest-11-build[7843]: xc: detail:   4KB PAGES: 0x0000000000000200
Feb  6 17:11:28 virt xenguest-11-build[7843]: xc: detail:   2MB PAGES: 0x00000000000003fb
Feb  6 17:11:28 virt xenguest-11-build[7843]: xc: detail:   1GB PAGES: 0x0000000000000002
Feb  6 17:11:28 virt xenguest-11-build[7843]: Final lower MMIO hole size is 0x10000000
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_build_image: called
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x100+0x5e at 0x7f82e4890000
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_alloc_segment:   kernel       : 0x100000 -> 0x15e000  (pfn 0x100 + 0x5e pages)
Feb  6 17:11:28 virt xenguest-11-build[7843]: xc: detail: ELF: phdr 0 at 0x7f82e4832000 -> 0x7f82e48855c0
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x15e+0x21 at 0x7f82e486f000
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_alloc_segment:   module0      : 0x15e000 -> 0x17f000  (pfn 0x15e + 0x21 pages)
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x17f+0x1 at 0x7f82e49bd000
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_alloc_segment:   HVM start info : 0x17f000 -> 0x180000  (pfn 0x17f + 0x1 pages)
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: alloc_pgtables_hvm: doing nothing
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_build_image  : virt_alloc_end : 0x180000
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_build_image  : virt_pgtab_end : 0x0
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_boot_image: called
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_64
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_32p
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32 <= matches
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32p
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_64
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: domain builder memory footprint
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail:    allocated
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail:       malloc             : 8694 kB
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail:       anon mmap          : 0 bytes
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail:    mapped
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail:       file mmap          : 765 kB
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail:       domU mmap          : 512 kB
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: Adding module 0 guest_addr 15e000 len 135168
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: vcpu_hvm: called
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_set_gnttab_entry: d11 gnt[0] -> d0 0xfefff
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_set_gnttab_entry: d11 gnt[1] -> d0 0xfeffc
Feb  6 17:11:28 virt xenguest-11-build[7843]: Parsing '178bfbff-f6f83203-2fd3fbff-040005f7-0000000f-219c01a9-00400004-00000000-00001005-00000000-00000000-00000000-00000000-00000000-00000000' as featureset
Feb  6 17:11:28 virt xenguest-11-build[7843]: domainbuilder: detail: xc_dom_release: called
Feb  6 17:11:28 virt xenguest-11-build[7843]: Writing to control: 'result:1044476 1044479#012'
Feb  6 17:11:28 virt xenguest-11-build[7843]: All done
Feb  6 17:11:28 virt squeezed[24058]: [-4853.75] Adding watches for domid: 11
Feb  6 17:11:28 virt squeezed: [debug||4 ||xenops] Adding watches for domid: 11
Feb  6 17:11:28 virt squeezed[24058]: [-4853.75] watch /memory/initial-reservation <- 2132992
Feb  6 17:11:28 virt squeezed: [debug||4 ||xenops] watch /memory/initial-reservation <- 2132992
Feb  6 17:11:28 virt squeezed[24058]: [-4853.75] watch /memory/target <- 2097152
Feb  6 17:11:28 virt squeezed: [debug||4 ||xenops] watch /memory/target <- 2097152
Feb  6 17:11:28 virt squeezed[24058]: [-4853.75] watch /control/feature-balloon <- None
Feb  6 17:11:28 virt squeezed: [debug||4 ||xenops] watch /control/feature-balloon <- None
Feb  6 17:11:28 virt squeezed[24058]: [-4853.75] watch /data/updated <- None
Feb  6 17:11:28 virt squeezed: [debug||4 ||xenops] watch /data/updated <- None
Feb  6 17:11:28 virt squeezed[24058]: [-4853.75] watch /memory/memory-offset <- None
Feb  6 17:11:28 virt squeezed: [debug||4 ||xenops] watch /memory/memory-offset <- None
Feb  6 17:11:28 virt squeezed[24058]: [-4853.75] watch /memory/uncooperative <- None
Feb  6 17:11:28 virt squeezed: [debug||4 ||xenops] watch /memory/uncooperative <- None
Feb  6 17:11:28 virt squeezed[24058]: [-4853.75] watch /memory/dynamic-min <- 2097152
Feb  6 17:11:28 virt squeezed: [debug||4 ||xenops] watch /memory/dynamic-min <- 2097152
Feb  6 17:11:28 virt squeezed[24058]: [-4853.75] watch /memory/dynamic-max <- 2097152
Feb  6 17:11:28 virt squeezed: [debug||4 ||xenops] watch /memory/dynamic-max <- 2097152
Feb  6 17:11:29 virt tapdisk[7958]: tapdisk-control: init, 10 x 4k buffers
Feb  6 17:11:29 virt tapdisk[7958]: I/O queue driver: lio
Feb  6 17:11:29 virt tapdisk[7958]: tapdisk-log: started, level 0
Feb  6 17:11:29 virt tapdisk[7958]: Tapdisk running, control on /var/run/blktap-control/ctl7958
Feb  6 17:11:29 virt tapdisk[7958]: nbd: Set up local unix domain socket on path '/var/run/blktap-control/nbdclient7958'
Feb  6 17:11:29 virt tapdisk[7958]: received 'attach' message (uuid = 1)
Feb  6 17:11:29 virt tapdisk[7958]: sending 'attach response' message (uuid = 1)
Feb  6 17:11:29 virt tapdisk[7958]: received 'open' message (uuid = 1)
Feb  6 17:11:29 virt tapdisk[7958]: /var/run/sr-mount/507a9a28-2e7c-89be-6960-d1ed9d93674b/7803a287-a875-472d-af32-5f1555cbc44f.vhd version: tap 0x00010003, b: 4096, a: 22, f: 8, n: 90320
Feb  6 17:11:29 virt tapdisk[7958]: opened image /var/run/sr-mount/507a9a28-2e7c-89be-6960-d1ed9d93674b/7803a287-a875-472d-af32-5f1555cbc44f.vhd (1 users, state: 0x00000001, type: 4, rw)
Feb  6 17:11:29 virt tapdisk[7958]: VBD CHAIN:
Feb  6 17:11:29 virt tapdisk[7958]: /var/run/sr-mount/507a9a28-2e7c-89be-6960-d1ed9d93674b/7803a287-a875-472d-af32-5f1555cbc44f.vhd: type:vhd(4) storage:ext(2)
Feb  6 17:11:29 virt tapdisk[7958]: bdev: capacity=16777216 sector_size=512/512 flags=0
Feb  6 17:11:29 virt tapdisk[7958]: Set request timeout to 40 s
Feb  6 17:11:29 virt tapdisk[7958]: nbd: Set up local unix domain socket on path '/var/run/blktap-control/nbdserver7958.1'
Feb  6 17:11:29 virt tapdisk[7958]: nbd: registering for unix_listening_fd
Feb  6 17:11:29 virt tapdisk[7958]: nbd: Successfully started NBD server on /var/run/blktap-control/nbd7958.1
Feb  6 17:11:29 virt tapdisk[7958]: sending 'open response' message (uuid = 1)
Feb  6 17:11:29 virt tapback[7967]: tapback.c:446 slave tapback daemon started, only serving domain 11
Feb  6 17:11:29 virt tapback[7967]: backend.c:286 768 physical_device_changed
Feb  6 17:11:29 virt tapback[7967]: backend.c:286 768 physical_device_changed
Feb  6 17:11:29 virt tapback[7967]: backend.c:372 768 found tapdisk[7958], for 254:1
Feb  6 17:11:29 virt tapdisk[7958]: received 'disk info' message (uuid = 1)
Feb  6 17:11:29 virt tapdisk[7958]: VBD 1 got disk info: sectors=16777216 sector size=512, info=0
Feb  6 17:11:29 virt tapdisk[7958]: sending 'disk info rsp' message (uuid = 1)
Feb  6 17:11:29 virt tapdisk[8042]: tapdisk-control: init, 10 x 4k buffers
Feb  6 17:11:29 virt tapdisk[8042]: I/O queue driver: lio
Feb  6 17:11:29 virt tapdisk[8042]: tapdisk-log: started, level 0
Feb  6 17:11:29 virt tapdisk[8042]: Tapdisk running, control on /var/run/blktap-control/ctl8042
Feb  6 17:11:29 virt tapdisk[8042]: nbd: Set up local unix domain socket on path '/var/run/blktap-control/nbdclient8042'
Feb  6 17:11:29 virt tapdisk[8042]: received 'attach' message (uuid = 2)
Feb  6 17:11:29 virt tapdisk[8042]: sending 'attach response' message (uuid = 2)
Feb  6 17:11:29 virt tapdisk[8042]: received 'open' message (uuid = 2)
Feb  6 17:11:29 virt tapdisk[8042]: block-aio open('/ISO/AlmaLinux-8.3-beta-1-x86_64-minimal.iso')
Feb  6 17:11:29 virt tapdisk[8042]: open(/ISO/AlmaLinux-8.3-beta-1-x86_64-minimal.iso) with O_DIRECT
Feb  6 17:11:29 virt tapdisk[8042]: Image size: #012#011pre sector_shift  [1892679680]#012#011post sector_shift [3696640]
Feb  6 17:11:29 virt tapdisk[8042]: opened image /ISO/AlmaLinux-8.3-beta-1-x86_64-minimal.iso (1 users, state: 0x00000003, type: 0, ro)
Feb  6 17:11:29 virt tapdisk[8042]: VBD CHAIN:
Feb  6 17:11:29 virt tapdisk[8042]: /ISO/AlmaLinux-8.3-beta-1-x86_64-minimal.iso: type:aio(0) storage:n/a(-1)
Feb  6 17:11:29 virt tapdisk[8042]: bdev: capacity=3696640 sector_size=512/512 flags=0x1
Feb  6 17:11:29 virt tapdisk[8042]: nbd: Set up local unix domain socket on path '/var/run/blktap-control/nbdserver8042.2'
Feb  6 17:11:29 virt tapdisk[8042]: nbd: registering for unix_listening_fd
Feb  6 17:11:29 virt tapdisk[8042]: nbd: Successfully started NBD server on /var/run/blktap-control/nbd8042.2
Feb  6 17:11:29 virt tapdisk[8042]: sending 'open response' message (uuid = 2)
Feb  6 17:11:29 virt tapback[7967]: backend.c:286 5696 physical_device_changed
Feb  6 17:11:29 virt tapback[7967]: backend.c:286 5696 physical_device_changed
Feb  6 17:11:29 virt tapback[7967]: backend.c:372 5696 found tapdisk[8042], for 254:2
Feb  6 17:11:29 virt tapdisk[8042]: received 'disk info' message (uuid = 2)
Feb  6 17:11:29 virt tapdisk[8042]: VBD 2 got disk info: sectors=3696640 sector size=512, info=0
Feb  6 17:11:29 virt tapdisk[8042]: sending 'disk info rsp' message (uuid = 2)
Feb  6 17:11:29 virt ovs-vsctl: ovs|00001|db_ctl_base|ERR|no row "vif11.0" in table Interface
Feb  6 17:11:29 virt ovs-vsctl: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=30 -- --if-exists del-port vif11.0
Feb  6 17:11:30 virt ovs-vsctl: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=30 add-port xenbr1 vif11.0 -- set interface vif11.0 "external-ids:\"xs-network-uuid\"=\"7e5e2cdc-377f-7726-093f-ff850135862d\"" -- set interface vif11.0 "external-ids:\"attached-mac\"=\"82:6b:6b:64:eb:eb\"" -- set interface vif11.0 "external-ids:\"xs-vif-uuid\"=\"2e3a1a9e-c697-ef70-e506-b032713e270e\"" -- set interface vif11.0 "external-ids:\"xs-vm-uuid\"=\"ba9a97f9-52dc-479e-db72-5745e5f616fa\""
Feb  6 17:11:30 virt forkexecd: [ info||0 ||forkexecd] qemu-dm-11[8205]: Arguments: 11 --syslog -std-vga -videoram 8 -vnc unix:/var/run/xen/vnc-11,lock-key-sync=off -acpi -monitor null -pidfile /var/run/xen/qemu-dm-11.pid -xen-domid 11 -m size=4088 -boot order=dcn -usb -device usb-tablet,port=2 -smp 1,maxcpus=1 -serial pty -display none -nodefaults -trace enable=xen_platform_log -sandbox on,obsolete=deny,elevateprivileges=allow,spawn=deny,resourcecontrol=deny -S -trad-compat -global PIIX4_PM.revision_id=0x1 -global ide-hd.ver=0.10.2 -global piix3-ide-xen.subvendor_id=0x5853 -global piix3-ide-xen.subsystem_id=0x0001 -global piix3-usb-uhci.subvendor_id=0x5853 -global piix3-usb-uhci.subsystem_id=0x0001 -global rtl8139.subvendor_id=0x5853 -global rtl8139.subsystem_id=0x0001 -parallel null -qmp unix:/var/run/xen/qmp-libxl-11,server,nowait -qmp unix:/var/run/xen/qmp-event-11,server,nowait -device xen-platform,addr=3,device-id=0x0001,revision=0x2,class-id=0x0100,subvendor_id=0x5853,subsystem_id=0x0001 -drive file=/dev/sm/backend/c226bdd8-31ea-f784-d91d-65d5cc44145e/0eed3613-df18-4841-8ad8-dfebfc0cb66e,if=ide,index=3,media=cdrom,force-lba=off,format=raw -drive file=/dev/sm/backend/507a9a28-2e7c-89be-6960-d1ed9d93674b/7803a287-a875-472d-af32-5f1555cbc44f,if=ide,index=0,media=disk,force-lba=on,format=raw -device rtl8139,netdev=tapnet0,mac=82:6b:6b:64:eb:eb,addr=4 -netdev tap,id=tapnet0,fd=7
Feb  6 17:11:30 virt forkexecd: [ info||0 ||forkexecd] qemu-dm-11[8205]: Exec: /usr/lib64/xen/bin/qemu-system-i386 qemu-dm-11 -machine pc-0.10,accel=xen,max-ram-below-4g=4026531840,allow-unassigned=true,trad_compat=True -vnc unix:/var/run/xen/vnc-11,lock-key-sync=off -monitor null -pidfile /var/run/xen/qemu-dm-11.pid -xen-domid 11 -m size=4088 -boot order=dcn -usb -device usb-tablet,port=2 -smp 1,maxcpus=1 -serial pty -display none -nodefaults -trace enable=xen_platform_log -sandbox on,obsolete=deny,elevateprivileges=allow,spawn=deny,resourcecontrol=deny -S -global PIIX4_PM.revision_id=0x1 -global ide-hd.ver=0.10.2 -global piix3-ide-xen.subvendor_id=0x5853 -global piix3-ide-xen.subsystem_id=0x0001 -global piix3-usb-uhci.subvendor_id=0x5853 -global piix3-usb-uhci.subsystem_id=0x0001 -global rtl8139.subvendor_id=0x5853 -global rtl8139.subsystem_id=0x0001 -parallel null -qmp unix:/var/run/xen/qmp-libxl-11,server,nowait -qmp unix:/var/run/xen/qmp-event-11,server,nowait -device xen-platform,addr=3,device-id=0x0001,revision=0x2,class-id=0x0100,subvendor_id=0x5853,subsystem_id=0x0001 -drive file=/dev/sm/backend/c226bdd8-31ea-f784-d91d-65d5cc44145e/0eed3613-df18-4841-8ad8-dfebfc0cb66e,if=ide,index=3,media=cdrom,force-lba=off,format=raw -drive file=/dev/sm/backend/507a9a28-2e7c-89be-6960-d1ed9d93674b/7803a287-a875-472d-af32-5f1555cbc44f,if=ide,index=0,media=disk,force-lba=on,format=raw -device rtl8139,netdev=tapnet0,mac=82:6b:6b:64:eb:eb,addr=4 -netdev tap,id=tapnet0,fd=7 -device VGA,vgamem_mb=8,addr=2,romfile=,rombar=1,subvendor_id=0x5853,subsystem_id=0x0001,qemu-extended-regs=false -vnc-clipboard-socket-fd 4 -xen-domid-restrict -chroot /var/xen/qemu/root-11 -runas 65546.1001
Feb  6 17:11:30 virt qemu-dm-11[8247]: Moving to cgroup slice ''
Feb  6 17:11:30 virt qemu-dm-11[8247]: core dump limit: 67108864
Feb  6 17:11:30 virt qemu-dm-11[8247]: qemu-dm-11: -serial pty: char device redirected to /dev/pts/5 (label serial0)
Feb  6 17:11:30 virt ovs-vsctl: ovs|00001|db_ctl_base|ERR|no row "tap11.0" in table Interface
Feb  6 17:11:30 virt ovs-vsctl: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=30 -- --if-exists del-port tap11.0
Feb  6 17:11:30 virt ovs-vsctl: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=30 add-port xenbr1 tap11.0 -- set interface tap11.0 "external-ids:\"xs-network-uuid\"=\"7e5e2cdc-377f-7726-093f-ff850135862d\"" -- set interface tap11.0 "external-ids:\"attached-mac\"=\"82:6b:6b:64:eb:eb\"" -- set interface tap11.0 "external-ids:\"xs-vif-uuid\"=\"2e3a1a9e-c697-ef70-e506-b032713e270e\"" -- set interface tap11.0 "external-ids:\"xs-vm-uuid\"=\"ba9a97f9-52dc-479e-db72-5745e5f616fa\""

rraines

Every time we create a new VM in XOA it reboot before we can finish the install. If we use the windows GUI or command line everything works fine. We have tried XOA community and compiling XO ourselves. Either way same behavior.

Xen Server - 8.2.0
XOA - 5.54.0 - XOA build: 20210102

This is a fresh install.
The guest OS has been RHEL 8 variants (RHEL CENTOS Alma) and vyos, all OSs that I have tried behave this way.

We re using a local (ext) store for VMs that is running RAID 5

Checked that the dates match, patches are up to date, DNS resolves properly