Cannot start VM to which a sata controller and pci nvme is passed through to.

[RAG67958472]

Hello i was trying to create a debian vm and passed through the sata controller and pci nvme controller to it.
The thing is whenever i passthrough anything it works but when i try to pass throught the sata controller and nvme together then the vm starts and stops immediately. Individually i can pass them both just fine.

i checked th daemon.log and it was showing domain_crash called from arch/x86/mm/p2m.c#set_typed_p2m_entry+0x264/0x5f

Does anyone have any ideas on how to fix it ??

[olivierlambert]

Hi!

Can you provide a bit more log? Is it the only line related? Do you have more on xl dmesg?

[RAG67958472]

This is what i get in xl dmesg

(XEN) [    5.239261] Std. Loglevel: Errors, warnings and info
(XEN) [    5.257841] Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) [    5.276800] Xen is relinquishing VGA console.
(XEN) [    5.300773] *** Serial input to DOM0 (type 'CTRL-a' three times to switch input)
(XEN) [    5.300853] Freed 608kB init memory
(XEN) [ 6839.987889] d1: GFN 0xf1807 (0xef138,0,5,7) -> (0xef004,0,5,7) not permitted
(XEN) [ 6839.987893] domain_crash called from arch/x86/mm/p2m.c#set_typed_p2m_entry+0x264/0x5f0
(XEN) [ 6839.987894] Domain 1 reported crashed by domain 0 on cpu#2:
(XEN) [ 6839.987897] memory_map:fail: dom1 gfn=f1807 mfn=ef004 nr=1 ret:-1

Im not sure which other logs I would have to check.

[olivierlambert]

Hmm does this ring any bell @andSmv or @fohdeesha ?

[andSmv]

@RAG67958472
Hmmm, seems to be a bug. There's someting special about machine frame ef004. I suppose it's a MMIO address (PCI bar?). Can you please provide an output of the whole xen log from the beggining with xl dmesg and also a pci conf space dump lspci -vvv ?
What is weird you can passthrough the both devices individually.

[RAG67958472]

@andSmv said in Cannot start VM to which a sata controller and pci nvme is passed through to.:

xl dmesg

Here is the xl dmesg

 __  __            _  _    _ _____  ____  
 \ \/ /___ _ __   | || |  / |___ / | ___| 
  \  // _ \ '_ \  | || |_ | | |_ \ |___ \ 
  /  \  __/ | | | |__   _|| |___) | ___) |
 /_/\_\___|_| |_|    |_|(_)_|____(_)____/ 
                                          
(XEN) [0000001114567371] Xen version 4.13.5-9.37 (mockbuild@[unknown]) (gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-28)) debug=n  Thu Oct 12 13:03:01 CEST 2023
(XEN) [00000011145684b2] Latest ChangeSet: 708e83f0e7d1, pq b3d5810fecbb
(XEN) [000000111456993b] build-id: aa50a2380e337c56184c942a01531883de539dbd
(XEN) [000000111456a2b0] Bootloader: GRUB 2.02
(XEN) [000000111456ac99] Command line: watchdog ucode=scan dom0_max_vcpus=1-4 crashkernel=256M,below=4G console=vga vga=mode-0x0311 extra_guest_irqs=128 dom0_mem=900M,max:900M
(XEN) [000000111456bbc7] Xen image load base address: 0xc3c00000
(XEN) [000000111456c395] Video information:
(XEN) [000000111456d0cb]  VGA is graphics mode 1920x1080, 32 bpp
(XEN) [000000111456d8c5] Disc information:
(XEN) [000000111456e0df]  Found 0 MBR signatures
(XEN) [000000111456e924]  Found 3 EDD information structures
(XEN) [0000001114573334] EFI RAM map:
(XEN) [0000001114573efe]  0000000000000000 - 0000000000058000 (usable)
(XEN) [0000001114574cc8]  0000000000058000 - 0000000000059000 (reserved)
(XEN) [00000011145758db]  0000000000059000 - 000000000009f000 (usable)
(XEN) [000000111457651f]  000000000009f000 - 0000000000100000 (reserved)
(XEN) [000000111457722c]  0000000000100000 - 00000000b8eaa000 (usable)
(XEN) [0000001114577ec5]  00000000b8eaa000 - 00000000b8eab000 (ACPI NVS)
(XEN) [0000001114578a7b]  00000000b8eab000 - 00000000b8eac000 (reserved)
(XEN) [00000011145795e7]  00000000b8eac000 - 00000000c97d4000 (usable)
(XEN) [000000111457a0ea]  00000000c97d4000 - 00000000cae0b000 (reserved)
(XEN) [000000111457ac05]  00000000cae0b000 - 00000000cae51000 (ACPI data)
(XEN) [000000111457b7f8]  00000000cae51000 - 00000000cb772000 (ACPI NVS)
(XEN) [000000111457c3a5]  00000000cb772000 - 00000000cbdff000 (reserved)
(XEN) [000000111457cec6]  00000000cbdff000 - 00000000cbe00000 (usable)
(XEN) [000000111457da46]  00000000cbe00000 - 00000000d0000000 (reserved)
(XEN) [000000111457e579]  00000000f0000000 - 00000000f8000000 (reserved)
(XEN) [000000111457f05a]  00000000fe000000 - 00000000fe011000 (reserved)
(XEN) [000000111457fb37]  00000000fec00000 - 00000000fec01000 (reserved)
(XEN) [0000001114580656]  00000000fee00000 - 00000000fee01000 (reserved)
(XEN) [000000111458129a]  00000000ff000000 - 0000000100000000 (reserved)
(XEN) [0000001114581f51]  0000000100000000 - 000000042e000000 (usable)
(XEN) [000000111686b03f] Kdump: 256MB (262144kB) at 0xa8e00000
(XEN) [0000001116884c49] ACPI: RSDP CAE19000, 0024 (r2 DELL  )
(XEN) [0000001116886e84] ACPI: XSDT CAE190B8, 00F4 (r1 DELL    CBX3     1072009 AMI     10013)
(XEN) [0000001116889294] ACPI: FACP CAE44210, 010C (r5 DELL    CBX3     1072009 AMI     10013)
(XEN) [000000111688b563] ACPI: DSDT CAE19240, 2AFCA (r2 DELL    CBX3     1072009 INTL 20160422)
(XEN) [000000111688cd7d] ACPI: FACS CB76CF00, 0040
(XEN) [000000111688dc71] ACPI: APIC CAE44320, 0084 (r3 DELL    CBX3     1072009 AMI     10013)
(XEN) [000000111688f079] ACPI: FPDT CAE443A8, 0044 (r1 DELL    CBX3     1072009 AMI     10013)
(XEN) [0000001116890415] ACPI: FIDT CAE443F0, 00AC (r1 DELL    CBX3     1072009 AMI     10013)
(XEN) [0000001116891728] ACPI: MCFG CAE444A0, 003C (r1 DELL    CBX3     1072009 MSFT       97)
(XEN) [0000001116892b64] ACPI: HPET CAE444E0, 0038 (r1 DELL    CBX3     1072009 AMI.    5000B)
(XEN) [0000001116893e8b] ACPI: SSDT CAE44518, 3176 (r2 SaSsdt  SaSsdt      3000 INTL 20160422)
(XEN) [000000111689543d] ACPI: SSDT CAE47690, 25A5 (r2 PegSsd  PegSsdt     1000 INTL 20160422)
(XEN) [000000111689682e] ACPI: HPET CAE49C38, 0038 (r1 INTEL       KBL        1 MSFT       5F)
(XEN) [0000001116897c23] ACPI: SSDT CAE49C70, 0DE5 (r2 INTEL  Ther_Rvp     1000 INTL 20160422)
(XEN) [00000011168990de] ACPI: SSDT CAE4AA58, 0BB4 (r2  INTEL DELL_MFF        0 INTL 20160422)
(XEN) [000000111689a5df] ACPI: UEFI CAE4B610, 0042 (r1                        0             0)
(XEN) [000000111689b9bf] ACPI: SSDT CAE4B658, 0EDE (r2 CpuRef  CpuSsdt     3000 INTL 20160422)
(XEN) [000000111689cf45] ACPI: LPIT CAE4C538, 0094 (r1 INTEL       KBL        0 MSFT       5F)
(XEN) [000000111689e1c5] ACPI: SSDT CAE4C5D0, 0141 (r2 INTEL    HdaDsp        0 INTL 20160422)
(XEN) [000000111689f59c] ACPI: SSDT CAE4C718, 029F (r2 INTEL  sensrhub        0 INTL 20160422)
(XEN) [00000011168a08ec] ACPI: SSDT CAE4C9B8, 3002 (r2 INTEL  PtidDevc     1000 INTL 20160422)
(XEN) [00000011168a1cef] ACPI: SSDT CAE4F9C0, 050D (r2 INTEL  TbtTypeC        0 INTL 20160422)
(XEN) [00000011168a300f] ACPI: DBGP CAE4FED0, 0034 (r1 INTEL                  2 MSFT       5F)
(XEN) [00000011168a42e3] ACPI: DBG2 CAE4FF08, 0054 (r0 INTEL                  2 MSFT       5F)
(XEN) [00000011168a5551] ACPI: MSDM CAE4FF60, 0055 (r3 DELL    CBX3     6222004 AMI     10013)
(XEN) [00000011168a6912] ACPI: SLIC CAE4FFB8, 0176 (r3 DELL    CBX3     1072009 MSFT    10013)
(XEN) [00000011168a7ca0] ACPI: TCPA CAE50130, 0032 (r2 ALASKA  NAPAASF        0 MSFT  1000013)
(XEN) [00000011168a9008] ACPI: ASF! CAE50168, 00A0 (r32 INTEL       HCG        1 TFSM    F4240)
(XEN) [00000011168aa4ab] ACPI: BGRT CAE50208, 0038 (r0     ??           1072009 AMI     10013)
(XEN) [00000011168aba13] ACPI: DMAR CAE50240, 00CC (r1 INTEL      KBL         1 INTL        1)
(XEN) [00000011168fb90f] System RAM: 16247MB (16637380kB)
(XEN) [00000011178d8a07] No NUMA configuration found
(XEN) [00000011178d9f5a] Faking a node at 0000000000000000-000000042e000000
(XEN) [000000114ceac1ba] Domain heap initialised
(XEN) [00000011c95fa2b8] vesafb: framebuffer at 0x00000000d0000000, mapped to 0xffff82c000201000, using 8128k, total 8128k
(XEN) [00000011c95fb492] vesafb: mode is 1920x1080x32, linelength=7680, font 8x16
(XEN) [00000011c95fc43c] vesafb: Truecolor: size=8:8:8:8, shift=24:16:8:0
(XEN) [00000011c962df35] CPU Vendor: Intel, Family 6 (0x6), Model 158 (0x9e), Stepping 9 (raw 000906e9)
(XEN) [00000011cad6799d] SMBIOS 3.0 present.
(XEN) [00000011cb099c8b] Using APIC driver default
(XEN) [00000011cb40f8da] XSM Framework v1.0.1 initialized
(XEN) [00000011cb7e9e2c] Initialising XSM SILO mode
(XEN) [00000011cbb87546] ACPI: PM-Timer IO Port: 0x1808 (24 bits)
(XEN) [00000011cbfc66eb] ACPI: v5 SLEEP INFO: control[1:1804], status[1:1800]
(XEN) [00000011cc4a564c] ACPI: Invalid sleep control/status register data: 0:0x8:0x3 0:0x8:0x3
(XEN) [00000011cca6905e] ACPI: SLEEP INFO: pm1x_cnt[1:1804,1:0], pm1x_evt[1:1800,1:0]
(XEN) [00000011ccfb2487] ACPI: 32/64X FACS address mismatch in FADT - cb76cf00/0000000000000000, using 32
(XEN) [00000011cd608c3b] ACPI:             wakeup_vec[cb76cf0c], vec_size[20]
(XEN) [00000011cdb71728] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
(XEN) [00000011ce036475] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
(XEN) [00000011ce4fae35] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x04] enabled)
(XEN) [00000011ce9c007d] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x06] enabled)
(XEN) [00000011cee982df] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
(XEN) [00000011cf373eef] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
(XEN) [00000011cf84e27f] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
(XEN) [00000011cfd28dc8] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
(XEN) [00000011d0284a20] ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
(XEN) [00000011d07925f5] IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-119
(XEN) [00000011d0d19db5] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) [00000011d12378d0] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) [00000011d1789a07] Enabling APIC mode:  Flat.  Using 1 I/O APICs
(XEN) [00000011d1c172bd] ACPI: HPET id: 0x8086a701 base: 0xfed00000
(XEN) [00000011d20836c5] PCI: MCFG configuration 0: base f0000000 segment 0000 buses 00 - 7f
(XEN) [00000011d2633ea1] PCI: MCFG area at f0000000 reserved in E820
(XEN) [00000011d2aa3cdf] PCI: Using MCFG for segment 0000 bus 00-7f
(XEN) [00000011d2faa395] ACPI: BGRT: invalidating v1 image at 0xc5e16018
(XEN) [00000011d344ea62] Using ACPI (MADT) for SMP configuration information
(XEN) [00000011d3928203] SMP: Allowing 4 CPUs (0 hotplug CPUs)
(XEN) [00000011d3d549e8] IRQ limits: 120 GSI, 840 MSI/MSI-X
(XEN) [00000011d51d5bd1] Switched to APIC driver x2apic_phys
(XEN) [00000011d570bc02] xstate: size: 0x440 and states: 0x1f
(XEN) [00000011d5b9a895] CPU0: Intel machine check reporting enabled
(XEN) [00000011d601241c] Speculative mitigation facilities:
(XEN) [00000011d6408468]   Hardware hints: RSBA
(XEN) [00000011d675c17b]   Hardware features: IBPB IBRS STIBP SSBD L1D_FLUSH MD_CLEAR SRBDS_CTRL GDS_CTRL
(XEN) [00000011d6dbd851]   Compiled-in support: INDIRECT_THUNK SHADOW_PAGING
(XEN) [00000011d729850c]   Xen settings: BTI-Thunk JMP, SPEC_CTRL: IBRS+ STIBP+ SSBD- PSFD-, Other: SRB_LOCK+ IBPB-ctxt L1D_FLUSH VERW BRANCH_HARDEN
(XEN) [00000011d7b3c556]   L1TF: believed vulnerable, maxphysaddr L1D 46, CPUID 39, Safe address 8000000000
(XEN) [00000011d81b784c]   Support for HVM VMs: MSR_SPEC_CTRL RSB EAGER_FPU MD_CLEAR
(XEN) [00000011d876908a]   Support for PV VMs: MSR_SPEC_CTRL EAGER_FPU MD_CLEAR
(XEN) [00000011d8c6d00f]   XPTI (64-bit PV only): Dom0 enabled, DomU enabled (with PCID)
(XEN) [00000011d91eb70d]   PV L1TF shadowing: Dom0 disabled, DomU enabled
(XEN) [00000011d96a2d2e] Using scheduler: SMP Credit Scheduler (credit)
(XEN) [00000011e1cb2012] Platform timer is 23.999MHz HPET
(XEN) [    1.271756] Detected 2712.156 MHz processor.
(XEN) [    1.276948] EFI memory map:
(XEN) [    1.277398]  0000000000000-0000000007fff type=3 attr=000000000000000f
(XEN) [    1.278211]  0000000008000-000000000bfff type=2 attr=000000000000000f
(XEN) [    1.279193]  000000000c000-0000000047fff type=7 attr=000000000000000f
(XEN) [    1.280008]  0000000048000-0000000057fff type=2 attr=000000000000000f
(XEN) [    1.280824]  0000000058000-0000000058fff type=0 attr=000000000000000f
(XEN) [    1.281637]  0000000059000-000000005efff type=7 attr=000000000000000f
(XEN) [    1.282450]  000000005f000-000000005ffff type=4 attr=000000000000000f
(XEN) [    1.283262]  0000000060000-000000009efff type=3 attr=000000000000000f
(XEN) [    1.284075]  000000009f000-000000009ffff type=0 attr=000000000000000f
(XEN) [    1.284889]  0000000100000-0000001c2ffff type=2 attr=000000000000000f
(XEN) [    1.285702]  0000001c30000-000007e279fff type=7 attr=000000000000000f
(XEN) [    1.286515]  000007e27a000-00000abf6cfff type=2 attr=000000000000000f
(XEN) [    1.287329]  00000abf6d000-00000abfacfff type=4 attr=000000000000000f
(XEN) [    1.288142]  00000abfad000-00000b7177fff type=7 attr=000000000000000f
(XEN) [    1.288956]  00000b7178000-00000b7271fff type=1 attr=000000000000000f
(XEN) [    1.289769]  00000b7272000-00000b8ea9fff type=4 attr=000000000000000f
(XEN) [    1.290582]  00000b8eaa000-00000b8eaafff type=10 attr=000000000000000f
(XEN) [    1.291406]  00000b8eab000-00000b8eabfff type=6 attr=800000000000000f
(XEN) [    1.314047]  00000b8eac000-00000b8f5cfff type=4 attr=000000000000000f
(XEN) [    1.336649]  00000b8f5d000-00000c3dfffff type=7 attr=000000000000000f
(XEN) [    1.359375]  00000c3e00000-00000c41defff type=2 attr=000000000000000f
(XEN) [    1.382334]  00000c41df000-00000c89a0fff type=4 attr=000000000000000f
(XEN) [    1.405266]  00000c89a1000-00000c8d2cfff type=7 attr=000000000000000f
(XEN) [    1.428267]  00000c8d2d000-00000c97d3fff type=3 attr=000000000000000f
(XEN) [    1.451410]  00000c97d4000-00000cae0afff type=0 attr=000000000000000f
(XEN) [    1.474365]  00000cae0b000-00000cae50fff type=9 attr=000000000000000f
(XEN) [    1.497456]  00000cae51000-00000cb771fff type=10 attr=000000000000000f
(XEN) [    1.520264]  00000cb772000-00000cbd16fff type=6 attr=800000000000000f
(XEN) [    1.543067]  00000cbd17000-00000cbdfefff type=5 attr=800000000000000f
(XEN) [    1.566053]  00000cbdff000-00000cbdfffff type=4 attr=000000000000000f
(XEN) [    1.588858]  0000100000000-000042dffffff type=7 attr=000000000000000f
(XEN) [    1.611716]  00000000a0000-00000000fffff type=0 attr=0000000000000000
(XEN) [    1.634742] Unknown cachability for MFNs 0xa0-0xff, assuming UC
(XEN) [    1.682484]  00000cbe00000-00000cfffffff type=0 attr=0000000000000000
(XEN) [    1.705318] Unknown cachability for MFNs 0xcbe00-0xcffff, assuming UC
(XEN) [    1.728783]  00000f0000000-00000f7ffffff type=11 attr=8000000000000000
(XEN) [    1.751623] Unknown cachability for MFNs 0xf0000-0xf7fff, assuming UC
(XEN) [    1.775323]  00000fe000000-00000fe010fff type=11 attr=8000000000000001
(XEN) [    1.798260]  00000fec00000-00000fec00fff type=11 attr=8000000000000001
(XEN) [    1.821050]  00000fee00000-00000fee00fff type=11 attr=800000000000100d
(XEN) [    1.843860]  00000ff000000-00000ffffffff type=11 attr=800000000000100d
(XEN) [    1.866833] alt table ffff82d080456fd8 -> ffff82d080465ef0
(XEN) [    1.921640] Intel VT-d iommu 0 supported page sizes: 4kB, 2MB, 1GB
(XEN) [    1.944353] Intel VT-d iommu 1 supported page sizes: 4kB, 2MB, 1GB
(XEN) [    1.967300] Intel VT-d Snoop Control not enabled.
(XEN) [    1.989941] Intel VT-d Dom0 DMA Passthrough not enabled.
(XEN) [    2.012773] Intel VT-d Queued Invalidation enabled.
(XEN) [    2.035305] Intel VT-d Interrupt Remapping enabled.
(XEN) [    2.057854] Intel VT-d Posted Interrupt not enabled.
(XEN) [    2.080597] Intel VT-d Shared EPT tables enabled.
(XEN) [    2.103587] I/O virtualisation enabled
(XEN) [    2.126004]  - Dom0 mode: Relaxed
(XEN) [    2.148496] Interrupt remapping enabled
(XEN) [    2.170755] Enabled directed EOI with ioapic_ack_old on!
(XEN) [    2.198385] ENABLING IO-APIC IRQs
(XEN) [    2.220421]  -> Using old ACK method
(XEN) [    2.242658] ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=0 pin2=0
(XEN) [    3.047775] Allocated console ring of 64 KiB.
(XEN) [    3.068809] VMX: Supported advanced features:
(XEN) [    3.090108]  - APIC MMIO access virtualisation
(XEN) [    3.111308]  - APIC TPR shadow
(XEN) [    3.132328]  - Extended Page Tables (EPT)
(XEN) [    3.153126]  - Virtual-Processor Identifiers (VPID)
(XEN) [    3.173944]  - Virtual NMI
(XEN) [    3.194601]  - MSR direct-access bitmap
(XEN) [    3.215445]  - Unrestricted Guest
(XEN) [    3.236083]  - VMCS shadowing
(XEN) [    3.256549]  - VM Functions
(XEN) [    3.276837]  - Virtualisation Exceptions
(XEN) [    3.297238]  - Page Modification Logging
(XEN) [    3.317351] HVM: ASIDs enabled.
(XEN) [    3.337212] HVM: VMX enabled
(XEN) [    3.356862] HVM: Hardware Assisted Paging (HAP) detected
(XEN) [    3.376609] HVM: HAP page sizes: 4kB, 2MB, 1GB
(XEN) [    3.397041] alt table ffff82d080456fd8 -> ffff82d080465ef0
(XEN) [    3.417340] [VT-D]INTR-REMAP: Request device [0000:f0:1f.0] fault index 0
(XEN) [    3.437008] [VT-D]INTR-REMAP: reason 24 - Detected reserved fields in the IRTE entry
(XEN) [    3.457214] Brought up 4 CPUs
(XEN) [    3.476330] Testing NMI watchdog on all CPUs: ok
(XEN) [    3.520284] Scheduling granularity: cpu, 1 CPU per sched-resource
(XEN) [    3.559896] mcheck_poll: Machine check polling timer started.
(XEN) [    3.579561] Dom0 has maximum 696 PIRQs
(XEN) [    3.598493] csched_alloc_domdata: setting dom 0 as the privileged domain
(XEN) [    3.617876] NX (Execute Disable) protection active
(XEN) [    3.636757] *** Building a PV Dom0 ***
(XEN) [    3.932906]  Xen  kernel: 64-bit, lsb, compat32
(XEN) [    3.951911]  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x302c000
(XEN) [    3.971564] PHYSICAL MEMORY ARRANGEMENT:
(XEN) [    3.990415]  Dom0 alloc.:   0000000418000000->000000041c000000 (208742 pages to be allocated)
(XEN) [    4.010375]  Init. ramdisk: 000000042cb66000->000000042dfff803
(XEN) [    4.029921] VIRTUAL MEMORY ARRANGEMENT:
(XEN) [    4.048679]  Loaded kernel: ffffffff81000000->ffffffff8302c000
(XEN) [    4.067494]  Init. ramdisk: 0000000000000000->0000000000000000
(XEN) [    4.086304]  Phys-Mach map: 0000008000000000->00000080001c2000
(XEN) [    4.105105]  Start info:    ffffffff8302c000->ffffffff8302c4b8
(XEN) [    4.123888]  Xenstore ring: 0000000000000000->0000000000000000
(XEN) [    4.142638]  Console ring:  0000000000000000->0000000000000000
(XEN) [    4.161312]  Page tables:   ffffffff8302d000->ffffffff8304a000
(XEN) [    4.180183]  Boot stack:    ffffffff8304a000->ffffffff8304b000
(XEN) [    4.198871]  TOTAL:         ffffffff80000000->ffffffff83400000
(XEN) [    4.217506]  ENTRY ADDRESS: ffffffff8242b180
(XEN) [    4.237502] Dom0 has maximum 4 VCPUs
(XEN) [    5.202354] Initial low memory virq threshold set at 0x4000 pages.
(XEN) [    5.220924] Scrubbing Free RAM in background
(XEN) [    5.239261] Std. Loglevel: Errors, warnings and info
(XEN) [    5.257841] Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) [    5.276800] Xen is relinquishing VGA console.
(XEN) [    5.300773] *** Serial input to DOM0 (type 'CTRL-a' three times to switch input)
(XEN) [    5.300853] Freed 608kB init memory
(XEN) [ 6839.987889] d1: GFN 0xf1807 (0xef138,0,5,7) -> (0xef004,0,5,7) not permitted
(XEN) [ 6839.987893] domain_crash called from arch/x86/mm/p2m.c#set_typed_p2m_entry+0x264/0x5f0
(XEN) [ 6839.987894] Domain 1 reported crashed by domain 0 on cpu#2:
(XEN) [ 6839.987897] memory_map:fail: dom1 gfn=f1807 mfn=ef004 nr=1 ret:-1
(XEN) [52867.219362] d2: GFN 0xf1807 (0xef138,0,5,7) -> (0xef004,0,5,7) not permitted
(XEN) [52867.219366] domain_crash called from arch/x86/mm/p2m.c#set_typed_p2m_entry+0x264/0x5f0
(XEN) [52867.219368] Domain 2 reported crashed by domain 0 on cpu#2:
(XEN) [52867.219371] memory_map:fail: dom2 gfn=f1807 mfn=ef004 nr=1 ret:-1

[RAG67958472]

lspci -vvv

00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v6/7th Gen Core Processor Host Bridge/DRAM Registers (rev 05)
	Subsystem: Dell Device 07a1
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ >SERR- <PERR- INTx-
	Latency: 0
	Capabilities: [e0] Vendor Specific Information: Len=10 <?>

00:02.0 VGA compatible controller: Intel Corporation HD Graphics 630 (rev 04) (prog-if 00 [VGA controller])
	Subsystem: Dell Device 07a1
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin A routed to IRQ 16
	Region 0: Memory at ee000000 (64-bit, non-prefetchable) [disabled] [size=16M]
	Region 2: Memory at d0000000 (64-bit, prefetchable) [disabled] [size=256M]
	Region 4: I/O ports at f000 [disabled] [size=64]
	[virtual] Expansion ROM at 000c0000 [disabled] [size=128K]
	Capabilities: [40] Vendor Specific Information: Len=0c <?>
	Capabilities: [70] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0
			ExtTag- RBE+
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR-, OBFF Not Supported
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
	Capabilities: [ac] MSI: Enable- Count=1/1 Maskable- 64bit-
		Address: 00000000  Data: 0000
	Capabilities: [d0] Power Management version 2
		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [100 v1] Process Address Space ID (PASID)
		PASIDCap: Exec- Priv-, Max PASID Width: 14
		PASIDCtl: Enable- Exec- Priv-
	Capabilities: [200 v1] Address Translation Service (ATS)
		ATSCap:	Invalidate Queue Depth: 00
		ATSCtl:	Enable-, Smallest Translation Unit: 00
	Capabilities: [300 v1] Page Request Interface (PRI)
		PRICtl: Enable- Reset-
		PRISta: RF- UPRGI- Stopped+
		Page Request Capacity: 00008000, Page Request Allocation: 00000000
	Kernel driver in use: pciback
	Kernel modules: i915

00:14.0 USB controller: Intel Corporation 200 Series/Z370 Chipset Family USB 3.0 xHCI Controller (prog-if 30 [XHCI])
	Subsystem: Dell Device 07a1
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin B routed to IRQ 154
	Region 0: Memory at ef120000 (64-bit, non-prefetchable) [size=64K]
	Capabilities: [70] Power Management version 2
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA PME(D0-,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [80] MSI: Enable+ Count=1/8 Maskable- 64bit+
		Address: 00000000fee00f58  Data: 0000
	Kernel driver in use: xhci_hcd
	Kernel modules: xhci_pci

00:14.2 Signal processing controller: Intel Corporation 200 Series PCH Thermal Subsystem
	Subsystem: Dell Device 07a1
	Control: I/O- Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin A routed to IRQ 6
	Region 0: Memory at ef13c000 (64-bit, non-prefetchable) [size=4K]
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
		Address: 00000000  Data: 0000

00:15.0 Signal processing controller: Intel Corporation 200 Series PCH Serial IO I2C Controller #0
	Subsystem: Dell Device 07a1
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 16
	Region 0: Memory at ef13b000 (64-bit, non-prefetchable) [size=4K]
	Capabilities: [80] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D3 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [90] Vendor Specific Information: Len=14 <?>
	Kernel driver in use: intel-lpss
	Kernel modules: intel_lpss_pci

00:16.0 Communication controller: Intel Corporation 200 Series PCH CSME HECI #1
	Subsystem: Dell Device 07a1
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin A routed to IRQ 10
	Region 0: Memory at ef13a000 (64-bit, non-prefetchable) [disabled] [size=4K]
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot+,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000

00:16.3 Serial controller: Intel Corporation Device a2bd (prog-if 02 [16550])
	Subsystem: Dell Device 07a1
	Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin D routed to IRQ 20
	Region 0: I/O ports at f0a0 [size=8]
	Region 1: Memory at ef139000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [40] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: serial

00:17.0 SATA controller: Intel Corporation 200 Series PCH SATA controller [AHCI mode] (prog-if 01 [AHCI 1.0])
	Subsystem: Dell Device 07a1
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin A routed to IRQ 22
	Region 0: Memory at ef134000 (32-bit, non-prefetchable) [size=8K]
	Region 1: Memory at ef138000 (32-bit, non-prefetchable) [size=256]
	Region 2: I/O ports at f090 [size=8]
	Region 3: I/O ports at f080 [size=4]
	Region 4: I/O ports at f060 [size=32]
	Region 5: Memory at ef137000 (32-bit, non-prefetchable) [size=2K]
	Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
		Address: 00000000  Data: 0000
	Capabilities: [70] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot+,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [a8] SATA HBA v1.0 BAR4 Offset=00000004
	Kernel driver in use: pciback
	Kernel modules: ahci

00:1b.0 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port #17 (rev f0) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR+ <PERR- INTx-
	Latency: 0
	Interrupt: pin A routed to IRQ 150
	Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
	I/O behind bridge: 0000f000-00000fff
	Memory behind bridge: ef000000-ef0fffff
	Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort+ <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity- SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [40] Express (v2) Root Port (Slot+), MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0
			ExtTag- RBE+
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 256 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
		LnkCap:	Port #17, Speed 8GT/s, Width x4, ASPM not supported, Exit Latency L0s <1us, L1 <16us
			ClockPM- Surprise- LLActRep+ BwNot+ ASPMOptComp+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 8GT/s, Width x4, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt-
		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
			Slot #1, PowerLimit 25.000W; Interlock- NoCompl+
		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
			Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
			Changed: MRL- PresDet- LinkState+
		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna- CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range ABC, TimeoutDis+, LTR+, OBFF Not Supported ARIFwd+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR+, OBFF Disabled ARIFwd-
		LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete+, EqualizationPhase1+
			 EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
		Address: fee00f18  Data: 0000
	Capabilities: [90] Subsystem: Dell Device 07a1
	Capabilities: [a0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 15, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [140 v1] Access Control Services
		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd- EgressCtrl- DirectTrans-
		ACSCtl:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
	Capabilities: [220 v1] #19
	Kernel driver in use: pcieport

00:1f.0 ISA bridge: Intel Corporation 200 Series PCH LPC Controller (Q270)
	Subsystem: Dell Device 07a1
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

00:1f.2 Memory controller: Intel Corporation 200 Series/Z370 Chipset Family Power Management Controller
	Subsystem: Dell Device 07a1
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Region 0: Memory at ef130000 (32-bit, non-prefetchable) [size=16K]

00:1f.4 SMBus: Intel Corporation 200 Series/Z370 Chipset Family SMBus Controller
	Subsystem: Dell Device 07a1
	Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin C routed to IRQ 23
	Region 0: Memory at ef136000 (64-bit, non-prefetchable) [size=256]
	Region 4: I/O ports at f040 [size=32]
	Kernel driver in use: i801_smbus
	Kernel modules: i2c_i801

00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (5) I219-LM
	Subsystem: Dell Device 07a1
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin D routed to IRQ 153
	Region 0: Memory at ef100000 (32-bit, non-prefetchable) [size=128K]
	Capabilities: [c8] Power Management version 3
		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME-
	Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
		Address: 00000000fee00f38  Data: 0000
	Capabilities: [e0] PCI Advanced Features
		AFCap: TP+ FLR+
		AFCtrl: FLR-
		AFStatus: TP-
	Kernel driver in use: e1000e
	Kernel modules: e1000e

01:00.0 Non-Volatile memory controller: Sandisk Corp Device 501a (prog-if 02 [NVM Express])
	Subsystem: Sandisk Corp Device 501a
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin A routed to IRQ 16
	Region 0: Memory at ef000000 (64-bit, non-prefetchable) [size=16K]
	Region 4: Memory at ef004000 (64-bit, non-prefetchable) [size=256]
	Capabilities: [80] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [90] MSI: Enable- Count=1/32 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [b0] MSI-X: Enable- Count=17 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=4 offset=00000000
	Capabilities: [c0] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <1us, L1 unlimited
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0.000W
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
			MaxPayload 256 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x4, ASPM L1, Exit Latency L0s <256ns, L1 <8us
			ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- CommClk+
			ExtSynch- ClockPM+ AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 8GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Range B, TimeoutDis+, LTR+, OBFF Not Supported
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR+, OBFF Disabled
		LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
			 EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
	Capabilities: [100 v2] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
	Capabilities: [150 v1] Device Serial Number 00-00-00-00-00-00-00-00
	Capabilities: [1b8 v1] Latency Tolerance Reporting
		Max snoop latency: 0ns
		Max no snoop latency: 0ns
	Capabilities: [300 v1] #19
	Capabilities: [900 v1] L1 PM Substates
		L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1- ASPM_L1.2+ ASPM_L1.1- L1_PM_Substates+
			  PortCommonModeRestoreTime=32us PortTPowerOnTime=10us
	Kernel driver in use: pciback
	Kernel modules: nvme

[andSmv]

@RAG67958472
Thank you!

This seems to be a bug. On some level when mapping NVMe device MMIO frame ef004 (BAR 4) it reuse the same guest frame where SATA device MMIO frame ef138 (BAR 1) is allready mapped. This is failing so the domain is stopped by XEN.

I have no idea what part of code is responsible of reusing the same guest frame (gfn) for this mappings (probably in toolstack/QEMU,....).

So at first it will be usefull have whole XEN traces from domU start (If I understand correctly you have XEN start in your traces and also the bug traces from 2 times you tried to launch the domU). Are these the only traces when you launch domU?

The second thing - it would be nice to start XEN in debug mode (normally you have XEN image builded with debug traces activated) Can you please start this image and provide these traces.

I will talk to XEN maintainers to see if the problem was allready reported by users. (The code wich stop the domain didn't change in most recent XEN, but the issue is probably situated in upper layers)

It would be also very usefull to see if the problem is the same with pvh and hvm guests.

[RAG67958472]

@andSmv Hello thanks for your response I looked through some docs and enabled loglvl all and seem to get more logs. Hope this is what you were looking for.

__  __            _  _    _ _____ _  _   
 \ \/ /___ _ __   | || |  / |___ /| || |  
  \  // _ \ '_ \  | || |_ | | |_ \| || |_ 
  /  \  __/ | | | |__   _|| |___) |__   _|
 /_/\_\___|_| |_|    |_|(_)_|____(_) |_|  
                                          
(XEN) [0000002e73d8310b] Xen version 4.13.4-9.19.1 (mockbuild@[unknown]) (gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-28)) debug=n  Wed Feb  9 12:07:47 CET 2022
(XEN) [0000002e73d84279] Latest ChangeSet: 6e2fc128eb1a, pq dd3d13f0a45e
(XEN) [0000002e73d85873] build-id: b709b0bb6a0cad9906689853f5bc629ba4b3e23f
(XEN) [0000002e73d86204] Bootloader: GRUB 2.02
(XEN) [0000002e73d86c42] Command line: dom0_mem=1840M,max:1840M watchdog ucode=scan dom0_max_vcpus=1-4 crashkernel=256M,below=4G console=vga vga=mode-0x0311 loglvl=all guest_loglvl=all
(XEN) [0000002e73d87b6a] Xen image load base address: 0xc3c00000
(XEN) [0000002e73d8830f] Video information:
(XEN) [0000002e73d88f14]  VGA is graphics mode 1920x1080, 32 bpp
(XEN) [0000002e73d89725] Disc information:
(XEN) [0000002e73d89f00]  Found 0 MBR signatures
(XEN) [0000002e73d8a6fb]  Found 3 EDD information structures
(XEN) [0000002e73d8f5f1] EFI RAM map:
(XEN) [0000002e73d902b2]  0000000000000000 - 0000000000058000 (usable)
(XEN) [0000002e73d91027]  0000000000058000 - 0000000000059000 (reserved)
(XEN) [0000002e73d91cec]  0000000000059000 - 000000000009f000 (usable)
(XEN) [0000002e73d9294e]  000000000009f000 - 0000000000100000 (reserved)
(XEN) [0000002e73d93768]  0000000000100000 - 00000000b8eaa000 (usable)
(XEN) [0000002e73d9441b]  00000000b8eaa000 - 00000000b8eab000 (ACPI NVS)
(XEN) [0000002e73d951b1]  00000000b8eab000 - 00000000b8eac000 (reserved)
(XEN) [0000002e73d95e40]  00000000b8eac000 - 00000000c97d4000 (usable)
(XEN) [0000002e73d96aa8]  00000000c97d4000 - 00000000cae0b000 (reserved)
(XEN) [0000002e73d9764c]  00000000cae0b000 - 00000000cae51000 (ACPI data)
(XEN) [0000002e73d982ba]  00000000cae51000 - 00000000cb772000 (ACPI NVS)
(XEN) [0000002e73d98e75]  00000000cb772000 - 00000000cbdff000 (reserved)
(XEN) [0000002e73d999dd]  00000000cbdff000 - 00000000cbe00000 (usable)
(XEN) [0000002e73d9a549]  00000000cbe00000 - 00000000d0000000 (reserved)
(XEN) [0000002e73d9b105]  00000000f0000000 - 00000000f8000000 (reserved)
(XEN) [0000002e73d9bcec]  00000000fe000000 - 00000000fe011000 (reserved)
(XEN) [0000002e73d9c82e]  00000000fec00000 - 00000000fec01000 (reserved)
(XEN) [0000002e73d9d3d4]  00000000fee00000 - 00000000fee01000 (reserved)
(XEN) [0000002e73d9dfdd]  00000000ff000000 - 0000000100000000 (reserved)
(XEN) [0000002e73d9ec0b]  0000000100000000 - 000000042e000000 (usable)
(XEN) [0000002e75fcf821] Kdump: 256MB (262144kB) at 0xa8e00000
(XEN) [0000002e75fe9a9d] ACPI: RSDP CAE19000, 0024 (r2 DELL  )
(XEN) [0000002e75feb985] ACPI: XSDT CAE190B8, 00F4 (r1 DELL    CBX3     1072009 AMI     10013)
(XEN) [0000002e75fedd6c] ACPI: FACP CAE44210, 010C (r5 DELL    CBX3     1072009 AMI     10013)
(XEN) [0000002e75fefe98] ACPI: DSDT CAE19240, 2AFCA (r2 DELL    CBX3     1072009 INTL 20160422)
(XEN) [0000002e75ff16b0] ACPI: FACS CB76CF00, 0040
(XEN) [0000002e75ff2601] ACPI: APIC CAE44320, 0084 (r3 DELL    CBX3     1072009 AMI     10013)
(XEN) [0000002e75ff3a73] ACPI: FPDT CAE443A8, 0044 (r1 DELL    CBX3     1072009 AMI     10013)
(XEN) [0000002e75ff4e7f] ACPI: FIDT CAE443F0, 00AC (r1 DELL    CBX3     1072009 AMI     10013)
(XEN) [0000002e75ff6151] ACPI: MCFG CAE444A0, 003C (r1 DELL    CBX3     1072009 MSFT       97)
(XEN) [0000002e75ff751a] ACPI: HPET CAE444E0, 0038 (r1 DELL    CBX3     1072009 AMI.    5000B)
(XEN) [0000002e75ff8843] ACPI: SSDT CAE44518, 3176 (r2 SaSsdt  SaSsdt      3000 INTL 20160422)
(XEN) [0000002e75ff9e09] ACPI: SSDT CAE47690, 25A5 (r2 PegSsd  PegSsdt     1000 INTL 20160422)
(XEN) [0000002e75ffb28d] ACPI: HPET CAE49C38, 0038 (r1 INTEL       KBL        1 MSFT       5F)
(XEN) [0000002e75ffc640] ACPI: SSDT CAE49C70, 0DE5 (r2 INTEL  Ther_Rvp     1000 INTL 20160422)
(XEN) [0000002e75ffdaf5] ACPI: SSDT CAE4AA58, 0BB4 (r2  INTEL DELL_MFF        0 INTL 20160422)
(XEN) [0000002e75ffef3b] ACPI: UEFI CAE4B610, 0042 (r1                        0             0)
(XEN) [0000002e7600033e] ACPI: SSDT CAE4B658, 0EDE (r2 CpuRef  CpuSsdt     3000 INTL 20160422)
(XEN) [0000002e76001760] ACPI: LPIT CAE4C538, 0094 (r1 INTEL       KBL        0 MSFT       5F)
(XEN) [0000002e760029bd] ACPI: SSDT CAE4C5D0, 0141 (r2 INTEL    HdaDsp        0 INTL 20160422)
(XEN) [0000002e76003cd3] ACPI: SSDT CAE4C718, 029F (r2 INTEL  sensrhub        0 INTL 20160422)
(XEN) [0000002e760050a1] ACPI: SSDT CAE4C9B8, 3002 (r2 INTEL  PtidDevc     1000 INTL 20160422)
(XEN) [0000002e7600645e] ACPI: SSDT CAE4F9C0, 050D (r2 INTEL  TbtTypeC        0 INTL 20160422)
(XEN) [0000002e7600773d] ACPI: DBGP CAE4FED0, 0034 (r1 INTEL                  2 MSFT       5F)
(XEN) [0000002e76008a44] ACPI: DBG2 CAE4FF08, 0054 (r0 INTEL                  2 MSFT       5F)
(XEN) [0000002e76009cfa] ACPI: MSDM CAE4FF60, 0055 (r3 DELL    CBX3     6222004 AMI     10013)
(XEN) [0000002e7600b0cd] ACPI: SLIC CAE4FFB8, 0176 (r3 DELL    CBX3     1072009 MSFT    10013)
(XEN) [0000002e7600c431] ACPI: TCPA CAE50130, 0032 (r2 ALASKA  NAPAASF        0 MSFT  1000013)
(XEN) [0000002e7600d779] ACPI: ASF! CAE50168, 00A0 (r32 INTEL       HCG        1 TFSM    F4240)
(XEN) [0000002e7600ec74] ACPI: BGRT CAE50208, 0038 (r0     ??           1072009 AMI     10013)
(XEN) [0000002e7601011d] ACPI: DMAR CAE50240, 00CC (r1 INTEL      KBL         1 INTL        1)
(XEN) [0000002e760600ff] System RAM: 16247MB (16637380kB)
(XEN) [0000002e770397a1] No NUMA configuration found
(XEN) [0000002e7703b006] Faking a node at 0000000000000000-000000042e000000
(XEN) [0000002eac248833] Domain heap initialised
(XEN) [0000002f28a89249] vesafb: framebuffer at 0x00000000d0000000, mapped to 0xffff82c000201000, using 8128k, total 8128k
(XEN) [0000002f28a8a3cf] vesafb: mode is 1920x1080x32, linelength=7680, font 8x16
(XEN) [0000002f28a8b39b] vesafb: Truecolor: size=8:8:8:8, shift=24:16:8:0
(XEN) [0000002f28abaab0] CPU Vendor: Intel, Family 6 (0x6), Model 158 (0x9e), Stepping 9 (raw 000906e9)
(XEN) [0000002f2a1e0203] SMBIOS 3.0 present.
(XEN) [0000002f2a50dfb1] Using APIC driver default
(XEN) [0000002f2a884cb7] XSM Framework v1.0.1 initialized
(XEN) [0000002f2ac598df] Initialising XSM SILO mode
(XEN) [0000002f2aff1070] ACPI: PM-Timer IO Port: 0x1808 (24 bits)
(XEN) [0000002f2b4317c8] ACPI: v5 SLEEP INFO: control[1:1804], status[1:1800]
(XEN) [0000002f2b9120ba] ACPI: Invalid sleep control/status register data: 0:0x8:0x3 0:0x8:0x3
(XEN) [0000002f2bed6fc3] ACPI: SLEEP INFO: pm1x_cnt[1:1804,1:0], pm1x_evt[1:1800,1:0]
(XEN) [0000002f2c491206] ACPI: 32/64X FACS address mismatch in FADT - cb76cf00/0000000000000000, using 32
(XEN) [0000002f2cae91e2] ACPI:             wakeup_vec[cb76cf0c], vec_size[20]
(XEN) [0000002f2cfd159b] ACPI: Local APIC address 0xfee00000
(XEN) [0000002f2d3e2391] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
(XEN) [0000002f2d8a8703] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
(XEN) [0000002f2dd6f28c] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x04] enabled)
(XEN) [0000002f2e23538f] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x06] enabled)
(XEN) [0000002f2e710dc5] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
(XEN) [0000002f2ebe4ff8] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
(XEN) [0000002f2f121d6a] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
(XEN) [0000002f2f5f538c] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
(XEN) [0000002f2fadec78] ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
(XEN) [0000002f2ffeda15] IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-119
(XEN) [0000002f3056bcc6] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) [0000002f30a822ae] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) [0000002f30fbff16] ACPI: IRQ0 used by override.
(XEN) [0000002f3135ed76] ACPI: IRQ2 used by override.
(XEN) [0000002f316fdd45] ACPI: IRQ9 used by override.
(XEN) [0000002f31b10f5b] Enabling APIC mode:  Flat.  Using 1 I/O APICs
(XEN) [0000002f31f97637] ACPI: HPET id: 0x8086a701 base: 0xfed00000
(XEN) [0000002f323fc7c9] PCI: MCFG configuration 0: base f0000000 segment 0000 buses 00 - 7f
(XEN) [0000002f329a69c3] PCI: MCFG area at f0000000 reserved in E820
(XEN) [0000002f32e1035f] PCI: Using MCFG for segment 0000 bus 00-7f
(XEN) [0000002f3329bd4f] ACPI: BGRT: invalidating v1 image at 0xc5deb018
(XEN) [0000002f337393b9] Using ACPI (MADT) for SMP configuration information
(XEN) [0000002f33c0bf73] SMP: Allowing 4 CPUs (0 hotplug CPUs)
(XEN) [0000002f34023aa4] NR_CPUS:512 nr_cpumask_bits:64
(XEN) [0000002f34458aff] IRQ limits: 120 GSI, 840 MSI/MSI-X
(XEN) [0000002f351f497d] Switched to APIC driver x2apic_cluster
(XEN) [0000002f35ec6a24] xstate: size: 0x440 and states: 0x1f
(XEN) [0000002f362e3ea3] CPU0: Intel machine check reporting enabled
(XEN) [0000002f36751b7b] Speculative mitigation facilities:
(XEN) [0000002f36b4169c]   Hardware hints: RSBA
(XEN) [0000002f36e9073d]   Hardware features: IBPB IBRS STIBP SSBD L1D_FLUSH MD_CLEAR SRBDS_CTRL
(XEN) [0000002f374dc7c8]   Compiled-in support: INDIRECT_THUNK SHADOW_PAGING
(XEN) [0000002f379af464]   Xen settings: BTI-Thunk JMP, SPEC_CTRL: IBRS+ SSBD-, Other: SRB_LOCK+ IBPB L1D_FLUSH VERW BRANCH_HARDEN
(XEN) [0000002f38155db2]   L1TF: believed vulnerable, maxphysaddr L1D 46, CPUID 39, Safe address 8000000000
(XEN) [0000002f387c78d4]   Support for HVM VMs: MSR_SPEC_CTRL RSB EAGER_FPU MD_CLEAR
(XEN) [0000002f38d051cf]   Support for PV VMs: MSR_SPEC_CTRL EAGER_FPU MD_CLEAR
(XEN) [0000002f39200039]   XPTI (64-bit PV only): Dom0 enabled, DomU enabled (with PCID)
(XEN) [0000002f397729d0]   PV L1TF shadowing: Dom0 disabled, DomU enabled
(XEN) [0000002f39c84177] Using scheduler: SMP Credit Scheduler (credit)
(XEN) [0000002f422a8d95] Platform timer is 23.999MHz HPET
(XEN) [    1.277990] Detected 2712.068 MHz processor.
(XEN) [    1.283944] EFI memory map:
(XEN) [    1.284962]  0000000000000-0000000007fff type=3 attr=000000000000000f
(XEN) [    1.286827]  0000000008000-000000000bfff type=2 attr=000000000000000f
(XEN) [    1.288693]  000000000c000-0000000047fff type=7 attr=000000000000000f
(XEN) [    1.290716]  0000000048000-0000000057fff type=2 attr=000000000000000f
(XEN) [    1.292581]  0000000058000-0000000058fff type=0 attr=000000000000000f
(XEN) [    1.294447]  0000000059000-000000005efff type=7 attr=000000000000000f
(XEN) [    1.296311]  000000005f000-000000005ffff type=4 attr=000000000000000f
(XEN) [    1.298176]  0000000060000-000000009efff type=3 attr=000000000000000f
(XEN) [    1.300041]  000000009f000-000000009ffff type=0 attr=000000000000000f
(XEN) [    1.301906]  0000000100000-0000001bcefff type=2 attr=000000000000000f
(XEN) [    1.303772]  0000001bcf000-000007e279fff type=7 attr=000000000000000f
(XEN) [    1.305636]  000007e27a000-00000abf6cfff type=2 attr=000000000000000f
(XEN) [    1.307661]  00000abf6d000-00000abfacfff type=4 attr=000000000000000f
(XEN) [    1.360620]  00000abfad000-00000b7177fff type=7 attr=000000000000000f
(XEN) [    1.413575]  00000b7178000-00000b7271fff type=1 attr=000000000000000f
(XEN) [    1.466811]  00000b7272000-00000b8ea9fff type=4 attr=000000000000000f
(XEN) [    1.520269]  00000b8eaa000-00000b8eaafff type=10 attr=000000000000000f
(XEN) [    1.574148]  00000b8eab000-00000b8eabfff type=6 attr=800000000000000f
(XEN) [    1.627975]  00000b8eac000-00000b8f5cfff type=4 attr=000000000000000f
(XEN) [    1.681820]  00000b8f5d000-00000c3dfffff type=7 attr=000000000000000f
(XEN) [    1.735508]  00000c3e00000-00000c41dcfff type=2 attr=000000000000000f
(XEN) [    1.789063]  00000c41dd000-00000c89a0fff type=4 attr=000000000000000f
(XEN) [    1.842513]  00000c89a1000-00000c8d2cfff type=7 attr=000000000000000f
(XEN) [    1.895657]  00000c8d2d000-00000c97d3fff type=3 attr=000000000000000f
(XEN) [    1.948882]  00000c97d4000-00000cae0afff type=0 attr=000000000000000f
(XEN) [    2.002142]  00000cae0b000-00000cae50fff type=9 attr=000000000000000f
(XEN) [    2.055424]  00000cae51000-00000cb771fff type=10 attr=000000000000000f
(XEN) [    2.108946]  00000cb772000-00000cbd16fff type=6 attr=800000000000000f
(XEN) [    2.162314]  00000cbd17000-00000cbdfefff type=5 attr=800000000000000f
(XEN) [    2.215694]  00000cbdff000-00000cbdfffff type=4 attr=000000000000000f
(XEN) [    2.269092]  0000100000000-000042dffffff type=7 attr=000000000000000f
(XEN) [    2.322519]  00000000a0000-00000000fffff type=0 attr=0000000000000000
(XEN) [    2.376122] Unknown cachability for MFNs 0xa0-0xff, assuming UC
(XEN) [    2.454173]  00000cbe00000-00000cfffffff type=0 attr=0000000000000000
(XEN) [    2.507640] Unknown cachability for MFNs 0xcbe00-0xcffff, assuming UC
(XEN) [    2.561317]  00000f0000000-00000f7ffffff type=11 attr=8000000000000000
(XEN) [    2.614507] Unknown cachability for MFNs 0xf0000-0xf7fff, assuming UC
(XEN) [    2.668640]  00000fe000000-00000fe010fff type=11 attr=8000000000000001
(XEN) [    2.722172]  00000fec00000-00000fec00fff type=11 attr=8000000000000001
(XEN) [    2.776125]  00000fee00000-00000fee00fff type=11 attr=800000000000100d
(XEN) [    2.830002]  00000ff000000-00000ffffffff type=11 attr=800000000000100d
(XEN) [    2.883978] alt table ffff82d080452ed0 -> ffff82d080461942
(XEN) [    2.938658] spurious 8259A interrupt: IRQ7.
(XEN) [    3.023242] Intel VT-d iommu 0 supported page sizes: 4kB, 2MB, 1GB
(XEN) [    3.077070] Intel VT-d iommu 1 supported page sizes: 4kB, 2MB, 1GB
(XEN) [    3.130784] Intel VT-d Snoop Control not enabled.
(XEN) [    3.184127] Intel VT-d Dom0 DMA Passthrough not enabled.
(XEN) [    3.237524] Intel VT-d Queued Invalidation enabled.
(XEN) [    3.291060] Intel VT-d Interrupt Remapping enabled.
(XEN) [    3.344438] Intel VT-d Posted Interrupt not enabled.
(XEN) [    3.397794] Intel VT-d Shared EPT tables enabled.
(XEN) [    3.451553] I/O virtualisation enabled
(XEN) [    3.504528]  - Dom0 mode: Relaxed
(XEN) [    3.557202] Interrupt remapping enabled
(XEN) [    3.610083] nr_sockets: 1
(XEN) [    3.662032] Enabled directed EOI with ioapic_ack_old on!
(XEN) [    3.722270] ENABLING IO-APIC IRQs
(XEN) [    3.773328]  -> Using old ACK method
(XEN) [    3.824297] ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=0 pin2=0
(XEN) [    4.076433] TSC deadline timer enabled
(XEN) [    4.702469] Allocated console ring of 64 KiB.
(XEN) [    4.752123] mwait-idle: MWAIT substates: 0x142120
(XEN) [    4.801623] mwait-idle: v0.4.1 model 0x9e
(XEN) [    4.850809] mwait-idle: lapic_timer_reliable_states 0xffffffff
(XEN) [    4.900390] VMX: Supported advanced features:
(XEN) [    4.949754]  - APIC MMIO access virtualisation
(XEN) [    4.999217]  - APIC TPR shadow
(XEN) [    5.048151]  - Extended Page Tables (EPT)
(XEN) [    5.096956]  - Virtual-Processor Identifiers (VPID)
(XEN) [    5.145756]  - Virtual NMI
(XEN) [    5.193859]  - MSR direct-access bitmap
(XEN) [    5.241866]  - Unrestricted Guest
(XEN) [    5.289293]  - VMCS shadowing
(XEN) [    5.336433]  - VM Functions
(XEN) [    5.383129]  - Virtualisation Exceptions
(XEN) [    5.429730]  - Page Modification Logging
(XEN) [    5.476034] HVM: ASIDs enabled.
(XEN) [    5.521715] HVM: VMX enabled
(XEN) [    5.567107] HVM: Hardware Assisted Paging (HAP) detected
(XEN) [    5.612803] HVM: HAP page sizes: 4kB, 2MB, 1GB
(XEN) [    5.659716] alt table ffff82d080452ed0 -> ffff82d080461942
(XEN) [    5.705424] Brought up 4 CPUs
(XEN) [    5.751073] Testing NMI watchdog on all CPUs: ok
(XEN) [    5.821661] Scheduling granularity: cpu, 1 CPU per sched-resource
(XEN) [    5.887756] mcheck_poll: Machine check polling timer started.
(XEN) [    5.933678] Dom0 has maximum 696 PIRQs
(XEN) [    5.979058] csched_alloc_domdata: setting dom 0 as the privileged domain
(XEN) [    6.024943] NX (Execute Disable) protection active
(XEN) [    6.070234] *** Building a PV Dom0 ***
(XEN) [    6.383473]  Xen  kernel: 64-bit, lsb, compat32
(XEN) [    6.428461]  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x302c000
(XEN) [    6.474228] PHYSICAL MEMORY ARRANGEMENT:
(XEN) [    6.519014]  Dom0 alloc.:   0000000418000000->000000041c000000 (449478 pages to be allocated)
(XEN) [    6.566690]  Init. ramdisk: 000000042cbc6000->000000042dfff3f8
(XEN) [    6.612901] VIRTUAL MEMORY ARRANGEMENT:
(XEN) [    6.657682]  Loaded kernel: ffffffff81000000->ffffffff8302c000
(XEN) [    6.702930]  Init. ramdisk: 0000000000000000->0000000000000000
(XEN) [    6.748119]  Phys-Mach map: 0000008000000000->0000008000398000
(XEN) [    6.793219]  Start info:    ffffffff8302c000->ffffffff8302c4b8
(XEN) [    6.837298]  Xenstore ring: 0000000000000000->0000000000000000
(XEN) [    6.881437]  Console ring:  0000000000000000->0000000000000000
(XEN) [    6.925504]  Page tables:   ffffffff8302d000->ffffffff8304a000
(XEN) [    6.969295]  Boot stack:    ffffffff8304a000->ffffffff8304b000
(XEN) [    7.013215]  TOTAL:         ffffffff80000000->ffffffff83400000
(XEN) [    7.056856]  ENTRY ADDRESS: ffffffff8242b180
(XEN) [    7.101780] Dom0 has maximum 4 VCPUs
(XEN) [    8.078875] Initial low memory virq threshold set at 0x4000 pages.
(XEN) [    8.122346] Scrubbing Free RAM in background
(XEN) [    8.165587] Std. Loglevel: All
(XEN) [    8.208697] Guest Loglevel: All
(XEN) [    8.251630] Xen is relinquishing VGA console.
(XEN) [    9.063439] *** Serial input to DOM0 (type 'CTRL-a' three times to switch input)
(XEN) [    9.063595] Freed 604kB init memory
(XEN) [   10.836138] PCI add device 0000:00:00.0
(XEN) [   10.836677] PCI add device 0000:00:02.0
(XEN) [   10.837495] PCI add device 0000:00:14.0
(XEN) [   10.838075] PCI add device 0000:00:14.2
(XEN) [   10.839526] PCI add device 0000:00:15.0
(XEN) [   10.840152] PCI add device 0000:00:16.0
(XEN) [   10.840668] PCI add device 0000:00:16.3
(XEN) [   10.841364] PCI add device 0000:00:17.0
(XEN) [   10.842033] PCI add device 0000:00:1b.0
(XEN) [   10.842593] PCI add device 0000:00:1f.0
(XEN) [   10.843097] PCI add device 0000:00:1f.2
(XEN) [   10.843709] PCI add device 0000:00:1f.4
(XEN) [   10.844377] PCI add device 0000:00:1f.6
(XEN) [   10.845390] PCI add device 0000:01:00.0
(XEN) [   86.458851] HVM d1v0 save: CPU
(XEN) [   86.458853] HVM d1v1 save: CPU
(XEN) [   86.458854] HVM d1 save: PIC
(XEN) [   86.458855] HVM d1 save: IOAPIC
(XEN) [   86.458856] HVM d1v0 save: LAPIC
(XEN) [   86.458857] HVM d1v1 save: LAPIC
(XEN) [   86.458858] HVM d1v0 save: LAPIC_REGS
(XEN) [   86.458859] HVM d1v1 save: LAPIC_REGS
(XEN) [   86.458860] HVM d1 save: PCI_IRQ
(XEN) [   86.458861] HVM d1 save: ISA_IRQ
(XEN) [   86.458862] HVM d1 save: PCI_LINK
(XEN) [   86.458863] HVM d1 save: PIT
(XEN) [   86.458864] HVM d1 save: RTC
(XEN) [   86.458865] HVM d1 save: HPET
(XEN) [   86.458866] HVM d1 save: PMTIMER
(XEN) [   86.458867] HVM d1v0 save: MTRR
(XEN) [   86.458869] HVM d1v1 save: MTRR
(XEN) [   86.458871] HVM d1 save: VIRIDIAN_DOMAIN
(XEN) [   86.458872] HVM d1v0 save: CPU_XSAVE
(XEN) [   86.458873] HVM d1v1 save: CPU_XSAVE
(XEN) [   86.458874] HVM d1v0 save: VIRIDIAN_VCPU
(XEN) [   86.458875] HVM d1v1 save: VIRIDIAN_VCPU
(XEN) [   86.458875] HVM d1v0 save: VMCE_VCPU
(XEN) [   86.458876] HVM d1v1 save: VMCE_VCPU
(XEN) [   86.458877] HVM d1v0 save: TSC_ADJUST
(XEN) [   86.458878] HVM d1v1 save: TSC_ADJUST
(XEN) [   86.458879] HVM d1v0 save: CPU_MSR
(XEN) [   86.458881] HVM d1v1 save: CPU_MSR
(XEN) [   86.458906] HVM1 restore: CPU 0
(d1) [   88.014036] HVM Loader
(d1) [   88.014231] Detected Xen v4.13
(d1) [   88.014502] Xenbus rings @0xfeffc000, event channel 3
(d1) [   88.014872] System requested ROMBIOS
(d1) [   88.015002] CPU speed is 2712 MHz
(d1) [   88.015503] Relocating guest memory for lowmem MMIO space disabled
(d1) [   88.016048] PCI-ISA link 0 routed to IRQ5
(d1) [   88.016434] PCI-ISA link 1 routed to IRQ10
(d1) [   88.016940] PCI-ISA link 2 routed to IRQ11
(d1) [   88.017326] PCI-ISA link 3 routed to IRQ5
(d1) [   88.039813] pci dev 01:2 INTD->IRQ5
(d1) [   88.044311] pci dev 01:3 INTA->IRQ10
(d1) [   88.052927] pci dev 03:0 INTA->IRQ5
(d1) [   88.057432] pci dev 04:0 INTA->IRQ5
(d1) [   88.062599] pci dev 05:0 INTA->IRQ10
(d1) [   88.069542] pci dev 06:0 INTA->IRQ11
(d1) [   88.094090] RAM in high memory; setting high_mem resource base to 21f800000
(d1) [   88.094595] pci dev 03:0 bar 14 size 001000000: 0f0000008
(d1) [   88.095164] pci dev 02:0 bar 10 size 000800000: 0f1000008
(d1) [   88.095709] pci dev 05:0 bar 10 size 000004000: 0f1800004
(d1) [   88.096328] pci dev 06:0 bar 10 size 000002000: 0f1804000
(d1) [   88.096908] pci dev 06:0 bar 24 size 000000800: 0f1806000
(d1) [   88.097394] pci dev 03:0 bar 10 size 000000100: 00000c001
(d1) [   88.097941] pci dev 04:0 bar 10 size 000000100: 00000c101
(d1) [   88.098495] pci dev 04:0 bar 14 size 000000100: 0f1806800
(d1) [   88.099067] pci dev 05:0 bar 20 size 000000100: 0f1806904
(d1) [   88.099575] pci dev 06:0 bar 14 size 000000100: 0f1806a00
(d1) [   88.100121] pci dev 01:2 bar 20 size 000000020: 00000c201
(d1) [   88.100668] pci dev 06:0 bar 20 size 000000020: 00000c221
(d1) [   88.101176] pci dev 01:1 bar 20 size 000000010: 00000c241
(d1) [   88.101688] pci dev 06:0 bar 18 size 000000008: 00000c251
(d1) [   88.102201] pci dev 06:0 bar 1c size 000000004: 00000c259
(XEN) [   88.114641] memory_map:add: dom1 gfn=f1800 mfn=ef000 nr=2
(XEN) [   88.115120] memory_map:add: dom1 gfn=f1803 mfn=ef003 nr=1
(XEN) [   88.115586] memory_map:add: dom1 gfn=f1807 mfn=ef004 nr=1
(XEN) [   88.116695] memory_map:add: dom1 gfn=f1804 mfn=ef134 nr=2
(XEN) [   88.117167] memory_map:add: dom1 gfn=f1806 mfn=ef137 nr=1
(XEN) [   88.117631] memory_map:add: dom1 gfn=f1807 mfn=ef138 nr=1
(XEN) [   88.117635] d1: GFN 0xf1807 (0xef004,0,5,7) -> (0xef138,0,5,7) not permitted
(XEN) [   88.117638] domain_crash called from arch/x86/mm/p2m.c#set_typed_p2m_entry+0x264/0x5f0
(XEN) [   88.117639] Domain 1 reported crashed by domain 0 on cpu#2:
(XEN) [   88.117642] memory_map:fail: dom1 gfn=f1807 mfn=ef138 nr=1 ret:-1
(XEN) [   88.118324] memory_map:remove: dom1 gfn=f1807 mfn=ef138 nr=1
(XEN) [   88.118958] ioport_map:add: dom1 gport=c220 mport=f060 nr=20
(XEN) [   88.119419] ioport_map:add: dom1 gport=c250 mport=f090 nr=8
(XEN) [   88.119872] ioport_map:add: dom1 gport=c258 mport=f080 nr=4

[RAG67958472]

Also i seem to get this when converting vm to PV in xoa and trying running it

vm.start
{
  "id": "58e58ab3-ba88-1634-2863-a00f78a32d03",
  "bypassMacAddressesCheck": false,
  "force": false
}
{
  "code": "INTERNAL_ERROR",
  "params": [
    "xenopsd internal error: Domain.Could_not_read_file(\"\")"
  ],
  "call": {
    "method": "VM.start",
    "params": [
      "OpaqueRef:487c7c8d-da73-4309-98d0-ff3ea67b29d8",
      false,
      false
    ]
  },
  "message": "INTERNAL_ERROR(xenopsd internal error: Domain.Could_not_read_file(\"\"))",
  "name": "XapiError",
  "stack": "XapiError: INTERNAL_ERROR(xenopsd internal error: Domain.Could_not_read_file(\"\"))
    at Function.wrap (file:///home/node/xen-orchestra/packages/xen-api/_XapiError.mjs:16:12)
    at file:///home/node/xen-orchestra/packages/xen-api/transports/json-rpc.mjs:35:21
    at runNextTicks (node:internal/process/task_queues:60:5)
    at processImmediate (node:internal/timers:447:9)
    at process.callbackTrampoline (node:internal/async_hooks:128:17)"
} 

[RAG67958472]

anyone has any other ideas ?? I seem to be lost at what to do.