XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Intel x710-t2l Problems

    Scheduled Pinned Locked Moved Hardware
    18 Posts 3 Posters 443 Views 3 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • W Offline
      wlp94114 @wlp94114
      last edited by olivierlambert

      This info may also shed light:

      [08:39 xandria /]# dmesg | grep i40e
      [   24.513039] i40e: Intel(R) 40-10 Gigabit Ethernet Connection Network Driver - version 2.25.11
      [   24.513042] i40e: Copyright (C) 2013-2024 Intel Corporation
      [   24.530151] i40e 0000:04:00.0: fw 6.0.48442 api 1.7 nvm 6.01 0x80003484 1.1747.0
      [   24.600704] i40e 0000:04:00.0: MAC source pruning enabled on all VFs
      [   24.600844] i40e 0000:04:00.0: MAC address: 40:a6:b7:b8:45:e8
      [   24.601304] i40e 0000:04:00.0: FW LLDP is disabled
      [   24.601361] i40e 0000:04:00.0: FW LLDP is disabled, attempting SW DCB
      [   24.609522] i40e 0000:04:00.0: SW DCB initialization succeeded.
      [   24.612187] i40e 0000:04:00.0: MAC source pruning enabled on all VFs
      [   24.626574] i40e 0000:04:00.0 eth1: NIC Link is Up, 10 Gbps Full Duplex, Flow Control: RX/TX
      [   24.628624] i40e 0000:04:00.0: PCI-Express: Speed 8.0GT/s Width x8
      [   24.637352] i40e 0000:04:00.0: Features: PF-id[0] VFs: 32 VSIs: 34 QP: 16 RSS FD_ATR FD_SB NTUPLE CloudF DCB VxLAN Geneve NVGRE PTP VEPA
      [   24.654350] i40e 0000:04:00.1: fw 6.0.48442 api 1.7 nvm 6.01 0x80003484 1.1747.0
      [   24.823713] i40e 0000:04:00.1: MAC source pruning enabled on all VFs
      [   24.823850] i40e 0000:04:00.1: MAC address: 40:a6:b7:b8:45:e9
      [   24.824318] i40e 0000:04:00.1: FW LLDP is disabled
      [   24.824375] i40e 0000:04:00.1: FW LLDP is disabled, attempting SW DCB
      [   24.832392] i40e 0000:04:00.1: SW DCB initialization succeeded.
      [   24.834904] i40e 0000:04:00.1: MAC source pruning enabled on all VFs
      [   24.848482] i40e 0000:04:00.1 eth3: NIC Link is Up, 10 Gbps Full Duplex, Flow Control: RX/TX
      [   24.850610] i40e 0000:04:00.1: PCI-Express: Speed 8.0GT/s Width x8
      [   24.859297] i40e 0000:04:00.1: Features: PF-id[1] VFs: 32 VSIs: 34 QP: 16 RSS FD_ATR FD_SB NTUPLE CloudF DCB VxLAN Geneve NVGRE PTP VEPA
      [   24.876551] i40e 0000:04:00.2: fw 6.0.48442 api 1.7 nvm 6.01 0x80003484 1.1747.0
      [   24.941234] i40e 0000:04:00.2: MAC source pruning enabled on all VFs
      [   24.941368] i40e 0000:04:00.2: MAC address: 40:a6:b7:b8:45:ea
      [   24.941827] i40e 0000:04:00.2: FW LLDP is disabled
      [   24.941883] i40e 0000:04:00.2: FW LLDP is disabled, attempting SW DCB
      [   24.949994] i40e 0000:04:00.2: SW DCB initialization succeeded.
      [   24.952571] i40e 0000:04:00.2: MAC source pruning enabled on all VFs
      [   24.966298] i40e 0000:04:00.2 eth5: NIC Link is Up, 10 Gbps Full Duplex, Flow Control: RX/TX
      [   24.968447] i40e 0000:04:00.2: PCI-Express: Speed 8.0GT/s Width x8
      [   24.977158] i40e 0000:04:00.2: Features: PF-id[2] VFs: 32 VSIs: 34 QP: 16 RSS FD_ATR FD_SB NTUPLE CloudF DCB VxLAN Geneve NVGRE PTP VEPA
      [   24.994453] i40e 0000:04:00.3: fw 6.0.48442 api 1.7 nvm 6.01 0x80003484 1.1747.0
      [   25.063546] i40e 0000:04:00.3: MAC source pruning enabled on all VFs
      [   25.063681] i40e 0000:04:00.3: MAC address: 40:a6:b7:b8:45:eb
      [   25.064149] i40e 0000:04:00.3: FW LLDP is disabled
      [   25.064205] i40e 0000:04:00.3: FW LLDP is disabled, attempting SW DCB
      [   25.072278] i40e 0000:04:00.3: SW DCB initialization succeeded.
      [   25.075960] i40e 0000:04:00.3: MAC source pruning enabled on all VFs
      [   25.089578] i40e 0000:04:00.3 eth7: NIC Link is Up, 10 Gbps Full Duplex, Flow Control: RX/TX
      [   25.091713] i40e 0000:04:00.3: PCI-Express: Speed 8.0GT/s Width x8
      [   25.100391] i40e 0000:04:00.3: Features: PF-id[3] VFs: 32 VSIs: 34 QP: 16 RSS FD_ATR FD_SB NTUPLE CloudF DCB VxLAN Geneve NVGRE PTP VEPA
      [   25.117883] i40e 0000:41:00.0: fw 9.154.78653 api 1.15 nvm 9.54 0x8000fb5f 1.3800.0
      [   25.306399] i40e 0000:41:00.0: MAC source pruning enabled on all VFs
      [   25.306607] i40e 0000:41:00.0: MAC address: 68:05:ca:df:3b:26
      [   25.307055] i40e 0000:41:00.0: FW LLDP is disabled
      [   25.307111] i40e 0000:41:00.0: FW LLDP is disabled, attempting SW DCB
      [   25.313620] i40e 0000:41:00.0: SW DCB initialization succeeded.
      [   25.316748] i40e 0000:41:00.0: MAC source pruning enabled on all VFs
      [   25.322371] i40e 0000:41:00.0: PCI-Express: Speed 8.0GT/s Width x8
      [   25.324617] i40e 0000:41:00.0: Features: PF-id[0] VFs: 64 VSIs: 66 QP: 16 RSS FD_ATR FD_SB NTUPLE CloudF DCB VxLAN Geneve NVGRE PTP VEPA
      [   25.342061] i40e 0000:41:00.1: fw 9.154.78653 api 1.15 nvm 9.54 0x8000fb5f 1.3800.0
      [   25.402254] i40e 0000:41:00.1: MAC source pruning enabled on all VFs
      [   25.402406] i40e 0000:41:00.1: MAC address: 68:05:ca:df:3b:27
      [   25.402924] i40e 0000:41:00.1: FW LLDP is disabled
      [   25.402981] i40e 0000:41:00.1: FW LLDP is disabled, attempting SW DCB
      [   25.409497] i40e 0000:41:00.1: SW DCB initialization succeeded.
      [   25.412550] i40e 0000:41:00.1: MAC source pruning enabled on all VFs
      [   25.418165] i40e 0000:41:00.1: PCI-Express: Speed 8.0GT/s Width x8
      [   25.420417] i40e 0000:41:00.1: Features: PF-id[1] VFs: 64 VSIs: 66 QP: 16 RSS FD_ATR FD_SB NTUPLE CloudF DCB VxLAN Geneve NVGRE P
      
      1 Reply Last reply Reply Quote 0
      • W Offline
        wlp94114 @olivierlambert
        last edited by

        @olivierlambert

        Good morning!

        I've performed a clean v8.3 install with all updates.

        As before, the Intel x710-DA4 works when added to a vm in Xen Orchestra. I'm still unable to do a pci passthrough to a TrueNAS vm. I can pass LSI hba and Intel datacenter nvmes.

        The Intel x710-T2l is listed via lspci but is otherwise unresponsive.

        Your thoughts?

        1 Reply Last reply Reply Quote 0
        • olivierlambertO Offline
          olivierlambert Vates 🪐 Co-Founder CEO
          last edited by olivierlambert

          Hi!

          What do you mean by "unresponsive"?

          W 1 Reply Last reply Reply Quote 0
          • W Offline
            wlp94114 @olivierlambert
            last edited by

            @olivierlambert

            Good morning!

            I've created a Debian 13 vm with x710-T2l as the network device.

            When I try to install Debian 13, the installer fails when trying to acquire a DHCP address.

            My original plan was/is to build a pfSense router/firewall using the x710. The installer configures the interfaces (WAN/LAN) but fails when trying to access the internet.

            The XCP-ng v8.3 host is using the alt i40 driver.

            1 Reply Last reply Reply Quote 0
            • olivierlambertO Offline
              olivierlambert Vates 🪐 Co-Founder CEO
              last edited by

              And if you add a fixed address, does it work?

              W 1 Reply Last reply Reply Quote 0
              • W Offline
                wlp94114 @olivierlambert
                last edited by

                @olivierlambert

                I ran through the install with a fixed address without success.

                I've attached some screenshots for your perusal.

                2025-08-27_NIC-test.png 2025-08-27_NIC-test-1.png 2025-08-27_NIC-test-2.png 2025-08-27_NIC-test-3.png

                1 Reply Last reply Reply Quote 0
                • olivierlambertO Offline
                  olivierlambert Vates 🪐 Co-Founder CEO
                  last edited by

                  Is your card having a recent firmware? I don't know why a passthrough NIC wouldn't work 🤔

                  W 1 Reply Last reply Reply Quote 0
                  • splastunovS Offline
                    splastunov
                    last edited by

                    try to disable tx/rx offload from xcp-ng side.

                    1. get VIF list of your VM
                    xe vm-vif-list uuid=VMUUID
                    
                    1. disable features for each VIF
                    xe vif-param-set uuid=VIFUUID other-config:ethtool-tx="off"
                    xe vif-param-set uuid=VIFUUID other-config:ethtool-rx="off"
                    
                    1. reboot VM
                    W 1 Reply Last reply Reply Quote 0
                    • W Offline
                      wlp94114 @olivierlambert
                      last edited by

                      @olivierlambert
                      Yes, there has been a recent firmware update.

                      Here is the info on the x710-T2l:
                      [08:19 xandria ~]# ethtool -i eth9,
                      driver: i40e
                      version: 2.26.8
                      firmware-version: 9.54 0x8000fb5f 1.3800.0
                      expansion-rom-version:
                      bus-info: 0000:41:00.1
                      supports-statistics: yes
                      supports-test: yes
                      supports-eeprom-access: yes
                      supports-register-dump: yes
                      supports-priv-flags: yes

                      The x710-DA4, which is assignable to a vm via Xen Orchestra but not assignable via pci passthrough, is on a much older firmware rev:
                      [08:24 xandria ~]# ethtool -i eth4
                      driver: i40e
                      version: 2.26.8
                      firmware-version: 6.01 0x80003484 1.1747.0
                      expansion-rom-version:
                      bus-info: 0000:04:00.0
                      supports-statistics: yes
                      supports-test: yes
                      supports-eeprom-access: yes
                      supports-register-dump: yes
                      supports-priv-flags: yes

                      1 Reply Last reply Reply Quote 0
                      • W Offline
                        wlp94114 @splastunov
                        last edited by

                        @splastunov said in Intel x710-t2l Problems:

                        xe vif-param-set uuid=VIFUUID other-config:ethtool-tx="off"
                        xe vif-param-set uuid=VIFUUID other-config:ethtool-rx="off"

                        Hi!

                        Thanks for your input. I set the vif parameters as suggested and am still unable to ping the gateway.

                        1 Reply Last reply Reply Quote 0
                        • First post
                          Last post