XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Intel x710-t2l Problems

    Scheduled Pinned Locked Moved Hardware
    18 Posts 3 Posters 443 Views 3 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • W Offline
      wlp94114 @olivierlambert
      last edited by olivierlambert

      @olivierlambert

      Re: the pfSense 2.8.1/x710-T2l problem

      Per your request I did the TSO performance checks with no success; TX checksumming is disabled. I've been sifting through forum posts looking for similiar issues and found this posting https://xcp-ng.org/forum/post/44207 which sounds a bit similar.

      Ethtool reports:

      ethtool -i eth9
      driver: i40e
      version: 2.25.11
      **firmware-version: 9.54 0x8000fb5f 1.3800.0**
      expansion-rom-version:
      bus-info: 0000:41:00.1
      supports-statistics: yes
      supports-test: yes
      supports-eeprom-access: yes
      supports-register-dump: yes
      supports-priv-flags: yes
      

      with lspci -vvxxx reporting:

      lspci -vvxxx
      41:00.1 Ethernet controller: Intel Corporation Ethernet Controller X710 for 10GBASE-T (rev 02)
              Subsystem: Intel Corporation Ethernet Network Adapter X710-TL
              Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
              Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
              Latency: 0, Cache Line Size: 64 bytes
              Interrupt: pin A routed to IRQ 66
              Region 0: Memory at c5000000 (64-bit, prefetchable) [size=16M]
              Region 3: Memory at c6ff8000 (64-bit, prefetchable) [size=32K]
              Expansion ROM at c8080000 [disabled] [size=512K]
              Capabilities: [40] Power Management version 3
                      Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                      Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME-
              Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
                      Address: 0000000000000000  Data: 0000
                      Masking: 00000000  Pending: 00000000
              Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
                      Vector table: BAR=3 offset=00000000
                      PBA: BAR=3 offset=00001000
              Capabilities: [a0] Express (v2) Endpoint, MSI 00
                      DevCap: MaxPayload 2048 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
                              ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0.000W
                      DevCtl: Report errors: Correctable- Non-Fatal+ Fatal+ Unsupported+
                              RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop- FLReset-
                              MaxPayload 256 bytes, MaxReadReq 512 bytes
                      DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
                      LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM L1, Exit Latency L0s <2us, L1 <16us
                              ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
                      LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                              ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                      LnkSta: Speed 8GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                      DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported
                      DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-, LTR-, OBFF Disabled
                      LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                               EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
              Capabilities: [e0] Vital Product Data
                      Product Name: Intel(R) Ethernet Network Adapter X710-T2L
                      Read-only fields:
                              [PN] Part number: ~PBA-----~
                              [SN] Serial number: ~MAC-------~
                              [V2] Vendor specific: ~WY~
                              [RV] Reserved: checksum good, 0 byte(s) reserved
                      Read/write fields:
                              [V1] Vendor specific: Intel(R) Ethernet Network Adapter X710-T2L
                      End
              Capabilities: [100 v2] Advanced Error Reporting
                      UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                      UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                      UESvrt: DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC+ UnsupReq- ACSViol-
                      CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                      CEMsk:  RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
                      AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
              Capabilities: [140 v1] Device Serial Number 26-3b-df-ff-ff-ca-05-68
              Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
                      ARICap: MFVC- ACS-, Next Function: 0
                      ARICtl: MFVC- ACS-, Function Group: 0
              Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
                      IOVCap: Migration-, Interrupt Message Number: 000
                      IOVCtl: Enable- Migration- Interrupt- MSE- ARIHierarchy-
                      IOVSta: Migration-
                      Initial VFs: 64, Total VFs: 64, Number of VFs: 0, Function Dependency Link: 01
                      VF offset: 79, stride: 1, Device ID: 154c
                      Supported Page Size: 00000553, System Page Size: 00000001
                      Region 0: Memory at 00000000c6800000 (64-bit, prefetchable)
                      Region 3: Memory at 00000000c6e00000 (64-bit, prefetchable)
                      VF Migration: offset: 00000000, BIR: 0
              Capabilities: [1a0 v1] Transaction Processing Hints
                      Device specific mode supported
                      No steering table available
              Capabilities: [1b0 v1] Access Control Services
                      ACSCap: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
                      ACSCtl: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
              Kernel driver in use: i40e
              Kernel modules: i40e
      00: 86 80 ff 15 06 04 10 00 02 00 00 02 10 00 80 00
      10: 0c 00 00 c5 00 00 00 00 00 00 00 00 0c 80 ff c6
      20: 00 00 00 00 00 00 00 00 00 00 00 00 86 80 00 00
      30: 00 00 00 c8 40 00 00 00 00 00 00 00 0f 01 00 00
      40: 01 50 23 c8 08 20 00 00 00 00 00 00 00 00 00 00
      50: 05 70 80 01 00 00 00 00 00 00 00 00 00 00 00 00
      60: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
      70: 11 a0 80 80 03 00 00 00 03 10 00 00 00 00 00 00
      80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
      90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
      a0: 10 e0 02 00 e4 8c 00 10 3e 21 09 00 83 58 42 00
      b0: 40 00 83 10 00 00 00 00 00 00 00 00 00 00 00 00
      c0: 00 00 00 00 1f 00 00 00 06 00 00 00 0e 00 00 00
      d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
      e0: 03 00 84 80 54 32 4c 78 00 00 00 00 00 00 00 00
      f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
      

      TrueNAS VM with pci passthrough

      The r720 also has an Intel x710-DA4 with much older firmware (v6.01) version. I've used this card with success in a VM, but when attempting a pci passthrough to a TrueNAS VM, the interface accepts an ip address from DHCP but is otherwise unreachable. TrueNAS shows the http/https addresses as unreachable.

      Ethtool reports:

      ethtool -i eth4
      driver: i40e
      version: 2.25.11
      **firmware-version: 6.01 0x80003484 1.1747.0**
      expansion-rom-version:
      bus-info: 0000:04:00.0
      supports-statistics: yes
      supports-test: yes
      supports-eeprom-access: yes
      supports-register-dump: yes
      supports-priv-flags: yes
      

      with lspci -vvxxx reporting:

      04:00.0 Ethernet controller: Intel Corporation Ethernet Controller X710 for 10GbE SFP+ (rev 02)
              Subsystem: Intel Corporation Ethernet Converged Network Adapter X710-4
              Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
              Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
              Latency: 0, Cache Line Size: 64 bytes
              Interrupt: pin A routed to IRQ 48
              Region 0: Memory at d1000000 (64-bit, prefetchable) [size=8M]
              Region 3: Memory at d3fe0000 (64-bit, prefetchable) [size=32K]
              Expansion ROM at da000000 [disabled] [size=512K]
              Capabilities: [40] Power Management version 3
                      Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                      Status: D0 NoSoftRst+ PME-Enable- DSel=8 DScale=1 PME-
              Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
                      Address: 0000000000000000  Data: 0000
                      Masking: 00000000  Pending: 00000000
              Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
                      Vector table: BAR=3 offset=00000000
                      PBA: BAR=3 offset=00001000
              Capabilities: [a0] Express (v2) Endpoint, MSI 00
                      DevCap: MaxPayload 2048 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
                              ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0.000W
                      DevCtl: Report errors: Correctable- Non-Fatal+ Fatal+ Unsupported+
                              RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop- FLReset-
                              MaxPayload 256 bytes, MaxReadReq 512 bytes
                      DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
                      LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM L1, Exit Latency L0s <2us, L1 <16us
                              ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
                      LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                              ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                      LnkSta: Speed 8GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                      DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported
                      DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-, LTR-, OBFF Disabled
                      LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-
                               Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                               Compliance De-emphasis: -6dB
                      LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
                               EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
              Capabilities: [e0] Vital Product Data
                      Product Name: XL710 40GbE Controller
                      Read-only fields:
                              [PN] Part number:
                              [EC] Engineering changes:
                              [FG] Unknown:
                              [LC] Unknown:
                              [MN] Manufacture ID:
                              [PG] Unknown:
                              [SN] Serial number:
                              [V0] Vendor specific:
                              [RV] Reserved: checksum good, 0 byte(s) reserved
                      Read/write fields:
                              [V1] Vendor specific:
                      End
              Capabilities: [100 v2] Advanced Error Reporting
                      UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                      UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                      UESvrt: DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC+ UnsupReq- ACSViol-
                      CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                      CEMsk:  RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
                      AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
              Capabilities: [140 v1] Device Serial Number e8-45-b8-ff-ff-b7-a6-40
              Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
                      ARICap: MFVC- ACS-, Next Function: 1
                      ARICtl: MFVC- ACS-, Function Group: 0
              Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
                      IOVCap: Migration-, Interrupt Message Number: 000
                      IOVCtl: Enable- Migration- Interrupt- MSE- ARIHierarchy+
                      IOVSta: Migration-
                      Initial VFs: 32, Total VFs: 32, Number of VFs: 0, Function Dependency Link: 00
                      VF offset: 16, stride: 1, Device ID: 154c
                      Supported Page Size: 00000553, System Page Size: 00000001
                      Region 0: Memory at 00000000d3400000 (64-bit, prefetchable)
                      Region 3: Memory at 00000000d3d80000 (64-bit, prefetchable)
                      VF Migration: offset: 00000000, BIR: 0
              Capabilities: [1a0 v1] Transaction Processing Hints
                      Device specific mode supported
                      No steering table available
              Capabilities: [1b0 v1] Access Control Services
                      ACSCap: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
                      ACSCtl: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
              Capabilities: [1d0 v1] #19
              Kernel driver in use: i40e
              Kernel modules: i40e
      00: 86 80 72 15 06 04 10 00 02 00 00 02 10 00 80 00
      10: 0c 00 00 d1 00 00 00 00 00 00 00 00 0c 00 fe d3
      20: 00 00 00 00 00 00 00 00 00 00 00 00 86 80 04 00
      30: 00 00 00 da 40 00 00 00 00 00 00 00 0f 01 00 00
      40: 01 50 23 c8 08 30 00 00 00 00 00 00 00 00 00 00
      50: 05 70 80 01 00 00 00 00 00 00 00 00 00 00 00 00
      60: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
      70: 11 a0 80 80 03 00 00 00 03 10 00 00 00 00 00 00
      80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
      90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
      a0: 10 e0 02 00 e4 8c 00 10 3e 21 09 00 83 58 42 00
      b0: 40 00 83 10 00 00 00 00 00 00 00 00 00 00 00 00
      c0: 00 00 00 00 1f 00 00 00 06 00 00 00 0e 00 00 00
      d0: 01 00 1e 00 00 00 00 00 00 00 00 00 00 00 00 00
      e0: 03 00 3c 80 31 00 78 00 00 00 00 00 00 00 00 00
      f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
      

      Let me know if there are further tests you'd like me to perform.

      W 1 Reply Last reply Reply Quote 0
      • W Offline
        wlp94114 @wlp94114
        last edited by olivierlambert

        This info may also shed light:

        [08:39 xandria /]# dmesg | grep i40e
        [   24.513039] i40e: Intel(R) 40-10 Gigabit Ethernet Connection Network Driver - version 2.25.11
        [   24.513042] i40e: Copyright (C) 2013-2024 Intel Corporation
        [   24.530151] i40e 0000:04:00.0: fw 6.0.48442 api 1.7 nvm 6.01 0x80003484 1.1747.0
        [   24.600704] i40e 0000:04:00.0: MAC source pruning enabled on all VFs
        [   24.600844] i40e 0000:04:00.0: MAC address: 40:a6:b7:b8:45:e8
        [   24.601304] i40e 0000:04:00.0: FW LLDP is disabled
        [   24.601361] i40e 0000:04:00.0: FW LLDP is disabled, attempting SW DCB
        [   24.609522] i40e 0000:04:00.0: SW DCB initialization succeeded.
        [   24.612187] i40e 0000:04:00.0: MAC source pruning enabled on all VFs
        [   24.626574] i40e 0000:04:00.0 eth1: NIC Link is Up, 10 Gbps Full Duplex, Flow Control: RX/TX
        [   24.628624] i40e 0000:04:00.0: PCI-Express: Speed 8.0GT/s Width x8
        [   24.637352] i40e 0000:04:00.0: Features: PF-id[0] VFs: 32 VSIs: 34 QP: 16 RSS FD_ATR FD_SB NTUPLE CloudF DCB VxLAN Geneve NVGRE PTP VEPA
        [   24.654350] i40e 0000:04:00.1: fw 6.0.48442 api 1.7 nvm 6.01 0x80003484 1.1747.0
        [   24.823713] i40e 0000:04:00.1: MAC source pruning enabled on all VFs
        [   24.823850] i40e 0000:04:00.1: MAC address: 40:a6:b7:b8:45:e9
        [   24.824318] i40e 0000:04:00.1: FW LLDP is disabled
        [   24.824375] i40e 0000:04:00.1: FW LLDP is disabled, attempting SW DCB
        [   24.832392] i40e 0000:04:00.1: SW DCB initialization succeeded.
        [   24.834904] i40e 0000:04:00.1: MAC source pruning enabled on all VFs
        [   24.848482] i40e 0000:04:00.1 eth3: NIC Link is Up, 10 Gbps Full Duplex, Flow Control: RX/TX
        [   24.850610] i40e 0000:04:00.1: PCI-Express: Speed 8.0GT/s Width x8
        [   24.859297] i40e 0000:04:00.1: Features: PF-id[1] VFs: 32 VSIs: 34 QP: 16 RSS FD_ATR FD_SB NTUPLE CloudF DCB VxLAN Geneve NVGRE PTP VEPA
        [   24.876551] i40e 0000:04:00.2: fw 6.0.48442 api 1.7 nvm 6.01 0x80003484 1.1747.0
        [   24.941234] i40e 0000:04:00.2: MAC source pruning enabled on all VFs
        [   24.941368] i40e 0000:04:00.2: MAC address: 40:a6:b7:b8:45:ea
        [   24.941827] i40e 0000:04:00.2: FW LLDP is disabled
        [   24.941883] i40e 0000:04:00.2: FW LLDP is disabled, attempting SW DCB
        [   24.949994] i40e 0000:04:00.2: SW DCB initialization succeeded.
        [   24.952571] i40e 0000:04:00.2: MAC source pruning enabled on all VFs
        [   24.966298] i40e 0000:04:00.2 eth5: NIC Link is Up, 10 Gbps Full Duplex, Flow Control: RX/TX
        [   24.968447] i40e 0000:04:00.2: PCI-Express: Speed 8.0GT/s Width x8
        [   24.977158] i40e 0000:04:00.2: Features: PF-id[2] VFs: 32 VSIs: 34 QP: 16 RSS FD_ATR FD_SB NTUPLE CloudF DCB VxLAN Geneve NVGRE PTP VEPA
        [   24.994453] i40e 0000:04:00.3: fw 6.0.48442 api 1.7 nvm 6.01 0x80003484 1.1747.0
        [   25.063546] i40e 0000:04:00.3: MAC source pruning enabled on all VFs
        [   25.063681] i40e 0000:04:00.3: MAC address: 40:a6:b7:b8:45:eb
        [   25.064149] i40e 0000:04:00.3: FW LLDP is disabled
        [   25.064205] i40e 0000:04:00.3: FW LLDP is disabled, attempting SW DCB
        [   25.072278] i40e 0000:04:00.3: SW DCB initialization succeeded.
        [   25.075960] i40e 0000:04:00.3: MAC source pruning enabled on all VFs
        [   25.089578] i40e 0000:04:00.3 eth7: NIC Link is Up, 10 Gbps Full Duplex, Flow Control: RX/TX
        [   25.091713] i40e 0000:04:00.3: PCI-Express: Speed 8.0GT/s Width x8
        [   25.100391] i40e 0000:04:00.3: Features: PF-id[3] VFs: 32 VSIs: 34 QP: 16 RSS FD_ATR FD_SB NTUPLE CloudF DCB VxLAN Geneve NVGRE PTP VEPA
        [   25.117883] i40e 0000:41:00.0: fw 9.154.78653 api 1.15 nvm 9.54 0x8000fb5f 1.3800.0
        [   25.306399] i40e 0000:41:00.0: MAC source pruning enabled on all VFs
        [   25.306607] i40e 0000:41:00.0: MAC address: 68:05:ca:df:3b:26
        [   25.307055] i40e 0000:41:00.0: FW LLDP is disabled
        [   25.307111] i40e 0000:41:00.0: FW LLDP is disabled, attempting SW DCB
        [   25.313620] i40e 0000:41:00.0: SW DCB initialization succeeded.
        [   25.316748] i40e 0000:41:00.0: MAC source pruning enabled on all VFs
        [   25.322371] i40e 0000:41:00.0: PCI-Express: Speed 8.0GT/s Width x8
        [   25.324617] i40e 0000:41:00.0: Features: PF-id[0] VFs: 64 VSIs: 66 QP: 16 RSS FD_ATR FD_SB NTUPLE CloudF DCB VxLAN Geneve NVGRE PTP VEPA
        [   25.342061] i40e 0000:41:00.1: fw 9.154.78653 api 1.15 nvm 9.54 0x8000fb5f 1.3800.0
        [   25.402254] i40e 0000:41:00.1: MAC source pruning enabled on all VFs
        [   25.402406] i40e 0000:41:00.1: MAC address: 68:05:ca:df:3b:27
        [   25.402924] i40e 0000:41:00.1: FW LLDP is disabled
        [   25.402981] i40e 0000:41:00.1: FW LLDP is disabled, attempting SW DCB
        [   25.409497] i40e 0000:41:00.1: SW DCB initialization succeeded.
        [   25.412550] i40e 0000:41:00.1: MAC source pruning enabled on all VFs
        [   25.418165] i40e 0000:41:00.1: PCI-Express: Speed 8.0GT/s Width x8
        [   25.420417] i40e 0000:41:00.1: Features: PF-id[1] VFs: 64 VSIs: 66 QP: 16 RSS FD_ATR FD_SB NTUPLE CloudF DCB VxLAN Geneve NVGRE P
        
        1 Reply Last reply Reply Quote 0
        • W Offline
          wlp94114 @olivierlambert
          last edited by

          @olivierlambert

          Good morning!

          I've performed a clean v8.3 install with all updates.

          As before, the Intel x710-DA4 works when added to a vm in Xen Orchestra. I'm still unable to do a pci passthrough to a TrueNAS vm. I can pass LSI hba and Intel datacenter nvmes.

          The Intel x710-T2l is listed via lspci but is otherwise unresponsive.

          Your thoughts?

          1 Reply Last reply Reply Quote 0
          • olivierlambertO Offline
            olivierlambert Vates 🪐 Co-Founder CEO
            last edited by olivierlambert

            Hi!

            What do you mean by "unresponsive"?

            W 1 Reply Last reply Reply Quote 0
            • W Offline
              wlp94114 @olivierlambert
              last edited by

              @olivierlambert

              Good morning!

              I've created a Debian 13 vm with x710-T2l as the network device.

              When I try to install Debian 13, the installer fails when trying to acquire a DHCP address.

              My original plan was/is to build a pfSense router/firewall using the x710. The installer configures the interfaces (WAN/LAN) but fails when trying to access the internet.

              The XCP-ng v8.3 host is using the alt i40 driver.

              1 Reply Last reply Reply Quote 0
              • olivierlambertO Offline
                olivierlambert Vates 🪐 Co-Founder CEO
                last edited by

                And if you add a fixed address, does it work?

                W 1 Reply Last reply Reply Quote 0
                • W Offline
                  wlp94114 @olivierlambert
                  last edited by

                  @olivierlambert

                  I ran through the install with a fixed address without success.

                  I've attached some screenshots for your perusal.

                  2025-08-27_NIC-test.png 2025-08-27_NIC-test-1.png 2025-08-27_NIC-test-2.png 2025-08-27_NIC-test-3.png

                  1 Reply Last reply Reply Quote 0
                  • olivierlambertO Offline
                    olivierlambert Vates 🪐 Co-Founder CEO
                    last edited by

                    Is your card having a recent firmware? I don't know why a passthrough NIC wouldn't work 🤔

                    W 1 Reply Last reply Reply Quote 0
                    • splastunovS Offline
                      splastunov
                      last edited by

                      try to disable tx/rx offload from xcp-ng side.

                      1. get VIF list of your VM
                      xe vm-vif-list uuid=VMUUID
                      
                      1. disable features for each VIF
                      xe vif-param-set uuid=VIFUUID other-config:ethtool-tx="off"
                      xe vif-param-set uuid=VIFUUID other-config:ethtool-rx="off"
                      
                      1. reboot VM
                      W 1 Reply Last reply Reply Quote 0
                      • W Offline
                        wlp94114 @olivierlambert
                        last edited by

                        @olivierlambert
                        Yes, there has been a recent firmware update.

                        Here is the info on the x710-T2l:
                        [08:19 xandria ~]# ethtool -i eth9,
                        driver: i40e
                        version: 2.26.8
                        firmware-version: 9.54 0x8000fb5f 1.3800.0
                        expansion-rom-version:
                        bus-info: 0000:41:00.1
                        supports-statistics: yes
                        supports-test: yes
                        supports-eeprom-access: yes
                        supports-register-dump: yes
                        supports-priv-flags: yes

                        The x710-DA4, which is assignable to a vm via Xen Orchestra but not assignable via pci passthrough, is on a much older firmware rev:
                        [08:24 xandria ~]# ethtool -i eth4
                        driver: i40e
                        version: 2.26.8
                        firmware-version: 6.01 0x80003484 1.1747.0
                        expansion-rom-version:
                        bus-info: 0000:04:00.0
                        supports-statistics: yes
                        supports-test: yes
                        supports-eeprom-access: yes
                        supports-register-dump: yes
                        supports-priv-flags: yes

                        1 Reply Last reply Reply Quote 0
                        • W Offline
                          wlp94114 @splastunov
                          last edited by

                          @splastunov said in Intel x710-t2l Problems:

                          xe vif-param-set uuid=VIFUUID other-config:ethtool-tx="off"
                          xe vif-param-set uuid=VIFUUID other-config:ethtool-rx="off"

                          Hi!

                          Thanks for your input. I set the vif parameters as suggested and am still unable to ping the gateway.

                          1 Reply Last reply Reply Quote 0
                          • First post
                            Last post