@TeddyAstie Thanks for the input.
This is what I was afraid of somehow In the meantime (a few months ago) I have done some tests with the machine.
Installed opnsense as described in the opening post and directly to the device without xcp-ng just to see if there is any issue. The result is the same (i have used in both cases the same settings and same spoofed mac) the spoofing did work without xcp-ng, this is why I was hoping that something can be done via xcp.

@olivierlambert said in NIC Passthrough with mac spoofing:

Out of curiosity, what about SRIOV in that case?

Regarding SRIOV right now its not possible for me to check if thats enabled/supported in the bios but its a good point, thanks Will take about 3-4 weeks to check.

/sad panda

@gb.123
I'm not using that feature as for the current setup this is not of any relevance, however you should check this: https://docs.xcp-ng.org/compute/#numa-affinity

via ssh those may give you what you are looking for:
xl vcpu-list
xenpm get-cpu-topology
xl info --numa

and probably you can set the core to use as:
xe vm-param-set uuid=[VM-UUID] VCPUs-params:mask=8,9,10,11,12,13,14,15`

if you define only core 3.7.9 as example (you have to know which is E or P) should do the trick.

@MasterOSkillio said in Intel CPUs with P and E cores or other server CPU suggestions:

From what I have seen in various places on the web P and E cores are not really supported yet for XCP-NG? Is it safe to assume that is changing? I believe proxmox, and VMware have moved to support them. If I use the 12600K will I have to turn off one (P or E) and use only the other?

Not sure what you mean by "support" but I'm running as of now the P+E core setup and it works just fine. Stable, performs as expected.

Hi

I have a VM (opnsense) with multiple NICs passed through:

vm-param-get param-name=other-config uuid=9573800d-e20d-151d-23ff-0fe0b1c22565
bla: {blabla}; pci: 0/0000:07:00.0,0/0000:06:00.0,0/0000:05:00.0,0/0000:04:00.0,0/0000:03:00.0; blablabla; bla

And it works perfectly fine absolutely happy with it!

Checking on the xcp-ng host: ip a

8: xenbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 88:01:5b:bl:ab:la brd ff:ff:ff:ff:ff:ff

it lists the desired NIC with its real mac address. This is also reflected in opnsense and the same address is shown in the webui.

I would like to change the mac to a custom one and on opnsense i can set it just fine, however the connection with the custom mac do not work.
Found this https://xcp-ng.org/forum/topic/9351/pcie-nic-passing-through-dropped-packets-no-communication but I'm not sure if "pci=realloc=on" helps in this case.

https://xcp-ng.org/docs/networking.html#full-mesh-network tells me how to change the mac on a non-passthrough device but cant see anything on passthrough
Or shall I just simply pif-forget & pif-introduce with the new mac?
pif-introduce host-uuid=host_uuid mac=mac_address_for_pif device=eth0 (or xenbr0?)

Thanks for the inputs