cant create a private cross pool network

bigpod98

Hello

first off im using XO from sources.

i tried creating a private network across 2 pools and it fails with error No PIF found in center

log here

sdnController.createPrivateNetwork
{
  "poolIds": [
    "34c3ea8f-b8bc-5b14-044e-6823f8e5fbdf",
    "8576139c-cde0-353c-3798-fa2a93dec586"
  ],
  "pifIds": [
    "4f3cf557-118e-bec2-4b7b-a05cbcf8dc68",
    "d9298975-8958-f92d-55fb-ecd34705b772"
  ],
  "name": "test",
  "description": "test",
  "encapsulation": "vxlan",
  "encrypted": false,
  "mtu": 1546
}
{
  "generatedMessage": false,
  "code": "ERR_ASSERTION",
  "actual": false,
  "expected": true,
  "operator": "==",
  "message": "No PIF found in center",
  "name": "AssertionError",
  "stack": "AssertionError [ERR_ASSERTION]: No PIF found in center
    at PrivateNetwork.addHost (/home/bigpod/xen-orchestra/packages/xo-server-sdn-controller/src/private-network/private-network.js:69:11)
    at /home/bigpod/xen-orchestra/packages/xo-server-sdn-controller/src/private-network/private-network.js:117:9"
}

and this

2025-05-03T17:35:09.970Z xo:xo-server:sdn-controller INFO Private network registered { privateNetwork: 'eed9d4e0-8ff2-4d90-b23b-c4176109b556' }
2025-05-03T17:35:10.034Z xo:xo-server:sdn-controller INFO New network created {
  privateNetwork: 'eed9d4e0-8ff2-4d90-b23b-c4176109b556',
  network: 'test',
  pool: ''
}
2025-05-03T17:35:10.253Z xo:xo-server:sdn-controller:ovsdb-client ERROR No result for select {
  columns: [ '_uuid', 'name' ],
  table: 'Bridge',
  where: [ [ 'external_ids', 'includes', [Array] ] ],
  host: 's00-xcpng'
}
2025-05-03T17:35:10.253Z xo:xo-server:sdn-controller:ovsdb-client ERROR No bridge found for network { network: 'test', host: 's00-xcpng' }
2025-05-03T17:35:10.537Z xo:xo-server:sdn-controller:ovsdb-client INFO Controller set { host: 's00-xcpng' }
2025-05-03T17:35:10.537Z xo:xo-server:sdn-controller:private-network INFO Adding network {
  privateNetwork: 'eed9d4e0-8ff2-4d90-b23b-c4176109b556',
  network: 'test',
  pool: ''
}
2025-05-03T17:35:10.555Z xo:xo-server:sdn-controller:private-network INFO New star-center elected {
  center: 's00-xcpng',
  privateNetwork: 'eed9d4e0-8ff2-4d90-b23b-c4176109b556'
}
2025-05-03T17:35:10.620Z xo:xo-server:sdn-controller INFO New network created {
  privateNetwork: 'eed9d4e0-8ff2-4d90-b23b-c4176109b556',
  network: 'test',
  pool: ''
}
2025-05-03T17:35:10.841Z xo:xo-server:sdn-controller:ovsdb-client ERROR No result for select {
  columns: [ '_uuid', 'name' ],
  table: 'Bridge',
  where: [ [ 'external_ids', 'includes', [Array] ] ],
  host: 'c00-xcpng'
}
2025-05-03T17:35:10.841Z xo:xo-server:sdn-controller:ovsdb-client ERROR No bridge found for network { network: 'test', host: 'c00-xcpng' }
2025-05-03T17:35:11.047Z xo:xo-server:sdn-controller:ovsdb-client INFO Controller set { host: 'c00-xcpng' }
2025-05-03T17:35:11.047Z xo:xo-server:sdn-controller:private-network INFO Adding network {
  privateNetwork: 'eed9d4e0-8ff2-4d90-b23b-c4176109b556',
  network: 'test',
  pool: ''
}
2025-05-03T17:35:11.067Z xo:api WARN admin@admin.net | sdnController.createPrivateNetwork(...) [1s] =!> AssertionError [ERR_ASSERTION]: No PIF found in center

Each time i try to create a network i both pools a network is created with tunnelX (x being a number) but no communication occurs between VMs added to those networks. if i click on button that shows PIFs each of these networks has a PIF. At this time im using latest commit from master branch from github repository

olivierlambert

Hi,

We are in the middle of a big rework on this part, IDK if we have enough resource on Vates side to debug it, but let me at least ping @bleader in case he can find someone to take a look

bleader

Sorry for the delay, I'm a bit swamped. That does not ring a bell to me right now.

What is you setup like? How many pools, how many host per pool, is there bond on some of them?

Then, more to debug what was actually created as you stated there network does exist but there is no traffic:

On your hosts:

xe network-list to get the uuid of one of these private networks you created
xe network-param-list uuid=<netwok-uuid> should tell you in which bridge they are
ovs-vsctl show shows all bridges and their ports, in there you should be seeing the bridge you found in previous step. This bridge should have:
- a port with type vxlan and options in which you have a remote_ip to the network center
- the VIFs for the VMs

On your VM:

is that network assigned to the VMs?
do the VM have new devices created in ip link or similar when you attached the network?
is there any error in VMs dmesg on device creation?

We'll see from there if we can get an idea of what is happening.