@Biggen The updated netdata packages display the vm's vbds data (in and out), but nothing for the vm's network interfaces. Not even its presence in the vm's domain.

I would like some examples too.

My latest (first) try gives me:

alfcruz-adm@local.hcpa.ufrgs.br@volt-ampere:~/packer-plugin-xenserver$ packer build ./ubuntu-2004.pkr.hcl
xenserver-iso.ubuntu-2004: output will be in this color.

Build 'xenserver-iso.ubuntu-2004' errored after 8 seconds 155 milliseconds: API Error: SESSION_AUTHENTICATION_FAILED root Authentication failure

==> Wait completed after 8 seconds 155 milliseconds

==> Some builds didn't complete successfully and had errors:
--> xenserver-iso.ubuntu-2004: API Error: SESSION_AUTHENTICATION_FAILED root Authentication failure

==> Builds finished but no artifacts were created.
alfcruz-adm@local.hcpa.ufrgs.br@volt-ampere:~/packer-plugin-xenserver$

Using root user. This user/pass works over SSH.

I would like some examples too.

My latest (first) try gives me:

alfcruz-adm@local.hcpa.ufrgs.br@volt-ampere:~/packer-plugin-xenserver$ packer build ./ubuntu-2004.pkr.hcl
xenserver-iso.ubuntu-2004: output will be in this color.

Build 'xenserver-iso.ubuntu-2004' errored after 8 seconds 155 milliseconds: API Error: SESSION_AUTHENTICATION_FAILED root Authentication failure

==> Wait completed after 8 seconds 155 milliseconds

==> Some builds didn't complete successfully and had errors:
--> xenserver-iso.ubuntu-2004: API Error: SESSION_AUTHENTICATION_FAILED root Authentication failure

==> Builds finished but no artifacts were created.
alfcruz-adm@local.hcpa.ufrgs.br@volt-ampere:~/packer-plugin-xenserver$

Using root user. This user/pass works over SSH.

@olivierlambert Thank you, Olivier. In fact I found in this forum another topic, don't remember by who. But that has already given me enough info to reach the solution. It was about generating images to use with cloud-init. Thank you all!

Hi there!

Please, delete my question if it is considered bad in any way.

I am able to write terraform code that creates a vm in one of our xcp pools.

But can't undertand how I must configure the template in order to be able to pass cloud-init userdata and metadata.

I am using a simple VM install from ubuntu 20.04.5 ISO, turned into a template. It does not seem to load the yaml templates.

code_textalfcruz-adm@local.hcpa.ufrgs.br@volt-ampere:~/terraform-provider-xenorchestra-intro/mkxcpvm2n$ cat main.tf
# Infrastructure parametrization

variable "xoa_pool_name" {
  type        = string
  description = "Pool Name at HCPA's XCP-ng infrastructure managed by XenOrchestra"
  default     = "UAAPool01"
}

variable "xoa_template_name" {
  type        = string
  description = "Template name at the chosen XCP-ng pool (must be unique between all the HCPA's pools"
  #default     = "Ubuntu 20.04 LTS Focal Fossa (20211008u)"
  default = "template-ubuntu-20045"
}

variable "xoa_sr_name" {
  type        = string
  description = "Name of the Storage Resource to place the VM disk(s) at the chosen pool"
  default     = "EQL01UHAASR01"
}

variable "xoa_public_vlanid" {
  type        = string
  description = "The VLAN id of the public (first) network interface of this VM"
  default     = "VLAN702"
}

variable "xoa_private_vlanid" {
  type        = string
  description = "The VLAN id of the private (or second) network interface of this VM"
  default     = "VLAN902"
}

# VM parametrization

variable "vm_memory_max" {
  type        = number
  description = "VM's maximum memory (in bytes)"
  default     = 2147467264
}

variable "vm_cpus" {
  type        = number
  description = "VM's number of virtual CPU cores"
  default     = 4
}

variable "vm_name_label" {
  type        = string
  description = "The VM's name on the XCP-ng infrastructure (XOA and XCP console)"
  default     = "Terraformed at HCPA"
}

variable "vm_disk_name_label" {
  type        = string
  description = "The name of the first VM's disk"
  default     = "Filesystem root"
}

variable "vm_disk_size" {
  type        = number
  description = "The size of this VM's first disk (in bytes - default = template thick / size - 30GB)"
  default     = 32212254720
}

variable "vm_public_domain" {
  type        = string
  description = "Name of the local intranet domain"
  default     = "local.hcpa.ufrgs.br"
}

variable "vm_public_ipv4_address" {
  type        = string
  description = "The VM's public (first) interface IPv4 address"
  default     = "10.70.3.250"
}

variable "vm_public_ipv4_prefixlen" {
  type        = string
  description = "The number of network bits to use for the public IPv4 interface netmask"
  default     = "23"
}

variable "vm_public_ipv4_gateway" {
  type        = string
  description = "The IPv4 default gateway for the public interface"
  default     = "10.72.0.1"
}

# Gattering ambient facts

data "xenorchestra_pool" "pool" {
  name_label = var.xoa_pool_name
}

data "xenorchestra_template" "vm_template" {
  name_label = var.xoa_template_name
}

data "xenorchestra_sr" "sr" {
  name_label = var.xoa_sr_name
  pool_id    = data.xenorchestra_pool.pool.id
}

data "xenorchestra_network" "public_vlanid" {
  name_label = var.xoa_public_vlanid
  pool_id    = data.xenorchestra_pool.pool.id
}

data "xenorchestra_network" "private_vlanid" {
  name_label = var.xoa_private_vlanid
  pool_id    = data.xenorchestra_pool.pool.id
}

# Create cloudinit templates

data "template_file" "userdata" {
  template  = file("./cloud_userdata_cfg.yaml")
  vars      = {
    hostname = var.vm_name_label
    domain   = var.vm_public_domain
  }
}

data "template_file" "metadata" {
  template = file("./cloud_metadata_cfg.yaml")
  vars     = {
    hostname  = var.vm_name_label
    ip        = var.vm_public_ipv4_address
    prefixlen = var.vm_public_ipv4_prefixlen
    gateway   = var.vm_public_ipv4_gateway
  }
}

resource "xenorchestra_cloud_config" "userdataconfig" {
  name = "user data config"
  template = data.template_file.userdata.rendered
}

resource "xenorchestra_cloud_config" "metadataconfig" {
  name = "network data config"
  template = data.template_file.metadata.rendered
}

# VM creation

resource "xenorchestra_vm" "vm" {
#  cloud_config = templatefile("cloud_userdata_cfg.yaml", {
#    hostname = var.vm_name_label
#    domain   = var.vm_public_domain
#  })
#  cloud_network_config = templatefile("cloud_metadata_cfg.yaml", {
#    hostname  = var.vm_name_label
#    ip        = var.vm_public_ipv4_address
#    prefixlen = var.vm_public_ipv4_prefixlen
#    gateway   = var.vm_public_ipv4_gateway
#  })
  cloud_network_config = xenorchestra_cloud_config.metadataconfig.template
  cloud_config = xenorchestra_cloud_config.userdataconfig.template
  memory_max = var.vm_memory_max
  cpus       = var.vm_cpus
  name_label = var.vm_name_label
  template   = data.xenorchestra_template.vm_template.id

  network {
    network_id = data.xenorchestra_network.public_vlanid.id
  }

#  network {
#    network_id = data.xenorchestra_network.private_vlanid.id
#  }

  disk {
    sr_id      = data.xenorchestra_sr.sr.id
    name_label = var.vm_disk_name_label
    size       = var.vm_disk_size
  }
}

alfcruz-adm@local.hcpa.ufrgs.br@volt-ampere:~/terraform-provider-xenorchestra-intro/mkxcpvm2n$
alfcruz-adm@local.hcpa.ufrgs.br@volt-ampere:~/terraform-provider-xenorchestra-intro/mkxcpvm2n$ cat cloud_userdata_cfg.yaml
#cloud-config
groups:
  - aghuse: [aghu]

users:
  # seiseg and aghu / REDACTED | same public key
  - name: aghu
    uid: 1003
    gecos: AGHU Application Standard User
    passwd: <REDACTED>
    lock_passwd: true
    sudo: ['ALL=(ALL) NOPASSWD:ALL']
    groups: [aghuse]
    shell: /bin/bash
    homedir: /opt/aghu
    no_create_home: false

packages:
  - tree

runcmd:
  - sed -i -e "s/PARAMMYHOSTNAME/${hostname}/g" /etc/postfix/main.cf
  - sed -i -e "s/PARAMMYHOSTNAME/${hostname}/" /etc/puppetlabs/puppet/puppet.conf
  - /opt/ds_agent/dsa_control -r
  - /opt/ds_agent/dsa_control -a dsm://goodman.local.hcpa.ufrgs.br:4120/ "policyid:60"
  - systemctl disable networker
  -


alfcruz-adm@local.hcpa.ufrgs.br@volt-ampere:~/terraform-provider-xenorchestra-intro/mkxcpvm2n$ cat cloud_metadata_cfg.yaml
#cloud-config
local-hostname: ${hostname}
instance-id: ${hostname}
network:
  version: 2
  ethernets:
    ens192:
      dhcp4: false
      addresses:
        - ${ip}/${prefixlen}
      gateway4: ${gateway}
      nameservers:
        search: [local.hcpa.ufrgs.br, hcpa]
        addresses: [10.10.31.13, 10.10.31.14, 10.10.31.42]
growpart:
  mode: auto
  devices: ['/dev/sda2']
  ignore_growroot_disabled: true
wait-on-network:
  ipv4: true

alfcruz-adm@local.hcpa.ufrgs.br@volt-ampere:~/terraform-provider-xenorchestra-intro/mkxcpvm2n$

@Biggen The updated netdata packages display the vm's vbds data (in and out), but nothing for the vm's network interfaces. Not even its presence in the vm's domain.

@Biggen I am not aware of this problem. Mine (updated) displays the server's 6 physical eth interfaces and 3 more xapi0 ~ xapi2 and 9 physical drives sda to sdi. I still not have multipath configured in the servers.


[10:37 xcpngp02h01 ~]# yum update "netdata*" --enablerepo=xcp-ng-testing
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
Excluding mirror: updates.xcp-ng.org
 * xcp-ng-base: mirrors.xcp-ng.org
Excluding mirror: updates.xcp-ng.org
 * xcp-ng-testing: mirrors.xcp-ng.org
Excluding mirror: updates.xcp-ng.org
 * xcp-ng-updates: mirrors.xcp-ng.org
xcp-ng-testing/signature                                 |  473 B     00:00     
xcp-ng-testing/signature                                 | 3.0 kB     00:00 !!! 
xcp-ng-testing/primary_db                                  |  22 kB   00:01     
Resolving Dependencies
--> Running transaction check
---> Package netdata.x86_64 0:1.19.0-3.xcpng8.1 will be updated
---> Package netdata.x86_64 0:1.19.0-4.xcpng8.1 will be an update
---> Package netdata-debuginfo.x86_64 0:1.19.0-3.xcpng8.1 will be updated
---> Package netdata-debuginfo.x86_64 0:1.19.0-4.xcpng8.1 will be an update
---> Package netdata-ui.x86_64 0:1.19.0-3.xcpng8.1 will be updated
---> Package netdata-ui.x86_64 0:1.19.0-4.xcpng8.1 will be an update
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package              Arch      Version                 Repository         Size
================================================================================
Updating:
 netdata              x86_64    1.19.0-4.xcpng8.1       xcp-ng-testing     11 M
 netdata-debuginfo    x86_64    1.19.0-4.xcpng8.1       xcp-ng-testing    1.6 M
 netdata-ui           x86_64    1.19.0-4.xcpng8.1       xcp-ng-testing    6.4 k

Transaction Summary
================================================================================
Upgrade  3 Packages

Total download size: 13 M
Is this ok [y/d/N]: y
Downloading packages:
Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
(1/3): netdata-debuginfo-1.19.0-4.xcpng8.1.x86_64.rpm      | 1.6 MB   00:02     
(2/3): netdata-ui-1.19.0-4.xcpng8.1.x86_64.rpm             | 6.4 kB   00:00     
(3/3): netdata-1.19.0-4.xcpng8.1.x86_64.rpm                |  11 MB   00:12     
--------------------------------------------------------------------------------
Total                                              1.1 MB/s |  13 MB  00:12     
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Updating   : netdata-1.19.0-4.xcpng8.1.x86_64                             1/6 
  Updating   : netdata-ui-1.19.0-4.xcpng8.1.x86_64                          2/6 
  Updating   : netdata-debuginfo-1.19.0-4.xcpng8.1.x86_64                   3/6 
  Cleanup    : netdata-ui-1.19.0-3.xcpng8.1.x86_64                          4/6 
  Cleanup    : netdata-debuginfo-1.19.0-3.xcpng8.1.x86_64                   5/6 
  Cleanup    : netdata-1.19.0-3.xcpng8.1.x86_64                             6/6 
  Verifying  : netdata-debuginfo-1.19.0-4.xcpng8.1.x86_64                   1/6 
  Verifying  : netdata-1.19.0-4.xcpng8.1.x86_64                             2/6 
  Verifying  : netdata-ui-1.19.0-4.xcpng8.1.x86_64                          3/6 
  Verifying  : netdata-ui-1.19.0-3.xcpng8.1.x86_64                          4/6
  Verifying  : netdata-1.19.0-3.xcpng8.1.x86_64                             5/6 
  Verifying  : netdata-debuginfo-1.19.0-3.xcpng8.1.x86_64                   6/6 

Updated:
  netdata.x86_64 0:1.19.0-4.xcpng8.1                                            
  netdata-debuginfo.x86_64 0:1.19.0-4.xcpng8.1                                  
  netdata-ui.x86_64 0:1.19.0-4.xcpng8.1                                         

Complete!
[12:47 xcpngp02h01 ~]# 
[12:50 xcpngp02h01 ~]# systemctl status netdata.service 
? netdata.service - Real time performance monitoring
   Loaded: loaded (/usr/lib/systemd/system/netdata.service; enabled; vendor preset: disabled)
   Active: active (running) since Thu 2020-07-16 12:50:46 -03; 10s ago
  Process: 9810 ExecStartPre=/usr/libexec/netdata/xcpng-iptables-restore.sh (code=exited, status=0/SUCCESS)
  Process: 9807 ExecStartPre=/bin/chown -R netdata:netdata /var/run/netdata (code=exited, status=0/SUCCESS)
  Process: 9804 ExecStartPre=/bin/mkdir -p /var/run/netdata (code=exited, status=0/SUCCESS)
  Process: 9800 ExecStartPre=/bin/chown -R netdata:netdata /var/cache/netdata (code=exited, status=0/SUCCESS)
  Process: 9797 ExecStartPre=/bin/mkdir -p /var/cache/netdata (code=exited, status=0/SUCCESS)
 Main PID: 9816 (netdata)
   CGroup: /system.slice/netdata.service
           ??9816 /usr/sbin/netdata -P /var/run/netdata/netdata.pid -D -W set...
           ??9849 /usr/bin/python /usr/libexec/netdata/plugins.d/python.d.plu...
           ??9852 /usr/libexec/netdata/plugins.d/go.d.plugin 1
           ??9854 /usr/libexec/netdata/plugins.d/freeipmi.plugin 1
           ??9857 /usr/libexec/netdata/plugins.d/xenstat.plugin 1
           ??9867 /usr/libexec/netdata/plugins.d/apps.plugin 1
[12:50 xcpngp02h01 ~]# 

HP BladeSystem c7000 enclosure G2, with Proliant BL460c Gen8 servers. HP VC FlexFabric 10Gb/24-port modules.

Dell PowerEdge M1000e enclosure with PowerEdge M620 blades. 4x Dell MXL 10/40GbE modules. Those I/O modules gave errors with Xenserver 7.6, XCP-ng 7.6 - one of the redundant HBAs get disconnected with DMA errors in the hypervisor logs.

So far, so good with XCP-ng 8.0 beta. Not much load on the servers. Some fake loading with fio.

@olivierlambert Please, how can I send good data about XCP-ng beta for two types of blades, from HP and Dell? Something like a Citrix Health check would do it?

@olivierlambert Best one!!! Super cool and not ultra left wing red-ish. Thanks.