Posts made by Tristis Oris

Greetings.
last few days receive this errors. Works fine for a months before.

• have 3 pool, but errors only at 1 of them.
• all pools at same network, backup at same 2 storages.
• it begins at 3-4 VMs, but today 2 more backup broken too. One of VM just created, so almost have no backup chain.
• after moving disk to another storage backup chain fixed.

weird that it happens only at 1 pool. It have no any errors with a link to storage or network. Empty space is enough too.

is it possible if link down between XO and pool during backup? this pool located in another place. this is the only difference.

found nothing at SMlog, only at XO syslog.

UUID: e8e86755-8e74-e078-8c43-955a7d521df4
    Start time: Thursday, May 19th 2022, 6:04:29 am
    End time: Thursday, May 19th 2022, 6:04:36 am
    Duration: a few seconds
    Reason: (unhealthy VDI chain) Job canceled to protect the VDI chain

2022-05-18T21:12:15.067Z xo:backups:mergeWorker FATAL ENOENT: no such file or directory, rename '/mnt/vc-2600-1/xo-vm-b>
 error: [Error: ENOENT: no such file or directory, rename '/mnt/vc-2600-1/xo-vm-backups/.queue/clean-vm/_20220518T211039Z-p7h0kr8o71d' -> '/mnt/vc-2600-1/xo-vm-backups/.queue/clean-vm/__20220518T211039Z-p7h0kr8o71d'] {
 errno: -2,
 code: 'ENOENT',
 syscall: 'rename',
 path: '/mnt/vc-2600-1/xo-vm-backups/.queue/clean-vm/_20220518T211039Z-p7h0kr8o71d',
 dest: '/mnt/vc-2600-1/xo-vm-backups/.queue/clean-vm/__20220518T211039Z-p7h0kr8o71d'

2022-05-18T10:00:54.337Z xo:backups:DeltaBackupWriter WARN checkBaseVdis {
  error: [Error: ENOENT: no such file or directory, scandir '/mnt/vc-2600-1/xo-vm-backups/06ff383c-6c59-7293-98f5-9ed62745e567/vdis/9f3f2ced-14b7-4857-8a07-e7fb1acce485/260dac24-cad6-4362-ab9f-0a872e1c08f2'] {
    errno: -2,
    code: 'ENOENT',
    syscall: 'scandir',
    path: '/mnt/vc-2600-1/xo-vm-backups/06ff383c-6c59-7293-98f5-9ed62745e567/vdis/9f3f2ced-14b7-4857-8a07-e7fb1acce485/260dac24-cad6-4362-ab9f-0a872e1c08f2'

@shinuza got it, thanks. sad of course(

"ansible needs a stable unique id to identify hosts"
not realy, with manual host lists awx download new every time and remove old\chenged info.
same for netbox integration.

for most of task just enough tags like linux, db, etc.

is it any way to translate uuid to names at inventory?

@shinuza it's a password.

with long one with symbols xo-cli can't register.
changed to simple, it works now.

tried "" or '' in playbook, it didnt work.

@shinuza both VM in same network, disabled firewall at orchestra.
same error. what it could be?

  File "/usr/local/lib/python3.8/site-packages/websocket/_http.py", line 130, in connect
    sock = _open_socket(addrinfo_list, options.sockopt, options.timeout)
  File "/usr/local/lib/python3.8/site-packages/websocket/_http.py", line 208, in _open_socket
    raise err
  File "/usr/local/lib/python3.8/site-packages/websocket/_http.py", line 185, in _open_socket
    sock.connect(address)
[WARNING]:  * Failed to parse /runner/project/inventory/xen_orchestra.yml with
yaml plugin: Plugin configuration YAML file, not YAML inventory
  File "/usr/local/lib/python3.8/site-packages/ansible/inventory/manager.py", line 290, in parse_source
    plugin.parse(self._inventory, self._loader, source, cache=cache)
  File "/usr/local/lib/python3.8/site-packages/ansible/plugins/inventory/yaml.py", line 112, in parse
    raise AnsibleParserError('Plugin configuration YAML file, not YAML inventory')
[WARNING]:  * Failed to parse /runner/project/inventory/xen_orchestra.yml with
ini plugin: Invalid host pattern 'plugin:' supplied, ending in ':' is not
allowed, this character is reserved to provide a port.
  File "/usr/local/lib/python3.8/site-packages/ansible/inventory/manager.py", line 290, in parse_source
    plugin.parse(self._inventory, self._loader, source, cache=cache)
  File "/usr/local/lib/python3.8/site-packages/ansible/plugins/inventory/ini.py", line 136, in parse
    raise AnsibleParserError(e)
[WARNING]: Unable to parse /runner/project/inventory/xen_orchestra.yml as an
inventory source
ERROR! No inventory was parsed, please check your configuration and options.

with a

plugin: community.general.xen_orchestra
api_host: ip
user: awx
password: "awx"
validate_certs: no
use_ssl: no

i got

ansible-inventory [core 2.11.7.post0] 
  config file = None
  configured module search path = ['/home/runner/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /usr/local/lib/python3.8/site-packages/ansible
  ansible collection location = /runner/requirements_collections:/home/runner/.ansible/collections:/usr/share/ansible/collections:/usr/share/automation-controller/collections
  executable location = /usr/local/bin/ansible-inventory
  python version = 3.8.8 (default, Aug 25 2021, 16:13:02) [GCC 8.5.0 20210514 (Red Hat 8.5.0-3)]
  jinja version = 2.10.3
  libyaml = True
No config file found; using defaults
setting up inventory plugins
host_list declined parsing /runner/project/inventory/xen_orchestra.yml as it did not pass its verify_file() method
script declined parsing /runner/project/inventory/xen_orchestra.yml as it did not pass its verify_file() method
Loading collection community.general from /usr/share/ansible/collections/ansible_collections/community/general
toml declined parsing /runner/project/inventory/xen_orchestra.yml as it did not pass its verify_file() method
[WARNING]:  * Failed to parse /runner/project/inventory/xen_orchestra.yml with
auto plugin: 'result'
  File "/usr/local/lib/python3.8/site-packages/ansible/inventory/manager.py", line 290, in parse_source
    plugin.parse(self._inventory, self._loader, source, cache=cache)
  File "/usr/local/lib/python3.8/site-packages/ansible/plugins/inventory/auto.py", line 58, in parse
    plugin.parse(inventory, loader, path, cache=cache)

@shinuza got it. any reason why it can be refused?
i created a user account, is it enough?
or a screening password.

@shinuza but no refused error with a structure:

simple_config_file:
    plugin: community.general.xen_orchestra

Greetings. trying to setup new ansible plugin as inventory source for AWX 19.5.

created custom EE with comunity plugin.
used a basic code from example https://docs.ansible.com/ansible/devel/collections/community/general/xen_orchestra_inventory.html

file named xen_orchestra.yml

simple_config_file:
    plugin: community.general.xen_orchestra
    api_host: ip
    user: awx
    password: awx
    validate_certs: no
    use_ssl: no

output for inventory update success, but:

ansible-inventory [core 2.11.7.post0] 
  config file = None
  configured module search path = ['/home/runner/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /usr/local/lib/python3.8/site-packages/ansible
  ansible collection location = /runner/requirements_collections:/home/runner/.ansible/collections:/usr/share/ansible/collections:/usr/share/automation-controller/collections
  executable location = /usr/local/bin/ansible-inventory
  python version = 3.8.8 (default, Aug 25 2021, 16:13:02) [GCC 8.5.0 20210514 (Red Hat 8.5.0-3)]
  jinja version = 2.10.3
  libyaml = True
No config file found; using defaults
setting up inventory plugins
host_list declined parsing /runner/project/inventory/xen_orchestra.yml as it did not pass its verify_file() method
script declined parsing /runner/project/inventory/xen_orchestra.yml as it did not pass its verify_file() method
[WARNING]: Skipping key (plugin) in group (simple_config_file) as it is not a
mapping, it is a <class 'ansible.parsing.yaml.objects.AnsibleUnicode'>
[WARNING]: Skipping key (api_host) in group (simple_config_file) as it is not a
mapping, it is a <class 'ansible.parsing.yaml.objects.AnsibleUnicode'>
[WARNING]: Skipping key (user) in group (simple_config_file) as it is not a
mapping, it is a <class 'ansible.parsing.yaml.objects.AnsibleUnicode'>
[WARNING]: Skipping key (password) in group (simple_config_file) as it is not a
mapping, it is a <class 'ansible.parsing.yaml.objects.AnsibleUnicode'>

if remove "simple_config_file:"

ansible-inventory [core 2.11.7.post0] 
  config file = None
  configured module search path = ['/home/runner/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /usr/local/lib/python3.8/site-packages/ansible
  ansible collection location = /runner/requirements_collections:/home/runner/.ansible/collections:/usr/share/ansible/collections:/usr/share/automation-controller/collections
  executable location = /usr/local/bin/ansible-inventory
  python version = 3.8.8 (default, Aug 25 2021, 16:13:02) [GCC 8.5.0 20210514 (Red Hat 8.5.0-3)]
  jinja version = 2.10.3
  libyaml = True
No config file found; using defaults
setting up inventory plugins
host_list declined parsing /runner/project/inventory/xen_orchestra.yml as it did not pass its verify_file() method
script declined parsing /runner/project/inventory/xen_orchestra.yml as it did not pass its verify_file() method
Loading collection community.general from /usr/share/ansible/collections/ansible_collections/community/general
toml declined parsing /runner/project/inventory/xen_orchestra.yml as it did not pass its verify_file() method
[WARNING]:  * Failed to parse /runner/project/inventory/xen_orchestra.yml with
auto plugin: [Errno 111] Connection refused
  File "/usr/local/lib/python3.8/site-packages/ansible/inventory/manager.py", line 290, in parse_source
    plugin.parse(self._inventory, self._loader, source, cache=cache)
  File "/usr/local/lib/python3.8/site-packages/ansible/plugins/inventory/auto.py", line 58, in parse
    plugin.parse(inventory, loader, path, cache=cache)

why all keys not valid?

@ronivay yes i see, most "used" memory just a cached. so as i ask before

1. How much memory XOA really required
2. and any point to increase resources?
3. Or it will consume any available memory without any visible profit.

is it fine to have 4gb for any installation size?

@julien-f
first 10min usage was ~4Gb, then slowly grow.

free -m
              total        used        free      shared  buff/cache   available
Mem:          64405         889       18383           1       45132       62827
Swap:          3912           2        3910

cat /proc/meminfo
MemTotal:       65951364 kB
MemFree:        19057564 kB
MemAvailable:   64344288 kB
Buffers:           73420 kB
Cached:         45693660 kB
SwapCached:           20 kB
Active:           432944 kB
Inactive:       45829948 kB
Active(anon):     248744 kB
Inactive(anon):   248388 kB
Active(file):     184200 kB
Inactive(file): 45581560 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:       4006908 kB
SwapFree:        4004092 kB
Dirty:           1248900 kB
Writeback:             0 kB
AnonPages:        496172 kB
Mapped:            92384 kB
Shmem:              1040 kB
Slab:             427740 kB
SReclaimable:     223828 kB
SUnreclaim:       203912 kB
KernelStack:        6464 kB
PageTables:        10196 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    36982588 kB
Committed_AS:     959248 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
CmaTotal:              0 kB
CmaFree:               0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      468992 kB
DirectMap2M:    28882944 kB
DirectMap1G:    38797312 kB


vmstat -s
     65951364 K total memory
       903496 K used memory
       433108 K active memory
     45665008 K inactive memory
     19221716 K free memory
        73420 K buffer memory
     45752732 K swap cache
      4006908 K total swap
         2816 K used swap
      4004092 K free swap
      1722699 non-nice user cpu ticks
          927 nice user cpu ticks
       650973 system cpu ticks
     93226562 idle cpu ticks
       562428 IO-wait cpu ticks
            0 IRQ cpu ticks
        88662 softirq cpu ticks
       199013 stolen cpu ticks
      1744586 pages paged in
       651916 pages paged out
            8 pages swapped in
           56 pages swapped out
    659058082 interrupts
    531357650 CPU context switches
   1637953158 boot time
        16715 forks

Greetings.
not a problem, just to know.

1. How much memory XOA really required
2. and any point to increase resources?
3. Or it will consume any available memory without any visible profit.

We have ~140 VM, 10 pools, backup tasks, etc.
During backups XOA eat all available memory. It was 8Gb, then 16, now 60.
last tests here, just a few VMs backups ~50-150gb total.