Netdata package is now available in XCP-ng

olivierlambert

It should be a systemd service IIRC, so systemctl status netdata

LunarstarPony

netdata.service - Real time performance monitoring
   Loaded: loaded (/usr/lib/systemd/system/netdata.service; enabled; vendor preset: disabled)
   Active: active (running) since Wed 2021-05-05 14:57:09 CST; 1h 27min ago
  Process: 1620 ExecStartPre=/usr/libexec/netdata/xcpng-iptables-restore.sh (code=exited, status=0/SUCCESS)
  Process: 1617 ExecStartPre=/bin/chown -R netdata:netdata /var/run/netdata (code=exited, status=0/SUCCESS)
  Process: 1612 ExecStartPre=/bin/mkdir -p /var/run/netdata (code=exited, status=0/SUCCESS)
  Process: 1608 ExecStartPre=/bin/chown -R netdata:netdata /var/cache/netdata (code=exited, status=0/SUCCESS)
  Process: 1604 ExecStartPre=/bin/mkdir -p /var/cache/netdata (code=exited, status=0/SUCCESS)
 Main PID: 1625 (netdata)
   CGroup: /system.slice/netdata.service
           ├─ 1625 /usr/sbin/netdata -P /var/run/netdata/netdata.pid -D -W set global process scheduling policy keep -W set global OOM score keep
           ├─ 1658 /usr/libexec/netdata/plugins.d/go.d.plugin 1
           ├─ 1659 /usr/bin/python /usr/libexec/netdata/plugins.d/python.d.plugin 1
           ├─ 1661 /usr/libexec/netdata/plugins.d/xenstat.plugin 1
           ├─ 1663 /usr/libexec/netdata/plugins.d/freeipmi.plugin 1
           ├─ 1684 /usr/libexec/netdata/plugins.d/apps.plugin 1
           └─16285 bash /usr/libexec/netdata/plugins.d/tc-qos-helper.sh 1

It seems working

olivierlambert

Then check if it's streaming correctly to the target

LunarstarPony

@olivierlambert
BTW Will Changing Hostname on the server break this?
I just change it's hostname recently

olivierlambert

Yes it's probably that.

LunarstarPony

@olivierlambert
Well Anyway to fix it or reinstall it?

olivierlambert

You should take a look in the netdata config on your host and check if it's streaming to the right XOA, check Netdata logs and so on.

LunarstarPony

@olivierlambert Any idea where's the netdata config file location?

stormi

/etc/netdata/streaming.conf IIRC.

LunarstarPony

@stormi

# do not edit, managed by XCP-ng

[stream]
    # Enable this on slaves, to have them send metrics.
    enabled = yes
    destination = tcp:*********.****.****:19999
    api key = 0b607150-79c6-11eb-9575-c210359af93e
    timeout seconds = 60
    default port = 19999
    send charts matching = *
    buffer size bytes = 1048576
    reconnect delay seconds = 5
    initial clock resync iterations = 60

I found these in stream.conf

olivierlambert

Is the destination matches XO IP address?

LunarstarPony

@olivierlambert
Yup It does match XOA's IP Address

olivierlambert

So check netdata logs in /var/log to see if there's any error.

LunarstarPony

This post is deleted!

stormi

I see this, which looks good at first sight:

2021-05-05 14:53:06: netdata INFO  : STREAM_SENDER[localhost] : STREAM localhost [send to tcp:XXX:19999]: connecting...
2021-05-05 14:53:06: netdata INFO  : STREAM_SENDER[localhost] : STREAM localhost [send to tcp:XXX:19999]: initializing communication...
2021-05-05 14:53:06: netdata INFO  : STREAM_SENDER[localhost] : STREAM localhost [send to tcp:XXX:19999]: waiting response from remote netdata...
2021-05-05 14:53:06: netdata INFO  : STREAM_SENDER[localhost] : STREAM localhost [send to tcp:XXX:19999]: established communication - ready to send metrics...
2021-05-05 14:53:07: netdata INFO  : PLUGIN[tc] : STREAM localhost [send]: sending metrics..

(caution: your log contains the IP address you masked earlier)

LunarstarPony

@stormi Oh No, have any idea what might be the problem?

stormi

No, I don't know where the problem resides exactly.

andrewm4894

Hello!

We have recently added some ml capabilities to netdata from netdata agent v1.32.0 onwards. Basically, its fairly lightweight unsupervised anomaly detection, so in addition to collecting raw metrics each second for about 1% cpu of one core (typically) and no extra storage the agent also can produce an "anomaly bit" that's 1 if recent data "looks" anomalous or 0 for normal.

Some of our users have asked about if this ML capabilities would work on netdata within XCP-ng.

I'm trying to figure out if/how i might go about answering that. I work on the ML part of all this so am a bit (very) naive on the packaging side of things.

I'm wondering if anyone would be able to help me try figure out if the ML features of the netdata agent would be available via XCP-ng?

olivierlambert

Hello @andrewm4894

Sure, what do you need to know? Let me add @stormi in the conversation

lawrencesystems

@andrewm4894 I am really looking forward to seeing how this update goes because using Netdata inside of XCP-NG is something that I want to do an updated video on to discuss performance and tesing.