Gather CPU utilization of host as variable for prometheus exporter
-
Everything is already exported via RRDs (see https://wiki.xenproject.org/wiki/XAPI_RRDs). That's what we use in XO.
But this is far from being nice because:
- Those RRDs are encapsulated in XML, which is costly to parse
- XAPI itself is hammering Xen with requests every 5 secs
So ideally, doing a metrics redesign from Xen to XAPI first, will be better.
-
how does API get these metrics?
-
You mean how XAPI is fetching these metrics?
-
@olivierlambert yes
-
there must be some low level way to do that from dom0
-
That's the plan, yes, there's some Xen stats backend, but it requires some work to modify Xen for a better system.
-
I just installed XCP-ng on a new server and wanted Prometheus metrics too, so I wrote this: https://github.com/MikeDombo/xen-exporter.
It is a simple Python script (which can run in Docker) that collects the metrics from XCP-ng's RRD API. These are the same metrics that you'd see in Xen Orchestra or in the XenServer Console application. In addition to the exporter, I've also created a Grafana dashboard to visualize these metrics too.
-
Ah nice!
Ideally, we'd like to avoid to use the complicated XAPI RRD + XML system. See https://xcp-ng.org/blog/2022/05/25/fetching-metrics-in-xen-why-the-method-matters/
Thanks a lot to bring this, I'll promote it!
-
I was about to link Mike's work here, but wanted to say how we desperately need a metrics system that would be exposed from a centralized location. There's no way in hell I'm giving a docker host credential access to the hypervisor it resides on (and all the other hypervisors) - on the other hand, if the metrics were exposed only via XO and limited in terms of where these metrics could be accessed from, now that would be a sold implementation.
-
-
@ScarfAntennae said in Gather CPU utilization of host as variable for prometheus exporter:
I was about to link Mike's work here, but wanted to say how we desperately need a metrics system that would be exposed from a centralized location. There's no way in hell I'm giving a docker host credential access to the hypervisor it resides on (and all the other hypervisors) - on the other hand, if the metrics were exposed only via XO and limited in terms of where these metrics could be accessed from, now that would be a sold implementation.
Looks like this wish has been granted with the latest Xen-Orchestra release.
I was able to successfully scrape the metrics from XO using Prometheus. I was wondering if there was any links or json file examples of a good Grafana dashboard to show these metrics? I saw example screenshots in the blog post here but nothing on grafana.com, here in the forums, or on Github had the config. I saw PR #9333 with documentation about the feature, and great rules for alerting, but also no dashboard configs. It has some beginning parts for variables and 2 visualisations, but a copy of the example in the blog would be wonderful as a starting point.
-
Question for @team-xo-backend
-
Yay! Santa came early this year!!
