Endless Xapi#getResource /rrd_updates in tasks list

Mathieu

@olivierlambert
It took a while to validate it, but I can also confirm that the perf-alert plugin is the culprit.

Here are my plugin's parameters, if it can help chasing the goose:

manilx

@Mathieu I just activated this plugin as a test on our 2 EPYC hosts and I also get these tasks now. So yes, this plugin has an issue.

Deactivated.

olivierlambert

Thanks @julien-f is now reviewing the plugin code

rmarion

I am seeing this same issue on master build cc049 if I turn on perf-alert it starts with in a few minutes. If I turn it off and restart the tool stack it stops.

olivierlambert

It's been fixed since a bit now. Double check you have the correct plugin code rebuilt.

14wkinnersley

@olivierlambert Unfortunately, I am still having this issue if I enable perf-alert. Im on the latest commit (cc049d3) and perf-alert (v0.3.7). I removed the plugin entirely from /packages/xo-server-perf-alert and rebuilt to test further (and restarted toolstack). Still having the tasks hang up

olivierlambert

Can you try with an XOA on latest release channel?

rmarion

Just rebuild open source from scratch and still getting the same issue

14wkinnersley

@olivierlambert Maybe I am doing something wrong but I went ahead and deployed xoa, and under plugins I only have two plugins and neither are for perf-alert. Ive never used XOA, only built XO, so its probably user error.

rmarion

you have to register XOA in order to activate all of the plugins. You do it under the XOA tab. I would role it out to test but I have already registered it one and can't do it again. So I to have been running the open source code for my testing and evaluations.

14wkinnersley

@rmarion Im registered but dont have a license. Dont really want to use up the free trial, and it still only shows the two plugins. So maybe someone else can test.

rmarion

@14wkinnersley Ya I don't work for Yates so I don't have any other option for you on that front. I was just advising on how you could test it with the trial.

olivierlambert

@14wkinnersley Please use the trial, we can extend it anytime if you need.

14wkinnersley

@olivierlambert ~~I activated the trial and imported my configuration from xo, making sure the perf-alert plugin was enabled/configured. I have not received any hanging tasks in XOA.~~

14wkinnersley

@olivierlambert I realized I was on the stable release... After updating to latest release I definately have hanging tasks

olivierlambert

That's interesting Pinging @julien-f

Do you have the tasks when you disable the perf plugin?

rmarion

how do I extend my trial to test it on my side

14wkinnersley

@olivierlambert I disabled perf-alert and restarted toolstack and let it sit for a while, no hanging tasks.

jasonmap

Wanted to chime in here to say I updated my 5 node cluster to the latest 8.2.1 and xo from source to 7b084. Definitely getting the hanging "Xapi#getResource /rrd_updates" tasks even with the perf-alert plugin disabled.

jasonmap

@jasonmap and might be unrelated but I'm not sure: one of my nodes rebooted without stats working either (not the master). Just says "No stats" on the tab. The others seem fine.