XOA Updater Down?

joneill

Is anyone else having issues getting the xoa-updater command to run?

I keep getting various errors like:

{ message: 'HTTP connection has timed out' }
{ message: 'Unexpected end of JSON input' }
{ message: '' }

Sometimes it will work but then loses connection when the command is running.
I have also confirmed that it is not a DNS issue.

Thanks.

DustinB

@joneill I'm seeing this

TheNorthernLight

@joneill I've been having periodic access issues as well for the past week. It seem xen-orchestry.com is acting with really slow response times (almost like a ddos attack, or something like that).

marekm

Same here, getting timeouts when trying to update but "ping xen-orchestra.com" seems normal (about 40 ms from here), so more like crashing server processes (out of memory?) than a DDoS (which usually saturates links resulting in high latency and packet loss).

olivierlambert

Hello,

We had an issue with the growing number of XOAs running all around the world. It was a legacy code (7 years old) that was untouched, and the number of calls started to be faster than we could process. We identified the specific call causing the issue, and implemented a neat cache solution in our code.

I let you watch the before/after on the CPU load in that VM hosting this code:

image (4).png

Anyway, now the updater service should work perfectly

marekm

@olivierlambert Thanks for the quick fix - update worked fine when I tried again, right after I wrote my post