xoa slow export
-
It has to flow from a host, to XOA then to your browser. Anything that could slow the traffic between could explain. Also, what kind of compression did you use?
-
It seems that this is impossible for xoa to export 2 o more vm at once
-
-
I've endless export task :
atlas vm on 2nd server xoa is on 1st, both xcp-ng servers connected to single gb switch thru 4-port lacp connection
-
Can't say for XOA specific, but let me add: 20 MB/s is slow (even with XS) - on better systems it should rather hit 200 MB/s.
-
It's hard to tell slow or not without knowing all the context
Using GZIP compression, it's "normal". Then you have network speed between the host and XO, then between XO and the web browser."Slow" alone doesn't mean anything!
-
@akurzawa said in xoa slow export:
It seems that this is impossible for xoa to export 2 o more vm at once
Indeed, for the time being, XO limits to 2 concurrent exports on any given pool, this will change in the near future.
-
@akurzawa said in xoa slow export:
I've endless export task
Should not cause any issues and it will automatically be destroyed by the XenAPI after 24 hours.
-
@julien-f said in xoa slow export:
@akurzawa said in xoa slow export:
I've endless export task
Should not cause any issues and it will automatically be destroyed by the XenAPI after 24 hours.
wow just 24 hours? Do you know that I cannot shotdown the host right now nor my UPS in case of power failure?
-
@akurzawa I'm not sure but restarting
xo-servermight do the trick as well. -
Toolstack restart will cancel the task.
-
Did you do any tests with XCP-ng Center? Just to get any numbers.
I have one VM on XS that needs to be exportet regulary, which hits about 800 GB in ~22 hours. It always starts reasonably quick and then becomes slower by time - but 800 vs. 8... -
@cg said in xoa slow export:
Did you do any tests with XCP-ng Center? Just to get any numbers.
I have one VM on XS that needs to be exportet regulary, which hits about 800 GB in ~22 hours. It always starts reasonably quick and then becomes slower by time - but 800 vs. 8...In 90% cases I'm obsrving the sam thing - export either in xoa or xcp-ng center is getting slowe over time... idk whats the reason of that.
-
As Citrix barely ever gave any insights... maybe @olivierlambert can bring light into that.
-
We aren't doing any test with XCP-ng Center because we don't use it at all
You can use xeto compare (xeCLI is basically another XAPI client -like XO or XCP-ng Center- which can run on the same host or even elsewhere) -
Regardin export from xoa I the highest speed that I've seen was 40MB/s on raid10 setup, xoa and vm on the same host. What could be the reason of that? Host is almost always idle, just very basic workload.
-
Export from XOA to where? Your browser, a remote?
-
Export from xoa, Gb LAN, latest Chrome, Windows
-
@olivierlambert It's basically the same. I almost only export via scripts/xe.
-
@akurzawa in this case, data is going from the SR to the host, then from the host to XOA, and finally from XOA to your PC with your browser. As you can see there is a lot of "hops" before being stored in your hard drive. And because it's a stream (there isn't any intermediate storage), it means it's going to the speed of the slower element (back pressure).
In general, Xen Orchestra isn't the bottleneck itself because it just "passes" the stream. The most common bottleneck is in general the host itself. Using VM export with
zstdcan yield good results.@cg so the bottleneck can be from your SR to your host, the host itself, or your host to the storage destination.
