Forum ©XSIBackup: ©VMWare ©ESXi Backup Software

slavikf

Member

Registered: 2017-11-13

Posts: 3

High CPU usage by xsibackup-rsync

I just installed XSIBACKUP-FREE 9.1.9 few days ago on my ESXI 6.0 host.

I'm running backup of 1st VM. It has 500GB disk, only ~60GB of which is really used.

/vmfs/volumes/datastore1/xsi-dir/xsibackup \
--backup-point="$IP:2220:/vmfs/volumes/datastore1/backup" \
--backup-prog=rsync:z \
--backup-type=custom \
--backup-vms="$VM" \
--snapshot=excludememory

I got following issues:
1) After running for about a day, about 50GB got processed and now it stuck at 9% and no more progress in the console.

Info: transfering file [ /vmfs/volumes/57f6c0c9-6ac2989c-4132-0cc47ac5a914/Gitlab/Gitlab-flat.vmdk ]
sending incremental file list
Gitlab-flat.vmdk
 50,508,693,504   9%  403.63kB/s  334:42:53

That progress is not changing for last ~10 hours. Including transfer rate - it stays constant, too.

2) Today (2nd day), I received alert: "Alarm - Host CPU usage".
And I see, that it caused by xsibackup-rsync:

# esxtop
CORE UTIL(%):  21     100      16      17     AVG:  38

      ID      GID NAME             NWLD   %USED    %RUN    %SYS   %WAIT %VMWAIT    %RDY   %IDLE  %OVRLP   %CSTP  %MLMTD  %SWPWT
40870515 40870515 xsibackup-rsync     1  110.45   97.49    0.00    0.00       -    0.00    0.00    0.02    0.00    0.00    0.00
34459113 34459113 33-Windows7Enpr     7   18.61   23.38    0.09  658.08    0.37    0.85  170.42    0.04    0.00    0.00    0.00
13306575 13306575 37-Gitlab           8   15.94   15.75    0.04  763.88    3.36    0.21  273.22    0.03    0.00    0.00    0.00

Any idea, how do I troubleshoot this issue?

admin

Administrator

Registered: 2017-04-21

Posts: 2,072

Re: High CPU usage by xsibackup-rsync

We need more info. Are you backing up over a WAN?, if so, what's your available bandwidth?
Most important: what is your remote's ESXi version?, have you detected any errors in the output?, can you provide it?

I'm afraid that Rsync is not a very practical way to move 500 gb. over IP, especially since it can't deal with zeros and copies them as data. Even though it can compress them, still is not the best way to do it. In any case it should work, no matter how long it takes, so please send us some more details.

slavikf

Member

Registered: 2017-11-13

Posts: 3

Re: High CPU usage by xsibackup-rsync

Yes, backing up over WAN.
From OVH data center near Montreal to the host in Seattle, WA.

OVH:
- bandwidth: 250 Mbps
- ESXI 6.0.0 Update 2 (Build 3620759)

Seattle endpoint:
- bandwidth: DSL 40Mbps Down / 5Mbps Up
- ESXI 6.0.0 Update 2 (Build 3620759)

When i just started the backup task I saw speed of 1-2 MBps (== 10-12 Mbps), which is ok for my purpose.

Here is complete log output. I only remove my IPs from it:
[url]https://slavikf.com/Shared/backupLog.txt[/url]

Let me know, if I can provide any additional troubleshoot info.

slavikf

Member

Registered: 2017-11-13

Posts: 3

Re: High CPU usage by xsibackup-rsync

[quote] I'm afraid that Rsync is not a very practical way to move 500 gb. over IP[/quote]

Do I have any other option for backup over WAN in free edition?

Last edited by slavikf (2017-11-13 20:44:45)

admin

Administrator

Registered: 2017-04-21

Posts: 2,072

Re: High CPU usage by xsibackup-rsync

This looks more like a communications problem, no errors thrown by Rsync, it just sits there waiting.
Free edition just offers Rsync to copy data over IP.

Try to disable compression to see if it helps. You can deactivate it yourself by replacing this line of code around line 430

SSHOPTS="-2 -4 -o StrictHostKeyChecking=no -i "${PWD}"/xsibackup_id_rsa"

With this

SSHOPTS="-2 -4 -o StrictHostKeyChecking=no –o compression=no -i "${PWD}"/xsibackup_id_rsa"

If you are using an OVH dedicated server, many of our clients do, I would use the primary disk to hold data and the secondary disk to store backups. Once you have your data in the secondary disk you have more freedom to replicate it somewhere else.