#1 2020-08-06 05:46:51

kisiek
Member
Registered: 2020-08-06
Posts: 1

Problem with rsync on incremental backup

Hi
I've already setup free version of XSI Backup and run first job without problem .
Copied over 600 GB of data without problems.
Now when scheduled job want to do inceremental backup I've got below error . How Can i resolve that ?

2020-08-05T23:20:04|  NOTICE: (c) XSIBackup kills any user launched jobs, make sure you don't overlap manual jobs
---------------------------------------------------------------------------------------------------------------------------------
XSIBackup PID:           271930                                               master.kisiek.net
Wed, 05 Aug 2020 23:20:03 +0000                                IPv4: 137.74.0.185/255.255.255.0
VMware ESXi 6.0.0 build-15517548                              (c) Rsync 3.1.0 as opt. dependency
---------------------------------------------------------------------------------------------------------------------------------
Backup Id:                  001                       Intel(R) Xeon(R) CPU E3-1245 v5 @ 3.50GHz
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:20:04|  Message: crontab is installed for user root
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:20:05|  ADVICE: no SSD disks, please consider adding an SSD cache disk to improve performance
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:20:05|  Backup user is: root
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:20:05|  Backup program is: rsync
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:20:48|  Remote OpenSSH version is: 7.6p1
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:20:50|  Negotiated Cipher (server->client): chacha20-poly1305@openssh.com
2020-08-05T23:20:50|  Negotiated Cipher (client->server): chacha20-poly1305@openssh.com
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:20:50|  Service OpenSSH ready at server 5.196.89.75:9922
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:20:52|  Remote ESXi version is bash: vmware: command not found
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:20:52|  Info: XSIBACKUP-FREE will now try to determine the remote's XSIBACKUP-FREE installation point...
2020-08-05T23:20:52|  Tip: should this process take too long, use the --remote-xsipath argument to set it
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:20:53|  Found (c) XSIBackup installation. Remote path is set dynamically
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:20:54|  Remote xsi path set to: none (filesystem: UNKNOWN)
---------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
|                     Custom ciphers is not available in XSIBACKUP-FREE                    |
|                          Get XSIBACKUP-PRO at http://33hops.com                          |
--------------------------------------------------------------------------------------------

2020-08-05T23:21:00|  Mirroring to server xxxxxxxx port xxxx
2020-08-05T23:21:00|  Checking Rsync exists on the other side...
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:00|  (c)Rsync (samba.org) found at [ xxxxxxxxx:xx:/usr/bin/rsync... ]
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:00|  Getting list of all VMs...
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:00|  1      zone.kisiek.net_vm   [datastore1] zone.kisiek.net/zone.kisiek.net.vmx   centos64Guest     vmx-11
2020-08-05T23:21:01|  2      Zabbix               [datastore1] Debian/Debian.vmx                     debian8_64Guest   vmx-11
2020-08-05T23:21:01|  27     owncloud RHEL        [datastore1] owncloud RHEL/owncloud RHEL.vmx       centos64Guest     vmx-11
2020-08-05T23:21:02|  28     grafana              [datastore1] grafana/grafana.vmx                   centos64Guest     vmx-11
2020-08-05T23:21:03|  3      zapasowy DNS         [datastore1] zapasowy DNS/zapasowy DNS.vmx         centos64Guest     vmx-11
2020-08-05T23:21:03|  34     docker centos 7      [datastore1] docker centos 7/docker centos 7.vmx   centos64Guest     vmx-11
2020-08-05T23:21:04|  35     RESTORE_ME           [datastore1] RESTORE_ME/RESTORE_ME.vmx             centos64Guest     vmx-11
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:04|  VMs to backup:
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:04|  1      zone.kisiek.net_vm   [datastore1] zone.kisiek.net/zone.kisiek.net.vmx   centos64Guest     vmx-11
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:07|  Calculating sizes...
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:08|  [zone.kisiek.net_vm] Starting backup (size is 928625M on 1228800M file)
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:08|  XSIBackup will backup your VMs while they are running, so that users can continue to use the VM
2020-08-05T23:21:08|  while the backup is taking place. You can also run --backup-how=cold|warm
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:08|  Hot backup selected for VM: [zone.kisiek.net_vm], will not be switched off
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:08|  [zone.kisiek.net_vm] info: boot partition is MBR
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:09|  Removing snapshots, please wait...
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:10|  Syncronizing config files
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:16|  [zone.kisiek.net_vm] info: VMX file succesfully queued
2020-08-05T23:21:18|  [zone.kisiek.net_vm] info: VMSD file succesfully queued
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:19|  [zone.kisiek.net_vm] info: VMXF file succesfully queued
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:20|  [zone.kisiek.net_vm] info: NVRAM file succesfully queued
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:20|  [zone.kisiek.net_vm] info: VMWare tools were not detected, the system will not be quiesced
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:27|  Backing up virtual disks...
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:27|  DISK=/vmfs/volumes/datastore1/zone.kisiek.net/zone.kisiek.net-Snapshot104.vmsn
2020-08-05T23:21:27|  DISK=/vmfs/volumes/datastore1/zone.kisiek.net/zone.kisiek.net.thin-000001-delta.vmdk
2020-08-05T23:21:27|  DISK=/vmfs/volumes/datastore1/zone.kisiek.net/zone.kisiek.net.thin-000001.vmdk
2020-08-05T23:21:27|  DISK=/vmfs/volumes/datastore1/zone.kisiek.net/zone.kisiek.net.thin.vmdk
2020-08-05T23:21:28|  DISK=/vmfs/volumes/datastore1/zone.kisiek.net/zone.kisiek.net.vmdk
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:29|  Rsync file transfer (1st)
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:29|  From: /vmfs/volumes/datastore1/zone.kisiek.net/zone.kisiek.net-Snapshot104.vmsn
2020-08-05T23:21:29|  To: /home/vmware/zone.kisiek.net_vm/zone.kisiek.net-Snapshot104.vmsn
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
zone.kisiek.net-Snapshot104.vmsn
         31,799 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/1)

sent 31,909 bytes  received 35 bytes  7,098.67 bytes/sec
total size is 31,799  speedup is 1.00
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:33|  Disk [/vmfs/volumes/datastore1/zone.kisiek.net/zone.kisiek.net.thin-000001-delta.vmdk] excluded
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:33|  Disk [/vmfs/volumes/datastore1/zone.kisiek.net/zone.kisiek.net.thin-000001.vmdk] excluded
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:34|  Rsync file transfer
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:34|  From: /vmfs/volumes/datastore1/zone.kisiek.net/zone.kisiek.net.thin.vmdk
2020-08-05T23:21:34|  To: /home/vmware/zone.kisiek.net_vm/zone.kisiek.net.thin.vmdk
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
zone.kisiek.net.thin.vmdk
            561 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/1)

sent 664 bytes  received 41 bytes  470.00 bytes/sec
total size is 561  speedup is 0.80
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:37|  Rsync: comparing file sizes...
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:38|  Rsync: sizes are different, calculating delta checksums, can take a while, time for a coffee...
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:21:38|  Rsync: transfering file [ /vmfs/volumes/datastore1/zone.kisiek.net/zone.kisiek.net.thin-flat.vmdk ]
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
2020-08-05T23:24:13|  [zone.kisiek.net_vm] CLXSIDF1 error: file transfer error: ERROR: out of memory in receive_sums [sender]
2020-08-05T23:24:13|  rsync error: error allocating core memory buffers (code 22) at util2.c(102) [sender=3.1.0]
2020-08-05T23:24:13|  [sender] io timeout after 60 seconds -- exiting
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:24:16|  Rsync file transfer
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:24:16|  From: /vmfs/volumes/datastore1/zone.kisiek.net/zone.kisiek.net.vmdk
2020-08-05T23:24:16|  To: /home/vmware/zone.kisiek.net_vm/zone.kisiek.net.vmdk
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
zone.kisiek.net.vmdk
            507 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/1)

sent 98 bytes  received 41 bytes  55.60 bytes/sec
total size is 507  speedup is 3.65
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:24:20|  Rsync: comparing file sizes...
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:24:21|  Rsync: sizes are different, calculating delta checksums, can take a while, time for a coffee...
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:24:21|  Rsync: transfering file [ /vmfs/volumes/datastore1/zone.kisiek.net/zone.kisiek.net-flat.vmdk ]
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
2020-08-05T23:26:25|  [zone.kisiek.net_vm] CLXSIDF1 error: file transfer error: ERROR: out of memory in receive_sums [sender]
2020-08-05T23:26:25|  rsync error: error allocating core memory buffers (code 22) at util2.c(102) [sender=3.1.0]
2020-08-05T23:26:25|  [sender] io timeout after 60 seconds -- exiting
---------------------------------------------------------------------------------------------------------------------------------
2020-08-05T23:26:26|  Excluded disks removed from backup .vmx file
---------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
|              Backup of ESXi configuration is not available in XSIBACKUP-FREE             |
|                          Get XSIBACKUP-PRO at http://33hops.com                          |
--------------------------------------------------------------------------------------------

2020-08-05T23:26:42|  Errors detected in backup, check logs
---------------------------------------------------------------------------------------------------------------------------------

Any idea how to resolve it ?

Offline

#2 2020-08-06 13:59:44

admin
Administrator
Registered: 2017-04-21
Posts: 1,363

Re: Problem with rsync on incremental backup

The message is clear, you ran out of memory

Offline

Board footer