Replication VM over IP

Dexxpo · 2019-02-28 14:39:47

Hello everyone,

I'm trying to replicate my virtual machine on my 2nd ESXi and I want to do a few daily replications.

I currently have 2 problems:

1- My job defined with the XSIDiff option launched the first time does not seem to work because the unused blocks are copied. And the second replication is again a full synchronization and not a differential backup.

Why does my job use RSYNC and not XSIDiff? How can I check if my license is correctly applied (I already check esxcfg-vmknic -l)?

2- A snapshot is generated at the beginning of the job and automatically deletes it at the end. But during the remove task, the VM is really slow and can not be used.

Is it possible to make a differential replication without snapshot?

Thank you in advance for your help

My job:
"/vmfs/volumes/Datastore1/xsi-dir/xsibackup" \
--backup-prog=XSIDiff \
--backup-point=192.168.95.66:22:"/vmfs/volumes/Datastore2" \
--remote-xsipath=/vmfs/volumes/5c6a9988-90463b0c-53b8-f8bc1252ec2a/xsi-dir \
--backup-type=custom \
--backup-vms=SRV-DC01 \
--backup-how=Hot \
--backup-id=Save1 \
--description="Save SRV-DC01 with XSIDiff" \
--exec=yes >> "/vmfs/volumes/Datastore1/xsi-dir/var/logs/xsibackup.log"

log:

---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:39| ###############################################################################
2019-02-28T11:06:39| XSIBACKUP-PRO 11.2.3: new execution request
2019-02-28T11:06:39| ###############################################################################
2019-02-28T11:06:39|
2019-02-28T11:06:39| NOTICE: (c) XSIBackup kills any user launched jobs, make sure you don't overlap manual jobs
---------------------------------------------------------------------------------------------------------------------------------
XSIBackup PID: 2270620 localhost
Thu, 28 Feb 2019 11:06:39 +0000 IPv4: 192.168.95.5/255.255.255.0
VMware ESXi 6.7.0 build-10302608 (c) Rsync 3.1.0 as opt. dependency
---------------------------------------------------------------------------------------------------------------------------------
Backup Id: save1 Intel(R) Xeon(R) CPU E3-1230 v5 @ 3.40GHz
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:40| Backup description: Save all VMs with XSIDiff
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:40| Message: crontab is installed for user root
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:40| ADVICE: no SSD disks, please consider adding an SSD cache disk to improve performance
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:40| Backup user is: root
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:40| Backup program is: xsidiff
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:41| Remote OpenSSH version is: 7.7
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:41| Negotiated Cipher (server->client): aes128-ctr
2019-02-28T11:06:41| Negotiated Cipher (client->server): aes128-ctr
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:41| Service OpenSSH ready at server 192.168.95.66:22
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:42| Remote ESXi version is 6.7.0
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:42| Info: remote XSIBACKUP-PRO install dir has been set by means of the --remote-xsipath argument
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:43| Remote xsi path set to: /vmfs/volumes/5c6a9988-90463b0c-53b8-f8bc1252ec2a/xsi-dir (filesystem: VMFS-6)
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:44| Mirroring to server 192.168.95.66 port 22
2019-02-28T11:06:44| Checking Rsync exists on the other side...
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:45| (c)Rsync (samba.org) found at [ 192.168.95.66:22:/vmfs/volumes/5c6a9988-90463b0c-53b8-f8bc1252ec2... ]
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:46| (c)XSIDiff found at [ 192.168.95.66:22:/vmfs/volumes/5c6a9988-90463b0c-53b8-f8bc1252ec2a/xsi-dir/... ]
---------------------------------------------------------------------------------------------------------------------------------
E-mail Warnings
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:46| The e-mail report will not be sent because of the followig reasons:
2019-02-28T11:06:46| The --mail-from string has not been set
2019-02-28T11:06:46| The --smtp-srv string has not been set
2019-02-28T11:06:46| The --smtp-port string has not been set
2019-02-28T11:06:46| The --smtp-usr string has not been set, you need --smtp-usr if --smtp-auth is other than -none-
2019-02-28T11:06:46| The --smtp-pwd string has not been set, you need --smtp-pwd if --smtp-auth is other than -none-
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:47| Getting list of all VMs...
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:47| 1 SRV-DC01 [Datastore2] SRV-DC01/SRV-DC01.vmx windows8Server64Guest vmx-14
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:47| VMs to backup:
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:47| 1 SRV-DC01 [Datastore2] SRV-DC01/SRV-DC01.vmx windows8Server64Guest vmx-14
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:49| Calculating sizes...
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:50| [SRV-DC01] Starting backup (size is 1285572M on 1285572M file)
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:50| XSIBackup will backup your VMs while they are running, so that users can continue to use the VM
2019-02-28T11:06:50| while the backup is taking place. You can also run --backup-how=cold|warm
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:50| Hot backup selected for VM: [SRV-DC01], will not be switched off
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:50| [SRV-DC01] info: boot partition is MBR
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:50| [SRV-DC01] info: Win64 OS (windows8Server64) detected on MBR, applying Windows algorithm
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:51| Removing snapshots, please wait...
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:52| Syncronizing config files
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:54| [SRV-DC01] info: created dir to host VM backup
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:54| [SRV-DC01] info: VMX file succesfully queued
2019-02-28T11:06:55| [SRV-DC01] info: VMSD file succesfully queued
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:55| [SRV-DC01] info: VMXF file succesfully queued
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:56| [SRV-DC01] info: NVRAM file succesfully queued
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:56| [SRV-DC01] info: VMWare Tools detected, taking snapshot QUIESCED(false)...
2019-02-28T11:06:56| [SRV-DC01] info: set argument --snapshot=doquiesce to quiesce your VMs
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:13| Backing up virtual disks...
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:13| DISK=/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-000001-sesparse.vmdk
2019-02-28T11:07:13| DISK=/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-000001.vmdk
2019-02-28T11:07:13| DISK=/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-Snapshot6.vmsn
2019-02-28T11:07:13| DISK=/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01.vmdk
2019-02-28T11:07:13| DISK=/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1-000001-sesparse.vmdk
2019-02-28T11:07:13| DISK=/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1-000001.vmdk
2019-02-28T11:07:13| DISK=/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1.vmdk
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:13| Disk [/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-000001-sesparse.vmdk] excluded
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:13| Disk [/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-000001.vmdk] excluded
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:14| Rsync file transfer (1st)
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:14| From: /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-Snapshot6.vmsn
2019-02-28T11:07:14| To: /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-Snapshot6.vmsn
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
SRV-DC01-Snapshot6.vmsn

32,737 100% 0.00kB/s 0:00:00
32,737 100% 0.00kB/s 0:00:00 (xfr#1, to-chk=0/1)

sent 32,851 bytes received 35 bytes 21,924.00 bytes/sec
total size is 32,737 speedup is 1.00
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:16| Rsync file transfer (1st)
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:16| From: /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01.vmdk
2019-02-28T11:07:16| To: /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01.vmdk
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
SRV-DC01.vmdk

617 100% 0.00kB/s 0:00:00
617 100% 0.00kB/s 0:00:00 (xfr#1, to-chk=0/1)

sent 721 bytes received 35 bytes 1,512.00 bytes/sec
total size is 617 speedup is 0.82
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:17| Info: transfering file | /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-flat.vmdk
---------------------------------------------------------------------------------------------------------------------------------
[32m(c) XSIDiff 1.1.1.4 licensed:
[0mWriting to file /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-flat.vmdk
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:53:57| Disk [/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1-000001-sesparse.vmdk] excluded
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:53:57| Disk [/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1-000001.vmdk] excluded
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:53:58| Rsync file transfer (1st)
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:53:58| From: /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1.vmdk
2019-02-28T11:53:58| To: /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1.vmdk
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
SRV-DC01_1.vmdk

622 100% 0.00kB/s 0:00:00
622 100% 0.00kB/s 0:00:00 (xfr#1, to-chk=0/1)

sent 728 bytes received 35 bytes 508.67 bytes/sec
total size is 622 speedup is 0.82
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:54:00| Info: transfering file | /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1-flat.vmdk
---------------------------------------------------------------------------------------------------------------------------------
[32m(c) XSIDiff 1.1.1.4 licensed:
[0mWriting to file /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1-flat.vmdk

Time taken: 10802 seconds
Speed 92.58 mb/s
Overall speed 92.58 mb/s
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T14:54:02| Excluded disks removed from backup .vmx file
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T15:02:53| The ESXi configuration was saved to "192.168.95.66:22:/vmfs/volumes/Datastore2"
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T15:02:53| Backup finished
2019-02-28T15:02:53| Tip: no chained backups scheduled, set --on-success and/or --on-error arguments to chain a backup
---------------------------------------------------------------------------------------------------------------------------------

Dexxpo · 2019-02-28 23:06:12

More details

In my previous example SRV-DC01_1-flat.vmdk size in the Datastore2 is 1 024 001 024 KB
And in the VHD 607,54 / 976,56 GB

10802 seconds x 92.58 mb/s = 1 000 049 MB

It is for this reason that I said that XSIDiff has transferred all the blocks and not just the used blocks as I read here:
[url=https://33hops.com/xsidiff-vmware-esxi-file-replication.html]XSIDiff Product Page[/url]

I may have missed something

admin · 2019-03-02 16:23:50

--backup-prog=Xsidiff is not differential, --backup-prog=Onediff is indeed differential, as well as --backup-prog=Xsitools:z and --backup-prog=Rsync

Dexxpo · 2019-03-07 12:20:56

Thank you for your answer, I will study that

Forum ©XSIBackup: ©VMWare ©ESXi Backup Software

#1 2019-02-28 14:39:47

Replication VM over IP

#2 2019-02-28 23:06:12

Re: Replication VM over IP

#3 2019-03-02 16:23:50

Re: Replication VM over IP

#4 2019-03-07 12:20:56

Re: Replication VM over IP

Board footer