#1 2019-02-28 14:39:47

Dexxpo
Member
Registered: 2019-02-28
Posts: 3

Replication VM over IP

Hello everyone,

I'm trying to replicate my virtual machine on my 2nd ESXi and I want to do a few daily replications.

I currently have 2 problems:

     1- My job defined with the XSIDiff option launched the first time does not seem to work because the unused blocks are copied. And the second replication is again a full synchronization and not a differential backup.

      Why does my job use RSYNC and not XSIDiff? How can I check if my license is correctly applied (I already check esxcfg-vmknic -l)?


     2- A snapshot is generated at the beginning of the job and automatically deletes it at the end. But during the remove task, the VM is really slow and can not be used.

     Is it possible to make a differential replication without snapshot?



Thank you in advance for your help


My job:
"/vmfs/volumes/Datastore1/xsi-dir/xsibackup" \
--backup-prog=XSIDiff \
--backup-point=192.168.95.66:22:"/vmfs/volumes/Datastore2" \
--remote-xsipath=/vmfs/volumes/5c6a9988-90463b0c-53b8-f8bc1252ec2a/xsi-dir \
--backup-type=custom \
--backup-vms=SRV-DC01 \
--backup-how=Hot \
--backup-id=Save1 \
--description="Save SRV-DC01 with XSIDiff" \
--exec=yes >> "/vmfs/volumes/Datastore1/xsi-dir/var/logs/xsibackup.log"


log:

---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:39|  ###############################################################################
2019-02-28T11:06:39|     XSIBACKUP-PRO 11.2.3: new execution request                     
2019-02-28T11:06:39|  ###############################################################################
2019-02-28T11:06:39| 
2019-02-28T11:06:39|  NOTICE: (c) XSIBackup kills any user launched jobs, make sure you don't overlap manual jobs
---------------------------------------------------------------------------------------------------------------------------------
XSIBackup PID:          2270620                                                       localhost
Thu, 28 Feb 2019 11:06:39 +0000                                IPv4: 192.168.95.5/255.255.255.0
VMware ESXi 6.7.0 build-10302608                              (c) Rsync 3.1.0 as opt. dependency
---------------------------------------------------------------------------------------------------------------------------------
Backup Id:                save1                       Intel(R) Xeon(R) CPU E3-1230 v5 @ 3.40GHz
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:40|  Backup description: Save all VMs with XSIDiff
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:40|  Message: crontab is installed for user root
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:40|  ADVICE: no SSD disks, please consider adding an SSD cache disk to improve performance
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:40|  Backup user is: root
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:40|  Backup program is: xsidiff
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:41|  Remote OpenSSH version is: 7.7
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:41|  Negotiated Cipher (server->client): aes128-ctr
2019-02-28T11:06:41|  Negotiated Cipher (client->server): aes128-ctr
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:41|  Service OpenSSH ready at server 192.168.95.66:22
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:42|  Remote ESXi version is 6.7.0
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:42|  Info: remote XSIBACKUP-PRO install dir has been set by means of the --remote-xsipath argument
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:43|  Remote xsi path set to: /vmfs/volumes/5c6a9988-90463b0c-53b8-f8bc1252ec2a/xsi-dir (filesystem: VMFS-6)
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:44|  Mirroring to server 192.168.95.66 port 22
2019-02-28T11:06:44|  Checking Rsync exists on the other side...
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:45|  (c)Rsync (samba.org) found at [ 192.168.95.66:22:/vmfs/volumes/5c6a9988-90463b0c-53b8-f8bc1252ec2... ]
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:46|  (c)XSIDiff found at [ 192.168.95.66:22:/vmfs/volumes/5c6a9988-90463b0c-53b8-f8bc1252ec2a/xsi-dir/... ]
---------------------------------------------------------------------------------------------------------------------------------
E-mail Warnings
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:46|  The e-mail report will not be sent because of the followig reasons:
2019-02-28T11:06:46|  The --mail-from string has not been set
2019-02-28T11:06:46|  The --smtp-srv string has not been set
2019-02-28T11:06:46|  The --smtp-port string has not been set
2019-02-28T11:06:46|  The --smtp-usr string has not been set, you need --smtp-usr if --smtp-auth is other than -none-
2019-02-28T11:06:46|  The --smtp-pwd string has not been set, you need --smtp-pwd if --smtp-auth is other than -none-
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:47|  Getting list of all VMs...
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:47|  1      SRV-DC01   [Datastore2] SRV-DC01/SRV-DC01.vmx   windows8Server64Guest   vmx-14             
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:47|  VMs to backup:
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:47|  1      SRV-DC01   [Datastore2] SRV-DC01/SRV-DC01.vmx   windows8Server64Guest   vmx-14             
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:49|  Calculating sizes...
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:50|  [SRV-DC01] Starting backup (size is 1285572M on 1285572M file)
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:50|  XSIBackup will backup your VMs while they are running, so that users can continue to use the VM
2019-02-28T11:06:50|  while the backup is taking place. You can also run --backup-how=cold|warm
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:50|  Hot backup selected for VM: [SRV-DC01], will not be switched off
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:50|  [SRV-DC01] info: boot partition is MBR
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:50|  [SRV-DC01] info: Win64 OS (windows8Server64) detected on MBR, applying Windows algorithm
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:51|  Removing snapshots, please wait...
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:52|  Syncronizing config files
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:54|  [SRV-DC01] info: created dir to host VM backup
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:54|  [SRV-DC01] info: VMX file succesfully queued
2019-02-28T11:06:55|  [SRV-DC01] info: VMSD file succesfully queued
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:55|  [SRV-DC01] info: VMXF file succesfully queued
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:56|  [SRV-DC01] info: NVRAM file succesfully queued
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:06:56|  [SRV-DC01] info: VMWare Tools detected, taking snapshot QUIESCED(false)...
2019-02-28T11:06:56|  [SRV-DC01] info: set argument --snapshot=doquiesce to quiesce your VMs
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:13|  Backing up virtual disks...
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:13|  DISK=/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-000001-sesparse.vmdk
2019-02-28T11:07:13|  DISK=/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-000001.vmdk
2019-02-28T11:07:13|  DISK=/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-Snapshot6.vmsn
2019-02-28T11:07:13|  DISK=/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01.vmdk
2019-02-28T11:07:13|  DISK=/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1-000001-sesparse.vmdk
2019-02-28T11:07:13|  DISK=/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1-000001.vmdk
2019-02-28T11:07:13|  DISK=/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1.vmdk
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:13|  Disk [/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-000001-sesparse.vmdk] excluded
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:13|  Disk [/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-000001.vmdk] excluded
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:14|  Rsync file transfer (1st)
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:14|  From: /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-Snapshot6.vmsn
2019-02-28T11:07:14|  To: /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-Snapshot6.vmsn
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
SRV-DC01-Snapshot6.vmsn

         32,737 100%    0.00kB/s    0:00:00 
         32,737 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/1)

sent 32,851 bytes  received 35 bytes  21,924.00 bytes/sec
total size is 32,737  speedup is 1.00
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:16|  Rsync file transfer (1st)
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:16|  From: /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01.vmdk
2019-02-28T11:07:16|  To: /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01.vmdk
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
SRV-DC01.vmdk

            617 100%    0.00kB/s    0:00:00 
            617 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/1)

sent 721 bytes  received 35 bytes  1,512.00 bytes/sec
total size is 617  speedup is 0.82
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:07:17|  Info: transfering file | /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-flat.vmdk
---------------------------------------------------------------------------------------------------------------------------------
[32m(c) XSIDiff 1.1.1.4 licensed:
[0mWriting to file /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01-flat.vmdk
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:53:57|  Disk [/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1-000001-sesparse.vmdk] excluded
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:53:57|  Disk [/vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1-000001.vmdk] excluded
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:53:58|  Rsync file transfer (1st)
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:53:58|  From: /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1.vmdk
2019-02-28T11:53:58|  To: /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1.vmdk
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
SRV-DC01_1.vmdk

            622 100%    0.00kB/s    0:00:00 
            622 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/1)

sent 728 bytes  received 35 bytes  508.67 bytes/sec
total size is 622  speedup is 0.82
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T11:54:00|  Info: transfering file | /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1-flat.vmdk
---------------------------------------------------------------------------------------------------------------------------------
[32m(c) XSIDiff 1.1.1.4 licensed:
[0mWriting to file /vmfs/volumes/Datastore2/SRV-DC01/SRV-DC01_1-flat.vmdk

Time taken: 10802 seconds
Speed 92.58 mb/s
Overall speed 92.58 mb/s
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T14:54:02|  Excluded disks removed from backup .vmx file
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T15:02:53|  The ESXi configuration was saved to "192.168.95.66:22:/vmfs/volumes/Datastore2"
---------------------------------------------------------------------------------------------------------------------------------
2019-02-28T15:02:53|  Backup finished
2019-02-28T15:02:53|  Tip: no chained backups scheduled, set --on-success and/or --on-error arguments to chain a backup
---------------------------------------------------------------------------------------------------------------------------------

Offline

#2 2019-02-28 23:06:12

Dexxpo
Member
Registered: 2019-02-28
Posts: 3

Re: Replication VM over IP

More details smile

In my previous example SRV-DC01_1-flat.vmdk size in the Datastore2 is 1 024 001 024 KB
And in the VHD 607,54 / 976,56 GB

10802 seconds x 92.58 mb/s = 1 000 049 MB

It is for this reason that I said that XSIDiff has transferred all the blocks and not just the used blocks as I read here:
https://33hops.com/xsidiff-vmware-esxi- … ation.html


I may have missed something sad

Offline

#3 2019-03-02 16:23:50

admin
Administrator
Registered: 2017-04-21
Posts: 1,362

Re: Replication VM over IP

--backup-prog=Xsidiff is not differential, --backup-prog=Onediff is indeed differential, as well as --backup-prog=Xsitools:z and --backup-prog=Rsync

Offline

#4 2019-03-07 12:20:56

Dexxpo
Member
Registered: 2019-02-28
Posts: 3

Re: Replication VM over IP

Thank you for your answer, I will study that smile

Offline

Board footer