©XSIBackup-Free: Free Backup Software for ©VMWare ©ESXi

Forum ©XSIBackup: ©VMWare ©ESXi Backup Software


You are not logged in.

#1 2021-05-16 22:35:49

herrep
Member
From: Munich
Registered: 2019-07-08
Posts: 77

XSIBackup-DC --replica=cbt: --options=R appears to be without function

Hi,

when executing XSIBackup-DC 1.5.0.3 with action -replica=cbt for ctk-enabled VMs, --options=R appears to be without function.

This is the command I executed right after having enabled cbt for the VM named vm:

"/vmfs/volumes/hdd1/XSIBackup-DC/xsibackup" \
--replica=cbt \
"VMs(vm)" \
"root@nas:22:/volume1/backup" \
--options=R \
--exclude="data[-.].*vmdk" \
--check=full \
--quiesce \
--config-backup \
--mail-to="<mail-recipient>" \
--use-smtp="1" \
--description="replica hot" \
--backup-how=hot \
--remote-path="/usr/bin/xsibackup"

I would expect that the vmx file at the target disk contains a VM name that is appended by _XSIREP and that the replicated VM is registered at the ESXi host. In the past, I used a similar setup where XSIBackup-Pro OneDiff resulted in replicated VMs. The corresponding VM names were automatically appended by _XSIBAK and registered at the ESXi host. The only change was that I now use XSiBackup-DC instead of XSIBackup-Pro.

However, the expected behavior does not take place. The files of the VM get copied, but there is no registration and also not alteration of the replicated VM name with an appaended _XSIREP. The first run of the above-shown command shows the following output in xsibackup.log:


Performing --replica action
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
vm Hardware Version is: 14
-------------------------------------------------------------------------------------------------------------
All snapshots were removed, as vm is engaged in a CBT job
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: vm
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : vm (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
Remote target dir is empty, full sync will be performed
-------------------------------------------------------------------------------------------------------------
Virtual Machine: vm
-------------------------------------------------------------------------------------------------------------
Backup start date: 2021-05-16T22:15:32
-------------------------------------------------------------------------------------------------------------
2021-05-16 22:15:32 | Backing up 29 files, total size is 96.46 GB
-------------------------------------------------------------------------------------------------------------
    NUMBER	                                                   FILE             SIZE          PROGRESS
-------------------------------------------------------------------------------------------------------------
    1/29                                                         vm.vmx          3.45 KB    | Done   0.00%
-------------------------------------------------------------------------------------------------------------
    2/29                                      vm-flat.vmdk (CBT 1 full)         64.00 GB    | Done   0.00%
-------------------------------------------------------------------------------------------------------------
    3/29                                                        vm.vmdk        583.00 B     | Done  66.35%
-------------------------------------------------------------------------------------------------------------
    4/29                                                        vm.vmsd        540.00 B     | Done  66.35%
-------------------------------------------------------------------------------------------------------------
    5/29                                                       vm.nvram          8.48 KB    | Done  66.35%
-------------------------------------------------------------------------------------------------------------
    6/29                                                        vm.vmxf        150.00 B     | Done  66.35%
-------------------------------------------------------------------------------------------------------------
    7/29                                                     vm-aux.xml        142.00 B     | Done  66.35%
-------------------------------------------------------------------------------------------------------------
    8/29                                                 vmware-162.log        319.17 KB    | Done  66.35%
-------------------------------------------------------------------------------------------------------------
    9/29                                       vmx-vm-2040435808-2.vswp         94.00 MB    | Done  66.35%
-------------------------------------------------------------------------------------------------------------
   10/29                                                 vmware-161.log        244.02 KB    | Done  66.44%
-------------------------------------------------------------------------------------------------------------
   11/29                                                 vmware-163.log        382.70 KB    | Done  66.44%
-------------------------------------------------------------------------------------------------------------
   12/29	                                   vmx-vm-2040435808-1.vswp                    [open excluded]
-------------------------------------------------------------------------------------------------------------
   13/29                                                     vmware.log        220.79 KB    | Done  66.44%
-------------------------------------------------------------------------------------------------------------
   14/29                                                 vmware-164.log        237.37 KB    | Done  66.44%
-------------------------------------------------------------------------------------------------------------
   15/29	                                                 vm.vmx.lck                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   16/29                                                 vmware-165.log        254.22 KB    | Done  66.44%
-------------------------------------------------------------------------------------------------------------
   17/29                                                 vmware-166.log        438.32 KB    | Done  66.44%
-------------------------------------------------------------------------------------------------------------
   18/29                                                        vm.vmx~          3.44 KB    | Done  66.44%
-------------------------------------------------------------------------------------------------------------
   19/29                                            vm-flat.vmdk___hash         82.00 B     | Done  66.44%
-------------------------------------------------------------------------------------------------------------
   20/29	                                           vm-799e9460.vswp                    [open excluded]
-------------------------------------------------------------------------------------------------------------
   21/29	                                                vm-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   22/29                                                    vm.vmsd.tmp         45.00 B     | Done  66.44%
-------------------------------------------------------------------------------------------------------------
   23/29                                                     vm.vmx.tmp          3.44 KB    | Done  66.44%
-------------------------------------------------------------------------------------------------------------
   24/29                                            vm-Snapshot662.vmsn         28.25 KB    | Done  66.44%
-------------------------------------------------------------------------------------------------------------
   25/29                                                vm.vmdk.extents          8.63 KB    | Done  66.44%
-------------------------------------------------------------------------------------------------------------
   26/29	                                    vm-000001-sesparse.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   27/29	                                             vm-000001.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   28/29	                                         vm-000001-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   29/29                                     vm-quiesce_manifest662.xml        120.00 B     | Done  66.44%
-------------------------------------------------------------------------------------------------------------
Total size:                                                                     64.09 GB    | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
Backup end date: 2021-05-16T22:22:43
-------------------------------------------------------------------------------------------------------------
Time taken: 00:07:11 (431 sec.)
-------------------------------------------------------------------------------------------------------------
Total time:      431 sec.
-------------------------------------------------------------------------------------------------------------
Full file speed:	                                                                   152.28 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed:	                                                                   163.36 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed without errors
-------------------------------------------------------------------------------------------------------------

What needs to be done that _XSIREP is appended to the VM name of the replicated VM and that the replicated VM is registered?

Best regards,
Peter

Last edited by herrep (2021-05-17 09:44:05)

Offline

#2 2021-05-17 09:21:39

admin
Administrator
Registered: 2017-04-21
Posts: 1,821

Re: XSIBackup-DC --replica=cbt: --options=R appears to be without function

Please, provide both the full command and its associated output every time.
Just make sure that you have written a well formed job command any run the CBT replica again, you are just reporting a first full copy.

Offline

#3 2021-05-17 09:54:19

herrep
Member
From: Munich
Registered: 2019-07-08
Posts: 77

Re: XSIBackup-DC --replica=cbt: --options=R appears to be without function

The original post is now updated so that it also shows the full command in addition to the already provided xsibackup log output.

From the log output, the CBT cycles appear to work, as after a second and now a third run, I can see more or less the same output as for the first run, but instead of "CBT 1 full" I can see "CBT 3".

However, due to the use of --options=R I would expect that the replicated VM is registered under the name vm_XSIREP. But this does not happen although the ESXi host can access the backup directory (NFS mount). It already worked fine with XSIBackup-Pro. I can also not see that the replicated vm.vmx includes a VM name that has been appended by _XSIREP. It is still a copy of the original VM.

Offline

#4 2021-05-18 09:34:59

admin
Administrator
Registered: 2017-04-21
Posts: 1,821

Re: XSIBackup-DC --replica=cbt: --options=R appears to be without function

We'll revise that and continue the post

Offline

#5 2021-05-18 15:26:55

admin
Administrator
Registered: 2017-04-21
Posts: 1,821

Re: XSIBackup-DC --replica=cbt: --options=R appears to be without function

We can't reproduce your issue. Our local --replica=cbt VMs are indeed registered and can be switched on.
There are still some limitations that we will waive in next minor releases, like not being able to switch the _XSIREP VM on when you --exclude some disk, as the remains of the disk are still present in the replica .vmx file. We will need to add extra logic to remove those config lines in case of excludes.

Offline

#6 2021-05-18 15:49:19

herrep
Member
From: Munich
Registered: 2019-07-08
Posts: 77

Re: XSIBackup-DC --replica=cbt: --options=R appears to be without function

I understand that using --exclude might cause issues.  However, I already re-run the command on other VMs where I did not need to exclude anything so that I could omit --exclude.  So the issue does not appear to be related to the --exclude option.

As already reported, I had absolutely no issues with XSIBackup-Pro and --backup-prog=Onediff.  The replica were written, the display name in the replicated vmx file got appended by _XSIBAK and verything worked fine. The only change I applied was activating ctkEnable and using XSIBackup-DC 1.5.0.3.  Everything else remained untouched.

Please let me know whether I can provide any further log files.

Offline

#7 2021-05-19 11:01:49

admin
Administrator
Registered: 2017-04-21
Posts: 1,821

Re: XSIBackup-DC --replica=cbt: --options=R appears to be without function

We aren't saying that using --exclude will cause issues. We are saying that it's not compatible with --options=R, which a different thing.
We can't introduce comparisons with other editions that have nothing to do with the issue. We know how Pro worked, still it's different software.

What we are stating is that we have revised the software and that we are indeed getting an _XSIREP replica with no issue and that we can't reproduce your problem.

So, please, simplify your job to the extreme, remove any unnecessary options and add --options=R at the end of the job from the command line.

Offline

#8 2021-05-19 12:30:32

herrep
Member
From: Munich
Registered: 2019-07-08
Posts: 77

Re: XSIBackup-DC --replica=cbt: --options=R appears to be without function

In the mean time, I simplified the backup command as follows:

"/vmfs/volumes/hdd/XSIBackup-DC/xsibackup" \
--replica=cbt \
"VMs(ups-vm)" \
"root@nas:22:/volume1/backup" \
--options=R

Prior to backup, I emptied the vm directory at the target. However, the result was unchanged. The backup as such was reported as successful, but when analyzing the replicated vmx-file, I noticed that it is still unchanged, i.e. no _XSIREP appended. There is also no registration on the ESXi host. Here is the xsibackup.log:

|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
|||   (c)XSIBackup-DC 1.5.0.3: Backup & Replication Software                    |||
|||   (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved    |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
                   (c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 6 Major 7 Minor 0 Patch 0
-------------------------------------------------------------------------------------------------------------
License: 000306E40000000000000000d89d67195a68 | (c)XSIBackup-DC
-------------------------------------------------------------------------------------------------------------
Remote system: Linux
-------------------------------------------------------------------------------------------------------------
PID: 34570689, Running job as: root
-------------------------------------------------------------------------------------------------------------
Remote xsibackup binary found at: /bin/xsibackup
-------------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC replicating data to /volume1/backup
-------------------------------------------------------------------------------------------------------------
Performing --replica action
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
ups-vm Hardware Version is: 14
-------------------------------------------------------------------------------------------------------------
All snapshots were removed, as ups-vm is engaged in a CBT job
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: ups-vm
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : ups-vm (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
Virtual Machine: ups-vm
-------------------------------------------------------------------------------------------------------------
Backup start date: 2021-05-19T11:34:43
-------------------------------------------------------------------------------------------------------------
2021-05-19 11:34:43 | Backing up 26 files, total size is 11.20 GB
-------------------------------------------------------------------------------------------------------------
    NUMBER	                                                   FILE             SIZE          PROGRESS
-------------------------------------------------------------------------------------------------------------
    1/26                                               ups-vm.vmx          2.86 KB    | Done   0.00%
-------------------------------------------------------------------------------------------------------------
    2/26                                ups-vm-flat.vmdk (CBT 17)         10.00 GB    | Done   0.00%
-------------------------------------------------------------------------------------------------------------
::: detail ::: 100.00% done | block 10240 out of 10240                                      | Done  89.27%
-------------------------------------------------------------------------------------------------------------
    3/26                                              ups-vm.vmdk        596.00 B     | Done  89.27%
-------------------------------------------------------------------------------------------------------------
    4/26                                              ups-vm.vmsd        455.00 B     | Done  89.27%
-------------------------------------------------------------------------------------------------------------
    5/26                                           ups-vm-aux.xml         13.00 B     | Done  89.27%
-------------------------------------------------------------------------------------------------------------
    6/26	                     vmx-ups-vm-1802602466-2.vswp                    [open excluded]
-------------------------------------------------------------------------------------------------------------
    7/26	                                   ups-vm.vmx.lck                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
    8/26                                                 vmware-617.log        219.98 KB    | Done  89.27%
-------------------------------------------------------------------------------------------------------------
    9/26                                                 vmware-618.log        263.72 KB    | Done  89.27%
-------------------------------------------------------------------------------------------------------------
   10/26                                             ups-vm.nvram          8.48 KB    | Done  89.27%
-------------------------------------------------------------------------------------------------------------
   11/26                                                 vmware-619.log        223.89 KB    | Done  89.27%
-------------------------------------------------------------------------------------------------------------
   12/26                                  ups-vm-flat.vmdk___hash         82.00 B     | Done  89.27%
-------------------------------------------------------------------------------------------------------------
   13/26                                                     vmware.log        333.84 KB    | Done  89.27%
-------------------------------------------------------------------------------------------------------------
   14/26                                              ups-vm.vmx~          2.85 KB    | Done  89.28%
-------------------------------------------------------------------------------------------------------------
   15/26                                          ups-vm.vmsd.tmp         45.00 B     | Done  89.28%
-------------------------------------------------------------------------------------------------------------
   16/26                                           ups-vm.vmx.tmp          2.85 KB    | Done  89.28%
-------------------------------------------------------------------------------------------------------------
   17/26                                                 vmware-614.log        220.84 KB    | Done  89.28%
-------------------------------------------------------------------------------------------------------------
   18/26                                                 vmware-616.log        358.92 KB    | Done  89.28%
-------------------------------------------------------------------------------------------------------------
   19/26                                                 vmware-615.log        220.83 KB    | Done  89.28%
-------------------------------------------------------------------------------------------------------------
   20/26	                             ups-vm-6b7187e2.vswp                    [open excluded]
-------------------------------------------------------------------------------------------------------------
   21/26                             vmx-ups-vm-1802602466-1.vswp         80.00 MB    | Done  89.28%
-------------------------------------------------------------------------------------------------------------
   22/26	                                  ups-vm-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   23/26                                  ups-vm-Snapshot536.vmsn         19.48 KB    | Done  89.98%
-------------------------------------------------------------------------------------------------------------
   24/26	                      ups-vm-000001-sesparse.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   25/26	                               ups-vm-000001.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   26/26	                           ups-vm-000001-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
Total size:                                                                     10.08 GB    | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
Backup end date: 2021-05-19T11:35:37
-------------------------------------------------------------------------------------------------------------
Time taken: 00:00:54 (54 sec.)
-------------------------------------------------------------------------------------------------------------
Total time:       54 sec.
-------------------------------------------------------------------------------------------------------------
Full file speed:	                                                                   191.15 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed:	                                                                   104.84 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed without errors
-------------------------------------------------------------------------------------------------------------
Final checksum: 110351964 bytes were sent and confirmed to have been written remotely
-------------------------------------------------------------------------------------------------------------
Data processing completed successfully
-------------------------------------------------------------------------------------------------------------
Removed host <tmp> dir        OK
-------------------------------------------------------------------------------------------------------------
Removed prog <tmp> dir        OK
-------------------------------------------------------------------------------------------------------------
Unlocked backup               OK
-------------------------------------------------------------------------------------------------------------

After this test, I run --reset-cbt, deleted the directory of that vm at the target and started again. Besides that now a CBT 1 full cycle was started, I had the same result of no changed vm name and no registration.

As the xsibackup.log is entirely silent about what is going on, is there any option to increase verbosity to see what is indeed happening?

Offline

#9 2021-05-19 15:23:04

admin
Administrator
Registered: 2017-04-21
Posts: 1,821

Re: XSIBackup-DC --replica=cbt: --options=R appears to be without function

What a conundrum!
It has to be something really simple.
We'll increase verbosity on that part, which BTW is quite trivial from a programmatic point of view.

Offline

#10 2021-05-19 17:52:59

admin
Administrator
Registered: 2017-04-21
Posts: 1,821

Re: XSIBackup-DC --replica=cbt: --options=R appears to be without function

OMG!, we just realized that you aren't backing up to an (c)ESXi server, but some sort of NAS.
How do you expect a VM to be registered in a NAS device?
This is just an imaginary issue.

Offline

#11 2021-09-25 20:43:33

herrep
Member
From: Munich
Registered: 2019-07-08
Posts: 77

Re: XSIBackup-DC --replica=cbt: --options=R appears to be without function

I got the point that a backup destination specified on a remote host having no ESXi functionality cannot lead to a registration of a replicated VM. However, in my setup, the backup destination is also accessible as an NFS drive at the ESXi host.

Of course, I continued in the present case by replacing the remote destination by a local path which results in storing the replicated VM on the same location as previously, but with the ability of being registered afterwards. Now I wonder whether there is a way of optimizing this setup.

I would prefer transferring the VM data via the remote path with xsibackup remotely executed on the NAS. And then, once the data are over there, I would like to register the replicated VM, but of course over the local path. Would this be somehow possible, e.g. bei running --options=R separately or whatever?

Or would this be a new feature request resulting in an option to specify the local path?

Offline

#12 2021-09-26 11:33:09

admin
Administrator
Registered: 2017-04-21
Posts: 1,821

Re: XSIBackup-DC --replica=cbt: --options=R appears to be without function

It's all simpler than that.
You want to register the VM to some (c)ESXi host?: no problem.
Replicate to some (c)ESXi host that has the NFS volume attached to it as a datastore.

Offline

#13 2021-09-26 12:59:12

herrep
Member
From: Munich
Registered: 2019-07-08
Posts: 77

Re: XSIBackup-DC --replica=cbt: --options=R appears to be without function

If I understood you correctly, you suggest to replicate the VM to the NAS by addressing the NAS destination by its NFS volume that is configured as datastore at the local ESXi host. This is exactly what I did.

However, my question was a kind of optimization: I understand that using xsibackup remotely on the NAS reduces load on the ESXi host so that a replication using the remote address of the NAS would increase performance.  Therefore, my question arose whether it would be possible to use the remote address for the copy part and as soon as --options=R will result in VM registration, a local path of the NFS volume is specified so that the remotely stored VM will nevertheless be registered at the local ESXi host.

Offline

#14 2021-09-26 16:16:18

admin
Administrator
Registered: 2017-04-21
Posts: 1,821

Re: XSIBackup-DC --replica=cbt: --options=R appears to be without function

You have to make too many assumptions to achieve that. You depend on the NAS type, not all Linux distros/flavours use compatible shells. We don't see it feasible. That should be left to an implementation development from part of the client, as it would be highly dependent on the set up.

Offline

#15 2021-09-27 12:27:40

herrep
Member
From: Munich
Registered: 2019-07-08
Posts: 77

Re: XSIBackup-DC --replica=cbt: --options=R appears to be without function

I believe that there is still some room for discussion with regard to --options=R (registration) in conjunction with a remote path. I will describe the situation in a new post so that we can close the thread here.

Offline

Board footer