#1 2019-08-15 05:12:21

hebasto
Member
Registered: 2019-08-07
Posts: 15

XSITools fails to create backup repo

Using XSIBackup-PRO 11.2.8

vmware -v
VMware ESXi 6.0.0 build-2809209
/vmfs/volumes/datastore1/xsi-dir/xsibackup --backup-prog=xsitools:z --check-repo=yes --backup-point="/vmfs/volumes/datastore2/xsitools-repo-local" --backup-type="custom" --backup-vms="Abso_XSIBAK" --override=xsibakfilter

Some excerpts from the output:

Backup program is: xsitools
-------------------------------------------------------------------------------------------------------------------------------------------
--backup-point created at /vmfs/volumes/datastore2/xsitools-repo-local (filesystem: VMFS-5)
-------------------------------------------------------------------------------------------------------------------------------------------
WARNING: the </vmfs/volumes/datastore2/xsitools-repo-local> dir is not an XSITOOLS repo, it will be initialized
-------------------------------------------------------------------------------------------------------------------------------------------
...
VMs to backup:
-------------------------------------------------------------------------------------------------------------------------------------------
6      Abso_XSIBAK          [datastore1] Abso/Abso.vmx                 windows7Server64Guest   vmx-11              
-------------------------------------------------------------------------------------------------------------------------------------------
Calculating sizes...
-------------------------------------------------------------------------------------------------------------------------------------------
Needed room: 71 Gb.
Sparse size: 278 Gb.
Available room: 285 Gb.
-------------------------------------------------------------------------------------------------------------------------------------------
[Abso_XSIBAK] Starting backup (size is 73540M on 284706M file)
-------------------------------------------------------------------------------------------------------------------------------------------
XSIBackup will backup your VMs while they are running, so that users can continue to use the VM
while the backup is taking place. You can also run --backup-how=cold|warm
-------------------------------------------------------------------------------------------------------------------------------------------
Hot backup selected for VM: [Abso_XSIBAK], the VM is off though
-------------------------------------------------------------------------------------------------------------------------------------------
[Abso_XSIBAK] info: boot partition is MBR
-------------------------------------------------------------------------------------------------------------------------------------------
[Abso_XSIBAK] info: Win64 OS (windows7Server64) detected on MBR, applying Windows algorithm
-------------------------------------------------------------------------------------------------------------------------------------------
Removing snapshots, please wait...
-------------------------------------------------------------------------------------------------------------------------------------------
Syncronizing config files
-------------------------------------------------------------------------------------------------------------------------------------------
Backing up virtual disks...
-------------------------------------------------------------------------------------------------------------------------------------------
DISK=/vmfs/volumes/datastore1/Abso/Abso.vmdk
DISK=/vmfs/volumes/datastore1/Abso/Abso_1.vmdk
-------------------------------------------------------------------------------------------------------------------------------------------
(c) XSIDiff 1.1.1.4 licensed: 
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/datastore1/Abso/Abso.vmdk
Writing to file /vmfs/volumes/datastore2/xsitools-repo-local/20190814123307/Abso_XSIBAK/Abso.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 1.00 mb/s
Overall speed 0.00 mb/s
-------------------------------------------------------------------------------------------------------------------------------------------
Blocksize is 52428800 bytes
-------------------------------------------------------------------------------------------------------------------------------------------
Compression has been set
-------------------------------------------------------------------------------------------------------------------------------------------
Backing up via XSITools
-------------------------------------------------------------------------------------------------------------------------------------------
File name: Abso-flat.vmdk, File size: 191158550528
Block size: 52428800, Block count: 3647
Disk usage: 74902929408
-------------------------------------------------------------------------------------------------------------------------------------------
3647/3647 blocks | Processed 100%
Previous block count: 0
Current block count: 1476
-------------------------------------------------------------------------------------------------------------------------------------------
Time taken: 2832 seconds
Avg speed: 64 mb/s
-------------------------------------------------------------------------------------------------------------------------------------------
(c) XSIDiff 1.1.1.4 licensed: 
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/datastore1/Abso/Abso_1.vmdk
Writing to file /vmfs/volumes/datastore2/xsitools-repo-local/20190814123307/Abso_XSIBAK/Abso_1.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 1.00 mb/s
Overall speed 0.00 mb/s
-------------------------------------------------------------------------------------------------------------------------------------------
Blocksize is 52428800 bytes
-------------------------------------------------------------------------------------------------------------------------------------------
Compression has been set
-------------------------------------------------------------------------------------------------------------------------------------------
Backing up via XSITools
-------------------------------------------------------------------------------------------------------------------------------------------
File name: Abso_1-flat.vmdk, File size: 107377328128
Block size: 52428800, Block count: 2049
Disk usage: 2209349632
-------------------------------------------------------------------------------------------------------------------------------------------
2049/2049 blocks | Processed 100%
Previous block count: 1476
Current block count: 1550
-------------------------------------------------------------------------------------------------------------------------------------------
Time taken: 311 seconds
Avg speed: 329 mb/s
-------------------------------------------------------------------------------------------------------------------------------------------
</vmfs/volumes/datastore2/xsitools-repo-local/20190814123307/Abso_XSIBAK> is an (c)XSITools repo VM directory
-------------------------------------------------------------------------------------------------------------------------------------------
Checking XSITools Repo: 
-------------------------------------------------------------------------------------------------------------------------------------------
XSIBackup will only check the VM folder: /vmfs/volumes/datastore2/xsitools-repo-local/20190814123307/Abso_XSIBAK
This are the deduplicated data files to check:
-------------------------------------------------------------------------------------------------------------------------------------------
/vmfs/volumes/datastore2/xsitools-repo-local/20190814123307/Abso_XSIBAK/Abso-flat.vmdk
/vmfs/volumes/datastore2/xsitools-repo-local/20190814123307/Abso_XSIBAK/Abso_1-flat.vmdk
-------------------------------------------------------------------------------------------------------------------------------------------
1551/1551 blocks | Processed 100%
1 bad blocks detected
49886561f8e26ed5e2ae549897a28aaab44881bd
Block 49886561f8e26ed5e2ae549897a28aaab44881bd is missing
-------------------------------------------------------------------------------------------------------------------------------------------
The ESXi configuration was saved to "/vmfs/volumes/datastore2/xsitools-repo-local/20190814123307"
-------------------------------------------------------------------------------------------------------------------------------------------
Errors detected in backup, check logs
-------------------------------------------------------------------------------------------------------------------------------------------

The error "Block ... is missing" appears every time I try to backup VM with XSITools.

Also note that disk space has not decreased by 71 GB, as one might expect.

What am I doing wrong?

Offline

#2 2019-08-16 17:28:01

joergnestler
Member
Registered: 2019-03-28
Posts: 12

Re: XSITools fails to create backup repo

I am having the same issue with the missing Block. I am running on 11.2.7 and I tried to perform Hot and Warm Backup. It is still the same behaviour :-/

1 bad blocks detected
49886561f8e26ed5e2ae549897a28aaab44881bd
Block 49886561f8e26ed5e2ae549897a28aaab44881bd is missing

Any Ideas or news at this issue?

Offline

#3 2019-08-19 14:14:04

admin
Administrator
Registered: 2017-04-21
Posts: 1,370

Re: XSITools fails to create backup repo

We'll check that, it could be a bug. Nevertheless that is the SHA1 hash of a 50M block of zeros. So XSIBackup will rebuild the VM without issue.

dd if=/dev/zero bs=$(( 1024*1024 )) count=50 2>/dev/null | openssl sha1

Offline

#4 2019-08-20 05:37:33

hebasto
Member
Registered: 2019-08-07
Posts: 15

Re: XSITools fails to create backup repo

admin wrote:

So XSIBackup will rebuild the VM without issue.

Unfortunately, this is not the case. Restoring from a backup repo fails as well.
Let me remind that it seems XSITools does not write full copy to the repo at all (while creating the repo).

Offline

#5 2019-08-21 16:56:44

admin
Administrator
Registered: 2017-04-21
Posts: 1,370

Re: XSITools fails to create backup repo

We have been able to reproduce the error when checking individual map files. This is a bug only since zero blocks should not be checked, we'll fix it in next release.

Hebasto, it seems to be indeed copying every block to the repo.
Please especify what you mean by "Restoring from a backup repo fails as well"
Post the log from the restore or contact support, plain comments are not of great help.

Blocksize is 52428800 bytes
----------------------------------------------------------------------------------------------------------------------------------
Compression has been set
----------------------------------------------------------------------------------------------------------------------------------
Backing up via XSITools
----------------------------------------------------------------------------------------------------------------------------------
File name: Abso_1-flat.vmdk, File size: 107377328128
Block size: 52428800, Block count: 2049
Disk usage: 2209349632
-------------------------------------------------------------------------------------------------------------------------------------------
2049/2049 blocks | Processed 100%
Previous block count: 1476
Current block count: 1550
----------------------------------------------------------------------------------------------------------------------------------
Time taken: 311 seconds
Avg speed: 329 mb/s

Offline

#6 2019-08-21 17:19:04

admin
Administrator
Registered: 2017-04-21
Posts: 1,370

Re: XSITools fails to create backup repo

The exact cause of this bug is that the function getSha1Zero at around line 50 in the src/xsitools module is returning an empty string in some circumstances, still determining...

Thus, although the check of the SHA1 50M zero block (49886561f8e26ed5e2ae549897a28aaab44881bd) should be skipped, as zeros are not saved, it's existence is still being checked, returning the missing block information.

This is not a real problem, apart from the inconvenience of the wrong error itself.
Hebasto, if you can't restore backups contact support, yours is a different issue.

Offline

#7 2019-08-21 17:51:10

admin
Administrator
Registered: 2017-04-21
Posts: 1,370

Re: XSITools fails to create backup repo

This issue has been solved today, version 11.2.9 is already available to all Pro users. If you don't want to update everything, you may just overwrite the src/xsitools file to fix it. You may want to overwrite the src/version file to to update the version number.

Offline

#8 2019-09-14 12:19:35

hebasto
Member
Registered: 2019-08-07
Posts: 15

Re: XSITools fails to create backup repo

admin wrote:

This issue has been solved today, version 11.2.9 is already available to all Pro users.

It works with empty blocks as expected. Thanks.

Offline

Board footer