#1 2018-03-13 22:44:02

wowbagger
Member
Registered: 2017-05-11
Posts: 23

xsitools snapshot VM's are stored outside data folder

Hi,

I'm using:

"/vmfs/volumes/datastore1/xsi-dir/xsibackup" \
--time="Mon 01:20|Tue 01:20|Wed 01:20|Thu 01:20|Fri 01:20|Sat 01:20|Sun 01:20" \
--backup-prog=xsitools:z \
--backup-point="/vmfs/volumes/XSI_BACKUP/server-xsitools/$(date +%Y%m'00000000')" \
--backup-type=all \
--mail-from=mail@mail.com \
--mail-to=mail@mail.com \
--subject=Full-Daily-Backup-server \
--smtp-srv=xxx.xxx.x.x \
--smtp-port=25 \
--smtp-auth=none \
--smtp-usr=any \
--smtp-pwd=any \
--check-repo=yes \
--debug-info=yes

The time stamped directories contain auxiliary files for VM's without a snapshot and are very small but for VM's that have a snapshot the delta.vmdk snapshot file is also stored in the time stamped folder and not in the deduplicated data folder. I removed all my unnecessary snapshots from the VM's in ESXi and with the next xsibackup run I presume the delta files will no longer be in the timestamped directories.

Is there an option I can remove the -delta.vdmk files from the timestamped directories as they take up space.

Thanks!

Offline

#2 2018-03-14 08:00:31

admin
Administrator
Registered: 2017-04-21
Posts: 1,369

Re: xsitools snapshot VM's are stored outside data folder

No there isn't any way and I would not do that if you appreciate your data, just let XSITools do it's job.

Offline

#3 2018-03-14 13:14:52

wowbagger
Member
Registered: 2017-05-11
Posts: 23

Re: xsitools snapshot VM's are stored outside data folder

These are the sizes:

du -sh /storage/NFS_VOL1/ESXPR1-xsitools/20180300000000/*
36G    /storage/NFS_VOL1/ESXPR1-xsitools/20180300000000/20180311160351
32G    /storage/NFS_VOL1/ESXPR1-xsitools/20180300000000/20180312124803
37G    /storage/NFS_VOL1/ESXPR1-xsitools/20180300000000/20180312135003
37G    /storage/NFS_VOL1/ESXPR1-xsitools/20180300000000/20180313012003
36G    /storage/NFS_VOL1/ESXPR1-xsitools/20180300000000/20180314012003
485G    /storage/NFS_VOL1/ESXPR1-xsitools/20180300000000/data

The delta files are not deduplicated into data with just an placeholder file containing the hashes like for the regular vmdk files so the backup folder grows significantly each run even with no change in the delta.vmdk file for an offline VM.

The md5sum of the ESX delta.vmdk files are the same as the files that xsitools backs up every day. They do not change.
So instead of deduplicating it is actually 1:1 replicating those same files every day for every backup.

Last edited by wowbagger (2018-03-14 13:29:14)

Offline

#4 2018-03-14 18:42:09

admin
Administrator
Registered: 2017-04-21
Posts: 1,369

Re: xsitools snapshot VM's are stored outside data folder

We know that, it's a current XSITools limitation that will be improved in future versions. By now, if you want to limit the size of XSITools repositories, you should not backup VMs containing big snapshots.

Production machines don't usually work on top of snapshots, except if they are engaged in a OneDiff chain per instance. If for whatever reason your VM needs to keep big files of this kind, just make a regular backup (vmkfstools or onediff) and then archive the resulting VM with XSITools.
https://33hops.com/xsibackup-pro-onedif … olicy.html

If you need your backup to contain the snapshots as they are in the original VM, then use --backup-prog=xsidiff

Offline

Board footer