Registered users
Linkedin Twitter Facebook Google+
  This website uses its own cookies or from third parties Close
33HOPS, IT Consultants
33HOPS ::: Proveedores de Soluciones Informáticas :: Madrid :+34 91 663 6085Avda. Castilla la Mancha, 95 - local posterior - 28700 S.S. de los Reyes - MADRID33HOPS, Sistemas de Informacion y Redes, S.L.Info

<< Return to index

How to use OneDiff and still keep a historic set of backups.

© OneDiff is a good way to backup your VMs over a narrower network, like a WAN. Narrower does not mean a 33 kbps modem link, but a data link wide enough to move the amount of data you need in a reasonable time. Those are relative terms, and it's you who must decide and calculate what you need.

As © OneDiff only copies the changed bytes since last backup, most of the times you'll be able to keep your VMs mirrored to an offsite location in some minutes. Nevertheless, keeping a mirrored copy is not enough, why?, because in case something goes wrong with your data in the production VM, you'll be mirroring the problem to the other end. So, what to do?, you need a way to keep a set of backups on the other end, so that you can move in time to a date when your data was intact. The wider your retention policy is, the better. Take on account that sometimes problems do not show up instantly, so you may need to move back in time one week to recover your OS properly. I'm putting it in the worst of the cases to make it clear.

© XSIBACKUP-PRO is flexible enough to offer you resources to cover this need. © OneDiff allows you to sync changed blocks, and © XSITools allows to store deduplicated compressed VMs. Let's see how to accomplish this.

First thing to do is to prepare a © OneDiff backup job and add it to the xsibackup-cron file, you have probably already done this.

O.K., this will make a OneDiff backup and inform you about its state once it has been completed. You should be familiarized with this type of backup job at this point, so we won't delve into it now.

Now you need a way to chain an © XSITools backup on the other end once this first stage of the process is over. © XSIBACKUP-PRO allows to fire remote backup commands so that they are executed on another server via the --host flag. Thus we can add the following line to our backup logic:

Let's see the details:

--host=, will make the current command be executed in the remote host with IP where the © OneDiff backup was stored by means of the previous command. You need to have previously linked the current server to the remote ESXi box, via the --link-srv command.

--backup-prog=xsitools:z, here you set © XSITools as the program to be used to do an incremental backup. Note that :z has been appended to the xsitools keyword. This is recommended, you should always use it, as it reduces the backup by an average of 50% and does not affect backup speed.

--backup-point="/vmfs/volumes/NAS03/xsit-$( date +'%Y-%m')", the backup point argument contains the path to the NAS03 device, mounted as a datastore with a dinamic folder name as the last storage dir that will create folders such as xsit-2017-05. If you use dynamic folders, new © XSITools repositories will be created as the calendar rolls.

--override=xsibakfilter, this argument will allow you to backup a © OneDiff backup directly, which is, by default, filtered out from the VM listing and thus ignored.

If everything has been set correctly, the first backup job will perform a © OneDiff backup to the server with IP, where a mirrored copy will be created after each backup cycle, ending in_XSIBAK. Once this first backup job has finished, the --on-error and --on-success arguments, set to execute the backup with backupid 02 will fire it, no matter what the exit status of the first job is. It's a must to try all backup jobs in the command line before adding them to the xsibackup-cron file.

The second backup job will perform a © XSITools backup to the --backup-point="/vmfs/volumes/NAS03/xsit-$( date +'%Y-%m')" folder, where the VM will be appended to the previously stored backups. © XSITools is capable to store a huge amount of data, thus you should be able to store many backups in your repository. In any case, you should read all the © XSITools documentation and set some limits to prevent your repository from growing unlimitedly, in this example we used a dynamic folder to limit repositories in time.

We have chosen © XSITools as the tool to archive our © OneDiff backup, but there are various option available:

• Borg Backup: a good option if you have access to your Borg server within a gigabit LAN.

• XSINAS: same as Borg Backup. It has the advantage of offering a real time inline deduplicated FS, the drawback is that it is more resource hungry than Borg, it's less efficient and the backup speed will degrade as the FS fills.

• XSITools: it's probably your best bet. It's lightweight, it offers de-duplication, you can store your backups in a VMFS volume or in any other FS available through your NAS and can store a lot of data. Its weakest point is that the de-duplication technology used is less efficient than that of Borg Backup due mainly to its much bigger block size, still it multiplies your available backup room.

Daniel J. García Fidalgo

Website Map
IT Manager
In Site
Resources & help
Index of Docs
33HOPS Forum

Fill in to download
The download link will be sent to your e-mail.

            Read our Privacy Policy