Registered users
Linkedin Twitter Google+
Close

In order to improve user's experience and to enable some functionalities by tracking the user accross the website, this website uses its own cookies and from third parties, like Google Analytics and other similar activity tracking software. Read the Privacy Policy
33HOPS, IT Consultants Download XSIBackup
33HOPS ::: Proveedores de Soluciones Informáticas :: Madrid :+34 91 930 98 66Avda. Castilla la Mancha, 95 - local posterior - 28700 S.S. de los Reyes - MADRID33HOPS, Sistemas de Informacion y Redes, S.L.Info

How to backup ©ESXi huge virtual machines

Preparing the ©ESXi hypervisor, checklist.

Download Download latest edition of ©XSIBackup-Free here

©XSIBackup has been designed with full unsigned 64 bit number support for sizes and offsets, thus, the theoretical limits for a VM are way beyond what's plausible today: around 18 Exabytes. Still, there are functions that have to deal with metadata, indexes, etc..., thus, the real practical VM size ©XSIBackup is able to handle is more in the order of some tenths of terabytes, probably more, just as long as you have some adequate server hosting the VM.

Even if you have a massive amount of RAM a mighty CPU and fast disks, you will still need to pay attention to some other things, before being able to successfully backup a 20 TB VM, just to put it down into some concrete figure.

Seagate Ironwolf 18TB One of the weakest points of ©ESXi is the default /tmp dir, which is limited to some 255 MB. Enough for VMs which are some hundreds of gigabytes in size, yet not enough for multiterabyte VMs.

As already stated in some previous posts, and as you can directly infer by just taking a look at any of the VM file manifests: .blocklog file or .map files for virtual machine constituent files: each block metainformation file takes the SHA-1 has plus the semicolon separator plus tipically 7 to 8 bytes for the block size column. We can round it up to 50 bytes per block approximately.

Thus, if you are backing up a 20 TB virtual machine using the default block size of 1 MB, you are going to need some 1 GB just to store the VM block data. Clearly the default /tmp folder is going to be insufficient for the task. If you just ignore reality and you try to backup such a VM without any previous preparation, you are going to hit some SEGFAULT condition or, at best, some clear message stating that you run out of space.

Managing a 20 TB server is not something you can overlook and pretend everything should just work out of the box. ©XSIBackup utilizes a .conf file which you normally don't edit. In this case scenario, you will need to edit it, but before doing it, you will need to provide the physical means to store the temporal data.

Any storage device with enough space will do it, still: in this case scenario you are administering a huge server, you must dedicate some appropriate means to keep it working right. Using an M.2 fast NVME device would be a great way to provide the additional temp space required to hold the meta-data, indexes and logs, making sure that things work fluently enough. You don't need this disk to be that big, a small 240 GB one would be more than enough.

Editing the xsibackup.conf file

Once you have your new fast disk installed, you just need to add it to the ©ESXi host through the Storage Management menu. It will finally appear as some new datastore, you could call it /vmfs/volumes/tmp-disk or any other way you like.

Now edit the etc/xsibackup.conf file, you will see something like this:


Although as per version 1.4.3.12 there is a variable called alt_tmp_dir, you should not edit this paths. The secondary tmp dir is by default associated to the installation root (/scratch/XSI/XSIBackup-DC).

(*) Newer versions will allow to edit the secondary temp dir directly, this will be announced in the change log and the xsibackup.conf file.

Apart from that, the /scratch partition where ©XSIBackup is installed by default has a default size of 4 GB, which is generally enough even for big VMs.

It is the pri_tmp_dir variable that we must focus our attention on first. As we have used the name /tmp-disk for our new fast datastore, we will just use some folder inside this DS and change the pri_tmp_dir var to:

pri_tmp_dir=/vmfs/volumes/tmp-disk/tmp1

We should create the folder first to make sure that it is available.

Now we have a big primary tmp dir which is at the same time fast enough to handle temporal files easily.

This page was last modified on 2021-03-02



Website Map
Resources & help
33HOPS Forum
Index of Docs

©33HOPS site relies on the following technologies and partners:
SSL Protocol PayPal Payment Gateway Stripe Payment Gateway

©33HOPS Sistemas de Información y Redes, S.L. | VAT No: ESB83583716 | Avda. Castilla la Mancha, 95, local posterior, 28701 San Sebastián e los Reyes (Madrid) Spain



Fill in to download
The download link will be sent to your e-mail.
Name
Lastname
E-mail


            Read our Privacy Policy

(*) DC & Pro users, please login to your user area to download