©XSIBackup-Free: Free Backup Software for ©VMWare ©ESXi

Forum ©XSIBackup: ©VMWare ©ESXi Backup Software


You are not logged in.

#851 Re: General matters » CLVMKFS1 error: Failed to clone disk: File too large (1769481)(SOLVED) » 2020-05-17 09:52:32

Maybe that disk was created with an older version of ESXi and has not yet been cloned to a more recent format?
It could also be corrupt. Clone it manually using vmkfstools and reattach it to the VM.

vmkfstools -i olddisk.vmdk newdisk.vmdk -d thin

#852 (c)XSIBackup-Pro & Free Classic bug tracker » (c)XSIBackup-DC does not clean temp folders after a backup » 2020-05-17 09:45:55

admin
Replies: 0

This is a bug detected in latest DC version, it will be solved in next release 1.3.0.0
To work this bug around, please add

rm -rf /scratch/XSI/XSIBackup-DC/tmp/*

at the end of your backup jobs

#853 Re: General matters » xsibackup doesn't cleanup tmp folder » 2020-05-17 09:44:37

This bug will be solved in next version 1.3.0.0, sorry about the inconvenience.

#854 Re: General matters » Error: skipping, not able to retrieve VM information » 2020-05-17 09:43:15

The exact reason for this error is that (c)XSIBackup can't get a list of the files compounding the VM to, in turn, calculate their size. The most likely cause is that there is some unsupported character in some path or that some file was edited externally and the original encoding was lost. Check the .vmx file with vi or a simple cat command:

cat JUTFEFSE0101.vmx | grep vmdk

To make sure that all paths are  O.K.
Also delete any eventually existing snapshot before trying again.

#855 Re: © OneDiff » Try OneDiff before purchase? » 2020-05-17 09:33:31

Onediff is included in (c)XSIBackup-Free
It just lacks the checksum comparison after integrating the diff data present in Pro version, which is a must have for enterprise use, but you may use it in Free version as well.

#856 Re: General matters » will and will not backup ESXi 6.7U3 » 2020-05-09 18:26:41

Persistent disks can be backed up using the --backup-how=warm option, RDM disks can't be backed up.

#857 Re: General matters » will and will not backup ESXi 6.7U3 » 2020-05-06 14:12:33

[b](c)XSIBackup-Free[/b] does not include some advanced features. If you can afford to stop the VM for a minute, just perform a [b]--backup-how=warm[/b] backup.

#858 Re: © OneDiff » error DIFQMSH4: first 500M mistmatch » 2020-05-06 14:09:47

Of course, if you try to quiesce a guest that can't be quiesced, or that is returning errors when trying to do so, you may get some undesired side effects. Please check whether the guest needs quiescing, only a database server which is active at the time to perform the backup will need so, and remove --snapshot=doquiesce if it doesn't need it.

#859 Re: General matters » Business model » 2020-05-05 15:36:24

Thank you for your feedback, but if we change the license model to a per VM basis, I believe many of our clients will be mad at you.
We may change the freemium model in the future, but we honestly don't try to please everybody.

We are a small company and need every cent we get out of our work, we believe to offer a good product at an unbeateable price and -over all- our products work in a transparent way: no propietary data models, standard protocols, no hidden "surprises".

#860 Re: General matters » Thin disk ? » 2020-05-05 15:26:38

That doesn't matter to (c)XSIBackup-DC, it will handle sparse thin or thick disks.

#861 Re: © OneDiff » error DIFQMSH4: first 500M mistmatch » 2020-05-05 15:24:01

You may suffer from disk metadata corruption, this is quite frequent in big NTFS disks which aren't defragmented when needed..

We don’t say so because we heard or read about it somewhere, but because we have some cases like yours per year against not a single file system level data corruption so far since 2013 on ext3, ext4, or XFS file systems (Linux).

Now, what to do?

First run this command on your .vmdk disk:

vmkfstools –t0 /path/to/the/disk.vmdk

Don’t try to look for the command in vmkfstools help, it’s undocumented.
You should get a list of extents. In Linux FSs this list is rather small. On Windows FSs it can become extremely long. This is due to data fragmentation in the Windows guest, especially since many sysadmins don’t defragment there Windows guest’s file systems until they are broken.

Apart from that aligning FSs in the virtualization stack can become rather important too in terms of performance.
[url=https://www.boche.net/blog/2009/03/20/storage-block-size-and-alignment/]A must read post on virtualization storage block alignment[/url]

So, getting back to the matter.
You will probably find lines like this in your extent list.

[ 2174627086336:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2175163957248:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2175700828160:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2176237699072:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2176774569984:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2177311440896:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2177848311808:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2178385182720:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2178922053632:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2179458924544:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2179995795456:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2180532666368:   536870912] --> [NOMP -- :(           0 -->    536870912)]

Those are dead extents pointing nowhere in the physical disk, “dark matter”.
Clone your disk with vmkfstools (all of them), repeat the –t0 command and chek whether the dead extent information disappeared, then reattach them to the VM.

©XSIBackup can’t warn you about that cause it’s one reality level below what it can see. It just believes your disks are O.K. so long as ESXi believes it.

#862 Re: © XSITools » CPERROR2 error: (c) XSIDiff 2.0.0.0 not licensed (20.00 GB limit) » 2020-05-05 15:15:52

You just need to pick the right one. Check your MAC with the script and select the one begining by the MAC address.

#863 Re: General matters » xsibackup doesn't cleanup tmp folder » 2020-04-29 15:53:12

If [b](c)XSIBackup-DC[/b] is installed in the [b]/scratchXSI/XSIBackup-DC[/b] default location, why does your job point to some xsibackup binary in a different place:

/vmfs/volumes/xxx/xsi/xsibackup

The job also points to some xsibackup.log file in a different place.

>> /vmfs/volumes/xxx/xsi/var/log/xsibackup.log 2>&1

#864 Re: © OneDiff » error DIFQMSH4: first 500M mistmatch » 2020-04-29 15:47:17

You are getting this mismatch on both disks, thus it seems that for some reason read data on the destination is not the same as on the source DS.

This could be due to read errors on the backup disk, try to backup to some alternative destination.

What kind of NFS server are you using?

#865 Re: © XSITools » CPERROR2 error: (c) XSIDiff 2.0.0.0 not licensed (20.00 GB limit) » 2020-04-29 15:40:41

Delete the request.key file, let a new one be generated and upload it to get a new license.key file. Then contact support to remove the old license file to free the slot in the user area.

#866 Re: General matters » Backup retention » 2020-04-27 18:37:34

There are built-in ways to rotate your backups, by size [b]--backup-room[/b] (recommended) and by number of backups [b]--del-dirs[/b].

[url=https://33hops.com/xsibackup-help-man-page.html]Please read the (c)XSIBackup Classic man page[/url]

#867 Re: © OneDiff » error DIFQMSH4: first 500M mistmatch » 2020-04-27 18:35:00

Your problem has nothing to do with XSIBackup, but with the virtual disk. First thing we would do is switching the server off and rebooting it after some seconds off. In case this doesn't help, clone the disk with vmkfstools, be careful not to clone it to thick in case it's thin.

Run

vmkfstools -i /path/to/your/in-disk.vmdk /path/to/your/out-disk.vmdk -d thin

Then use the output disk instead of the original one and see if this helps the problem.

#868 Re: General matters » Copying between different ESXi versions? » 2020-04-27 18:29:36

Yes, you can, just as long you keep the least common denominator, namely, as you stated: the hardware version the lower ESXi can run.
Nonetheless you will hit dificult issues to solve when trying to move data over an SSH tunnel that connects from some OpenSSH version to a much lower one, as many of the ciphers have been deprecated and newer OpenSSL versions include security features that some older ones won't have.

Thus, why complicating your life and try to do such cumbersome thing, which in the end you might very well not solve, when you can upgrade the old ESXi box.

#869 Re: General matters » Backup starts before old backup ends » 2020-04-21 14:56:44

As with any other Linux binary, you may need to clean up memory by using ps command and kill -9 on any eventual ghost process.
This should be exceptional of course, just as long as you set things up in a proper way.

Waiting for a job to finish is the opposite approach that we took, it would generate more uncertainties, as the lag would be propagated forward.

Just as long as you just chain jobs in a classic Linux style, you will be safe from overlapping jobs:

i.e.:
File: /scratch/XSI/XSIBackup-Pro/etc/jobs/700

Content:

[b]Example 1[/b]: you run jobs one after another, no matter what happens

/scratch/XSI/XSIBackup-Pro/etc/jobs/001
/scratch/XSI/XSIBackup-Pro/etc/jobs/002

[b]Example 2[/b]: second job runs in case the first suceeds

/scratch/XSI/XSIBackup-Pro/etc/jobs/001 & \
/scratch/XSI/XSIBackup-Pro/etc/jobs/002

#870 Re: General matters » Backup starts before old backup ends » 2020-04-21 14:21:34

Yes, absolutely. XSIBackup-DC client can't run multiple jobs at the same time and if you execute a new job when some other is still running the previous one will be killed. Concurrent backups are a terrible idea that can only lead to clogging the hardware.

You can easily serialize your jobs by coalescing them into a file, i.e.:

File: /scratch/XSI/XSIBackup-Pro/etc/jobs/700

Content:
/scratch/XSI/XSIBackup-Pro/etc/jobs/001
/scratch/XSI/XSIBackup-Pro/etc/jobs/002

#871 Re: General matters » VMware ESXi 7 problem » 2020-04-21 14:13:55

Well, we would be careful and not use XSIBackup on [b]ESXi 7.0.0[/b] ultil we announce compatibility, as per our initial tests ESXi 7.0.0 locks the [b]-flat.vmdk[/b] files.

As per our tests, backups performed by means of the [b]--backup-prog=Vmkfstools[/b] backup program will run just fine. All other backup programs will just not work on [b]ESXi 7.0.0[/b]

#872 Re: General matters » XSIBackup more and more tmp directories » 2020-04-14 20:44:45

It isn't a big deal just as long as everything else is working fine. What FS are you using to save your backup repos?, do not use VMFS, it is not optimized to store deduplicated repos, use some ext4 or XFS over IP if possible or attached through NFS.

#873 Re: General matters » VMware ESXi 7 problem » 2020-04-12 11:06:09

Edit the code and enable at your own risk. What ESXi version are you planning to use?.

#874 Re: General matters » XSIBackup more and more tmp directories » 2020-04-12 11:05:06

They are genarally wiped by the clean up routine. Should you run some tests, interrupt execution or receive some segfault, they might remain in there. You can safely delete anything inside the tmp dirs except while some job is running.

#875 Re: General matters » --backup-room not removing old backups, crazy read on free space » 2020-04-09 12:13:00

You should not be using [b]--backup-prog=xsitools[/b] with [b]©XSIBackup-Free[/b], it is a test feature which will not allow to restore backups unless you buy [b]©XSIBackup-Pro[/b], use some other backup program instead, we recommend that you use [b]--backup-prog=Vmkfstools[/b]

Board footer