©XSIBackup-Free: Free Backup Software for ©VMWare ©ESXi

Forum ©XSIBackup: ©VMWare ©ESXi Backup Software


You are not logged in.

#776 Re: General matters » Problem with parameter --backup-prog=Vmkfstools » 2020-07-08 17:03:09

[b](c)XSIBackup-Pro[/b] is not compatible with [b](c)ESXi 7.0.0[/b]. This is due to some drastic changes that have been introduced in ESXi 7 from part of VMWare. We will reorganize our software offer this summer to use the DC line of development, which is far more advanced and this way we will offer compatibility with ESXi 7 on Free, Pro and DC

#777 Re: Repositories » Expected behavior of delta backup and speed » 2020-07-07 18:19:52

You are then playing in a mayor league. Fast NVMe, more RAM and 10GB NICs are a must in your case.

#778 Re: General matters » Feature request: More stats in email report » 2020-07-07 18:17:08

We'll take this into account, thank you for your feedback.

#779 Re: General matters » Repository or Vmdk native file » 2020-07-06 19:01:59

As clearly stated in the manual, the [b]--remote-path[/b] argument must point to the remote xsibackup binary, you are pointing it to a dir.

You are using a different user than root. Unless you are willing to go through configuring a different user to be used on the remote backup server, we recommend that you stick to root user.

You must make sure that the user you are passing in your backup command has all the neccessary rights to perform all the actions a backup job must perform on the remote end.

In your case, the [b]study[/b] user needs write permissions on the [b]/etc/xsi[/b] folder. Of course it must also have full permissions on the folder you are storing your backups to.

Configuring some other user different than root is not a trivial task, you need to take into account permissions on all files and dirs implied in the backup or replica.

#780 Re: Repositories » Expected behavior of delta backup and speed » 2020-07-05 14:28:54

That's 575.00GB of real data (non zeros) per hour. Not bad, an average of 164.00 MB/s
It could be considerably faster if you used faster disks/controller

[b](c)XSIBackup-DC[/b] can jump over zeros, thus, if you backup a VM which is 4.00TB in size but only contains, let's say 20.00GB, it will be backed up really fast, as zeros will be ignored and from the second pass the 20GB will be traversed at read speed.

If your VM contains 4,6 TB of real data, nothing is going to keep you from having to walk through every byte. Most of the data will most probably not have changed, thus your effective speed on a [b](c)XSIBackup-DC[/b] backup will be close to the read speed you can achieve, as SHA-1 calculations are RAM fast even with a modest Intel CPU. That should yield over 200.00MB/S on enterprise grade HDs and about twice that on enterprise grade SSDs or NVMe, M2, ...

As you say (c)OneDiff can be much faster in this case, but you must not forget some facts: (c)OnedIff depends on the differential snapshot being integrated in the remote VM, that requires some ESXi host to replicate data. Apart from that, the integration of the snapshot may fail depending on the ESXi host conditions, while [b](c)XSIBackup-DC[/b] differential feature is completely independent of the target system. As [b](c)XSIBackup-DC[/b] walks through every byte, you can be sure that the resulting VM will be consistent, no matter what happens with the backup snapshot.

Apart from that, [b](c)XSIBackup-DC[/b] will only be sending data when it detects some block that has changed, thus, although it may take 8 h. to complete, all that it's doing most of the time is to read data.

#781 Re: Repositories » --rotate clarification » 2020-07-05 14:17:00

It is very simple, [b]--rotate[/b] deletes anything older than the number of backups to keep in the repository you are working on, regardless of where you run it from.

#782 Re: General matters » Backup stuck » 2020-07-01 14:10:52

If you interrupt an XSITools:z backup, you will generate half written block manifests at the YYYYMMDDhhmmss timestamped directory, thus you should remove that folder. When you do that you will leave some orphan blocks (blocks which were only present in the backup that was halted). This is not crucial, as will only occupy some MBs and they will be pruned next time you prune the repository.

To check a repository at any time:

./xsibackup --check-xsitoolsrepo=/path/to/repo

#783 Re: General matters » Backup stuck » 2020-07-01 11:16:22

You said to have already stopped it.
The only way to stop a process is through Linux signalling:

kill -9 PID # To stop it immediately
kill -15 PID # to request a gentle shutdown

As (c)XSIBackup just reads data, you may stop it forcefully, the backup won't be good though.

#784 Re: General matters » Fails to create snapshot even though it reports success » 2020-07-01 11:13:26

That doesn't mean anything, the snapshot could be failing due to some heavy load during the backup per instance, or some missing software in the guest, like VMWare Tools, or even some faulty service that causes the snapshot request to time out.

You should check the guest's logs more than the ESXi host itself when you have this kind of issue.

#785 Re: General matters » Backup stuck » 2020-07-01 11:09:46

You published this URL in your first post:

/vmfs/volumes/DATASTORE1/XSIBACKUPPRO/XSIBackup-Pro/jobs/1

Which shows some job named "1" instead of "001"

Your log shows that the program halted, you may be low of memory or be experiencing some network problem.
Try to look for some possible cause in the logs of your ESXi host and the backup host too.

#786 Re: General matters » SIGTERM (13) condition - Receiver can't evaluate ? as a local path » 2020-07-01 11:06:59

If your file names and paths are orthodox in naming, then you are losing packets beyond what TCP can handle.

You may use WinMTR to have an insight into what might be going on:
[url=https://sourceforge.net/projects/winmtr/files/]WinMTR Home Page[/url]

Or use some more classic tool such as ping and/ or tcpdump

A regular ping can offer some insight, pay attention to whether some packet is lost and also wht's the jitter, the difference between the largest and the lowest ping times.

You will need to perform the tests while you are backing up, sometimes it's a poorly written driver that could be causing the problems, nevertheless it could be any network element.

#787 Re: General matters » Fails to create snapshot even though it reports success » 2020-07-01 10:47:41

There's been errors related to snapshots in Windows since ever. Now in more recent versions of ESXi and Windows the problems not only didn't cease, but they seem to have managed to create a bunch of new ones.

[url=https://kb.vmware.com/s/article/71130]Unable to take quiesced snapshot in Windows guest[/url]
[url=https://kb.vmware.com/s/article/60395]Windows Server 2019 snapshot error[/url]

Whatever is holding the file, it is outside the guest.
What type of Datastore are you using?
It might not be a cluster lock that you are experiencing.

#788 Re: General matters » Backup stuck » 2020-07-01 10:41:44

Please, do not name jobs outside its naming scheme 000-999

Depending on the amount of data you are storing, rotating data can take a long time.
You should inspect what's going on in the log before actually killing the process:

tail -f /scratch/XSI/XSIBackup-Pro/var/logs/xsibackup.log

#789 Re: General matters » SIGTERM (13) condition - Receiver can't evaluate ? as a local path » 2020-07-01 10:38:22

Well, it's clear that the server is receiving file names which are ackward and they are breaking regexp path integrity rules on the server side, which is in turn causing the server to drop the tunnel.

You aren't showing the name of the files you are trying to backup, maybe you need some name + path cleaning.

Another possibility is that some packets are lost due to an unstable link and the server drops the connection when it receives some unformatted garbage. There are previous checks to path not matching though.

#790 Re: General matters » Fails to create snapshot even though it reports success » 2020-07-01 10:30:03

Is that file in a cluster?, is it being open by some other process?
What kind of DS is it residing in?
Something is clearly holding it at the time to backup.
What type of guest OS are you running?.

#791 Re: © OneDiff » OneDiff error performing second backup » 2020-07-01 10:27:15

To perform a Onediff backup you need to meet some basic requirements:

- The VMFS version must be coherent between the servers, you can't Onediff from VMFS5 to VMFS6 per instance.
- The target ESXi system must support the HW version of the VM you are replicating, which doesn't seem to be an issue in this case.

Apart from that, checking the disks via checksum may throw an insight into the state of your disks.

[url]https://33hops.com/xsibackup-disk-checksum-verification-silent-corruption.html[/url]

#792 Re: General matters » --prune and --info local only? » 2020-06-28 14:24:43

--prune does indeed work on remote repositories, it is an internal feature though, we will change that message.

#793 Re: General matters » Fails to create snapshot even though it reports success » 2020-06-28 14:23:10

There isn't any sign that the snapshot is failing to be taken. Can you see something denoting that in the ESXi log?
Nonetheless the -flat.vmdk file does indeed seem to be blocked.

Check whether there is some .lck file on the flat file from some previous interrupted process and delete it manually should it exist.

#794 Re: General matters » Scheduled Backups » 2020-06-28 12:55:49

Yes, that is for the Free edition too.
What do installation dir and backup point have to do with the crontab?

#795 Re: Bugs » Closing restore window does not stop samba » 2020-06-28 12:53:40

It's still in an early development stage, there might be some bugs or inconsistencies between some messages and the real behaviour.

#796 Re: General matters » --prune and --info local only? » 2020-06-28 12:51:52

Yes, they are local options.
Only --backup and --replica arguments need to be licensed to work without restrictions.

#797 Re: General matters » VM exclusion list » 2020-06-28 12:50:26

Use the [b][url=https://33hops.com/xsibackup-dc-full-manual-home.html#disable-vmotion]--disable-vmotion[/url][/b] argument.

#798 Re: Repositories » Additional commands » 2020-06-24 18:40:55

Current Pro version does have that feature.
We thought of adding it to the DC binary, nonetheless we want to keep it as compact and fast as possible, so that kind of functionality will probably be added to the GUI, so that the main binary remains small and fast.

#799 Re: Repositories » Additional commands » 2020-06-24 14:29:43

Isn't that similar to?:

ls -la /some/repository

1.4.0.0 will include a GUI that will be conceptually different to that in Pro. Pro's GUI was ment to work through some sort of wizard, but that concept is probably twisting the GUI too much. New DC's GUI will be cleaner and more straight.

#800 Re: General matters » Show elapsed time on restore » 2020-06-24 14:26:13

Yes, you are right, we'll add it in next main release 1.4.0.0

Board footer