©XSIBackup-Free: Free Backup Software for ©VMWare ©ESXi

Forum ©XSIBackup: ©VMWare ©ESXi Backup Software


You are not logged in.

#101 Re: General matters » network overview use XSIBackup » 2022-10-10 10:28:14

(c)XSIBackup-DC is indeed compatible with ©ESXi 7.0. Version 7.0 has been some kind of transition version though launched amidst profound changes in (c)VMWare which have undoubtedly affected the development of the software. In fact version 8.0 is already there.

The main change in v. 7 affecting backups is that the data can't be read from the -flat.vmdk disks, as they are blocked (even for reading) while the VM is on. This makes it necessary to read the data from the SCSI device, which adds an additional level of complexity.

Also, for the same reason you can't keep snapshots in your VMs as opposed to earlier versions. ALL snapshots are removed when using (c)ESXi 7.0

You seem to be a cautious user, that plays on your side, as many people tend to upgrade software as it is released and thus they unwittingly become the Caesar's food tasters.

As always, there is a good rule of thumb to know if the time to upgrade has come. Make your self some questions loud:

- Do I need some of the new features?
- Will the new feature/s compensate for the work and the risks (closer to 0 in virtualized environments) derived from an upgrade.

If you think you can obtain an advantage from one of the new features, like the ones having to do with Kubernettes integration that will compensate the work done to upgrade, then do upgrade.

[url=https://www.techtarget.com/searchvmware/tip/Top-10-new-vSphere-70-features]New (c)ESXi 7.0 features[/url]

#102 Re: General matters » XSIBACKUP-FREE 11.2.9 slow NFS backup speed » 2022-10-05 11:51:37

Backups made to local storage are always much slower than over IP backups. Reading, hashing and compression must be done with a single core as the (c)ESXi shell is limited that way. By using an IP backup host you allow the load to be distributed among the two ends.

If you need more speed than with (c)XSIBackup Classic, use new [b][url=https://33hops.com/xsibackup-vmware-esxi-backup.html](c)XSIBackup-DC[/url][/b]. It is a C monolithic binary and it offers native support for [b][url=https://kb.vmware.com/s/article/1020128]CBT[/url][/b] (Changed Block Tracking) technology.

Still, even by using our latest edition, backups made over IP will be much faster than local backups.

#103 Re: General matters » VMWare ESXi: error code 131 | trapped SIGTERM (13) » 2022-10-05 11:42:56

Thank you for your feedback.
Since version 1.5.2.0 integration with Linux is somewhat trivial. You just need to exchange keys with the remote host via the [b][url=https://33hops.com/xsibackup-dc-full-manual-home.html#add-key]--add-key[/url][/b] argument and the rest is done automatically.

Wait till we launch (c)XSIBackup 1.6.0.0, the improvement in speed will be remarkable, it will more than double previous 1.5 banch speed by using multiple threads simultaneously.

#104 Re: General matters » From old free to licensed PRO-issue with GUI TARGET » 2022-09-14 10:05:17

It is not a bug. Note that you are trying to convert the root of a volume into an (c)XSIBackup repository. Please, just add some folder below the data store, something like: /vmfs/volumes/datastore1/my-repo

We will still revise this behaviour in the GUI before our next release.

#105 Re: General matters » From old free to licensed PRO-issue with GUI TARGET » 2022-09-05 12:06:40

We believe you are having trouble understanding how the Dialog nCurses GUI works. Use the space bar to select a dir and the slash "/" to list the contents in a dir, then the space bar again to select a directory.

The GUI will help you to increase your productivity building jobs, nonetheless you should understand the command line and try your jobs there. Appending the --save-job=NNN argument at the end of the job will save it formatted to the etc/jobs folder.

#106 Re: General matters » It looks like you are trying to backup to the root of an (c)ESXi DS » 2022-09-05 12:01:36

Yes, we have indeed changed the command line arguments. We redesigned the concept from scratch, thus we took the chance to improve the arguments' syntax. Still the concept is the same.

Just take a look at the new [b][url=https://33hops.com/xsibackup-dc-full-manual-home.html]XSIBackup Man Page[/url][/b]. The main thing to take on account is that the three first arguments have a fixed order: action, source & target.

#107 Re: General matters » path to .xsitools is empty » 2022-08-08 11:13:01

Please, next time publish the full output, so that we can have as many details as possible. The header contains valuable information such as (c)ESXi and (c)XSIBackup versions, file system, free space, CPU, available RAM, etc...

The key in this case is this piece of info:

Source is a file: VMs(newmirrors)

You get that message when (c)XSIBackup detects that there exists one folder/file by the name passed as the second argument: [b]VMs(newmirrors)[/b].

Thus, there must be some folder/file named "VMs(newmirrors)" relative to xsibackup binary that was maybe created by some previous wrong attempt to test the job.

It could be somewhere else if the working dir is not the main (c)XSIBackup installation dir.

#108 Re: General matters » Backup hangs » 2022-07-25 09:54:59

We are lacking important information at the header of the job: (c)XSIBackup version, (c)ESXi version, remote OS, free space, etc...

All we know is that your TTY freezes at different points in time: 85%, 93%.... We don't think using VMs(ALL) or a custom selection has anything to do as the SSH tunnel is created in exactly the same way with the very same parameters, there is no difference at all.

The fact that no error is printed out makes this even spookier. Please revise free space in your local volumes.

df -h
vdf -h

And the load on your systems, both ESXi and remote

esxtop # ESXi box
top # Linux backend

Plus any errors in your remote backup server a.b.c.d

tail -n30 /var/log/xsi/error.log
tail -n30 /home/remoteuser/.xsi/var/log/error.log

(*) Depending on the (c)XSIBackup version your error.log file will be at different locations.

You may need to revise the remote OpenSSH log for some more clues, should the problem not be related to some more obvious matter.

Also check that you didn't run out of memory, although this could only happen in some versions of (c)ESXi with huge VMs.
Read this post on the subject and run the command to check your memory load.

[url]https://33hops.com/vmware-esxi-memory-constrains-and-workarounds.html[/url]

If you are using the Free version, make sure you aren't trying to backup something which exceeds its limits, Although in that case you should simply receive a message.

#109 Re: General matters » Backup hangs » 2022-07-24 17:50:51

Can you share the output?
If it contains sensible data or you prefer not to post it contact us at Support.

#110 Re: General matters » From old free to licensed PRO-issue with GUI TARGET » 2022-07-22 09:00:36

Please, note that current (c)XSIBackup edition is new software and although it resembles the Classic version and follows the same working principles, it is indeed new software with different arguments and syntax. Nonetheless, if you are used to (c)XSIBackup-Classic, getting adapted to new (c)XSIBackup will be fairly simple.

[url=/xsibackup-dc-full-manual-home.html](c)XSIBackup Manual[/url]

You should remove any older version of our software and any previously configured cron entries to avoid conflicts, i.e. running multiple jobs at the same time.

You are receiving that message because you are trying to set some target outside /vmfs/volumes/ which is the root all local datastores should stem from. Select a dir by using the space bar and list contents inside of it by appending a slash "/"

#111 Re: General matters » Transfer VMs across DataCenters » 2022-07-06 10:44:05

Well, there isn't any specific guide so far. To transfer VMs from one datacenter to another, just make the target server available to the source server via SSH, exchange keys and transfer the VMs, that's all there is to it.

You should take into account that as latency increases, the effective bandwidths will be reduced as an effect of the very TCP protocol nature and small TCP windows. Nonetheless, you should still keep a viable bandwidth, even for big vms, when latency keeps below 30-40 ms.

[url]https://33hops.com/vmware-esxi-ssh-scp-throughput-limitations.html[/url]

Of course, once you have completed the first transfer, (c)VMWare's CBT technology will take care to minimize the data transferred as only changed blocks will be sent.

#112 Re: General matters » --backup over ssh replacing default base64 which breaks apt update » 2022-06-29 09:29:03

[url]https://33hops.com/xsibackup-datacenter-change-log.html[/url]

#113 Re: General matters » --backup over ssh replacing default base64 which breaks apt update » 2022-06-28 11:43:56

Thank you for your feedback, we will sort this around by naming (c)XSIBackup's base64 binary in a different way (xsib64), so that it doesn't create any conflict.

#114 (c)XSIBackup-Pro & DC bug tracker » Non CBT VM makes other CBT backups in same job to trow errors » 2022-06-17 09:15:25

admin
Replies: 0

Version 1.5.1.17
To be fixed in 1.5.2.0

When a VM which is CBT enabled has some missing -ctk.vmdk file, the backup will throw errors for the rest of the CBT enabled VMs even if they are correctly configured for CBT.

Workaround:
Split non CBT VMs in a different backup job

#115 Re: General Matters » Questions about this product » 2022-06-13 17:31:04

We'll investigate that. There's always a chance that something is mispelled or that some weird character is printed to the job file.

#116 Re: General matters » Backups to FreeNAS » 2022-06-13 17:29:14

(c)XSIBackup is designed to work on a Linux/(c)ESXi backend. We can't support exotic combinations. FreeBSD is not Linux.
If we allowed your choice, why not Windows WLS?, or Android or MAC.

#117 Re: General Matters » Questions about this product » 2022-06-09 18:16:33

[quote=mikeg]My two outstanding questions are:

1) What is the best way to only keep a certain number of the last available backups automatically?
2) The backup jobs to the nfs share are not storing the host config to the cfgbak folder even though that option has been added.[/quote]

Please, read the manual and the related articles and posts before posting questions.

On rotation:

[url=https://33hops.com/xsibackup-dc-full-manual-home.html#rotate]--rotate argument in the (c)XSIBackup Man Page[/url]
- [url=https://33hops.com/xsibackup-rotating-replicas.html]Rotating replicas[/url]
- [url=https://33hops.com/xsibackup-extended-rotation-features.html]Extended rotation features[/url]

On --config-backup:

The argument is working well. Check your job syntax, beware of invisible characters and substitutions on cut&paste, etc...

#118 Re: General Matters » Questions about this product » 2022-06-09 18:11:10

[quote=mikeg]I also just discovered that the backup jobs to the nfs share are not storing the host config to the cfgbak folder even though that option has been added. The same job configuration to a local vmfs6 datastore does write the host config to that folder. Any ideas on that?[/quote]

The --config-backup argument just copies the (c)ESXi configuration to the remote end, it makes no difference between a VMFS and an NFS datastore.

#119 Re: General Matters » Questions about this product » 2022-06-09 10:57:10

[quote=mikeg][quote=admin]
ON ADDITION:

We have just tested (c)XSIBackup-NAS and xsigr is installed with all components and working properly.
What is the exact version that you are using?
Did you download it from the sourceforge.net download page?:
[url]https://sourceforge.net/projects/xsibackup-nas/[/url][/quote]

Yes I downloaded XSIBackup-NAS_2.1.1_C7.tar.gz from there and followed the steps in the readme to set it up.

Today I deleted the VM but if you would like me to test it again for you I will be happy to. Just let me know.[/quote]

We already tested it, use if you will, then post if you find any difficulty. Nonetheless Rocky Linux is a better option nowadays, as (c)XSIBackup-NAS is based in CentOS 7

#120 Re: General Matters » Questions about this product » 2022-06-09 10:55:24

[quote=mikeg]Thanks. I was learning them both and agree. All seems to be working well now and I am looking at some of the other commands/options available. What is the best way to only keep a certain number of the last available backups automatically?

Also I just discovered the ESXi NFS datastore share is lost after rebooting Rocky Linux. Trying to figure out why. It becomes accessible again if I simply duplicate these steps in terminal:

nano /etc/exports
CTRL-O
CTRL-X
exportfs -arv[/quote]

Well, those are general Linux administration issues, just make sure that you have enabled the NFS service to start at boot time.

#121 Re: General Matters » Questions about this product » 2022-06-08 10:26:44

That is just a warning, it's there just because XSIFS was compiled on a previous version of FUSE. It does not affect functionality.

Run: [b]xsigr --interactive[/b] to mount some restore point and recover individual files.

You can mount some -flat.vmdk file manually using xsifs directly, it will be much more cumbersome than using [b]xsigr[/b] though, plus you will need to mount it on a loop device, list its partitions, detect any eventual LVM2 volume in Linux, mount the volume, etc...

By using the scripted TUI you just have a to answer a few questions to get your disk/partition mounted.

ON ADDITION:

We have just tested (c)XSIBackup-NAS and xsigr is installed with all components and working properly.
What is the exact version that you are using?
Did you download it from the sourceforge.net download page?:
[url]https://sourceforge.net/projects/xsibackup-nas/[/url]

#122 Re: General Matters » Questions about this product » 2022-06-06 22:50:23

Congratulations, yours is the biggest homelab server that we ever came to know:
20 CPUs x Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz , 320 GB RAM

Yes, it's perfectly fine to use some VM as the target of your backups, in fact using a VM has some big advantages when compared to using a disk or a physical server.

We can't asess your setup based on words such as "slow" or "fast". You don't even provide some relative comparison that we can base our assesment on.

There are some obvious facts, such as setting your backup VM in a separate datastore, but we guess you already thought of that.

Do use Rocky Linux 8 as your NAS OS?. (c)XSIBackup-NAS is an apliance to help quickly deploy NFS and iSCSI shares for (c)ESXi. You can run XSIGR from (c)XSIBackup-NAS, you may need to install some components manually though.

To have a more straight granular restore backup server just use a minimal install of Rocky Linux 8, then run [b]./bin/XSIGR/install[/b] from the (c)XSIBackup installation dir in the (c)ESXi host.

#123 Re: General matters » ERROR (CLDELSN1), details Error: cannot delete snapshot VM Id: 19 » 2022-06-06 22:38:46

In this post on [url=https://33hops.com/esxi-snapshot-errors-and-solutions.html]troubleshooting (c)VMWare (c)ESXi snapshots[/url] you will find everything you need to know to fix that kind of error.

#124 General matters » Debian as (c)XSIBackup backend » 2022-06-01 12:28:38

admin
Replies: 0

Debian is a great classical Linux distro which has in turn given birth to many successful forks. We have noticed that some default installtions of current Debian versions as of 2022 do activate by default the iNOTIFY service. This seems to somehow affect (c)XSIBackup server and produces ENOSPC system call errors when the limit at /proc/sys/fs/inotify/max_user_watches is reached.

(c)XSIBackup backup repositories consist in millions of data chunks. If you enable some system such as inotify in your backup server, you will be adding some overhead to the FS and on top of that you will be bound by the limits of the iNOTIFY service itself.

It is a must to disable inotify in your host. If you don't know what it is or you don't want to go through the hassle of learning about it, then you should stick to the recommended distros: CentOS 7 and Rocky Linux 8

The only scenario in which inotify would be useful is if you are willing to create some sort of distributed backup repository system that keeps a copy of your backup repository in the cloud and you will be using iNOTIFY to move the new block files when they are detected in the repository directory structure.

#125 (c)XSIBackup-Pro & DC bug tracker » Unknown cipher type » 2022-05-30 15:32:56

admin
Replies: 0

You will get the error: Unknown cipher type when trying to exchange keys with some Rocky Linux 8.6

[b]Unknown cipher type 'aes128-ctr,aes192-ctr,aes256-ctr,aes128-cbc,3des-cbc,blowfish-cbc,cast128-cbc,aes192-cbc,aes256-cbc'[/b]

The reason is that (c)XSIBackup tries to use some fixed set of ciphers when probing the remote end for the type of system.

It uses:

'aes128-ctr,aes192-ctr,aes256-ctr,aes128-cbc,3des-cbc,blowfish-cbc,cast128-cbc,aes192-cbc,aes256-cbc'

Now the thing is that for some reason OpenSSL fails to negotiate a cipher if only one of the ciphers presented in the list is not present. This is some ackward behaviour in our humble opinión, still that's what it is.

We will fix this by using a widely available cipher such as [b]aes128-ctr[/b] or similar for the remote system probe or just allow it to work in automatic mode.

Board footer