You are not logged in.
We have detected a bug that affects only Windows 64 bit OSs when backed up using OneDiff program. The CID is not updated on first run and the OneDiff cycle always copies all data. XSIBACKUP-PRO 10.1.1 will be launched in short and will contain the bug fix.
Until we release the fix and as a workaround you can:
1 - Turn off quiescing --snapshot=dontquiesce
2 - Use --backup-how=warm
That doesn't make much sense, XSIBackup can use any datastore as it's backup target.
You must have some previous error. It looks like the XSITools repository hasn't been correctly initialized and the [b].xsitools[/b] file is missing.
This looks more like a communications problem, no errors thrown by Rsync, it just sits there waiting.
Free edition just offers Rsync to copy data over IP.
Try to disable compression to see if it helps. You can deactivate it yourself by replacing this line of code around line 430
SSHOPTS="-2 -4 -o StrictHostKeyChecking=no -i "${PWD}"/xsibackup_id_rsa"With this
SSHOPTS="-2 -4 -o StrictHostKeyChecking=no –o compression=no -i "${PWD}"/xsibackup_id_rsa"If you are using an OVH dedicated server, many of our clients do, I would use the primary disk to hold data and the secondary disk to store backups. Once you have your data in the secondary disk you have more freedom to replicate it somewhere else.
We need more info. Are you backing up over a WAN?, if so, what's your available bandwidth?
Most important: what is your remote's ESXi version?, have you detected any errors in the output?, can you provide it?
I'm afraid that Rsync is not a very practical way to move 500 gb. over IP, especially since it can't deal with zeros and copies them as data. Even though it can compress them, still is not the best way to do it. In any case it should work, no matter how long it takes, so please send us some more details.
Well, the message is revealing. XSIBackup can't open the XSITools repository config file at: /vmfs/volumes/SATA3/xsit-2017-11/.xsitools
Is there a "/vmfs/volumes/SATA3" datastore at --host=x?
Thank you for your feedback.
xsibackup-cron.log
From XSIBackup 9.1.9 and up, the program will detect versions on both sides of the peer and choose an adequate Key Exchange Protocol (A.K.A. K.E.X.). Nevertheless, if you connect from an ESXi 6.5.0 box to a lower version one, the remote party will only offer KEX methods that the OpenSSH version present in ESXi 6.5.0 does not support any more, resulting in the message above. As a result, you can only perform IP data transfers from a lower version to a higher one or between same version, but not from ESXi 6.5.0 to a lower version of ESXi.
In any case backing up from a given version to a lower one is not very common, nor very recommendable, as you may be copying VMs which cannot be used in a lower ESXi version. The word "may" is there on purpose, as it really depends on the VM hardware version, and not on the ESXi version itself. If you don't fully understand what is exposed in this post, I suggest that you start here: [url]https://pubs.vmware.com/vsphere-51/index.jsp?topic=%2Fcom.vmware.vsphere.vm_admin.doc%2FGUID-68E5EDAE-66DE-43F8-9420-F424AFEADB1D.html[/url]
Another approach would be to use compression, but set its level down to 1
CompressionLevel 1
This yields the best results on fast networks
[b]EXPLANATION[/b]:
When you use compression on highly compressed data, you obtain the opposite result; data is not compressed at all, but the CPU time to process it slows the transfer down. So, compression is only effective when you have big sparse files with a lot of empty space per instance. In any case SSH2 dynamic compresson algorithm is sopoused to be able to detect wether compression needs to be turned on and up to what point.
Pro version uses XSIDiff to copy data the first time, it knows how to skip zero blocks, so compression is not used here. In case of using Rsync with the free version, it still uses SSH 1.0
Just disable compression in your /etc/ssh/ssh_config file to find out if this is the cause of your slow down.
Add the line to the SSH client config file.
Compression no
Mmm, that does not seem to be a problem with your CPU capabilities. We have not experienced this issue when using SSH 2.0 dynamic compression. We'll try to add a flag to disable it.
Yes, most of the overhead in Rsync transfers is caused by the SSH encryption and/or compression. What kind of server/CPU are you using?
Backing up to a Synology NAS via IP can be cumbersome, mainly due to the security design of DSM OS. It is imperative to have root access rights to manage SSL keys.
Solutions:
1 - There's always been a way to enable login as root via SSH in Synology NAS devices anyway, you could try this approach too.
[url]https://www.youtube.com/watch?v=aRfW_YKKZFg[/url]
In general, systems that prevent root login, namely, obly you to login as a different user and then sudo, do so by removing the root user from the wheel group at /etc/passwd. To reenable root access via IP you could try to add root user to this built-in group. There might be other tweaks that keep root from login.
[url]https://superuser.com/questions/1057853/synology-dsm-cant-log-as-root-but-works-with-admin[/url]
2 - Happily there's a really easy workaround, which is to use the Synology NAS as an NFS or iSCSI datastore and then backup to the local datastore attached as a network device. Once you have your data in the Synology NAS device, you can easily use backup programs like Hyperbackup to copy data offsite to the cloud, to another Synology device or to any other place. It's easy to take data out of the Synology NAS, not so easy to bring it in, unless you use the pre-stablished mechanisms.
3 - Another workaround is to install a small Linux VM stored in the Synology NAS as a datastore, and then use this totally open Linux system to backup to, or even better, backup to another ESXi, that way your backups are ready to be switched on in case of disaster.
XSIBackup has its own built-in cron system, which is the recommended scheduling method. Of course, you are free to experiment and launch XSIBackup from other outer schedulers like cron or Windows Task Manager.
Almost every SSH client has an argument or switch to redirect output of command run in remote systems, in some cases this is the default behaviour, in some others you need to explicitly state that this redirection should take place. Nevertheless this is something that has to do with your chosen SSH client and not with XSIBackup itself, which simply prints its output to [b]stdout[/b] and knows/cares nothing about what happens with that output, whether it is redirected or not, or where it is indeed effectively redirected.
You should read this post [b][https://33hops.com/xsibackup-remote-execution.html]Executing XSIBackup Remotely[/url][/b], it should help you clarify how to execute remote commands from other Linux systems.
There are other posts in the Internet that treat this subject, this is a selection:
[url]https://unix.stackexchange.com/questions/1630/redirect-stdout-over-ssh[/url]
[url]https://unix.stackexchange.com/questions/151316/how-to-send-a-output-of-unix-command-from-one-server-to-another-server[/url]
[url]https://askubuntu.com/questions/917200/how-to-redirect-command-output-from-remote-machine-to-local-file-via-ssh[/url]
We have created a version of the [b]OneDiff[/b] algorithm to backup Windows VMs and still be able to quiesce them properly. Normal cloning of this type of VMs will also be allowed. Should some Pro user want to try a preview of this upcoming version, please just send us a form stating your registered address at: [url=https://33hops.com/contact-form.html]https://33hops.com/contact-form.html[/url]
By now XSITools works only to local storage, but you can just attach your Ubuntu box as an NFS datastore, it's very easy. You can just follow this guide: [url]https://nfs.sourceforge.net/nfs-howto/ar01s03.html[/url]
You have some problem with your backup devices, all of them returned [b]Input/output error[/b]. That is a kind of error you get when something has been removed, some cable is not working, etc... in short, when you have registered a backup device (NFS, local, iSCSI), but ESXi can't access that device.
You are pasting something that does not make sense ([b]esxi-host#[/b]).
1 - CD to your installation dir and run the program from that folder
cd /vmfs/volumes/datastore1/xsi-dir
./xsibackup2 - Or invoke execution through an absolute path to the program
/vmfs/volumes/datastore1/xsi-dir/xsibackupThose are the two main ways to execute something in a *NIX environment.
ESXi supports NFS and iSCSI, apart from locally attached storage. So your posibilities to mount Tandberg RDX will depend on the kind of storage protocols it supports.
In case it does not support anything but attaching it locally via a driver, you would depend on that driver being available for ESXi. In case such driver does not exist for ESXi, you could attach your Tandberg device to a small PC (something like a Raspberry Pi) running some OS that your device supports, and then share that OS via NFS or iSCSI.
ESXi duplicates snapshot files when performing a quiesced backup on GPT Windows guests, this causes the [b]OneDiff[/b] algorithm to fail. We are working on a solution.
We want to clarify that [b]OneDiff[/b] algorithm works perfectly well on all other GPT OSs which support quiescing. It is only Windows that fails, or..., just follows a totally different behaviour than the rest of OSs. This error is very similar to this previous one affecting MBR Windows Systems: [url]https://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2006849[/url]
It looks like Windows developers are not able to make their VSS behave as consistently as LVM in Linux. In fact, I would say that in regards to VMWare: 1/ They aren't able to make Windows work consistently on VMWare, 2/ They don't want to make Windows behave consistently in VMWare
As said, we will release a fix in short. By now, if you want to perform a quiesced backup on a Windows GPT or MBR server, you will need to asume a short down time (usually less than a minute) and use the [b][https://33hops.com/xsibackup-help-man-page.html#backuphow]--backup-prog=warm[/url][/b] switch, which will turn the server off, take a snapshot and then switch the OS back again, before making the hot backup.
[quote=ulfthomas][quote=admin]
Yes, it could be related to the VMWare issue that you pointed out. Remove the 500M check with the options flag [b]--options=no-500M-check[/b] and see if this helps the problem. Nevertheless, the fact that the resulting VM is not an exact copy of the original one when quiescing, is something to be concerned about. I guess VMWare should solve this issue. [/quote]
I fully agree. But Vmware do state in this article that this is by design and by that I understand the presence of this partition should not be of any concern. Are you saying that the disks are not identical or could it be an error that happens within the test itself? Could the disks be compared in any other ways?
[quote]We are working on this issue. We will offer a solution or workaround in short.[/quote]
Highly appreciated. Let me know if you need any help testing or debugging. I'll assist with as much as I can.[/quote]
Thank you for your offer, we will get in contact with you once we have some new code to test. You can, by now, just turn off the check.
[quote=ulfthomas][quote=admin][quote=sistemi]
I'm interested at the link, can you provide it?[/quote]
You have a link to a free tool in our Most Common Issues page here: [url=https://33hops.com/xsibackup-most-common-issues.html]https://33hops.com/xsibackup-most-common-issues.html[/url][/quote]
That is indeed the link I was using (I'm sorry but I forgot).
There is a couple of typos in that article:
gptgen.exe -w [b]\.physicaldrive0[/b]
bcdboot [b]c:windows[/b] /s s: /f UEFI
Needs to be changed to:
gptgen.exe -w [b]\\.\\physicaldrive0[/b]
bcdboot [b]c:\windows[/b] /s s: /f UEFI
Else it will fail.[/quote]
Thank you for the info, but you should communicate that to the software authors at: [url]https://sabrnet.wzk.cz/2015/03/convert-windows-system-mbr-disk-to-gpt-with-efi-without-data-loss/[/url]
There is a textbox where you can leave some comments.
You just have to overwrite all your files in your installation folder with the the newer files, except the [b]conf[/b] folder. When you copy them over, your license files are preserved, as well as your xsibackup-cron and log files. [b]XSIBackup[/b] .zip package does not contain any license, log or cron file, so the only files you need to be concerned about are those in the conf directory, if you have configured some SMTP servers at [b]smtpsrvs[/b] or custom options at [b]xsiopts[/b], other than the default ones.
You can also use the script in the resource area, which will take care of backing up your config files before upgrading.
[quote=ulfthomas]A couple of more tests:
[quote]
- Cleaned out all the snaphosts and folders
- Initiated the first Onediff backup with additional switch --backup-how=warm: Backup successful
- Initiated the second Onediff backup with the same switch: Backup successful
- Initiated the third Onediff backup removing warm switch but adding --snapshot=dontquiesce: Backup successful
- [b]Initiated the forth Onediff backup removing both warm and snapshot switch: [u]failed[/u][/b]
[/quote]
Wouldn't this indicate that it could be related to the quiescing of the VM?[/quote]
Yes, it could be related to the VMWare issue that you pointed out. Remove the 500M check with the options flag [b]--options=no-500M-check[/b] and see if this helps the problem. Nevertheless, the fact that the resulting VM is not an exact copy of the original one when quiescing, is something to be concerned about. I guess VMWare should solve this issue.
We are working on this issue. We will offer a solution or workaround in short.
[quote=sistemi][quote=ulfthomas]
Long story short:
• I converted the disk to GPT (I can revive the link if needed)
...
[/quote]
I'm interested at the link, can you provide it?[/quote]
You have a link to a free tool in our Most Common Issues page here: [url=https://33hops.com/xsibackup-most-common-issues.html]https://33hops.com/xsibackup-most-common-issues.html[/url]