©XSIBackup-Free: Free Backup Software for ©VMWare ©ESXi

Forum ©XSIBackup: ©VMWare ©ESXi Backup Software


You are not logged in.

#1201 Re: General matters » Installation problem / no key in script / where can i find it? » 2019-07-11 23:17:08

That is due to that you probably upgraded a previously existing subscription of XSIBACKUP-FREE but you didn't enter a name and lastname, but just the e-mail address. This causes a security routine to block the key generation resulting in that empty var.

Please contact support to have it fixed manually, we could not find you by the e-mail address in the forum.

#1202 Re: © OneDiff » Error DFUPCID0 » 2019-07-11 18:04:35

We have been testing [b]XSIBACKUP-PRO 11.2.6[/b] all day with special focus on ESXi 6.5.0 and we have not been able to reproduce any cipher issue, OpenSSH versions seem to be perfectly able to negotiate a cipher with default options.

Of course we are referring to VMWare official builds. Should somebody encounter a similar issue, please contact support and we'll try to help you find a common cipher denominator and set it via the [b]--ssh-ciphers[/b] argument.

#1203 Re: © OneDiff » Error DFUPCID0 » 2019-07-10 23:35:19

Thank you very much for your feedback, that will help a lot. We probably entered a minefield when fine tweaking the ciphers depending on the ESXi/OpenSSH version, but the difference in performance is worth the time, as that, so many times named, [b]chacha20-poly1305@openssh.com[/b] or some older or deprecated [b][https://33hops.com/xsibackup-ssh-less-secure-ciphers.html]Less Secure Ciphers[/url][/b] can boost throughput up to 30%

As stated DELL builds are not bad at all, especially when you compare them to some other manufacturers that I will not mention and whose ESXi builds in the past contained critical bugs and arbitrary modifications that even broke some base design principles of ESXi.

As a rule of thumb: VMWare certifies hardware on its own, you don't need a manufacturer build to be sure your hardware is supported. Manufacturers will usually claim that if you use their version, everything will run smoother and bla, bla, bla. I will leave the matter to your own thoughts and will just place a question the other way around: If you were a manufacturer, why would you invest a lot of money and resources to create a custom build when your hardware has already been certified by VMWare?...

I can sympathize with some users like Rasmus. XSIBackup has evolved through the years always adding more options. Of course there's always a default bahaviour, so you don't need to set too many arguments, but when it comes to use it over IP, especially when mixing ESXi versions, you need to at least take on account a number of things: ESXi version, VMFS version, OpenSSH version, etc...

The key is to always take it as easy as possible and use the same ESXi version, same VMFS version, share datastores when operating in a LAN, etc... If you can't use the same ESXi version you will need to at least use a common denominator Hardware Version.

[b][https://33hops.com/xsibackup-datacenter-vmware-esxi-backup.html]©XSIBackup Datacenter[/url][/b] is a total rethink of the same concept. It performs two actions: [b][https://33hops.com/xsibackup-datacenter-help-man-page.html]--backup[/url][/b] and [b]--replica[/b], it does it really fast and simplifies usage greatly. You have a totally working trial version that copies VMs up to 40 GB.

#1204 Re: © OneDiff » Error DFUPCID0 » 2019-07-10 22:13:05

To jybleau:

Same as above, you said that you are using DELL builds. This manufacturer builds are not among the worse, DELL is a serious enterprise and they do a good job, but still, they incorporate arbitrary changes, so you might need to deal with them.

#1205 Re: © OneDiff » Error DFUPCID0 » 2019-07-10 22:04:33

To Rasmus:

We already asked you to contact support. You have pasted only part of the output, we don't know what is your job syntax, we don't know what are your case details cause you ommited the header where all general variables and versions appear. You need personalized help, we are sorry that you feel frustrated but we never said that this was for novices. Believe us, it's a lot simpler that you think it is.

On the other hand, if version 11.2.3 was working for you, why did you update to a newer one?

If you don't know what the support e-mail address is, just send us a form and we'll get back to you: [url=https://33hops.com/contact-form.html]Contact form[/url]

As general information: we do not support other ESXi "versions" than the official builds from VMWare.
Manufacturer builds are arbitrary modifications of the original software, we cannot support anything under the sun.

We have thoroughly tested latest XSIBackup versions on the official VMWare builds.

#1206 Re: © OneDiff » Error DFUPCID0 » 2019-07-10 17:48:13

Your problem is with the cipher, which is in turn causing the other error.
Please, contact support with all details:

- ESXi version.
- Full backup job.
- Full output log.

[quote=Rasmus]Ok, so I installed 11.2.6, and no joy. Actually even worse. Now I also receive the UTF 8 error mesage that a different user also complained about. I am not very experienced with VM Ware, and I am really afraid of messing up the original VM machines. They seem to be littered with snapshots an logfiles from countelss of failed backups.
Here is a parts of my latest logfile. And just to make it clear, I have not manualy modified any .vmx file. I dont even know how to.

2019-07-10T13:03:51|  Removing snapshots, please wait...
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:03:53|  Syncronizing config files
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:03:56|  [Frontend] error: cannot copy VMX file, details: Unknown cipher type 'arcfour,blowfish-cbc,aes128-ctr'
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:03:56|  [Frontend] error: cannot copy VMSD file, details: Unknown cipher type 'arcfour,blowfish-cbc,aes128-ctr'
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:03:56|  [Frontend] info: no .vmxf file found
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:03:56|  [Frontend] info: no .nvram file found
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:07|  Backing up virtual disks...
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:07|  DISK=/vmfs/volumes/datastore1/Frontend/Frontend-000001-sesparse.vmdk
2019-07-10T13:04:07|  DISK=/vmfs/volumes/datastore1/Frontend/Frontend-000001.vmdk
2019-07-10T13:04:07|  DISK=/vmfs/volumes/datastore1/Frontend/Frontend-Snapshot31.vmsn
2019-07-10T13:04:07|  DISK=/vmfs/volumes/datastore1/Frontend/Frontend-Snapshot88.vmsn
2019-07-10T13:04:07|  DISK=/vmfs/volumes/datastore1/Frontend/Frontend.vmdk
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:07|  Disk [/vmfs/volumes/datastore1/Frontend/Frontend-000001-sesparse.vmdk] excluded
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:07|  Disk [/vmfs/volumes/datastore1/Frontend/Frontend-000001.vmdk] excluded
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:07|  Rsync file transfer (1st)
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:07|  From: /vmfs/volumes/datastore1/Frontend/Frontend-Snapshot31.vmsn
2019-07-10T13:04:07|  To: /vmfs/volumes/datastore2/Frontend/Frontend-Snapshot31.vmsn
---------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:07|  [Frontend] error CLRSYNC4: Unknown cipher type 'arcfour,blowfish-cbc,aes128-ctr'
2019-07-10T13:04:07|  rsync: connection unexpectedly closed (0 bytes received so far) [sender]
2019-07-10T13:04:07|  rsync error: unexplained error (code 255) at io.c(226) [sender=3.1.0]
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:07|  Rsync file transfer (1st)
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:07|  From: /vmfs/volumes/datastore1/Frontend/Frontend-Snapshot88.vmsn
2019-07-10T13:04:07|  To: /vmfs/volumes/datastore2/Frontend/Frontend-Snapshot88.vmsn
---------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:07|  [Frontend] error CLRSYNC4: Unknown cipher type 'arcfour,blowfish-cbc,aes128-ctr'
2019-07-10T13:04:07|  rsync: connection unexpectedly closed (0 bytes received so far) [sender]
2019-07-10T13:04:07|  rsync error: unexplained error (code 255) at io.c(226) [sender=3.1.0]
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:07|  Rsync file transfer (1st)
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:07|  From: /vmfs/volumes/datastore1/Frontend/Frontend.vmdk
2019-07-10T13:04:07|  To: /vmfs/volumes/datastore2/Frontend/Frontend.vmdk
---------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:07|  [Frontend] error CLRSYNC4: Unknown cipher type 'arcfour,blowfish-cbc,aes128-ctr'
2019-07-10T13:04:07|  rsync: connection unexpectedly closed (0 bytes received so far) [sender]
2019-07-10T13:04:07|  rsync error: unexplained error (code 255) at io.c(226) [sender=3.1.0]
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:07|  Info: transfering file | /vmfs/volumes/datastore1/Frontend/Frontend-flat.vmdk
---------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:08|  [Frontend] CLXSIDF1 error: file transfer error: Unknown cipher type 'arcfour,blowfish-cbc,aes128-ctr'
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:08|  Excluded disks removed from backup .vmx file
---------------------------------------------------------------------------------------------------------------------------------
2019-07-10T13:04:10|  [Frontend] error OVMXCHK2: VMX file check 2 fail, details: first line in .vmx file is not [.encoding = "UTF-8"], has this file been manually modified/edited?
2019-07-10T13:04:11|  [Frontend] error CPVMXCNT: could not update VMX file in [Frontend_XSIBAK], details: Unknown cipher type 'arcfour,blowfish-cbc,aes128-ctr'
2019-07-10T13:04:11|  [Frontend] error DIFDVMSD: could not delete VMSD file in [Frontend_XSIBAK], details: Unknown cipher type 'arcfour,blowfish-cbc,aes128-ctr'
2019-07-10T13:04:11|  [Frontend] info: Updating CID at [192.168.148.3:22:/vmfs/volumes/datastore2/Frontend/Frontend.vmdk]
2019-07-10T13:04:11|  [Frontend] error DIFUPCID: cannot update CID at VM [Frontend_XSIBAK], details: Unknown cipher type 'arcfour,blowfish-cbc,aes128-ctr'
2019-07-10T13:04:11|  [Frontend] info: backup complete
2019-07-10T13:04:11|  [Frontend] info: finished doing a first copy in a diff scope, subsequent backups will be differential
2019-07-10T13:04:11|  [Frontend] info: should you need to use the mirror VM, register it manually at the backup ESXi host
----------------------------------------------------------------------------------------------------------------------------[/quote]

#1207 Re: © OneDiff » Error DFUPCID0 » 2019-07-10 16:24:18

It should work just as long as one of the ciphers offered by the client exists in the server.
This is the output from one of our 6.5.0 test servers:

[root@esxi21:/vmfs/volumes/57e961ea-90e2ba-2d89c4/xsi-dir] vmware -v
VMware ESXi 6.5.0 build-4564106
[root@esxi21:/vmfs/volumes/57e961ea-90e2ba-2d89c4/xsi-dir] ssh -Q cipher
3des-cbc
blowfish-cbc
cast128-cbc
arcfour
arcfour128
arcfour256
aes128-cbc
aes192-cbc
aes256-cbc
rijndael-cbc@lysator.liu.se
aes128-ctr
aes192-ctr
aes256-ctr
aes128-gcm@openssh.com
aes256-gcm@openssh.com
chacha20-poly1305@openssh.com

The client offers these ciphers, but then the sshd_config file has these:

blowfish-cbc,aes128-ctr,aes192-ctr,aes256-ctr,3des-cbc

Which is clearly inconsistent.

I believe VMWare has been extremely concerned about the multiple security issues that have affected OpenSSH in the last years and how that could affect them as a brand. They have probably became progressively paranoid, cause they have removed a number of useful ciphers and they seem to be narrowing everything down to FIPS compliant stuff.

The thing is that SSH is much more than a way to tunnel shell commands. Some of these ciphers are so inneficcient, in terms of speed, that they limit SSH/SCP speed by 50-60% when compared to unencrypted data transfers with NetCat (nc). Then users start spreading urban legends about ESXi Shell network throughput being limited..., it's not the shell network speed that's limited, it's the fact that it uses one core and SSH uses extremely heavy ciphers.

[b]chacha20-poly1305@openssh.com[/b] is a beam of light in regards to this, as it offers a high level of security but due to its nature it is extremely efficient.

#1208 Re: © OneDiff » Error DFUPCID0 » 2019-07-10 12:23:37

We have published a fix as [b][url=https://33hops.com/xsibackup-vmware-esxi-backup.html]XSIBackup-Pro 11.2.6[/url][/b]
We will be actively improving this branch, so any eventual new issue will be fixed rapidly.

#1209 (c)XSIBackup-Pro & Free Classic bug tracker » chacha20-poly1305@openssh.com not supported in ESXi 6.7.0 » 2019-07-09 22:59:26

admin
Replies: 0

We have enabled [b]chacha20-poly1305@openssh.com[/b] cipher for all OpenSSH versions above 6.5 in [b]XSIBACKUP-PRO 11.2.5[/b], but we overlooked the fact that this cipher was removed from ESXi 6.7.0, thus it returns some nasty errors when using version 11.2.5 over SSH. It will be fixed in 11.2.6

#1210 Re: © OneDiff » Error DFUPCID0 » 2019-07-09 22:53:40

Our fault, the [b]chacha20-poly1305@openssh.com[/b] cipher was removed from the list of OpenSSH vSphere drivers, most probably cause its not FIPS compliant. We'll fix this issue tomorrow, or should I say today :-)

#1211 Re: © OneDiff » Error DFUPCID0 » 2019-07-09 12:15:00

Yes, when we detect that OpenSSH version is 6.5 or above, we prepend [b]chacha20-poly1305@openssh.com[/b] to the list of ciphers to use in SSH transfers. The reason is that that cipher created by Prof. Daniel Berstein, is far lighter than regular AES, while still keeping a high level of security, thus tranfer speeds boost up when using it.

We can be pretty sure that OpenSSH includes it, nevertheless, there could always be some bug at detecting it when combining different ESXi versions. What ESXi versions are you using?

UPDATE:

The change log reflects this change in version 11.2.5. Please contact us if you are still getting this error, it can be easily fixed.

[url=https://33hops.com/xsibackup-change-log.html](c)XSIBackup Classic Change log[/url]

#1212 Re: © OneDiff » error OVMXCHK1: VMX file check » 2019-07-09 12:10:04

Extra content is filtered.
That extra line

#!/usr/bin/vmware

is out of place .vmx files do not start by a sheebang.
Start asking yourself what has added that line to the header of the .vmx file

#1213 Re: General matters » line 490: syntax error: unexpected "&" » 2019-07-04 12:40:07

We already fixed that name and republished as same version

#1214 Re: General matters » line 490: syntax error: unexpected "&" » 2019-07-04 10:53:28

Just an error naming things, it's indeed Free version

#1215 Speed » Achieving maximum speed » 2019-07-02 18:41:04

admin
Replies: 6

To be able to bring out the full speed of [b]©XSIBackup-Datacenter[/b], which is probably well above your most optimistic expectations, you will need a fairly capable CPU. Don't get us wrong, a simple double core Pentium will suffice, just don't try to break some speed limit with an Atom processor.

• All Pentium, i3, i5, i7 and i9 CPUs score above the minimum requirements, even pretty old ones.
• All fairly recent ©XEON CPUs, even the low end series (E), score way over the minimum requirements for maximum speed.
• In case you find yourself in a situation in which you are limited by some single core performance limitation, i.e. you are using an Atom CPU and you can't make it better, just disable --compression on your backups and eventually allow the remote FS to perform the compression on the block chunks on the other side. This technique allows to shift part of the CPU load to the remote end when transferring data over IP.
• And do not forget to enable cache on your controller should you need to: enabling cache on an HP disk controller

[b]Note:[/b]
We have made a correction to this text, as some tests with an old Xeon CPU were throwing poor results due to the HD controller, not the CPU itself. Most XEON CPUs since more than 10 years ago will more than suffice for [b]©XSIBackup-Datacenter[/b] operations.

#1216 Re: General matters » test email » 2019-07-02 12:38:20

Set --smtp-auth to "none" in the conf/smtpsrvs file.

[url=https://33hops.com/xsibackup-smtp-server-configuration-file.html](c)XSIBackup SMTP configuration file[/url]

#1218 Re: General matters » line 490: syntax error: unexpected "&" » 2019-07-01 16:07:07

We just released XSIBACKUP-FREE 11.2.4, it's available for download.
It is compatible with ESXi 6.7.0 Update 2

#1219 Re: General matters » line 490: syntax error: unexpected "&" » 2019-07-01 14:47:53

There isn't any such thing as version 11.2.3 in trial mode. Only trial version of XSIBACKUP-PRO is 11.0.1.
Any 11.2.3 version is a PRO version, which can only be downloaded after being licensed.

In any case, this is not the thread to pose such questions.

#1220 Re: General matters » line 490: syntax error: unexpected "&" » 2019-07-01 11:29:49

We have been taking a look at this issue again.

It's clear that the double quote inside the curly brace expansion was causing the bash parser to behave oddly. It's also obvious that all previous bash interpreters didn't care much about this fact. Double quotes are treated differently inside subprocess expansion in between parentheses too, and it has been doing the same with curly brace expansion so far.

We have solved this by just using the sed call above this line to escape double quotes inside variable values. This is not very likely to be found, but still we'll keep it just in case.

We will now check functioning thoroughly before considering this a definitive solution, but you may use it to workaround this issue.

The above mentioned line

VARVAL="${VARVAL//"/\"}"

Is at line 300 in version 11.2.3
Right above that line you can find this

VARVAL="$( echo $block | awk -F "=" '{print $2}' | sed -e 's/^ *//g' -e 's/ *$//g' )"

We just extended that line adding an additional sed code block to perform the same task that the old curly brace expansion. So just add the new block and delete or comment out the faulty line.

VARVAL="$( echo $block | awk -F "=" '{print $2}' | sed -e 's/^ *//g' -e 's/ *$//g' -e 's/"/\"/g' )"

#1221 Re: © OneDiff » Segmentation fault using xsibackup » 2019-07-01 09:23:42

XSIBackup is a script, you will have to debug that on your own.

#1222 Re: General matters » Error code 97 at file crypt.c, line 97 Error description: decrypt erro » 2019-07-01 09:21:50

That's just an error after

Trial version allows backups and replicas during 6 h. after each reboot

Reboot your test server and try again.

XSIBackup will always try to keep running instead of raising the error and exiting, which is normal behaviour. Thus, only the first error in the stack is indicating the real error condition that, in turn, is causing the rest in a cascade effect.

In this case, the program stops execution due to the Trial version limitation and then keeps on raising errors. We'll probably consider this an exception in next version and just exit after the notice.

Have you set proper execution permissions for the program to be able to run?

chmod -R 0700 xsibackup bin

#1223 Re: General matters » jobs dir not created under xsi-dir? » 2019-07-01 09:15:14

We'll fix that issue in some days.
Well, that directory should have been created by the program. Where are the jobs that you are running through the cron then.

#1224 Re: General matters » line 490: syntax error: unexpected "&" » 2019-07-01 09:11:12

Running it in a regular Bash should not make much sense, in this case might have helped you to detect this, though. Busybox shell is not Bash, but Ash, which is a much more primitive shell language closer to the original Bourne Shell.

It would be rare that we had not detected any gross syntax error for years. It would make sense that the syntax parser thinks the second double quote is the end of the string though, but changing it to this:

VARVAL="${VARVAL//\"/\"}"

leaves the line without effect, so in any case that should be:

VARVAL="${VARVAL//\"/\\"}"

As the function of that type of code is to escape double quotes. Sed would have probably done it better here, we'll revise it soon, thank you for the feedback.

We'll take a look at this and eventually fix it. Nevertheless the new XSIBackup version has been released as a Beta and will be our main branch of development for the next years, XSIBackup as a script will probably be kept as the free version of our software.

#1225 Re: General matters » Is DC a trial? » 2019-06-27 00:10:24

There's a PDF manual in the docs folder

Board footer