©XSIBackup-Free: Free Backup Software for ©VMWare ©ESXi

Forum ©XSIBackup: ©VMWare ©ESXi Backup Software


You are not logged in.

#401 Re: General matters » Snapshots are deleted when --backup-how=cold used on ESXi 7.0 (solved) » 2021-06-28 14:50:57

It's summer, we have some scheduled works and some other things that entered the priority list, like this bug. Hard to say, it shuld be ready in less than two weeks though.

#402 Re: General matters » xsibackup fails to find existing VM (solved) » 2021-06-28 14:49:36

You can contact support so that we debug this for you, nonetheless it looks like there's something in that VM which is not what you believe it to be.

#403 Re: General matters » Snapshots are deleted when --backup-how=cold used on ESXi 7.0 (solved) » 2021-06-27 12:06:52

We'll revise that behaviour in next release, thank you for pointing out.

#405 Re: General matters » xsibackup fails to find existing VM (solved) » 2021-06-25 17:56:17

No, that can't be the reason. The most likely reason is that the VM's name is not the one you believe it is.

Please, avoid such naming.

We have taken the time to make ©XSIBackup-DC work with spaces, dashes, hyphens, underscores, at signs, etc.., still we have detected a number of shell component bugs in the past related to space handling.

On top of that there exist a number of different characters that will produce an invisible space. Same applies to hyphens, dashes, etc...

Make your life easier and renounce to using fancy characters in production environments, you will for sure save yourself time and money enough for some days of vacation in the Caribbean after a decade.

#406 Re: General matters » use regexp for VMs source selection in XSIBackup-DC » 2021-06-25 17:49:12

Well, we didn't pretend to reach perfection in an ad-hoc written code snippet, just to point you in the right direction.
Nonetheless, try to avoid fancy names in VMs or paths.

#407 Re: General matters » has it updated crontab? (solved) » 2021-06-24 06:34:33

(c)XSIBackup Classic is based in scripts, use at your will.

./xsibackup ... && do something || whatever

#408 Re: General matters » has it updated crontab? (solved) » 2021-06-23 09:33:28

You don't need it, use bash features to chain jobs depending on the outcome.

#409 Re: General matters » Unable to create cbt replica (solved) » 2021-06-22 16:52:01

Well, that's it.

Of course special characters matter. ©XSIBackup-DC has some more strict requirements than ©ESXi in regards to file naming conventions, still they are quite permissive in regards to spaces, hyphens, etc..., special characters like accented ones are not compatible though, at least in case of CBT.

Please, rename your files and/ or VM names and try again.

In general, please do pledge to using ASCII character sets to name your files in (c)ESXi and by extension any Linux FS. You can look at it from a 'reductio ad absurdum' point of view: what's the point in using special characters in virtual disk file names?.

We are obviously more general public oriented and open to all kind of situations, as we now distribute freemium software to people in five continents, using different character sets, keyboards, etc... Nonetheless we have known consultants that would plainly refuse to offer any kind of service to a client with such kind of naming scheme. You are probably thinking that's too radical from part of that person, still we can understand it, as it denotes not having much control on what's going on.

#410 Re: General matters » Ideas to backup a VM that runs under VCloud Director? » 2021-06-22 15:10:36

Then you became a user, you are bound to pre-stablished solutions.

#411 Re: General matters » Unable to create cbt replica (solved) » 2021-06-22 15:06:51

Well, thank you for the precise feedback, some users tend to ommit important information or to exaggerate It in the hope, we guess, that they will receive some extra attention. This only makes things worse and support a matter of guessing.

Knowing that this is a VM specific issue is extremely important to narrow the problem down.

Is there something in the VM disk files (special characters, spaces) that makes it different from the other VMs?

#412 Re: General matters » Ideas to backup a VM that runs under VCloud Director? » 2021-06-22 10:46:42

AFAIK you can still use (c)XSIBackup on your (c)ESXi hosts, which will still be the base of your virtualization system.
That will depend on the kind of infrastructure that you are assigned and the level of control you have on it. If you are just delegated some resources from a bigger administered pool of hardware, you will no longer be the real administrator of the hardware and thus you will have no control on what you can install or use, that will be chosen for you.

Just as long as you can still access your hosts via SSH with admin rights, you will still be able to use (c)XSIBackup

In case you still have admin rights on the hypervisors and you have a number of hosts to manage, you may find this extremely useful:
[url]https://33hops.com/xsidirector-esxi-management-deployment.html[/url]

#413 Re: General matters » use regexp for VMs source selection in XSIBackup-DC » 2021-06-22 10:30:40

By now you can only select groups of VMs by using the keywords RUNNING or ALL.
REGEXP support for selection of VMs will be added in short, you can nonetheless easily implement this in the very DC job by using this code snippet.
The grep expresssion contains the regular expression that you use to filter the VMs, in this example it is [b]^W.*0[/b]

vim-cmd vmsvc/getallvms | tail -n+2 | awk -F '[' '{print $1}' | awk '{print $2}' | grep -E "^W.*0" | sed ':a;N;$!ba;s/\n/,/g'

This code snippet integrated in a job would look something like this:

/vmfs/volumes/6071af03-9b59286b-5ed6-001517c3fbf5/XSI/XSIBackup-DC/xsibackup \
--backup \
"VMs($(vim-cmd vmsvc/getallvms | tail -n+2 | awk -F '[' '{print $1}' | awk '{print $2}' | grep -E "^W.*0" | sed ':a;N;$!ba;s/\n/,/g'))" \
/xsibackups/xsibackup_default_repository \
--mail-to=mail-from \
>> /vmfs/volumes/6071af03-9b59286b-5ed6-001517c3fbf5/XSI/XSIBackup-DC/var/log/xsibackup.log 2>&1

The code snippet takes  all the VMs in the host, then it filters them by using the regular expression in the grep command to finally remove the new line characters and substitute them by a comma, which is the VM separator in a VM list.

You can test the code in the command line prior to using it in a job.

#414 Re: General matters » Replica XSIBackup-DC versions » 2021-06-22 09:33:49

We will dedicate some development time to this in the following days. We are finishing to test new features that will allow you to rotate multiple replicas, as some users prefer to keep ready to use copies even though it may take more time to complete the backups. Nonetheless since we added the multitenant CBT feature, this technique has emerged as some much more feasible way to keep ready to use copies, just as long as you have the necessary space to host them.

#415 Re: Feature requests & improvements » Central Logging » 2021-06-22 09:28:43

What you say does make sense. You can actually add the information generated during a backup cycle to let's say some MySQL DB easily, you just have to exchange key with the DB server and run a postbackup script to add this info to the database.

We will dedicate some time to writing some posts and offer some examples that can be reused by (c)XSIBackup users and also some DB triggers to generate alerts on the situation that you describe.

We are actually finishing to test some new features around --rotate to allow setting virtual user space limits and improving the rotation features.

#416 Re: General matters » Backup blew up after 30% » 2021-06-21 08:08:41

There is already a new release with a new expiration date, download and overwrite your old main xsibackup binary or install on top.

#417 Re: General matters » Backup blew up after 30% » 2021-06-20 10:56:40

Do not even try to store a deduplicated backup on VMFS-5, we won't comment any further around this issue, we already explained on that.

You are running --info on a datastore, why?. It is meant to be run on a backup repository.
Please read the manual and examples before using the software.
[url=https://33hops.com/xsibackup-dc-full-manual-home.html](c)XSIBackup-DC[/url]

We will modify the info.c module so that it terminates with a clear message when no .blocklog file is detected. Nonetheless we can't detect every possible wrong way that users will be trying to use the software to print a message stating why it shouldn't be used that way.

The job below is conceptually wrong:

./xsibackup --backup "VMs(Black)" "/vmfs/volumes/nas 1 john"

You should not backup to a repository in the root of a datastore.
You should instead run:

./xsibackup --backup "VMs(Black)" "/vmfs/volumes/nas 1 john/some_repository"

And then get information on that repository running

./xsibackup --info "/vmfs/volumes/nas 1 john/some_repository"

We specifically block attempts to backup to the root of a datastore. Maybe the fact that you used some datastore containing spaces managed to work those checks around, we'll check that point.

Needless to say you should avoid spaces in paths as well as special characters or accented ones.

#418 Re: General matters » Backup blew up after 30% » 2021-06-19 08:42:21

Please post the whole job and output. Knowing the command that you have run (c)ESXi version, kind of DS, file system, etc.. is crucial to offering an answer.

Nonetheless you have a bunch of errors, your output denotes some kind of gross error in what you are doing. Are you sure that your datastore is there (VMDATA)? and that it's not full. Is it VMFS-5 by some chance?
You can't perform a deduplicated backup to a VMFS-5 datastore, it only has 130,000 available inodes, not enough to host deduplicated data.

You may very well replicate to it on the other side.

Use a fast file system over NFS to host deduplicated repositories: ext4 or XFS are your best bet. If you can use SSD HDs even better, take on account that deduplication will save 98% of your space once you add a number of restore points, thus using some SSD about double the size of a single deduplicated backup set will be able to host hundreds of restore points.

#419 Re: General matters » vmdk not found, but it's there. Backups seem to be stuck (solved) » 2021-06-19 08:35:02

This is due to a limitation in regards to NFS based disks, already fixed in 1.5.0.9

#420 Re: General matters » vmdk not found, but it's there. Backups seem to be stuck (solved) » 2021-06-18 08:21:00

Yours is an issue detecting the physical location of your .vmdk disk.
You may post the output of the following commands to try to determine the reason.

vim-cmd vmsvc/getallvms
readlink /vmfs/volumes/YOUR-DATASTORE
esxcli storage vmfs extent list

Replace [b]YOUR-DATASTORE[/b] by the name of the DS where your VM is.

#422 Re: General matters » Details on the --on-success and --on-error options » 2021-06-16 08:32:36

(c)XSIBackup Classic is a script, you have full access to the code and permission to modify it, just as long as you don't redistribute the changes. Set your own flag based on your requirements or reuse/modify the very --on-* functions.

#423 Re: General matters » Unable to create cbt replica (solved) » 2021-06-16 08:28:18

Yes, that could be indeed an issue, as every .vmdk descriptor file will be matched with its hash. Should there not be a hash for some file, the CBT cycle will be reinitialized.

Clean it up whenever you have the chance, leave: active .vmdk and -flat.vmdk files along with the .vmx file. Everything else can be deleted. Make a copy of the VM dir just in case though.

We will reproduce your environment as closely as possible and check the logic.

#424 Re: General matters » Replica with large diff size » 2021-06-16 08:21:54

You are a registered user, contact support, we'll publish an excerpt here

#425 Re: General matters » vmdk not found, but it's there. Backups seem to be stuck (solved) » 2021-06-15 14:25:25

Use this script to kill any ghost processes. The below script will look for any process containing the string "xsi" and kill it.

P="$( ps -c | grep xsi | awk '{print $1}' )";for p in $P;do kill -9 $p;done

Just discard any backup that you can't trust. If it's a replica delete it or rename the folder.
If it's a backup to a deduplicated repository, you may just delete the backup folder, this will maybe keep some useless blocks (some MB), that's the only side effect.
You may very well just keep it there, the reason for removing the backup folder is to avoid believing it's OK in the future, you may also rename the folder to YYYMMDDhhmmss.bad to mark it as a bad backup.

Board footer