©XSIBackup-Free: Free Backup Software for ©VMWare ©ESXi

Forum ©XSIBackup: ©VMWare ©ESXi Backup Software


You are not logged in.

#1526 (c)XSIBackup-Pro & Free Classic bug tracker » Argument --update-cron fails from the command line » 2018-11-07 17:30:19

admin
Replies: 1

Due to some code reorganization error the argument [b][https://33hops.com/xsibackup-help-man-page.html#updatecron]--update-cron[/url][/b] fails from the command line in [b]XSIBACKUP-PRO 11.1.0[/b] and above. It works fine from the GUI though, so use the GUI until we release a fix in next [b]version 11.1.5[/b]

#1527 Re: © OneDiff » Activate XSIDiff license » 2018-11-05 15:45:08

Thank you for the feedback, we'll close this thread by now.

#1528 Re: Rsync » Ignores backup-room parameter via rsync backup » 2018-11-05 10:58:30

XSITools stores files in repositories, as you can see a repository is compounded of a data folder, an .xsitools descriptor file and some timestamped folders which have nothing to do with regular backup folders, they just store the hash maps and auxiliary VM files of every backup operation, but do not contain data, they are not backup folders, they are the intermediate differential data description.

The backup folder is the repository itself, but as you have stored the XSITools repository to the root of the datastore. The backup folder is the datastore, not the [b](c)XSITools[/b] repository and has no name, but the upper level, which is the datastore and cannot be removed.

To have your XSITools repository considered for deletion, place it inside a folder in the root of the datastore, not in the root itself. You must make sure that the folder name follows the [b]datedirmask[/b] convention. You can easily achieve that by using dynamic folders like:

To create a monthly XSITools repository that will be deleted when the disk is full.

--backup-point="/vmfs/volumes/backup/$(date +%Y%m'00000000')"

If you want to store quaterly.

--backup-point="/vmfs/volumes/backup3/$( date +"%Y %m" | awk '{Q=int($2/4)+1; printf("%sQ%s\n", $1, Q);}' )"

You have a more thorough explanation along with examples here:

[url]https://33hops.com/xsibackup-pro-dynamically-naming.html[/url]

#1529 Re: General matters » Unable to restore in XSIBACKUP-PRO 10.3.4 » 2018-11-05 10:40:44

Well, the restore module is asking you to create the restore dir first. You created [b]/vmfs/volumes/datastore1/new_dir[/b], now execute the restore operation again and set the newly created dir as the restore point.

#1530 Re: General matters » line 1: arithmetic syntax error » 2018-11-03 15:54:08

You have some previous errors:

sh: rsync: unknown operand
Error: skipping, not able to retrieve VM information

The [b]arithmetic syntax error[/b] is just a consequence of not having been able to retreive some fundamental information previously.

XSIBackup is not that picky as some people want to believe. Just as long as you have clean paths with no especial characters, just letters, numbers and spaces, except in the datastores names and you have a properly configured host, it will work.

#1531 Re: General matters » Test mode option in GUI for PRO version » 2018-11-03 15:28:00

[b]--test-mode=true[/b] is just an old way to check your SMTP server. We just kept this option for older users, but will remove it in future versions. It will not check that your syntax is O.K., the only way to test a backup job in full is by executing it:

1/ In the command line, by writing the full job and reading the output. Once you have verified the job, you can create a job file inside the [b]xsi-dir/jobs[/b] folder by just appending the [b][https://33hops.com/xsibackup-help-man-page.html#savejob]--save-job=XXX[/url][/b] argument.

2/ By invoking some previously stored job in the xsi-dir/jobs folder via the [b][https://33hops.com/xsibackup-help-man-page.html#runbackup]--run-backup=XXX[/url][/b] argument.

* XXX is the backup Id

#1532 Re: General matters » My error are are all over the map » 2018-11-03 15:22:52

1/ Already answered in [b][https://33hops.com/viewtopic.php?id=337]this previous post[/url][/b]
10/ XSIBackup does not allow especial characters in VM names nor paths, remove the parenthesis.
13/ Same problem as number 1
14/ Same problem as number 1
15/ You seem to have some permission issue in your target datastore.
6 & 7/ comparison of backed up disks failed, the reason for this could vary, but there should be some previous error.

Please, contact support with all the details: full backup job and full output corresponding to the issue, one issue at a time. Some of your problems are related to naming conventions or permission configuration. Our support department will help you with identifying the source of your problem, namely, we will point the possible issue, nevertheless you are responsible for configuring your system.

#1533 Re: General matters » vm onediffbackup error » 2018-11-03 15:09:05

You are trying to overwrite an already existing .vmdk file with Vmkfstools.
The source of the problem could also be the fact that you are pointing to an invalid [b][https://33hops.com/xsibackup-help-man-page.html#backuppoint]--backup-point[/url][/b] path

[url]https://communities.vmware.com/thread/115543[/url]

#1534 Re: General matters » Are the scheduled time based on localtime or UTC? » 2018-11-03 15:05:04

That depends on how you have configured your ESXi clock.

#1535 Re: General matters » Try to schedule job with no luck » 2018-11-03 15:03:37

Well, you probably had duplicated your crond daemon process. The ESXi crond facility is very primitive in terms of usage, it lacks any kind of intialization control. Nevertheless it works well once you know how to deal with it.

Anybody having problems with the crond service should read [b][https://33hops.com/xsibackup-cron-troubleshooting.html]this post[/url][/b]

#1536 Re: © OneDiff » Activate XSIDiff license » 2018-11-03 14:53:42

Have you renamed the license files to [b]license.key[/b] and placed them in the installation root dir (xsi-dir)?
In regards to the second issue, the size mistmatch. Are your two servers coherent in terms of VMFS version?
You are getting this message:

2018-11-03T08:06:03|  [v02] error DIFQMSH3: data size mistmatch: 56984 NE 56156... 

Which means that [b][url=https://linuxcommand.org/lc3_man_pages/du1.html]du -m[/url][/b] is reporting a different number of used blocks.
Resolve issues in order: first make sure your license.key file is correctly installed, once you have fixed that issue, if the size mistmatch problem persists, contact support to diagnose the exact cause.

#1537 Re: Rsync » Ignores backup-room parameter via rsync backup » 2018-11-02 13:17:31

XSIBackup will only make room by deleting folders in the root dir which follow the pattern expressed by the datedirmask variable defined in [b]conf/xsiopts[/b]

Which is the same that the [b]--date-dir=yes[/b] argument uses BTW.

datedirmask="20[1-3][0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9]"

If you have some other data there that does not follow the mask in the root dir, XSIBackup will ignore it. This is by design, XSIBackup cannot happily delete data about which knows nothing.

#1538 Re: General matters » Backup room » 2018-11-01 14:58:35

Most probably some space in your paths. XSIBackup does not support spaces in datastore routes.

#1539 Re: General matters » Logging Suggestion / Idea » 2018-11-01 14:52:37

Logs follow a consistent format, maybe it's not the consistent format that you would like it to be.

We believe standards are important and will consider your complaint as a feature request, we nevertheless have a number of them in the todo list.

Given the fact that no syslog client is available in ESXi and that some would need to be adapted or programmed from scratch, this could take some time.

#1540 Re: General matters » remote job failing to run » 2018-11-01 14:38:30

Is server [b]10.240.100.45[/b] reachable at port 22?
Have you exchanged the RSA key via the [b]--link-srv[/b] argument with [b]10.240.100.45[/b]?
Is XSIBackup really installed to the folder: [b]/vmfs/volumes/esx-data-store[/b] on the remote server?
What do you mean by "no log events"?, are you aware of the fact that the log file will be

xsi-dir/var/logs/xsibackup-10.240.100.45.log

#1541 Re: General matters » Test mode option in GUI for PRO version » 2018-11-01 14:29:19

You can just try them with the [b][https://33hops.com/xsibackup-help-man-page.html#runbackup]--run-backup[/url][/b] argument, which is listed in the [b][https://33hops.com/xsibackup-help-man-page.html]Man Page[/url][/b]

#1542 Re: General matters » Cant find extent map » 2018-10-31 14:39:50

Yes, you are absolutely right, this is a bug, we'll fix it today.

Nevertheless, we must insist in taking the chance and try to convince you to move your VMs to an VMFS volume for the reasons exposed above.

VMFS has been designed to store VMs, whereas ZFS is a general purpose FS. VMFS keeps track of every extent of data stored in your .vmdk files, this allows to jump over zeroed zones, replicate data and run quick algorithms to check data integrity. You loose all that features by using an NFS volume to run your VMs, on top of that, as estated in the previous post you limit bandwith and increase latencies in disk I/O operations.

Just to pose a real life example: backing up a Linux VM in a single .vmdk disk which is 20 gb in size and contains 2.7 gb of data will take (in one of our test servers, which is an i3 with 16 gb. memory and regular HD with a small SSD acting as a host cache disk) 9 minutes if hosted on an NFS share against 1.5 minutes when hosted in an VMFS5 volume, when using [b]XSITools:z[/b] to backup over IP to a Linux server.

#1543 (c)XSIBackup-Pro & Free Classic bug tracker » XSITools not backing up VMs hosted in a non-VMFS volume » 2018-10-31 12:26:34

admin
Replies: 0

We have detected a bug when backing up VMs which are not hosted in an VMFS volume via [b][https://33hops.com/xsitools-vmfs-deduplication.html]XSITools[/url][/b]. The symptoms are some error messages such us:

Can't find extent map at /vmfs/volumes/NAS/VM1/VM1.vmdk.extents

You may as well not get any error, but the VM will not be backed up.

We are currently working in fixing this bug, the fix will be released in short as [b]XSIBackup 11.1.4[/b]
Please, be aware of the fact that storing production VMs in non VMFS volumes is something not recommendable, as ESXi will loose the advantages of hosting files in a file system that has especifically been designed for the purpose. It won't have access to data structure metadata and everything will be slower, including [b][https://33hops.com/xsitools-vmfs-deduplication.html]XSITools[/url][/b] backups.

#1544 Re: General matters » Cant find extent map » 2018-10-31 12:05:17

Please, let us know what your ESXi version and build are and whether you are using [b][https://33hops.com/xsitools-vmfs-deduplication.html]XSITools[/url][/b] as the backup program or not, we have had to guess so far.

#1545 Re: General matters » Cant find extent map » 2018-10-31 11:59:53

NFS is not a file system, although the acronym stands for Network File System, it's a data transport protocol, a real file system is what maps a recording media such as a HD or SSD. If it's a free NAS device that you are using, the underlying filesystem will most probably be ZFS.

We are making tests right now, as the backup should still be performed. In any case, if you host your VMs in a NAS through NFS and a non-VMFS file system, you are not only narrowing your I/O bandwidth down to 1 gbps and increasing I/O latencies wildly, you are also limiting the possibilities of ESXi in regards to managind data and recovering it. NFS NAS can be a great asset to backup your VMs to, but it's definitely not the best choice by far to host your production VMs.

#1546 Re: General matters » Job Monitoring » 2018-10-31 11:13:17

Schedule it in the cron and inspect the log afterwards. If you want to see the output in real time while it is taking place, just use tail -f

tail -f /vmfs/volumes/datastore1/xsi-dir/var/logs/xsibackup.log

#1547 Re: General matters » Cant find extent map » 2018-10-31 11:10:40

Mmm, what kind of file system are you hosting the VMs in?
It could be a bug related to not hosting VMs in an VMFS volume, which is an almost mandatory issue, especially if using [b][https://33hops.com/xsitools-vmfs-deduplication.html]XSITools[/url][/b] to backup your VMs.
We'll check that possibility, in the meanwhile use some other --backup-prog to backup your Virtual Machines.

#1548 Re: General matters » Location of the Clone » 2018-10-30 18:26:47

The VMs are copied, including their disks, where you point the --backup-point argument to, i.e.: /vmfs/volumes/backup

#1549 Re: General matters » AWS S3 bucket size problem » 2018-10-30 18:04:23

O.K., thank you for the explanation. We had just taken a quick glance at the product. Being as you say, there's nothing that should prevent the appliance from being correctly mounted and its size reported accurately.

Please, note that the issue has nothing to do with XSIBackup, as the figures you see from a simple [b]df[/b] command are equally wrong. You should contact Amazon, they should know what's it all about, although I suspect it might be the NFS version. As stated NFS 4.1 will not work from the ESXi shell, this is an ESXi bug and has nothing to do with XSIBackup either, mount the appliance as NFS 3.

#1550 Re: General matters » AWS S3 bucket size problem » 2018-10-29 12:51:55

That product seems to be designed to be used from within S3 environment.
As stated: NFS is not an easy protocol to be used over a WAN. If you are not a computer expert, then you probably have chosen a very picky subject to deal with.

Are you seeing the right figures when issuing df -h from the command line?
XSIBackup just picks the information from the shell.

Board footer