Forum ©XSIBackup: ©VMWare ©ESXi Backup Software
MenuYou are not logged in.
- Topics: Active | Unanswered
Pages: 1
#1 Re: General matters » ror count is: 1 » 2023-03-30 16:17:19
I'm sorry for the late response.
That's all the output I've got, I've only obfuscated some data and deleted . This is not the job output, it's the mail that's send after the job is finished.
I think there's an issue with the mail, further review of the error shows that the line is pointing to the last VM, and that has no errors, so maybe it's messing the output (I think "ror count is: 1" is a trimmed version of "Error count is: 1"):
---------------------
UTC | Mon, 20 Mar 2023 02:40:24
XSIBackup-DC 1.5.0.11
backuphost.eu
License: xx
Session Id: 12929042815674418
ESXi #1 SMP Release build-19193900 Jax86_64
Action: replica
Remote folder: root@xx:22:/vmfs/volumes/Backups/xx
Session Id: 12929042815674418
Num VM Name Size Diff. State Time Speed Compress Errors
1 [9] proxy 100.02 GB 344.55 MB 1 00:01:55 890.58 MB/s 1 0
2 [4] vm1 116.91 GB 16.54 GB 1 00:24:15 82.28 MB/s 1 1
3 [7] vm2 100.02 GB 1.09 GB 1 00:03:40 465.53 MB/s 1 0
4 [1] vm3 200.00 GB 809.40 KB 1 00:01:02 3303.25 MB/s 1 0
5 [6] vm4 320.02 GB 2.30 MB 1 00:01:50 2979.07 MB/s 1 0
6 [3] vm5 100.02 GB 2.35 MB 1 00:01:18 1313.15 MB/s 1 0
7 [11] vm6 200.01 GB 2.58 MB 1 00:01:24 2438.19 MB/s 1 0
8 [13] vm7 50.00 GB 1.98 MB 1 00:01:07 764.21 MB/s 1 0
9 [10] vm8 120.00 GB 2.21 MB 1 00:01:21 1517.08 MB/s 1 0
Time taken: 00:37:52 (2272 sec.)
Detected errors:
· vm1: 2023-03-20T02:02:48 | Error code 1223 at file esxi.c, line 1223 | Error description: could not create snapshot in vm1, error: KO
· vm8: ror count is: 1
--------------------------
Once I solved the error with vm1, the error on vm8 is also gone.
#2 General matters » ror count is: 1 » 2023-03-13 08:58:04
- underdpt
- Replies: 2
Hello,
I have this message on one of my backups:
---------------------------------------------------
UTC | Mon, 13 Mar 2023 02:42:43
XSIBackup-DC 1.5.0.11
xx
License: xx
Session Id: xx
ESXi #1 SMP Release build-19193900 Jax86_64
Action: replica
Remote folder: xx@xx:xx:/vmfs/volumes/Backups/backups_esxi4
Session Id: xx
Num VM Name Size Diff. State Time Speed Compress Errors
...deleted...
9 [10] cloud.xx.es 120.00 GB 1.85 MB 1 00:01:21 1517.07 MB/s 1 0
Time taken: 00:40:08 (2408 sec.)
Detected errors:
· cloud.xx.es: ror count is: 1
-------------------------------------
I've searched on google and the forum, found nothing. What does it means?
#3 Feature requests & improvements » Add smart info (like XSI Backup Pro) » 2021-08-17 13:55:25
- underdpt
- Replies: 1
Hello,
It would be very helpful to add smart info like XSI Backup Pro does to the email.
Also some option to not replicate if smart indicates that some disk is going to fail. That way the remote replica won't get destroyed if the copy process fails or the disk fails (that hit me just a few days ago).
Best regards,
#4 Re: General matters » Issue on ESXi 5.5: sh: syntax error: unterminated quoted string » 2021-08-02 06:30:46
Hello,
First, I wanna thank you for your kind support. Much appreciated!
FYI, the remote host is hosting backups from serveral systems correctly, all from XSIBackup, so I think the remote host isn't involved in this problem. All the other hosts doing backups to this same remote host are EXSi 6.5 or higher, that's why I though the ESXi version of the system was involved on the error.
#5 Re: General matters » Issue on ESXi 5.5: sh: syntax error: unterminated quoted string » 2021-07-31 12:55:49
Hello,
">1" is to send all strace output to a file.
"--mail-to" is missing the "--" due to a copy/paste error.
This is the output of the command:
# ./xsibackup --replica=cbt "VMs(Lecturas)" root@REDACTED:22:/vmfs/volumes/Backups/backups_ctec
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
||| (c)XSIBackup-DC 1.5.0.11: Backup & Replication Software |||
||| (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
(c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 5 Major 5 Minor 0 Patch 0
-------------------------------------------------------------------------------------------------------------
License: 000306A90000000000000000e06995d797e0 | (c)XSIBackup-DC
-------------------------------------------------------------------------------------------------------------
Remote system: ESXi
-------------------------------------------------------------------------------------------------------------
PID: 524375708, Running job as: root
-------------------------------------------------------------------------------------------------------------
Remote xsibackup binary found at: /scratch/XSI/XSIBackup-DC/xsibackup
-------------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC replicating data to /vmfs/volumes/Backups/backups_ctec
-------------------------------------------------------------------------------------------------------------
Performing --replica action
-------------------------------------------------------------------------------------------------------------
Backup folder '/vmfs/volumes/Backups/backups_ctec'
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-31T10:01:55 | Error code 1500 at file common.c, line 1500 | Error description: could not get remote FS available space at /vmfs/volumes/Backups/backups_ctec, details: No such file or directory
-------------------------------------------------------------------------------------------------------------
Available space in backup volume: -1 (17179.87 PB)
-------------------------------------------------------------------------------------------------------------
Lecturas Hardware Version is: 8
-------------------------------------------------------------------------------------------------------------
All snapshots were removed, as Lecturas is engaged in a CBT job
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-31T10:01:57 | Error code 3477 at file xsibackup.c, line 3477 | Error description: could not delete snapshot files for VM(0) Lecturas_XSIREP, error:
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: Lecturas
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : Lecturas (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
Virtual Machine: Lecturas
-------------------------------------------------------------------------------------------------------------
Backup start date: 2021-07-31T10:02:10
-------------------------------------------------------------------------------------------------------------
2021-07-31 10:02:10 | Backing up 23 files, total size is 204.12 GB
-------------------------------------------------------------------------------------------------------------
NUMBER FILE SIZE PROGRESS
-------------------------------------------------------------------------------------------------------------
1/23 Lecturas.vmx 3.19 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2/23 Lecturas.vmxf 3.19 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
3/23 Lecturas.vmsd 446.00 B | Done 0.00%
-------------------------------------------------------------------------------------------------------------
4/23 Lecturas-flat.vmdk (CBT 147) 200.00 GB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
::: detail ::: 100.00% done | block 204800 out of 204800 | Done 97.98%
-------------------------------------------------------------------------------------------------------------
5/23 Lecturas.vmdk 557.00 B | Done 97.98%
-------------------------------------------------------------------------------------------------------------
6/23 vmware-1.log 590.96 KB | Done 97.98%
-------------------------------------------------------------------------------------------------------------
7/23 vmware-3.log 165.28 KB | Done 97.98%
-------------------------------------------------------------------------------------------------------------
8/23 Lecturas.nvram 8.48 KB | Done 97.98%
-------------------------------------------------------------------------------------------------------------
9/23 vmware-2.log 173.00 KB | Done 97.98%
-------------------------------------------------------------------------------------------------------------
10/23 vmware-4.log 3.47 MB | Done 97.98%
-------------------------------------------------------------------------------------------------------------
11/23 vmx-Lecturas-1993332819-1.vswp [open excluded]
-------------------------------------------------------------------------------------------------------------
12/23 Lecturas.vmx.lck [skipped excluded]
-------------------------------------------------------------------------------------------------------------
13/23 Lecturas.vmx~ 3.18 KB | Done 97.98%
-------------------------------------------------------------------------------------------------------------
14/23 vmware.log 1.05 MB | Done 97.98%
-------------------------------------------------------------------------------------------------------------
15/23 Lecturas-76cfd853.vswp [open excluded]
-------------------------------------------------------------------------------------------------------------
16/23 Lecturas-ctk.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
17/23 Lecturas.vmsd.tmp 44.00 B | Done 97.98%
-------------------------------------------------------------------------------------------------------------
18/23 Lecturas.vmx.tmp 3.18 KB | Done 97.98%
-------------------------------------------------------------------------------------------------------------
19/23 Lecturas-aux.xml 13.00 B | Done 97.98%
-------------------------------------------------------------------------------------------------------------
20/23 Lecturas-Snapshot13.vmsn 31.03 KB | Done 97.98%
-------------------------------------------------------------------------------------------------------------
21/23 Lecturas-000001-delta.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
22/23 Lecturas-000001.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
23/23 Lecturas-000001-ctk.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
Total size: 200.01 GB | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-31T10:09:47 | Error code 4287 at file xsibackup.c, line 4287 | Error description: could not remove CTK Info from .vmx.tmp file, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-31T10:09:47 | Error code 4301 at file xsibackup.c, line 4301 | Error description: could not remove CTK info from .vmdk file descriptors, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-31T10:09:47 | Error code 4316 at file xsibackup.c, line 4316 | Error description: could not update the .vmdk file descriptors hashes, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-31T10:09:47 | Error code 4334 at file xsibackup.c, line 4334 | Error description: could not rename .vmx.tmp file to .vmx, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-31T10:09:48 | Error code 4343 at file xsibackup.c, line 4343 | Error description: could not rename .vmsd.tmp file to .vmsd, error:
-------------------------------------------------------------------------------------------------------------
Backup end date: 2021-07-31T10:08:51
-------------------------------------------------------------------------------------------------------------
Time taken: 00:06:41 (401 sec.)
-------------------------------------------------------------------------------------------------------------
Total time: 401 sec.
-------------------------------------------------------------------------------------------------------------
Full file speed: 510.74 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed: 11.18 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed with errors
-------------------------------------------------------------------------------------------------------------
Final checksum: 2188883130 bytes were sent and confirmed to have been written remotely
-------------------------------------------------------------------------------------------------------------
2021-07-31T10:09:49 | Error code 4574 at file xsibackup.c, line 4574 | Error description: some error/s were raised while backing up: VMs(Lecturas), error count is: 7
-------------------------------------------------------------------------------------------------------------
Removed host <tmp> dir OK
-------------------------------------------------------------------------------------------------------------
Removed prog <tmp> dir OK
-------------------------------------------------------------------------------------------------------------
Unlocked backup OK
-------------------------------------------------------------------------------------------------------------I also removed the destination folder to be sure there's nothing in it causing the error. This is the result after removing the folder:
# ./xsibackup --replica=cbt "VMs(Lecturas)" root@REDACTED:22:/vmfs/volumes/Backups/backups_ctec
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
||| (c)XSIBackup-DC 1.5.0.11: Backup & Replication Software |||
||| (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
(c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 5 Major 5 Minor 0 Patch 0
-------------------------------------------------------------------------------------------------------------
License: 000306A90000000000000000e06995d797e0 | (c)XSIBackup-DC
-------------------------------------------------------------------------------------------------------------
Remote system: ESXi
-------------------------------------------------------------------------------------------------------------
PID: 524377608, Running job as: root
-------------------------------------------------------------------------------------------------------------
Remote xsibackup binary found at: /scratch/XSI/XSIBackup-DC/xsibackup
-------------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC replicating data to /vmfs/volumes/Backups/backups_ctec
-------------------------------------------------------------------------------------------------------------
Performing --replica action
-------------------------------------------------------------------------------------------------------------
Backup folder '/vmfs/volumes/Backups/backups_ctec'
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-31T10:11:24 | Error code 1500 at file common.c, line 1500 | Error description: could not get remote FS available space at /vmfs/volumes/Backups/backups_ctec, details: No such file or directory
-------------------------------------------------------------------------------------------------------------
Available space in backup volume: -1 (17179.87 PB)
-------------------------------------------------------------------------------------------------------------
Lecturas Hardware Version is: 8
-------------------------------------------------------------------------------------------------------------
All snapshots were removed, as Lecturas is engaged in a CBT job
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-31T10:11:26 | Error code 3477 at file xsibackup.c, line 3477 | Error description: could not delete snapshot files for VM(0) Lecturas_XSIREP, error:
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: Lecturas
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : Lecturas (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
Remote target dir is empty, full sync will be performed
-------------------------------------------------------------------------------------------------------------
Virtual Machine: Lecturas
-------------------------------------------------------------------------------------------------------------
Backup start date: 2021-07-31T10:11:40
-------------------------------------------------------------------------------------------------------------
2021-07-31 10:11:40 | Backing up 23 files, total size is 204.14 GB
-------------------------------------------------------------------------------------------------------------
NUMBER FILE SIZE PROGRESS
-------------------------------------------------------------------------------------------------------------
1/23 Lecturas.vmx 3.19 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2/23 Lecturas.vmxf 3.19 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
3/23 Lecturas.vmsd 447.00 B | Done 0.00%
-------------------------------------------------------------------------------------------------------------
4/23 Lecturas-flat.vmdk (CBT 1 full) 200.00 GB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
::: detail ::: 100.00% done | block 204800 out of 204800 | Done 97.97%
-------------------------------------------------------------------------------------------------------------
5/23 Lecturas.vmdk 557.00 B | Done 97.97%
-------------------------------------------------------------------------------------------------------------
6/23 vmware-1.log 590.96 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
7/23 vmware-3.log 165.28 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
8/23 Lecturas.nvram 8.48 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
9/23 vmware-2.log 173.00 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
10/23 vmware-4.log 3.47 MB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
11/23 vmx-Lecturas-1993332819-1.vswp [open excluded]
-------------------------------------------------------------------------------------------------------------
12/23 Lecturas.vmx.lck [skipped excluded]
-------------------------------------------------------------------------------------------------------------
13/23 Lecturas.vmx~ 3.18 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
14/23 vmware.log 1.08 MB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
15/23 Lecturas-76cfd853.vswp [open excluded]
-------------------------------------------------------------------------------------------------------------
16/23 Lecturas-ctk.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
17/23 Lecturas.vmsd.tmp 44.00 B | Done 97.97%
-------------------------------------------------------------------------------------------------------------
18/23 Lecturas.vmx.tmp 3.18 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
19/23 Lecturas-aux.xml 13.00 B | Done 97.97%
-------------------------------------------------------------------------------------------------------------
20/23 Lecturas-Snapshot14.vmsn 31.03 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
21/23 Lecturas-000001-delta.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
22/23 Lecturas-000001.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
23/23 Lecturas-000001-ctk.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
Total size: 200.01 GB | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-31T12:36:23 | Error code 4287 at file xsibackup.c, line 4287 | Error description: could not remove CTK Info from .vmx.tmp file, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-31T12:36:23 | Error code 4301 at file xsibackup.c, line 4301 | Error description: could not remove CTK info from .vmdk file descriptors, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-31T12:36:24 | Error code 4316 at file xsibackup.c, line 4316 | Error description: could not update the .vmdk file descriptors hashes, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-31T12:36:24 | Error code 4334 at file xsibackup.c, line 4334 | Error description: could not rename .vmx.tmp file to .vmx, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-31T12:36:24 | Error code 4343 at file xsibackup.c, line 4343 | Error description: could not rename .vmsd.tmp file to .vmsd, error:
-------------------------------------------------------------------------------------------------------------
Backup end date: 2021-07-31T12:35:34
-------------------------------------------------------------------------------------------------------------
Time taken: 02:23:54 (8634 sec.)
-------------------------------------------------------------------------------------------------------------
Total time: 8634 sec.
-------------------------------------------------------------------------------------------------------------
Full file speed: 23.72 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed: 9.67 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed with errors
-------------------------------------------------------------------------------------------------------------
Final checksum: 77400130812 bytes were sent and confirmed to have been written remotely
-------------------------------------------------------------------------------------------------------------
2021-07-31T12:36:25 | Error code 4574 at file xsibackup.c, line 4574 | Error description: some error/s were raised while backing up: VMs(Lecturas), error count is: 7
-------------------------------------------------------------------------------------------------------------
Removed host <tmp> dir OK
-------------------------------------------------------------------------------------------------------------
Removed prog <tmp> dir OK
-------------------------------------------------------------------------------------------------------------
Unlocked backup OK
-------------------------------------------------------------------------------------------------------------#6 Re: General matters » Issue on ESXi 5.5: sh: syntax error: unterminated quoted string » 2021-07-30 17:55:43
Hello,
This is the command:
strace ./xsibackup --replica=cbt "VMs(Lecturas)" root@REDACTED:22:/vmfs/volumes/Backups/backups_ctec mail-to=REDACTED --subject="Backup ESXi CTEC" --html-template=001 1> /vmfs/volumes/datastore1/xsibackup_strace.log 2>&1I'm unable to send the full strace log, I tried to remove some parts to 340kb but the forum throws an 404 error.
You can download it from:
https://cloud.mainsip.com/index.php/s/5e7fe5tvdQqRjJo
If you need the original log, please give me an email address as I don't want to put it on a public forum.
Thanks for your support.
#7 Re: General matters » Issue on ESXi 5.5: sh: syntax error: unterminated quoted string » 2021-07-30 07:44:21
I'm sorry you didn't understood me (maybe my English isn't so good).
I didn't rename or remove anything, I'm talking about the messages logged on the backup:
...
All snapshots were removed, as Lecturas is engaged in a CBT job
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T15:56:43 | Error code 3477 at file xsibackup.c, line 3477 | Error description: could not delete snapshot files for VM(0) Lecturas_XSIREP, error:
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: Lecturas
....
Total size: 200.00 GB | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T18:28:25 | Error code 4287 at file xsibackup.c, line 4287 | Error description: could not remove CTK Info from .vmx.tmp file, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T18:28:25 | Error code 4301 at file xsibackup.c, line 4301 | Error description: could not remove CTK info from .vmdk file descriptors, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T18:28:25 | Error code 4316 at file xsibackup.c, line 4316 | Error description: could not update the .vmdk file descriptors hashes, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T18:28:26 | Error code 4334 at file xsibackup.c, line 4334 | Error description: could not rename .vmx.tmp file to .vmx, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T18:28:26 | Error code 4343 at file xsibackup.c, line 4343 | Error description: could not rename .vmsd.tmp file to .vmsd, error:
-------------------------------------------------------------------------------------------------------------
Backup end date: 2021-07-23T18:27:18So, to synthetize:
- I'm trying to backup a ESXi 5.5 host
- XSIBackup tries to remove a VM that didn't exist (Lecturas_XSIREP). I never ran the backup with the argument --options=R
- XSIBackup tries to remove CTK Info from .vmx.tmp and from .vmdk file descriptors / descriptor hashes, and it fails due to a syntax error
- XSIBackup tries to rename .vmx.tmp file to .vmx and .vmsd.tmp file to .vmsd, that fails due to a syntax error
I'm going to try an scp copy and then upgrade the host, but it felt that you should know about these, so that's why I did the report.
#8 Re: Feature requests & improvements » Add some email content flexibility » 2021-07-30 07:22:03
Yeah, I know that, but that doesn't include accessing backup data to present it on a custom format, you only have one placeholder for the full backup data, or am I missing something?
#9 Re: General matters » Issue on ESXi 5.5: sh: syntax error: unterminated quoted string » 2021-07-30 07:18:22
Yeah, it exists in the remote FS. Indeed, XSIBackup did create it on first backup test. Also the backup somehow works, it seems to fail when removing the CTK info or renaming some files. This is the content of one VM backup dir:
[root@REDACTED:/vmfs/volumes/5ba26f3e-372b4cf8-8bb0-ac1f6b16e426/backups_ctec/Lecturas] ls -la
total 75598464
drwxr-xr-x 1 root root 77824 Jul 24 09:03 .
drwxr-xr-x 1 root root 73728 Jul 23 19:54 ..
drwxr-xr-x 1 root root 77824 Jul 24 09:03 .map
-rw-r--r-- 1 root root 17190912 Jul 24 09:01 Lecturas-000002-delta.vmdk
-rw-r--r-- 1 root root 387 Jul 24 09:01 Lecturas-000002.vmdk
-rw-r--r-- 1 root root 31777 Jul 23 18:38 Lecturas-Snapshot1.vmsn
-rw-r--r-- 1 root root 31777 Jul 24 07:28 Lecturas-Snapshot2.vmsn
-rw-r--r-- 1 root root 31784 Jul 24 09:02 Lecturas-Snapshot3.vmsn
-rw-r--r-- 1 root root 214748364800 Jul 24 08:58 Lecturas-flat.vmdk
-rw-r--r-- 1 root root 8684 Jul 24 09:01 Lecturas.nvram
-rw-r--r-- 1 root root 557 Jul 24 09:00 Lecturas.vmdk
-rw-r--r-- 1 root root 483 Jul 24 08:47 Lecturas.vmsd
-rw-r--r-- 1 root root 77 Jul 24 09:01 Lecturas.vmsd.tmp
-rw-r--r-- 1 root root 3262 Jul 24 08:47 Lecturas.vmx
-rw-r--r-- 1 root root 3262 Jul 24 09:01 Lecturas.vmx.tmp
-rw-r--r-- 1 root root 3263 Jul 24 08:47 Lecturas.vmxf
-rw-r--r-- 1 root root 3262 Jul 24 09:01 Lecturas.vmx~
-rw-r--r-- 1 root root 605141 Jul 24 09:01 vmware-1.log
-rw-r--r-- 1 root root 177153 Jul 24 09:01 vmware-2.log
-rw-r--r-- 1 root root 169246 Jul 24 09:01 vmware-3.log
-rw-r--r-- 1 root root 3634137 Jul 24 09:01 vmware-4.log
-rw-r--r-- 1 root root 443310 Jul 24 09:01 vmware.log#10 Re: General matters » Jobs are saved with wrong executable path » 2021-07-29 16:19:42
No, I'm not using the GUI.
What I do is test some backups with the CLI, and once I'm satisfied I simply add the --save-job option to the command.
#11 General matters » Jobs are saved with wrong executable path » 2021-07-28 07:23:30
- underdpt
- Replies: 3
Hello,
I'm configuring two new hosts to backup (thanks for the license offer, btw!) and on both hosts the saved jobs executable path is wrong:
This is what i found on xsibackup.log:
/scratch/XSI/XSIBackup-DC/etc/jobs/001: line 8: /vmfs/volumes/5ad9b7f9-64891fd0-c055-e840f20ae690/XSI/XSIBackup-DC/xsibackup/xsibackup: not foundAnd the job:
/vmfs/volumes/5ad9b7f9-64891fd0-c055-e840f20ae690/XSI/XSIBackup-DC/xsibackup/xsibackup \
--replica \
"VMs(##REDACTED##)" \
"root@##REDACTED##:22:/vmfs/volumes/Backups/backups_exi2" \
--mail-to=##REDACTED## \
--html-template=001 \
--subject="Backup ESXi 2" \
>> /vmfs/volumes/5ad9b7f9-64891fd0-c055-e840f20ae690/XSI/XSIBackup-DC/var/log/xsibackup.log 2>&1As you can see, there's an extra "/xsibackup" on the first job line, that i've removed manually.
This is on version 1.5.0.11
#12 Feature requests & improvements » Add some email content flexibility » 2021-07-28 06:29:49
- underdpt
- Replies: 3
Hello,
We have a custom log monitoring tool that processes the emails from our customer's backup solutions. It's a simple solution that can be configured to scan the subject or the body of the email, searching for some words, mainly 'success' to mark a backup as good or 'failure' or 'error' to mark a backup as bad.
We cannot use this solution with XSIBackup emails. We cannot add the state of the backup to the subject, and the body contains a error count for each VM, which is hard to process as the body cannot be modified to add some tags.
I would suggest to add some placeholders to the subject and body that you can add when neccesary, for example:
%RESULT%: 'success' if no error found, 'failed' if any error was found
%VMS%: comma separated list of VMs for the backup
%STARTDATE%
%ENDDATE%
%TOTALTIME%
%ACTION%
%XSIVERSION%
%ESXIVERSION%
%HOSTNAME%
I would also suggest adding one more column to the table with the individual result for each backup, so you can see ...Speed - Compress - Errors - Result (success or failed)
Regards,
#13 Re: General matters » Issue on ESXi 5.5: sh: syntax error: unterminated quoted string » 2021-07-28 06:15:49
Thanks for your quick answer!
I was trying to have a replica before upgrading :-) I'll go with scp, then upgrade, then XSIBackup doing our regular replicas off-site.
#14 General matters » Issue on ESXi 5.5: sh: syntax error: unterminated quoted string » 2021-07-24 08:49:26
- underdpt
- Replies: 15
Hello,
I'm trying to implement XSIBackup DC on one older host with ESXi 5.5, and it's throwing this error on some opertions:
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
||| (c)XSIBackup-DC 1.5.0.11: Backup & Replication Software |||
||| (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
(c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 5 Major 5 Minor 0 Patch 0
-------------------------------------------------------------------------------------------------------------
License: 000306A90000000000000000e06995d797e0 | (c)XSIBackup-DC
-------------------------------------------------------------------------------------------------------------
Remote system: ESXi
-------------------------------------------------------------------------------------------------------------
PID: 522583668, Running job as: root
-------------------------------------------------------------------------------------------------------------
Remote xsibackup binary found at: /scratch/XSI/XSIBackup-DC/xsibackup
-------------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC replicating data to /vmfs/volumes/Backups/backups_ctec
-------------------------------------------------------------------------------------------------------------
Performing --replica action
-------------------------------------------------------------------------------------------------------------
Backup folder '/vmfs/volumes/Backups/backups_ctec'
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T15:39:36 | Error code 1500 at file common.c, line 1500 | Error description: could not get remote FS available space at /vmfs/volumes/Backups/backups_ctec, details: No such file or directory
-------------------------------------------------------------------------------------------------------------
Available space in backup volume: -1 (17179.87 PB)
-------------------------------------------------------------------------------------------------------------
pfsense Hardware Version is: 8
-------------------------------------------------------------------------------------------------------------
All snapshots were removed, as pfsense is engaged in a CBT job
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T15:39:40 | Error code 3477 at file xsibackup.c, line 3477 | Error description: could not delete snapshot files for VM(0) pfsense_XSIREP, error:
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: pfsense
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : pfsense (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
Remote target dir is empty, full sync will be performed
-------------------------------------------------------------------------------------------------------------
Virtual Machine: pfsense
-------------------------------------------------------------------------------------------------------------
Backup start date: 2021-07-23T15:40:10
-------------------------------------------------------------------------------------------------------------
2021-07-23 15:40:10 | Backing up 21 files, total size is 9.12 GB
-------------------------------------------------------------------------------------------------------------
NUMBER FILE SIZE PROGRESS
-------------------------------------------------------------------------------------------------------------
1/21 pfsense.vmx 3.17 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2/21 pfsense.vmxf 262.00 B | Done 0.00%
-------------------------------------------------------------------------------------------------------------
3/21 pfsense.vmsd 439.00 B | Done 0.00%
-------------------------------------------------------------------------------------------------------------
4/21 pfsense-flat.vmdk (CBT 1 full) 8.00 GB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
::: detail ::: 100.00% done | block 8192 out of 8192 | Done 87.68%
-------------------------------------------------------------------------------------------------------------
5/21 pfsense.vmdk 527.00 B | Done 87.68%
-------------------------------------------------------------------------------------------------------------
6/21 pfsense.nvram 8.48 KB | Done 87.68%
-------------------------------------------------------------------------------------------------------------
7/21 vmware-1.log 129.13 KB | Done 87.68%
-------------------------------------------------------------------------------------------------------------
8/21 vmware-2.log 130.81 KB | Done 87.69%
-------------------------------------------------------------------------------------------------------------
9/21 vmware-3.log 130.72 KB | Done 87.69%
-------------------------------------------------------------------------------------------------------------
10/21 vmx-pfsense-2229485668-1.vswp [open excluded]
-------------------------------------------------------------------------------------------------------------
11/21 pfsense.vmx.lck [skipped excluded]
-------------------------------------------------------------------------------------------------------------
12/21 pfsense.vmx~ 3.16 KB | Done 87.69%
-------------------------------------------------------------------------------------------------------------
13/21 vmware.log 102.71 KB | Done 87.69%
-------------------------------------------------------------------------------------------------------------
14/21 pfsense-84e34064.vswp [open excluded]
-------------------------------------------------------------------------------------------------------------
15/21 pfsense-ctk.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
16/21 pfsense.vmsd.tmp 0.00 B | Done 87.69%
-------------------------------------------------------------------------------------------------------------
17/21 pfsense.vmx.tmp 3.16 KB | Done 87.69%
-------------------------------------------------------------------------------------------------------------
18/21 pfsense-Snapshot1.vmsn 28.08 KB | Done 87.69%
-------------------------------------------------------------------------------------------------------------
19/21 pfsense-000001-delta.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
20/21 pfsense-000001.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
21/21 pfsense-000001-ctk.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
Total size: 8.00 GB | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T15:56:13 | Error code 4287 at file xsibackup.c, line 4287 | Error description: could not remove CTK Info from .vmx.tmp file, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T15:56:13 | Error code 4301 at file xsibackup.c, line 4301 | Error description: could not remove CTK info from .vmdk file descriptors, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T15:56:14 | Error code 4316 at file xsibackup.c, line 4316 | Error description: could not update the .vmdk file descriptors hashes, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T15:56:15 | Error code 4334 at file xsibackup.c, line 4334 | Error description: could not rename .vmx.tmp file to .vmx, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T15:56:18 | Error code 4343 at file xsibackup.c, line 4343 | Error description: could not rename .vmsd.tmp file to .vmsd, error:
-------------------------------------------------------------------------------------------------------------
Backup end date: 2021-07-23T15:46:06
-------------------------------------------------------------------------------------------------------------
Time taken: 00:05:56 (356 sec.)
-------------------------------------------------------------------------------------------------------------
Total time: 356 sec.
-------------------------------------------------------------------------------------------------------------
Full file speed: 23.01 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed: 67.04 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed with errors
-------------------------------------------------------------------------------------------------------------
Item number 2 in this job
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T15:56:39 | Error code 1500 at file common.c, line 1500 | Error description: could not get remote FS available space at /vmfs/volumes/Backups/backups_ctec, details: No such file or directory
-------------------------------------------------------------------------------------------------------------
Available space in backup volume: -1 (17179.87 PB)
-------------------------------------------------------------------------------------------------------------
Lecturas Hardware Version is: 8
-------------------------------------------------------------------------------------------------------------
All snapshots were removed, as Lecturas is engaged in a CBT job
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T15:56:43 | Error code 3477 at file xsibackup.c, line 3477 | Error description: could not delete snapshot files for VM(0) Lecturas_XSIREP, error:
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: Lecturas
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : Lecturas (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
Remote target dir is empty, full sync will be performed
-------------------------------------------------------------------------------------------------------------
Virtual Machine: Lecturas
-------------------------------------------------------------------------------------------------------------
Backup start date: 2021-07-23T15:57:16
-------------------------------------------------------------------------------------------------------------
2021-07-23 15:57:16 | Backing up 22 files, total size is 204.14 GB
-------------------------------------------------------------------------------------------------------------
NUMBER FILE SIZE PROGRESS
-------------------------------------------------------------------------------------------------------------
1/22 Lecturas.vmx 3.19 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2/22 Lecturas.vmxf 3.19 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
3/22 Lecturas.vmsd 442.00 B | Done 0.00%
-------------------------------------------------------------------------------------------------------------
4/22 Lecturas-flat.vmdk (CBT 1 full) 200.00 GB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
::: detail ::: 100.00% done | block 204800 out of 204800 | Done 97.97%
-------------------------------------------------------------------------------------------------------------
5/22 Lecturas.vmdk 557.00 B | Done 97.97%
-------------------------------------------------------------------------------------------------------------
6/22 vmware-1.log 590.96 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
7/22 vmware-3.log 165.28 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
8/22 Lecturas.nvram 8.48 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
9/22 vmware-2.log 173.00 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
10/22 vmware-4.log 3.47 MB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
11/22 vmx-Lecturas-1993332819-1.vswp [open excluded]
-------------------------------------------------------------------------------------------------------------
12/22 Lecturas.vmx.lck [skipped excluded]
-------------------------------------------------------------------------------------------------------------
13/22 Lecturas.vmx~ 3.18 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
14/22 vmware.log 197.17 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
15/22 Lecturas-76cfd853.vswp [open excluded]
-------------------------------------------------------------------------------------------------------------
16/22 Lecturas-ctk.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
17/22 Lecturas.vmsd.tmp 0.00 B | Done 97.97%
-------------------------------------------------------------------------------------------------------------
18/22 Lecturas.vmx.tmp 3.18 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
19/22 Lecturas-Snapshot1.vmsn 31.03 KB | Done 97.97%
-------------------------------------------------------------------------------------------------------------
20/22 Lecturas-000001-delta.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
21/22 Lecturas-000001.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
22/22 Lecturas-000001-ctk.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
Total size: 200.00 GB | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T18:28:25 | Error code 4287 at file xsibackup.c, line 4287 | Error description: could not remove CTK Info from .vmx.tmp file, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T18:28:25 | Error code 4301 at file xsibackup.c, line 4301 | Error description: could not remove CTK info from .vmdk file descriptors, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T18:28:25 | Error code 4316 at file xsibackup.c, line 4316 | Error description: could not update the .vmdk file descriptors hashes, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T18:28:26 | Error code 4334 at file xsibackup.c, line 4334 | Error description: could not rename .vmx.tmp file to .vmx, error:
-------------------------------------------------------------------------------------------------------------
sh: syntax error: unterminated quoted string
2021-07-23T18:28:26 | Error code 4343 at file xsibackup.c, line 4343 | Error description: could not rename .vmsd.tmp file to .vmsd, error:
-------------------------------------------------------------------------------------------------------------
Backup end date: 2021-07-23T18:27:18
-------------------------------------------------------------------------------------------------------------
Time taken: 02:30:02 (9002 sec.)
-------------------------------------------------------------------------------------------------------------
Total time: 9358 sec.
-------------------------------------------------------------------------------------------------------------
Full file speed: 22.75 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed: 10.13 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed with errors
-------------------------------------------------------------------------------------------------------------
Item number 3 in this job
-------------------------------------------------------------------------------------------------------------
-- lines deleted due to forum constraints -
-------------------------------------------------------------------------------------------------------------
2021-07-23T19:54:18 | Error code 4574 at file xsibackup.c, line 4574 | Error description: some error/s were raised while backing up: VMs(pfsense,Lecturas,mysql server,ownCloud), error count is: 28
-------------------------------------------------------------------------------------------------------------
Removed host <tmp> dir OK
-------------------------------------------------------------------------------------------------------------
Removed prog <tmp> dir OK
-------------------------------------------------------------------------------------------------------------
Unlocked backup OK
-------------------------------------------------------------------------------------------------------------The backup target is a ESXi host version 6.5.0, don't know if that matters.
I tried without CBT and errors persist.
Any suggestion?
#15 Re: General matters » Error description: can't open output file: /vmfs/volumes/... » 2021-05-31 05:42:59
Hello,
Ok, I finally found the culprit. It wasn't the tmp dir, there was the numeric subfolders empty, but the tmp dir was writable and not full.
This was a test machine with the old xsibackup installed. I think maybe some library was messing up and that's why it failed. Just uninstalling that xsibackup did the trick.
Thanks for your quick support!
#16 Re: General matters » Error description: can't open output file: /vmfs/volumes/... » 2021-05-28 16:13:28
Thanks for your quick answer!!!
My command did work when doing backups through ssh to the local server, so I assumed it would work pointing to a remote server.
Anyway, changing the command to the one suggested did not work, the error being the same :-(
#17 General matters » Error description: can't open output file: /vmfs/volumes/... » 2021-05-28 15:51:42
- underdpt
- Replies: 4
Hello,
I'm a user of the legacy xsibackup-pro and willing to move to xsibackup-dc, so I'm doing some tests with the trial version.
Doing local backups works fine, even doing local backups through ssh (for testing purposes). But when I try to do a backup to another ESXi host through ssh, the remote folder is created but nothing is copied, i get this error for every file:
2021-05-28T16:04:18 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/pfsense-Snapshot21.vmsnI'm not sure what can be happening here, as the user sure has permissions (root user, indeed the folder is succesfully created). This is the command i'm using:
./xsibackup --replica /vmfs/volumes/datastore1/pfsense/ root@my.remote.eu:22:/vmfs/volumes/Backups/backups_exi2This is the full output:
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
||| (c)XSIBackup-Free 1.5.0.5: Backup & Replication Software |||
||| (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
(c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 6 Major 5 Minor 0 Patch 0
-------------------------------------------------------------------------------------------------------------
License: unlicensed trial version, remaining trial time: 91:55:14 | (c)XSIBackup-Free
-------------------------------------------------------------------------------------------------------------
Remote system: ESXi
-------------------------------------------------------------------------------------------------------------
PID: 51003851, Running job as: root
-------------------------------------------------------------------------------------------------------------
Remote xsibackup binary found at: /scratch/XSI/XSIBackup-DC/xsibackup
-------------------------------------------------------------------------------------------------------------
SOURCE: /vmfs/volumes/5ad9b7f8-b3e2885a-2796-e840f20ae690/pfsense
-------------------------------------------------------------------------------------------------------------
(c)XSIBackup-Free replicating data to /vmfs/volumes/Backups/backups_exi2
-------------------------------------------------------------------------------------------------------------
Performing --replica action
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
pfsense Hardware Version is: 13
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: pfsense
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : pfsense (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
Virtual Machine: pfsense
-------------------------------------------------------------------------------------------------------------
Backup start date: 2021-05-28T16:04:57
-------------------------------------------------------------------------------------------------------------
2021-05-28 16:04:57 | Backing up 23 files, total size is 17.13 GB
-------------------------------------------------------------------------------------------------------------
NUMBER FILE SIZE PROGRESS
-------------------------------------------------------------------------------------------------------------
1/23 pfsense.vmx 3.26 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:01 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/pfsense.vmx
-------------------------------------------------------------------------------------------------------------
2/23 pfsense-flat.vmdk 16.00 GB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:02 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/pfsense-flat.vmdk
-------------------------------------------------------------------------------------------------------------
3/23 pfsense.vmdk 587.00 B | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:03 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/pfsense.vmdk
-------------------------------------------------------------------------------------------------------------
4/23 pfsense.vmsd 443.00 B | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:04 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/pfsense.vmsd
-------------------------------------------------------------------------------------------------------------
5/23 pfsense.nvram 8.48 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:04 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/pfsense.nvram
-------------------------------------------------------------------------------------------------------------
6/23 vmware-1.log 198.60 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:05 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/vmware-1.log
-------------------------------------------------------------------------------------------------------------
7/23 vmware-2.log 237.34 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:05 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/vmware-2.log
-------------------------------------------------------------------------------------------------------------
8/23 pfsense.vmxf 47.00 B | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:06 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/pfsense.vmxf
-------------------------------------------------------------------------------------------------------------
9/23 vmware-3.log 246.13 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:07 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/vmware-3.log
-------------------------------------------------------------------------------------------------------------
10/23 pfsense.vmx.tmp 3.25 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:08 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/pfsense.vmx.tmp
-------------------------------------------------------------------------------------------------------------
11/23 pfsense-flat.vmdk___hash 82.00 B | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:09 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/pfsense-flat.vmdk___hash
-------------------------------------------------------------------------------------------------------------
12/23 pfsense.vmsd.tmp 44.00 B | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:09 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/pfsense.vmsd.tmp
-------------------------------------------------------------------------------------------------------------
13/23 vmware-4.log 552.49 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:10 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/vmware-4.log
-------------------------------------------------------------------------------------------------------------
14/23 vmx-pfsense-2782880133-1.vswp [open excluded]
-------------------------------------------------------------------------------------------------------------
15/23 pfsense.vmx.lck [skipped excluded]
-------------------------------------------------------------------------------------------------------------
16/23 pfsense.vmx~ 3.25 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:11 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/pfsense.vmx~
-------------------------------------------------------------------------------------------------------------
17/23 vmware.log 254.08 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:12 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/vmware.log
-------------------------------------------------------------------------------------------------------------
18/23 pfsense-a5df6185.vswp [open excluded]
-------------------------------------------------------------------------------------------------------------
19/23 pfsense-ctk.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
20/23 pfsense-Snapshot22.vmsn 27.96 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:13 | Error code 118 at file copy-in.c, line 118 | Error description: can't open output file: /vmfs/volumes/Backups/backups_exi2/pfsense/pfsense-Snapshot22.vmsn
-------------------------------------------------------------------------------------------------------------
21/23 pfsense-000001-delta.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
22/23 pfsense-000001.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
23/23 pfsense-000001-ctk.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
Total size: 16.00 GB | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
Backup end date: 2021-05-28T16:05:13
-------------------------------------------------------------------------------------------------------------
Time taken: 00:00:16 (16 sec.)
-------------------------------------------------------------------------------------------------------------
Total time: 16 sec.
-------------------------------------------------------------------------------------------------------------
Full file speed: 1024.09 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed: 17592186044416.00 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed with errors
-------------------------------------------------------------------------------------------------------------
Final checksum: 0 bytes were sent and confirmed to have been written remotely
-------------------------------------------------------------------------------------------------------------
2021-05-28T16:05:19 | Error code 4291 at file xsibackup.c, line 4291 | Error description: some error/s were raised while backing up: /vmfs/volumes/5ad9b7f8-b3e2885a-2796-e840f20ae690/pfsense, error count is: 16
-------------------------------------------------------------------------------------------------------------
Unlocked backup OK
-------------------------------------------------------------------------------------------------------------
Removed PID OK#18 Re: General matters » Backups stalls » 2018-05-08 17:13:19
Hi,
First, thank you for your quick and comprehensive answer. I've been doing tests these days and will try to do my best explaining every point:
1. My desired setup is: a backup server, from where i launch, log and manage the backups. The backups are launched on remote servers, and the storage server is the backup server. I though that setup were doable with XSIBACKUP.
2. I know that, and because of that the backup server (the one storing the backups) is a ESXi 6.5, i'm doing the backup from older to newer version of ESXi. Anyway I'm not interested on running the backups on the backup server (but would like that to be possible).
3. That's because on first run, without using --remote-xsipath, XSIBACKUP did an install on the root folder (without asking or using a more logical path). I noticed a message about speeding up the process and tried with that, using the path where previously XSIBACKUP was installed. I think that might be an issue (I didn't tell where to install the binaries)
4. I'm doing a WAN backup, with 250Mbps connections, but I've disabled compression to check it (I think I lost some throughput here, going from around 10MB/s to 7MB/s on very-quick-and-dirty tests). The backup stalls anyway.
5. I'm not trying to overlap backup jobs. I'm only launching a second backup when I see the first one stalls (there is a message saying that when you launch a overlapping backup, the first one is killed, and that's what I intended to do).
6. Understood. Without that argument, the backup did stall again.
Start by using the other backup programs, which don't have the above implications and: use the same ESXi versions when running OneDiff or study your setup carefully.
I've been trying with --backup-prog=rsync:z and --backup-prog=rsync and the issue remains: the backup stalls at some point (sometimes during 'sending incremental file list' phase, sometimes in the middle of a transfer. Could you point me on anything I can try?
Thanks,
David
#19 General matters » Backups stalls » 2018-04-30 08:12:20
- underdpt
- Replies: 3
Hi,
I'm evaluating XSIBackup Pro, and doing some tests backing up VMS from an ESXi 5.5 to ESXi 6.5, using the 6.5 machine as the backup manager, thus launching the backup with this command:
./xsibackup --host=XXX.XXX.XXX.XXX --backup-point="YYY.YYY.YYY.YYY:22:/vmfs/volumes/datastore1/backups/remoto1" --use-smtp=1 --remote-xsipath=. --exec=yes --mail-to=REMOVED --backup-type=running --backup-prog=onediff:zEvery try I do, It stalls at some point. Sometimes backups 3 machines, somethimes 1 (after doing a incremental backup over the machines already done). This is the output I get:
2018-04-30T05:28:49| ###############################################################################
2018-04-30T05:28:49| XSIBACKUP-PRO 10.3.3: new execution request
2018-04-30T05:28:49| ###############################################################################
2018-04-30T05:28:49|
2018-04-30T05:28:50| NOTICE: (c) XSIBackup kills any user launched jobs, make sure you don't overlap manual jobs
---------------------------------------------------------------------------------------------------------------------------------
XSIBackup PID: 39392680 YYY.YYY.YYY.YYY
Mon, 30 Apr 2018 05:28:49 +0000 IPv4: YYY.YYY.YYY.YYY/255.255.255.0
VMware ESXi 5.5.0 build-2456374 (c) Rsync 3.1.0 as opt. dependency
---------------------------------------------------------------------------------------------------------------------------------
Backup Id: unknown Intel(R) Xeon(R) CPU E3-1245 V2 @ 3.40GHz
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:28:51| ADVICE: no SSD disks, please consider adding an SSD cache disk to improve performance
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:28:51| Backup user is: root
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:28:51| Backup program is: onediff
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:28:51| Service OpenSSH ready at server XXX.XXX.XXX.XXX:22
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:28:51| Info: remote XSIBACKUP-PRO install dir has been set by means of the --remote-xsipath argument
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:28:52| Remote xsi path set to: . (filesystem: VMFS-5)
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:28:52| Compression option is deprecated since XSIBackup 10.0.4, SSH 2.0 is forced since this version and it handles compression dynamically
2018-04-30T05:28:54| Remote ESXi version is 6.5.0
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:28:54| Mirroring to server 94.23.195.183 port 22
2018-04-30T05:28:54| Checking Rsync exists on the other side...
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:28:55| (c) Rsync (samba.org) found at [ XXX.XXX.XXX.XXX:22:./bin/xsibackup-rsync... ]
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:28:57| (c) XSIDiff found at [ XXX.XXX.XXX.XXX:22:./bin/xsidiff... ]
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:28:57| Getting list of all VMs...
---------------------------------------------------------------------------------------------------------------------------------
DATA REMOVED
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:29:08| VMs to backup:
---------------------------------------------------------------------------------------------------------------------------------
DATA REMOVED
---------------------------------------------------------------------------------------------------------------------------------
SOME INCREMENTAL BACKUPS DONE OK
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:19| [reverse_proxy] Starting backup (size is 102400M on 102400M file)
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:19| XSIBackup will backup your VMs while they are running and will quiesce guest services too, so that users
2018-04-30T05:56:19| can continue to use the VM while the backup is taking place. You can also run cold and warm --backup-how
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:19| Hot backup selected for VM: [reverse_proxy], will not be switched off
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:20| [reverse_proxy] info: boot partition is MBR
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:20| Remember: --date-dir argument will be ignored in OneDiff backups
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:22| [reverse_proxy] notice DIFRMMIS: no [reverse_proxy-flat.vmdk] in remote OneDiff mirror, first run?.
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:23| [reverse_proxy] (c) OneDiff algorithm
---------------------------------------------------------------------------------------------------------------------------------
[reverse_proxy] info: OneDiff backup first run, removing snapshots
[reverse_proxy] info: all snapshots removed
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:23| Snapshot & Quiescing
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:23| [reverse_proxy] info: the VM will now be quiesced to ensure proper data handling
2018-04-30T05:56:23| [reverse_proxy] info: round 1
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:34| [reverse_proxy] info: snapshot taken, quiescing status: YES
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:36| Removing snapshots, please wait...
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:37| Syncronizing config files
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:40| [reverse_proxy] info: created dir to host VM backup
2018-04-30T05:56:42| [reverse_proxy] info: VMX file succesfully queued
2018-04-30T05:56:42| [reverse_proxy] info: VMSD file succesfully queued
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:44| Backing up virtual disks...
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:44| DISK=/vmfs/volumes/datastore2/reverse_proxy/reverse_proxy-000001.vmdk (excluded)
2018-04-30T05:56:44| DISK=/vmfs/volumes/datastore2/reverse_proxy/reverse_proxy-Snapshot1.vmsn
2018-04-30T05:56:44| DISK=/vmfs/volumes/datastore2/reverse_proxy/reverse_proxy.vmdk
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:45| Rsync: transfering file | /vmfs/volumes/datastore2/reverse_proxy/reverse_proxy-Snapshot1.vmsn
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
reverse_proxy-Snapshot1.vmsn
28,447 100% 0.00kB/s 0:00:00 (xfr#1, to-chk=0/1)
sent 28,553 bytes received 35 bytes 19,058.67 bytes/sec
total size is 28,447 speedup is 1.00
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:47| Rsync: transfering file | /vmfs/volumes/datastore2/reverse_proxy/reverse_proxy.vmdk
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
reverse_proxy.vmdk
508 100% 0.00kB/s 0:00:00 (xfr#1, to-chk=0/1)
sent 604 bytes received 35 bytes 426.00 bytes/sec
total size is 508 speedup is 0.79
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:48| Info: transfering file | /vmfs/volumes/datastore2/reverse_proxy/reverse_proxy-flat.vmdk
---------------------------------------------------------------------------------------------------------------------------------
2018-04-30T05:56:48| Info: activate your (c)XSIDiff license to boost transfer speed
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
reverse_proxy-flat.vmdk
869,072,896 0% 11.16MB/s 2:35:16And it keeps there for hours, until I kill the process o launch another backup.
So, after some tries, I got some VMs backed up, but I think something's not correct or that I'm missing something.
Thanks!
Pages: 1