Forum ©XSIBackup: ©VMWare ©ESXi Backup Software
MenuYou are not logged in.
- Topics: Active | Unanswered
#1 Re: General matters » Checking backups » 2022-12-13 20:49:01
Seems I can no longer enter in the user area... support ended 
I also tried with the --check=full option and that gives the same problem, so perhaps the file is corrupt.
#2 Re: General matters » Checking backups » 2022-12-13 20:43:04
Thanks for your quick reply!
[root@olympus:~] ls -la /vmfs/volumes/0c6d4303-b890de35/xsi_repos/2021_DC/data/0/8/4/1/a/0841a2831ad01edb010183ea62baee3cb5ba3c76
-rw-r--r-- 1 root root 11359593 Nov 25 03:12 /vmfs/volumes/0c6d4303-b890de35/xsi_repos/2021_DC/data/0/8/4/1/a/0841a2831ad01edb010183ea62baee3cb5ba3c76
It's on an NFS share, I tried copying the file on the ESX server to another location and that worked.
I checked if I could generate a hash from it on ESX, and that worked also, so I think the file should be allright.
I will try 1.6.0.0 now.
#3 Re: General matters » Checking backups » 2022-12-13 19:52:55
The VM has one 20G and another 600GB disk, at first I though it had something to do with that but it seems it crashes on the 20G disk.
This is the log:
write(1, "\33[90m---------------------------"..., 117-----------------------------------------------------------------------------------------------------------
) = 117
access("/vmfs/volumes/0c6d4303-b890de35/xsi_repos/2021_DC/.xsitools", F_OK) = 0
open("/vmfs/volumes/0c6d4303-b890de35/xsi_repos/2021_DC/.xsitools", O_RDONLY) = 5
fstat(5, {st_mode=S_IFREG|0644, st_size=51, ...}) = 0
mmap(NULL, 131072, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2e5976c000
read(5, "Desc: XSITools Repo v 2.0.0\nBsiz"..., 131072) = 51
read(5, "", 131072) = 0
close(5) = 0
munmap(0x2e5976c000, 131072) = 0
brk(0x2e1a122000) = 0x2e1a122000
unlink("/vmfs/volumes/ssdvol/restored/vlpr-mongodb01.prd.saas.dpp.company.network/vlpr-mongodb01.prd.saas.dpp.company.network-flat.vmdk") = 0
open("/vmfs/volumes/0c6d4303-b890de35/xsi_repos/2021_DC/20221204020530/vlpr-mongodb01.prd.saas.dpp.company.network/vlpr-mongodb01.prd.saas.dpp.company.network-flat.vmdk.map", O_RDONLY) = 5
fstat(5, {st_mode=S_IFREG|0644, st_size=102400, ...}) = 0
mmap(NULL, 131072, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2e5976c000
read(5, "d58d0696c5accaf8c2a52dcce61fef6f"..., 131072) = 102400
read(5, "", 131072) = 0
lseek(5, 0, SEEK_SET) = 0
access("/vmfs", F_OK) = 0
access("/vmfs/volumes", F_OK) = 0
access("/vmfs/volumes/ssdvol", F_OK) = 0
access("/vmfs/volumes/ssdvol/restored", F_OK) = 0
access("/vmfs/volumes/ssdvol/restored/vlpr-mongodb01.prd.saas.dpp.company.network", F_OK) = 0
brk(0x2e1ab22000) = 0x2e1ab22000
open("/vmfs/volumes/ssdvol/restored/vlpr-mongodb01.prd.saas.dpp.company.network/vlpr-mongodb01.prd.saas.dpp.company.network-flat.vmdk", O_RDWR|O_CREAT|O_TRUNC, 0666) = 6
ftruncate(6, 21474836480) = 0
close(6) = 0
open("/vmfs/volumes/ssdvol/restored/vlpr-mongodb01.prd.saas.dpp.company.network/vlpr-mongodb01.prd.saas.dpp.company.network-flat.vmdk", O_RDWR|O_CREAT|O_TRUNC, 0666) = 6
read(5, "d58d0696c5accaf8c2a52dcce61fef6f"..., 131072) = 102400
access("/vmfs/volumes/0c6d4303-b890de35/xsi_repos/2021_DC/data/d/5/8/d/0/d58d0696c5accaf8c2a52dcce61fef6f2915134c", F_OK) = 0
stat("/vmfs/volumes/0c6d4303-b890de35/xsi_repos/2021_DC/data/d/5/8/d/0/d58d0696c5accaf8c2a52dcce61fef6f2915134c", {st_mode=S_IFREG|0644, st_size=7673185, ...}) = 0
open("/vmfs/volumes/0c6d4303-b890de35/xsi_repos/2021_DC/data/d/5/8/d/0/d58d0696c5accaf8c2a52dcce61fef6f2915134c", O_RDONLY) = 7
fstat(7, {st_mode=S_IFREG|0644, st_size=7673185, ...}) = 0
mmap(NULL, 131072, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2e5978c000
read(7, "\5\0\0\201\0\353c\220\20\216\320\274\0\0\260\270\0\0\216\330\216\300\0\373\276\0|\277\0\6\271\0"..., 7602176) = 7602176
read(7, "\0\374]\257\332\274\226\226\317\0\212\345\223Z\356\213Zw\0\347\313\34557\7\177v\0\237\270^\273"..., 131072) = 71009
lseek(7, 0, SEEK_SET) = 0
read(7, "\5\0\0\201\0\353c\220\20\216\320\274\0\0\260\270\0\0\216\330\216\300\0\373\276\0|\277\0\6\271\0"..., 131072) = 131072
read(7, "ctl\25,\36e\2\276T\16\276attHrib\6\353st.|2\22e\10Dar"..., 7471104) = 7471104
read(7, "\0\374]\257\332\274\226\226\317\0\212\345\223Z\356\213Zw\0\347\313\34557\7\177v\0\237\270^\273"..., 131072) = 71009
fstat(6, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
mmap(NULL, 131072, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2e597ac000
write(6, "\353c\220\20\216\320\274\0\260\270\0\0\216\330\216\300\373\276\0|\277\0\6\271\0\2\363\244\352!\6\0"..., 10485760) = 10485760
close(7) = 0
munmap(0x2e5978c000, 131072) = 0
::: detail ::: 0.05% done | block 1 out of 2048 | Done 0.00%) = 135
access("/vmfs/volumes/0c6d4303-b890de35/xsi_repos/2021_DC/data/0/8/4/1/a/0841a2831ad01edb010183ea62baee3cb5ba3c76", F_OK) = 0
stat("/vmfs/volumes/0c6d4303-b890de35/xsi_repos/2021_DC/data/0/8/4/1/a/0841a2831ad01edb010183ea62baee3cb5ba3c76", {st_mode=S_IFREG|0644, st_size=11359593, ...}) = 0
open("/vmfs/volumes/0c6d4303-b890de35/xsi_repos/2021_DC/data/0/8/4/1/a/0841a2831ad01edb010183ea62baee3cb5ba3c76", O_RDONLY) = 7
mmap(NULL, 11362304, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2e597cc000
fstat(7, {st_mode=S_IFREG|0644, st_size=11359593, ...}) = 0
mmap(NULL, 131072, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2e5978c000
read(7, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 11272192) = 11272192
read(7, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 131072) = 87401
--- SIGSEGV (Segmentation fault) @ 0 (0) ---
close(0) = 0
write(1, "\n", 1
) = 1
write(1, "\33[90m---------------------------"..., 117-----------------------------------------------------------------------------------------------------------
) = 117
write(1, "\n", 1
) = 1
write(1, "\33[90m---------------------------"..., 117-----------------------------------------------------------------------------------------------------------
) = 117
write(1, "SIGTERM (11) condition was trapp"..., 64SIGTERM (11) condition was trapped: check logs for more details
Didn't know about debug-print & strace. Nice!
I checked 0841a2831ad01edb010183ea62baee3cb5ba3c76 and it's there.
Thanks!
#4 General matters » Checking backups » 2022-12-09 17:16:43
- wowbagger
- Replies: 6
Hello,
Without providing all the necessary logs, I'm testing some restores but there are two specific servers that have the same error when I try to restore them, we backup about 50 servers daily and only 2 generate an error when restoring:
[root@olympus:/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.4.3.17_olympus] ./xsibackup \
> --restore \
> /vmfs/volumes/nfs_typhon_xsi_olympus/xsi_repos/2021_DC/20221204020530/vlpr-mongodb01.prd.saas.dpp.company.network \
> /vmfs/volumes/ssdvol/restored/
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
||| (c)XSIBackup-DC 1.4.3.17: Backup & Replication Software |||
||| (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
(c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 6 Major 7 Minor 0 Patch 0
-----------------------------------------------------------------------------------------------------------
PID: 2120899, Running job as: root
-----------------------------------------------------------------------------------------------------------
SOURCE: /vmfs/volumes/0c6d4303-b890de35/xsi_repos/2021_DC/20221204020530/vlpr-mongodb01.prd.saas.dpp.company.network
-----------------------------------------------------------------------------------------------------------
Found .xsitools file at: /vmfs/volumes/0c6d4303-b890de35/xsi_repos/2021_DC/.xsitools
-----------------------------------------------------------------------------------------------------------
Restoring from directory: /vmfs/volumes/0c6d4303-b890de35/xsi_repos/2021_DC/20221204020530/vlpr-mongodb01.prd.saas.dpp.company.network
-----------------------------------------------------------------------------------------------------------
Restoring to directory: /vmfs/volumes/ssdvol/restored
-----------------------------------------------------------------------------------------------------------
Total size: 620.71 GB, block size: 10.00 MB
-----------------------------------------------------------------------------------------------------------
NUMBER FILE SIZE PROGRESS
-----------------------------------------------------------------------------------------------------------
1/18 vlpr-mongodb01.prd.saas.dpp.company.network-60b927b3.hlog 633.00 B | Done 0.00%
-----------------------------------------------------------------------------------------------------------
2/18 vlpr-mongodb01.prd.saas.dpp.company.network-flat.vmdk 20.00 GB | Done 0.00%
-----------------------------------------------------------------------------------------------------------
::: detail ::: 0.05% done | block 1 out of 2048 | Done 0.00%
-----------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------------
SIGTERM (11) condition was trapped: check logs for more details
-----------------------------------------------------------------------------------------------------------
Cleaning up...
-----------------------------------------------------------------------------------------------------------
Removed host <tmp> dir OK
-----------------------------------------------------------------------------------------------------------
Removed prog <tmp> dir OK
-----------------------------------------------------------------------------------------------------------
Removed PID OK
-----------------------------------------------------------------------------------------------------------Nothing in the logs.
The backup command used is:
xsibackup --backup "VMs(vlpr-mongodb01.prd.saas.dpp.company.network)" \
/vmfs/volumes/nfs_typhon_xsi_olympus/xsi_repos/2022_DC \
--block-size=10M \
--verbosity=5 \
--use-smtp=1 \
--compression=true \
--config-backup \
--subject='Olympus Backup vlpr-mongodb01.prd.saas.dpp.company.network' \
--mail-to=icc@company.comThis backup command is the same for the other 48 servers that do restore successfully.
None of the backup emails contain any error.
When running with the --check option against the 2 servers that fail to restore xsibackup does not return any error at all, it checks all the files and reports 100% OK.
Servers are pretty big in size, could that be the issue at play?
Thanks for any insight.
L
#5 Re: General matters » Error code 1547 at file common.c, line 1547 | Error description: could » 2022-01-09 15:27:23
I tested some more, changed the NFS volume from async to sync but it still threw the error.
I also tried using a non-NFS repository, actually a local SSD vmfs volume. Same behaviour, first run is without error, second run it threw the error.
It looks like indeed some timing issue where the code is too fast. It does not interfere with the actual backup so it's ok.
/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC/xsibackup --backup "VMs(vpn.infra.xxxxxx.network)" /vmfs/volumes/ssdvol/2022_DC_CBT --verbosity=5 --use-smtp=1 --config-backup --subject='Olympus2 Backup vpn.infra.xxxxxx.network' --mail-to=icc@xxxxxx.com
[90m|---------------------------------------------------------------------------------|[0m
[90m||-------------------------------------------------------------------------------||[0m
[90m|||[0m[1m (c)XSIBackup-DC 1.5.1.6: Backup & Replication Software [0m [90m|||[0m
[90m|||[0m[1m (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved[0m [90m|||[0m
[90m||-------------------------------------------------------------------------------||[0m
[90m|---------------------------------------------------------------------------------|[0m
(c)Daniel J. Garcia Fidalgo | info@33hops.com
[90m|---------------------------------------------------------------------------------|[0m
System Information: ESXi, Kernel 6 Major 7 Minor 0 Patch 0
[90m-------------------------------------------------------------------------------------------------------------[0m
License: [1m000506540000000000000000ecf4bbcb4b50[0m | (c)XSIBackup-DC
[90m-------------------------------------------------------------------------------------------------------------[0m
Primary TMP folder: /tmp/xsi/4773327
[90m-------------------------------------------------------------------------------------------------------------[0m
Secondary TMP folder: /vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC/tmp/4773327
[90m-------------------------------------------------------------------------------------------------------------[0m
PID: 4773327, Running job as: [1mroot[0m
[90m-------------------------------------------------------------------------------------------------------------[0m
LZJB compression has been enabled
[90m-------------------------------------------------------------------------------------------------------------[0m
Block size is 1.00 MB (1048576 bytes)
[90m-------------------------------------------------------------------------------------------------------------[0m
Performing --backup action
[90m-------------------------------------------------------------------------------------------------------------[0m
Backup folder '/vmfs/volumes/ssdvol/2022_DC_CBT/20220109151648'
[90m-------------------------------------------------------------------------------------------------------------[0m
(c)XSIBackup-DC setting repository at /vmfs/volumes/ssdvol/2022_DC_CBT
[90m-------------------------------------------------------------------------------------------------------------[0m
.xsitools file located: /vmfs/volumes/ssdvol/2022_DC_CBT/.xsitools
[90m-------------------------------------------------------------------------------------------------------------[0m
Repository info: bs is 1048576, compression is 1
[90m-------------------------------------------------------------------------------------------------------------[0m
Getting .blocklog data...
[90m-------------------------------------------------------------------------------------------------------------[0m
Sorting local .blocklog data...
[90m-------------------------------------------------------------------------------------------------------------[0m
Mapping local .blocklog data...
[90m-------------------------------------------------------------------------------------------------------------[0m
Item number 1 in this job
[90m-------------------------------------------------------------------------------------------------------------[0m
.vmx file found at: /vmfs/volumes/6050ad66-7fc9b4fc-fe74-ecf4bbcb4b54/vpn.infra.xxxxxx.network/vpn.infra.xxxxxx.network.vmx
[90m-------------------------------------------------------------------------------------------------------------[0m
.vmsd file found at: /vmfs/volumes/6050ad66-7fc9b4fc-fe74-ecf4bbcb4b54/vpn.infra.xxxxxx.network/vpn.infra.xxxxxx.network.vmsd
[90m-------------------------------------------------------------------------------------------------------------[0m
VM Id: 9
[90m-------------------------------------------------------------------------------------------------------------[0m
Available space in backup volume: 1155032678400 (1.08 TB)
[90m-------------------------------------------------------------------------------------------------------------[0m
vpn.infra.xxxxxx.network Hardware Version is: 11
[90m-------------------------------------------------------------------------------------------------------------[0m
Getting Power state...
[90m-------------------------------------------------------------------------------------------------------------[0m
VM power state: 1
[90m-------------------------------------------------------------------------------------------------------------[0m
Virtual Machine Name: vpn.infra.xxxxxx.network
[90m-------------------------------------------------------------------------------------------------------------[0m
Creating snapshot VM : vpn.infra.xxxxxx.network (powered on)
[90m-------------------------------------------------------------------------------------------------------------[0m
*** Snapshot was successfully created ***
[90m-------------------------------------------------------------------------------------------------------------[0m
Start epoch: 1641741414
[90m-------------------------------------------------------------------------------------------------------------[0m
Build type: esxi_trial, expires: 2019626482
[90m-------------------------------------------------------------------------------------------------------------[0m
Start of RDTSC
[90m-------------------------------------------------------------------------------------------------------------[0m
Virtual Machine: [1mvpn.infra.xxxxxx.network[0m
[90m-------------------------------------------------------------------------------------------------------------[0m
Backup start date: 2022-01-09T15:16:54
[90m-------------------------------------------------------------------------------------------------------------[0m
2022-01-09 15:16:54 | Backing up 27 files, total size is 26.17 GB
[90m-------------------------------------------------------------------------------------------------------------[0m
NUMBER FILE SIZE PROGRESS
[90m-------------------------------------------------------------------------------------------------------------[0m
1/27 vpn.infra.xxxxxx.network-3b0d93cd.hlog 53.00 B [90m|[0m Done 0.00%
[90m-------------------------------------------------------------------------------------------------------------[0m
2/27 vpn.infra.xxxxxx.network.vmx 3.43 KB [90m|[0m Done 0.00%
[90m-------------------------------------------------------------------------------------------------------------[0m
3/27 vpn.infra.xxxxxx.network-Snapshot135.vmsn 28.85 KB [90m|[0m Done 0.00%
[90m-------------------------------------------------------------------------------------------------------------[0m
SCSI Device: /dev/disks/naa.61418770652eee0027e367601a86381c
[90m-------------------------------------------------------------------------------------------------------------[0m
4/27 vpn.infra.xxxxxx.network-flat.vmdk 20.00 GB [90m|[0m Done 0.00%
[90m-------------------------------------------------------------------------------------------------------------[0m
Disk metadata map available, zeros will be skipped
[90m-------------------------------------------------------------------------------------------------------------[0m
[90m-------------------------------------------------------------------------------------------------------------[0m
5/27 vpn.infra.xxxxxx.network.vmdk 657.00 B [90m|[0m Done 76.42%
[90m-------------------------------------------------------------------------------------------------------------[0m
6/27 vmx-vpn.infra.xxxxxx.network-1276924052-1.vswp [skipped excluded]
[90m-------------------------------------------------------------------------------------------------------------[0m
7/27 vpn.infra.xxxxxx.network.nvram 8.48 KB [90m|[0m Done 76.42%
[90m-------------------------------------------------------------------------------------------------------------[0m
8/27 vpn.infra.xxxxxx.network.vmsd 495.00 B [90m|[0m Done 76.42%
[90m-------------------------------------------------------------------------------------------------------------[0m
9/27 vpn.infra.xxxxxx.network-aux.xml 13.00 B [90m|[0m Done 76.42%
[90m-------------------------------------------------------------------------------------------------------------[0m
10/27 vpn.infra.xxxxxx.network.vmxf 47.00 B [90m|[0m Done 76.42%
[90m-------------------------------------------------------------------------------------------------------------[0m
11/27 vmware-8.log 272.26 KB [90m|[0m Done 76.42%
[90m-------------------------------------------------------------------------------------------------------------[0m
12/27 vmware-9.log 667.20 KB [90m|[0m Done 76.42%
[90m-------------------------------------------------------------------------------------------------------------[0m
13/27 vmware.log 735.66 KB [90m|[0m Done 76.42%
[90m-------------------------------------------------------------------------------------------------------------[0m
14/27 vpn.infra.xxxxxx.network.vmsd.tmp 45.00 B [90m|[0m Done 76.43%
[90m-------------------------------------------------------------------------------------------------------------[0m
15/27 vpn.infra.xxxxxx.network.vmx.lck [skipped excluded]
[90m-------------------------------------------------------------------------------------------------------------[0m
16/27 vmware-4.log 396.63 KB [90m|[0m Done 76.43%
[90m-------------------------------------------------------------------------------------------------------------[0m
17/27 vmware-5.log 295.34 KB [90m|[0m Done 76.43%
[90m-------------------------------------------------------------------------------------------------------------[0m
18/27 vmware-6.log 3.59 MB [90m|[0m Done 76.43%
[90m-------------------------------------------------------------------------------------------------------------[0m
19/27 vpn.infra.xxxxxx.network.vmx~ 3.43 KB [90m|[0m Done 76.44%
[90m-------------------------------------------------------------------------------------------------------------[0m
20/27 vpn.infra.xxxxxx.network-4c1c5094.vswp [skipped excluded]
[90m-------------------------------------------------------------------------------------------------------------[0m
21/27 vpn.infra.xxxxxx.network-ctk.vmdk [skipped excluded]
[90m-------------------------------------------------------------------------------------------------------------[0m
22/27 vmware-7.log 322.42 KB [90m|[0m Done 76.44%
[90m-------------------------------------------------------------------------------------------------------------[0m
23/27 vpn.infra.xxxxxx.network.vmx.tmp 3.43 KB [90m|[0m Done 76.44%
[90m-------------------------------------------------------------------------------------------------------------[0m
24/27 vpn.infra.xxxxxx.network-Snapshot167.vmsn 28.14 KB [90m|[0m Done 76.44%
[90m-------------------------------------------------------------------------------------------------------------[0m
25/27 vpn.infra.xxxxxx.network-000001-sesparse.vmdk [skipped excluded]
[90m-------------------------------------------------------------------------------------------------------------[0m
26/27 vpn.infra.xxxxxx.network-000001.vmdk [skipped excluded]
[90m-------------------------------------------------------------------------------------------------------------[0m
27/27 vpn.infra.xxxxxx.network-000001-ctk.vmdk [skipped excluded]
[90m-------------------------------------------------------------------------------------------------------------[0m
Total size: 20.01 GB [90m|[0m Done 100.00%
[90m-------------------------------------------------------------------------------------------------------------[0m
*** Snapshot was removed ***
[90m-------------------------------------------------------------------------------------------------------------[0m
Backup end date: 2022-01-09T15:18:20
[90m-------------------------------------------------------------------------------------------------------------[0m
Time taken: 00:01:26 (86 sec.)
[90m-------------------------------------------------------------------------------------------------------------[0m
Total time: 00:01:26 (86 sec.)
[90m-------------------------------------------------------------------------------------------------------------[0m
Full file speed: 238.21 mb/s
[90m-------------------------------------------------------------------------------------------------------------[0m
Real data speed: 22.72 mb/s
[90m-------------------------------------------------------------------------------------------------------------[0m
[32mItem backup completed without errors
[0m[90m-------------------------------------------------------------------------------------------------------------[0m
Differential blocks were added to the .blocklog database
[90m-------------------------------------------------------------------------------------------------------------[0m
(c)ESXi host <olympus2.infra.xxxxxx.network> configuration backup:
[90m-------------------------------------------------------------------------------------------------------------[0m
Saving config: [1m/scratch/downloads/521ec46f-5c11-5a6f-c688-917b446f728b/configBundle-olympus2.infra.xxxxxx.network.tgz[0m
Backing up to: [1m/vmfs/volumes/ssdvol/2022_DC_CBT/cfgbak/esxi-config_olympus2.infra.xxxxxx.network_2022-01-09T15:18:20.tgz[0m
[90m-------------------------------------------------------------------------------------------------------------[0m
Data processing completed successfully
[90m-----------------------------------------------------------------rm: can't remove '/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC/tmp/4773327/.vnfs-f000340a0-.blocklog': Device or resource busy
rm: can't remove '/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC/tmp/4773327': Directory not empty
--------------------------------------------[0m
Removed host <tmp> dir [32mOK[0m
[90m-------------------------------------------------------------------------------------------------------------[0m
2022-01-09T15:18:24 | Error code 2209 at file common.c, line 2209 | Error description: can't remove directory tree, error: 0
, description: No such file or directory
[90m-------------------------------------------------------------------------------------------------------------[0m
Unlocked backup [32mOK[0m
[90m-------------------------------------------------------------------------------------------------------------[0m
Log file unmapped [32mOK[0m
[90m-------------------------------------------------------------------------------------------------------------[0m
Sending e-mail to icc@xxxxxx.com through SMTP#1...
[90m-------------------------------------------------------------------------------------------------------------[0m
E-mail was sent [32mOK[0m
[90m-------------------------------------------------------------------------------------------------------------[0m
********************************************************************************#6 Re: General matters » Error code 1547 at file common.c, line 1547 | Error description: could » 2022-01-05 17:07:28
I can reproduce the error this like this (found while testing CBT stuff):
1) remove tmp/* and /tmp/xsi/* folders
2) take backup to a new xsi repository, no tmp error, exitcode 0
3) clear out .xsi files from VM folder (probably not necessary for this test but necessary while I'm testing the CBT stuff)
4) remove tmp/* and /tmp/xsi/* folders
5) take backup to the same xsi repository, tmp error pops up, exitcode 1
6) delete repository
7) start back at 1
So it never seems happens with a new, empty repository.
#7 General matters » Email template images » 2022-01-05 16:30:07
- wowbagger
- Replies: 1
Seems the website redesign upsets the standard email template but I'm not sure since when, just noticed it now.
Images such as "https://33hops.com/images/logo1.gif" are no longer found.
#8 General matters » Resetting CBT » 2022-01-05 16:10:18
- wowbagger
- Replies: 2
Is it sufficient to remove the .xsi folders inside a VM directory to have xsibackup take a full backup to a new repository again?
Reason is we don't prune xsibackup repositories but use new empty ones and back up the old repositories to tape and delete them after a month from disk. If we have to execute --reset-cbt each time we cycle a repository this means the server will have downtime and that could be problematic for some servers.
Thanks
#9 Re: General matters » Error code 1547 at file common.c, line 1547 | Error description: could » 2022-01-05 15:28:31
Before running xsibackup I remove anything from the tmp/* folder and check there's no xsibackup running anymore.
In this log you can see no xsibackup running, tmp/ contains 2 folders from the last run where it failed to remove tmp dirs, I remove the tmp/* contents and execute a new run that start with pid 4714664 but and the end it fails to remove that pid directory probably because at that point the file ".vnfs-f0002842e-.blocklog" still seems to exist but when the job is finished, the directory is empty as seen in the ls -al tmp/4714664/ command at the end.
[root@olympus2:/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC] ps -Tcjstv | grep xsi
4713181 4713181 grep 4713181 User WAIT UPIPER 0-111 0.2167 grep xsi
[root@olympus2:/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC] ls -la tmp/
total 4
drwx------ 4 root root 46 Jan 5 15:16 .
drwxr-xr-x 9 root root 4096 Jan 5 15:15 ..
drw-r----- 2 root root 10 Jan 5 15:16 4712149
drw-r----- 2 root root 10 Jan 5 15:16 4712217
[root@olympus2:/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC] rm -Rf tmp/*
[root@olympus2:/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC] ./xsibackup \
> --backup=cbt "VMs(vpn.infra.xxxxxx.network)" \
> /vmfs/volumes/nfs_typhon_xsi_olympus2/xsi_repos/2022_DC_CBT/ \
> --verbosity=5 \
> --use-smtp=1 \
> --config-backup \
> --subject="Backup vpn.infra.xxxxxx.network" \
> --mail-to="icc@xxxxxx.com"
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
||| (c)XSIBackup-DC 1.5.1.6: Backup & Replication Software |||
||| (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
(c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 6 Major 7 Minor 0 Patch 0
-------------------------------------------------------------------------------------------------------------
License: 000506540000000000000000ecf4bbcb4b50 | (c)XSIBackup-DC
-------------------------------------------------------------------------------------------------------------
Primary TMP folder: /tmp/xsi/4714664
-------------------------------------------------------------------------------------------------------------
Secondary TMP folder: /vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC/tmp/4714664
-------------------------------------------------------------------------------------------------------------
PID: 4714664, Running job as: root
-------------------------------------------------------------------------------------------------------------
LZJB compression has been enabled
-------------------------------------------------------------------------------------------------------------
Block size is 1.00 MB (1048576 bytes)
-------------------------------------------------------------------------------------------------------------
Performing --backup action
-------------------------------------------------------------------------------------------------------------
Backup folder '/vmfs/volumes/nfs_typhon_xsi_olympus2/xsi_repos/2022_DC_CBT/20220105151658'
-------------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC setting repository at /vmfs/volumes/nfs_typhon_xsi_olympus2/xsi_repos/2022_DC_CBT
-------------------------------------------------------------------------------------------------------------
.xsitools file located: /vmfs/volumes/nfs_typhon_xsi_olympus2/xsi_repos/2022_DC_CBT/.xsitools
-------------------------------------------------------------------------------------------------------------
Repository info: bs is 1048576, compression is 1
-------------------------------------------------------------------------------------------------------------
Getting .blocklog data...
-------------------------------------------------------------------------------------------------------------
Sorting local .blocklog data...
-------------------------------------------------------------------------------------------------------------
Mapping local .blocklog data...
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
CBT dir: /vmfs/volumes/6050ad66-7fc9b4fc-fe74-ecf4bbcb4b54/vpn.infra.xxxxxx.network/.xsi/.cbt
-------------------------------------------------------------------------------------------------------------
.vmx file found at: /vmfs/volumes/6050ad66-7fc9b4fc-fe74-ecf4bbcb4b54/vpn.infra.xxxxxx.network/vpn.infra.xxxxxx.network.vmx
-------------------------------------------------------------------------------------------------------------
.vmsd file found at: /vmfs/volumes/6050ad66-7fc9b4fc-fe74-ecf4bbcb4b54/vpn.infra.xxxxxx.network/vpn.infra.xxxxxx.network.vmsd
-------------------------------------------------------------------------------------------------------------
VM Id: 9
-------------------------------------------------------------------------------------------------------------
Available space in backup volume: 35126561800192 (32.71 TB)
-------------------------------------------------------------------------------------------------------------
vpn.infra.xxxxxx.network Hardware Version is: 11
-------------------------------------------------------------------------------------------------------------
Getting Power state...
-------------------------------------------------------------------------------------------------------------
VM power state: 1
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: vpn.infra.xxxxxx.network
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : vpn.infra.xxxxxx.network (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
Start epoch: 1641395823
-------------------------------------------------------------------------------------------------------------
Build type: esxi_trial, expires: 2019626482
-------------------------------------------------------------------------------------------------------------
Start of RDTSC
-------------------------------------------------------------------------------------------------------------
Virtual Machine: vpn.infra.xxxxxx.network
-------------------------------------------------------------------------------------------------------------
Backup start date: 2022-01-05T15:17:03
-------------------------------------------------------------------------------------------------------------
2022-01-05 15:17:03 | Backing up 27 files, total size is 26.17 GB
-------------------------------------------------------------------------------------------------------------
NUMBER FILE SIZE PROGRESS
-------------------------------------------------------------------------------------------------------------
1/27 vpn.infra.xxxxxx.network-3b0d93cd.hlog 53.00 B | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2/27 vpn.infra.xxxxxx.network-Snapshot135.vmsn 28.85 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
SCSI Device: /dev/disks/naa.61418770652eee0027e367601a86381c
-------------------------------------------------------------------------------------------------------------
Flat file: /vmfs/volumes/6050ad66-7fc9b4fc-fe74-ecf4bbcb4b54/vpn.infra.xxxxxx.network/vpn.infra.xxxxxx.network-flat.vmdk
CTK file: /vmfs/volumes/6050ad66-7fc9b4fc-fe74-ecf4bbcb4b54/vpn.infra.xxxxxx.network/vpn.infra.xxxxxx.network-ctk.vmdk
-------------------------------------------------------------------------------------------------------------
CTK seq: 49
-------------------------------------------------------------------------------------------------------------
3/27 vpn.infra.xxxxxx.network-flat.vmdk (CBT 49) 20.00 GB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
Disk metadata map available, zeros will be skipped
-------------------------------------------------------------------------------------------------------------
::: detail ::: 100.00% done | block 20480 out of 20480 | Done 76.42%
-------------------------------------------------------------------------------------------------------------
4/27 vpn.infra.xxxxxx.network.vmdk 657.00 B | Done 76.42%
-------------------------------------------------------------------------------------------------------------
5/27 vpn.infra.xxxxxx.network.vmx 3.43 KB | Done 76.42%
-------------------------------------------------------------------------------------------------------------
6/27 vpn.infra.xxxxxx.network.nvram 8.48 KB | Done 76.42%
-------------------------------------------------------------------------------------------------------------
7/27 vpn.infra.xxxxxx.network.vmsd 494.00 B | Done 76.42%
-------------------------------------------------------------------------------------------------------------
8/27 vpn.infra.xxxxxx.network-aux.xml 13.00 B | Done 76.42%
-------------------------------------------------------------------------------------------------------------
9/27 vpn.infra.xxxxxx.network.vmxf 47.00 B | Done 76.42%
-------------------------------------------------------------------------------------------------------------
10/27 vmware-8.log 272.26 KB | Done 76.42%
-------------------------------------------------------------------------------------------------------------
11/27 vmware.log 592.53 KB | Done 76.42%
-------------------------------------------------------------------------------------------------------------
12/27 vmware-3.log 409.57 KB | Done 76.43%
-------------------------------------------------------------------------------------------------------------
13/27 vpn.infra.xxxxxx.network.vmsd.tmp 45.00 B | Done 76.43%
-------------------------------------------------------------------------------------------------------------
14/27 vpn.infra.xxxxxx.network.vmx.tmp 3.43 KB | Done 76.43%
-------------------------------------------------------------------------------------------------------------
15/27 vmware-4.log 396.63 KB | Done 76.43%
-------------------------------------------------------------------------------------------------------------
16/27 vmware-5.log 295.34 KB | Done 76.43%
-------------------------------------------------------------------------------------------------------------
17/27 vmware-6.log 3.59 MB | Done 76.43%
-------------------------------------------------------------------------------------------------------------
18/27 vmx-vpn.infra.xxxxxx.network-1276924052-1.vswp [skipped excluded]
-------------------------------------------------------------------------------------------------------------
19/27 vpn.infra.xxxxxx.network.vmx.lck [skipped excluded]
-------------------------------------------------------------------------------------------------------------
20/27 vpn.infra.xxxxxx.network.vmx~ 3.43 KB | Done 76.44%
-------------------------------------------------------------------------------------------------------------
21/27 vmware-7.log 322.42 KB | Done 76.44%
-------------------------------------------------------------------------------------------------------------
22/27 vpn.infra.xxxxxx.network-4c1c5094.vswp [skipped excluded]
-------------------------------------------------------------------------------------------------------------
23/27 vpn.infra.xxxxxx.network-ctk.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
24/27 vpn.infra.xxxxxx.network-Snapshot148.vmsn 28.14 KB | Done 76.44%
-------------------------------------------------------------------------------------------------------------
25/27 vpn.infra.xxxxxx.network-000001-sesparse.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
26/27 vpn.infra.xxxxxx.network-000001.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
27/27 vpn.infra.xxxxxx.network-000001-ctk.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
Total size: 20.01 GB | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
Backup end date: 2022-01-05T15:17:05
-------------------------------------------------------------------------------------------------------------
Time taken: 00:00:02 (2 sec.)
-------------------------------------------------------------------------------------------------------------
Total time: 00:00:02 (2 sec.)
-------------------------------------------------------------------------------------------------------------
Full file speed: 10242.95 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed: 7.58 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed without errors
-------------------------------------------------------------------------------------------------------------
Differential blocks were added to the .blocklog database
-------------------------------------------------------------------------------------------------------------
(c)ESXi host <olympus2.infra.xxxxxx.network> configuration backup:
-------------------------------------------------------------------------------------------------------------
Saving config: /scratch/downloads/52bd5079-b984-f43c-ee01-a8438a0f4d0c/configBundle-olympus2.infra.xxxxxx.network.tgz
Backing up to: /vmfs/volumes/nfs_typhon_xsi_olympus2/xsi_repos/2022_DC_CBT/cfgbak/esxi-config_olympus2.infra.xxxxxx.network_2022-01-05T15:17:05.tgz
-------------------------------------------------------------------------------------------------------------
Data processing completed successfully
-------------------------------------------------------------------------------------------------------------
Removed host <tmp> dir OK
-------------------------------------------------------------------------------------------------------------
rm: can't remove '/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC/tmp/4714664/.vnfs-f0002842e-.blocklog': Device or resource busy
rm: can't remove '/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC/tmp/4714664': Directory not empty
2022-01-05T15:17:09 | Error code 2209 at file common.c, line 2209 | Error description: can't remove directory tree, error: 0
, description: No such file or directory
-------------------------------------------------------------------------------------------------------------
Unlocked backup OK
-------------------------------------------------------------------------------------------------------------
Log file unmapped OK
-------------------------------------------------------------------------------------------------------------
Sending e-mail to icc@xxxxxx.com through SMTP#1...
-------------------------------------------------------------------------------------------------------------
E-mail was sent OK
-------------------------------------------------------------------------------------------------------------
[root@olympus2:/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC] ls -al tmp/
total 4
drwx------ 4 root root 46 Jan 5 15:17 .
drwxr-xr-x 9 root root 4096 Jan 5 15:15 ..
drw-r----- 2 root root 10 Jan 5 15:17 4714664
drw-r----- 2 root root 10 Jan 5 15:17 4714732
[root@olympus2:/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC] ls -al tmp/4714664/
total 0
drw-r----- 2 root root 10 Jan 5 15:17 .
drwx------ 4 root root 46 Jan 5 15:17 ..
[root@olympus2:/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC]#10 Re: General matters » Error code 1547 at file common.c, line 1547 | Error description: could » 2022-01-05 13:46:36
There's still the issue when xsibackup removes the tmp directory.
Strange thing that it did not throw an error on the first run, but it threw the error only on the 2nd and following runs.
The first run had an exit code of 0 while the 2nd and following runs returned the error & exitcode 1.
I tried another VM that was never backed up, but it returned the same error, so it seems only the first run of xsibackup executed with exitcode 0, next runs always return the tmp error & exitcode 1.
[root@olympus2:/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC] ./xsibackup \
> --backup=cbt "VMs(vpn.infra.xxxxxx.network)" \
> /vmfs/volumes/nfs_typhon_xsi_olympus2/xsi_repos/2022_DC_CBT/ \
> --block-size=1M \
> --verbosity=5 \
> --use-smtp=1 \
> --compression=true \
> --config-backup \
> --subject="Backup vpn.infra.xxxxxx.network" \
> --mail-to="icc@xxxxxx.com"
-------------------------------------------------------------------------------------------------------------
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
||| (c)XSIBackup-DC 1.5.1.6: Backup & Replication Software |||
||| (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
(c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 6 Major 7 Minor 0 Patch 0
-------------------------------------------------------------------------------------------------------------
License: 000506540000000000000000ecf4bbcb4b50 | (c)XSIBackup-DC
-------------------------------------------------------------------------------------------------------------
Primary TMP folder: /tmp/xsi/4703949
-------------------------------------------------------------------------------------------------------------
Secondary TMP folder: /vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC/tmp/4703949
-------------------------------------------------------------------------------------------------------------
PID: 4703949, Running job as: root
-------------------------------------------------------------------------------------------------------------
LZJB compression has been enabled
-------------------------------------------------------------------------------------------------------------
Block size is 1.00 MB (1048576 bytes)
-------------------------------------------------------------------------------------------------------------
Performing --backup action
-------------------------------------------------------------------------------------------------------------
Backup folder '/vmfs/volumes/nfs_typhon_xsi_olympus2/xsi_repos/2022_DC_CBT/20220105124122'
-------------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC setting repository at /vmfs/volumes/nfs_typhon_xsi_olympus2/xsi_repos/2022_DC_CBT
-------------------------------------------------------------------------------------------------------------
.xsitools file located: /vmfs/volumes/nfs_typhon_xsi_olympus2/xsi_repos/2022_DC_CBT/.xsitools
-------------------------------------------------------------------------------------------------------------
Repository info: bs is 1048576, compression is 1
-------------------------------------------------------------------------------------------------------------
Getting .blocklog data...
-------------------------------------------------------------------------------------------------------------
Sorting local .blocklog data...
-------------------------------------------------------------------------------------------------------------
Mapping local .blocklog data...
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
CBT dir: /vmfs/volumes/6050ad66-7fc9b4fc-fe74-ecf4bbcb4b54/vpn.infra.xxxxxx.network/.xsi/.cbt
-------------------------------------------------------------------------------------------------------------
.vmx file found at: /vmfs/volumes/6050ad66-7fc9b4fc-fe74-ecf4bbcb4b54/vpn.infra.xxxxxx.network/vpn.infra.xxxxxx.network.vmx
-------------------------------------------------------------------------------------------------------------
.vmsd file found at: /vmfs/volumes/6050ad66-7fc9b4fc-fe74-ecf4bbcb4b54/vpn.infra.xxxxxx.network/vpn.infra.xxxxxx.network.vmsd
-------------------------------------------------------------------------------------------------------------
VM Id: 9
-------------------------------------------------------------------------------------------------------------
Available space in backup volume: 35149327319040 (32.74 TB)
-------------------------------------------------------------------------------------------------------------
vpn.infra.xxxxxx.network Hardware Version is: 11
-------------------------------------------------------------------------------------------------------------
Getting Power state...
-------------------------------------------------------------------------------------------------------------
VM power state: 1
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: vpn.infra.xxxxxx.network
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : vpn.infra.xxxxxx.network (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
Start epoch: 1641386488
-------------------------------------------------------------------------------------------------------------
Build type: esxi_trial, expires: 2019626482
-------------------------------------------------------------------------------------------------------------
Start of RDTSC
-------------------------------------------------------------------------------------------------------------
Virtual Machine: vpn.infra.xxxxxx.network
-------------------------------------------------------------------------------------------------------------
Backup start date: 2022-01-05T12:41:28
-------------------------------------------------------------------------------------------------------------
2022-01-05 12:41:28 | Backing up 27 files, total size is 26.17 GB
-------------------------------------------------------------------------------------------------------------
NUMBER FILE SIZE PROGRESS
-------------------------------------------------------------------------------------------------------------
1/27 vpn.infra.xxxxxx.network-3b0d93cd.hlog 53.00 B | Done 0.00%
-------------------------------------------------------------------------------------------------------------
2/27 vpn.infra.xxxxxx.network-Snapshot135.vmsn 28.85 KB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
SCSI Device: /dev/disks/naa.61418770652eee0027e367601a86381c
-------------------------------------------------------------------------------------------------------------
Flat file: /vmfs/volumes/6050ad66-7fc9b4fc-fe74-ecf4bbcb4b54/vpn.infra.xxxxxx.network/vpn.infra.xxxxxx.network-flat.vmdk
CTK file: /vmfs/volumes/6050ad66-7fc9b4fc-fe74-ecf4bbcb4b54/vpn.infra.xxxxxx.network/vpn.infra.xxxxxx.network-ctk.vmdk
-------------------------------------------------------------------------------------------------------------
CTK seq: 17
-------------------------------------------------------------------------------------------------------------
3/27 vpn.infra.xxxxxx.network-flat.vmdk (CBT 17) 20.00 GB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
Disk metadata map available, zeros will be skipped
-------------------------------------------------------------------------------------------------------------
::: detail ::: 100.00% done | block 20480 out of 20480 | Done 76.42%
-------------------------------------------------------------------------------------------------------------
4/27 vpn.infra.xxxxxx.network.vmdk 657.00 B | Done 76.42%
-------------------------------------------------------------------------------------------------------------
5/27 vpn.infra.xxxxxx.network.vmx 3.43 KB | Done 76.42%
-------------------------------------------------------------------------------------------------------------
6/27 vpn.infra.xxxxxx.network.nvram 8.48 KB | Done 76.42%
-------------------------------------------------------------------------------------------------------------
7/27 vpn.infra.xxxxxx.network.vmsd 493.00 B | Done 76.42%
-------------------------------------------------------------------------------------------------------------
8/27 vpn.infra.xxxxxx.network-aux.xml 13.00 B | Done 76.42%
-------------------------------------------------------------------------------------------------------------
9/27 vpn.infra.xxxxxx.network.vmxf 47.00 B | Done 76.42%
-------------------------------------------------------------------------------------------------------------
10/27 vmware-8.log 272.26 KB | Done 76.42%
-------------------------------------------------------------------------------------------------------------
11/27 vmware.log 365.99 KB | Done 76.42%
-------------------------------------------------------------------------------------------------------------
12/27 vmware-3.log 409.57 KB | Done 76.43%
-------------------------------------------------------------------------------------------------------------
13/27 vpn.infra.xxxxxx.network.vmsd.tmp 45.00 B | Done 76.43%
-------------------------------------------------------------------------------------------------------------
14/27 vpn.infra.xxxxxx.network.vmx.tmp 3.43 KB | Done 76.43%
-------------------------------------------------------------------------------------------------------------
15/27 vmware-4.log 396.63 KB | Done 76.43%
-------------------------------------------------------------------------------------------------------------
16/27 vmware-5.log 295.34 KB | Done 76.43%
-------------------------------------------------------------------------------------------------------------
17/27 vmware-6.log 3.59 MB | Done 76.43%
-------------------------------------------------------------------------------------------------------------
18/27 vmx-vpn.infra.xxxxxx.network-1276924052-1.vswp [skipped excluded]
-------------------------------------------------------------------------------------------------------------
19/27 vpn.infra.xxxxxx.network.vmx.lck [skipped excluded]
-------------------------------------------------------------------------------------------------------------
20/27 vpn.infra.xxxxxx.network.vmx~ 3.43 KB | Done 76.44%
-------------------------------------------------------------------------------------------------------------
21/27 vmware-7.log 322.42 KB | Done 76.44%
-------------------------------------------------------------------------------------------------------------
22/27 vpn.infra.xxxxxx.network-4c1c5094.vswp [skipped excluded]
-------------------------------------------------------------------------------------------------------------
23/27 vpn.infra.xxxxxx.network-ctk.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
24/27 vpn.infra.xxxxxx.network-Snapshot140.vmsn 28.14 KB | Done 76.44%
-------------------------------------------------------------------------------------------------------------
25/27 vpn.infra.xxxxxx.network-000001-sesparse.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
26/27 vpn.infra.xxxxxx.network-000001.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
27/27 vpn.infra.xxxxxx.network-000001-ctk.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
Total size: 20.01 GB | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
Backup end date: 2022-01-05T12:41:30
-------------------------------------------------------------------------------------------------------------
Time taken: 00:00:02 (2 sec.)
-------------------------------------------------------------------------------------------------------------
Total time: 00:00:02 (2 sec.)
-------------------------------------------------------------------------------------------------------------
Full file speed: 10242.84 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed: 28.36 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed without errors
-------------------------------------------------------------------------------------------------------------
Differential blocks were added to the .blocklog database
-------------------------------------------------------------------------------------------------------------
(c)ESXi host <olympus2.infra.xxxxxx.network> configuration backup:
-------------------------------------------------------------------------------------------------------------
Saving config: /scratch/downloads/5236aafa-61f0-b625-e456-d8cb77b37110/configBundle-olympus2.infra.xxxxxx.network.tgz
Backing up to: /vmfs/volumes/nfs_typhon_xsi_olympus2/xsi_repos/2022_DC_CBT/cfgbak/esxi-config_olympus2.infra.xxxxxx.network_2022-01-05T12:41:30.tgz
-------------------------------------------------------------------------------------------------------------
Data processing completed successfully
-------------------------------------------------------------------------------------------------------------
Removed host <tmp> dir OK
-------------------------------------------------------------------------------------------------------------
rm: can't remove '/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC/tmp/4703949/.vnfs-120000540f-.blocklog': Device or resource busy
rm: can't remove '/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus2/XSIBackup-DC/tmp/4703949': Directory not empty
2022-01-05T12:41:33 | Error code 2209 at file common.c, line 2209 | Error description: can't remove directory tree, error: 0
, description: No such file or directory
-------------------------------------------------------------------------------------------------------------
Unlocked backup OK
-------------------------------------------------------------------------------------------------------------
Log file unmapped OK
-------------------------------------------------------------------------------------------------------------
Removed PID OK
-------------------------------------------------------------------------------------------------------------
Returned(0): could not find SMTP 1, falling back to SMTP 0
-------------------------------------------------------------------------------------------------------------
Sending e-mail to icc@xxxxxx.com through SMTP#0...
-------------------------------------------------------------------------------------------------------------
E-mail was sent OK
-------------------------------------------------------------------------------------------------------------#11 Re: General matters » Error code 1547 at file common.c, line 1547 | Error description: could » 2022-01-05 10:51:34
Yup, that was the issue. I'm trying to figure out install script to see why it happened, but running it did remove the error.
Thanks.
#12 General matters » Error code 1547 at file common.c, line 1547 | Error description: could » 2022-01-04 22:43:38
- wowbagger
- Replies: 9
Hi,
I'm upgrading from 1.4.3.17 to 1.5.1.6.
1.4.3.17 has been running since 04/2021 pretty flawless but I'm looking into the CBT functionality as some +2TB servers take a while to back up, CBT might speed that up.
I'm first trying to upgrade to 1.5.1.6 as is, without using CBT and get these errors:
[root@olympus:/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus] ./xsibackup \
> --backup "VMs(PSDeployer)" \
> /vmfs/volumes/nfs_typhon_xsi_olympus/xsi_repos/2022_DC_CBT/ \
> --block-size=1M \
> --verbosity=5 \
> --use-smtp=1 \
> --compression=true \
> --config-backup \
> --subject="Backup PSDeployer" \
> --mail-to="icc@xxx.com"
-------------------------------------------------------------------------------------------------------------
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
||| (c)XSIBackup-DC 1.5.1.6: Backup & Replication Software |||
||| (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
(c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 6 Major 7 Minor 0 Patch 0
-------------------------------------------------------------------------------------------------------------
License: 00050654000000000000000090b11c1f6861 | (c)XSIBackup-DC
-------------------------------------------------------------------------------------------------------------
Primary TMP folder: /tmp/xsi/12344571
-------------------------------------------------------------------------------------------------------------
Secondary TMP folder: /vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus/tmp/12344571
-------------------------------------------------------------------------------------------------------------
PID: 12344571, Running job as: root
-------------------------------------------------------------------------------------------------------------
LZJB compression has been enabled
-------------------------------------------------------------------------------------------------------------
Block size is 1.00 MB (1048576 bytes)
-------------------------------------------------------------------------------------------------------------
Performing --backup action
-------------------------------------------------------------------------------------------------------------
Backup folder '/vmfs/volumes/nfs_typhon_xsi_olympus/xsi_repos/2022_DC_CBT/20220104220544'
-------------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC setting repository at /vmfs/volumes/nfs_typhon_xsi_olympus/xsi_repos/2022_DC_CBT
-------------------------------------------------------------------------------------------------------------
.xsitools file located: /vmfs/volumes/nfs_typhon_xsi_olympus/xsi_repos/2022_DC_CBT/.xsitools
-------------------------------------------------------------------------------------------------------------
Repository info: bs is 1048576, compression is 1
-------------------------------------------------------------------------------------------------------------
Getting .blocklog data...
-------------------------------------------------------------------------------------------------------------
Sorting local .blocklog data...
-------------------------------------------------------------------------------------------------------------
Mapping local .blocklog data...
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
.vmx file found at: /vmfs/volumes/5f6e1921-dcd07fca-9726-ecf4bbe842dc/PSDeployer/PSDeployer.vmx
-------------------------------------------------------------------------------------------------------------
.vmsd file found at: /vmfs/volumes/5f6e1921-dcd07fca-9726-ecf4bbe842dc/PSDeployer/PSDeployer.vmsd
-------------------------------------------------------------------------------------------------------------
VM Id: 591
-------------------------------------------------------------------------------------------------------------
2022-01-04T22:05:49 | Error code 1522 at file common.c, line 1522 | Error description: error running command run_backup_cmd(), returned: 127
-------------------------------------------------------------------------------------------------------------
2022-01-04T22:05:49 | Error code 1547 at file common.c, line 1547 | Error description: could not get remote FS available space at /vmfs/volumes/nfs_typhon_xsi_olympus/xsi_repos/2022_DC_CBT, details: No such file or directory
-------------------------------------------------------------------------------------------------------------
Available space in backup volume: -1 (17179.87 PB)
-------------------------------------------------------------------------------------------------------------
PSDeployer Hardware Version is: 11
-------------------------------------------------------------------------------------------------------------
Getting Power state...
-------------------------------------------------------------------------------------------------------------
VM power state: 1
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: PSDeployer
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : PSDeployer (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
Start epoch: 1641333960
-------------------------------------------------------------------------------------------------------------
Build type: esxi_trial, expires: 2019626482
-------------------------------------------------------------------------------------------------------------
Start of RDTSC
-------------------------------------------------------------------------------------------------------------
Virtual Machine: PSDeployer
-------------------------------------------------------------------------------------------------------------
Backup start date: 2022-01-04T22:06:00
-------------------------------------------------------------------------------------------------------------
2022-01-04 22:06:00 | Backing up 19 files, total size is 8.11 GB
-------------------------------------------------------------------------------------------------------------
NUMBER FILE SIZE PROGRESS
-------------------------------------------------------------------------------------------------------------
1/19 PSDeployer-166487e5.hlog 490.00 B | Done 0.00%
-------------------------------------------------------------------------------------------------------------
SCSI Device: /dev/disks/naa.6d0946600e2ae10026ffec6d9a6d9017
-------------------------------------------------------------------------------------------------------------
2/19 PSDeployer-flat.vmdk 7.00 GB | Done 0.00%
-------------------------------------------------------------------------------------------------------------
Disk metadata map available, zeros will be skipped
-------------------------------------------------------------------------------------------------------------
::: detail ::: 100.00% done | block 7168 out of 7168 | Done 86.26%
-------------------------------------------------------------------------------------------------------------
3/19 PSDeployer.vmdk 552.00 B | Done 86.26%
-------------------------------------------------------------------------------------------------------------
4/19 PSDeployer.nvram 8.48 KB | Done 86.26%
-------------------------------------------------------------------------------------------------------------
5/19 vmware-1.log 1.40 MB | Done 86.26%
-------------------------------------------------------------------------------------------------------------
6/19 PSDeployer.vmx 2.90 KB | Done 86.28%
-------------------------------------------------------------------------------------------------------------
7/19 PSDeployer.vmsd 452.00 B | Done 86.28%
-------------------------------------------------------------------------------------------------------------
8/19 PSDeployer.vmx.tmp 2.90 KB | Done 86.28%
-------------------------------------------------------------------------------------------------------------
9/19 vmware-2.log 1.16 MB | Done 86.28%
-------------------------------------------------------------------------------------------------------------
10/19 vmx-PSDeployer-312326077-1.vswp [skipped excluded]
-------------------------------------------------------------------------------------------------------------
11/19 PSDeployer.vmx.lck [skipped excluded]
-------------------------------------------------------------------------------------------------------------
12/19 PSDeployer.vmx~ 2.90 KB | Done 86.29%
-------------------------------------------------------------------------------------------------------------
13/19 vmware.log 2.88 MB | Done 86.29%
-------------------------------------------------------------------------------------------------------------
14/19 PSDeployer-129db7bd.vswp [skipped excluded]
-------------------------------------------------------------------------------------------------------------
15/19 PSDeployer-aux.xml 13.00 B | Done 86.33%
-------------------------------------------------------------------------------------------------------------
16/19 PSDeployer-Snapshot174.vmsn 19.53 KB | Done 86.33%
-------------------------------------------------------------------------------------------------------------
17/19 PSDeployer-000001-sesparse.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
18/19 PSDeployer-000001.vmdk [skipped excluded]
-------------------------------------------------------------------------------------------------------------
19/19 PSDeployer.vmsd.tmp 45.00 B | Done 86.33%
-------------------------------------------------------------------------------------------------------------
Total size: 7.01 GB | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
Backup end date: 2022-01-04T22:07:35
-------------------------------------------------------------------------------------------------------------
Time taken: 00:01:35 (95 sec.)
-------------------------------------------------------------------------------------------------------------
Total time: 00:01:35 (95 sec.)
-------------------------------------------------------------------------------------------------------------
Full file speed: 75.51 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed: 36.88 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed with errors
-------------------------------------------------------------------------------------------------------------
Differential blocks were added to the .blocklog database
-------------------------------------------------------------------------------------------------------------
(c)ESXi host <olympus.infra.xxxxxx.network> configuration backup:
-------------------------------------------------------------------------------------------------------------
Saving config: /scratch/downloads/520f3f29-b44c-6556-ee58-5f937cb3748f/configBundle-olympus.infra.xxxxxx.network.tgz
Backing up to: /vmfs/volumes/nfs_typhon_xsi_olympus/xsi_repos/2022_DC_CBT/cfgbak/esxi-config_olympus.infra.xxxxxx.network_2022-01-04T22:07:35.tgz
-------------------------------------------------------------------------------------------------------------
2022-01-04T22:07:38 | Error code 4701 at file xsibackup.c, line 4701 | Error description: some error/s were raised while backing up: VMs(PSDeployer), error count is: 2
-------------------------------------------------------------------------------------------------------------
Removed host <tmp> dir OK
-------------------------------------------------------------------------------------------------------------
rm: can't remove '/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus/tmp/12344571/.vnfs-b1507ee3c-.blocklog': Device or resource busy
rm: can't remove '/vmfs/volumes/0c6d4303-b890de35/xsibackup_1.5.1.6_olympus/tmp/12344571': Directory not empty
2022-01-04T22:07:38 | Error code 2209 at file common.c, line 2209 | Error description: can't remove directory tree, error: 0
, description: No such file or directory
-------------------------------------------------------------------------------------------------------------
Unlocked backup OK
-------------------------------------------------------------------------------------------------------------
Log file unmapped OK
-------------------------------------------------------------------------------------------------------------
Sending e-mail to icc@xxxxxx.com through SMTP#1...
-------------------------------------------------------------------------------------------------------------
E-mail was sent OK
-------------------------------------------------------------------------------------------------------------The backup succeeded but it throws an error from what I understand to be:
-------------------------------------------------------------------------------------------------------------
2022-01-04T22:05:49 | Error code 1522 at file common.c, line 1522 | Error description: error running command run_backup_cmd(), returned: 127
-------------------------------------------------------------------------------------------------------------
2022-01-04T22:05:49 | Error code 1547 at file common.c, line 1547 | Error description: could not get remote FS available space at /vmfs/volumes/nfs_typhon_xsi_olympus/xsi_repos/2022_DC_CBT, details: No such file or directory
-------------------------------------------------------------------------------------------------------------Which is strange, as the NFS mounted volume is also used by 1.4.3.17 (which doesn't throw the error) as:
/vmfs/volumes/nfs_typhon_xsi_olympus/xsi_repos/2021_DC/
I read in another post about permissions, in this case the FS permissions are all 755.
The NFS volume is exported with:
rw,async,no_root_squash,no_subtree_check
Any idea what could be the cause?
#13 Re: General matters » VMWare ESXi: hardware Segmentation fault » 2020-12-20 22:28:45
Could not retrieve disk metadata all blocks will be scanned
That indicates that some of your VMs reside in an NFS host or that the metadata for that VM is corrupt, as it could not be retrieved.
If you have mixed datastore types VMFS & NFS, try to group VMs by datastore type into two different jobs. We will check that posibility in search of an eventual bug.
If you don't have NFS datastores, then clone that VM with vmkfstools to regenerate the associated metadata.
Thanks for your reply.
Yes, it's mixed VMFS/NFS.
For now I'm just running xsibackup for each individual VM but that also fails after a few days with segmentation faults.
The only way to fix it is to give it an empty repository directory, it continues without segmentation faults.
Never had this problem in 1.4.0.0, is there a way to download 1.4.0.0 again?
#14 Re: General matters » VMWare ESXi: hardware Segmentation fault » 2020-12-16 23:58:44
Splitting did not really work for some reason, perhaps it has to do with the VM name characters. I'm looping over the list so there is just a single xsibackup invocation each time as opposed to providing a long list of VM's.
I noticed in /scratch/downloads/ the exported configs .tgz files accumulate, maybe also a candidate for cleaning after a backup run.
#15 Re: General matters » VMWare ESXi: hardware Segmentation fault » 2020-12-16 16:01:27
Yes, I read somewhere here about a bug in the 1.4.0.0 and an upgrade was probably best, hence why I upgraded. 1.4.0.0 was pretty rock solid indeed. I should have have stayed at 1.4.0.0 
It seems the problem is in some way triggered when providing multiple VM's, it never happens when just backing up a single VM.
I'll probably end up looping over the VM's I want backed-up and starting xsibackup with a single VM.
In another run I now got:
2020-12-16T14:12:32 | Error code 131 at file signal.c, line 131 | Error description: some error was trapped SIGTERM (11) (11) while executing the job, error: No space left on device
Which is probably /tmp filling up, but XSIBackup-DC is the only folder with data in /tmp. I have now symlinked /tmp/xsi to another location, perhaps I can get a full set of backups this way.
Maybe I'll have to symlink /scratch/xsibackup/tmp also to another location.
#16 General matters » VMWare ESXi: hardware Segmentation fault » 2020-12-16 09:34:57
- wowbagger
- Replies: 23
Running this cmdline:
/scratch/xsibackup/xsibackup --backup "VMs(ansible01.infra.dileoz.network,vlpr-mongodb01.prd.saas.dpp.dileoz.network,pfsense2_dileoz_network,vlpr-jasper01.prd.saas.dpp.dileoz.network,vwac03_acc_template_empower_dileoz_network,sftp.prd.saas.dileoz.network,vwac02_acc_pov_empower_dileoz_network,vwac01_acc_saas_empower_dileoz_network,vwpr02_prd_pov_empower_dileoz_network,vlpr-order01.prd.saas.dpp.dileoz.network,vcenter01_infra_dileoz_network,codeks_prd_knokkeheist_dpp_dileoz_network,DILEWEB0001,Oracle-1,softether.infra.dileoz.network,vault01_dileoz_network,SRVPBSTEST02,SRVPBSSQL02,Graylog2)" /vmfs/volumes/nfs_typhon_olympus/XSI_Backup/2020_DC --verbosity=5 --use-smtp=1 --compression=true --config-backup --subject='Olympus Backup' --mail-to=icc@dileoz.com
Always happens at the exact same VM, number #5.
Backing the VM's individually does not generate the error.
[90m-----------------------------------------------------------------------------------------------------------[0m
<icc@dileoz.com> was evaluated as an e-mail address
[90m|---------------------------------------------------------------------------------|[0m
[90m||-------------------------------------------------------------------------------||[0m
[90m|||[0m[1m (c)XSIBackup-DC 1.4.2.7: Backup & Replication Software [0m [90m|||[0m
[90m|||[0m[1m (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved[0m [90m|||[0m
[90m||-------------------------------------------------------------------------------||[0m
[90m|---------------------------------------------------------------------------------|[0m
(c)Daniel J. Garcia Fidalgo | info@33hops.com
[90m|---------------------------------------------------------------------------------|[0m
System Information: ESXi, Kernel 6 Major 7 Minor 0 Patch 0
[90m-----------------------------------------------------------------------------------------------------------[0m
License: [1m00050654000000000000000090b11c1f6861[0m
[90m-----------------------------------------------------------------------------------------------------------[0m
Primary TMP folder: /tmp/xsi/2789239
[90m-----------------------------------------------------------------------------------------------------------[0m
Secondary TMP folder: /scratch/xsibackup/tmp/2789239
[90m-----------------------------------------------------------------------------------------------------------[0m
PID: 2789239, Running job as: [1mroot[0m
[90m-----------------------------------------------------------------------------------------------------------[0m
LZJB compression has been enabled
[90m-----------------------------------------------------------------------------------------------------------[0m
Block size is 1.00 MB (1048576 bytes)
[90m-----------------------------------------------------------------------------------------------------------[0m
Performing --backup action
[90m-----------------------------------------------------------------------------------------------------------[0m
Created backup folder at: [90m/vmfs/volumes/nfs_typhon_olympus/XSI_Backup/2020_DC/20201216001541[0m
[90m-----------------------------------------------------------------------------------------------------------[0m
(c)XSIBackup-DC setting repository at /vmfs/volumes/nfs_typhon_olympus/XSI_Backup/2020_DC
[90m-----------------------------------------------------------------------------------------------------------[0m
Located backup folder at: [90m/vmfs/volumes/nfs_typhon_olympus/XSI_Backup/2020_DC/data[0m
[90m-----------------------------------------------------------------------------------------------------------[0m
.xsitools file located: /vmfs/volumes/nfs_typhon_olympus/XSI_Backup/2020_DC/.xsitools
[90m-----------------------------------------------------------------------------------------------------------[0m
Item number 1 in this job
[90m-----------------------------------------------------------------------------------------------------------[0m
Hardware disk: /dev/disks/naa.6d0946600e2ae10026ffec6d9a6d9017
[90m-----------------------------------------------------------------------------------------------------------[0m
Created backup folder at: [90m/vmfs/volumes/4e815752-33eb9462/XSI_Backup/2020_DC/20201216001541/ansible01.infra.dileoz.network[0m
[90m-----------------------------------------------------------------------------------------------------------[0m
Lock file: /vmfs/volumes/4e815752-33eb9462/XSI_Backup/2020_DC/20201216001541/ansible01.infra.dileoz.network/.locked
Virtual Machine: [1mansible01.infra.dileoz.network[0m
[90m-----------------------------------------------------------------------------------------------------------[0m
Backup start date: 2020-12-16T00:15:54
[90m-----------------------------------------------------------------------------------------------------------[0m
2020-12-16 00:15:54 | Backing up 13 files, total size is 108.08 GB
[90m-----------------------------------------------------------------------------------------------------------[0m
NUMBER FILE SIZE PROGRESS
[90m-----------------------------------------------------------------------------------------------------------[0m1/13 ansible01.infra.dileoz.network-376bec04.hlog 549.00 B [90m|[0m Done 0.00%
[90m-----------------------------------------------------------------------------------------------------------[0m
FS block size: 1048576
Source file size: 549 bytes
Source file: 0 allocated blocks
Using default block size: 1048576
LZJB compression set by user
[90m-----------------------------------------------------------------------------------------------------------[0m
1 blocks to backup
[90m-----------------------------------------------------------------------------------------------------------[0m
1 lines in .map file vs 1 detected blocks
[90m-----------------------------------------------------------------------------------------------------------[0m2/13 ansible01.infra.dileoz.network-flat.vmdk [open excluded]
[90m-----------------------------------------------------------------------------------------------------------[0m3/13 ansible01.infra.dileoz.network.vmdk 552.00 B [90m|[0m Done 0.00%
[90m-----------------------------------------------------------------------------------------------------------[0m
FS block size: 1048576
Source file size: 552 bytes
Source file: 0 allocated blocks
Using default block size: 1048576
LZJB compression set by user
[90m-----------------------------------------------------------------------------------------------------------[0m
Could not retrieve disk metadata all blocks will be scanned
[90m-----------------------------------------------------------------------------------------------------------[0m
1 blocks to backup
[90m-----------------------------------------------------------------------------------------------------------[0m
1 lines in .map file vs 1 detected blocks
[90m-----------------------------------------------------------------------------------------------------------[0m4/13 ansible01.infra.dileoz.network.nvram 8.48 KB [90m|[0m Done 0.00%
[90m-----------------------------------------------------------------------------------------------------------[0m
FS block size: 1048576
Source file size: 8684 bytes
Source file: 128 allocated blocks
Using default block size: 1048576
LZJB compression set by user
[90m-----------------------------------------------------------------------------------------------------------[0m
1 blocks to backup
[90m-----------------------------------------------------------------------------------------------------------[0m
1 lines in .map file vs 1 detected blocks
[90m-----------------------------------------------------------------------------------------------------------[0m5/13 ansible01.infra.dileoz.network.vmx 3.48 KB [90m|[0m Done 0.00%
[90m-----------------------------------------------------------------------------------------------------------[0m<SNIPPED>
15/19 vlpr-jasper01.prd.saas.dpp.dileoz.network-Snapshot39.vmsn 19.69 KB [90m|[0m Done 75.42%
[90m-----------------------------------------------------------------------------------------------------------[0m
FS block size: 1048576
Source file size: 20167 bytes
Source file: 128 allocated blocks
Using default block size: 1048576
LZJB compression set by user
[90m-----------------------------------------------------------------------------------------------------------[0m
1 blocks to backup
[90m-----------------------------------------------------------------------------------------------------------[0m
1 lines in .map file vs 1 detected blocks
[90m-----------------------------------------------------------------------------------------------------------[0m16/19 vlpr-jasper01.prd.saas.dpp.dileoz.network-000001-sesparse.vmdk [skipped excluded]
[90m-----------------------------------------------------------------------------------------------------------[0m17/19 vlpr-jasper01.prd.saas.dpp.dileoz.network-000001.vmdk [skipped excluded]
[90m-----------------------------------------------------------------------------------------------------------[0m18/19 vlpr-jasper01.prd.saas.dpp.dileoz.network_1-000001-sesparse.vmdk [skipped excluded]
[90m-----------------------------------------------------------------------------------------------------------[0m19/19 vlpr-jasper01.prd.saas.dpp.dileoz.network_1-000001.vmdk [skipped excluded]
[90m-----------------------------------------------------------------------------------------------------------[0m
Total size: 50.00 GB [90m|[0m Done 100.00%
[90m-----------------------------------------------------------------------------------------------------------[0m
*** Snapshot was removed ***
[90m-----------------------------------------------------------------------------------------------------------[0m
Total CPU ticks: 173885795048
Avg frequency (Ghz): 2.02
Real data ticks: 437557411326
Real data seconds: 216
Raw data speed: 0.00
Backup end date: 2020-12-16T00:33:21
[90m-----------------------------------------------------------------------------------------------------------[0m
Time taken: 00:01:26 (86 sec.)
[90m-----------------------------------------------------------------------------------------------------------[0m
Total time: 989 sec.
[90m-----------------------------------------------------------------------------------------------------------[0m
Full file speed: 595.35 mb/s
[90m-----------------------------------------------------------------------------------------------------------[0m
Real data speed: 0.38 mb/s
[90m-----------------------------------------------------------------------------------------------------------[0m
Item backup completed
[90m-----------------------------------------------------------------------------------------------------------[0m
Item number 5 in this job
[90m-----------------------------------------------------------------------------------------------------------[0m
Hardware dSegmentation fault
What could this mean?
Thx
#17 Re: General matters » Error code 665 » 2020-12-13 15:33:39
Just saw this in the ESX log:
The ramdisk 'tmp' is full. As a result, the file /tmp/xsi/2742247/ansible01.infra.dileoz.network-5b835202.hlog.map could not be written.
There were several 70M directories in /tmp/xsi/.
Removing those fixed this issue.
Do we have to clean out specific folders after an XSI run?
#18 General matters » Error code 665 » 2020-12-13 15:18:30
- wowbagger
- Replies: 2
Hi,
I'm getting Error code 665. What could be the cause?
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
||| (c)XSIBackup-DC 1.4.2.7: Backup & Replication Software |||
||| (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
(c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 6 Major 7 Minor 0 Patch 0
-----------------------------------------------------------------------------------------------------------
License: 00050654000000000000000090b11c1f6861
-----------------------------------------------------------------------------------------------------------
Primary TMP folder: /tmp/xsi/2742247
-----------------------------------------------------------------------------------------------------------
Secondary TMP folder: /vmfs/volumes/5f734afc-781c5998-3e6c-ecf4bbe842dc/xsibackup/tmp/2742247
-----------------------------------------------------------------------------------------------------------
PID: 2742247, Running job as: root
-----------------------------------------------------------------------------------------------------------
LZJB compression has been enabled
-----------------------------------------------------------------------------------------------------------
Block size is 1.00 MB (1048576 bytes)
-----------------------------------------------------------------------------------------------------------
Performing --backup action
-----------------------------------------------------------------------------------------------------------
Created backup folder at: /vmfs/volumes/nfs_typhon_olympus/XSI_Backup/2020_DC/20201213151720
-----------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC setting repository at /vmfs/volumes/nfs_typhon_olympus/XSI_Backup/2020_DC
-----------------------------------------------------------------------------------------------------------
Located backup folder at: /vmfs/volumes/nfs_typhon_olympus/XSI_Backup/2020_DC/data
-----------------------------------------------------------------------------------------------------------
.xsitools file located: /vmfs/volumes/nfs_typhon_olympus/XSI_Backup/2020_DC/.xsitools
-----------------------------------------------------------------------------------------------------------
Item number 1 in this job
-----------------------------------------------------------------------------------------------------------
Hardware disk: /dev/disks/naa.6d0946600e2ae10026ffec6d9a6d9017
-----------------------------------------------------------------------------------------------------------
Virtual Machine Name: ansible01.infra.dileoz.network
-----------------------------------------------------------------------------------------------------------
Creating snapshot VM : ansible01.infra.dileoz.network (powered on)
-----------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-----------------------------------------------------------------------------------------------------------
Created backup folder at: /vmfs/volumes/4e815752-33eb9462/XSI_Backup/2020_DC/20201213151720/ansible01.infra.dileoz.network
-----------------------------------------------------------------------------------------------------------
Lock file: /vmfs/volumes/4e815752-33eb9462/XSI_Backup/2020_DC/20201213151720/ansible01.infra.dileoz.network/.locked
Virtual Machine: ansible01.infra.dileoz.network
-----------------------------------------------------------------------------------------------------------
Backup start date: 2020-12-13T15:17:30
-----------------------------------------------------------------------------------------------------------
2020-12-13 15:17:30 | Backing up 20 files, total size is 58.29 GB
-----------------------------------------------------------------------------------------------------------
NUMBER FILE SIZE PROGRESS
-----------------------------------------------------------------------------------------------------------
1/20 ansible01.infra.dileoz.network-5b835202.hlog 549.00 B | Done 0.00%
-----------------------------------------------------------------------------------------------------------
FS block size: 1048576
Source file size: 549 bytes
Source file: 0 allocated blocks
Using default block size: 1048576
LZJB compression set by user
-----------------------------------------------------------------------------------------------------------
1 blocks to backup
-----------------------------------------------------------------------------------------------------------Block 0, exists: 1, f9322789e6997ef3a162af3cbd3b1d7f0113de80;549
0 lines in .map file vs 1 detected blocks
-----------------------------------------------------------------------------------------------------------
2020-12-13T15:17:30 | Error code 665 at file dedup-in.c, line 665 | Error description: 0 lines in .map file is different to 1 detected blocks
-----------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-----------------------------------------------------------------------------------------------------------
Removed <tmp> dir OK
-----------------------------------------------------------------------------------------------------------
Unlocked backup OK
-----------------------------------------------------------------------------------------------------------
#19 Re: General matters » Different Versions » 2020-10-08 14:42:04
Ok, thanks for your reply.
To be sure, so there is no problem using 1.1.0.4 and 1.4.1.1 together on the same repo?
#20 General matters » Different Versions » 2020-10-08 10:41:04
- wowbagger
- Replies: 3
Hi,
I'm using XSIBackup-DC over 2 different ESXi hosts using the same DC repository, XSIBackup-DC 1.1.0.4
I am now adding a 3d ESXi host and would like to re-use the same DC repository, but with version XSIBackup-DC 1.4.0.0 that I now registered.
Is the version difference a problem for the same repository?
Thanks.
#21 General matters » XSIBackup DC - multiple emails » 2020-01-22 09:04:18
- wowbagger
- Replies: 1
XSIBackup used to take a comma separated list of emails, but this doesn't seem to work with XSIBackup DC.
Error description: the --mail-to value can't be evaluated as an e-mail address: mail1@domain.com,mail2@domain.com
Used cmdline:
--mail-to=mail1@domain.com,mail2@domain.com
Is there a way to send the report to multiple email addresses with DC?
Thx!
#22 Re: General matters » xsibackup DC exit code » 2020-01-21 21:55:40
Thanks for your reply,
The error itself I copied has something to do with a VM that has been renamed through vCenter, I'm still planning to analyse it a bit deeper but I guess I can fix it by using vmware-convertor on the renamed VM so all notions of the previous name are gone. I don't think it's a problem with XSIBackup.
Reason for renaming was that the VM name itself contained () braces after joining other ESX hosts into vCenter and it detected VM's with the same (Windows-Test-Machine) name and appended (1) (2) ... after each VM, so I renamed them because I figured VM's with () braces in the name could upset the XSIBackup cmdline.
But the question was indeed for the exit-codes , I'm using XSIBackup in a remote ssh execution inside a Jenkins job and now work around it by first deleting var/log/error.log file before starting XSIBackup and when the backup is finished I count the lines in var/log/error.log and use that as an exit code for the Jenkins job so when it's != 0 the Jenkins job throws an error so we know the backup or the repo-check had an issue.
Thx!
#23 General matters » xsibackup DC exit code » 2020-01-20 18:56:31
- wowbagger
- Replies: 3
Using NFS sync fixed my previous problem but now I'm running into this:
2020-01-20T18:36:04 | Error code 2713 at file xsibackup.c, line 2713
Error description: some error was raised while backing up: VMs(Windows-Test-Machine), error count is: 2
-----------------------------------------------------------------------------------------------------------
Removed /tmp/xsi dir OK
-----------------------------------------------------------------------------------------------------------
Unlocked backup OK
-----------------------------------------------------------------------------------------------------------
Removed PID OK
-----------------------------------------------------------------------------------------------------------
[root@castor:/vmfs/volumes/5ac69dfc-2fa7b7e2-0c51-000af78e7300/xsi] echo $?
0XSIBackup DC exit code is zero but it did encounter an error.
Is it possible to throw exit code <> 0 if it encountered an error?
Thx
#24 Re: General matters » Error when running backup » 2019-10-18 13:11:30
Thanks for your reply but I don't see how you consider the SSH session to expire when VM_SERVER_LIST contains multiple servers and it errors on each of the servers after a while but continues with the next server when encountered an error, DC continues to log output, it does not stop.
Consider this command, it's just a standard remote SSH command execution and nothing complex, this is how we execute XSIBackup Pro for the last >year also:
$ssh root@$ESX_SERVER '/scratch/xsi/xsibackup --backup "VMs(Oracle-1)" /vmfs/volumes/XSI_BACKUP/POLLUX-xsitools/2019_DC/ --verbosity=5 --use-smtp=1 --subject="Pollux Backup"'
XSIBackup DC generates this as output:
[90m|---------------------------------------------------------------------------------|[0m
[90m||-------------------------------------------------------------------------------||[0m
[90m|||[0m[1m (c)XSIBackup-Datacenter 1.0.0.1: Backup & Replication Software [0m [90m|||[0m
[90m|||[0m[1m (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved[0m [90m|||[0m
[90m||-------------------------------------------------------------------------------||[0m
[90m|---------------------------------------------------------------------------------|[0m
(c)Daniel J. Garcia Fidalgo | info@33hops.com
[90m|---------------------------------------------------------------------------------|[0m
System Information: ESXi, Kernel 6 Major 0 Minor 0 Patch 0
[90m-----------------------------------------------------------------------------------------------------------------[0m
License: [1m000306F200000000000000002047479466ac[0m
[90m-----------------------------------------------------------------------------------------------------------------[0m
PID: 245181660, Running job as: [1mroot[0m
[90m-----------------------------------------------------------------------------------------------------------------[0m
(c)XSIBackup-Datacenter setting repository at /vmfs/volumes/XSI_BACKUP/POLLUX-xsitools/2019_DC/
[90m-----------------------------------------------------------------------------------------------------------------[0m
Virtual Machine Name: Oracle-1
[90m-----------------------------------------------------------------------------------------------------------------[0m
Creating snapshot VM : Oracle-1 (powered on)
[90m-----------------------------------------------------------------------------------------------------------------[0m
*** Snapshot was successfully created ***
[90m-----------------------------------------------------------------------------------------------------------------[0m
New Backup: [1mOracle-1[0m
[90m-----------------------------------------------------------------------------------------------------------------[0m
Backup start date: 2019-10-18 10:17:18
[90m-----------------------------------------------------------------------------------------------------------------[0m
2019-10-18 10:17:18 | Backing up 41 files, total size is 224624829954
[90m-----------------------------------------------------------------------------------------------------------------[0m
NUMBER FILE SIZE PROGRESS
[90m-----------------------------------------------------------------------------------------------------------------[0m1/41 Oracle-1-3a76f09d.hlog 42.00 B [90m|[0m Done 0.00%
[90m-----------------------------------------------------------------------------------------------------------------[0m<******* LOGLINES ARE REMOVED HERE FOR LENGTH *******>
2/41 Oracle-1-flat.vmdk 16.00 GB [90m|[0m Done 0.00%
[90m-----------------------------------------------------------------------------------------------------------------[0m
Disk metadata map available, zeros will be skipped
[90m-----------------------------------------------------------------------------------------------------------------[0m[90m::: detail :::[0m 0.06% done [90m|[0m block 1 out of 1639 [90m|[0m Done 0.00%
[90m::: detail :::[0m 100.00% done [90m|[0m block 1024 out of 1024 [90m|[0m Done 12.43%
[90m-----------------------------------------------------------------------------------------------------------------[0m9/41 Oracle-1.vmxf 150.00 B [90m|[0m Done 12.43%
[90m-----------------------------------------------------------------------------------------------------------------[0m10/41 Oracle-1.vmx 3.64 KB [90m|[0m Done 12.43%
[90m-----------------------------------------------------------------------------------------------------------------[0m11/41 Oracle-1.vmx~ 3.61 KB [90m|[0m Done 12.43%
[90m-----------------------------------------------------------------------------------------------------------------[0m12/41 Oracle-1.nvram 8.48 KB [90m|[0m Done 12.43%
[90m-----------------------------------------------------------------------------------------------------------------[0m13/41 Oracle-1_6-flat.vmdk 110.00 GB [90m|[0m Done 12.43%
[90m-----------------------------------------------------------------------------------------------------------------[0m
Disk metadata map available, zeros will be skipped
[90m-----------------------------------------------------------------------------------------------------------------[0m[90m::: detail :::[0m 0.01% done [90m|[0m block 1 out of 11264 [90m|[0m Done 12.43%
[90m::: detail :::[0m 0.02% done [90m|[0m block 2 out of 11264 [90m|[0m Done 12.44%<******* LOGLINES ARE REMOVED HERE FOR LENGTH *******>
[90m::: detail :::[0m 100.00% done [90m|[0m block 11264 out of 11264 [90m|[0m Done 65.01%
[90m-----------------------------------------------------------------------------------------------------------------[0m14/41 Oracle-1_1.vmdk.extents 37.05 KB [90m|[0m Done 65.01%
[90m-----------------------------------------------------------------------------------------------------------------[0m
Could not retrieve disk metadata all blocks will be scanned
[90m-----------------------------------------------------------------------------------------------------------------[0m15/41 vmware-61.log 3.15 MB [90m|[0m Done 65.01%
[90m-----------------------------------------------------------------------------------------------------------------[0m16/41 Oracle-1_5-flat.vmdk 20.00 GB [90m|[0m Done 65.01%
[90m-----------------------------------------------------------------------------------------------------------------[0m
Disk metadata map available, zeros will be skipped
[90m-----------------------------------------------------------------------------------------------------------------[0m[90m::: detail :::[0m 0.05% done [90m|[0m block 1 out of 2048 [90m|[0m Done 65.02%
[90m::: detail :::[0m 0.10% done [90m|[0m block 2 out of 2048 [90m|[0m Done 65.02%<******* LOGLINES ARE REMOVED HERE FOR LENGTH *******>
[90m::: detail :::[0m 100.00% done [90m|[0m block 2048 out of 2048 [90m|[0m Done 74.57%
[90m-----------------------------------------------------------------------------------------------------------------[0m17/41 Oracle-1_5.vmdk 498.00 B [90m|[0m Done 74.57%
[90m-----------------------------------------------------------------------------------------------------------------[0m
Could not retrieve disk metadata all blocks will be scanned
[90m-----------------------------------------------------------------------------------------------------------------[0m18/41 vmware-58.log 1.14 MB [90m|[0m Done 74.57%
[90m-----------------------------------------------------------------------------------------------------------------[0m19/41 vmware-56.log 204.36 KB [90m|[0m Done 74.57%
[90m-----------------------------------------------------------------------------------------------------------------[0m20/41 Oracle-1_6.vmdk 500.00 B [90m|[0m Done 74.57%
[90m-----------------------------------------------------------------------------------------------------------------[0m
Could not retrieve disk metadata all blocks will be scanned
[90m-----------------------------------------------------------------------------------------------------------------[0m21/41 Oracle-1_2-flat.vmdk 40.00 GB [90m|[0m Done 74.57%
[90m-----------------------------------------------------------------------------------------------------------------[0m
Disk metadata map available, zeros will be skipped
[90m-----------------------------------------------------------------------------------------------------------------[0m[90m::: detail :::[0m 0.02% done [90m|[0m block 1 out of 4096 [90m|[0m Done 74.58%
[90m::: detail :::[0m 0.05% done [90m|[0m block 2 out of 4096 [90m|[0m Done 74.58%<******* LOGLINES ARE REMOVED HERE FOR LENGTH *******>
[90m::: detail :::[0m 15.89% done [90m|[0m block 651 out of 4096 [90m|[0m Done 77.61%
[90m::: detail :::[0m 15.92% done [90m|[0m block 652 out of 4096 [90m|[0m Done 77.62%2019-10-18T11:45:18 | Error code 434 at file dedup-in.c, line 434
Error description: can't rename temp block: /vmfs/volumes/XSI_BACKUP/POLLUX-xsitools/2019_DC//data/f/a/6/f/6/fa6f6e33afff2395af66b83ada7674a785d4f717
[90m-----------------------------------------------------------------------------------------------------------------[0m[90m-----------------------------------------------------------------------------------------------------------------[0m
22/41 Oracle-1_2.vmdk 498.00 B [90m|[0m Done 77.62%
[90m-----------------------------------------------------------------------------------------------------------------[0m
Could not retrieve disk metadata all blocks will be scanned
[90m-----------------------------------------------------------------------------------------------------------------[0m23/41 Oracle-1_5.vmdk.extents 36.77 KB [90m|[0m Done 77.62%
[90m-----------------------------------------------------------------------------------------------------------------[0m
Could not retrieve disk metadata all blocks will be scanned
[90m-----------------------------------------------------------------------------------------------------------------[0m24/41 Oracle-1_2.vmdk.extents 139.43 KB [90m|[0m Done 77.62%
[90m-----------------------------------------------------------------------------------------------------------------[0m
Could not retrieve disk metadata all blocks will be scanned
[90m-----------------------------------------------------------------------------------------------------------------[0m25/41 vmware-59.log 795.52 KB [90m|[0m Done 77.62%
[90m-----------------------------------------------------------------------------------------------------------------[0m26/41 Oracle-1.vmdk.extents 935.00 B [90m|[0m Done 77.62%
[90m-----------------------------------------------------------------------------------------------------------------[0m
Could not retrieve disk metadata all blocks will be scanned
[90m-----------------------------------------------------------------------------------------------------------------[0m27/41 Oracle-1_6.vmdk.extents 201.27 KB [90m|[0m Done 77.62%
[90m-----------------------------------------------------------------------------------------------------------------[0m
Could not retrieve disk metadata all blocks will be scanned
[90m-----------------------------------------------------------------------------------------------------------------[0m28/41 vmx-Oracle-1-2449876116-1.vswp [open excluded] [90m|[0m Done 77.62%
[90m-----------------------------------------------------------------------------------------------------------------[0m29/41 Oracle-1.vmx.lck [open excluded] [90m|[0m Done 77.62%
[90m-----------------------------------------------------------------------------------------------------------------[0m30/41 vmware.log 8.57 MB [90m|[0m Done 77.62%
[90m-----------------------------------------------------------------------------------------------------------------[0m31/41 Oracle-1-92062494.vswp [open excluded] [90m|[0m Done 77.62%
[90m-----------------------------------------------------------------------------------------------------------------[0m32/41 Oracle-1.vmx.tmp 3.61 KB [90m|[0m Done 77.62%
[90m-----------------------------------------------------------------------------------------------------------------[0m33/41 Oracle-1-Snapshot640.vmsn 28.42 KB [90m|[0m Done 77.62%
[90m-----------------------------------------------------------------------------------------------------------------[0m34/41 Oracle-1-000001-delta.vmdk [skipped excluded]
[90m-----------------------------------------------------------------------------------------------------------------[0m35/41 Oracle-1-000001.vmdk [skipped excluded]
[90m-----------------------------------------------------------------------------------------------------------------[0m36/41 Oracle-1_6-000001-delta.vmdk [skipped excluded]
[90m-----------------------------------------------------------------------------------------------------------------[0m37/41 Oracle-1_6-000001.vmdk [skipped excluded]
[90m-----------------------------------------------------------------------------------------------------------------[0m38/41 Oracle-1_2-000001-delta.vmdk [skipped excluded]
[90m-----------------------------------------------------------------------------------------------------------------[0m39/41 Oracle-1_2-000001.vmdk [skipped excluded]
[90m-----------------------------------------------------------------------------------------------------------------[0m40/41 Oracle-1_5-000001-delta.vmdk [skipped excluded]
[90m-----------------------------------------------------------------------------------------------------------------[0m41/41 Oracle-1_5-000001.vmdk [skipped excluded]
[90m-----------------------------------------------------------------------------------------------------------------[0m
Total size: 200719 MB [90m|[0m Done 100.00%
[90m-----------------------------------------------------------------------------------------------------------------[0m
*** Snapshot was removed ***
[90m-----------------------------------------------------------------------------------------------------------------[0m
Backup end date: 2019-10-18 11:45:19
[90m-----------------------------------------------------------------------------------------------------------------[0m
Time taken: 5281 sec.
[90m-----------------------------------------------------------------------------------------------------------------[0m
Total time: 5281 sec.
[90m-----------------------------------------------------------------------------------------------------------------[0m
Full file speed: 38.01 mb/s
[90m-----------------------------------------------------------------------------------------------------------------[0m
Real data speed: 56.55 mb/s
[90m-----------------------------------------------------------------------------------------------------------------[0m
Differential blocks were added to the .blocklog database
[90m-----------------------------------------------------------------------------------------------------------------[0m
Data processing completed successfully
[90m-----------------------------------------------------------------------------------------------------------------[0m
Sending e-mail to email@email.com...
[90m-----------------------------------------------------------------------------------------------------------------[0m
E-mail was sent [32mOK[0m
[90m-----------------------------------------------------------------------------------------------------------------[0m
Removed /tmp/xsi dir [32mOK[0m
[90m-----------------------------------------------------------------------------------------------------------------[0m
Unlocked backup [32mOK[0m
[90m-----------------------------------------------------------------------------------------------------------------[0m
Removed PID [32mOK[0m
[90m-----------------------------------------------------------------------------------------------------------------[0m
If the SSH session would expire or time out at the moment the error is thrown everything would pretty much stop and the connection would be closed with an error state, it would not continue. But the SSH session does not stop or expires as you can see because DC continues.
XSIBackup Pro runs every weekend long-running jobs on a big list of huge VM's and runs for >12h without interruption and executed in the exact same remote SSH executed way, never had an issue but I cannot say the same for DC, I cannot execute it remotely.
#25 Re: General matters » Error when running backup » 2019-10-16 20:51:10
It happens for every backup run. Basically the XSI invocation is a Jenkins job that does a remote SSH's to the ESX server as a user with admin rights and executes XSIBackup cmdline with a list of VM's. The repo is a NFS mounted synology 6TB disk. It holds a 4TB XSIBackup-Pro repository and 2TB of free disk space. It throws the error and moves on to the next VM in the backup list, processes it for a while (actual blocks are added to the data folder) and throws the same error, it does that for every VM in the backup list. I've checked the Synology to see if the disks are failing/going to fail (SMAT) but it all looks good. I've switched back to XSIBackup Pro and initialised a new repository (renamed the old 4TB etc) and it runs without a problem so I'm not sure if it's infrastructure related at this point but then again, they're two different products.
What does the rename temp block actually do?
I tested it with a 4GB VM and didn't have this problem, I'll try to manually do one of the big VM's to see if it's occurring also.