©XSIBackup-Free: Free Backup Software for ©VMWare ©ESXi

Forum ©XSIBackup: ©VMWare ©ESXi Backup Software


You are not logged in.

#1 2021-06-14 19:27:43

ivan
Member
From: Madrid
Registered: 2021-05-26
Posts: 5
Website

Unable to create cbt replica (solved)

Hi there, I'm seeing this problem with a VM after I issue a command like this:

xsibackup --replica=cbt "VMs(Servidor Gestion)" "root@10.10.1.10:22:/vmfs/volumes/datastore2" --options=R --quiesce 

The replica is created, but always with the following message:

Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
Servidor Gestion Hardware Version is: 8
-------------------------------------------------------------------------------------------------------------
All snapshots were removed, as Servidor Gestion is engaged in a CBT job
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: Servidor Gestion
-------------------------------------------------------------------------------------------------------------
(c)ESXi 7.0 or higher detected, all snapshots were removed for VM Servidor Gestion(4)
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : Servidor Gestion (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
|   /!\ Some changes were detected in the remote replicated VM a full sync will be performed now.           |
|   Add --options=R to allow the remote replica to be switched on without triggering a full resync.         |
|   You may continue to run the CBT job later on, it will restart the CBT chain where it was left.          |
|   If you don't know why you are receiving this message you should run --reset-cbt=THIS-VM.                |
-------------------------------------------------------------------------------------------------------------
Virtual Machine: Servidor Gestion

needless to say, the previous replica was never modified, and no matter what I do ( reset the cbt, delete de target repository...) I always get the same message on the second try to create a replica. So, any idea of what should I look into?

Thanks!

-Iván.

Offline

#2 2021-06-14 22:09:21

admin
Administrator
Registered: 2017-04-21
Posts: 2,055

Re: Unable to create cbt replica (solved)

The remote hashes could happen to not be updated.
Could you post the full output of the previous job and the current one please?
Have you tried without quiescing?.

Offline

#3 2021-06-15 14:09:09

admin
Administrator
Registered: 2017-04-21
Posts: 2,055

Re: Unable to create cbt replica (solved)

When a CBT sync is performed, the .vmdk file descriptors need to be updated in the .map files of the replica to reflect the new CID.
When a subsequent sync cycle is run (c)XSIBackup-DC checks that the hash of the .vmdk file descriptors is the same as those stored in the corresponding .map files. When some discrepancy is detected, the CBT scheme is reinitilized.

There are mainly two reasons that could lead to this:

1/ The remote VM was switched on without a test snapshot (--options=R) and the CID changed as per the VM activity. This is the simplest explanation and the first we think of, although at this point it seems clear that is not the case.

2/ The remote hashes of the .vmdk descriptor files failed to be updated. This is the most likely cause as of today. That's why we need the full log. If this is the cause, then there must be some special condition: it could be some bug or some faulty component of the ESXi shell (which we have found to be relatively frequent). Having the exact ESXi version and the rest of details present in the log is fundamental to delve into the issue.

Offline

#4 2021-06-15 16:33:37

ivan
Member
From: Madrid
Registered: 2021-05-26
Posts: 5
Website

Re: Unable to create cbt replica (solved)

Ok, so here is the output of two sequential replicas launched for that VM. The command issued is stored as a job, so it is always the same:

xsibackup \
--replica=cbt \
"VMs(Servidor Gestion)" \
"root@10.10.1.10:22:/vmfs/volumes/datastore2" \
--options=R \
--quiesce \
--mail-to=ivan@redacted.com \
--subject="Replica de Sol/Servidor Gestion en Luna/datastore2" \
>> /vmfs/volumes/60ac44fc-696304c8-eb29-2cea7f551fa5/XSI/XSIBackup-DC/var/log/xsibackup.log 2>&1

And the log file contains this output (no modifications made, save the redacted email addresses):

---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
|||   (c)XSIBackup-DC 1.5.0.7: Backup & Replication Software                    |||
|||   (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved    |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
                   (c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 7 Major 0 Minor 1 Patch 0
-------------------------------------------------------------------------------------------------------------
License: 0005065700000000000000002cea7f551fa5 | (c)XSIBackup-DC
-------------------------------------------------------------------------------------------------------------
Remote system: ESXi
-------------------------------------------------------------------------------------------------------------
PID: 726466, Running job as: root
-------------------------------------------------------------------------------------------------------------
Remote xsibackup binary found at: /scratch/XSI/XSIBackup-DC/xsibackup
-------------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC replicating data to /vmfs/volumes/datastore2
-------------------------------------------------------------------------------------------------------------
Performing --replica action
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
Servidor Gestion Hardware Version is: 8
-------------------------------------------------------------------------------------------------------------
All snapshots were removed, as Servidor Gestion is engaged in a CBT job
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: Servidor Gestion
-------------------------------------------------------------------------------------------------------------
(c)ESXi 7.0 or higher detected, all snapshots were removed for VM Servidor Gestion(4)
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : Servidor Gestion (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
Remote target dir is empty, full sync will be performed
-------------------------------------------------------------------------------------------------------------
Virtual Machine: Servidor Gestion
-------------------------------------------------------------------------------------------------------------
Backup start date: 2021-06-12T22:18:10
-------------------------------------------------------------------------------------------------------------
2021-06-12 22:18:10 | Backing up 37 files, total size is 442.64 GB
-------------------------------------------------------------------------------------------------------------
    NUMBER	                                                   FILE             SIZE          PROGRESS
-------------------------------------------------------------------------------------------------------------
    1/37                       Servidor Gestión-flat.vmdk (CBT 1 full)        136.66 GB    | Done   0.00%
-------------------------------------------------------------------------------------------------------------
    2/37                                         Servidor Gestión.vmxf          3.81 KB    | Done  30.87%
-------------------------------------------------------------------------------------------------------------
    3/37                                         Servidor Gestión.vmdk        729.00 B     | Done  30.87%
-------------------------------------------------------------------------------------------------------------
    4/37                                                  vmx-zdump.000          6.43 MB    | Done  30.87%
-------------------------------------------------------------------------------------------------------------
    5/37                                                  vmware-54.log         71.15 MB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    6/37                                                  vmx-zdump.001          6.18 MB    | Done  30.89%
-------------------------------------------------------------------------------------------------------------
    7/37                                      Servidor Gestión-aux.xml        136.00 B     | Done  30.89%
-------------------------------------------------------------------------------------------------------------
    8/37                                                  vmmcores-1.gz          2.54 MB    | Done  30.89%
-------------------------------------------------------------------------------------------------------------
    9/37                                        Servidor Gestión.nvram          8.48 KB    | Done  30.89%
-------------------------------------------------------------------------------------------------------------
   10/37                                                  vmmcores-2.gz          2.23 MB    | Done  30.89%
-------------------------------------------------------------------------------------------------------------
   11/37                                                  vmware-53.log        155.02 KB    | Done  30.89%
-------------------------------------------------------------------------------------------------------------
   12/37                                                  vmware-50.log          6.75 MB    | Done  30.89%
-------------------------------------------------------------------------------------------------------------
   13/37                                                  vmware-55.log         37.64 MB    | Done  30.90%
-------------------------------------------------------------------------------------------------------------
   14/37                     Servidor Gestión_1-flat.vmdk (CBT 1 full)        300.00 GB    | Done  30.90%
-------------------------------------------------------------------------------------------------------------
   15/37                                                     vmware.log        389.17 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   16/37                                                  vmware-52.log        158.49 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   17/37                                                  vmware-51.log        148.27 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   18/37                                     Servidor Gestión.vmsd.tmp         44.00 B     | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   19/37                                          Servidor Gestión.vmx          4.53 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   20/37	 vmx-Servidor Gestión-e36f5def4d744f686a5dda4115157e05                    [open excluded]
-------------------------------------------------------------------------------------------------------------
   21/37                                         Servidor Gestión.vmsd        612.00 B     | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   22/37                                       Servidor Gestión_1.vmdk        633.00 B     | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   23/37	                              Servidor Gestión.vmx.lck                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   24/37                                         Servidor Gestión.vmx~          4.52 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   25/37	                        Servidor Gestión-cade58d0.vswp                    [open excluded]
-------------------------------------------------------------------------------------------------------------
   26/37	                           Servidor Gestión_1-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   27/37	                             Servidor Gestión-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   28/37                                      Servidor Gestión.vmx.tmp          4.52 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   29/37	                      Servidor Gestión-000001-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   30/37	                    Servidor Gestión_1-000001-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   31/37                              Servidor Gestión-Snapshot28.vmsn         33.00 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   32/37	                 Servidor Gestión-000001-sesparse.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   33/37	                          Servidor Gestión-000001.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   34/37	               Servidor Gestión_1-000001-sesparse.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   35/37	                        Servidor Gestión_1-000001.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   37/37                          Servidor Gestión-vss_manifests28.zip         35.16 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
Total size:                                                                    436.79 GB    | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
SHA-1 hashes updated for .vmdk descriptor files
-------------------------------------------------------------------------------------------------------------
Replica registered for VM Servidor Gestion as Servidor Gestion_XSIREP with Id 22
-------------------------------------------------------------------------------------------------------------
Temp snapshot created at replica VM Servidor Gestion_XSIREP
-------------------------------------------------------------------------------------------------------------
Backup end date: 2021-06-13T00:41:30
-------------------------------------------------------------------------------------------------------------
Time taken: 02:23:20 (8600 sec.)
-------------------------------------------------------------------------------------------------------------
Total time:     8600 sec.
-------------------------------------------------------------------------------------------------------------
Full file speed:	                                                                    52.01 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed:	                                                                    69.17 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed without errors
-------------------------------------------------------------------------------------------------------------
Final checksum: 466577882448 bytes were sent and confirmed to have been written remotely
-------------------------------------------------------------------------------------------------------------
Data processing completed successfully
-------------------------------------------------------------------------------------------------------------
Returned(0): could not find SMTP -1, falling back to SMTP 1
-------------------------------------------------------------------------------------------------------------
Sending e-mail to ivan@redacted.com through SMTP#1...
-------------------------------------------------------------------------------------------------------------
E-mail was sent               OK
-------------------------------------------------------------------------------------------------------------
Removed host <tmp> dir        OK
-------------------------------------------------------------------------------------------------------------
Removed prog <tmp> dir        OK
-------------------------------------------------------------------------------------------------------------
Unlocked backup               OK
-------------------------------------------------------------------------------------------------------------
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
|||   (c)XSIBackup-DC 1.5.0.7: Backup & Replication Software                    |||
|||   (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved    |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
                   (c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 7 Major 0 Minor 1 Patch 0
-------------------------------------------------------------------------------------------------------------
License: 0005065700000000000000002cea7f551fa5 | (c)XSIBackup-DC
-------------------------------------------------------------------------------------------------------------
Remote system: ESXi
-------------------------------------------------------------------------------------------------------------
PID: 734579, Running job as: root
-------------------------------------------------------------------------------------------------------------
Remote xsibackup binary found at: /scratch/XSI/XSIBackup-DC/xsibackup
-------------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC replicating data to /vmfs/volumes/datastore2
-------------------------------------------------------------------------------------------------------------
Performing --replica action
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
Servidor Gestion Hardware Version is: 8
-------------------------------------------------------------------------------------------------------------
All snapshots were removed, as Servidor Gestion is engaged in a CBT job
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: Servidor Gestion
-------------------------------------------------------------------------------------------------------------
(c)ESXi 7.0 or higher detected, all snapshots were removed for VM Servidor Gestion(4)
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : Servidor Gestion (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
|   /!\ Some changes were detected in the remote replicated VM a full sync will be performed now.           |
|   Add --options=R to allow the remote replica to be switched on without triggering a full resync.         |
|   You may continue to run the CBT job later on, it will restart the CBT chain where it was left.          |
|   If you don't know why you are receiving this message you should run --reset-cbt=THIS-VM.                |
-------------------------------------------------------------------------------------------------------------
Virtual Machine: Servidor Gestion
-------------------------------------------------------------------------------------------------------------
Backup start date: 2021-06-13T18:37:56
-------------------------------------------------------------------------------------------------------------
2021-06-13 18:37:56 | Backing up 36 files, total size is 442.63 GB
-------------------------------------------------------------------------------------------------------------
    NUMBER	                                                   FILE             SIZE          PROGRESS
-------------------------------------------------------------------------------------------------------------
    1/36                       Servidor Gestión-flat.vmdk (CBT 1 full)        136.66 GB    | Done   0.00%
-------------------------------------------------------------------------------------------------------------
    2/36                                         Servidor Gestión.vmxf          3.81 KB    | Done  30.87%
-------------------------------------------------------------------------------------------------------------
    3/36                                         Servidor Gestión.vmdk        729.00 B     | Done  30.87%
-------------------------------------------------------------------------------------------------------------
    4/36                                                  vmx-zdump.000          6.43 MB    | Done  30.87%
-------------------------------------------------------------------------------------------------------------
    5/36                                                  vmware-54.log         71.15 MB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    6/36                                                  vmx-zdump.001          6.18 MB    | Done  30.89%
-------------------------------------------------------------------------------------------------------------
    7/36                                      Servidor Gestión-aux.xml        136.00 B     | Done  30.89%
-------------------------------------------------------------------------------------------------------------
    8/36                                                  vmmcores-1.gz          2.54 MB    | Done  30.89%
-------------------------------------------------------------------------------------------------------------
    9/36                                        Servidor Gestión.nvram          8.48 KB    | Done  30.89%
-------------------------------------------------------------------------------------------------------------
   10/36                                                  vmmcores-2.gz          2.23 MB    | Done  30.89%
-------------------------------------------------------------------------------------------------------------
   11/36                                                  vmware-53.log        155.02 KB    | Done  30.89%
-------------------------------------------------------------------------------------------------------------
   12/36                                                  vmware-50.log          6.75 MB    | Done  30.89%
-------------------------------------------------------------------------------------------------------------
   13/36                                                  vmware-55.log         37.64 MB    | Done  30.90%
-------------------------------------------------------------------------------------------------------------
   14/36                     Servidor Gestión_1-flat.vmdk (CBT 1 full)        300.00 GB    | Done  30.90%
-------------------------------------------------------------------------------------------------------------
   15/36                                                     vmware.log        447.32 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   16/36                                                  vmware-52.log        158.49 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   17/36                                                  vmware-51.log        148.27 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   18/36                                     Servidor Gestión.vmsd.tmp         44.00 B     | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   19/36                                          Servidor Gestión.vmx          4.53 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   20/36	 vmx-Servidor Gestión-e36f5def4d744f686a5dda4115157e05                    [open excluded]
-------------------------------------------------------------------------------------------------------------
   21/36                                         Servidor Gestión.vmsd        613.00 B     | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   22/36                                       Servidor Gestión_1.vmdk        633.00 B     | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   23/36	                              Servidor Gestión.vmx.lck                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   24/36                                         Servidor Gestión.vmx~          4.52 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   25/36	                        Servidor Gestión-cade58d0.vswp                    [open excluded]
-------------------------------------------------------------------------------------------------------------
   26/36	                           Servidor Gestión_1-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   27/36	                             Servidor Gestión-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   28/36                                      Servidor Gestión.vmx.tmp          4.52 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   29/36	                      Servidor Gestión-000001-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   30/36	                    Servidor Gestión_1-000001-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   31/36                              Servidor Gestión-Snapshot29.vmsn         33.00 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   32/36	                 Servidor Gestión-000001-sesparse.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   33/36	                          Servidor Gestión-000001.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   34/36	               Servidor Gestión_1-000001-sesparse.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   35/36	                        Servidor Gestión_1-000001.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   36/36                          Servidor Gestión-vss_manifests29.zip         35.18 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
Total size:                                                                    436.79 GB    | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
SHA-1 hashes updated for .vmdk descriptor files
-------------------------------------------------------------------------------------------------------------
Replica registered for VM Servidor Gestion as Servidor Gestion_XSIREP with Id 23
-------------------------------------------------------------------------------------------------------------
Temp snapshot created at replica VM Servidor Gestion_XSIREP
-------------------------------------------------------------------------------------------------------------
Backup end date: 2021-06-13T21:11:26
-------------------------------------------------------------------------------------------------------------
Time taken: 02:33:30 (9210 sec.)
-------------------------------------------------------------------------------------------------------------
Total time:     9210 sec.
-------------------------------------------------------------------------------------------------------------
Full file speed:	                                                                    48.56 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed:	                                                                    63.01 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed without errors
-------------------------------------------------------------------------------------------------------------
Final checksum: 466577942023 bytes were sent and confirmed to have been written remotely
-------------------------------------------------------------------------------------------------------------
Data processing completed successfully
-------------------------------------------------------------------------------------------------------------
Returned(0): could not find SMTP -1, falling back to SMTP 1
-------------------------------------------------------------------------------------------------------------
Sending e-mail to ivan@redacted.com through SMTP#1...
-------------------------------------------------------------------------------------------------------------
E-mail was sent               OK
-------------------------------------------------------------------------------------------------------------
Removed host <tmp> dir        OK
-------------------------------------------------------------------------------------------------------------
Removed prog <tmp> dir        OK
-------------------------------------------------------------------------------------------------------------
Unlocked backup               OK
-------------------------------------------------------------------------------------------------------------

I see there are probably a lot of garbage files around (this VM has come a long way, it is a Win2003 Server+SQLServer 2000!), maybe the presence of one of those unused files is making xsibackup think there's something wrong with the replica?

Thanks!

-Iván.

Last edited by ivan (2021-06-15 16:35:33)

Offline

#5 2021-06-16 08:28:18

admin
Administrator
Registered: 2017-04-21
Posts: 2,055

Re: Unable to create cbt replica (solved)

Yes, that could be indeed an issue, as every .vmdk descriptor file will be matched with its hash. Should there not be a hash for some file, the CBT cycle will be reinitialized.

Clean it up whenever you have the chance, leave: active .vmdk and -flat.vmdk files along with the .vmx file. Everything else can be deleted. Make a copy of the VM dir just in case though.

We will reproduce your environment as closely as possible and check the logic.

Offline

#6 2021-06-22 14:23:50

ivan
Member
From: Madrid
Registered: 2021-05-26
Posts: 5
Website

Re: Unable to create cbt replica (solved)

OK, so I just deleted all the unnecessary files and left it as follows ( ls command issued twice: first in powered off state and then after powering the VM on):

[root@sol:/vmfs/volumes/60ac467c-7dd1f8a6-f101-2cea7f551fa5/Servidor Gestion] ls -la
total 455644736
drwx------    1 root     root         81920 Jun 21 19:00 .
drwxr-xr-t    1 root     root         77824 Jun 21 18:48 ..
drwx------    1 root     root         77824 May 29 21:01 .map
d-w-r-xr-T    1 root     root         73728 Jun 10 18:43 .xsi
-rw-------    1 root     root       4478976 Jun 21 18:48 Servidor Gestión-ctk.vmdk
-rw-------    1 root     root     146740871168 Jun 21 18:48 Servidor Gestión-flat.vmdk
-rw-r--r--    1 root     root          8684 Jun 21 18:48 Servidor Gestión.nvram
-rw-------    1 root     root           729 Jun 14 20:17 Servidor Gestión.vmdk
-rw-r--r--    1 root     root          4623 Jun 21 18:48 Servidor Gestión.vmx
-rw-r--r--    1 root     root          3903 May 29 20:58 Servidor Gestión.vmxf
-rw-------    1 root     root       4915712 Jun 21 18:48 Servidor Gestión_1-ctk.vmdk
-rw-------    1 root     root     322122547200 Jun 21 18:48 Servidor Gestión_1-flat.vmdk
-rw-------    1 root     root           633 Jun 15 06:29 Servidor Gestión_1.vmdk
[root@sol:/vmfs/volumes/60ac467c-7dd1f8a6-f101-2cea7f551fa5/Servidor Gestion] ls -lah
total 459924096
drwx------    1 root     root       80.0K Jun 21 19:03 .
drwxr-xr-t    1 root     root       76.0K Jun 21 18:48 ..
drwx------    1 root     root       76.0K May 29 21:01 .map
d-w-r-xr-T    1 root     root       72.0K Jun 10 18:43 .xsi
-rw-------    1 root     root        4.0G Jun 21 19:03 Servidor Gestión-cade58d0.vswp
-rw-------    1 root     root        4.3M Jun 21 19:03 Servidor Gestión-ctk.vmdk
-rw-------    1 root     root      136.7G Jun 21 19:05 Servidor Gestión-flat.vmdk
-rw-r--r--    1 root     root        8.5K Jun 21 18:48 Servidor Gestión.nvram
-rw-------    1 root     root         729 Jun 21 19:03 Servidor Gestión.vmdk
-rw-r--r--    1 root     root        4.5K Jun 21 19:03 Servidor Gestión.vmx
-rw-------    1 root     root           0 Jun 21 19:03 Servidor Gestión.vmx.lck
-rw-r--r--    1 root     root        3.8K May 29 20:58 Servidor Gestión.vmxf
-rw-r--r--    1 root     root        4.4K Jun 21 19:03 Servidor Gestión.vmx~
-rw-------    1 root     root        4.7M Jun 21 19:03 Servidor Gestión_1-ctk.vmdk
-rw-------    1 root     root      300.0G Jun 21 19:04 Servidor Gestión_1-flat.vmdk
-rw-------    1 root     root         633 Jun 21 19:03 Servidor Gestión_1.vmdk
-rw-r--r--    1 root     root      137.0K Jun 21 19:04 vmware.log
-rw-------    1 root     root       82.0M Jun 21 19:03 vmx-Servidor Gestión-e36f5def4d744f686a5dda4115157e059893cdf3-1.vswp

After that I resetted the cbt

<[root@sol:/vmfs/volumes/60ac44fc-696304c8-eb29-2cea7f551fa5/XSI/XSIBackup-DC] ./xsibackup --reset-cbt="Servidor Gestion"
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
|||   (c)XSIBackup-DC 1.5.0.7: Backup & Replication Software                    |||
|||   (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved    |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
                   (c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
Resetting CBT will delete all snapshots and restart the VM
Are you sure you want to completely reset CBT for VM Servidor Gestion? (y/n): y
All snapshots were removed from VM Servidor Gestion
-------------------------------------------------------------------------------------------------------------
(c)VMWare Tools detected, controlled shut down requested
-------------------------------------------------------------------------------------------------------------
Powering off VM: Servidor Gestion(4)...........
-------------------------------------------------------------------------------------------------------------
VM Servidor Gestion(4) is now off.
-------------------------------------------------------------------------------------------------------------
VM Servidor Gestion was stopped
-------------------------------------------------------------------------------------------------------------
All pre-existing -ctk.vmdk files were deleted for VM
-------------------------------------------------------------------------------------------------------------
ctkEnabled general config appended to VM Servidor Gestion
-------------------------------------------------------------------------------------------------------------
ctkEnabled disk config appended to VM Servidor Gestion: scsi0:0.ctkEnabled = "TRUE"
-------------------------------------------------------------------------------------------------------------
ctkEnabled disk config appended to VM Servidor Gestion: scsi0:1.ctkEnabled = "TRUE"
-------------------------------------------------------------------------------------------------------------
VM Servidor Gestion .vmx config was reloaded
-------------------------------------------------------------------------------------------------------------
Turning on VM: Servidor Gestion(4).
-------------------------------------------------------------------------------------------------------------
VM Servidor Gestion(4) is now on.
-------------------------------------------------------------------------------------------------------------
VM Servidor Gestion was restarted
-------------------------------------------------------------------------------------------------------------
CBT was reset for VM: Servidor Gestion
-------------------------------------------------------------------------------------------------------------
Removed host <tmp> dir        OK
-------------------------------------------------------------------------------------------------------------
Removed prog <tmp> dir        OK

then I deleted the destination folder completely and started a new replica, that finished successfully:

|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
|||   (c)XSIBackup-DC 1.5.0.7: Backup & Replication Software                    |||
|||   (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved    |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
                   (c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 7 Major 0 Minor 1 Patch 0
-------------------------------------------------------------------------------------------------------------
License: 0005065700000000000000002cea7f551fa5 | (c)XSIBackup-DC
-------------------------------------------------------------------------------------------------------------
Remote system: ESXi
-------------------------------------------------------------------------------------------------------------
PID: 812879, Running job as: root
-------------------------------------------------------------------------------------------------------------
Remote xsibackup binary found at: /scratch/XSI/XSIBackup-DC/xsibackup
-------------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC replicating data to /vmfs/volumes/datastore2
-------------------------------------------------------------------------------------------------------------
Performing --replica action
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
Servidor Gestion Hardware Version is: 8
-------------------------------------------------------------------------------------------------------------
All snapshots were removed, as Servidor Gestion is engaged in a CBT job
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: Servidor Gestion
-------------------------------------------------------------------------------------------------------------
(c)ESXi 7.0 or higher detected, all snapshots were removed for VM Servidor Gestion(4)
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : Servidor Gestion (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
Remote target dir is empty, full sync will be performed
-------------------------------------------------------------------------------------------------------------
Virtual Machine: Servidor Gestion
-------------------------------------------------------------------------------------------------------------
Backup start date: 2021-06-21T22:03:43
-------------------------------------------------------------------------------------------------------------
2021-06-21 22:03:43 | Backing up 28 files, total size is 442.51 GB
-------------------------------------------------------------------------------------------------------------
    NUMBER	                                                   FILE             SIZE          PROGRESS
-------------------------------------------------------------------------------------------------------------
    1/28                       Servidor Gestión-flat.vmdk (CBT 1 full)        136.66 GB    | Done   0.00%
-------------------------------------------------------------------------------------------------------------
    2/28                                         Servidor Gestión.vmxf          3.81 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    3/28                                         Servidor Gestión.vmdk        729.00 B     | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    4/28                                          Servidor Gestión.vmx          4.53 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    5/28	 vmx-Servidor Gestión-e36f5def4d744f686a5dda4115157e05                    [open excluded]
-------------------------------------------------------------------------------------------------------------
    6/28	                              Servidor Gestión.vmx.lck                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
    7/28                                                   vmware-1.log        276.67 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    8/28                                         Servidor Gestión.vmx~          4.52 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    9/28                                        Servidor Gestión.nvram          8.48 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   10/28                                                     vmware.log        325.34 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   11/28                                         Servidor Gestión.vmsd        609.00 B     | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   12/28	                        Servidor Gestión-cade58d0.vswp                    [open excluded]
-------------------------------------------------------------------------------------------------------------
   13/28                                      Servidor Gestión-aux.xml        134.00 B     | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   14/28                     Servidor Gestión_1-flat.vmdk (CBT 1 full)        300.00 GB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   15/28	                             Servidor Gestión-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   16/28                                     Servidor Gestión.vmsd.tmp         43.00 B     | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   17/28	                           Servidor Gestión_1-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   18/28                                      Servidor Gestión.vmx.tmp          4.52 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   19/28	                      Servidor Gestión-000001-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   20/28	                    Servidor Gestión_1-000001-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   21/28                               Servidor Gestión-Snapshot6.vmsn         33.00 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   22/28                                       Servidor Gestión_1.vmdk        633.00 B     | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   23/28	                 Servidor Gestión-000001-sesparse.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   24/28	                          Servidor Gestión-000001.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   25/28	               Servidor Gestión_1-000001-sesparse.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   27/28	                        Servidor Gestión_1-000001.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   28/28                           Servidor Gestión-vss_manifests6.zip         34.18 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
Total size:                                                                    436.66 GB    | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
SHA-1 hashes updated for .vmdk descriptor files
-------------------------------------------------------------------------------------------------------------
Replica registered for VM Servidor Gestion as Servidor Gestion_XSIREP with Id 26
-------------------------------------------------------------------------------------------------------------
Temp snapshot created at replica VM Servidor Gestion_XSIREP
-------------------------------------------------------------------------------------------------------------
Backup end date: 2021-06-22T00:28:45
-------------------------------------------------------------------------------------------------------------
Time taken: 02:25:02 (8702 sec.)
-------------------------------------------------------------------------------------------------------------
Total time:     8702 sec.
-------------------------------------------------------------------------------------------------------------
Full file speed:	                                                                    51.38 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed:	                                                                    67.49 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed without errors
-------------------------------------------------------------------------------------------------------------
Final checksum: 466408874889 bytes were sent and confirmed to have been written remotely
-------------------------------------------------------------------------------------------------------------
Data processing completed successfully
-------------------------------------------------------------------------------------------------------------
Returned(0): could not find SMTP -1, falling back to SMTP 1
-------------------------------------------------------------------------------------------------------------
Sending e-mail to ivan@redeacted.com through SMTP#1...
-------------------------------------------------------------------------------------------------------------
E-mail was sent               OK
-------------------------------------------------------------------------------------------------------------
Removed host <tmp> dir        OK
-------------------------------------------------------------------------------------------------------------
Removed prog <tmp> dir        OK
-------------------------------------------------------------------------------------------------------------
Unlocked backup               OK

But, unfortunately, the next replica started with the same warning...

|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
|||   (c)XSIBackup-DC 1.5.0.7: Backup & Replication Software                    |||
|||   (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved    |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
                   (c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 7 Major 0 Minor 1 Patch 0
-------------------------------------------------------------------------------------------------------------
License: 0005065700000000000000002cea7f551fa5 | (c)XSIBackup-DC
-------------------------------------------------------------------------------------------------------------
Remote system: ESXi
-------------------------------------------------------------------------------------------------------------
PID: 819822, Running job as: root
-------------------------------------------------------------------------------------------------------------
Remote xsibackup binary found at: /scratch/XSI/XSIBackup-DC/xsibackup
-------------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC replicating data to /vmfs/volumes/datastore2
-------------------------------------------------------------------------------------------------------------
Performing --replica action
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
Servidor Gestion Hardware Version is: 8
-------------------------------------------------------------------------------------------------------------
All snapshots were removed, as Servidor Gestion is engaged in a CBT job
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: Servidor Gestion
-------------------------------------------------------------------------------------------------------------
(c)ESXi 7.0 or higher detected, all snapshots were removed for VM Servidor Gestion(4)
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : Servidor Gestion (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
|   /!\ Some changes were detected in the remote replicated VM a full sync will be performed now.           |
|   Add --options=R to allow the remote replica to be switched on without triggering a full resync.         |
|   You may continue to run the CBT job later on, it will restart the CBT chain where it was left.          |
|   If you don't know why you are receiving this message you should run --reset-cbt=THIS-VM.                |
-------------------------------------------------------------------------------------------------------------
Virtual Machine: Servidor Gestion
-------------------------------------------------------------------------------------------------------------
Backup start date: 2021-06-22T14:04:12
-------------------------------------------------------------------------------------------------------------
2021-06-22 14:04:12 | Backing up 27 files, total size is 442.50 GB
.
.
.

So, no, it looks like the extra files present had nothing to do with the problem for this replica (also, other VMs are being replicated correctly on the same server, it's just this VM).

Thanks,

-Iván.

Offline

#7 2021-06-22 15:06:51

admin
Administrator
Registered: 2017-04-21
Posts: 2,055

Re: Unable to create cbt replica (solved)

Well, thank you for the precise feedback, some users tend to ommit important information or to exaggerate It in the hope, we guess, that they will receive some extra attention. This only makes things worse and support a matter of guessing.

Knowing that this is a VM specific issue is extremely important to narrow the problem down.

Is there something in the VM disk files (special characters, spaces) that makes it different from the other VMs?

Offline

#8 2021-06-22 15:50:48

ivan
Member
From: Madrid
Registered: 2021-05-26
Posts: 5
Website

Re: Unable to create cbt replica (solved)

Well I prefer to be precise and as extensive as necessary, saves time in the end. And It takes 2 and a half hours to make one of these replicas, so why hurry! :-)

OK, I was hoping that shouldn't be a problem, but yeah, disk names contain a special character (an o with a tilde in the word Gestión). I suppose it was inherited from the VM name, and it made it to the disk names. Should I power it off, edit by hand the vmx file and rename the files? (a bit scary, but I think its the fastest way to make the changes...)

Thanks!,

-Iván.

Offline

#9 2021-06-22 16:52:01

admin
Administrator
Registered: 2017-04-21
Posts: 2,055

Re: Unable to create cbt replica (solved)

Well, that's it.

Of course special characters matter. ©XSIBackup-DC has some more strict requirements than ©ESXi in regards to file naming conventions, still they are quite permissive in regards to spaces, hyphens, etc..., special characters like accented ones are not compatible though, at least in case of CBT.

Please, rename your files and/ or VM names and try again.

In general, please do pledge to using ASCII character sets to name your files in (c)ESXi and by extension any Linux FS. You can look at it from a 'reductio ad absurdum' point of view: what's the point in using special characters in virtual disk file names?.

We are obviously more general public oriented and open to all kind of situations, as we now distribute freemium software to people in five continents, using different character sets, keyboards, etc... Nonetheless we have known consultants that would plainly refuse to offer any kind of service to a client with such kind of naming scheme. You are probably thinking that's too radical from part of that person, still we can understand it, as it denotes not having much control on what's going on.

Offline

#10 2021-06-29 16:22:38

ivan
Member
From: Madrid
Registered: 2021-05-26
Posts: 5
Website

Re: Unable to create cbt replica (solved)

OK, soI did all the name cleaning, modified all the pertinent files and got the VM up and running again. At first it looked good, I got a first full replica, and even a second replica made it in just some minutes (finally!!):

-------------------------------------------------------------------------------------------------------------
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
|||   (c)XSIBackup-DC 1.5.0.7: Backup & Replication Software                    |||
|||   (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved    |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
                   (c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 7 Major 0 Minor 1 Patch 0
-------------------------------------------------------------------------------------------------------------
License: 0005065700000000000000002cea7f551fa5 | (c)XSIBackup-DC
-------------------------------------------------------------------------------------------------------------
Remote system: ESXi
-------------------------------------------------------------------------------------------------------------
PID: 832799, Running job as: root
-------------------------------------------------------------------------------------------------------------
Remote xsibackup binary found at: /scratch/XSI/XSIBackup-DC/xsibackup
-------------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC replicating data to /vmfs/volumes/datastore2
-------------------------------------------------------------------------------------------------------------
Performing --replica action
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
Servidor Gestion Hardware Version is: 8
-------------------------------------------------------------------------------------------------------------
All snapshots were removed, as Servidor Gestion is engaged in a CBT job
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: Servidor Gestion
-------------------------------------------------------------------------------------------------------------
(c)ESXi 7.0 or higher detected, all snapshots were removed for VM Servidor Gestion(22)
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : Servidor Gestion (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
Virtual Machine: Servidor Gestion
-------------------------------------------------------------------------------------------------------------
Backup start date: 2021-06-23T21:00:27
-------------------------------------------------------------------------------------------------------------
2021-06-23 21:00:27 | Backing up 28 files, total size is 442.50 GB
-------------------------------------------------------------------------------------------------------------
    NUMBER	                                                   FILE             SIZE          PROGRESS
-------------------------------------------------------------------------------------------------------------
    1/28                            Servidor Gestion-flat.vmdk (CBT 24)        136.66 GB    | Done   0.00%
-------------------------------------------------------------------------------------------------------------
    2/28                                          Servidor Gestion.vmxf          3.79 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    3/28                                          Servidor Gestion.vmdk        727.00 B     | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    4/28                                           Servidor Gestion.vmx          4.52 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    5/28                                       Servidor Gestion-aux.xml        133.00 B     | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    6/28	                              Servidor Gestion-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
    7/28                                                   vmware-1.log        276.67 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    8/28	                            Servidor Gestion_1-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
    9/28                                         Servidor Gestion.nvram          8.48 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   10/28                                                   vmware-2.log        448.98 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   11/28                                          Servidor Gestion.vmsd        604.00 B     | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   12/28                                      Servidor Gestion.vmsd.tmp         43.00 B     | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   13/28                                       Servidor Gestion.vmx.tmp          4.51 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   14/28                          Servidor Gestion_1-flat.vmdk (CBT 24)        300.00 GB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   15/28	                       Servidor Gestion-000001-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   16/28                                        Servidor Gestion_1.vmdk        631.00 B     | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   17/28	 vmx-Servidor Gestion-5368c30ba8d518bfa06f39a42af612e5d                    [open excluded]
-------------------------------------------------------------------------------------------------------------
   18/28	                               Servidor Gestion.vmx.lck                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   19/28                                          Servidor Gestion.vmx~          4.51 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   20/28                                                     vmware.log        222.79 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   21/28	                         Servidor Gestion-cade58d0.vswp                    [open excluded]
-------------------------------------------------------------------------------------------------------------
   22/28	                     Servidor Gestion_1-000001-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   23/28                                Servidor Gestion-Snapshot9.vmsn         32.97 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   24/28	                  Servidor Gestion-000001-sesparse.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   25/28	                           Servidor Gestion-000001.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   26/28	                Servidor Gestion_1-000001-sesparse.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   27/28	                         Servidor Gestion_1-000001.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   28/28                            Servidor Gestion-vss_manifests9.zip         35.16 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
Total size:                                                                    436.66 GB    | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
SHA-1 hashes updated for .vmdk descriptor files
-------------------------------------------------------------------------------------------------------------
Replica registered for VM Servidor Gestion as Servidor Gestion_XSIREP with Id 28
-------------------------------------------------------------------------------------------------------------
Temp snapshot created at replica VM Servidor Gestion_XSIREP
-------------------------------------------------------------------------------------------------------------
Backup end date: 2021-06-23T21:02:29
-------------------------------------------------------------------------------------------------------------
Time taken: 00:02:02 (122 sec.)
-------------------------------------------------------------------------------------------------------------
Total time:      122 sec.
-------------------------------------------------------------------------------------------------------------
Full file speed:	                                                                  3665.11 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed:	                                                                    77.05 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed without errors
-------------------------------------------------------------------------------------------------------------
Final checksum: 1714950417 bytes were sent and confirmed to have been written remotely
-------------------------------------------------------------------------------------------------------------
Data processing completed successfully
-------------------------------------------------------------------------------------------------------------
Returned(0): could not find SMTP -1, falling back to SMTP 1
-------------------------------------------------------------------------------------------------------------
Sending e-mail to ivan@redacted.com through SMTP#1...
-------------------------------------------------------------------------------------------------------------
E-mail was sent               OK
-------------------------------------------------------------------------------------------------------------
Removed host <tmp> dir        OK
-------------------------------------------------------------------------------------------------------------
Removed prog <tmp> dir        OK
-------------------------------------------------------------------------------------------------------------
Unlocked backup               OK

But, unfortunatelly, trying to make another replica merely 4 days later...

-------------------------------------------------------------------------------------------------------------
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
|||   (c)XSIBackup-DC 1.5.0.7: Backup & Replication Software                    |||
|||   (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved    |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
                   (c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 7 Major 0 Minor 1 Patch 0
-------------------------------------------------------------------------------------------------------------
License: 0005065700000000000000002cea7f551fa5 | (c)XSIBackup-DC
-------------------------------------------------------------------------------------------------------------
Remote system: ESXi
-------------------------------------------------------------------------------------------------------------
PID: 870366, Running job as: root
-------------------------------------------------------------------------------------------------------------
Remote xsibackup binary found at: /scratch/XSI/XSIBackup-DC/xsibackup
-------------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC replicating data to /vmfs/volumes/datastore2
-------------------------------------------------------------------------------------------------------------
Performing --replica action
-------------------------------------------------------------------------------------------------------------
Item number 1 in this job
-------------------------------------------------------------------------------------------------------------
Servidor Gestion Hardware Version is: 8
-------------------------------------------------------------------------------------------------------------
All snapshots were removed, as Servidor Gestion is engaged in a CBT job
-------------------------------------------------------------------------------------------------------------
Virtual Machine Name: Servidor Gestion
-------------------------------------------------------------------------------------------------------------
(c)ESXi 7.0 or higher detected, all snapshots were removed for VM Servidor Gestion(22)
-------------------------------------------------------------------------------------------------------------
Creating snapshot VM : Servidor Gestion (powered on)
-------------------------------------------------------------------------------------------------------------
*** Snapshot was successfully created ***
-------------------------------------------------------------------------------------------------------------
|   /!\ Some changes were detected in the remote replicated VM a full sync will be performed now.           |
|   Add --options=R to allow the remote replica to be switched on without triggering a full resync.         |
|   You may continue to run the CBT job later on, it will restart the CBT chain where it was left.          |
|   If you don't know why you are receiving this message you should run --reset-cbt=THIS-VM.                |
-------------------------------------------------------------------------------------------------------------
Virtual Machine: Servidor Gestion
-------------------------------------------------------------------------------------------------------------
Backup start date: 2021-06-27T17:59:10
-------------------------------------------------------------------------------------------------------------
2021-06-27 17:59:10 | Backing up 28 files, total size is 442.50 GB
-------------------------------------------------------------------------------------------------------------
    NUMBER	                                                   FILE             SIZE          PROGRESS
-------------------------------------------------------------------------------------------------------------
    1/28                        Servidor Gestion-flat.vmdk (CBT 1 full)        136.66 GB    | Done   0.00%
-------------------------------------------------------------------------------------------------------------
    2/28                                          Servidor Gestion.vmxf          3.79 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    3/28                                          Servidor Gestion.vmdk        727.00 B     | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    4/28                                           Servidor Gestion.vmx          4.52 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    5/28                                       Servidor Gestion-aux.xml        135.00 B     | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    6/28	                              Servidor Gestion-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
    7/28                                                   vmware-1.log        276.67 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
    8/28	                            Servidor Gestion_1-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
    9/28                                         Servidor Gestion.nvram          8.48 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   10/28                                                   vmware-2.log        448.98 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   11/28                                          Servidor Gestion.vmsd        609.00 B     | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   12/28                                      Servidor Gestion.vmsd.tmp         44.00 B     | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   13/28                                       Servidor Gestion.vmx.tmp          4.51 KB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   14/28                      Servidor Gestion_1-flat.vmdk (CBT 1 full)        300.00 GB    | Done  30.88%
-------------------------------------------------------------------------------------------------------------
   15/28	                       Servidor Gestion-000001-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   16/28                                        Servidor Gestion_1.vmdk        631.00 B     | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   17/28	 vmx-Servidor Gestion-5368c30ba8d518bfa06f39a42af612e5d                    [open excluded]
-------------------------------------------------------------------------------------------------------------
   18/28	                               Servidor Gestion.vmx.lck                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   19/28                                          Servidor Gestion.vmx~          4.51 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   20/28                                                     vmware.log        338.13 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   21/28	                         Servidor Gestion-cade58d0.vswp                    [open excluded]
-------------------------------------------------------------------------------------------------------------
   22/28	                     Servidor Gestion_1-000001-ctk.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   23/28                               Servidor Gestion-Snapshot11.vmsn         32.97 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
   24/28	                  Servidor Gestion-000001-sesparse.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   25/28	                           Servidor Gestion-000001.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   26/28	                Servidor Gestion_1-000001-sesparse.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   27/28	                         Servidor Gestion_1-000001.vmdk                 [skipped excluded]
-------------------------------------------------------------------------------------------------------------
   28/28                           Servidor Gestion-vss_manifests11.zip         35.14 KB    | Done  98.68%
-------------------------------------------------------------------------------------------------------------
Total size:                                                                    436.66 GB    | Done 100.00%
-------------------------------------------------------------------------------------------------------------
*** Snapshot was removed ***
-------------------------------------------------------------------------------------------------------------
SHA-1 hashes updated for .vmdk descriptor files
-------------------------------------------------------------------------------------------------------------
Replica registered for VM Servidor Gestion as Servidor Gestion_XSIREP with Id 30
-------------------------------------------------------------------------------------------------------------
Temp snapshot created at replica VM Servidor Gestion_XSIREP
-------------------------------------------------------------------------------------------------------------
Backup end date: 2021-06-27T20:33:28
-------------------------------------------------------------------------------------------------------------
Time taken: 02:34:18 (9258 sec.)
-------------------------------------------------------------------------------------------------------------
Total time:     9258 sec.
-------------------------------------------------------------------------------------------------------------
Full file speed:	                                                                    48.30 mb/s
-------------------------------------------------------------------------------------------------------------
Real data speed:	                                                                    61.86 mb/s
-------------------------------------------------------------------------------------------------------------
Item backup completed without errors
-------------------------------------------------------------------------------------------------------------
Final checksum: 466330705506 bytes were sent and confirmed to have been written remotely
-------------------------------------------------------------------------------------------------------------
Data processing completed successfully
-------------------------------------------------------------------------------------------------------------
Returned(0): could not find SMTP -1, falling back to SMTP 1
-------------------------------------------------------------------------------------------------------------
Sending e-mail to ivan@redacted.com through SMTP#1...
-------------------------------------------------------------------------------------------------------------
E-mail was sent               OK
-------------------------------------------------------------------------------------------------------------
Removed host <tmp> dir        OK
-------------------------------------------------------------------------------------------------------------
Removed prog <tmp> dir        OK
-------------------------------------------------------------------------------------------------------------
Unlocked backup               OK

I'm back to square one. I'm pretty sure nothing touches the replica destination between jobs, as I have another 2 VMs being replicated over the same destination datastore without problems. What can be the "changes" made to the replica VM?

Thanks,

-Iván.

Last edited by ivan (2021-06-29 16:23:06)

Offline

#11 2021-06-29 17:00:12

admin
Administrator
Registered: 2017-04-21
Posts: 2,055

Re: Unable to create cbt replica (solved)

At the end of every CBT round the remote hash maps of the descriptor files (.vmdk) are resync'ed, as they need to be modified to remove the CBT attributes from the replicated VM. This is noted as per the line in the CBT +1 round as.

SHA-1 hashes updated for .vmdk descriptor files

What (c)XSIBackup-DC detects is that some of the descriptor files, one or more, are different than the ones stored in the previous CBT cycle. What we would do is to check whether the .vmdk file/s SHA-1 checksum is the same as the one stored in the .map folder as your-disk.vmdk.blocklog.

Could it be that you forgot to clean the remote .map folder of some previous file/s?
Did you restart the CBT cycle from scratch?
Did you reset CBT for the new VM?

Offline

Board footer