©XSIBackup-Free: Free Backup Software for ©VMWare ©ESXi

Forum ©XSIBackup: ©VMWare ©ESXi Backup Software


You are not logged in.

#1 2020-04-23 10:58:28

vladox
Member
Registered: 2020-04-23
Posts: 7

error DIFQMSH4: first 500M mistmatch

Hi all of you,

I need your help, because I'm running ONEDIFF for VM Win2019 every night, but before 2 weeks ago I had to increase data disk to 1,8TB.
After this I performed first backup  - it always complete successfully, but every other backup with OneDIFF write me error "error DIFQMSH4: first 500M mistmatch...".
I tried to remove everything from the backup storage, setup first backup, but anyway - always the same.
Strength is, that before when I increase disk was everything OK.
Please look on my configuration of job and log file and tell me what I have to do or where I'm wrong.
Version of XSIBACKUP PRO is 11.2.11


Thank you very much for your help

Vladox


"/vmfs/volumes/system/xsibackup/xsibackup" \
--backup-prog=onediff \
--certify-backup=no \
--backup-point="/vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/" \
--backup-type=Custom \
--backup-vms="Akcent-Woodwing" \
--backup-how=Hot \
--use-smtp=1 \
--mail-to=dosedel@vcomnet.cz \
--subject="ESXI-Akcent-Woodwing on TTC - finished" \
--backup-id=000 \
--description="XSI Backup diff Akcent Woodwing on TTC" \
--img-list="none|none|none|none|none|none" \
--snapshot=doquiesce \
--exec=yes >> "/vmfs/volumes/system/xsibackup/var/logs/xsibackup.log"







Getting list of all VMs...
--------------------------------------------------------------------------------------------------------------------------
1      Akcent-Woodwing          [data] Akcent-Woodwing/Akcent-Woodwing.vmx                         windows8Server64Guest   vmx-08
--------------------------------------------------------------------------------------------------------------------------
VMs to backup:
--------------------------------------------------------------------------------------------------------------------------
1      Akcent-Woodwing          [data] Akcent-Woodwing/Akcent-Woodwing.vmx                         windows8Server64Guest   vmx-08
--------------------------------------------------------------------------------------------------------------------------
Calculating sizes...
--------------------------------------------------------------------------------------------------------------------------
Needed room: 1153 Gb.
Sparse size: 2355 Gb.
Available room: 3327 Gb.
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] Starting backup (size is 1181164M on 2411963M file)
--------------------------------------------------------------------------------------------------------------------------
XSIBackup will backup your VMs while they are running, so that users can continue to use the VM
while the backup is taking place. You can also run --backup-how=cold|warm
--------------------------------------------------------------------------------------------------------------------------
Hot backup selected for VM: [Akcent-Woodwing], will not be switched off
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: boot partition is MBR
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: Win64 OS (windows8Server64) detected on MBR, applying Windows algorithm
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: quick size check...
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: file [Akcent-Woodwing-flat.vmdk]...
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: file size check | OK [ 64424509440 bytes | 64424509440 bytes ]
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: quick size check...
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: file [Akcent-Woodwing-data-flat.vmdk]...
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: file size check | OK [ 1918647789568 bytes | 1918647789568 bytes ]
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: remote VMX file size 3744
--------------------------------------------------------------------------------------------------------------------------
System disk CIDs b8abb0ef|b8abb0ef
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] (c) OneDiff algorithm
--------------------------------------------------------------------------------------------------------------------------
Mirror VM exists and the system disks CID are the same, starting OneDiff...
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: length of .vmx file before OneDiff phase is 3964
--------------------------------------------------------------------------------------------------------------------------
Snapshot & Quiescing
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: VMWare Tools detected, taking snapshot QUIESCED(true)...
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: round 3
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: snapshot taken, quiescing status:
--------------------------------------------------------------------------------------------------------------------------
INFO: found [Akcent-Woodwing_XSIBAK] with Id: 15
--------------------------------------------------------------------------------------------------------------------------
Initiating OneDiff differential backup...
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: delta remains cleaned up at mirror VM [Akcent-Woodwing_XSIBAK]
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: transfering snapshot file [Akcent-Woodwing-000004.vmdk]
(c) XSIDiff 1.1.1.4 licensed:
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/Akcent-Woodwing/Akcent-Woodwing-000004.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/Akcent-Woodwing/Akcent-Woodwing-000004.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 1.00 mb/s
Overall speed 0.00 mb/s
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: transfering snapshot file [Akcent-Woodwing-000003.vmdk]
(c) XSIDiff 1.1.1.4 licensed:
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/Akcent-Woodwing/Akcent-Woodwing-000003.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/Akcent-Woodwing/Akcent-Woodwing-000003.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 1.00 mb/s
Overall speed 0.00 mb/s
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: transfering snapshot file [Akcent-Woodwing-000004-delta.vmdk]
(c) XSIDiff 1.1.1.4 licensed:
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/Akcent-Woodwing/Akcent-Woodwing-000004-delta.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/Akcent-Woodwing/Akcent-Woodwing-000004-delta.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 3 seconds
Speed 48.33 mb/s
Overall speed 48.04 mb/s
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: transfering snapshot file [Akcent-Woodwing-000003-delta.vmdk]
(c) XSIDiff 1.1.1.4 licensed:
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/Akcent-Woodwing/Akcent-Woodwing-000003-delta.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/Akcent-Woodwing/Akcent-Woodwing-000003-delta.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 2 seconds
Speed 48.50 mb/s
Overall speed 48.06 mb/s
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: transfering snapshot file [Akcent-Woodwing-data-000004.vmdk]
(c) XSIDiff 1.1.1.4 licensed:
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/5e8f7b7b-08763938-88df-00d8617ba898/Akcent-Woodwing/Akcent-Woodwing-data-000004.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/Akcent-Woodwing/Akcent-Woodwing-data-000004.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 1.00 mb/s
Overall speed 0.00 mb/s
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: transfering snapshot file [Akcent-Woodwing-data-000004-delta.vmdk]
(c) XSIDiff 1.1.1.4 licensed:
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/5e8f7b7b-08763938-88df-00d8617ba898/Akcent-Woodwing/Akcent-Woodwing-data-000004-delta.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/Akcent-Woodwing/Akcent-Woodwing-data-000004-delta.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 20.00 mb/s
Overall speed 19.49 mb/s
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: length of remote .vmx file after copying it is 3736
[Akcent-Woodwing] info: length of remote .vmx after replacing name is 3743
[Akcent-Woodwing] info: name changed to [Akcent-Woodwing_XSIBAK]
--------------------------------------------------------------------------------------------------------------------------
Removing hot snapshot & merging data
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: OneDiff backup differential data (155) merged with base data
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: diff mirror VM reloaded
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: deleting snapshot at [Akcent-Woodwing_XSIBAK] Id 15...
[Akcent-Woodwing] info: all snapshots removed
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: Updating CID at [/vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/Akcent-Woodwing/Akcent-Woodwing.vmdk]
[Akcent-Woodwing] info: finished OneDiff backup, CID updated
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: performing quick check...
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: file [Akcent-Woodwing-flat.vmdk]...
[Akcent-Woodwing] info: file size check | OK [ 64424509440B | 64424509440B ]
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: comparing first 500M of [Akcent-Woodwing-flat.vmdk]...
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: (source) first 500M hash is: 64ce99f7c68d769923fdae0d8d9e188e4eb1fea5
[Akcent-Woodwing] info: (target) first 500M hash is: faa055ca867fdcc6de97e79a6011f3ecb77177ed
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] error DIFQMSH4: first 500M mistmatch...
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: performing quick check...
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: file [Akcent-Woodwing-data-flat.vmdk]...
[Akcent-Woodwing] info: file size check | OK [ 1918647789568B | 1918647789568B ]
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: comparing first 500M of [Akcent-Woodwing-data-flat.vmdk]...
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] info: (source) first 500M hash is: 09843150d11344f24d92881c2161c1107a3f59fb
[Akcent-Woodwing] info: (target) first 500M hash is: 13490aa033ccf71e4660436cf69f140f3cb678d8
--------------------------------------------------------------------------------------------------------------------------
[Akcent-Woodwing] error DIFQMSH4: first 500M mistmatch...
--------------------------------------------------------------------------------------------------------------------------
The ESXi configuration was saved to "/vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi"
--------------------------------------------------------------------------------------------------------------------------
Errors detected in backup, check logs
--------------------------------------------------------------------------------------------------------------------------
Using stored SMTP server info...

Offline

#2 2020-04-27 18:35:00

admin
Administrator
Registered: 2017-04-21
Posts: 2,072

Re: error DIFQMSH4: first 500M mistmatch

Your problem has nothing to do with XSIBackup, but with the virtual disk. First thing we would do is switching the server off and rebooting it after some seconds off. In case this doesn't help, clone the disk with vmkfstools, be careful not to clone it to thick in case it's thin.

Run

vmkfstools -i /path/to/your/in-disk.vmdk /path/to/your/out-disk.vmdk -d thin

Then use the output disk instead of the original one and see if this helps the problem.

Offline

#3 2020-04-29 09:16:41

vladox
Member
Registered: 2020-04-23
Posts: 7

Re: error DIFQMSH4: first 500M mistmatch

Thanks for your feedback,

unfortunately, it is still same.
I did both virtual disks like you wrote me, also I created new virtual machine and place the new created disks into it.
First backup (round 1) was OK, like always.
Second backup with OneDiff was with mistmatch as we did before.
Do you have any suggestion?

[root@akcent-esxi-ttc:/vmfs/volumes/5dd9a2f4-6f076bd0-637a-00d8617ba898/xsibackup] ./xsibackup --run-backup=000
###############################################################################
#
# (c) XSIBACKUP-PRO 11.2.19 | Backup for (c) VMWARE ESXi Hypervisor by 33hops.com
#
###################################################################################

NOTICE: (c) XSIBackup kills any user launched jobs, make sure you don't overlap manual jobs
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
XSIBackup PID:          2102251                                      akcent-esxi-ttc.akcent.com
Tue, 28 Apr 2020 22:36:14 +0000                                IPv4: 192.168.7.10/255.255.255.0
VMware ESXi 6.7.0 build-14320388                              (c) Rsync 3.1.0 as opt. dependency

Backup Id:                  000                       Intel(R) Core(TM) i7-9700KF CPU @ 3.60GHz

Backup description: XSI Backup diff Akcent Woodwing on TTC

Alert: crontab is not installed for user root

Backup user is: root

Backup program is: onediff

--backup-point found at /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi (filesystem: NFS)

Custom image settings:

Getting list of all VMs...

2      cmng.akcent.com   [data] cmng.akcent.com/cmng.akcent.com.vmx   windows9Server64Guest   vmx-10

VMs to backup:

2      cmng.akcent.com   [data] cmng.akcent.com/cmng.akcent.com.vmx   windows9Server64Guest   vmx-10

Calculating sizes...

Needed room: 726 Gb.
Sparse size: 1903 Gb.
Available room: 2594 Gb.

[cmng.akcent.com] Starting backup (size is 743912M on 1948876M file)

XSIBackup will backup your VMs while they are running, so that users can continue to use the VM
while the backup is taking place. You can also run --backup-how=cold|warm

Hot backup selected for VM: [cmng.akcent.com], will not be switched off

[cmng.akcent.com] info: boot partition is MBR

[cmng.akcent.com] info: Win64 OS (windows9Server64) detected on MBR, applying Windows algorithm

[cmng.akcent.com] notice DIFRMMIS: no [Woodwing-system-flat.vmdk] in remote OneDiff mirror, first run?.

[cmng.akcent.com] notice DIFRMMIS: no [Woodwing-data-flat.vmdk] in remote OneDiff mirror, first run?.

[cmng.akcent.com] (c) OneDiff algorithm

[cmng.akcent.com] info: OneDiff backup first run, removing snapshots
[cmng.akcent.com] info: all snapshots removed

Snapshot & Quiescing

[cmng.akcent.com] info: VMWare Tools detected, taking snapshot QUIESCED(true)...

[cmng.akcent.com] info: round 1

[cmng.akcent.com] info: snapshot taken, quiescing status:

Removing snapshots, please wait...

Syncronizing config files

Backing up virtual disks...

scsi0:0.fileName = "Woodwing-system.vmdk"
scsi0:1.fileName = "/vmfs/volumes/5e8f7b7b-08763938-88df-00d8617ba898/Woodwing-data/Woodwing-data.vmdk"

Destination disk format: VMFS thin-provisioned
Cloning disk '/vmfs/volumes/data/cmng.akcent.com/Woodwing-system.vmdk'...
Clone: 100% done.

[cmng.akcent.com] Disk copied to /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-system.vmdk

Destination disk format: VMFS thin-provisioned
Cloning disk '/vmfs/volumes/5e8f7b7b-08763938-88df-00d8617ba898/Woodwing-data/Woodwing-data.vmdk'...
Clone: 100% done.

[cmng.akcent.com] Disk copied to /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-data.vmdk

[cmng.akcent.com] info: Updating CID at [/vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-system.vmdk]
[cmng.akcent.com] info: finished OneDiff backup, CID updated
[cmng.akcent.com] info: backup complete
[cmng.akcent.com] info: finished doing a first copy in a diff scope, subsequent backups will be differential
[cmng.akcent.com] info: should you need to use the mirror VM, register it manually at the backup ESXi host

The ESXi configuration was saved to "/vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi"

Adding debug information to the report
No errors detected in backup



Tue Apr 28 22:36:15 UTC 2020
XSIBACKUP-PRO 11.2.19 AT HOST:
akcent-esxi-ttc.akcent.com
IP v4: 192.168.7.10/ 255.255.255.0
VMware ESXi 6.7.0 build-14320388


Done hot backup (id: 000) using onediff (no compression)
Available room in device /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi before backup: 2594 Gb.
Sparse size on disk of the selected virtual machines: 1903 Gb.
Needed room in device /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi for backup: 726 Gb.
(Id)VM Name    State    Size (Gb)    Stop    Copy    Start    Time (min:sec)    Speed (mb/s)
(2) cmng.akcent.com    ON    726.48/ 1903.20    NO (hot backup)    OK    -    256:03    48/ 126
Available space in device /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi after backup: 1894 Gb.
Complete backup elapsed time: 256 min
The ESXi configuration was saved to /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi
DEBUG INFORMATION:

• backupprog: onediff
• certifybackup: no
• debuginfo: yes
• backuppoint: /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/
• backuptype: custom
• backupvms: cmng.akcent.com
• backuphow: hot
• usesmtp: 1
• mailto: dosedel@vcomnet.cz
• subject: ESXI-Akcent-Woodwing on TTC - finished
• backupid: 000
• description: XSI Backup diff Akcent Woodwing on TTC
• imglist: none|none|none|none|none|none
• snapshot: doquiesce
• KEY: -q -o PreferredAuthentications=publickey -o StrictHostKeyChecking=no -i "/vmfs/volumes/system/xsibackup/xsibackup_id_rsa"
• PID: 2102251
• ESXi VERSION: 6.7.0
• DATE DIR:
• XSIDIR: /vmfs/volumes/system/xsibacku p
• LAUNCHED BY: user
VMXFILEPATH: /vmfs/volumes/data/cmng.akcent.com/cmng.akcent.com.vmx
• VM cmng.akcent.com remote vmx file does not exist. Nothing to worry if this is the 1st OneDiff: /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/cmng.akcent.com.vmx
• VM cmng.akcent.com CID: 1
• VM cmng.akcent.com SNAPSHOT:
• VM cmng.akcent.com SNAPSHOT NUM:



Second backup:

[root@akcent-esxi-ttc:/vmfs/volumes/5dd9a2f4-6f076bd0-637a-00d8617ba898/xsibackup] ./xsibackup --run-backup=000
###############################################################################
#
# (c) XSIBACKUP-PRO 11.2.19 | Backup for (c) VMWARE ESXi Hypervisor by 33hops.com
#
###################################################################################

NOTICE: (c) XSIBackup kills any user launched jobs, make sure you don't overlap manual jobs

XSIBackup PID:          2108012                                      akcent-esxi-ttc.akcent.com
Wed, 29 Apr 2020 08:51:47 +0000                                IPv4: 192.168.7.10/255.255.255.0
VMware ESXi 6.7.0 build-14320388                              (c) Rsync 3.1.0 as opt. dependency

Backup Id:                  000                       Intel(R) Core(TM) i7-9700KF CPU @ 3.60GHz

Backup description: XSI Backup diff Akcent Woodwing on TTC

Alert: crontab is not installed for user root

Backup user is: root

Backup program is: onediff

--backup-point found at /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi (filesystem: NFS)

Custom image settings:
...
...
...

Getting list of all VMs...

2      cmng.akcent.com   [data] cmng.akcent.com/cmng.akcent.com.vmx   windows9Server64Guest   vmx-10

VMs to backup:

2      cmng.akcent.com   [data] cmng.akcent.com/cmng.akcent.com.vmx   windows9Server64Guest   vmx-10

Calculating sizes...

Needed room: 728 Gb.
Sparse size: 1904 Gb.
Available room: 1894 Gb.

[cmng.akcent.com] Starting backup (size is 745507M on 1950466M file)

XSIBackup will backup your VMs while they are running, so that users can continue to use the VM
while the backup is taking place. You can also run --backup-how=cold|warm

Hot backup selected for VM: [cmng.akcent.com], will not be switched off

[cmng.akcent.com] info: boot partition is MBR

[cmng.akcent.com] info: Win64 OS (windows9Server64) detected on MBR, applying Windows algorithm

[cmng.akcent.com] info: quick size check...

[cmng.akcent.com] info: file [Woodwing-system-flat.vmdk]...

[cmng.akcent.com] info: file size check | OK [ 64424509440 bytes | 64424509440 bytes ]

[cmng.akcent.com] info: quick size check...

[cmng.akcent.com] info: file [Woodwing-data-flat.vmdk]...

[cmng.akcent.com] info: file size check | OK [ 1979120929792 bytes | 1979120929792 bytes ]

[cmng.akcent.com] info: remote VMX file size 3353

System disk CIDs d3fd1df4|d3fd1df4

[cmng.akcent.com] (c) OneDiff algorithm

Mirror VM exists and the system disks CID are the same, starting OneDiff...

[cmng.akcent.com] info: length of .vmx file before OneDiff phase is 3546

Snapshot & Quiescing

[cmng.akcent.com] info: VMWare Tools detected, taking snapshot QUIESCED(true)...

[cmng.akcent.com] info: round 2

[cmng.akcent.com] info: snapshot taken, quiescing status:

Initiating OneDiff differential backup...

[cmng.akcent.com] info: delta remains cleaned up at mirror VM [cmng.akcent.com_XSIBAK]

[cmng.akcent.com] info: transfering snapshot file [Woodwing-system-000002.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/cmng.akcent.com/Woodwing-system-000002.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-system-000002.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 1.00 mb/s
Overall speed 0.00 mb/s

[cmng.akcent.com] info: transfering snapshot file [Woodwing-system-000001.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/cmng.akcent.com/Woodwing-system-000001.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-system-000001.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 1.00 mb/s
Overall speed 0.00 mb/s

[cmng.akcent.com] info: transfering snapshot file [Woodwing-system-000002-delta.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/cmng.akcent.com/Woodwing-system-000002-delta.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-system-000002-delta.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 17.00 mb/s
Overall speed 16.12 mb/s

[cmng.akcent.com] info: transfering snapshot file [Woodwing-system-000001-delta.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/cmng.akcent.com/Woodwing-system-000001-delta.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-system-000001-delta.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 4 seconds
Speed 32.25 mb/s
Overall speed 32.03 mb/s

[cmng.akcent.com] info: transfering snapshot file [Woodwing-data-000002.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/5e8f7b7b-08763938-88df-00d8617ba898/Woodwing-data/Woodwing-data-000002.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-data-000002.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 1.00 mb/s
Overall speed 0.00 mb/s

[cmng.akcent.com] info: transfering snapshot file [Woodwing-data-000002-delta.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/5e8f7b7b-08763938-88df-00d8617ba898/Woodwing-data/Woodwing-data-000002-delta.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-data-000002-delta.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 20.00 mb/s
Overall speed 19.61 mb/s

Synchronizing configuration files

[cmng.akcent.com] info: length of .vmx file before converting paths to absolute is 3546
[cmng.akcent.com] info: length of .vmx file after converting paths to absolute is 3359
[cmng.akcent.com] info: length of remote .vmx file after copying it is 3359
[cmng.akcent.com] info: length of remote .vmx after replacing name is 3366
[cmng.akcent.com] info: name changed to [cmng.akcent.com_XSIBAK]

Removing hot snapshot & merging data

[cmng.akcent.com] info: OneDiff backup differential data (1) merged with base data

[cmng.akcent.com] info: the backup mirror VM [cmng.akcent.com_XSIBAK] Id 3 has been created

[cmng.akcent.com] info: diff mirror VM reloaded

[cmng.akcent.com] info: deleting snapshot at [cmng.akcent.com_XSIBAK] Id 3...
[cmng.akcent.com] info: all snapshots removed

[cmng.akcent.com] info: Updating CID at [/vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-system.vmdk]
[cmng.akcent.com] info: finished OneDiff backup, CID updated

[cmng.akcent.com] info: performing quick check...

[cmng.akcent.com] info: file [Woodwing-system-flat.vmdk]...
[cmng.akcent.com] info: file size check | OK [ 64424509440B | 64424509440B ]

[cmng.akcent.com] info: comparing first 500M of [Woodwing-system-flat.vmdk]...

[cmng.akcent.com] info: (source) first 500M hash is: a6ad0f03bbdf3cc21b85445dd75a293be9b5d956
[cmng.akcent.com] info: (target) first 500M hash is: f0d8ebbe106fd534a89562edc28f106d3fee7ea0

[cmng.akcent.com] error DIFQMSH4: first 500M mistmatch...

[cmng.akcent.com] info: performing quick check...

[cmng.akcent.com] info: file [Woodwing-data-flat.vmdk]...
[cmng.akcent.com] info: file size check | OK [ 1979120929792B | 1979120929792B ]

[cmng.akcent.com] info: comparing first 500M of [Woodwing-data-flat.vmdk]...

[cmng.akcent.com] info: (source) first 500M hash is: ab016b6efb3e8c6f7a1981f05136c8e6cc6d886d
[cmng.akcent.com] info: (target) first 500M hash is: 1a006d9e750012b900a780b2e675749a63234a35

[cmng.akcent.com] error DIFQMSH4: first 500M mistmatch...

The ESXi configuration was saved to "/vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi"

Adding debug information to the report
Errors detected in backup, check logs


Wed Apr 29 08:51:48 UTC 2020
XSIBACKUP-PRO 11.2.19 AT HOST:
akcent-esxi-ttc.akcent.com
IP v4: 192.168.7.10/ 255.255.255.0
VMware ESXi 6.7.0 build-14320388


Done hot backup (id: 000) using onediff (no compression)
Available room in device /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi before backup: 1894 Gb.
Sparse size on disk of the selected virtual machines: 1904 Gb.
Needed room in device /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi for backup: 728 Gb.
(Id)VM Name    State    Size (Gb)    Stop    Copy    Start    Time (min:sec)    Speed (mb/s)
(2) cmng.akcent.com    ON    728.35/ 1904.77    NO (hot backup)    KO!    -    01:32    8103/ 21200
Last error raised for the above VM:
ERROR DIFQMSH4, details: [cmng.akcent.com] error: first 500M mistmatch [Woodwing-data-flat.vmdk]
Available space in device /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi after backup: 1894 Gb.
Complete backup elapsed time: 1 min
The ESXi configuration was saved to /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi
DEBUG INFORMATION:

• backupprog: onediff
• certifybackup: no
• debuginfo: yes
• backuppoint: /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/
• backuptype: custom
• backupvms: cmng.akcent.com
• backuphow: hot
• usesmtp: 1
• mailto: dosedel@vcomnet.cz
• subject: ESXI-Akcent-Woodwing on TTC - finished
• backupid: 000
• description: XSI Backup diff Akcent Woodwing on TTC
• imglist: none|none|none|none|none|none
• snapshot: doquiesce
• KEY: -q -o PreferredAuthentications=publickey -o StrictHostKeyChecking=no -i "/vmfs/volumes/system/xsibackup/xsibackup_id_rsa"
• PID: 2108012
• ESXi VERSION: 6.7.0
• DATE DIR:
• XSIDIR: /vmfs/volumes/system/xsibacku p
• LAUNCHED BY: user
VMXFILEPATH: /vmfs/volumes/data/cmng.akcent.com/cmng.akcent.com.vmx
• VM cmng.akcent.com remote VMX path exists at: /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/cmng.akcent.com.vmx
• VM cmng.akcent.com SYS DISK1 EXISTS: /vmfs/volumes/data/cmng.akcent.com/Woodwing-system.vmdk
• VM cmng.akcent.com SYS DISK2 EXISTS: /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-system.vmdk
• VM cmng.akcent.com CID1: d3fd1df4
• VM cmng.akcent.com CID2: d3fd1df4
• VM cmng.akcent.com CID: 0
• VM cmng.akcent.com SNAPSHOT: xsibackupdiff
• VM cmng.akcent.com SNAPSHOT NUM: 1
• [ Wed Apr 29 08:52:56 UTC 2020 ] ERROR (DIFQMSH4), details [cmng.akcent.com] error: first 500M mistmatch [Woodwing-system-flat.vmdk]

• [ Wed Apr 29 08:53:13 UTC 2020 ] ERROR (DIFQMSH4), details [cmng.akcent.com] error: first 500M mistmatch [Woodwing-data-flat.vmdk]


Here is the configuration of the backup job:

"/vmfs/volumes/system/xsibackup/xsibackup" \
--backup-prog=OneDiff \
--certify-backup=no \
--debug-info=yes \
--backup-point="/vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/ \
--backup-type=Custom \
--backup-vms="cmng.akcent.com" \
--backup-how=Hot \
--use-smtp=1 \
--mail-to=dosedel@vcomnet.cz \
--subject="ESXI-Akcent-Woodwing on TTC - finished" \
--backup-id=000 \
--description="XSI Backup diff Akcent Woodwing on TTC" \
--img-list="none|none|none|none|none|none" \
--snapshot=doquiesce \
--exec=yes >> "/vmfs/volumes/system/xsibackup/var/logs/xsibackup.log"




Thank you very much for your help!

Offline

#4 2020-04-29 15:47:17

admin
Administrator
Registered: 2017-04-21
Posts: 2,072

Re: error DIFQMSH4: first 500M mistmatch

You are getting this mismatch on both disks, thus it seems that for some reason read data on the destination is not the same as on the source DS.

This could be due to read errors on the backup disk, try to backup to some alternative destination.

What kind of NFS server are you using?

Offline

#5 2020-04-29 21:01:32

vladox
Member
Registered: 2020-04-23
Posts: 7

Re: error DIFQMSH4: first 500M mistmatch

It is strange, because I'm using same destination disk also for different ESXI machine with same version and there XSI ONEDIFF backup works normally without any mismatch.
The destination is Synology model 1813+ with DSM 6.2.2-24922 Update 4. NFS I'm using version 2 or 3 with read and write size 32kB. Standard settings on Synology.

When I'm using this backup storage for different esxi machine, there is no big vmdk file like in this machine. So Maybe there is the problem.
When the second .vmdk file in this problematic VM was less than 500GB everything it was OK.

So I will try different connection to the different NFS server and backup to there like you wrote and let you know.

Thank you very much

Offline

#6 2020-04-30 09:12:23

vladox
Member
Registered: 2020-04-23
Posts: 7

Re: error DIFQMSH4: first 500M mistmatch

Hi, I tried to backup to the different location, but still I have error mismatch on both disks.
I don't know where is the problem.
I will try install some different VM on same esxi host and try backup.
If it will work what I have to do with production VM ?
If not, should I have to reinstall esxi host?

Also strange is, that if I check backup VM on the esxi host, after second backup is different size of second hard drive. Is it correct?
Probably because it is not possibility to merge data from snapshot?

Thanks for your help!

CPU    8 vCPUs
Memory    29.3 GB
Hard disk 1    60 GB
Hard disk 2    0 B
USB controller    USB 2.0
Network adapter 1    VM Network (Connected)
Video card    4 MB
CD/DVD drive 1    ATAPI
Others    Additional Hardware
Resource Consumption
Consumed host CPU    0 MHz
Consumed host memory    0 MB
Active guest memory    0 MB
Storage   
Provisioned    60 GB
Uncommitted    88.72 GB
Not-shared    34.36 GB
Used    34.36 GB


This is debug information about second round of the backup
Thu Apr 30 08:02:36 UTC 2020
XSIBACKUP-PRO 11.2.19 AT HOST:
akcent-esxi-ttc.akcent.com
IP v4: 192.168.7.10/ 255.255.255.0
VMware ESXi 6.7.0 build-14320388


Done hot backup (id: 000) using onediff (no compression)
Available room in device /vmfs/volumes/Backup-AK/Akcent before backup: 2262 Gb.
Sparse size on disk of the selected virtual machines: 1904 Gb.
Needed room in device /vmfs/volumes/Backup-AK/Akcent for backup: 734 Gb.
(Id)VM Name    State    Size (Gb)    Stop    Copy    Start    Time (min:sec)    Speed (mb/s)
(2) cmng.akcent.com    ON    734.11/ 1904.96    NO (hot backup)    KO!    -    01:51    6772/ 17573
Last error raised for the above VM:
ERROR DIFQMSH4, details: [cmng.akcent.com] error: first 500M mistmatch [Woodwing-data-flat.vmdk]
Available space in device /vmfs/volumes/Backup-AK/Akcent after backup: 2261 Gb.
Complete backup elapsed time: 1 min
The ESXi configuration was saved to /vmfs/volumes/Backup-AK/Akcent
DEBUG INFORMATION:

• backupprog: onediff
• certifybackup: no
• debuginfo: yes
• backuppoint: /vmfs/volumes/Backup-AK/Akcent/
• backuptype: custom
• backupvms: cmng.akcent.com
• backuphow: hot
• usesmtp: 1
• mailto: dosedel@vcomnet.cz
• subject: ESXI-Akcent-Woodwing on TTC - finished
• backupid: 000
• description: XSI Backup diff Akcent Woodwing on TTC
• imglist: none|none|none|none|none|none
• snapshot: doquiesce
• KEY: -q -o PreferredAuthentications=publickey -o StrictHostKeyChecking=no -i "/vmfs/volumes/system/xsibackup/xsibackup_id_rsa"
• PID: 2121765
• ESXi VERSION: 6.7.0
• DATE DIR:
• XSIDIR: /vmfs/volumes/system/xsibackup
&bull ; LAUNCHED BY: user
VMXFILEPATH: /vmfs/volumes/data/cmng.akcent.com/cmng.akcent.com.vmx
• VM cmng.akcent.com remote VMX path exists at: /vmfs/volumes/Backup-AK/Akcent/cmng.akcent.com/cmng.akcent.com.vmx
• VM cmng.akcent.com SYS DISK1 EXISTS: /vmfs/volumes/data/cmng.akcent.com/Woodwing-system.vmdk
• VM cmng.akcent.com SYS DISK2 EXISTS: /vmfs/volumes/Backup-AK/Akcent/cmng.akcent.com/Woodwing-system.vmdk
• VM cmng.akcent.com CID1: 3e940798
• VM cmng.akcent.com CID2: 3e940798
• VM cmng.akcent.com CID: 0
• VM cmng.akcent.com SNAPSHOT: xsibackupdiff
• VM cmng.akcent.com SNAPSHOT NUM: 1
• [ Thu Apr 30 08:04:02 UTC 2020 ] ERROR (DIFQMSH4), details [cmng.akcent.com] error: first 500M mistmatch [Woodwing-system-flat.vmdk]

• [ Thu Apr 30 08:04:19 UTC 2020 ] ERROR (DIFQMSH4), details [cmng.akcent.com] error: first 500M mistmatch [Woodwing-data-flat.vmdk]



and the log file:

[root@akcent-esxi-ttc:/vmfs/volumes/5dd9a2f4-6f076bd0-637a-00d8617ba898/xsibackup] ./xsibackup --run-backup=000
###############################################################################
#
# (c) XSIBACKUP-PRO 11.2.19 | Backup for (c) VMWARE ESXi Hypervisor by 33hops.com
#
###################################################################################

NOTICE: (c) XSIBackup kills any user launched jobs, make sure you don't overlap manual jobs

XSIBackup PID:          2121765                                      akcent-esxi-ttc.akcent.com
Thu, 30 Apr 2020 08:02:35 +0000                                IPv4: 192.168.7.10/255.255.255.0
VMware ESXi 6.7.0 build-14320388                              (c) Rsync 3.1.0 as opt. dependency

Backup Id:                  000                       Intel(R) Core(TM) i7-9700KF CPU @ 3.60GHz

Backup description: XSI Backup diff Akcent Woodwing on TTC

Alert: crontab is not installed for user root

Backup user is: root

Backup program is: onediff

--backup-point found at /vmfs/volumes/Backup-AK/Akcent (filesystem: NFS)

Custom image settings:
...
...
Finished setting custom images

Getting list of all VMs...

2      cmng.akcent.com   [data] cmng.akcent.com/cmng.akcent.com.vmx   windows9Server64Guest   vmx-10

VMs to backup:

2      cmng.akcent.com   [data] cmng.akcent.com/cmng.akcent.com.vmx   windows9Server64Guest   vmx-10

Calculating sizes...

Needed room: 734 Gb.
Sparse size: 1904 Gb.
Available room: 2262 Gb.

[cmng.akcent.com] Starting backup (size is 751727M on 1950658M file)

XSIBackup will backup your VMs while they are running, so that users can continue to use the VM
while the backup is taking place. You can also run --backup-how=cold|warm

Hot backup selected for VM: [cmng.akcent.com], will not be switched off

[cmng.akcent.com] info: boot partition is MBR

[cmng.akcent.com] info: Win64 OS (windows9Server64) detected on MBR, applying Windows algorithm

[cmng.akcent.com] info: quick size check...

[cmng.akcent.com] info: file [Woodwing-system-flat.vmdk]...

[cmng.akcent.com] info: file size check | OK [ 64424509440 bytes | 64424509440 bytes ]

[cmng.akcent.com] info: quick size check...

[cmng.akcent.com] info: file [Woodwing-data-flat.vmdk]...

[cmng.akcent.com] info: file size check | OK [ 1979120929792 bytes | 1979120929792 bytes ]

[cmng.akcent.com] info: remote VMX file size 3353

System disk CIDs 3e940798|3e940798

[cmng.akcent.com] (c) OneDiff algorithm

Mirror VM exists and the system disks CID are the same, starting OneDiff...

[cmng.akcent.com] info: length of .vmx file before OneDiff phase is 3546

Snapshot & Quiescing

[cmng.akcent.com] info: VMWare Tools detected, taking snapshot QUIESCED(true)...

[cmng.akcent.com] info: round 2

[cmng.akcent.com] info: snapshot taken, quiescing status:

Initiating OneDiff differential backup...

[cmng.akcent.com] info: delta remains cleaned up at mirror VM [cmng.akcent.com_XSIBAK]

[cmng.akcent.com] info: transfering snapshot file [Woodwing-system-000002.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/cmng.akcent.com/Woodwing-system-000002.vmdk
Writing to file /vmfs/volumes/Backup-AK/Akcent/cmng.akcent.com/Woodwing-system-000002.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 1.00 mb/s
Overall speed 0.00 mb/s

[cmng.akcent.com] info: transfering snapshot file [Woodwing-system-000001.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/cmng.akcent.com/Woodwing-system-000001.vmdk
Writing to file /vmfs/volumes/Backup-AK/Akcent/cmng.akcent.com/Woodwing-system-000001.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 1.00 mb/s
Overall speed 0.00 mb/s

[cmng.akcent.com] info: transfering snapshot file [Woodwing-system-000002-delta.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/cmng.akcent.com/Woodwing-system-000002-delta.vmdk
Writing to file /vmfs/volumes/Backup-AK/Akcent/cmng.akcent.com/Woodwing-system-000002-delta.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 17.00 mb/s
Overall speed 16.12 mb/s

[cmng.akcent.com] info: transfering snapshot file [Woodwing-system-000001-delta.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/cmng.akcent.com/Woodwing-system-000001-delta.vmdk
Writing to file /vmfs/volumes/Backup-AK/Akcent/cmng.akcent.com/Woodwing-system-000001-delta.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 20 seconds
Speed 40.05 mb/s
Overall speed 40.01 mb/s

[cmng.akcent.com] info: transfering snapshot file [Woodwing-data-000002.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/5e8f7b7b-08763938-88df-00d8617ba898/Woodwing-data/Woodwing-data-000002.vmdk
Writing to file /vmfs/volumes/Backup-AK/Akcent/cmng.akcent.com/Woodwing-data-000002.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 1.00 mb/s
Overall speed 0.00 mb/s

[cmng.akcent.com] info: transfering snapshot file [Woodwing-data-000002-delta.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/5e8f7b7b-08763938-88df-00d8617ba898/Woodwing-data/Woodwing-data-000002-delta.vmdk
Writing to file /vmfs/volumes/Backup-AK/Akcent/cmng.akcent.com/Woodwing-data-000002-delta.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 20.00 mb/s
Overall speed 19.61 mb/s

Synchronizing configuration files

[cmng.akcent.com] info: length of .vmx file before converting paths to absolute is 3546
[cmng.akcent.com] info: length of .vmx file after converting paths to absolute is 3359
[cmng.akcent.com] info: length of remote .vmx file after copying it is 3359
[cmng.akcent.com] info: length of remote .vmx after replacing name is 3366
[cmng.akcent.com] info: name changed to [cmng.akcent.com_XSIBAK]

Removing hot snapshot & merging data

[cmng.akcent.com] info: OneDiff backup differential data (3) merged with base data

[cmng.akcent.com] info: the backup mirror VM [cmng.akcent.com_XSIBAK] Id 4 has been created

[cmng.akcent.com] info: diff mirror VM reloaded

[cmng.akcent.com] info: deleting snapshot at [cmng.akcent.com_XSIBAK] Id 4...
[cmng.akcent.com] info: all snapshots removed

[cmng.akcent.com] info: Updating CID at [/vmfs/volumes/Backup-AK/Akcent/cmng.akcent.com/Woodwing-system.vmdk]
[cmng.akcent.com] info: finished OneDiff backup, CID updated

[cmng.akcent.com] info: performing quick check...

[cmng.akcent.com] info: file [Woodwing-system-flat.vmdk]...
[cmng.akcent.com] info: file size check | OK [ 64424509440B | 64424509440B ]

[cmng.akcent.com] info: comparing first 500M of [Woodwing-system-flat.vmdk]...

[cmng.akcent.com] info: (source) first 500M hash is: 151ce1eb529316efddbb177995056a946b2c8ef8
[cmng.akcent.com] info: (target) first 500M hash is: e0fa21b8730f0e8563bb6cfa14fa6228b148f456

[cmng.akcent.com] error DIFQMSH4: first 500M mistmatch...

[cmng.akcent.com] info: performing quick check...

[cmng.akcent.com] info: file [Woodwing-data-flat.vmdk]...
[cmng.akcent.com] info: file size check | OK [ 1979120929792B | 1979120929792B ]

[cmng.akcent.com] info: comparing first 500M of [Woodwing-data-flat.vmdk]...

[cmng.akcent.com] info: (source) first 500M hash is: b6349c2cc7e92ffd0bd86b5e57cb28869f19946e
[cmng.akcent.com] info: (target) first 500M hash is: a1c628b92614930937b3e908a3d4bddad567047f

[cmng.akcent.com] error DIFQMSH4: first 500M mistmatch...

The ESXi configuration was saved to "/vmfs/volumes/Backup-AK/Akcent"

Adding debug information to the report
Errors detected in backup, check logs

Offline

#7 2020-05-05 15:24:01

admin
Administrator
Registered: 2017-04-21
Posts: 2,072

Re: error DIFQMSH4: first 500M mistmatch

You may suffer from disk metadata corruption, this is quite frequent in big NTFS disks which aren't defragmented when needed..

We don’t say so because we heard or read about it somewhere, but because we have some cases like yours per year against not a single file system level data corruption so far since 2013 on ext3, ext4, or XFS file systems (Linux).

Now, what to do?

First run this command on your .vmdk disk:

vmkfstools –t0 /path/to/the/disk.vmdk

Don’t try to look for the command in vmkfstools help, it’s undocumented.
You should get a list of extents. In Linux FSs this list is rather small. On Windows FSs it can become extremely long. This is due to data fragmentation in the Windows guest, especially since many sysadmins don’t defragment there Windows guest’s file systems until they are broken.

Apart from that aligning FSs in the virtualization stack can become rather important too in terms of performance.
[url=https://www.boche.net/blog/2009/03/20/storage-block-size-and-alignment/]A must read post on virtualization storage block alignment[/url]

So, getting back to the matter.
You will probably find lines like this in your extent list.

[ 2174627086336:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2175163957248:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2175700828160:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2176237699072:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2176774569984:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2177311440896:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2177848311808:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2178385182720:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2178922053632:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2179458924544:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2179995795456:   536870912] --> [NOMP -- :(           0 -->    536870912)]
[ 2180532666368:   536870912] --> [NOMP -- :(           0 -->    536870912)]

Those are dead extents pointing nowhere in the physical disk, “dark matter”.
Clone your disk with vmkfstools (all of them), repeat the –t0 command and chek whether the dead extent information disappeared, then reattach them to the VM.

©XSIBackup can’t warn you about that cause it’s one reality level below what it can see. It just believes your disks are O.K. so long as ESXi believes it.

Offline

#8 2020-05-05 21:40:44

vladox
Member
Registered: 2020-04-23
Posts: 7

Re: error DIFQMSH4: first 500M mistmatch

Hello,
Thank you very much for your answer.
It is possible, that my VM disks are corrupted, especially after increased disk from 500GB to 1,8TB.
So why it mismatched system disk 60GB? It is still in the same size.
For sure I will do backup vmfs files and try to defragment it and run command like you wrote me.

But actually I did one think and ONEDIFF running without mismatch:
I delete from command this parameter --snapshot=doquiesce
and tried to run backuped machine if backup works and seems to be OK.

So do you think that is correct?

Thank you very much for your help.

Vlada

Offline

#9 2020-05-05 21:47:58

vladox
Member
Registered: 2020-04-23
Posts: 7

Re: error DIFQMSH4: first 500M mistmatch

[root@akcent-esxi-ttc:/vmfs/volumes/5dd9a2f4-6f076bd0-637a-00d8617ba898/xsibackup] ./xsibackup --run-backup=000
###############################################################################
#
# (c) XSIBACKUP-PRO 11.2.19 | Backup for (c) VMWARE ESXi Hypervisor by 33hops.com
#
###################################################################################

NOTICE: (c) XSIBackup kills any user launched jobs, make sure you don't overlap manual jobs
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
XSIBackup PID:          2179256                                      akcent-esxi-ttc.akcent.com
Tue, 05 May 2020 21:41:16 +0000                                IPv4: 192.168.7.10/255.255.255.0
VMware ESXi 6.7.0 build-14320388                              (c) Rsync 3.1.0 as opt. dependency
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Backup Id:                  000                       Intel(R) Core(TM) i7-9700KF CPU @ 3.60GHz
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Backup description: XSI Backup diff Akcent Woodwing on TTC
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Message: crontab is installed for user root
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Backup user is: root
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Backup program is: onediff
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--backup-point found at /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi (filesystem: NFS)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Custom image settings:
------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Finished setting custom images
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Getting list of all VMs...
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
2      cmng.akcent.com          [data] cmng.akcent.com/cmng.akcent.com.vmx                         windows9Server64Guest   vmx-10
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
VMs to backup:
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
2      cmng.akcent.com          [data] cmng.akcent.com/cmng.akcent.com.vmx                         windows9Server64Guest   vmx-10
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Calculating sizes...
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Needed room: 746 Gb.
Sparse size: 1904 Gb.
Available room: 1850 Gb.
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] Starting backup (size is 764067M on 1950447M file)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
XSIBackup will backup your VMs while they are running, so that users can continue to use the VM
while the backup is taking place. You can also run --backup-how=cold|warm
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Hot backup selected for VM: [cmng.akcent.com], will not be switched off
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: boot partition is MBR
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: Win64 OS (windows9Server64) detected on MBR, applying Windows algorithm
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: quick size check...
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: file [Woodwing-system-flat.vmdk]...
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: file size check | OK [ 64424509440 bytes | 64424509440 bytes ]
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: quick size check...
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: file [Woodwing-data-flat.vmdk]...
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: file size check | OK [ 1979120929792 bytes | 1979120929792 bytes ]
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: remote VMX file size 3353
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
System disk CIDs 626cc105|626cc105
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] (c) OneDiff algorithm
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Mirror VM exists and the system disks CID are the same, starting OneDiff...
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: length of .vmx file before OneDiff phase is 3546
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Snapshot & Quiescing
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: VMWare Tools detected, taking snapshot QUIESCED(false)...
[cmng.akcent.com] info: set argument --snapshot=doquiesce to quiesce your VMs
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: round 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: snapshot taken, quiescing status:
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
INFO: found [cmng.akcent.com_XSIBAK] with Id: 5
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Initiating OneDiff differential backup...
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: delta remains cleaned up at mirror VM [cmng.akcent.com_XSIBAK]
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: transfering snapshot file [cmng.akcent.com-Snapshot8.vmsn]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/cmng.akcent.com/cmng.akcent.com-Snapshot8.vmsn
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/cmng.akcent.com-Snapshot8.vmsn
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 1.00 mb/s
Overall speed 0.03 mb/s
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: transfering snapshot file [Woodwing-system-000002.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/cmng.akcent.com/Woodwing-system-000002.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-system-000002.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 1.00 mb/s
Overall speed 0.00 mb/s
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: transfering snapshot file [Woodwing-data-000002.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/5e8f7b7b-08763938-88df-00d8617ba898/Woodwing-data/Woodwing-data-000002.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-data-000002.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 1 seconds
Speed 1.00 mb/s
Overall speed 0.00 mb/s
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: transfering snapshot file [Woodwing-system-000002-delta.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/data/cmng.akcent.com/Woodwing-system-000002-delta.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-system-000002-delta.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 12 seconds
Speed 44.08 mb/s
Overall speed 44.01 mb/s
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: transfering snapshot file [Woodwing-data-000002-delta.vmdk]
A full file copy will be performed, no meta-data available
Reading from file /vmfs/volumes/5e8f7b7b-08763938-88df-00d8617ba898/Woodwing-data/Woodwing-data-000002-delta.vmdk
Writing to file /vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-data-000002-delta.vmdk
Set input file offset to 0 bytes
100.00% done
Time taken: 27 seconds
Speed 38.67 mb/s
Overall speed 38.65 mb/s
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Synchronizing configuration files
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: length of .vmx file before converting paths to absolute is 3546
[cmng.akcent.com] info: length of .vmx file after converting paths to absolute is 3359
[cmng.akcent.com] info: length of remote .vmx file after copying it is 3359
[cmng.akcent.com] info: length of remote .vmx after replacing name is 3366
[cmng.akcent.com] info: name changed to [cmng.akcent.com_XSIBAK]
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Removing hot snapshot & merging data
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: OneDiff backup differential data (8) merged with base data
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: diff mirror VM reloaded
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: deleting snapshot at [cmng.akcent.com_XSIBAK] Id 5...
[cmng.akcent.com] info: all snapshots removed
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: Updating CID at [/vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi/cmng.akcent.com/Woodwing-system.vmdk]
[cmng.akcent.com] info: finished OneDiff backup, CID updated
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: performing quick check...
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: file [Woodwing-system-flat.vmdk]...
[cmng.akcent.com] info: file size check | OK [ 64424509440B | 64424509440B ]
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: comparing first 500M of [Woodwing-system-flat.vmdk]...
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: (source) first 500M hash is: 8aff4290fb0940497e10243869b36512e123c999
[cmng.akcent.com] info: (target) first 500M hash is: 8aff4290fb0940497e10243869b36512e123c999
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: first 500M check | OK [ 8aff4290fb0940497e10243869b36512e123c999 ]
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: [Woodwing-system-flat.vmdk] not a thin disk or FS not VMFS, used size check skipped
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: performing quick check...
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: file [Woodwing-data-flat.vmdk]...
[cmng.akcent.com] info: file size check | OK [ 1979120929792B | 1979120929792B ]
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: comparing first 500M of [Woodwing-data-flat.vmdk]...
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: (source) first 500M hash is: 69f46d662a773ea0b48b8dc10837a48828047c0c
[cmng.akcent.com] info: (target) first 500M hash is: 69f46d662a773ea0b48b8dc10837a48828047c0c
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: first 500M check | OK [ 69f46d662a773ea0b48b8dc10837a48828047c0c ]
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[cmng.akcent.com] info: [Woodwing-data-flat.vmdk] not a thin disk or FS not VMFS, used size check skipped
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
The ESXi configuration was saved to "/vmfs/volumes/VCOMNET-BACKUP/Akcent-esxi"
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Adding debug information to the report
No errors detected in backup
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Using stored SMTP server info...

Offline

#10 2020-05-06 14:09:47

admin
Administrator
Registered: 2017-04-21
Posts: 2,072

Re: error DIFQMSH4: first 500M mistmatch

Of course, if you try to quiesce a guest that can't be quiesced, or that is returning errors when trying to do so, you may get some undesired side effects. Please check whether the guest needs quiescing, only a database server which is active at the time to perform the backup will need so, and remove --snapshot=doquiesce if it doesn't need it.

Offline

Board footer