Missing vdmk file .. cant start VM

magicker · 2020-01-04 19:11:27

After running countless tests with various options I can't get this to work (using rsync or xsidiff)

I am using the gui to try and send a hot copy of a VM to a remote ESXI server with the aim of putting it live straight away.

The transfer seems to go fine.

I can see a note saying

From : /vmfs/volumes/datastore1/vps4017/ubuntu16 image.vmdk
To: /vmfs/volumes/datastore1/imcoming/20200104183957/vps4017archemy/vps4017/ubuntu16 image.vmdk

sending incremental file list
ubuntu16 image.vmdk 557 100% 0.00kb 0:00:00 (xfs#1, to-chk=0/1)

send 654 bytes received 35 bytes 459.33 bytes/sec
total size is 557

This is the original file on the source:

557 Jan 4 17:35 ubuntu16 image.vmdk

so it looks like it transferred fine.

However, it is just not present on the target system.

The main vmdk works fine
96636764160 Jan 4 18:40 ubuntu16 image-flat.vmdk

admin · 2020-01-05 11:57:55

Please post the full output, otherwise we are just playing a guess game.

magicker · 2020-01-10 20:10:36

Still cant find away around this. It only affects some VMs.
Essentially ubuntu16 image.vmdk is missing on the remote server despite appearing to transfer.
Here is full output

output:

 "/vmfs/volumes/datastore1/XSIBackup-Pro/xsibackup" --backup-prog=X
SIDiff:l --date-dir=yes --backup-point=xxx.xxx.xxx.xxx:22:"/vmfs/volumes/datastore2/11000/" --backup-type=Custom --backup-vms="vps3024tempdevserver" --
backup-how=Hot --remote-xsipath=/vmfs/volumes/datastore1/XSIBackup-Pro --del-dirs=+3d
###############################################################################
#
# (c) XSIBACKUP-PRO 11.2.16 | Backup for (c) VMWARE ESXi Hypervisor by 33hops.com
#
###################################################################################

NOTICE: (c) XSIBackup kills any user launched jobs, make sure you don't overlap manual jobs
----------------------------------------------------------------------------------------------------------------------------------------------------
XSIBackup PID:         63210450                                                        hostname
Fri, 10 Jan 2020 15:19:48 +0000                              IPv4: xxx.xxx.xxx.252/255.255.255.0
VMware ESXi 6.5.0 build-7388607                              (c) Rsync 3.1.0 as opt. dependency
----------------------------------------------------------------------------------------------------------------------------------------------------
Backup Id:              unknown                       Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
----------------------------------------------------------------------------------------------------------------------------------------------------
Alert: crontab is not installed for user root
----------------------------------------------------------------------------------------------------------------------------------------------------
ADVICE: no SSD disks, please consider adding an SSD cache disk to improve performance
----------------------------------------------------------------------------------------------------------------------------------------------------
Backup user is: root
----------------------------------------------------------------------------------------------------------------------------------------------------
Backup program is: xsidiff
----------------------------------------------------------------------------------------------------------------------------------------------------
Remote OpenSSH version is: 7.9
----------------------------------------------------------------------------------------------------------------------------------------------------
Less Secure Ciphers enabled: arcfour,blowfish-cbc,aes128-ctr will allow faster SSH transfers
----------------------------------------------------------------------------------------------------------------------------------------------------
Negotiated Cipher (server->client): aes128-ctr
Negotiated Cipher (client->server): aes128-ctr
----------------------------------------------------------------------------------------------------------------------------------------------------
Service OpenSSH ready at server xxx.xxx.xxx.xxx:22
----------------------------------------------------------------------------------------------------------------------------------------------------
Remote ESXi version is 6.7.0
----------------------------------------------------------------------------------------------------------------------------------------------------
Info: remote XSIBACKUP-PRO install dir has been set by means of the --remote-xsipath argument
----------------------------------------------------------------------------------------------------------------------------------------------------
Remote xsi path set to: /vmfs/volumes/datastore1/XSIBackup-Pro (filesystem: VMFS-6)
----------------------------------------------------------------------------------------------------------------------------------------------------
Mirroring to server xxx.xxx.xxx.xxx port 22
Checking Rsync exists on the other side...
----------------------------------------------------------------------------------------------------------------------------------------------------
(c)Rsync (samba.org) found at [ xxx.xxx.xxx.xxx:22:/vmfs/volumes/datastore1/XSIBackup-Pro/bin/xsiba... ]
----------------------------------------------------------------------------------------------------------------------------------------------------
(c)XSIDiff found at [ xxx.xxx.xxx.xxx:22:/vmfs/volumes/datastore1/XSIBackup-Pro/bin/xsidiff... ]
----------------------------------------------------------------------------------------------------------------------------------------------------
E-mail Warnings
----------------------------------------------------------------------------------------------------------------------------------------------------
The e-mail report will not be sent because of the followig reasons:
The --mail-from string has not been set
The --smtp-srv string has not been set
The --smtp-port string has not been set
The --smtp-usr string has not been set, you need --smtp-usr if --smtp-auth is other than -none-
The --smtp-pwd string has not been set, you need --smtp-pwd if --smtp-auth is other than -none-
----------------------------------------------------------------------------------------------------------------------------------------------------
Getting list of all VMs...
----------------------------------------------------------------------------------------------------------------------------------------------------

18     vps3024tempdevserver                        [datastore2] vps3024/ubuntu16 image.vmx                      ubuntu64Guest   vmx-08
---
VMs to backup:
----------------------------------------------------------------------------------------------------------------------------------------------------
18     vps3024tempdevserver                        [datastore2] vps3024/ubuntu16 image.vmx                      ubuntu64Guest   vmx-08
----------------------------------------------------------------------------------------------------------------------------------------------------
Calculating sizes...
----------------------------------------------------------------------------------------------------------------------------------------------------
[vps3024tempdevserver] Starting backup (size is 563598M on 565791M file)
----------------------------------------------------------------------------------------------------------------------------------------------------
XSIBackup will backup your VMs while they are running, so that users can continue to use the VM
while the backup is taking place. You can also run --backup-how=cold|warm
----------------------------------------------------------------------------------------------------------------------------------------------------
Hot backup selected for VM: [vps3024tempdevserver], will not be switched off
----------------------------------------------------------------------------------------------------------------------------------------------------
[vps3024tempdevserver] info: boot partition is MBR
----------------------------------------------------------------------------------------------------------------------------------------------------
Removing snapshots, please wait...
----------------------------------------------------------------------------------------------------------------------------------------------------
Syncronizing config files
----------------------------------------------------------------------------------------------------------------------------------------------------
[vps3024tempdevserver] info: created dir to host VM backup
----------------------------------------------------------------------------------------------------------------------------------------------------
[vps3024tempdevserver] info: VMX file succesfully queued
[vps3024tempdevserver] info: VMSD file succesfully queued
----------------------------------------------------------------------------------------------------------------------------------------------------
[vps3024tempdevserver] info: no .vmxf file found
----------------------------------------------------------------------------------------------------------------------------------------------------
[vps3024tempdevserver] info: no .nvram file found
----------------------------------------------------------------------------------------------------------------------------------------------------
[vps3024tempdevserver] info: VMWare Tools detected, taking snapshot QUIESCED(false)...
[vps3024tempdevserver] info: set argument --snapshot=doquiesce to quiesce your VMs
----------------------------------------------------------------------------------------------------------------------------------------------------
Backing up virtual disks...
----------------------------------------------------------------------------------------------------------------------------------------------------
DISK=/vmfs/volumes/datastore2/vps3024/ubuntu16 image-000001-sesparse.vmdk
DISK=/vmfs/volumes/datastore2/vps3024/ubuntu16 image-000001.vmdk
DISK=/vmfs/volumes/datastore2/vps3024/ubuntu16 image-Snapshot7.vmsn
DISK=/vmfs/volumes/datastore2/vps3024/ubuntu16 image.vmdk
----------------------------------------------------------------------------------------------------------------------------------------------------
Disk [/vmfs/volumes/datastore2/vps3024/ubuntu16 image-000001-sesparse.vmdk] excluded
----------------------------------------------------------------------------------------------------------------------------------------------------
Disk [/vmfs/volumes/datastore2/vps3024/ubuntu16 image-000001.vmdk] excluded
----------------------------------------------------------------------------------------------------------------------------------------------------
Rsync file transfer (1st)
----------------------------------------------------------------------------------------------------------------------------------------------------
From: /vmfs/volumes/datastore2/vps3024/ubuntu16 image-Snapshot7.vmsn
To: /vmfs/volumes/datastore2/11000/20200110151948/vps3024tempdevserver/ubuntu16 image-Snapshot7.vmsn
----------------------------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
ubuntu16 image-Snapshot7.vmsn
         29,012 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/1)

sent 29,119 bytes  received 35 bytes  19,436.00 bytes/sec
total size is 29,012  speedup is 1.00
----------------------------------------------------------------------------------------------------------------------------------------------------
Rsync file transfer (1st)
----------------------------------------------------------------------------------------------------------------------------------------------------
From: /vmfs/volumes/datastore2/vps3024/ubuntu16 image.vmdk
To: /vmfs/volumes/datastore2/11000/20200110151948/vps3024tempdevserver/ubuntu16 image.vmdk
----------------------------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
ubuntu16 image.vmdk
            558 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/1)

sent 655 bytes  received 35 bytes  1,380.00 bytes/sec
total size is 558  speedup is 0.81
----------------------------------------------------------------------------------------------------------------------------------------------------
Info: transfering file | /vmfs/volumes/datastore2/vps3024/ubuntu16 image-flat.vmdk
----------------------------------------------------------------------------------------------------------------------------------------------------
Writing to file /vmfs/volumes/datastore2/11000/20200110151948/vps3024tempdevserver/ubuntu16 image-flat.vmdk
(c)XSIDiff 100.00% done
Time taken: 9845 seconds
Speed 57.21 mb/s
Overall speed 57.21 mb/s
----------------------------------------------------------------------------------------------------------------------------------------------------
Excluded disks removed from backup .vmx file
----------------------------------------------------------------------------------------------------------------------------------------------------

Connection to xxx.xxx.xxx.xxx closed by remote host.
[vps3024tempdevserver] info: no directories to delete as per the --del-dirs argument
----------------------------------------------------------------------------------------------------------------------------------------------------
The ESXi configuration was saved to "xxx.xxx.xxx.xxx:22:/vmfs/volumes/datastore2/11000"
----------------------------------------------------------------------------------------------------------------------------------------------------
No errors detected in backup
----------------------------------------------------------------------------------------------------------------------------------------------------
Backup finished
Tip: no chained backups scheduled, set --on-success and/or --on-error arguments to chain a backup
----------------------------------------------------------------------------------------------------------------------------------------------------
Killed

Files on remote server

-rw-------    1 root     root           558 Jan 10 18:31 ubuntu16
-rw-r--r--    1 root     root     590558003200 Jan 10 19:57 ubuntu16 image-flat.vmdk
-rw-r--r--    1 root     root            43 Jan 10 18:31 ubuntu16 image.vmsd
-rw-r--r--    1 root     root          3381 Jan 10 18:31 ubuntu16 image.vmx

Error making basic edits to VM

Virtual machine:
vps3024tempdevserver
State
Failed - Unable to access file [datastore2] vps3024tempdevserver/ubuntu16 image.vmdk

Errors

admin · 2020-01-11 12:27:34

Just as long as your [b]-flat.vmdk[/b] files are present you are safe.

Programs outputs can show any kind of error, segfault conditions, etc..., nonetheless what we have not found so far is some log trying to cheat you (just kidding). What we mean by that is that if you are shown this:

--------------------------------------------------------------------------------------------------------------------------------
Rsync file transfer (1st)
--------------------------------------------------------------------------------------------------------------------------------
From: /vmfs/volumes/datastore2/vps3024/ubuntu16 image.vmdk
To: /vmfs/volumes/datastore2/11000/20200110151948/vps3024tempdevserver/ubuntu16 image.vmdk
--------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
ubuntu16 image.vmdk
            558 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/1)

sent 655 bytes  received 35 bytes  1,380.00 bytes/sec
total size is 558  speedup is 0.81
--------------------------------------------------------------------------------------------------------------------------------

There are many more chances that you are wrong somehow than the log is lying.
Have you tried looking for that [b]ubuntu16 image.vmdk[/b] file in your remote disk?

find / -name "ubuntu16 image.vmdk"

Have you monitored the backup in real time to see if the file is actually being copied and some other process is deleting it afterwards?, that'd be our next step to solve the mistery.

You can't totally discard a broken disk either, but you would receive low level errors. Run a SMART test on the remote disk anyway, just to be sure.

magicker · 2020-01-11 16:30:19

dong a constant

 ls -al

while transfer in progress reveals that the files never make it

I took the same vms and manually renamed ubuntu16 image.vmx to ubuntu16image.vmx (no space) (and edited the vmx file etc) and now the backups work fine.

thanks

admin · 2020-01-13 18:17:33

That is weird, [b](c)XSIBackup-Pro[/b] is indeed compatible with spaces in VM names since a long time ago. On top of that any failure to transfer those files should get reflected in the log.

We'll perform extensive tests in ESXi 6.7.0 with spaces in names and try to find out what might be the cause.

Thank you for your feedback.

admin · 2021-05-24 12:27:42

Please, note this thread corresponds to an old software edition - (c)XSIBackup Classic - which has been deprecated. Use our latest software edition: [b](c)XSIBackup-DC[/b] and refer to [url=https://33hops.com/xsibackup-dc-full-manual-home.html]its manual[/url] to [url=https://33hops.com/xsibackup-vmware-esxi-backup.html#prodchart]backup your (c)ESXi VMs[/url] as of 2021

Forum ©XSIBackup: ©VMWare ©ESXi Backup Software

#1 2020-01-04 19:11:27

Missing vdmk file .. cant start VM

#2 2020-01-05 11:57:55

Re: Missing vdmk file .. cant start VM

#3 2020-01-10 20:10:36

Re: Missing vdmk file .. cant start VM

#4 2020-01-11 12:27:34

Re: Missing vdmk file .. cant start VM

#5 2020-01-11 16:30:19

Re: Missing vdmk file .. cant start VM

#6 2020-01-13 18:17:33

Re: Missing vdmk file .. cant start VM

#7 2021-05-24 12:27:42

Re: Missing vdmk file .. cant start VM

Board footer