Posts by magicker

magicker · General matters

we are using XSIDiff ?

(not sure if you answer was meant to be directed at me)

magicker · General matters

Hi there,
We are nearly at the end of our testing phase and generally speaking everything is working as we would expect.

However, we had an incident this morning. The email reported that everything had completed however, a quick manual inspection of the copy showed a few discrepancies in file sizes. At least 3 of the *flat* files had only partially copied and those vms were not bootable.

---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:04:32|  [vps2013tvbeds] Starting backup (size is 86123M on 92160M file)
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:04:32|  XSIBackup will backup your VMs while they are running, so that users can continue to use the VM
2020-01-31T11:04:32|  while the backup is taking place. You can also run --backup-how=cold|warm
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:04:32|  Hot backup selected for VM: [vps2013tvbeds], will not be switched off
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:04:33|  [vps2013tvbeds] info: boot partition is MBR
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:04:33|  Removing snapshots, please wait...
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:04:35|  Syncronizing config files
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:04:37|  [vps2013tvbeds] info: created dir to host VM backup
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:04:39|  [vps2013tvbeds] info: VMX file succesfully queued
2020-01-31T11:04:39|  [vps2013tvbeds] info: VMSD file succesfully queued
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:04:40|  [vps2013tvbeds] info: VMXF file succesfully queued
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:04:40|  [vps2013tvbeds] info: NVRAM file succesfully queued
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:04:40|  [vps2013tvbeds] info: VMWare Tools detected, taking snapshot QUIESCED(false)...
2020-01-31T11:04:40|  [vps2013tvbeds] info: set argument --snapshot=doquiesce to quiesce your VMs
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:05:33|  Backing up virtual disks...
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:05:33|  DISK=/vmfs/volumes/datastore2/vps2013tvbeds/vps2013tvbeds-000001-sesparse.vmdk
2020-01-31T11:05:33|  DISK=/vmfs/volumes/datastore2/vps2013tvbeds/vps2013tvbeds-000001.vmdk
2020-01-31T11:05:33|  DISK=/vmfs/volumes/datastore2/vps2013tvbeds/vps2013tvbeds-Snapshot2.vmsn
2020-01-31T11:05:33|  DISK=/vmfs/volumes/datastore2/vps2013tvbeds/vps2013tvbeds.vmdk
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:05:34|  Disk [/vmfs/volumes/datastore2/vps2013tvbeds/vps2013tvbeds-000001-sesparse.vmdk] excluded
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:05:34|  Disk [/vmfs/volumes/datastore2/vps2013tvbeds/vps2013tvbeds-000001.vmdk] excluded
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:05:35|  Rsync file transfer (1st)
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:05:35|  From: /vmfs/volumes/datastore2/vps2013tvbeds/vps2013tvbeds-Snapshot2.vmsn
2020-01-31T11:05:35|  To: /vmfs/volumes/datastore2/10000/20200131080805/vps2013tvbeds/vps2013tvbeds-Snapshot2.vmsn
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
vps2013tvbeds-Snapshot2.vmsn
^M         28,656 100%    0.00kB/s    0:00:00  ^M         28,656 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/1)

sent 28,762 bytes  received 35 bytes  19,198.00 bytes/sec
total size is 28,656  speedup is 1.00
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:05:37|  Rsync file transfer (1st)
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:05:37|  From: /vmfs/volumes/datastore2/vps2013tvbeds/vps2013tvbeds.vmdk
2020-01-31T11:05:37|  To: /vmfs/volumes/datastore2/10000/20200131080805/vps2013tvbeds/vps2013tvbeds.vmdk
---------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
vps2013tvbeds.vmdk
^M            557 100%    0.00kB/s    0:00:00  ^M            557 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/1)

sent 653 bytes  received 35 bytes  1,376.00 bytes/sec
total size is 557  speedup is 0.81
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:05:38|  Info: transfering file | /vmfs/volumes/datastore2/vps2013tvbeds/vps2013tvbeds-flat.vmdk
---------------------------------------------------------------------------------------------------------------------------------
Writing to file /vmfs/volumes/datastore2/10000/20200131080805/vps2013tvbeds/vps2013tvbeds-flat.vmdk

Time taken: 1757 seconds
Speed 49.02 mb/s
Overall speed 52.45 mb/s
---------------------------------------------------------------------------------------------------------------------------------
2020-01-31T11:34:58|  Excluded disks removed from backup .vmx file

How do I go about troubleshooting this?

job:

"/vmfs/volumes/datastore1/XSIBackup-Pro/xsibackup" \
--backup-prog=XSIDiff \
--date-dir=yes \
--backup-point=xxx.xxx.xxx.xxx:22:"/vmfs/volumes/datastore2/10000" \
--backup-type=Custom \
--backup-vms="REGEXP(^v.*)" \
--backup-how=Hot \
--remote-xsipath=/vmfs/volumes/datastore1/XSIBackup-Pro \
--del-dirs=+2d \
--use-smtp=1 \
--mail-to=xxxxx@gmail.com \
--subject="10000" \
--backup-id=001 \
--description="full" \
--exec=yes >> "/vmfs/volumes/datastore1/XSIBackup-Pro/var/logs/xsibackup.log"

magicker · General matters

dong a constant

 ls -al

while transfer in progress reveals that the files never make it

I took the same vms and manually renamed ubuntu16 image.vmx to ubuntu16image.vmx (no space) (and edited the vmx file etc) and now the backups work fine.

thanks

magicker · General matters

Still cant find away around this. It only affects some VMs.
Essentially ubuntu16 image.vmdk is missing on the remote server despite appearing to transfer.
Here is full output

output:

 "/vmfs/volumes/datastore1/XSIBackup-Pro/xsibackup" --backup-prog=X
SIDiff:l --date-dir=yes --backup-point=xxx.xxx.xxx.xxx:22:"/vmfs/volumes/datastore2/11000/" --backup-type=Custom --backup-vms="vps3024tempdevserver" --
backup-how=Hot --remote-xsipath=/vmfs/volumes/datastore1/XSIBackup-Pro --del-dirs=+3d
###############################################################################
#
# (c) XSIBACKUP-PRO 11.2.16 | Backup for (c) VMWARE ESXi Hypervisor by 33hops.com
#
###################################################################################

NOTICE: (c) XSIBackup kills any user launched jobs, make sure you don't overlap manual jobs
----------------------------------------------------------------------------------------------------------------------------------------------------
XSIBackup PID:         63210450                                                        hostname
Fri, 10 Jan 2020 15:19:48 +0000                              IPv4: xxx.xxx.xxx.252/255.255.255.0
VMware ESXi 6.5.0 build-7388607                              (c) Rsync 3.1.0 as opt. dependency
----------------------------------------------------------------------------------------------------------------------------------------------------
Backup Id:              unknown                       Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
----------------------------------------------------------------------------------------------------------------------------------------------------
Alert: crontab is not installed for user root
----------------------------------------------------------------------------------------------------------------------------------------------------
ADVICE: no SSD disks, please consider adding an SSD cache disk to improve performance
----------------------------------------------------------------------------------------------------------------------------------------------------
Backup user is: root
----------------------------------------------------------------------------------------------------------------------------------------------------
Backup program is: xsidiff
----------------------------------------------------------------------------------------------------------------------------------------------------
Remote OpenSSH version is: 7.9
----------------------------------------------------------------------------------------------------------------------------------------------------
Less Secure Ciphers enabled: arcfour,blowfish-cbc,aes128-ctr will allow faster SSH transfers
----------------------------------------------------------------------------------------------------------------------------------------------------
Negotiated Cipher (server->client): aes128-ctr
Negotiated Cipher (client->server): aes128-ctr
----------------------------------------------------------------------------------------------------------------------------------------------------
Service OpenSSH ready at server xxx.xxx.xxx.xxx:22
----------------------------------------------------------------------------------------------------------------------------------------------------
Remote ESXi version is 6.7.0
----------------------------------------------------------------------------------------------------------------------------------------------------
Info: remote XSIBACKUP-PRO install dir has been set by means of the --remote-xsipath argument
----------------------------------------------------------------------------------------------------------------------------------------------------
Remote xsi path set to: /vmfs/volumes/datastore1/XSIBackup-Pro (filesystem: VMFS-6)
----------------------------------------------------------------------------------------------------------------------------------------------------
Mirroring to server xxx.xxx.xxx.xxx port 22
Checking Rsync exists on the other side...
----------------------------------------------------------------------------------------------------------------------------------------------------
(c)Rsync (samba.org) found at [ xxx.xxx.xxx.xxx:22:/vmfs/volumes/datastore1/XSIBackup-Pro/bin/xsiba... ]
----------------------------------------------------------------------------------------------------------------------------------------------------
(c)XSIDiff found at [ xxx.xxx.xxx.xxx:22:/vmfs/volumes/datastore1/XSIBackup-Pro/bin/xsidiff... ]
----------------------------------------------------------------------------------------------------------------------------------------------------
E-mail Warnings
----------------------------------------------------------------------------------------------------------------------------------------------------
The e-mail report will not be sent because of the followig reasons:
The --mail-from string has not been set
The --smtp-srv string has not been set
The --smtp-port string has not been set
The --smtp-usr string has not been set, you need --smtp-usr if --smtp-auth is other than -none-
The --smtp-pwd string has not been set, you need --smtp-pwd if --smtp-auth is other than -none-
----------------------------------------------------------------------------------------------------------------------------------------------------
Getting list of all VMs...
----------------------------------------------------------------------------------------------------------------------------------------------------

18     vps3024tempdevserver                        [datastore2] vps3024/ubuntu16 image.vmx                      ubuntu64Guest   vmx-08
---
VMs to backup:
----------------------------------------------------------------------------------------------------------------------------------------------------
18     vps3024tempdevserver                        [datastore2] vps3024/ubuntu16 image.vmx                      ubuntu64Guest   vmx-08
----------------------------------------------------------------------------------------------------------------------------------------------------
Calculating sizes...
----------------------------------------------------------------------------------------------------------------------------------------------------
[vps3024tempdevserver] Starting backup (size is 563598M on 565791M file)
----------------------------------------------------------------------------------------------------------------------------------------------------
XSIBackup will backup your VMs while they are running, so that users can continue to use the VM
while the backup is taking place. You can also run --backup-how=cold|warm
----------------------------------------------------------------------------------------------------------------------------------------------------
Hot backup selected for VM: [vps3024tempdevserver], will not be switched off
----------------------------------------------------------------------------------------------------------------------------------------------------
[vps3024tempdevserver] info: boot partition is MBR
----------------------------------------------------------------------------------------------------------------------------------------------------
Removing snapshots, please wait...
----------------------------------------------------------------------------------------------------------------------------------------------------
Syncronizing config files
----------------------------------------------------------------------------------------------------------------------------------------------------
[vps3024tempdevserver] info: created dir to host VM backup
----------------------------------------------------------------------------------------------------------------------------------------------------
[vps3024tempdevserver] info: VMX file succesfully queued
[vps3024tempdevserver] info: VMSD file succesfully queued
----------------------------------------------------------------------------------------------------------------------------------------------------
[vps3024tempdevserver] info: no .vmxf file found
----------------------------------------------------------------------------------------------------------------------------------------------------
[vps3024tempdevserver] info: no .nvram file found
----------------------------------------------------------------------------------------------------------------------------------------------------
[vps3024tempdevserver] info: VMWare Tools detected, taking snapshot QUIESCED(false)...
[vps3024tempdevserver] info: set argument --snapshot=doquiesce to quiesce your VMs
----------------------------------------------------------------------------------------------------------------------------------------------------
Backing up virtual disks...
----------------------------------------------------------------------------------------------------------------------------------------------------
DISK=/vmfs/volumes/datastore2/vps3024/ubuntu16 image-000001-sesparse.vmdk
DISK=/vmfs/volumes/datastore2/vps3024/ubuntu16 image-000001.vmdk
DISK=/vmfs/volumes/datastore2/vps3024/ubuntu16 image-Snapshot7.vmsn
DISK=/vmfs/volumes/datastore2/vps3024/ubuntu16 image.vmdk
----------------------------------------------------------------------------------------------------------------------------------------------------
Disk [/vmfs/volumes/datastore2/vps3024/ubuntu16 image-000001-sesparse.vmdk] excluded
----------------------------------------------------------------------------------------------------------------------------------------------------
Disk [/vmfs/volumes/datastore2/vps3024/ubuntu16 image-000001.vmdk] excluded
----------------------------------------------------------------------------------------------------------------------------------------------------
Rsync file transfer (1st)
----------------------------------------------------------------------------------------------------------------------------------------------------
From: /vmfs/volumes/datastore2/vps3024/ubuntu16 image-Snapshot7.vmsn
To: /vmfs/volumes/datastore2/11000/20200110151948/vps3024tempdevserver/ubuntu16 image-Snapshot7.vmsn
----------------------------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
ubuntu16 image-Snapshot7.vmsn
         29,012 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/1)

sent 29,119 bytes  received 35 bytes  19,436.00 bytes/sec
total size is 29,012  speedup is 1.00
----------------------------------------------------------------------------------------------------------------------------------------------------
Rsync file transfer (1st)
----------------------------------------------------------------------------------------------------------------------------------------------------
From: /vmfs/volumes/datastore2/vps3024/ubuntu16 image.vmdk
To: /vmfs/volumes/datastore2/11000/20200110151948/vps3024tempdevserver/ubuntu16 image.vmdk
----------------------------------------------------------------------------------------------------------------------------------------------------
sending incremental file list
ubuntu16 image.vmdk
            558 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/1)

sent 655 bytes  received 35 bytes  1,380.00 bytes/sec
total size is 558  speedup is 0.81
----------------------------------------------------------------------------------------------------------------------------------------------------
Info: transfering file | /vmfs/volumes/datastore2/vps3024/ubuntu16 image-flat.vmdk
----------------------------------------------------------------------------------------------------------------------------------------------------
Writing to file /vmfs/volumes/datastore2/11000/20200110151948/vps3024tempdevserver/ubuntu16 image-flat.vmdk
(c)XSIDiff 100.00% done
Time taken: 9845 seconds
Speed 57.21 mb/s
Overall speed 57.21 mb/s
----------------------------------------------------------------------------------------------------------------------------------------------------
Excluded disks removed from backup .vmx file
----------------------------------------------------------------------------------------------------------------------------------------------------

Connection to xxx.xxx.xxx.xxx closed by remote host.
[vps3024tempdevserver] info: no directories to delete as per the --del-dirs argument
----------------------------------------------------------------------------------------------------------------------------------------------------
The ESXi configuration was saved to "xxx.xxx.xxx.xxx:22:/vmfs/volumes/datastore2/11000"
----------------------------------------------------------------------------------------------------------------------------------------------------
No errors detected in backup
----------------------------------------------------------------------------------------------------------------------------------------------------
Backup finished
Tip: no chained backups scheduled, set --on-success and/or --on-error arguments to chain a backup
----------------------------------------------------------------------------------------------------------------------------------------------------
Killed

Files on remote server

-rw-------    1 root     root           558 Jan 10 18:31 ubuntu16
-rw-r--r--    1 root     root     590558003200 Jan 10 19:57 ubuntu16 image-flat.vmdk
-rw-r--r--    1 root     root            43 Jan 10 18:31 ubuntu16 image.vmsd
-rw-r--r--    1 root     root          3381 Jan 10 18:31 ubuntu16 image.vmx

Error making basic edits to VM

Virtual machine:
vps3024tempdevserver
State
Failed - Unable to access file [datastore2] vps3024tempdevserver/ubuntu16 image.vmdk

Errors

magicker · Feature requests & improvements

ok that did the trick.

Am i right in thinking that VMs still cant have spaces in their names? when testing with a space I get
2020-01-05T17:23:13 | Error code 2361 at file xsibackup.c, line 2361
Error description: failed to lock the repo /vmfs/volumes/datastore2/incoming2

(info only.. removing space seems to work fine)

thanks

I was trying to follow these examples. hence no root@

./xsibackup --add-key 10.10.1.20:22
./xsibackup --backup /home/me/my-data /mnt/NFS/backup --compression
./xsibackup --backup /home/me/my-data /mnt/NFS/backup --compression --rotate=30
./xsibackup --backup "VMs(Win01, Lin03, MyERP)" /vmfs/volumes/backup
./xsibackup --backup "VMs(Win01, Lin03, MyERP)" 10.10.1.20:22:/vmfs/volumes/backup --compression
./xsibackup --replica "VMs(Win01, Lin03, MyERP)" /vmfs/volumes/backup
./xsibackup --replica "VMs(Win01, Lin03, MyERP)" 10.10.1.20:22://vmfs/volumes/backup
./xsibackup --backup "VMs(Win01, Lin03, MyERP)" 192.168.10.91:22:/vmfs/volumes/backup --compression
./xsibackup --replica "VMs(Win01, Lin03, MyERP)" 192.168.10.91:4432:/vmfs/volumes/backup
./xsibackup --repair /vmfs/volumes/backup
./xsibackup --info /vmfs/volumes/backup
./xsibackup --prune /vmfs/volumes/backup/20190603211935

magicker · General matters

After running countless tests with various options I can't get this to work (using rsync or xsidiff)

I am using the gui to try and send a hot copy of a VM to a remote ESXI server with the aim of putting it live straight away.

The transfer seems to go fine.

I can see a note saying

From : /vmfs/volumes/datastore1/vps4017/ubuntu16 image.vmdk
To: /vmfs/volumes/datastore1/imcoming/20200104183957/vps4017archemy/vps4017/ubuntu16 image.vmdk

sending incremental file list
ubuntu16 image.vmdk 557 100% 0.00kb 0:00:00 (xfs#1, to-chk=0/1)

send 654 bytes received 35 bytes 459.33 bytes/sec
total size is 557

This is the original file on the source:

557 Jan 4 17:35 ubuntu16 image.vmdk

so it looks like it transferred fine.

However, it is just not present on the target system.

The main vmdk works fine
96636764160 Jan 4 18:40 ubuntu16 image-flat.vmdk

magicker · Feature requests & improvements

Starting to feel very stupid now.

I have exchanged keys with a remote esxi system and that seemed to work just fine.

Now I want to send over a replica

./xsibackup --replica "VMs(test)" xxx.xxx.xxx.xxx:22:/vmfs/volumes/datastore2/incoming --remote-path=/vmfs/volumes/datastore1/xsibackup/xsibackup

However, the system then dumps a replicate on the Source server in the xsibackup folder under a folder called /vmfs/volumes/5ae1cdf5-fb8f1c53-59f4-246e96881b24/xsibackup/xxx.xxx.xxx.xxx:22:/test/

what on earth am I doing wrong?

magicker · General matters

damn it.. read the pdf back to front but missed the readme.txt completely..

sorry for wasting your time

magicker · General matters

HI there

I seem to have a few permissions everytime I try to run anything

[root@15000:/vmfs/volumes/5d9e0b20-a5b36164-5afe-ecf4bbed095c/xsibackup] ./xsibackup --request-key
sh: /vmfs/volumes/5d9e0b20-a5b36164-5afe-ecf4bbed095c/xsibackup/bin/xsilib: Permission denied
2019-11-07T18:51:44 | Error code 1304 at file common.c, line 1304
Error description: could not prune the /vmfs/volumes/5d9e0b20-a5b36164-5afe-ecf4bbed095c/xsibackup/var/log/prog directory
-----------------------------------------------------------------------------------------------------------------
Can't find error file:
Something went wrong at checking (c)XSIBackup directory structure-----------------------------------------------------------------------------------------------------------------
Removed /tmp/xsi dir OK
-----------------------------------------------------------------------------------------------------------------
2019-11-07T18:51:44 | Error code 52 at file signal.c, line 52
Error description: can't remove PID file /tmp/xsibackup.pid, error: No such file or directory
-----------------------------------------------------------------------------------------------------------------
Can't find error file:

I cant even generate a licence key so far.

6.7.0 Update 2 (Build 13006603)

magicker · General matters

Hi there
We have literally just started working with Pro and are still getting our heads around the various backup methods etc.

Should we stop this work and concentrate on the DC version?

Will their be a discount for Pro users upgrading?

magicker · General matters

Hi there

Yes.. this is probably me being stupid

Most of the MVs I attempt to copy over to a remote esxi server cant be edited or powered up once they are on the remote system

Failed to reconfigure virtual machine some name ofVM. Unable to access file [datastore2] 14000/20190623110553/some name ofVM/ubuntu1804.vmdk

is this because the spaces in the paths?

(a quick test showed that a new vm with no spaces worked fine... all my damn VMs have spaces)

thanks

Forum ©XSIBackup: ©VMWare ©ESXi Backup Software

#1 Re: General matters » Reports sucess after failed transfer » 2020-02-03 14:15:00

#2 General matters » Reports sucess after failed transfer » 2020-01-31 16:56:41

#3 Re: General matters » Missing vdmk file .. cant start VM » 2020-01-11 16:30:19

#4 Re: General matters » Missing vdmk file .. cant start VM » 2020-01-10 20:10:36

#5 Re: Feature requests & improvements » replica over IP? » 2020-01-05 17:31:44

#6 General matters » Missing vdmk file .. cant start VM » 2020-01-04 19:11:27

#7 Feature requests & improvements » replica over IP? » 2020-01-03 21:44:56

#8 Re: General matters » permissions? » 2019-11-11 12:39:03

#9 General matters » permissions? » 2019-11-07 18:56:48

#10 General matters » DC v Pro » 2019-07-27 09:04:54

#11 General matters » can edit any copied VMs » 2019-06-23 12:19:14

Board footer