©XSIBackup-Free: Free Backup Software for ©VMWare ©ESXi

Forum ©XSIBackup: ©VMWare ©ESXi Backup Software


You are not logged in.

#1 2018-11-07 05:19:07

itservice614
Member
Registered: 2018-10-01
Posts: 37

New CRON Jobs Process late comparing to Old

Hi,

I have Installed latest version of XSIBACKUP with cron job. Though it was tough to configure, however i managed to make it run the cron jobs, just for 1.5 TB it takes around 8 hours completed only 23% , on Dell Server(16 GB RAM and 6 Core Processor) and another Server Dell R710 with 12 Core and 24 TB hdd with 64 GB RAM, for File Server it takes 12 hours 28% still continous on local hard disk.

How can I uninstall all latest Installed XSIBACKUP and try with old XSIBACKUP Software, can i just replace the key and place with old software installation steps and try or there is something i can do on latest version of xsibackup to fast backup in local drive.


Thanks in advance.

Sam

Offline

#2 2018-11-07 13:27:14

itservice614
Member
Registered: 2018-10-01
Posts: 37

Re: New CRON Jobs Process late comparing to Old

Hi,

can you send me link to subcribe for previous version please, so i can install and test the speed.

Offline

#3 2018-11-07 13:52:30

itservice614
Member
Registered: 2018-10-01
Posts: 37

Re: New CRON Jobs Process late comparing to Old

After uninstalling by removing directories

rm -rf /vmfs/volumes/datastore1/xsi-dir;
chmod 0700 /var/spool/cron/crontabs/root;
sed -i '/-dir\/jobs/d' /var/spool/cron/crontabs/root;
sed -i '/cron-init/d' /etc/rc.local.d/local.sh

I tried to install old version.

But i get following error

[root@localhost:~] cd /vmfs/volumes/datastore1/xsi-dir 2>/dev/null || mkdir /vmfs/volumes/datastore1/xsi-dir && \
> cd /vmfs/volumes/datastore1/xsi-dir && \
> esxcli network firewall unload && \
> wget IREMOVED -O xsibackup.zip && \
> unzip -o xsibackup.zip || cat xsibackup.zip && echo "" && \
> chmod -R 0700 xsibackup* bin src && \
> rm -rf xsibackup.zip && \
> esxcli network firewall load
Connecting to a.33hops.com (188.165.2.135:80)
xsibackup.zip        100% |*****************************************************************************************************************|  1651k  0:00:00 ETA
Archive:  xsibackup.zip
  inflating: install
  inflating: README.txt
  inflating: XSIBACKUP-FREE.zip

chmod: bin: No such file or directory
chmod: src: No such file or directory
[root@localhost:/vmfs/volumes/5b97034d-d0fdbcd5-e679-842b2b4df21f/xsi-dir]

Last edited by itservice614 (2018-11-07 13:53:01)

Offline

#4 2018-11-07 22:32:00

admin
Administrator
Registered: 2017-04-21
Posts: 2,055

Re: New CRON Jobs Process late comparing to Old

XSIBackup is as fast as your hardware is, you should be able to achieve at a minimum 70 mb./s on commodity hardware. If your server is overloaded the speed can reduce to almost zero, but that is something we have no control on.

Avoid manufacturer ESXi builds, XSIBackup is NOT compatible with manufacturer builds. If you use some DELL ESXi version we will offer no support, not even in the forum. Use official ESXi builds.

Offline

#5 2018-11-08 12:05:59

itservice614
Member
Registered: 2018-10-01
Posts: 37

Re: New CRON Jobs Process late comparing to Old

Hi,

Thanks for your reply.

Please note, I downloaded & setup from Official website of VMWARE ESXi Build 6.7.

Next

Do you want me to change from 6.7 to 6.5 my ESXi Server, try?
or
What if i install the previous version of XSIBACKUP10, does it work with ESXi.6.7, if that support, please send me the link to subscribe and try?

Only one VM server running on each Server, and XSIBACKUP shutdown VM and does the backup, its taking huge time..

I have setup at least 10 Locations XSIBACKUP and its working fine as per the requirement.

But i dont what is the problem on this

DELL R710 64 GB RAM -12 Cores - 24 TB HDD, just for 6 IT it taken ages to backup.
HP ML 360 16 GB RAM - 6 Cores  - 4 TB SAS HDD, just for 1.5 TB it takes ages to do backup.

Do I need to purchase XSIBACKUP PRO for speed backup, please advice the best solution or if someone can connect check, as my client requires the solution implemented asap, then next phase, wanted this VMs to shifted backup at a remote location on NAS

PLease help.

Sam

Offline

#6 2018-11-08 13:17:41

admin
Administrator
Registered: 2017-04-21
Posts: 2,055

Re: New CRON Jobs Process late comparing to Old

Why should you change to 6.5?, we never suggested that. You seem to be having some problems determining the cause of your hardware slugishness.

You are not telling us where are you backing up to, it does not matter if your hardware has many CPUs or a lot of RAM, if you use a cheap switch to connect to some NAS datastore that will make the difference and make any server feature useless.

Offline

#7 2018-11-08 13:25:10

itservice614
Member
Registered: 2018-10-01
Posts: 37

Re: New CRON Jobs Process late comparing to Old

Thanks for your reply, okay noted i will use same backup latest backup.

Im doing backup within Esxi Local Server Path, so there shouldnt be any backup over network.
Yes Agree, but im using Cisco 3560 Gigabyte POE Switch.

Offline

#8 2018-11-08 15:11:54

admin
Administrator
Registered: 2017-04-21
Posts: 2,055

Re: New CRON Jobs Process late comparing to Old

The path being local means nothing. It could be pointing to a datastore mounted over a NAS. You still don't mention what your setup is, so we are sorry, but we can't help you if you don't offer the details we ask for, "Big DELL server slow" is not enough information.

Post the output of a df -h command and say where your VM is and where you are copying it to.

The switch you mention is a nice piece of hardware, it should not be the culprit, but there are many other pieces in the setup and all of them must be properly configured to get the most out of your system.

Have you tried performing a backup by an alternative means, i.e. --backup-prog=Vmkfstools? If not, do it and send us the output.

Offline

#9 2018-11-26 13:23:57

itservice614
Member
Registered: 2018-10-01
Posts: 37

Re: New CRON Jobs Process late comparing to Old

Thanks I used this following

"/vmfs/volumes/datastore1/xsi-dir/xsibackup" \
--certify-backup=yes \
--backup-point=/vmfs/volumes/DATA/Backup/$( date +%Y%m'00000000' ) \
--backup-type=Custom \
--backup-vms="mailsrv12" \
--backup-how=warm \
--use-smtp=1 \
--backup-room=1500 \
--mail-to=itservice614@gmail.com \
--backup-id=001 \
--description="MAILSRV BACKUP" \
--exec=yes >> "/vmfs/volumes/datastore1/xsi-dir/var/logs/xsibackup.log"

and its taken 1 days if you see below logs in xsibackup, but still taking more than 24 hours, Im i missing again anything


2018-11-24T18:00:05|  ###############################################################################
2018-11-24T18:00:05|     XSIBACKUP-FREE 11.0.1: new execution request                     
2018-11-24T18:00:05|  ###############################################################################
2018-11-24T18:00:05| 
2018-11-24T18:00:05|  NOTICE: (c) XSIBackup kills any user launched jobs, make sure you don't overlap manual jobs
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:05|  NOTICE: (c) XSIBackup-Pro 11.1.5 is available to download
---------------------------------------------------------------------------------------------------------------------------------
XSIBackup PID:          2233398                                                    sales-exe100
Sat, 24 Nov 2018 18:00:05 +0000                               IPv4: 192.168.3.205/255.255.255.0
VMware ESXi 6.7.0 build-8169922                              (c) Rsync 3.1.0 as opt. dependency
---------------------------------------------------------------------------------------------------------------------------------
Backup Id:                  001                       Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:06|  Backup description: task mailsrv backup
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:06|  Message: crontab is installed for user root
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:08|  ADVICE: no SSD disks, please consider adding an SSD cache disk to improve performance
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:08|  Backup user is: root
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:08|  /vmfs/volumes/DATA/Backup/20181100000000 is an XSITools repo
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:08|  XSITools Error XSITCMP1: /vmfs/volumes/DATA/Backup/20181100000000 is a compressed repository, you must enable compression to backup to it
2018-11-24T18:00:09|  --backup-point found at /vmfs/volumes/DATA/Backup/20181100000000 (filesystem: VMFS-6)
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:09|  The backup room has been limited to 1500 gb.
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:10|  Getting list of all VMs...
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:10|  8      mailsrv12    [DATA] mailsrv12/mailsrv12.vmx     debian8_64Guest   vmx-14                                                                                                                               
2018-11-24T18:00:10|  9      Mailserver   [DATA] Mailserver/Mailserver.vmx   ubuntu64Guest     vmx-07    Ubuntu 16.04 Server VA with NAKIVO Backup and Replication Transporter 8.0 preinstalledVA login: rootVA password: QExS-6b%3D
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:11|  VMs to backup:
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:11|  8      mailsrv12    [DATA] mailsrv12/mailsrv12.vmx     debian8_64Guest   vmx-14                                                                                                                               
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:13|  Needed room: 1779 Gb.
2018-11-24T18:00:13|  Sparse size: 1779 Gb.
2018-11-24T18:00:13|  Available room: 213 Gb.
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:13|  Not enough room to make the backup, some older folders will be deleted
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:14|  [mailsrv12] Starting backup (size is 1822070M on 1822070M file)
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:14|  XSIBackup will backup your VMs while they are running and will quiesce guest services too, so that users
2018-11-24T18:00:14|  can continue to use the VM while the backup is taking place. You can also run cold and warm --backup-how
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:14|  Stopping VM [mailsrv12]
---------------------------------------------------------------------------------------------------------------------------------
Powering off VM:
2018-11-24T18:00:15|  VMware Tools are not present or outdated in VM: [mailsrv12], power-off issued
2018-11-24T18:00:45|  Sleeping :-o 30 s, waiting for VM to be off
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:47|  [mailsrv12] info: boot partition is EFI
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:47|  [mailsrv12] Info: attempting to free 1834358 mb at [ /vmfs/volumes/DATA ]
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:52|  Removing snapshots, please wait...
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:00:52|  Syncronizing config files
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:01:25|  [mailsrv12] info: VMWare tools were not detected, the system will not be quiesced
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:01:29|  [mailsrv12] info: bringing VM up again
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:01:30|  Backing up virtual disks...
---------------------------------------------------------------------------------------------------------------------------------
2018-11-24T18:01:30|  scsi0:0.fileName = "mailsrv12.vmdk"
---------------------------------------------------------------------------------------------------------------------------------
Destination disk format: VMFS thin-provisioned
Cloning disk '/vmfs/volumes/DATA/mailsrv12/mailsrv12.vmdk'...

Clone: 10% done.
.....
Clone: 97% done.
Clone: 98% done.
Clone: 99% done.
Clone: 100% done.
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T09:19:15|  [mailsrv12] Disk copied to /vmfs/volumes/DATA/Backup/20181100000000/mailsrv12/mailsrv12.vmdk
---------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
|                  Backup certification is not available in XSIBACKUP-FREE                 |
|                          Get XSIBACKUP-PRO at https://33hops.com                          |
|                              USE DISCOUNT COUPON: XSIDREWYI                              |
--------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------
|              Backup of ESXi configuration is not available in XSIBACKUP-FREE             |
|                          Get XSIBACKUP-PRO at https://33hops.com                          |
--------------------------------------------------------------------------------------------

2018-11-25T09:22:17|  Errors detected in backup, check logs
---------------------------------------------------------------------------------------------------------------------------------
Using stored SMTP server info...
Found conf/smtpsrvs file...
[0;31mError: cannot determine the e-mail server credentials, each smtpsrvs entry requires seven fields, please check syntax[0m
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:04|  ###############################################################################
2018-11-25T18:00:04|     XSIBACKUP-FREE 11.0.1: new execution request                     
2018-11-25T18:00:04|  ###############################################################################
2018-11-25T18:00:04| 
2018-11-25T18:00:05|  NOTICE: (c) XSIBackup kills any user launched jobs, make sure you don't overlap manual jobs
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:05|  NOTICE: (c) XSIBackup-Pro 11.1.6 is available to download
---------------------------------------------------------------------------------------------------------------------------------
XSIBackup PID:          2248139                                                    sales-exe100
Sun, 25 Nov 2018 18:00:04 +0000                               IPv4: 192.168.3.205/255.255.255.0
VMware ESXi 6.7.0 build-8169922                              (c) Rsync 3.1.0 as opt. dependency
---------------------------------------------------------------------------------------------------------------------------------
Backup Id:                  001                       Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:06|  Backup description: task mailsrv backup
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:06|  Message: crontab is installed for user root
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:08|  ADVICE: no SSD disks, please consider adding an SSD cache disk to improve performance
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:08|  Backup user is: root
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:08|  /vmfs/volumes/DATA/Backup/20181100000000 is an XSITools repo
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:08|  XSITools Error XSITCMP1: /vmfs/volumes/DATA/Backup/20181100000000 is a compressed repository, you must enable compression to backup to it
2018-11-25T18:00:09|  --backup-point found at /vmfs/volumes/DATA/Backup/20181100000000 (filesystem: VMFS-6)
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:09|  The backup room has been limited to 1500 gb.
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:09|  Getting list of all VMs...
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:09|  8      mailsrv12    [DATA] mailsrv12/mailsrv12.vmx     debian8_64Guest   vmx-14                                                                                                                               
2018-11-25T18:00:10|  9      Mailserver   [DATA] Mailserver/Mailserver.vmx   ubuntu64Guest     vmx-07    Ubuntu 16.04 Server VA with NAKIVO Backup and Replication Transporter 8.0 preinstalledVA login: rootVA password: QExS-6b%3D
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:11|  VMs to backup:
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:11|  8      mailsrv12    [DATA] mailsrv12/mailsrv12.vmx     debian8_64Guest   vmx-14                                                                                                                               
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:13|  Needed room: 1779 Gb.
2018-11-25T18:00:13|  Sparse size: 1779 Gb.
2018-11-25T18:00:13|  Available room: 213 Gb.
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:13|  Not enough room to make the backup, some older folders will be deleted
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:14|  [mailsrv12] Starting backup (size is 1822070M on 1822070M file)
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:14|  XSIBackup will backup your VMs while they are running and will quiesce guest services too, so that users
2018-11-25T18:00:14|  can continue to use the VM while the backup is taking place. You can also run cold and warm --backup-how
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:14|  Stopping VM [mailsrv12]
---------------------------------------------------------------------------------------------------------------------------------
Powering off VM:
2018-11-25T18:00:15|  VMware Tools are not present or outdated in VM: [mailsrv12], power-off issued
2018-11-25T18:00:45|  Sleeping :-o 30 s, waiting for VM to be off
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:47|  [mailsrv12] info: boot partition is EFI
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:47|  [mailsrv12] Info: attempting to free 1834358 mb at [ /vmfs/volumes/DATA ]
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:51|  Removing snapshots, please wait...
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:00:52|  Syncronizing config files
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:01:23|  [mailsrv12] info: VMWare tools were not detected, the system will not be quiesced
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:01:27|  [mailsrv12] info: bringing VM up again
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:01:28|  Backing up virtual disks...
---------------------------------------------------------------------------------------------------------------------------------
2018-11-25T18:01:28|  scsi0:0.fileName = "mailsrv12.vmdk"
---------------------------------------------------------------------------------------------------------------------------------
Destination disk format: VMFS thin-provisioned
Cloning disk '/vmfs/volumes/DATA/mailsrv12/mailsrv12.vmdk'...

Clone: 10% done.
Clone: 11% done.
....
Clone: 99% done.
Clone: 100% done.
---------------------------------------------------------------------------------------------------------------------------------
2018-11-26T09:18:04|  [mailsrv12] Disk copied to /vmfs/volumes/DATA/Backup/20181100000000/mailsrv12/mailsrv12.vmdk
---------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
|                  Backup certification is not available in XSIBACKUP-FREE                 |
|                          Get XSIBACKUP-PRO at https://33hops.com                          |
--------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------
|              Backup of ESXi configuration is not available in XSIBACKUP-FREE             |
|                          Get XSIBACKUP-PRO at https://33hops.com                          |
--------------------------------------------------------------------------------------------

2018-11-26T09:20:38|  Errors detected in backup, check logs
---------------------------------------------------------------------------------------------------------------------------------
Using stored SMTP server info...
Found conf/smtpsrvs file...
[0;31mError: cannot determine the e-mail server credentials, each smtpsrvs entry requires seven fields, please check syntax[0m

Offline

#10 2018-11-26 19:36:21

admin
Administrator
Registered: 2017-04-21
Posts: 2,055

Re: New CRON Jobs Process late comparing to Old

Well, it didn't take 24 h. it took 15 h. 20 mins. aproximately which is about 27 mb./s, not a record speed, but if the server is under load while the backup is taking place, then it's not a big surprise.

Backing up 1,5 tb of data on a production server is not a trivial task, you should consider dedicating some hardware resources to the backup process to improve those figures, like using a dedicated NIC connected to a dedicated NAS, all with Intel NICs and professional switch or direct cable. Needless to say when you handle that amount of data 10 gb NICs are something to think about.

Offline

#11 2018-11-27 04:53:52

itservice614
Member
Registered: 2018-10-01
Posts: 37

Re: New CRON Jobs Process late comparing to Old

Thanks, but there is nothing running on this ESXI server, except email server, even that will be switched off and do xsibackup.
Secondly if you see the Path, im doing backup locally.

--backup-point=/vmfs/volumes/DATA/Backup/$( date +%Y%m'00000000' ) \

Is there any thing i can do in following job config to backup more faster

"/vmfs/volumes/datastore1/xsi-dir/xsibackup" \
--certify-backup=yes \
--backup-point=/vmfs/volumes/DATA/Backup/$( date +%Y%m'00000000' ) \
--backup-type=Custom \
--backup-vms="mailsrv12" \
--backup-how=warm \
--use-smtp=1 \
--backup-room=1500 \
--mail-to=itservice614@gmail.com \
--backup-id=001 \
--description="MAILSRV BACKUP" \
--exec=yes >> "/vmfs/volumes/datastore1/xsi-dir/var/logs/xsibackup.log"

Offline

#12 2018-11-27 09:09:18

admin
Administrator
Registered: 2017-04-21
Posts: 2,055

Re: New CRON Jobs Process late comparing to Old

What do you mean by "will be switched off"?.
Is the e-mail server actually stopped to make the backup?
A local path means nothing in ESXi, it could be pointing to an NFS or iSCSI device over a network. We asked you to post the output of df -h command but you didn't do it. We cannot help you if you don't provide the information we ask for.

As stated, XSIBackup is as fast as your hardware is. If you run the above backup job in a quiet server and you get 27 mb/s, then that means that's what your hardware can offer.

Offline

#13 2018-11-27 09:23:50

itservice614
Member
Registered: 2018-10-01
Posts: 37

Re: New CRON Jobs Process late comparing to Old

What do you mean by "will be switched off"?.
Is the e-mail server actually stopped to make the backup?

NO...because i given --backup-how=warm \   so it should not switch off until i give cold

I always do backups into Local Drive. --backup-point=/vmfs/volumes/DATA/Backup/

Below is DF -H


[root@sales-exe100:~] df -h
Filesystem   Size               Used       Available   Use%          Mounted on
VMFS-6       271.8G          1.4G        270.3G     1%             /vmfs/volumes/datastore1
VMFS-6       3.3T              3.1T        211.8G     94%           /vmfs/volumes/DATA
vfat            249.7M          8.0K        249.7M     0%            /vmfs/volumes/a989a971-44002dfd-e038-05185a8c2feb
vfat            249.7M         141.2M    108.6M      57%          /vmfs/volumes/65848375-90899f6d-ff7d-5a85e09970bc
vfat            4.0G             19.0M      4.0G         0%            /vmfs/volumes/5b9e3002-3943ae25-c8a4-5820b10bcf4e
vfat            285.8M         209.1M     76.8M      73%          /vmfs/volumes/5b9e2ff7-5d877790-d2fc-5820b10bcf4e
[root@sales-exe100:~]

Offline

#14 2018-11-27 09:50:51

admin
Administrator
Registered: 2017-04-21
Posts: 2,055

Re: New CRON Jobs Process late comparing to Old

Then why do you say "but there is nothing running on this ESXI server", do you think an e-mail server running is something trivial?
You are missing some critical facts in this issue, please think about what elements you have into play and how they interact.

Offline

#15 2018-11-27 09:58:21

itservice614
Member
Registered: 2018-10-01
Posts: 37

Re: New CRON Jobs Process late comparing to Old

Its simple..earlier when i use cold backup it was not doing backup. But now im doing backup by WARM
Please note i always do backup into local path.

Now I sent you DF-H


is there any option to make more faster backup by adding or removing any parameters into below job

"/vmfs/volumes/datastore1/xsi-dir/xsibackup" \
--certify-backup=yes \
--backup-point=/vmfs/volumes/DATA/Backup/$( date +%Y%m'00000000' ) \
--backup-type=Custom \
--backup-vms="mailsrv12" \
--backup-how=warm \
--use-smtp=1 \
--backup-room=1500 \
--mail-to=itservice614@gmail.com \
--backup-id=001 \
--description="MAILSRV BACKUP" \
--exec=yes >> "/vmfs/volumes/datastore1/xsi-dir/var/logs/xsibackup.log"

Offline

#16 2018-12-05 05:25:18

itservice614
Member
Registered: 2018-10-01
Posts: 37

Re: New CRON Jobs Process late comparing to Old

Hello Im waiting for reply for above.

Offline

#17 2018-12-05 13:00:07

admin
Administrator
Registered: 2017-04-21
Posts: 2,055

Re: New CRON Jobs Process late comparing to Old

We are sorry, but we believe nobody can help you but yourself.
A warm backup being slower than a cold one when run on an ESXi server that hosts an e-mail server is not an issue.
You need to think about what you are doing, how your server works and how your resources are being used.

A warm backup switches off the VM takes a snapshot and then switches the VM back on again while the backup is taking place, while a cold backup leaves the VM off while the backup is running. This is clearly stated in the Man Page and related posts. If you do not comprehend the difference, then there's nothing we can do for you.

Offline

#18 2018-12-05 13:10:51

itservice614
Member
Registered: 2018-10-01
Posts: 37

Re: New CRON Jobs Process late comparing to Old

I Agree what you say, that why i wanted to make sure the configuration is okay.

I will try for cold backup and try

Offline

#19 2018-12-06 09:08:33

itservice614
Member
Registered: 2018-10-01
Posts: 37

Re: New CRON Jobs Process late comparing to Old

Below is the Result for Default Warn Backup




Done warm backup (id: 001) using vmkfstools (no compression)
The backup room has been limited to 1500 Gb.
Available room in device /vmfs/volumes/DATA/Backup/20181200000000 before backup: 210 Gb.
Sparse size on disk of the selected virtual machines: 1779 Gb.
Needed room in device /vmfs/volumes/DATA/Backup/20181200000000 for backup: 1779 Gb.
(Id)VM Name
(8) mailsrv12
The eldest folders were deleted to make room:
Error MKROOM01: cannot make 1791G of room, only 225G can be made available
Last error raised for the above VM:
ERROR CLDELSN3, details: [mailsrv12] error: cannot delete snapshot, details: Skipping invalid VM '4' Skipping invalid VM '4'
Available space in device /vmfs/volumes/DATA/Backup/20181200000000 after backup: 210 Gb.
Complete backup elapsed time: 214 min
Backup of ESXi configuration is not available in XSIBACKUP-FREE
Get XSIBACKUP-PRO at https://33hops.com
USE DISCOUNT COUPON XSIDREWYI
• [ Wed Dec 5 18:00:56 UTC 2018 ] ERROR (MKROOM01), details Error: cannot make 1791G of room, only 225G can be made available

• [ Wed Dec 5 21:34:03 UTC 2018 ] ERROR (CLVMKFS1), details [mailsrv12] error: vmkfstools error, details: Failed to clone disk: There is not enough space on the file system for the selected operation (13).

• [ Wed Dec 5 21:34:49 UTC 2018 ] ERROR (CLDELSN3), details [mailsrv12] error: cannot delete snapshot, details: Skipping invalid VM '4'
• Skipping invalid VM '4'

Offline

#20 2018-12-06 14:38:01

admin
Administrator
Registered: 2017-04-21
Posts: 2,055

Re: New CRON Jobs Process late comparing to Old

You have a lot of errors in your log.

[mailsrv12] error: cannot delete snapshot, details: Skipping invalid VM '4' Skipping invalid VM '4'

There are some registered VMs which do not exist on disk any more.
You need to have an ESXi in good working condition before you even attempt to perform a backup.
Please, fix your server and try again.

Offline

#21 2018-12-09 14:05:31

itservice614
Member
Registered: 2018-10-01
Posts: 37

Re: New CRON Jobs Process late comparing to Old

Thanks for your reply.

But this VM is running fine, its available on our ESXI Server, im not understanding what is really going wrong, i did not get this errors in Esxi Server V6.5 with XSIBACKUP 10, after ESXI 6.7 release and XSIBACKUP 11 release, since then or not sure, what is wrong.

I really wanted to get this working without errors, like i said...[mailsrv12]  is running into my ESXI Server for which i wanted to take backup.
I dont wanted the SNAPSHOT to be done from your backup. I wanted to delete snapshot and start your backup.

How can i make it work, same way im getting error on File Server.


Appreciate if you can help me out of this to handover my job.

FIRST DF -H

Filesystem   Size           Used      Available   Use%   Mounted on
VMFS-6       271.8G       1.4G      270.3G     1%       /vmfs/volumes/datastore1
VMFS-6       3.3T           2.7T      601.7G     82%     /vmfs/volumes/DATA
vfat           249.7M        8.0K      249.7M     0%      /vmfs/volumes/a989a971-44002dfd-e038-05185a8c2feb
vfat           249.7M       141.2M    108.6M    57%    /vmfs/volumes/65848375-90899f6d-ff7d-5a85e09970bc
vfat         4.0G             13.9M      4.0G       0%      /vmfs/volumes/5b9e3002-3943ae25-c8a4-5820b10bcf4e
vfat       285.8M           209.1M     76.8M     73%   /vmfs/volumes/5b9e2ff7-5d877790-d2fc-5820b10bcf4e



BUT WHAT I WANTED TO DELETE THE OLDER BACKUP AND MAKE ROOM FOR 1 BACKUP AS ONLY 1 DAY BACKUP CAN BE POSSIBLE HERE, BUT NOT 2 DAYS BACKUP, FOR WHICH I NEED TO INCREASE MY HDD SPACE.

But i done the backup by JOB 001   (IS THIS CORRECT)


"/vmfs/volumes/datastore1/xsi-dir/xsibackup" \
--backup-point=/vmfs/volumes/DATA/Backup/ \
--backup-type=Custom \
--backup-vms="mailsrv12" \
--backup-how=Hot \
--use-smtp=1 \
--backup-room=2000 \
--mail-to=shah55589@gmail.com \
--backup-id=001 \
--description="MAILSRV BACKUP" \
--exec=yes >> "/vmfs/volumes/datastore1/xsi-dir/var/logs/xsibackup.log"




Looking to below logs its look fines now   

(DOES THE LOG SAYS ALL OKAY, BECAUSE I CAN OPEN SUCCESSFULLY THE VM BY REGISTERING)







2018-12-08T18:00:05|  NOTICE: (c) XSIBackup kills any user launched jobs, make sure you don't overlap manual jobs
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:05|  NOTICE: (c) XSIBackup-Pro 11.1.7 is available to download
---------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------------------------------------------------------
Backup Id:                  001                       Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:06|  Backup description: task mailsrv backup
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:06|  Message: crontab is installed for user root
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:08|  ADVICE: no SSD disks, please consider adding an SSD cache disk to improve performance
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:08|  Backup user is: root
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:09|  --backup-point found at /vmfs/volumes/DATA/Backup (filesystem: VMFS-6)
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:09|  The backup room has been limited to 2000 gb.
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:09|  Getting list of all VMs...
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:09|  8      mailsrv12   [DATA] mailsrv12/mailsrv12.vmx   debian8_64Guest   vmx-14             
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:10|  VMs to backup:
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:10|  8      mailsrv12   [DATA] mailsrv12/mailsrv12.vmx   debian8_64Guest   vmx-14             
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:12|  Needed room: 1779 Gb.
2018-12-08T18:00:12|  Sparse size: 1779 Gb.
2018-12-08T18:00:12|  Available room: 601 Gb.
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:12|  Not enough room to make the backup, some older folders will be deleted
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:13|  [mailsrv12] Starting backup (size is 1822070M on 1822070M file)
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:13|  XSIBackup will backup your VMs while they are running and will quiesce guest services too, so that users
2018-12-08T18:00:13|  can continue to use the VM while the backup is taking place. You can also run cold and warm --backup-how
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:13|  Hot backup selected for VM: [mailsrv12], will not be switched off
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:14|  [mailsrv12] info: boot partition is EFI
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:14|  [mailsrv12] Info: attempting to free 1834358 mb at [ /vmfs/volumes/DATA ]
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:19|  Removing snapshots, please wait...
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:20|  Error CLDELSN1: cannot delete snapshot VM Id: 8, details: Skipping invalid VM '4'
2018-12-08T18:00:20|  Skipping invalid VM '4'
2018-12-08T18:00:20|  Syncronizing config files
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:53|  [mailsrv12] info: VMWare tools were not detected, the system will not be quiesced
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:57|  Backing up virtual disks...
---------------------------------------------------------------------------------------------------------------------------------
2018-12-08T18:00:57|  scsi0:0.fileName = "mailsrv12.vmdk"
---------------------------------------------------------------------------------------------------------------------------------
Destination disk format: VMFS thin-provisioned
Cloning disk '/vmfs/volumes/DATA/mailsrv12/mailsrv12.vmdk'...

Clone: 10% done.
Clone: 11% done.
...
Clone: 99% done.
Clone: 100% done.
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T09:33:50|  [mailsrv12] Disk copied to /vmfs/volumes/DATA/Backup/mailsrv12/mailsrv12.vmdk
---------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
|              Backup of ESXi configuration is not available in XSIBACKUP-FREE             |
|                          Get XSIBACKUP-PRO at https://33hops.com                          |
--------------------------------------------------------------------------------------------

2018-12-09T09:36:48|  Errors detected in backup, check logs
---------------------------------------------------------------------------------------------------------------------------------

Offline

#22 2018-12-10 09:38:27

itservice614
Member
Registered: 2018-10-01
Posts: 37

Re: New CRON Jobs Process late comparing to Old

Hello,

Im only having problem with snapshot, i dont want the snapshot to be worked or is it mandatory.

Because now im getting errors as below


Backup Id:                  001                       Intel(R) Xeon(R) CPU E5-2609 v3 @ 1.90GHz
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:07|  Backup description: mailsrv backup
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:07|  Message: crontab is installed for user root
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:09|  ADVICE: no SSD disks, please consider adding an SSD cache disk to improve performance
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:09|  Backup user is: root
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:09|  --backup-point found at /vmfs/volumes/DATA/Backup (filesystem: VMFS-6)
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:09|  The backup room has been limited to 2000 gb.
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:10|  Getting list of all VMs...
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:10|  8      mailsrv12   [DATA] mailsrv12/mailsrv12.vmx   debian8_64Guest   vmx-14             
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:11|  VMs to backup:
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:11|  8      mailsrv12   [DATA] mailsrv12/mailsrv12.vmx   debian8_64Guest   vmx-14             
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:12|  Needed room: 1779 Gb.
2018-12-09T18:00:12|  Sparse size: 1779 Gb.
2018-12-09T18:00:12|  Available room: 601 Gb.
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:12|  Not enough room to make the backup, some older folders will be deleted
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:14|  [mailsrv12] Starting backup (size is 1822070M on 1822070M file)
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:14|  XSIBackup will backup your VMs while they are running and will quiesce guest services too, so that users
2018-12-09T18:00:14|  can continue to use the VM while the backup is taking place. You can also run cold and warm --backup-how
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:14|  Hot backup selected for VM: [mailsrv12], will not be switched off
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:15|  [mailsrv12] info: boot partition is EFI
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:15|  [mailsrv12] Info: attempting to free 1834358 mb at [ /vmfs/volumes/DATA ]
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:19|  Removing snapshots, please wait...
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:21|  Error CLDELSN1: cannot delete snapshot VM Id: 8, details: Skipping invalid VM '4'
2018-12-09T18:00:21|  Skipping invalid VM '4'
2018-12-09T18:00:21|  Syncronizing config files
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:23|  [mailsrv12] info: VMWare tools were not detected, the system will not be quiesced
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:27|  Backing up virtual disks...
---------------------------------------------------------------------------------------------------------------------------------
2018-12-09T18:00:27|  scsi0:0.fileName = "mailsrv12.vmdk"
---------------------------------------------------------------------------------------------------------------------------------
Destination disk format: VMFS thin-provisioned
Cloning disk '/vmfs/volumes/DATA/mailsrv12/mailsrv12.vmdk'...

Clone: 10% done.
Clone: 11% done.
Clone: 12% done.
Clone: 13% done.
Clone: 14% done.
Clone: 15% done.
Clone: 16% done.
Clone: 17% done.
Clone: 18% done.
Clone: 19% done.
Clone: 20% done.
Clone: 21% done.
Clone: 22% done.
Clone: 23% done.
Clone: 24% done.
Clone: 25% done.
Clone: 26% done.
Clone: 27% done.
Clone: 28% done.
Clone: 29% done.
Clone: 30% done.
Clone: 31% done.
Clone: 32% done.
Clone: 33% done.
Clone: 34% done.
Clone: 35% done.
Clone: 36% done.
Clone: 37% done.
Clone: 38% done.
Clone: 39% done.
Clone: 40% done.
Clone: 41% done.---------------------------------------------------------------------------------------------------------------------------------
2018-12-10T03:45:04|  [mailsrv12] CLVMKFS1 error: Failed to clone disk: There is not enough space on the file system for the selected operation (13).
---------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
|              Backup of ESXi configuration is not available in XSIBACKUP-FREE             |
|                          Get XSIBACKUP-PRO at https://33hops.com                          |
|                              USE DISCOUNT COUPON: XSIDREWYI                              |
--------------------------------------------------------------------------------------------

2018-12-10T03:46:02|  Errors detected in backup, check logs






TWO THINGS,



2018-12-09T18:00:21|  Error CLDELSN1: cannot delete snapshot VM Id: 8, details: Skipping invalid VM '4'
2018-12-09T18:00:21|  Skipping invalid VM '4'
2018-12-09T18:00:21|  Syncronizing config files

QUESTION : STILL ITS CHECKING SNAPSHOT, CANT WE DISABLED IT, OR IS IT COMPULSARY, I DONT WANT THAT TO INTEREFERE MY BACKUP.



VMWare tools were not detected, the system will not be quiesced

QUESTION : DO I NEED TO INSTALL VMWARE TOOLS INTO DEBIAN, DOES IT HELP.



SINCE THE BACKUP IS GOING FINE, TILL END SUCESSFULLY, ALSO I CAN ABLE TO REGISTER SUCCESSFULLY, I JUST WANTED TO MAKE SURE FINALLY THERE IS NO ERROR. PLEASE LET ME KNOW WHAT BEST I CAN MAKE IT TO RUN WITHOUR ERROR.

Offline

Board footer