You are not logged in.
Hi, I'm interested in trying this, but how can I get the value for "YOUR_AD_INSTANCE_NAME" ?
Thank you.
Thanks, but I have no ssh access, I can only use the vcd web interface and vcd api, have to check if the api's are powerful enough... Just to know, I successfully tested install of an embedded esxi on VCD, so this could be the second choice, but mainly I would prefer to work with just one level of astraction.
Hi, I'm planning to move my on-premise infrastructure to Cloud Director, available by external cloud provider, I'm rather new to that so there are solutions, that can give me the freedom of use that i currently have with xsibackup suite?
Thanks.
Also, since yuu requested feedback, I launched it again from command line and progress is very inaccurate:
Backup start date: 2020-08-25 13:28:24
-----------------------------------------------------------------------------------------------------------
2020-08-25 13:28:24 | Backing up 15 files, total size is 190.00 GB
-----------------------------------------------------------------------------------------------------------
NUMBER FILE SIZE PROGRESS
-----------------------------------------------------------------------------------------------------------
1/15 .vmx 3.73 KB | Done 0.00%
-----------------------------------------------------------------------------------------------------------
2/15 .vmsd 45.00 B | Done 0.00%
-----------------------------------------------------------------------------------------------------------
3/15 .vmxf 4.26 KB | Done 0.00%
-----------------------------------------------------------------------------------------------------------
4/15 .nvram 8.48 KB | Done 0.00%
-----------------------------------------------------------------------------------------------------------
5/15 -flat.vmdk 40.00 GB | Done 0.00%
-----------------------------------------------------------------------------------------------------------
6/15 .vmdk 524.00 B | Done 21.05%
-----------------------------------------------------------------------------------------------------------
7/15 -flat.vmdk 150.00 GB | Done 21.05%
file 5/15 was 0.00% while copying, 6/15 started from 21.05, lasting same, 7/15 started from 21.05 and after 5 minutes is still at 21.05
Noticed that there there's no more "Details" row with real time progress.
While I'm almost sure that it wasn't any other job running, but I'll check tonight, this is the log. My thought i that the software should had to send the mail, but it didn't.
ssh root@myremotehost 'cd /scratch/XSI/XSIBackup-DC;./xsibackup --replica "VMs(myVM)" root@remoterepo.com:22:/vmfs/volumes/datastore1/bkp --options=L --remote-path=/scratch/XSI/XSIBackup-DC/xsibackup --use-smtp=2 --mail-to=user@somemail.com --subject="subject"' | /scratch/XSI/XSIBackup-DC/ansi2txt > "/vmfs/volumes/datastore1/xsi-dir/var/logs/DCxsibackup.log"
"ansi2txt" is just to strip formatting escape sequences.
Obviously the same command was running previously, before switching to 1.4.0.0, my point is about the mail not the behavior, relaunching from command line it started, but I didn't check previously for the ".locked" file.
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
||| (c)XSIBackup-DC 1.4.0.0: Backup & Replication Software |||
||| (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
(c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 5 Major 5 Minor 0 Patch 0
-----------------------------------------------------------------------------------------------------------
License: purchasedxxxxxxxxxxxxxxxx
-----------------------------------------------------------------------------------------------------------
SSH: Tue Aug 25 13:12:53 UTC 2020
-----------------------------------------------------------------------------------------------------------
Remote system: vmkernel
-----------------------------------------------------------------------------------------------------------
Less Secure Ciphers enabled: arcfour,blowfish-cbc,aes128-ctr
-----------------------------------------------------------------------------------------------------------
PID: 84854724, Running job as: root
-----------------------------------------------------------------------------------------------------------
(c)XSIBackup-DC replicating data to /vmfs/volumes/datastore1/bkp
-----------------------------------------------------------------------------------------------------------
Performing --replica action
-----------------------------------------------------------------------------------------------------------
Item number 1 in this job
-----------------------------------------------------------------------------------------------------------
*** Remote directory is locked ***
-----------------------------------------------------------------------------------------------------------
The remote repository or replication directory is locked
This usually means that there's some process writing data
to it at this moment, or that some process was interrupted
Check for a file named .locked in the root of it and if
you believe it has been left there by some unfinished process,
you may delete it manually to allow new operations
-----------------------------------------------------------------------------------------------------------
2020-08-25T13:13:02 | Error code 2778 at file xsibackup.c, line 2778 | Error description: failed to lock the repo /vmfs/
volumes/datastore1/bkp
-----------------------------------------------------------------------------------------------------------
Removed <tmp> dir OK
-----------------------------------------------------------------------------------------------------------
Unlocked backup OK
-----------------------------------------------------------------------------------------------------------
SSH session was closed OK
-----------------------------------------------------------------------------------------------------------
The download link returns a blank page!
Thank you don't worry for the delay, I'll wait the next official release
Well, while waiting for a reply from 33hops, i found a little C program (compiled from source and copied to esxi) that strips all ansi escapes codes and also the progress indicator from output, so piping xsidc output to the program and the sending to a file i have a clean log to store. Search ansi2txt on sourceforge.
I'm testing DC and, wow, I gained about five hours on a remote backup, I'm interested in purging the log file created redirecting output, so could you explain the verbosity levels ? How can I strip the progress indicator?
Thanks.
nevermind, solved opening new port, now testing real speeds...
Sorry to bother, i'm resuming tests, there an open port (i suppose) in esxi firewall 427 CIM SLP, soi' trying to use it. I started sxidiff in server mode:
bin/xsidiff --source=xx.xx.xx.xx:427 --target=testfile
Listening socket: IP xx.xx.xx.xx, port 427
Receive buffer size 32768
- First question, how i can stop this, the ctrl-c seems not responding, i have to kill process
Starting client side:
./xsidiff --source=/vmfs/volumes/datastore1/testfile --target=zz.zz.zz.zz:427
Meta-data available, zero aware copy
Reading from file /vmfs/volumes/datastore1/bkp/zfs1/zfs2-flat.vmdk
Writing to socket, block size 16384
Connected to socket 5
Error writing struct info to SOCKET 5Set input file offset to 0 bytes
Error writing struct offset_out position 0
Error writing struct offset_out position 5242880
Error writing struct offset_out position 115343360
... same errors with different numbers
Error writing struct offset_out position 21473787904
100.00% done
Time taken: 87 seconds
Speed 105.55 mb/s
Overall speed 235.40 mb/s
Destination file is zero byte, what's wrong? How can i test if the ports are reachable on both sides?
Thanks a lot.
I would like to test it, the examples refer to port 33 which is closed, I have to open adding a firewall service or there is another pen port that I can use? Esxi 5.5.0
thanks
You used xsitools, that is a deduplication engine, so the .vmdk contains just the "indexes" to the data chunks, you ave to restore the vm prior to be runnable
Thank you for the reply, I think my bottleneck is the public internet, I tried DC to test performances, but I had some unexpected errors that stopped the trial. I'll try again with the latest version, when possible.
In a remote backup scenario, I have hostA that runs an xsitools job on remote (cloud hosted) hostB.
Which host is computing hash for every 50MB chunk?
Assuming a hostB theoretical throghput of 100 mb/s and hostA with about 80 mb/s, reducing chunk size could speed up the whole operations?
Thanks.
We are finishing the test phase of a new product: XSIBackup-Datacenter, which has been programmed in C+Assembly, it will be much more powerful than XSIBackup-Pro, both in terms of compression ratio and backup and replication speed, while keeping the same XSIBackup principles. All Pro users will have an upgrade path which will deduce the amount they paid for their Pro versions.
COOL! Waiting for it, time and size are my worst enemies!
For PRO users that can't revert ESXi and use remote backups, in addition to the workaround suggested in the bug tracker post, change the file <xsi-dir>/src/pro/host at the line 47 from
XSISTUFF="xsibackup$newline"
to
XSISTUFF=""
so the auto update fase will not override the xsibackup script that must to be modified on the remote hosts affected by the busybox bug.
it seems related to special chars like "&", "(", ")", I tried escaping some lines and the scripts runs just until next unescaped char. Very ugly shell bug, or perhaps just a config option to set...
I have PRO and the error is at line 605, while building debuginfo string
If it could enhance the overall process, I found an alternative to openssl hashing that is very fast. I know that the bottleneck is the storage, but in some scenarios could speed up the block checks. I tested in esxi 5 and 6 and it is working, has to be compiled statically on linux.
Crontab guru says “At every minute past hour 23 on Monday, Tuesday, Wednesday, Thursday, and Friday.” The crontab line should be
0 23 * * 1,2,3,4,5 "/vmfs/volumes/datastore1/xsi-dir/jobs/041"
There's no scheduled job, the xsibackup instance that deletes the .ERR log files is launched from the scheduled system crontab, and also if it 's not time to fire the backup, the .ERR files are unconditionally deleted! You moved the "create_errfile" call in the wrong position in the latest version (10.3.4 PRO)
When the behaviour was changed? I used 10.2.9 for months without changes on xsibackup-cron file, yesterday I switched to 10.3.4 and chained jobs weren't fired.
Anyway, I have to change --on-success="backupId->AR2ZF" with --on-success="backupId-\>AR2ZF" ?
xsibackup-cron file has several jobs scheduled in the night, the system cron launch it every minute, right?
When in the mornig I launch manually a job, the xsibackup launched from cron deletes the the .ERR file of the current interactive backup, to prove it i modified xsibackup adding the launch type in the .ERR file name (user, cron), the the file is not deleted sue to the different launch type and the errors found during that backup are correctly sent by email.
Dont'know if it can be the correct solution...