#1 2021-04-14 15:35:27

ealib
Member
Registered: 2021-04-14
Posts: 21

XSI DC 1.4.3.17: job with --replica --config-backup half works

VMkernel vmhost01.mtka.eu 6.5.0 #1 SMP Release build-17477841 Jan 17 2021 19:24:58 x86_64 x86_64 x86_64 ESXi


In --replica jobs with --config-backup, replication is performed and logged correctly, config backup, instead, is logged, but no directory/file/archive is found in the target path.

Offline

#2 2021-04-14 17:19:07

admin
Administrator
Registered: 2017-04-21
Posts: 1,658

Re: XSI DC 1.4.3.17: job with --replica --config-backup half works

We'll check this. Thank you for your feedback.

Offline

#3 2021-04-18 20:08:32

admin
Administrator
Registered: 2017-04-21
Posts: 1,658

Re: XSI DC 1.4.3.17: job with --replica --config-backup half works

We have checked this feature and it's working fine. The configuration is saved to the cfgbak folder in the same folder as the replica VM directory.

Offline

#4 2021-04-20 12:24:59

ealib
Member
Registered: 2021-04-14
Posts: 21

Re: XSI DC 1.4.3.17: job with --replica --config-backup half works

I created the cfgbak directory and, after last run of xsibackup, at least one replication job created the compressed archive with ESXi configuration data.

Offline

#5 2021-04-20 12:44:19

admin
Administrator
Registered: 2017-04-21
Posts: 1,658

Re: XSI DC 1.4.3.17: job with --replica --config-backup half works

That is weird. That directory should be created automatically. Maybe somehow you asigned full permissions on the replica folder, but not on the relative root. This can happen if you use some other user than root.

Offline

#6 2021-05-11 07:07:14

ealib
Member
Registered: 2021-04-14
Posts: 21

Re: XSI DC 1.4.3.17: job with --replica --config-backup half works

I double checked permissions, but they seem OK.

Replication target path is on a VMFS datastore connected to a multipathed iSCSI target.

Offline

#7 2021-05-11 09:18:22

admin
Administrator
Registered: 2017-04-21
Posts: 1,658

Re: XSI DC 1.4.3.17: job with --replica --config-backup half works

Maybe multipathing is the culprit, not an expert, but some round robin splitting system calls could be an issue. There should be some option for this in the iSCSI client configuration.

Offline

#8 2021-05-14 16:59:09

ealib
Member
Registered: 2021-04-14
Posts: 21

Re: XSI DC 1.4.3.17: job with --replica --config-backup half works

I guess not. We moved PB of VM-related data for years between multiple 2- or 4-pathed iSCSI backed datastores and never lost a byte.

Offline

#9 2021-05-14 18:18:41

admin
Administrator
Registered: 2017-04-21
Posts: 1,658

Re: XSI DC 1.4.3.17: job with --replica --config-backup half works

This issue is not something obscure. It's a simple system call (mkdir) that creates that dir. You can run some job with strace (just prepend 'strace' to it) to detect the exact reason why the system call fails. It will produce a lot of output though, and will be slower.

Are you using some kind of Async option maybe?

Offline

#10 2021-05-14 22:49:48

herrep
Member
From: Munich
Registered: 2019-07-08
Posts: 53

Re: XSI DC 1.4.3.17: job with --replica --config-backup half works

Probably related to this issue?

Offline

#11 2021-05-15 09:52:08

admin
Administrator
Registered: 2017-04-21
Posts: 1,658

Re: XSI DC 1.4.3.17: job with --replica --config-backup half works

As stated, we are talking about a simple atomic mkdir system call, not any complicated set of commands. Strace will offer you all the details on the issue. It could be that some DS in async mode would not create the folder in time for the subsequent commands to be able to copy to it. If that was the case, switching to Sync mode would solve the issue.

We could add a helper to wait until we detect the folder, but that would be misleading, as the rest of the program works in Sync mode. Could be some other thing, we'll keep investigating, we haven't been able to reproduce the issue though.

Offline

#12 2021-05-15 10:07:36

herrep
Member
From: Munich
Registered: 2019-07-08
Posts: 53

Re: XSI DC 1.4.3.17: job with --replica --config-backup half works

Could you give some hints as how to switch to sync mode?

Could you briefly explain why the mentioned helper to wait until the folder is created would be misleading? Besides, the folder does not appear to be created at all - at least at my system, cfgbak is simply not there.  I only succeed when manually creating the folder and restarting the replica operation again.  So I wonder why waiting for the folder to be created would be an option.

Offline

#13 2021-05-15 10:15:28

admin
Administrator
Registered: 2017-04-21
Posts: 1,658

Re: XSI DC 1.4.3.17: job with --replica --config-backup half works

If you can steadily reproduce your error, you should first prepend strace to your job, run it and post at least the end of the output.

strace ./xsibackup --backup ....

Offline

Board footer