Forum ©XSIBackup: ©VMWare ©ESXi Backup Software

lievenmoors

Member

Registered: 2018-11-21

Posts: 28

error using --rotate

Hi,

I'm always getting this error, when Xsibackup tries to prune my backups.
Any idea what's going wrong here?

Also, Xsibackup doesn't report this failure in the email that is sent after finishing the backup.

Thanks for your help.

Greetings,

lieven

Please wait while we order the data at: /vmfs/volumes/59397c00-97c01908-d68f-0cc47a91a3c8/xsi/tmp/0U.xsi
-----------------------------------------------------------------------------------------------------------
sort: out of memory
2020-03-24T10:41:33 | Error code 287 at file prune.c, line 287
Error description: something went wrong when ordering: /vmfs/volumes/59397c00-97c01908-d68f-0cc47a91a3c8/xsi/tmp/0U.xsi, count was: 0

lievenmoors

Member

Registered: 2018-11-21

Posts: 28

Re: error using --rotate

It also seems that everytime this happens, new files are left in /scratch/xsi/tmp.
This is probably the reason my /tmp directory was getting full after a while.

After deleting everything in /scratch/xsi/tmp, I tried to --prune one of the directories,
but I still get the same error.

Because pruning has been failing for quite some time now, I have 24 snapshots in
my xsibackup repository.

admin

Administrator

Registered: 2017-04-21

Posts: 2,057

Re: error using --rotate

You have some little dependencies in the server OS like sort binary. In your case it looks like it's running out of memory

sort: out of memory

:
- What OS are you using as the target server?
- What version is it?
- What is the size of the repository you are trying to prune?

lievenmoors

Member

Registered: 2018-11-21

Posts: 28

Re: error using --rotate

Xsibackup is running on VMware ESXi, and repository is on NFS 4.1 share,
provided by CentOS 8 system. The size of the repository is about 2TB.

lievenmoors

Member

Registered: 2018-11-21

Posts: 28

Re: error using --rotate

When trying to use --prune instead of --rotate, I get a little more output:

./xsibackup --prune /vmfs/volumes/xsibackup/xsibackup_repo/20200218122926
/
|---------------------------------------------------------------------------------|
||-------------------------------------------------------------------------------||
|||   (c)XSIBackup-DC 1.1.1.0: Backup & Replication Software                    |||
|||   (c)33HOPS, Sistemas de Informacion y Redes, S.L. | All Rights Reserved    |||
||-------------------------------------------------------------------------------||
|---------------------------------------------------------------------------------|
                   (c)Daniel J. Garcia Fidalgo | info@33hops.com
|---------------------------------------------------------------------------------|
System Information: ESXi, Kernel 6 Major 0 Minor 0 Patch 0
-----------------------------------------------------------------------------------------------------------
License: unlicensed trial version
-----------------------------------------------------------------------------------------------------------
PID: 1479730, Running job as: root
-----------------------------------------------------------------------------------------------------------
Finding blocks to prune, please wait...
-----------------------------------------------------------------------------------------------------------
Getting map files from repo...
-----------------------------------------------------------------------------------------------------------
Retrieving general block data 100.00%
-----------------------------------------------------------------------------------------------------------
Please wait while we order the data at: /vmfs/volumes/59397c00-97c01908-d68f-0cc47a91a3c8/xsi/tmp/0U.xsi
-----------------------------------------------------------------------------------------------------------
sort: out of memory
2020-04-01T12:23:27 | Error code 287 at file prune.c, line 287
Error description: something went wrong when ordering: /vmfs/volumes/59397c00-97c01908-d68f-0cc47a91a3c8/xsi/tmp/0U.xsi, count was: 0

-----------------------------------------------------------------------------------------------------------
Removed <tmp> dir        OK
-----------------------------------------------------------------------------------------------------------
Removed PID              OK
-----------------------------------------------------------------------------------------------------------

admin

Administrator

Registered: 2017-04-21

Posts: 2,057

Re: error using --rotate

You haven't still provided your backup job. There's very little we can do without knowing all the details, but guessing.

You get the same simple straight message: sort: out of memory
By now (c)XSIBackup-DC depends on sort, in any case you could still be running out of memory if it didn't, so:

- Increase your system's memory.
- Run the backup as a remote IP backup to the CentOS 8.0 box so that the load is shared amoung the two CPUs and memory.
- Use a bigger block size to help the problem, i.e.: 10MB block size will require ten times less memory to prune the same amount of data.
- Don't prune, rotate backups to two or more repositories.