Re: Filling up /var/spool
Joachim Langenbach via Duplicity-talk <[email protected]>
| Newsgroups | gmane.comp.sysutils.backup.duplicity.general |
|---|---|
| Message-ID | <9705727.eNJFYEL58v@laptopjoachim> |
hej sunny,
thanks for your reply!
Am Montag, 27. Mai 2024, 12:40:31 CEST schrieb edgar.soldin--- via Duplicity-
talk:
> hey Joachim,
>
> On 27.05.2024 10:08, Joachim Langenbach via Duplicity-talk wrote:
> > Hello together,
> >
> > we have some backup jobs running on our server. Sometimes a backup jobs
> > fails. And after a certain amount of failes, the /var/spool volume is
> > shown as full. Actually it is not filled really, but the space is
> > occupied by file handles of dead processes. Many of them are duplicity.
> >
> > This is typically the last report before the volume is full:
> >
> > Giving up after 5 attempts. OSError: Quota exceeded
> > 2024-05-08 05:53:49.765 Task 'BKP' failed with exit code '50'.
> > Invalid data - SHA1 hash mismatch for file:
> > duplicity-full.20240508T030756Z.vol1.difftar.gpg
> > Calculated hash: 0724bb31e26b7fe7975f40b4bfefb5913b5b6fe5
> > Manifest hash: ba61cc857e2bbcc4bb9be9b1350589a61562d29c
> > 2024-05-08 05:53:57.250 Task 'VERIFY' failed with exit code '21'.
>
> 'Quota exceeded' is a pretty forward error message.
>
> 1. what are the quotas for that user on that system?
What do you mean? The disk space in /var/spool, useable by the backup user?
That's 16GB.
> 2. can you please post the outputs for
> `cat /proc/sys/fs/file-max`
9223372036854775807
> `ulimit -n`
1024
> ?
>
> also please state your operating system and duplicity version.
Debian Bookworm (12), duplicity version 0.8.22
>
> > Do you have any idea, how to solve this issue? It is ok, that the backup
> > is failing sometime, but there should be no open file handles from dead
> > processes. That's my first priority :-)
> if handles are kept open after duplicity finished or crashed then there
> should still be processes running keeping them open. you may want to check
> your system for lingering gpg processes and simply kill them. that is not
> supposed to happen, but would be the only reason i can imagine that handles
> are kept.
>
> duplicity running out of file descriptors is usually caused by very long
> backup chains with lot's of volumes. could you please post the output of
> `duply status`?
Start duply v2.4.1, time is 2024-05-27 20:23:43.
Using profile '/root/.duply/cloud'.
Using installed duplicity version 0.8.22, python 3.11.2 (/usr/bin/python3.11)
'PYTHONPATH=:/usr/lib/python311.zip:/usr/lib/python3.11:/usr/lib/python3.11/
lib-dynload:/usr/local/lib/python3.11/dist-packages:/usr/lib/python3/dist-
packages', gpg 2.2.40 (Home: /root/.gnupg), awk 'GNU Awk 5.2.1, API 3.2, PMA
Avon 8-g1, (GNU MPFR 4.2.0, GNU MP 6.2.1)', grep 'grep (GNU grep) 3.8', bash
'5.2.15(1)-release (x86_64-pc-linux-gnu)'.
Public key '446DA1C7' found in keychain.
Autoset found secret key of first GPG_KEY entry '446DA1C7' for signing.
Checking TEMP_DIR '/var/spool/duply' is a folder and writable (OK)
Test - Encrypt to '446DA1C7' & Sign with '446DA1C7' (OK)
Test - Decrypt (OK)
Test - Compare (OK)
Cleanup - Delete '/var/spool/duply/duply.110628.1716834224_*'(OK)
--- Start running command STATUS at 2024-05-27 20:23:45.101 ---
Collection Status
-----------------
Connecting with backend: BackendWrapper
Archive dir: /root/.cache/duplicity/duply_cloud
Found 0 secondary backup chains.
Found primary backup chain with matching signature chain:
-------------------------
Chain start time: Sun Jan 28 23:00:02 2024
Chain end time: Sun May 26 23:00:15 2024
Number of contained backup sets: 113
Total number of contained volumes: 2191
Type of backup set: Time: Num volumes:
Full Sun Jan 28 23:00:02 2024 2066
Incremental Sat Feb 3 23:00:11 2024 1
Incremental Sun Feb 4 23:00:21 2024 1
Incremental Mon Feb 5 23:00:13 2024 1
Incremental Tue Feb 6 23:00:15 2024 1
Incremental Wed Feb 7 23:00:12 2024 1
Incremental Thu Feb 8 23:00:12 2024 1
Incremental Fri Feb 9 23:00:12 2024 1
Incremental Sat Feb 10 23:00:11 2024 1
Incremental Sun Feb 11 23:00:12 2024 1
Incremental Mon Feb 12 23:00:12 2024 1
Incremental Tue Feb 13 23:00:11 2024 1
Incremental Wed Feb 14 23:00:12 2024 1
Incremental Thu Feb 15 23:00:12 2024 1
Incremental Fri Feb 16 23:00:12 2024 1
Incremental Sat Feb 17 23:00:14 2024 1
Incremental Sun Feb 18 23:00:11 2024 1
Incremental Mon Feb 19 23:00:16 2024 1
Incremental Tue Feb 20 23:00:12 2024 1
Incremental Wed Feb 21 23:00:11 2024 1
Incremental Thu Feb 22 23:00:11 2024 1
Incremental Fri Feb 23 23:00:15 2024 1
Incremental Sat Feb 24 23:00:11 2024 1
Incremental Sun Feb 25 23:00:15 2024 1
Incremental Mon Feb 26 23:00:13 2024 1
Incremental Tue Feb 27 23:00:13 2024 1
Incremental Wed Feb 28 23:00:12 2024 1
Incremental Thu Feb 29 23:00:14 2024 1
Incremental Fri Mar 1 23:00:12 2024 1
Incremental Sat Mar 2 23:00:20 2024 8
Incremental Sun Mar 3 23:00:12 2024 1
Incremental Mon Mar 4 23:00:13 2024 1
Incremental Tue Mar 5 23:00:14 2024 1
Incremental Wed Mar 6 23:00:26 2024 1
Incremental Thu Mar 7 23:00:12 2024 1
Incremental Fri Mar 8 23:00:17 2024 1
Incremental Sat Mar 9 23:00:12 2024 1
Incremental Sun Mar 10 23:00:12 2024 1
Incremental Mon Mar 11 23:00:16 2024 1
Incremental Tue Mar 12 23:00:12 2024 1
Incremental Wed Mar 13 23:00:13 2024 1
Incremental Thu Mar 14 23:00:13 2024 1
Incremental Fri Mar 15 23:00:15 2024 1
Incremental Sat Mar 16 23:00:12 2024 1
Incremental Sun Mar 17 23:00:19 2024 1
Incremental Mon Mar 18 23:00:12 2024 1
Incremental Tue Mar 19 23:00:17 2024 1
Incremental Wed Mar 20 23:00:12 2024 1
Incremental Thu Mar 21 23:00:15 2024 1
Incremental Fri Mar 22 23:00:19 2024 1
Incremental Sat Mar 23 23:00:16 2024 1
Incremental Sun Mar 24 23:00:29 2024 1
Incremental Mon Mar 25 23:01:30 2024 1
Incremental Tue Mar 26 23:00:24 2024 1
Incremental Thu Mar 28 23:00:15 2024 1
Incremental Fri Mar 29 23:00:11 2024 1
Incremental Sat Mar 30 23:00:13 2024 1
Incremental Sun Mar 31 23:00:12 2024 1
Incremental Mon Apr 1 23:00:13 2024 1
Incremental Tue Apr 2 23:00:13 2024 1
Incremental Wed Apr 3 23:00:13 2024 1
Incremental Thu Apr 4 23:00:12 2024 1
Incremental Fri Apr 5 23:00:14 2024 1
Incremental Sat Apr 6 23:00:11 2024 1
Incremental Sun Apr 7 23:00:15 2024 1
Incremental Mon Apr 8 23:00:13 2024 1
Incremental Tue Apr 9 23:00:18 2024 1
Incremental Wed Apr 10 23:00:13 2024 1
Incremental Thu Apr 11 23:00:13 2024 5
Incremental Fri Apr 12 23:00:15 2024 1
Incremental Sun Apr 14 23:00:16 2024 1
Incremental Mon Apr 15 23:00:13 2024 1
Incremental Tue Apr 16 23:00:12 2024 1
Incremental Wed Apr 17 23:00:13 2024 1
Incremental Thu Apr 18 23:00:12 2024 1
Incremental Fri Apr 19 23:00:17 2024 1
Incremental Sat Apr 20 23:00:14 2024 1
Incremental Sun Apr 21 23:00:13 2024 1
Incremental Mon Apr 22 23:00:13 2024 1
Incremental Tue Apr 23 23:00:17 2024 1
Incremental Wed Apr 24 23:00:13 2024 1
Incremental Thu Apr 25 23:00:18 2024 1
Incremental Fri Apr 26 23:00:13 2024 1
Incremental Sat Apr 27 23:00:16 2024 1
Incremental Sun Apr 28 23:00:14 2024 1
Incremental Mon Apr 29 23:00:16 2024 1
Incremental Tue Apr 30 23:00:14 2024 1
Incremental Wed May 1 23:00:15 2024 1
Incremental Thu May 2 23:00:13 2024 1
Incremental Fri May 3 23:00:15 2024 1
Incremental Sat May 4 23:00:15 2024 1
Incremental Sun May 5 23:00:14 2024 1
Incremental Mon May 6 23:00:12 2024 1
Incremental Tue May 7 23:00:13 2024 1
Incremental Wed May 8 23:00:13 2024 1
Incremental Thu May 9 23:00:43 2024 3
Incremental Fri May 10 23:00:24 2024 1
Incremental Sat May 11 23:00:17 2024 1
Incremental Sun May 12 23:00:36 2024 1
Incremental Mon May 13 23:00:18 2024 1
Incremental Tue May 14 23:00:35 2024 1
Incremental Wed May 15 23:00:24 2024 1
Incremental Thu May 16 23:00:25 2024 1
Incremental Fri May 17 23:00:14 2024 1
Incremental Sat May 18 23:00:16 2024 1
Incremental Sun May 19 23:00:20 2024 1
Incremental Mon May 20 23:00:15 2024 1
Incremental Tue May 21 23:00:21 2024 1
Incremental Wed May 22 23:00:13 2024 1
Incremental Thu May 23 23:00:16 2024 1
Incremental Fri May 24 23:00:15 2024 1
Incremental Sat May 25 23:00:17 2024 1
Incremental Sun May 26 23:00:15 2024 1
-------------------------
No orphaned or incomplete backup sets found.
--- Finished state OK at 2024-05-27 20:23:57.546 - Runtime 00:00:12.444 ---
>
> sunny regards ..ede/duply.net
>
> _______________________________________________
> Duplicity-talk mailing list
> [email protected]
> https://lists.nongnu.org/mailman/listinfo/duplicity-talk
_______________________________________________
Duplicity-talk mailing list
[email protected]
https://lists.nongnu.org/mailman/listinfo/duplicity-talk