Re: amvault hanging
Orion Poplawski <[email protected]>
| Newsgroups | gmane.comp.archivers.amanda.devel |
|---|---|
| Message-ID | <[email protected]> |
On 05/19/2017 10:31 AM, Jean-Louis Martineau wrote: > On 19/05/17 11:48 AM, Orion Poplawski wrote: >> On 05/19/2017 06:19 AM, Jean-Louis Martineau wrote: >> > Orion, >> > >> > Use attachment to attach the debug files. cut&paste are too much hard to read >> > because the lines wrap. >> > Can you get a stracktrace of all thread using gdb? >> > thread apply all bt >> > >> > Jean-Louis >> >> Another debug log with debug-recovery 9 > Where is it??? Sorry - crazy morning here. Attached now. > What is in the Offsite-01 tape? > Can you do an 'ls -l' of the directory? # ls -l /mnt/amanda/data total 6533399160 -rw-r--r--. 1 amandabackup disk 32768 May 14 00:04 00000.Offsite-01 -rw-------. 1 amandabackup disk 542173661 May 13 03:54 00001.saga._export_backup_eule.0 -rw-------. 1 amandabackup disk 4832222897 May 13 03:56 00002.saga._export_backup_zabbix.0 -rw-------. 1 amandabackup disk 79861703759 May 13 04:26 00003.saga._export_backup_alala.0 -rw-------. 1 amandabackup disk 316660668440 May 13 06:02 00004.csdisk4ib._export_cora2_soldyn_working2.0 -rw-------. 1 amandabackup disk 6288303908968 May 14 00:04 00005.alxdisk1ib._export_clouds.0 -- Orion Poplawski Technical Manager 720-772-5637 NWRA, Boulder/CoRA Office FAX: 303-415-9702 3380 Mitchell Lane [email protected] Boulder, CO 80301 http://www.nwra.com
amvault.20170519093657.debug
(text/plain, 6.7 KB)
Fri May 19 09:36:57.547178799 2017: pid 30156: thd-0x62e400: amvault: pid 30156 ruid 27120 euid 27120 version 3.4.4: start at Fri May 19 09:36:57 2017 Fri May 19 09:36:57.547323199 2017: pid 30156: thd-0x62e400: amvault: Arguments: --exact-match --fulls-only Offsite alxdisk1ib /export/clouds 20170513031353 0 Fri May 19 09:36:57.548352785 2017: pid 30156: thd-0x62e400: amvault: reading config file /etc/amanda/Offsite/amanda.conf Fri May 19 09:36:57.548489540 2017: pid 30156: thd-0x62e400: amvault: reading config file /etc/amanda/Offsite/../vault.conf Fri May 19 09:36:57.548870626 2017: pid 30156: thd-0x62e400: amvault: reading config file /etc/amanda/Offsite/../dumptypes.conf Fri May 19 09:36:57.557043176 2017: pid 30156: thd-0x62e400: amvault: pid 30156 ruid 27120 euid 27120 version 3.4.4: rename at Fri May 19 09:36:57 2017 Fri May 19 09:36:57.565608593 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Vault.pm:218:info:2500001 The amdump log file is '/var/lib/amanda/Offsite/amdump.20170519093657' Fri May 19 09:36:57.565821754 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Vault.pm:224:info:2500000 The trace log file is '/var/lib/amanda/Offsite/log.20170519093657.0' Fri May 19 09:36:57.572364032 2017: pid 30156: thd-0x62e400: amvault: dir_name: /mnt/amanda/data/ Fri May 19 09:36:57.623238731 2017: pid 30156: thd-0x62e400: amvault: chg-disk: Dir /mnt/vault Fri May 19 09:36:57.623270723 2017: pid 30156: thd-0x62e400: amvault: chg-disk: Using statefile '/mnt/vault/state' Fri May 19 09:36:57.630126018 2017: pid 30156: thd-0x62e400: amvault: Amanda::Taper::Scan::traditional stage 1: search for oldest reusable volume Fri May 19 09:36:57.630415808 2017: pid 30156: thd-0x62e400: amvault: Amanda::Taper::Scan::traditional no oldest reusable volume Fri May 19 09:36:57.630570687 2017: pid 30156: thd-0x62e400: amvault: Amanda::Taper::Scan::traditional stage 2: scan for any reusable volume Fri May 19 09:36:57.698111655 2017: pid 30156: thd-0x62e400: amvault: dir_name: /mnt/vault/slot1/ Fri May 19 09:36:57.698880801 2017: pid 30156: thd-0x62e400: amvault: Device file:/mnt/vault/slot1 error = 'File 0 not found' Fri May 19 09:36:57.698924460 2017: pid 30156: thd-0x62e400: amvault: Device file:/mnt/vault/slot1 setting status flag(s): DEVICE_STATUS_VOLUME_UNLABELED Fri May 19 09:36:57.699888637 2017: pid 30156: thd-0x62e400: amvault: Slot 1 without label can be labeled Fri May 19 09:36:57.701143126 2017: pid 30156: thd-0x62e400: amvault: Amanda::Taper::Scan::traditional result: 'OVault-045' on file:/mnt/vault/slot1 slot 1, mode 2 Fri May 19 09:36:57.701821380 2017: pid 30156: thd-0x62e400: amvault: Amanda::Recovery::Clerk: loading volume 'Offsite-01' Fri May 19 09:36:57.702127908 2017: pid 30156: thd-0x62e400: amvault: find_volume labeled 'Offsite-01' Fri May 19 09:36:57.702240090 2017: pid 30156: thd-0x62e400: amvault: parse_inventory: load slot 1 Fri May 19 09:36:57.702407779 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Recovery/Scan.pm:420:info:1200000 slot 1 Fri May 19 09:36:57.702643666 2017: pid 30156: thd-0x62e400: amvault: dir_name: /mnt/amanda/data/ Fri May 19 09:36:57.703573207 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Recovery/Scan.pm:459:info:1200001 Offsite-01 Fri May 19 09:36:57.704494195 2017: pid 30156: thd-0x62e400: amvault: Amanda::Recovery::Clerk: successfully located first part for recovery Fri May 19 09:36:57.704892011 2017: pid 30156: thd-0x62e400: amvault: Amanda::Taper::Scribe preparing to write, part size 0, using LEOM detection (no caching) (splitter) (LEOM supported) Fri May 19 09:36:57.706054467 2017: pid 30156: thd-0x62e400: amvault: Starting <Xfer@0x202c600 (<XferSourceRecovery@0x2056000> -> <XferDestTaperSplitter@0x2057000>)> Fri May 19 09:36:57.706107172 2017: pid 30156: thd-0x62e400: amvault: Final linkage: <XferSourceRecovery@0x2056000> -(PULL_BUFFER)-> <XferElementGlue@0x205b030> -(PUSH_BUFFER)-> <XferDestTaperSplitter@0x2057000> Fri May 19 09:36:57.706123163 2017: pid 30156: thd-0x62e400: amvault: setup_impl: 3, 5 Fri May 19 09:36:57.709504538 2017: pid 30156: thd-0x62e400: amvault: XSR: not using DirectTCP: sending XMSG_READY immediately Fri May 19 09:36:57.709537289 2017: pid 30156: thd-0x62e400: amvault: xfer_queue_message: MSG: <XMsg@0x202bb50 type=XMSG_READY elt=<XferSourceRecovery@0x2056000> version=0> Fri May 19 09:36:57.709617124 2017: pid 30156: thd-0x62e400: amvault: Amanda::Recovery::Clerk: starting recovery Fri May 19 09:36:57.709712227 2017: pid 30156: thd-0x2040850: amvault: pull_and_push Fri May 19 09:36:57.713394394 2017: pid 30156: thd-0x62e400: amvault: Building type TAPESTART header of 32768-32768 bytes with name='OVault-045' disk='' dumplevel=0 and blocksize=32768 Fri May 19 09:37:19.970038253 2017: pid 30156: thd-0x2040800: amvault: Building type FILE header of 32768-32768 bytes with name='alxdisk1ib' disk='/export/clouds' dumplevel=0 and blocksize=32768 Fri May 19 09:37:19.970607938 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Vault.pm:310:info:2500008 0 KB Fri May 19 09:37:19.972476034 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Vault.pm:1177:info:2500016 Reading Offsite-01:5: FILE: date 20170513031353 host alxdisk1ib disk /export/clouds lev 0 comp cust program APPLICATION server_custom_compress /usr/local/bin/pigz-fast Fri May 19 09:37:19.973046944 2017: pid 30156: thd-0x62e400: amvault: Amanda::Recovery::Clerk: reading file 5 on 'Offsite-01' Fri May 19 09:37:31.483216741 2017: pid 30156: thd-0x62e400: amvault: XSR: start_part called Fri May 19 09:40:13.033202150 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Vault.pm:310:info:2500008 0 KB Fri May 19 09:40:14.035330586 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Vault.pm:310:info:2500008 0 KB Fri May 19 09:40:15.037423386 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Vault.pm:310:info:2500008 0 KB Fri May 19 09:40:16.038513395 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Vault.pm:310:info:2500008 0 KB Fri May 19 09:40:17.039770505 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Vault.pm:310:info:2500008 0 KB Fri May 19 09:40:18.041710140 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Vault.pm:310:info:2500008 0 KB Fri May 19 09:40:19.043663091 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Vault.pm:310:info:2500008 0 KB Fri May 19 09:40:20.045462547 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Vault.pm:310:info:2500008 0 KB Fri May 19 09:40:21.047545449 2017: pid 30156: thd-0x62e400: amvault: /usr/lib64/perl5/vendor_perl/Amanda/Vault.pm:310:info:2500008 0 KB