Re: did it again. -- crc differ

On Saturday 19 December 2020 09:42:55 Nathan Stratton Treadway wrote:

> On Sat, Dec 19, 2020 at 03:32:07 -0500, Gene Heskett wrote:
> > But the problem is not fixed:
>
> Well, at least this time it's a one-part dump file, so that may make
> investigation at little easier....
>
> > FAILURE DUMP SUMMARY:
> >   rpi4 /usr/lib lev 0  partial taper: source server crc
> > (efe0c707:1538583893) and input server crc (fa79e777:1538583893)
> > differ)
> >   rpi4 /usr/lib lev 0  was successfully retried
> >
> > But the failed dump is still in the holding disk:
> >
> > root@coyote:config-bak$ ls -l /sdb/dumps/20201219020104/
> > total 1502560
> > -rw------- 1 amanda amanda 1538616661 Dec 19 02:13 rpi4._usr_lib.0
> >
> > >From the emailed report:
> >
> >   driver: rpi4 /usr/lib 20201219020104 0 [Will retry dump because of
> > holding disk error: source server crc (efe0c707:1538583893) and
> > input server crc (fa79e777:1538583893) differ)] taper: tape
> > Dailys-24 kb 16495500 fm 79 [OK]
> >
> > and:
> > rpi4  /usr/lib 0 3273 1467  -- 5:23 10366.4  0:01 1502523.0 PARTIAL
> > FLUSH  5:11  4831.3
> >
> > Even the sizes don't match so of course the crc's won't either.
>
> Note that the two sizes mentioned in the error message do match
> (1538583893), so I think the full file is getting transfered.
>
> (The file on the holding disk is 32kiB larger, i.e. the size of the
> Amanda header:  1538616661-1538583893=32768 .)
>
>
> What's the header of that holding-disk file look like? (e.g.
>   $ sudo dd if=/sdb/dumps/20201219020104/rpi4._usr_lib.0 bs=32k
> count=1 )
new error file, from /home on GO704:(word wrap off)

dd if=/sdb/dumps/20201219085654/GO704._home.0 bs=32k count=1

AMANDA: FILE 20201219085654 GO704 /home  lev 0 comp .gz program APPLICATION
APPLICATION=amgtar
ORIGSIZE=7322300
SERVER-CRC=adcf8473:2018270728
DLE=<<ENDDLE
<dle>
  <program>APPLICATION</program>
  <disk>/home</disk>
  <level>0</level>
  <auth>bsdtcp</auth>
  <compress>BEST</compress>
  <record>YES</record>
  <index>YES</index>
  <datapath>AMANDA</datapath>
  <exclude>
    <list>/GenesAmandaHelper-0.61/excludes</list>
  </exclude>
  <backup-program>
    <plugin>amgtar</plugin>
    <property>
      <name>ignore</name>
      <value encoding="raw" raw="OiBzb2NrZXQgaWdub3JlZCQ=">:_socket_ignored$</value>      <value encoding="raw" 
raw="ZmlsZSBjaGFuZ2VkIGFzIHdlIHJlYWQgaXQk">file_changed_as_we_read_it$</value>
    </property>
    <property>
      <name>one-file-system</name>
      <value>yes</value>
    </property>
    <property>
      <name>check-device</name>
      <value>no</value>
    </property>
  </backup-program>
</dle>
ENDDLE
To restore, position tape at start of file and run:
        dd if=<tape> skip=1 | /bin/gzip -dc | /usr/lib/amanda/application/amgtar restore [./file-to-restore]+

That's a different error and that machines background activity may have 
caused apt-get to refresh its list of available updates at about that
time of the morning. That however, should not have affetcted /home.
There was no other commanded activity at the time although I do have 
an ssh session open to all machines from this machine full time, and 
they are all mounted here via sshnet. Beats nfs like a 
white nosed mule since it Just Works.
>
> Do you get any hits when you grep the Amanda debug and log files for
> those two CRC values ( efe0c707 and fa79e777 )?

New crc's

root@coyote:GenesAmandaHelper-0.61$ grep adcf8473:2018270728 /usr/local/var/amanda/Daily/*
/usr/local/var/amanda/Daily/amdump.1:driver: result time 2044.439 from chunker3: DONE 03-00051 
1970967 "adcf8473:2018270728" "[sec 1253.143125 kb 1970967 kps 1572.818747]"
/usr/local/var/amanda/Daily/amdump.1:driver: result time 2045.654 from taper0: PARTIAL worker0-0 02-00088 INPUT-ERROR 
TAPE-GOOD "1452994d:2018270728" "[sec 1.000000 bytes 2018270728 kps 1970967.000000 orig-kb 7322300]" "source server crc 
(1452994d:2018270728) and input server crc (adcf8473:2018270728) differ)" ""
/usr/local/var/amanda/Daily/amdump.1:driver: taper failed GO704 /home: source server crc (1452994d:2018270728) and input 
server crc (adcf8473:2018270728) differ)
/usr/local/var/amanda/Daily/amdump.20201219085654:driver: result time 2044.439 from chunker3: DONE 03-00051 
1970967 "adcf8473:2018270728" "[sec 1253.143125 kb 1970967 kps 1572.818747]"
/usr/local/var/amanda/Daily/amdump.20201219085654:driver: result time 2045.654 from taper0: PARTIAL worker0-0 02-00088 
INPUT-ERROR TAPE-GOOD "1452994d:2018270728" "[sec 1.000000 bytes 2018270728 kps 1970967.000000 orig-kb 7322300]" "source 
server crc (1452994d:2018270728) and input server crc (adcf8473:2018270728) differ)" ""
/usr/local/var/amanda/Daily/amdump.20201219085654:driver: taper failed GO704 /home: source server crc 
(1452994d:2018270728) and input server crc (adcf8473:2018270728) differ)
grep: /usr/local/var/amanda/Daily/curinfo: Is a directory
grep: /usr/local/var/amanda/Daily/gnutar-lists: Is a directory
grep: /usr/local/var/amanda/Daily/index: Is a directory
/usr/local/var/amanda/Daily/log:SUCCESS chunker GO704 /home 20201219085654 0 adcf8473:2018270728 [sec 1253.143125 kb 
1970967 kps 1572.818747]
/usr/local/var/amanda/Daily/log:PARTIAL taper "ST:Daily" "POOL:Daily" GO704 /home 20201219085654 1 0 00000000:0 
00000000:0 adcf8473:2018270728 [sec 1.000000 bytes 2018270728 kps 1970967.000000 orig-kb 7322300] "source server crc 
(1452994d:2018270728) and input server crc (adcf8473:2018270728) differ)"
/usr/local/var/amanda/Daily/log:INFO driver GO704 /home 20201219085654 0 [Will retry dump because of holding disk error: 
source server crc (1452994d:2018270728) and input server crc (adcf8473:2018270728) differ)]
/usr/local/var/amanda/Daily/log.20201219085654.0:SUCCESS chunker GO704 /home 20201219085654 0 adcf8473:2018270728 [sec 
1253.143125 kb 1970967 kps 1572.818747]
/usr/local/var/amanda/Daily/log.20201219085654.0:PARTIAL taper "ST:Daily" "POOL:Daily" GO704 /home 20201219085654 1 0 
00000000:0 00000000:0 adcf8473:2018270728 [sec 1.000000 bytes 2018270728 kps 1970967.000000 orig-kb 7322300] "source 
server crc (1452994d:2018270728) and input server crc (adcf8473:2018270728) differ)"
/usr/local/var/amanda/Daily/log.20201219085654.0:INFO driver GO704 /home 20201219085654 0 [Will retry dump because of 
holding disk error: source server crc (1452994d:2018270728) and input server crc (adcf8473:2018270728) differ)]
grep: /usr/local/var/amanda/Daily/oldlog: Is a directory

Good luck wading thru all THAT!
                                              

Thanks.                         >
> 							Nathan
>
>
>
> ----------------------------------------------------------------------
>------ Nathan Stratton Treadway  -  [email protected]  -  Mid-Atlantic
> region Ray Ontko & Co.  -  Software consulting services  -  
> http://www.ontko.com/ GPG Key:
> http://www.ontko.com/~nathanst/gpg_key.txt   ID: 1023D/ECFB6239 Key
> fingerprint = 6AD8 485E 20B9 5C71 231C  0C32 15F3 ADCD ECFB 6239



Copyright 2019 by Maurice E. Heskett
Cheers, Gene Heskett
-- 
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
If we desire respect for the law, we must first make the law respectable.
 - Louis D. Brandeis
Genes Web page <http://geneslinuxbox.net:6309/gene>