Re: Amanda 3.5.1 - "ERROR: amcheck-device terminated with signal 11"

Chris Hoogendyk <[email protected]> Tue, 13 Oct 2020 15:08:43 -0400
Newsgroups	gmane.comp.archivers.amanda.user
Message-ID	<[email protected]>
Patched.

    amanda@marlin:~/daily$ amcheck -s -otaperscan=taper_lexical daily

        Amanda Tape Server Host Check
        -----------------------------
        NOTE: Holding disk '/amanda3': 449998848 KB disk space available, using 345141248 KB
        NOTE: Holding disk '/amanda4': 3026923520 KB disk space available, using 2922065920 KB
        NOTE: Holding disk '/amanda5': 104857600 KB disk space available, using 0 KB
        ERROR: amcheck-device terminated with signal 11
        Server check took 1.883 seconds
        (brought to you by Amanda 3.5.1)

    amanda@marlin:~/daily$


End of /tmp/amanda/server/daily/amcheck-device.20201013150303.debug

    Tue Oct 13 15:03:04.314561876 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 33:Full :VolumeTag=000036L7
    Tue Oct 13 15:03:04.314617462 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 34:Full :VolumeTag=000037L7
    Tue Oct 13 15:03:04.314665487 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 35:Full :VolumeTag=000038L7
    Tue Oct 13 15:03:04.314711679 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 36:Full :VolumeTag=000039L7
    Tue Oct 13 15:03:04.314757827 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 37:Full :VolumeTag=000040L7
    Tue Oct 13 15:03:04.314803076 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 38:Full :VolumeTag=000041L7
    Tue Oct 13 15:03:04.314848723 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 39:Full :VolumeTag=000042L7
    Tue Oct 13 15:03:04.314890084 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 40:Empty
    Tue Oct 13 15:03:04.314928126 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 41:Empty
    Tue Oct 13 15:03:04.314965283 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 42:Empty
    Tue Oct 13 15:03:04.315007303 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 43:Full :VolumeTag=000043L7
    Tue Oct 13 15:03:04.315050910 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 44:Empty
    Tue Oct 13 15:03:04.315092078 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 45:Empty
    Tue Oct 13 15:03:04.315129499 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 46:Empty
    Tue Oct 13 15:03:04.315171329 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 47:Full :VolumeTag=CLN001CU
    Tue Oct 13 15:03:04.315218349 2020: pid 10777: thd-0x2688800: amcheck-device: mtx:Â Â Â Â Â Â  Storage
    Element 48:Full :VolumeTag=CLN002CU
    Tue Oct 13 15:03:04.315378917 2020: pid 10777: thd-0x2688800: amcheck-device: NEO200x48:
    updating state
    Tue Oct 13 15:03:04.322889915 2020: pid 10777: thd-0x2688800: amcheck-device: slot: 0Â  label:
    Bio-Research-013ds: 0
    Tue Oct 13 15:03:04.324824228 2020: pid 10777: thd-0x2688800: amcheck-device: slot: 1Â  label:
    Bio-Research-003ds: 0
    Tue Oct 13 15:03:04.324975904 2020: pid 10777: thd-0x2688800: amcheck-device: slot: 2Â  label:
    Bio-Research-004ds: 0
    Tue Oct 13 15:03:04.325194015 2020: pid 10777: thd-0x2688800: amcheck-device: slot: 3Â  label:
    Bio-Research-005ds: 0
    Tue Oct 13 15:03:04.325323140 2020: pid 10777: thd-0x2688800: amcheck-device: slot: 4Â  label:
    Bio-Research-006ds: 0
    Tue Oct 13 15:03:04.325481141 2020: pid 10777: thd-0x2688800: amcheck-device: slot: 5Â  label:
    Bio-Research-007ds: 0
    Tue Oct 13 15:03:04.325672484 2020: pid 10777: thd-0x2688800: amcheck-device: slot: 6Â  label:
    Bio-Research-008ds: 0
    Tue Oct 13 15:03:04.325764902 2020: pid 10777: thd-0x2688800: amcheck-device: slot: 7Â  label:
    Bio-Research-009ds: 0
    Tue Oct 13 15:03:04.325915539 2020: pid 10777: thd-0x2688800: amcheck-device: warning: Use of
    uninitialized value in concatenation (.) or string at
    /usr/local/share/perl/5.22.1/Amanda/Taper/Scan/lexical.pm line 102.
    Tue Oct 13 15:03:04.325943596 2020: pid 10777: thd-0x2688800: amcheck-device: slot: 8Â  label:
    Bio-Research-010ds:
    Tue Oct 13 15:03:04.326044285 2020: pid 10777: thd-0x2688800: amcheck-device:
    volume_is_labelable start: label: Bio-Research-010 barcode: 000010L7
    Tue Oct 13 15:03:04.326096109 2020: pid 10777: thd-0x2688800: amcheck-device: warning: Use of
    uninitialized value in concatenation (.) or string at
    /usr/local/share/perl/5.22.1/Amanda/Taper/Scan/lexical.pm line 102.
    Tue Oct 13 15:03:04.326128079 2020: pid 10777: thd-0x2688800: amcheck-device: slot: 9Â  label:
    Bio-Research-011ds:
    Tue Oct 13 15:03:04.326151100 2020: pid 10777: thd-0x2688800: amcheck-device:
    volume_is_labelable start: label: Bio-Research-011 barcode: 000011L7
    Tue Oct 13 15:03:04.326172195 2020: pid 10777: thd-0x2688800: amcheck-device: slot: 10Â  label:
    Bio-Research-012ds: 0
    Tue Oct 13 15:03:04.326249834 2020: pid 10777: thd-0x2688800: amcheck-device: slot: 11Â  label:
    Bio-Research-028ds: 0
    Tue Oct 13 15:03:04.326338664 2020: pid 10777: thd-0x2688800: amcheck-device: warning: Use of
    uninitialized value in concatenation (.) or string at
    /usr/local/share/perl/5.22.1/Amanda/Taper/Scan/lexical.pm line 102.
    Tue Oct 13 15:03:04.326360737 2020: pid 10777: thd-0x2688800: amcheck-device: slot: 12Â  label: ds: 0
    Tue Oct 13 15:03:04.326400287 2020: pid 10777: thd-0x2688800: amcheck-device: warning: Use of
    uninitialized value $label in concatenation (.) or string at
    /usr/local/share/perl/5.22.1/Amanda/ScanInventory.pm line 687.
    Tue Oct 13 15:03:04.326421243 2020: pid 10777: thd-0x2688800: amcheck-device:
    volume_is_labelable start: label:Â  barcode: 000029L7
    Tue Oct 13 15:03:04.326444683 2020: pid 10777: thd-0x2688800: amcheck-device:
    volume_is_labelable pre-matchlabel call


On 10/13/20 1:16 AM, Nathan Stratton Treadway wrote:
> On Mon, Oct 12, 2020 at 22:22:45 -0400, Chris Hoogendyk wrote:
>>     Mon Oct 12 22:16:21.857347044 2020: pid 23996: thd-0x25c0800: amcheck-device: slot: 9Â  label:
>>     Bio-Research-011ds:
>>     Mon Oct 12 22:16:21.857380544 2020: pid 23996: thd-0x25c0800: amcheck-device: slot: 10Â  label:
>>     Bio-Research-012ds: 0
>>     Mon Oct 12 22:16:21.857471810 2020: pid 23996: thd-0x25c0800: amcheck-device: slot: 11Â  label:
>>     Bio-Research-028ds: 0
>>     Mon Oct 12 22:16:21.857580226 2020: pid 23996: thd-0x25c0800: amcheck-device: warning: Use of
>>     uninitialized value in concatenation (.) or string at
>>     /usr/local/share/perl/5.22.1/Amanda/Taper/Scan/lexical.pm line 102.
>>     Mon Oct 12 22:16:21.857607369 2020: pid 23996: thd-0x25c0800: amcheck-device: slot: 12Â  label: ds: 0
> Progress!
>
> This shows that the crash happens during processing of slot 12.
>
> (Looking back through the output of "amtape inventory" you sent, it
> appears that this slot contains a tape with barcode 000029L7.)
>
>
> An interesting thing to note is that the *label* variable for that slot is
> uninitialized -- perhaps that's what is causing the crash?
>
> To test that theory a bit, I've attached another patch to try.
> Unfortunately this one is in a file used by the oldest.pm algorithm,
> too, so you'll probably want to revert the file back to the original as
> soon as you've finished teating, to make sure that the patched version
> doesn't affect an actual amanda run.
>
> So, basically save a copy of the original
>     /usr/local/share/perl/5.22.1/Amanda/ScanInventory.pm
> file, then apply the patch attached to this email in-place to that file,
> and run the
>    amcheck -s -otaperscan=taper_lexical daily
> test again.  (I don't expect this patch to prevent the crash, but
> hopefully the new log messages will narrow down exactly where it is crashing.)
>
> 								Nathan
>
>
> ----------------------------------------------------------------------------
> Nathan Stratton Treadway  -  [email protected]  -  Mid-Atlantic region
> Ray Ontko & Co.  -  Software consulting services  -   http://www.ontko.com/
>   GPG Key: http://www.ontko.com/~nathanst/gpg_key.txt   ID: 1023D/ECFB6239
>   Key fingerprint = 6AD8 485E 20B9 5C71 231C  0C32 15F3 ADCD ECFB 6239

-- 
---------------

Chris Hoogendyk

-
    O__  ---- Systems Administrator, Retired
   c/ /'_ --- Biology & Geosciences Departments
  (*) \(*) -- 315 Morrill Science Center III
~~~~~~~~~~ - University of Massachusetts, Amherst

<[email protected]>

---------------

ErdÃ¶s 4