Re: kernel: aacraid: Host adapter reset request. SCSI hang ? (

James Bourne <[email protected]> Mon, 23 Jun 2003 21:10:21 -0600 (MDT)
Newsgroups gmane.linux.drivers.aacraid.devel,gmane.linux.hardware.dell.poweredge
Message-ID <[email protected]>
On Sun, 22 Jun 2003, Alan Cox wrote:

> > Alan, I'm going to be grabbing the newer code out of your
> > latest and see how it fairs.  I know it's not stable, this box is *not* in
> > production anyway.
> 
> 
> OK - grab from -ac2 not -ac1 if so. -ac1 will crash if you hot add a volume

OK, still getting timeouts.  I'm attaching a typescript from the
system (includes dmesg) and here's the --changelog from the kernel I'm
running.  I can make the entire patch kit for 2.4.20 available to
anyone who wants it.

Regards
James

bash# rpm -qp --changelog
/usr/src/mrc-redhat/RPMS/i386/kernel-2.4.2012PE26506650-2.i386.rpm 
* Sun Jun 22 2003 James Bourne <[email protected]> 2.4.20-12-PE2650-6650

- Updated to 2.4.21-ac2 aacraid version

* Thu Jun 05 2003 James Bourne <[email protected]> 2.4.20-11-PE2650-6650

- Turned on ip_tables support
- added nethash patch
- Updated to current RH ptrace patch for i386
- Added opengfs kernel patch
- Added aacraid signed int patch

* Mon May 12 2003 James Bourne <[email protected]> 2.4.20-10-PE2650-6650

- Turned on scsi debugging for aacraid problems.

* Mon Mar 17 2003 James Bourne <[email protected]> 2.4.20-9-PE2650-6650

- Added ptrace patch from AC

* Wed Feb 19 2003 James Bourne <[email protected]> 2.4.20-8-PE2650-6650

- Start from clean 2.4.20 sources, add mrc-base (big uid quota), add VFS
  lock patch, add Andrew Mortons 2.4.20 ext3 patches, add irqbalance patch
  then add tg3-1.4c patch for 2.4.20.

-- 
James Bourne, Supervisor Data Centre Operations
Mount Royal College, Calgary, AB, CA
www.mtroyal.ab.ca
typescript (text/plain, 16.5 KB)
Script started on Mon Jun 23 20:59:29 2003
midgarth-st:bash# uname -a
Linux midgarth-st 2.4.20-12-PE2650-6650 #2 SMP Sun Jun 22 14:57:47 MDT 2003 i686 unknown
midgarth-st:bash# dmesg
served twice.
hm, page 000f0000 reserved twice.
On node 0 totalpages: 524272
zone(0): 4096 pages.
zone(1): 225280 pages.
zone(2): 294896 pages.
ACPI: Searched entire block, no RSDP was found.
ACPI: RSDP located at physical address c00fdc60
RSD PTR  v0 [DELL  ]
__va_range(0xfdc74, 0x68): idx=8 mapped at ffff6000
ACPI table found: RSDT v1 [DELL   PE2650   0.1]
__va_range(0xfdca4, 0x24): idx=8 mapped at ffff6000
__va_range(0xfdca4, 0x74): idx=8 mapped at ffff6000
ACPI table found: FACP v1 [DELL   PE2650   0.1]
__va_range(0xfdd18, 0x24): idx=8 mapped at ffff6000
__va_range(0xfdd18, 0x88): idx=8 mapped at ffff6000
ACPI table found: APIC v1 [DELL   PE2650   0.1]
__va_range(0xfdd18, 0x88): idx=8 mapped at ffff6000
LAPIC (acpi_id[0x0001] id[0x0] enabled[1])
CPU 0 (0x0000) enabledProcessor #0 Pentium 4(tm) XEON(tm) APIC version 16

LAPIC (acpi_id[0x0002] id[0x2] enabled[1])
CPU 1 (0x0200) enabledProcessor #2 Pentium 4(tm) XEON(tm) APIC version 16

LAPIC (acpi_id[0x0003] id[0x1] enabled[1])
CPU 2 (0x0100) enabledProcessor #1 Pentium 4(tm) XEON(tm) APIC version 16

LAPIC (acpi_id[0x0004] id[0x3] enabled[1])
CPU 3 (0x0300) enabledProcessor #3 Pentium 4(tm) XEON(tm) APIC version 16

IOAPIC (id[0x4] address[0xfec00000] global_irq_base[0x0])
IOAPIC (id[0x5] address[0xfec01000] global_irq_base[0x10])
IOAPIC (id[0x6] address[0xfec02000] global_irq_base[0x20])
LAPIC_NMI (acpi_id[0x0001] polarity[0x1] trigger[0x1] lint[0x1])
LAPIC_NMI (acpi_id[0x0002] polarity[0x1] trigger[0x1] lint[0x1])
LAPIC_NMI (acpi_id[0x0003] polarity[0x1] trigger[0x1] lint[0x1])
LAPIC_NMI (acpi_id[0x0004] polarity[0x1] trigger[0x1] lint[0x1])
4 CPUs total
Local APIC address fee00000
__va_range(0xfdda0, 0x24): idx=8 mapped at ffff6000
__va_range(0xfdda0, 0x50): idx=8 mapped at ffff6000
ACPI table found: SPCR v1 [DELL   PE2650   0.1]
Enabling the CPU's according to the ACPI table
Intel MultiProcessor Specification v1.4
    Virtual Wire compatibility mode.
OEM ID: DELL     Product ID: PE 0121      APIC at: 0xFEE00000
I/O APIC #4 Version 17 at 0xFEC00000.
I/O APIC #5 Version 17 at 0xFEC01000.
I/O APIC #6 Version 17 at 0xFEC02000.
Processors: 4
Kernel command line: auto BOOT_IMAGE=linux ro root=807 BOOT_FILE=/boot/vmlinuz
Initializing CPU#0
Detected 1794.272 MHz processor.
Console: colour VGA+ 80x25
Calibrating delay loop... 3578.26 BogoMIPS
Memory: 2069700k/2097088k available (1219k kernel code, 27004k reserved, 347k data, 252k init, 1179584k highmem)
Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes)
Inode cache hash table entries: 131072 (order: 8, 1048576 bytes)
Mount-cache hash table entries: 32768 (order: 6, 262144 bytes)
Buffer-cache hash table entries: 131072 (order: 7, 524288 bytes)
Page-cache hash table entries: 524288 (order: 9, 2097152 bytes)
CPU: L1 I cache: 0K, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 0
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#0.
CPU:     After generic, caps: 3febfbff 00000000 00000000 00000000
CPU:             Common caps: 3febfbff 00000000 00000000 00000000
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Checking 'hlt' instruction... OK.
POSIX conformance testing by UNIFIX
mtrr: v1.40 (20010327) Richard Gooch ([email protected])
mtrr: detected mtrr type: Intel
CPU: L1 I cache: 0K, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 0
Intel machine check reporting enabled on CPU#0.
CPU:     After generic, caps: 3febfbff 00000000 00000000 00000000
CPU:             Common caps: 3febfbff 00000000 00000000 00000000
CPU0: Intel(R) XEON(TM) CPU 1.80GHz stepping 04
per-CPU timeslice cutoff: 1462.89 usecs.
enabled ExtINT on CPU#0
ESR value before enabling vector: 00000040
ESR value after enabling vector: 00000000
Booting processor 1/1 eip 2000
Initializing CPU#1
masked ExtINT on CPU#1
ESR value before enabling vector: 00000000
ESR value after enabling vector: 00000000
Calibrating delay loop... 3578.26 BogoMIPS
CPU: L1 I cache: 0K, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 0
Intel machine check reporting enabled on CPU#1.
CPU:     After generic, caps: 3febfbff 00000000 00000000 00000000
CPU:             Common caps: 3febfbff 00000000 00000000 00000000
CPU1: Intel(R) XEON(TM) CPU 1.80GHz stepping 04
Booting processor 2/2 eip 2000
Initializing CPU#2
masked ExtINT on CPU#2
ESR value before enabling vector: 00000000
ESR value after enabling vector: 00000000
Calibrating delay loop... 3578.26 BogoMIPS
CPU: L1 I cache: 0K, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 3
Intel machine check reporting enabled on CPU#2.
CPU:     After generic, caps: 3febfbff 00000000 00000000 00000000
CPU:             Common caps: 3febfbff 00000000 00000000 00000000
CPU2: Intel(R) XEON(TM) CPU 1.80GHz stepping 04
Booting processor 3/3 eip 2000
Initializing CPU#3
masked ExtINT on CPU#3
ESR value before enabling vector: 00000000
ESR value after enabling vector: 00000000
Calibrating delay loop... 3578.26 BogoMIPS
CPU: L1 I cache: 0K, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 3
Intel machine check reporting enabled on CPU#3.
CPU:     After generic, caps: 3febfbff 00000000 00000000 00000000
CPU:             Common caps: 3febfbff 00000000 00000000 00000000
CPU3: Intel(R) XEON(TM) CPU 1.80GHz stepping 04
Total of 4 processors activated (14313.06 BogoMIPS).
cpu_sibling_map[0] = 1
cpu_sibling_map[1] = 0
cpu_sibling_map[2] = 3
cpu_sibling_map[3] = 2
ENABLING IO-APIC IRQs
Setting 4 in the phys_id_present_map
...changing IO-APIC physical APIC ID to 4 ... ok.
Setting 5 in the phys_id_present_map
...changing IO-APIC physical APIC ID to 5 ... ok.
Setting 6 in the phys_id_present_map
...changing IO-APIC physical APIC ID to 6 ... ok.
init IO_APIC IRQs
 IO-APIC (apicid-pin) 4-0, 4-7, 4-10, 4-11, 4-13, 6-0, 6-1, 6-2, 6-3, 6-4, 6-5, 6-6, 6-7, 6-8, 6-9, 6-10, 6-11, 6-12, 6-13, 6-14, 6-15 not connected.
..TIMER: vector=0x31 pin1=2 pin2=0
..MP-BIOS bug: 8254 timer not connected to IO-APIC
...trying to set up timer (IRQ0) through the 8259A ... 
..... (found pin 0) ...works.
number of MP IRQ sources: 33.
number of IO-APIC #4 registers: 16.
number of IO-APIC #5 registers: 16.
number of IO-APIC #6 registers: 16.
testing the IO APIC.......................

IO APIC #4......
.... register #00: 04000000
.......    : physical APIC id: 04
.... register #01: 000F0011
.......     : max redirection entries: 000F
.......     : PRQ implemented: 0
.......     : IO APIC version: 0011
.... register #02: 04000000
.......     : arbitration: 04
.... IRQ redirection table:
 NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
 00 00F 0F  0    0    0   0   0    1    1    31
 01 00F 0F  0    0    0   0   0    1    1    39
 02 001 01  1    0    0   0   0    0    0    00
 03 00F 0F  0    0    0   0   0    1    1    41
 04 00F 0F  0    0    0   0   0    1    1    49
 05 00F 0F  1    1    0   1   0    1    1    51
 06 00F 0F  0    0    0   0   0    1    1    59
 07 000 00  1    0    0   0   0    0    0    00
 08 00F 0F  0    0    0   0   0    1    1    61
 09 00F 0F  0    0    0   0   0    1    1    69
 0a 000 00  1    0    0   0   0    0    0    00
 0b 000 00  1    0    0   0   0    0    0    00
 0c 00F 0F  0    0    0   0   0    1    1    71
 0d 000 00  1    0    0   0   0    0    0    00
 0e 00F 0F  0    0    0   0   0    1    1    79
 0f 00F 0F  0    0    0   0   0    1    1    81

IO APIC #5......
.... register #00: 05000000
.......    : physical APIC id: 05
.... register #01: 000F0011
.......     : max redirection entries: 000F
.......     : PRQ implemented: 0
.......     : IO APIC version: 0011
.... register #02: 05000000
.......     : arbitration: 05
.... IRQ redirection table:
 NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
 00 00F 0F  1    1    0   1   0    1    1    89
 01 00F 0F  1    1    0   1   0    1    1    91
 02 00F 0F  1    1    0   1   0    1    1    99
 03 00F 0F  1    1    0   1   0    1    1    A1
 04 00F 0F  1    1    0   1   0    1    1    A9
 05 00F 0F  1    1    0   1   0    1    1    B1
 06 00F 0F  1    1    0   1   0    1    1    B9
 07 00F 0F  1    1    0   1   0    1    1    C1
 08 00F 0F  1    1    0   1   0    1    1    C9
 09 00F 0F  1    1    0   1   0    1    1    D1
 0a 00F 0F  1    1    0   1   0    1    1    D9
 0b 00F 0F  1    1    0   1   0    1    1    E1
 0c 00F 0F  1    1    0   1   0    1    1    E9
 0d 00F 0F  1    1    0   1   0    1    1    32
 0e 00F 0F  1    1    0   1   0    1    1    3A
 0f 00F 0F  1    1    0   1   0    1    1    42

IO APIC #6......
.... register #00: 06000000
.......    : physical APIC id: 06
.... register #01: 000F0011
.......     : max redirection entries: 000F
.......     : PRQ implemented: 0
.......     : IO APIC version: 0011
.... register #02: 06000000
.......     : arbitration: 06
.... IRQ redirection table:
 NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
 00 000 00  1    0    0   0   0    0    0    00
 01 000 00  1    0    0   0   0    0    0    00
 02 000 00  1    0    0   0   0    0    0    00
 03 000 00  1    0    0   0   0    0    0    00
 04 000 00  1    0    0   0   0    0    0    00
 05 000 00  1    0    0   0   0    0    0    00
 06 000 00  1    0    0   0   0    0    0    00
 07 000 00  1    0    0   0   0    0    0    00
 08 000 00  1    0    0   0   0    0    0    00
 09 000 00  1    0    0   0   0    0    0    00
 0a 000 00  1    0    0   0   0    0    0    00
 0b 000 00  1    0    0   0   0    0    0    00
 0c 000 00  1    0    0   0   0    0    0    00
 0d 000 00  1    0    0   0   0    0    0    00
 0e 000 00  1    0    0   0   0    0    0    00
 0f 000 00  1    0    0   0   0    0    0    00
IRQ to pin mappings:
IRQ0 -> 0:0
IRQ1 -> 0:1
IRQ3 -> 0:3
IRQ4 -> 0:4
IRQ5 -> 0:5
IRQ6 -> 0:6
IRQ8 -> 0:8
IRQ9 -> 0:9
IRQ12 -> 0:12
IRQ14 -> 0:14
IRQ15 -> 0:15
IRQ16 -> 1:0
IRQ17 -> 1:1
IRQ18 -> 1:2
IRQ19 -> 1:3
IRQ20 -> 1:4
IRQ21 -> 1:5
IRQ22 -> 1:6
IRQ23 -> 1:7
IRQ24 -> 1:8
IRQ25 -> 1:9
IRQ26 -> 1:10
IRQ27 -> 1:11
IRQ28 -> 1:12
IRQ29 -> 1:13
IRQ30 -> 1:14
IRQ31 -> 1:15
.................................... done.
Using local APIC timer interrupts.
calibrating APIC timer ...
..... CPU clock speed is 1794.2032 MHz.
..... host bus clock speed is 99.6777 MHz.
cpu: 0, clocks: 996777, slice: 199355
CPU0<T0:996768,T1:797408,D:5,S:199355,C:996777>
cpu: 1, clocks: 996777, slice: 199355
cpu: 3, clocks: 996777, slice: 199355
cpu: 2, clocks: 996777, slice: 199355
CPU2<T0:996768,T1:398672,D:31,S:199355,C:996777>
CPU3<T0:996768,T1:199344,D:4,S:199355,C:996777>
CPU1<T0:996768,T1:598048,D:10,S:199355,C:996777>
checking TSC synchronization across CPUs: passed.
Waiting on wait_init_idle (map = 0xe)
All processors have done init_idle
PCI: PCI BIOS revision 2.10 entry at 0xfc97e, last bus=5
PCI: Using configuration type 1
PCI: Probing PCI hardware
PCI: Discovered primary peer bus 01 [IRQ]
PCI: Discovered primary peer bus 02 [IRQ]
PCI: Discovered primary peer bus 03 [IRQ]
PCI: Discovered primary peer bus 04 [IRQ]
PCI: Using IRQ router ServerWorks [1166/0201] at 00:0f.0
PCI->APIC IRQ transform: (B0,I4,P0) -> 19
PCI->APIC IRQ transform: (B0,I4,P1) -> 23
PCI->APIC IRQ transform: (B0,I4,P2) -> 27
PCI->APIC IRQ transform: (B3,I6,P0) -> 28
PCI->APIC IRQ transform: (B3,I8,P0) -> 29
PCI->APIC IRQ transform: (B4,I8,P0) -> 30
PCI->APIC IRQ transform: (B5,I6,P0) -> 30
PCI->APIC IRQ transform: (B5,I6,P1) -> 31
Linux NET4.0 for Linux 2.4
Based upon Swansea University Computer Society NET3.039
Initializing RT netlink socket
Starting kswapd
allocated 32 pages and 32 bhs reserved for the highmem bounces
VFS: Diskquotas version dquot_6.5.0 initialized
Journalled Block Device driver loaded
pty: 256 Unix98 ptys configured
Real Time Clock Driver v1.10e
Intel(R) PRO/1000 Network Driver - version 4.4.12-k1
Copyright (c) 1999-2002 Intel Corporation.
tg3.c:v1.4c (Feb 18, 2003)
eth0: Tigon3 [partno(BCM95701A10) rev 0105 PHY(5701)] (PCIX:133MHz:64-bit) 10/100/1000BaseT Ethernet 00:06:5b:3f:52:7a
eth1: Tigon3 [partno(BCM95701A10) rev 0105 PHY(5701)] (PCIX:133MHz:64-bit) 10/100/1000BaseT Ethernet 00:06:5b:3f:52:7b
SCSI subsystem driver Revision: 1.00
Red Hat/Adaptec aacraid driver (1.1.2 Jun 22 2003 14:59:06)
AAC0: kernel 2.7.4 build 3170
AAC0: monitor 2.7.4 build 3170
AAC0: bios 2.7.0 build 3170
AAC0: serial 5bd421d3fafaf001
scsi0 : percraid
  Vendor: DELL      Model: PERCRAID Mirror   Rev: V1.0
  Type:   Direct-Access                      ANSI SCSI revision: 02
  Vendor: DELL      Model: PERCRAID RAID5    Rev: V1.0
  Type:   Direct-Access                      ANSI SCSI revision: 02
megaraid: v1.18 (Release Date: Thu Oct 11 15:02:53 EDT 2001)
megaraid: no BIOS enabled.
Attached scsi removable disk sda at scsi0, channel 0, id 0, lun 0
Attached scsi removable disk sdb at scsi0, channel 0, id 1, lun 0
SCSI device sda: 71091456 512-byte hdwr sectors (36399 MB)
sda: Write Protect is off
Partition check:
 sda: sda1 sda2 sda3 sda4 < sda5 sda6 sda7 >
SCSI device sdb: 142182912 512-byte hdwr sectors (72798 MB)
sdb: Write Protect is off
 sdb: sdb1
NET4: Linux TCP/IP 1.0 for NET4.0
IP Protocols: ICMP, UDP, TCP
IP: routing cache hash table of 16384 buckets, 128Kbytes
TCP: Hash tables configured (established 262144 bind 65536)
NET4: Unix domain sockets 1.0/SMP for Linux NET4.0.
kjournald starting.  Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
VFS: Mounted root (ext3 filesystem) readonly.
Freeing unused kernel memory: 252k freed
Adding Swap: 2097136k swap-space (priority -1)
usb.c: registered new driver hub
usb-ohci.c: USB OHCI at membase 0xf893a000, IRQ 5
usb-ohci.c: usb-00:0f.2, ServerWorks OSB4/CSB5 OHCI USB Controller
usb.c: new USB bus registered, assigned bus number 1
hub.c: USB hub found
hub.c: 4 ports detected
EXT3 FS 2.4-0.9.19, 19 August 2002 on sd(8,7), internal journal
md: md driver 0.90.0 MAX_MD_DEVS=256, MD_SB_DISKS=27
kjournald starting.  Commit interval 5 seconds
EXT3 FS 2.4-0.9.19, 19 August 2002 on sd(8,1), internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting.  Commit interval 5 seconds
EXT3 FS 2.4-0.9.19, 19 August 2002 on sd(8,6), internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting.  Commit interval 5 seconds
EXT3 FS 2.4-0.9.19, 19 August 2002 on sd(8,5), internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting.  Commit interval 5 seconds
EXT3 FS 2.4-0.9.19, 19 August 2002 on sd(8,3), internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting.  Commit interval 5 seconds
EXT3 FS 2.4-0.9.19, 19 August 2002 on sd(8,17), internal journal
EXT3-fs: mounted filesystem with ordered data mode.
inserting floppy driver for 2.4.20-12-PE2650-6650
Floppy drive(s): fd0 is 1.44M
FDC 0 is a National Semiconductor PC87306
Serial driver version 5.05c (2001-07-08) with MANY_PORTS SHARE_IRQ SERIAL_PCI enabled
ttyS00 at 0x03f8 (irq = 4) is a 16550A
ttyS01 at 0x02f8 (irq = 3) is a 16550A
tg3: eth0: Link is up at 100 Mbps, full duplex.
tg3: eth0: Flow control is off for TX and off for RX.
tg3: eth1: Link is up at 100 Mbps, full duplex.
tg3: eth1: Flow control is off for TX and off for RX.
aacraid:ID(0:00:0) Timeout detected on cmd[0x28]
aacraid:SCSI Channel[0]: Timeout Detected On 20 Command(s)
midgarth-st:bash# cat /proc/scsi/aacraid/0 
Adaptec Raid Controller 1.1.2 Jun 22 2003 14:59:06, scsi hba number 0
midgarth-st:bash# cat /proc/interrupts 
           CPU0       CPU1       CPU2       CPU3       
  0:    1269945    1250817    1234658    1232493    IO-APIC-edge  timer
  1:          2          0          0          1    IO-APIC-edge  keyboard
  2:          0          0          0          0          XT-PIC  cascade
  5:          0          0          0          0   IO-APIC-level  usb-ohci
  8:          1          0          0          0    IO-APIC-edge  rtc
 28:     209689     207093     203779     203569   IO-APIC-level  eth0
 29:     142155     139576     137572     137772   IO-APIC-level  eth1
 30:   20886187   20307431   20333984   19889920   IO-APIC-level  aacraid
NMI:          0          0          0          0 
LOC:    4987810    4987831    4987808    4987832 
ERR:          0
MIS:          0
midgarth-st:bash# uptime
  9:00pm  up 13:51,  1 user,  load average: 10.82, 11.94, 12.01
midgarth-st:bash# exit

Script done on Mon Jun 23 21:00:20 2003