Re: Kernel panic

Chris Wilson <[email protected]>
Newsgroups gmane.linux.network.bridge.ebtables.devel
Message-ID <Pine.LNX.4.44.0308051518090.21531-200000@localhost>
Dear sirs,

Cho Soon Yim wrote:

> I got the following kernel panic messages,
> ------------------------------------------------------------------------
> Warning: kfree_skb passed an skb still on a list (from c022069f).
> kernel BUG at skbuff.c:323!
> invalid operand: 0000

We are also experiencing the same problem reported by Cho Soon Yim. It
only happens when we feed "abmient" traffic from a certain hosting
provider into the machine, and tcpdump on the external interface. The
traffic includes HSRP packets (presumably from a pair of Cisco routers),
and the machine is connected to a Cisco switch, but I don't know what
kind.

I have a tcpdump trace file which, with tcpreplay, causes the machine to
panic within a few seconds, with the same message reported by Yimbo
(kernel BUG at skbuff.c:330 in our case). Line 330 in our heavily-patched
2.4.20 kernel is just below the line which printk's "Warning: kfree_skb
passed an skb still on a list".

The error started at precisely the time we upgraded to the new patch:

  ebtables-brnf_vs_2.4.21.diff.gz

Previously we had been using:

  ebtables-v2.0.003_vs_2.4.20.diff,
  bridge-nf-0.0.10-against-2.4.20.diff, and
  a patch based on ebt-802_3.tar.gz

and this version does not crash.

I have attached a decoded Oops. Hopefully this will be of use to you,
despite the warnings which I haven not been able to eliminate yet. Please
let me know if you need the tcpdump trace file (pcap format) or if I can
provide any other assistance in fixing this problem.

Cheers, Chris.
-- 
   ___ __     _
 / __// / ,__(_)_  | Chris Wilson -- UNIX Firewall Lead Developer |
/ (_ / ,\/ _/ /_ \ | NetServers.co.uk http://www.netservers.co.uk |
\ _//_/_/_//_/___/ | 21 Signet Court, Cambridge, UK. 01223 576516 |
panic-decoded.txt (text/plain, 9 KB)
ksymoops 2.4.4 on i686 2.4.18-19.7.x.  Options used
     -V (default)
     -k ksyms (specified)
     -l modules (specified)
     -O (specified)
     -m System.map (specified)

Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/sched/cls_u32.o for module cls_u32 has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/sched/sch_htb.o for module sch_htb has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ip_queue.o for module ip_queue has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipsec/ipsec.o for module ipsec has changed since load
Error (expand_objects): cannot stat(/lib/modules/2.4.20-FW33/misc/via686a.o) for via686a
Error (expand_objects): cannot stat(/lib/modules/2.4.20-FW33/misc/i2c-proc.o) for i2c-proc
Error (expand_objects): cannot stat(/lib/modules/2.4.20-FW33/misc/i2c-isa.o) for i2c-isa
Error (expand_objects): cannot stat(/lib/modules/2.4.20-FW33/misc/i2c-core.o) for i2c-core
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/drivers/usb/usb-uhci.o for module usb-uhci has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/drivers/usb/usbcore.o for module usbcore has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/drivers/isdn/hisax/hisax.o for module hisax has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/drivers/pnp/isa-pnp.o for module isa-pnp has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/drivers/isdn/isdn.o for module isdn has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/drivers/net/slhc.o for module slhc has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/drivers/net/8139too.o for module 8139too has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/drivers/net/mii.o for module mii has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/bridge/netfilter/ebtable_nat.o for module ebtable_nat has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/bridge/netfilter/ebt_dnat.o for module ebt_dnat has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/bridge/netfilter/ebtable_broute.o for module ebtable_broute has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/bridge/bridge.o for module bridge has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/bridge/netfilter/ebtables.o for module ebtables has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ipt_LOG.o for module ipt_LOG has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ipt_limit.o for module ipt_limit has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ipt_owner.o for module ipt_owner has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ipt_REJECT.o for module ipt_REJECT has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ipt_multiport.o for module ipt_multiport has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ipt_MASQUERADE.o for module ipt_MASQUERADE has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ipt_state.o for module ipt_state has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ip_nat_ftp.o for module ip_nat_ftp has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ip_conntrack_tftp.o for module ip_conntrack_tftp has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ip_conntrack_pptp.o for module ip_conntrack_pptp has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ip_conntrack_proto_gre.o for module ip_conntrack_proto_gre has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ip_conntrack_mms.o for module ip_conntrack_mms has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ip_conntrack_irc.o for module ip_conntrack_irc has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ip_conntrack_h323.o for module ip_conntrack_h323 has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ip_conntrack_ftp.o for module ip_conntrack_ftp has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ip_conntrack_amanda.o for module ip_conntrack_amanda has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/iptable_raw.o for module iptable_raw has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/iptable_nat.o for module iptable_nat has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ip_conntrack.o for module ip_conntrack has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/iptable_mangle.o for module iptable_mangle has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/iptable_filter.o for module iptable_filter has changed since load
Warning (expand_objects): object /lib/modules/2.4.20-FW33/kernel/net/ipv4/netfilter/ip_tables.o for module ip_tables has changed since load
Warning (compare_maps): mismatch on symbol zeroes  , ipsec says c8202c20, /lib/modules/2.4.20-FW33/kernel/net/ipsec/ipsec.o says c8202b20.  Ignoring /lib/modules/2.4.20-FW33/kernel/net/ipsec/ipsec.o entry
Warning (map_ksym_to_module): cannot match loaded module via686a to a unique module object.  Trace may not be reliable.
Warning (map_ksym_to_module): cannot match loaded module i2c-proc to a unique module object.  Trace may not be reliable.
Warning (map_ksym_to_module): cannot match loaded module i2c-isa to a unique module object.  Trace may not be reliable.
Warning (map_ksym_to_module): cannot match loaded module i2c-core to a unique module object.  Trace may not be reliable.
kernel BUG at skbuff.c:330!
invalid operand: 0000
CPU:    0
EIP:    0010:[<c020a6a0>]    Not tainted
Using defaults from ksymoops -t elf32-i386 -a i386
EFLAGS: 00010282
eax: 00000045   ebx: c3822370   ecx: 00000082   edx: 00000001
esi: c3822370   edi: 00000081   ebp: c02e9ec4   esp: c02e9ea4
ds: 0018   es: 0018   ss: 0018
Process swapper (pid: 0, stackpage=c02e9000)
Stack: c0296e00 c020ee76 c02e9ed4 c74dc3a0 c3822370 00000081 00000000 00000081
       c02e9f00 c020ee76 c3822370 c6195400 c02e9f20 c8110f2a c8115037 c81131dc
       0000075d 00000040 00000044 0000124c c6195400 c0301b6c 00000000 c02e9f30
Call Trace:    [<c020ee76>] [<c020ee76>] [<c8110f2a>] [<c81131dc>] [<c020ef1d>]
  [<c020f03e>] [<c011bf5b>] [<c010aa39>] [<c01072b0>] [<c01072b0>] [<c01072d6>]
  [<c0107372>] [<c0105000>]
Code: 0f 0b 4a 01 12 de 29 c0 5b 5f 8b 5d 08 8b 43 28 85 c0 74 06

>>EIP; c020a6a0 <__kfree_skb+20/160>   <=====
Trace; c020ee76 <netif_receive_skb+206/240>
Trace; c020ee76 <netif_receive_skb+206/240>
Trace; c8110f2a <[8139too]rtl8139_rx_interrupt+25a/2c0>
Trace; c81131dc <[8139too].rodata.end+bd/361>
Trace; c020ef1d <process_backlog+6d/110>
Trace; c020f03e <net_rx_action+7e/160>
Trace; c011bf5b <do_softirq+6b/e0>
Trace; c010aa39 <do_IRQ+119/130>
Trace; c01072b0 <default_idle+0/40>
Trace; c01072b0 <default_idle+0/40>
Trace; c01072d6 <default_idle+26/40>
Trace; c0107372 <cpu_idle+52/70>
Trace; c0105000 <_stext+0/0>
Code;  c020a6a0 <__kfree_skb+20/160>
00000000 <_EIP>:
Code;  c020a6a0 <__kfree_skb+20/160>   <=====
   0:   0f 0b                     ud2a      <=====
Code;  c020a6a2 <__kfree_skb+22/160>
   2:   4a                        dec    %edx
Code;  c020a6a3 <__kfree_skb+23/160>
   3:   01 12                     add    %edx,(%edx)
Code;  c020a6a5 <__kfree_skb+25/160>
   5:   de 29                     fisubr (%ecx)
Code;  c020a6a7 <__kfree_skb+27/160>
   7:   c0 5b 5f 8b               rcrb   $0x8b,0x5f(%ebx)
Code;  c020a6ab <__kfree_skb+2b/160>
   b:   5d                        pop    %ebp
Code;  c020a6ac <__kfree_skb+2c/160>
   c:   08 8b 43 28 85 c0         or     %cl,0xc0852843(%ebx)
Code;  c020a6b2 <__kfree_skb+32/160>
  12:   74 06                     je     1a <_EIP+0x1a> c020a6ba <__kfree_skb+3a/160>

 .625715 deadbeef<0>Kernel panic: Aiee, killing interrupt handler!

44 warnings and 4 errors issued.  Results may not be reliable.
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.