text core analysis ddb script can't find the symbols

Marcin Cieslak <[email protected]>
Newsgroups gmane.os.freebsd.current
Message-ID <[email protected]>
I have a kernel panic (separate post on this one) and I wonder
why the core.txt.4 file is missing some crucial informaton
such as kernel messages buffer:

dmesg: /boot/nvmekernel/kernel: msgbufp not found

I believe I have my freshly built kernel und userland in sync (1600019)
everything is based off 1c0d2f0b1a98526e4f1f5a051ce6904b4c3164e1
(I had to revert nvme change as suggested earlier on this list).

The only "strange" thing is that I boot /boot/nvmekernel, not the "usual" /boot/kernel

> kenv kernel
nvmekernel

kgdb reacts as follows:

root@radziecki:/var/crash # kgdb -n 4
kgdb: couldn't find a suitable kernel image

root@radziecki:/var/crash # kgdb /boot/nvmekernel/kernel /var/crash/vmcore.4 
GNU gdb (GDB) 15.1 [GDB v15.1 for FreeBSD]
Copyright (C) 2024 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-portbld-freebsd16.0".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<https://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
     <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /boot/nvmekernel/kernel...
Reading symbols from /usr/lib/debug//boot/nvmekernel/kernel.debug...

Unread portion of the kernel message buffer:
rgephy0: detached
miibus0: detached
ure0: detached
uhub2: detached


Fatal trap 12: page fault while in kernel mode
cpuid = 1; apic id = 02
fault virtual address	= 0x488
fault code		= supervisor read data, page not present

(...)
(kgdb) p msgbufp
$1 = (struct msgbuf *) 0xfffff8046effffb8

I have a full dump and it seems to have all the things available.

Full core.txt.4 below:

radziecki dumped core - see /var/crash/vmcore.4

Thu Aug  6 15:40:44 CEST 2026

FreeBSD radziecki 16.0-CURRENT FreeBSD 16.0-CURRENT #2 revert-nvme-n287937-25cc19ba6958: Tue Aug  4 20:58:12 CEST 2026     saper@radziecki:/big/obj/usr/src/amd64.amd64/sys/VAIO  amd64

panic: page fault

Reading symbols from /boot/nvmekernel/kernel...
Reading symbols from /usr/lib/debug//boot/nvmekernel/kernel.debug...
Reading symbols from /boot/nvmekernel/geom_eli.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/geom_eli.ko.debug...
Reading symbols from /boot/nvmekernel/zfs.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/zfs.ko.debug...
Reading symbols from /boot/nvmekernel/wsp.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/wsp.ko.debug...
Reading symbols from /boot/nvmekernel/linux.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/linux.ko.debug...
Reading symbols from /boot/nvmekernel/mqueuefs.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/mqueuefs.ko.debug...
Reading symbols from /boot/nvmekernel/linux_common.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/linux_common.ko.debug...
Reading symbols from /boot/nvmekernel/linux64.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/linux64.ko.debug...
Reading symbols from /boot/modules/i915kms.ko...
(No debugging symbols found in /boot/modules/i915kms.ko)
Reading symbols from /boot/modules/drm.ko...
(No debugging symbols found in /boot/modules/drm.ko)
Reading symbols from /boot/nvmekernel/iic.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/iic.ko.debug...
Reading symbols from /boot/nvmekernel/linuxkpi_video.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/linuxkpi_video.ko.debug...
Reading symbols from /boot/modules/dmabuf.ko...
(No debugging symbols found in /boot/modules/dmabuf.ko)
Reading symbols from /boot/nvmekernel/lindebugfs.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/lindebugfs.ko.debug...
Reading symbols from /boot/modules/ttm.ko...
(No debugging symbols found in /boot/modules/ttm.ko)
Reading symbols from /boot/nvmekernel/hms.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/hms.ko.debug...
Reading symbols from /boot/nvmekernel/hidbus.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/hidbus.ko.debug...
Reading symbols from /boot/nvmekernel/hidmap.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/hidmap.ko.debug...
Reading symbols from /boot/nvmekernel/nmdm.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/nmdm.ko.debug...
Reading symbols from /boot/nvmekernel/asmc.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/asmc.ko.debug...
Reading symbols from /boot/nvmekernel/ichsmb.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/ichsmb.ko.debug...
Reading symbols from /boot/nvmekernel/smbus.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/smbus.ko.debug...
Reading symbols from /boot/nvmekernel/ig4.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/ig4.ko.debug...
Reading symbols from /boot/nvmekernel/intelspi.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/intelspi.ko.debug...
Reading symbols from /boot/nvmekernel/spibus.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/spibus.ko.debug...
Reading symbols from /boot/nvmekernel/pty.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/pty.ko.debug...
Reading symbols from /boot/nvmekernel/fdescfs.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/fdescfs.ko.debug...
Reading symbols from /boot/nvmekernel/linprocfs.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/linprocfs.ko.debug...
Reading symbols from /boot/nvmekernel/linsysfs.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/linsysfs.ko.debug...
Reading symbols from /boot/nvmekernel/if_bridge.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/if_bridge.ko.debug...
Reading symbols from /boot/nvmekernel/bridgestp.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/bridgestp.ko.debug...
Reading symbols from /boot/nvmekernel/vmm.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/vmm.ko.debug...
Reading symbols from /boot/nvmekernel/cuse.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/cuse.ko.debug...
Reading symbols from /boot/nvmekernel/if_ure.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/if_ure.ko.debug...
Reading symbols from /boot/nvmekernel/uether.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/uether.ko.debug...
Reading symbols from /boot/nvmekernel/uhid.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/uhid.ko.debug...
Reading symbols from /boot/nvmekernel/ums.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/ums.ko.debug...
Reading symbols from /boot/nvmekernel/usbhid.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/usbhid.ko.debug...
Reading symbols from /boot/nvmekernel/atopcase.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/atopcase.ko.debug...
Reading symbols from /boot/nvmekernel/hmt.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/hmt.ko.debug...
Reading symbols from /boot/nvmekernel/hconf.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/hconf.ko.debug...
Reading symbols from /boot/nvmekernel/hkbd.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/hkbd.ko.debug...
Reading symbols from /boot/nvmekernel/ng_btsocket.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/ng_btsocket.ko.debug...
Reading symbols from /boot/nvmekernel/ng_bluetooth.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/ng_bluetooth.ko.debug...
Reading symbols from /boot/nvmekernel/netgraph.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/netgraph.ko.debug...
Reading symbols from /boot/nvmekernel/mac_ntpd.ko...
Reading symbols from /usr/lib/debug//boot/nvmekernel/mac_ntpd.ko.debug...
__curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:57
57		__asm("movq %%gs:%c1,%0" : "=r" (td)
(kgdb) #0  __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:57
         td = <optimized out>
#1  doadump (textdump=32) at /usr/src/sys/kern/kern_shutdown.c:399
         error = 0
         coredump = <optimized out>
#2  0xffffffff804f6e38 in db_fncall_generic (args=0xfffffe010a53ee80,
     addr=<optimized out>, rv=<optimized out>, nargs=<optimized out>)
     at /usr/src/sys/ddb/db_command.c:631
         f = <optimized out>
#3  db_fncall (dummy1=<optimized out>, dummy2=<optimized out>,
     dummy3=<optimized out>, dummy4=<optimized out>)
     at /usr/src/sys/ddb/db_command.c:679
         fn_addr = -2134272704
         args = {32, 22, -2194555015328, 0, -2195741921280, 4,
           3419777737255264901, 0, 4, -2116180316}
         nargs = <optimized out>
         t = <optimized out>
         retval = <optimized out>
#4  0xffffffff804f694a in db_command (last_cmdp=<optimized out>,
     cmd_table=<optimized out>, dopager=false)
     at /usr/src/sys/ddb/db_command.c:508
         modif = "\300\357S\n\001\376\377\377\243\246݁\377\377\377\377\260\360S\n\001\376\377\377\000\000\000\000\000\000\000\000\240\357S\n\001\376\377\377\247\242O\200\377\377\377\377\220Oπ\377\377\377\377\000\000\000\000\000\000\000\000\340\241݁\377\377\377\377\243\246݁\377\377\377\377;\000\000\000\000\000\000\000BR6\201\377\377\377\377\000\357S\n\001\376\377\377\205\242㷻}u/\220\357S\n\001\376\377\377"
         addr = 4294977024
         count = 3419777737255264901
         cmd = 0xffffffff81c17d08 <db_cmds+1736>
         have_addr = <optimized out>
         t = <optimized out>
         result = <optimized out>
#5  0xffffffff804f69d6 in db_command_script (
     command=command@entry=0xffffffff81dda6a4 <db_recursion_data+68> "call doadump()") at /usr/src/sys/ddb/db_command.c:573
No locals.
#6  0xffffffff804fca28 in db_script_exec (
     scriptname=scriptname@entry=0xfffffe010a53f060 "kdb.enter.panic",
     warnifnotfound=warnifnotfound@entry=0) at /usr/src/sys/ddb/db_script.c:301
         buffer = 0xffffffff81dda6b3 <db_recursion_data+83> " reset"
         jb = {{_jb = {4294977024, -2194555015256, -2194555015088,
               -2194555015232, -2116180316, -2194555014992, 0, -2142254365,
               -2120768128, -2126566903, -2126809375, 0}}}
         dsp = 0xffffffff81dda1e0 <db_script_table+160>
         drd = <optimized out>
         command = 0xffffffff81dda6a4 <db_recursion_data+68> "call doadump()"
         prev_jb = 0xfffffe010a53f0b0
#7  0xffffffff804fc912 in db_script_kdbenter (eventname=<optimized out>)
     at /usr/src/sys/ddb/db_script.c:323
         scriptname = "kdb.enter.panic\000\b\000\000\0000\000\000\0003\000\000\000\000\000\000"
#8  0xffffffff804fa0eb in db_trap (type=<optimized out>, code=<optimized out>)
     at /usr/src/sys/ddb/db_main.c:266
         jb = {{_jb = {0, -2194555015016, -2194555014864, -8784535046272,
               -2118024192, -2194555014992, -2194555014320, -2142265224,
               -2194555014896, -2136246209, -2113237184, 3}}}
         bkpt = false
         watchpt = false
         prev_jb = 0x0
         why = <unavailable>
#9  0xffffffff80ceb6c5 in kdb_trap (type=type@entry=3, code=code@entry=0,
     tf=tf@entry=0xfffffe010a53f350) at /usr/src/sys/kern/subr_kdb.c:790
         __pc = 0x0
         __pc = 0x0
         other_cpus = {__bits = {18446744071582379939, 4294967281,
             18446741879154537440, 18446744071582379937, 18446741878981263360,
             5, 18446744071582742241, 875586361, 18446744071575651440, 0,
             18446741878981263392, 12, 18446741879154537168, 0,
             18446744071600544033, 3419777737255264901}}
         be = 0xffffffff81c18400 <ddb_dbbe>
         intr = 70
         did_stop_cpus = <optimized out>
         handled = <optimized out>
#10 0xffffffff811f9f61 in trap (frame=<optimized out>)
     at /usr/src/sys/amd64/amd64/trap.c:702
         __pc = 0x0
         __pc = 0x0
         __pc = 0x0
         ksi = {ksi_link = {tqe_next = 0x1, tqe_prev = 0xfffff802b0e8b780},
           ksi_info = {si_signo = 5, si_errno = 0, si_code = -1, si_pid = 0,
             si_uid = 173274016, si_status = -511,
             si_addr = 0xffffffff80cf4b4b <_vprintf+139>, si_value = {
               sival_int = 5, sival_ptr = 0xffffffff00000005, sigval_int = 5,
               sigval_ptr = 0xffffffff00000005}, _reason = {_fault = {
                 _trapno = 0}, _timer = {_timerid = 0, _overrun = 0}, _mesgq = {
                 _mqd = 0}, _poll = {_band = 0}, _capsicum = {_syscall = 0},
               __spare__ = {__spare1__ = 0, __spare2__ = {173273856, -511, 128,
                   0, 173273856, -511, 128}}}}, ksi_flags = 977421312,
           ksi_sigq = 0x696e6170203a7265}
         signo = 0
         ucode = 256
         td = <optimized out>
         p = 0xffffffff820a8378 <proc0>
         dr6 = 0
         type = 3
         addr = <optimized out>
         pf = <optimized out>
         i = <optimized out>
#11 <signal handler called>
No locals.
#12 kdb_enter (why=<optimized out>, msg=<optimized out>)
     at /usr/src/sys/kern/subr_kdb.c:556
No locals.
#13 0xffffffff80c997b9 in vpanic (fmt=<optimized out>,
     ap=ap@entry=0xfffffe010a53f580) at /usr/src/sys/kern/kern_shutdown.c:962
         buf = "page fault", '\000' <repeats 245 times>
         __pc = 0x0
         __pc = 0x0
         __pc = 0x0
         other_cpus = {__bits = {1, 0 <repeats 15 times>}}
         td = 0xfffff802b0e8b780
         bootopt = <optimized out>
         newpanic = <optimized out>
#14 0xffffffff80c99633 in panic (fmt=0x0)
     at /usr/src/sys/kern/kern_shutdown.c:887
         ap = {{gp_offset = 16, fp_offset = 48,
             overflow_arg_area = 0xfffffe010a53f5b0,
             reg_save_area = 0xfffffe010a53f550}}
#15 0xffffffff811fa648 in trap_fatal (frame=<optimized out>,
     eva=<optimized out>) at /usr/src/sys/amd64/amd64/trap.c:1031
         type = <optimized out>
         handled = <optimized out>
#16 0xffffffff811fa648 in trap_pfault (frame=0xfffffe010a53f610,
     usermode=false, signo=<optimized out>, ucode=<optimized out>)
         __pc = 0x0
         __pc = 0x0
         __pc = 0x0
         td = <optimized out>
         p = <optimized out>
         eva = <optimized out>
         map = <optimized out>
         ftype = <optimized out>
         rv = <optimized out>
#17 <signal handler called>
No locals.
#18 __mtx_lock_sleep (c=0xfffff800015e9ee0, v=<optimized out>)
     at /usr/src/sys/kern/kern_mutex.c:614
         __pc = 0x0
         __pc = 0x0
         __pc = 0x0
         __pc = 0x0
         __pc = 0x0
         __pc = 0x0
         __pc = 0x0
         lda = {config = 0xffffffff81c000a0 <locks_delay>, delay = 1,
           spin_cnt = 1}
         sleep_cnt = 0
         sleep_time = 0
         all_time = 0
         doing_lockprof = <optimized out>
         td = 0xfffff802b0e8b780
         tid = 18446735289174505344
         m = 0xfffff800015e9ec8
         owner = 0x0
         ts = <optimized out>
#19 0xffffffff80a84eb7 in usb_pause_mtx (mtx=mtx@entry=0xfffff800015e9ec8,
     timo=<optimized out>) at /usr/src/sys/dev/usb/usb_util.c:123
         _tid = <optimized out>
         _v = 4
#20 0xffffffff80a7d521 in usbd_do_request_flags (
     udev=udev@entry=0xfffff80001cdd000, mtx=0xfffff800015e9ec8,
     req=req@entry=0xfffffe010a53f878, data=data@entry=0xfffffe010a53f874,
     flags=0, actlen=actlen@entry=0x0, timeout=<optimized out>)
     at /usr/src/sys/dev/usb/usb_request.c:734
         desc = 0xfffff80001cdd000
         temp = 4
         err = <optimized out>
         length = <optimized out>
         do_unlock = <optimized out>
         hr_func = <optimized out>
         xfer = <optimized out>
         start_ticks = <optimized out>
         max_ticks = <optimized out>
         delta_ticks = <optimized out>
         acttemp = <optimized out>
#21 0xffffffff80a7d60e in usbd_do_request_proc (udev=0xfffff80001cdd000,
     pproc=pproc@entry=0xfffff800015e9c40, req=req@entry=0xfffffe010a53f878,
     data=data@entry=0xfffffe010a53f874, flags=flags@entry=0,
     actlen=actlen@entry=0x0, timeout=1000)
     at /usr/src/sys/dev/usb/usb_request.c:768
         len = 4
         err = <optimized out>
#22 0xffffffff84d3f550 in ure_ctl (sc=<optimized out>, rw=1 '\001', val=59656,
     index=256, buf=0xfffffe010a53f874, len=4)
     at /usr/src/sys/dev/usb/net/if_ure.c:261
         req = {bmRequestType = 192 '\300', bRequest = 5 '\005',
           wValue = <incomplete sequence \351>, wIndex = "\000\001",
           wLength = "\004"}
#23 ure_read_mem (sc=<optimized out>, addr=59656, index=256,
     buf=0xfffffe010a53f874, len=4) at /usr/src/sys/dev/usb/net/if_ure.c:269
No locals.
#24 ure_read_1 (sc=<optimized out>, reg=59656, index=256)
     at /usr/src/sys/dev/usb/net/if_ure.c:290
         temp = "\000\000\000"
         shift = 0 '\000'
         val = <optimized out>
#25 ure_miibus_readreg (dev=<optimized out>, phy=<optimized out>, reg=59656)
     at /usr/src/sys/dev/usb/net/if_ure.c:419
         sc = <optimized out>
         val = <optimized out>
         locked = <optimized out>
#26 0xffffffff80780913 in MIIBUS_READREG (dev=<optimized out>,
     phy=<optimized out>, reg=<optimized out>) at ./miibus_if.h:28
         _m = <optimized out>
         rc = <optimized out>
         _cep = <optimized out>
         _ce = <optimized out>
         _desc = <optimized out>
#27 0xffffffff80780913 in rgephy_linkup (sc=<optimized out>)
         linkup = 0
         reg = <optimized out>
#28 0xffffffff8077fe88 in rgephy_status (sc=0xfffff800015e9ee0)
     at /usr/src/sys/dev/mii/rgephy.c:318
         mii = 0xfffff8027ad15800
         bmsr = <optimized out>
         bmcr = <optimized out>
         ssr = <optimized out>
#29 0xffffffff8077fe13 in rgephy_service (sc=0xfffff8027ad15880,
     mii=0xfffff8027ad15800, cmd=3) at /usr/src/sys/dev/mii/rgephy.c:262
         ife = <optimized out>
         anar = <optimized out>
         speed = <optimized out>
         gig = <optimized out>
#30 0xffffffff8077bd37 in mii_pollstat (mii=mii@entry=0xfffff8027ad15800)
     at /usr/src/sys/dev/mii/mii.c:616
         ife = 0xfffff80001cce800
         child = <optimized out>
#31 0xffffffff84d44def in ure_ifmedia_sts (ifp=<optimized out>,
     ifmr=0xfffffe010a53fa78) at /usr/src/sys/dev/usb/net/if_ure.c:1465
         sc = 0xfffff800015e9c00
         status = <optimized out>
         mii = 0xfffff8027ad15800
#32 0xffffffff80de892e in ifmedia_ioctl (ifp=0xfffff800015e9ee0,
     ifr=0xfffffe010a53fa78, ifm=0xfffff8027ad15800, cmd=<optimized out>)
     at /usr/src/sys/net/if_media.c:310
         i = <optimized out>
         ep = <optimized out>
         ifmr = 0xfffffe010a53fa78
         error = 0
         match = <optimized out>
#33 0xffffffff80f1b04d in get_operstate_ether (ifp=0xfffff80001899400,
     pstate=<optimized out>) at /usr/src/sys/netlink/route/iface.c:126
         ifmr = {ifm_name = '\000' <repeats 15 times>, ifm_current = 32,
           ifm_mask = -251658240, ifm_status = 0, ifm_active = 32,
           ifm_count = 0, ifm_ulist = 0x0}
         error = <optimized out>
#34 get_operstate (ifp=0xfffff80001899400, pstate=<optimized out>)
     at /usr/src/sys/netlink/route/iface.c:183
No locals.
#35 dump_iface (nw=0xfffffe010a53fd78, ifp=0xfffff80001899400,
     hdr=<optimized out>, if_flags_mask=if_flags_mask@entry=0,
     ifname=ifname@entry=0x0) at /usr/src/sys/netlink/route/iface.c:312
         et = {et_link = {tqe_next = 0xffffffffffffffff,
             tqe_prev = 0xffffffffffffffff}, et_td = 0xfffff802b0e8b780,
           et_section = {bucket = 1}, et_old_priority = 47 '/'}
         ifinfo = 0xfffff803e16c9438
         ifs = {ifla_operstate = 0 '\000', ifla_carrier = 0 '\000'}
         off = <optimized out>
         val = <optimized out>
#36 0xffffffff80f1d4bf in dump_cb (ifp=0x0, _arg=_arg@entry=0xfffffe010a53fba8)
     at /usr/src/sys/netlink/route/iface.c:444
         wa = <optimized out>
#37 0xffffffff80dde357 in if_foreach_sleep (
     match_cb=0xffffffff80f1d430 <match_iface>,
     match_arg=match_arg@entry=0xfffffe010a53fbe8,
     cb=0xffffffff80f1d4a0 <dump_cb>, cb_arg=cb_arg@entry=0xfffffe010a53fba8)
     at /usr/src/sys/net/if.c:4479
         i = 3
         et = {et_link = {tqe_next = 0xffffffffffffffff,
             tqe_prev = 0xffffffffffffffff}, et_td = 0xfffff802b0e8b780,
           et_section = {bucket = 1}, et_old_priority = 47 '/'}
         new_array = 0xfffff80085a66e80
         new_size = <optimized out>
         ifp = <optimized out>
         match_count = <optimized out>
         array_size = <optimized out>
         match_array = 0xfffff80085a66e80
         error = 0
#38 0xffffffff80f1bfaf in rtnl_handle_getlink (hdr=0xfffff8043737281c,
     nlp=0xfffff804371ed700, npt=<optimized out>)
     at /usr/src/sys/netlink/route/iface.c:514
         et = {et_link = {tqe_next = 0x2, tqe_prev = 0xfffffe0018c06800},
           et_td = 0xfffffe010a53fc80, et_section = {bucket = 2160509294},
           et_old_priority = 255 '\377'}
         attrs = {ifla_group = 0x0, ifla_ifname = 0x0, ifla_cloner = 0x0,
           ifla_ifalias = 0x0, ifla_idata = 0x0, ifla_address = 0x0,
           ifi_type = 0, ifi_index = 0, ifla_link = 0, ifla_mtu = 0,
           ifi_flags = 0, ifi_change = 0}
         wa = {nw = 0xfffffe010a53fd78, hdr = {nlmsg_len = 0, nlmsg_type = 16,
             nlmsg_flags = 775, nlmsg_seq = 1, nlmsg_pid = 0},
           so = 0xfffff804371ed700, cred = 0x0, fibnum = 0, family = 0,
           error = 0, count = 0, dumped = 0}
         error = <optimized out>
         ifp = <optimized out>
#39 0xffffffff80f1a240 in rtnl_handle_message (
     hdr=hdr@entry=0xfffff8043737281c, npt=npt@entry=0xfffffe010a53fdb0)
     at /usr/src/sys/netlink/netlink_route.c:103
         et = {et_link = {tqe_next = 0x4, tqe_prev = 0xfffffe0018c0b000},
           et_td = 0xfffffe010a53fce0, et_section = {bucket = 2160509294},
           et_old_priority = 255 '\377'}
         nlp = 0xfffff804371ed700
         error = 0
         cmd = 0xffffffff817c46b0 <cmd_handlers>
         need_epoch = <optimized out>
#40 0xffffffff80f18b6d in nl_receive_message (hdr=0xfffff8043737281c,
     remaining_length=<optimized out>, nlp=nlp@entry=0xfffff804371ed700,
     npt=npt@entry=0xfffffe010a53fdb0) at /usr/src/sys/netlink/netlink_io.c:294
         handler = 0xffffffff80f1a0a0 <rtnl_handle_message>
         error = <optimized out>
#41 0xffffffff80f1833b in nl_process_nbuf (nb=0xfffff80437372800,
     nlp=0xfffff804371ed700) at /usr/src/sys/netlink/netlink_io.c:356
         msglen = 32
         nw = {buf = 0xfffff803e16c9000, hdr = 0xfffff803e16c9428,
           cb = 0xffffffff80f18d40 <nl_send_one>, {nlp = 0xfffff804371ed700,
             group = {proto = 55040, id = 14110, priv = -2044}},
           ifp = 0xfffff80001898400, num_messages = 3, malloc_flag = 1,
           ignore_limit = true, enomem = false, suppress_ack = false}
         npt = {lb = {base = 0xfffff8043737283c "", offset = 0, size = 1152},
           nlp = 0xfffff804371ed700, nw = 0xfffffe010a53fd78,
           hdr = 0xfffff8043737281c, err_off = 0, error = 0, err_msg = 0x0,
           cookie = 0x0, strict = false}
         hdr = 0xfffff8043737281c
         error = <optimized out>
#42 nl_process_received_one (nlp=0xfffff804371ed700)
     at /usr/src/sys/netlink/netlink_io.c:122
         so = 0xfffff80005f49400
         reschedule = <optimized out>
         sb = 0xfffff80005f496d0
         nb = <optimized out>
#43 nl_process_received (nlp=0xfffff804371ed700)
     at /usr/src/sys/netlink/netlink_io.c:153
No locals.
#44 nl_taskqueue_handler (_arg=0xfffff804371ed700, pending=<optimized out>)
     at /usr/src/sys/netlink/netlink_io.c:190
         nlp = 0xfffff804371ed700
         saved_vnet = 0x0
#45 0xffffffff80d0367b in taskqueue_run_locked (
     queue=queue@entry=0xfffff80051694600)
     at /usr/src/sys/kern/subr_taskqueue.c:531
         et = {et_link = {tqe_next = 0xffffffff81cd4e60 <lock_class_mtx_sleep>,
             tqe_prev = 0x80cb2324}, et_td = 0x0, et_section = {
             bucket = 2181727096}, et_old_priority = 255 '\377'}
         tb = {tb_running = 0xfffff804371ed738, tb_seq = 1,
           tb_canceling = false, tb_link = {le_next = 0x0,
             le_prev = 0xfffff80051694610}}
         epochtasks = 0
         pending = 1
         task = <optimized out>
#46 0xffffffff80d04932 in taskqueue_thread_loop (
     arg=arg@entry=0xfffff804371ed730) at /usr/src/sys/kern/subr_taskqueue.c:847
         tqp = <optimized out>
         tq = 0xfffff80051694600
#47 0xffffffff80c4a7cb in fork_exit (
     callout=0xffffffff80d04870 <taskqueue_thread_loop>,
     arg=0xfffff804371ed730, frame=0xfffffe010a53ff40)
     at /usr/src/sys/kern/kern_fork.c:1220
         __pc = 0x0
         __pc = 0x0
         td = 0xfffff802b0e8b780
         p = 0xffffffff820a8378 <proc0>
         dtd = <optimized out>
#48 <signal handler called>
No locals.
#49 0x0000240c3679e76c in ?? ()
No symbol table info available.
Backtrace stopped: Cannot access memory at address 0x240c95c18b58
(kgdb) Tracing command "idle\000l", '\000' <repeats 13 times> pid 11 tid 100003 (CPU 0)
#0  cpustop_handler () at /usr/src/sys/x86/x86/mp_x86.c:1537
#1  0xffffffff811bf568 in ipi_nmi_handler ()
     at /usr/src/sys/x86/x86/mp_x86.c:1494
#2  0xffffffff811b3e1f in nmi_handle_intr (frame=<unavailable>)
     at /usr/src/sys/x86/x86/cpu_machdep.c:1086
#3  <signal handler called>
#4  acpi_cpu_idle_mwait (mwait_hint=0)
     at /usr/src/sys/x86/x86/cpu_machdep.c:411
#5  0xffffffff80524521 in acpi_cpu_idle (sbt=<optimized out>)
     at /usr/src/sys/dev/acpica/acpi_cpu.c:1166
#6  0xffffffff811b3a76 in cpu_idle_acpi (sbt=72264092)
     at /usr/src/sys/x86/x86/cpu_machdep.c:712
#7  0xffffffff811b3b2d in cpu_idle (busy=0)
     at /usr/src/sys/x86/x86/cpu_machdep.c:801
#8  0xffffffff80cd0ce6 in sched_ule_idletd (dummy=<optimized out>)
     at /usr/src/sys/kern/sched_ule.c:3195
#9  0xffffffff80c4a7cb in fork_exit (
     callout=0xffffffff80cd07a0 <sched_ule_idletd>, arg=0x0,
     frame=0xfffffe00d4e21f40) at /usr/src/sys/kern/kern_fork.c:1220
#10 <signal handler called>
#11 0xad8d48bdfcc7273c in ?? ()
Backtrace stopped: Cannot access memory at address 0x2fa58c8c285db87a

Tracing command "kernel", '\000' <repeats 13 times> pid 0 tid 455027 (CPU 1)
#0  __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:57
#1  doadump (textdump=32) at /usr/src/sys/kern/kern_shutdown.c:399
#2  0xffffffff804f6e38 in db_fncall_generic (args=0xfffffe010a53ee80,
     addr=<optimized out>, rv=<optimized out>, nargs=<optimized out>)
     at /usr/src/sys/ddb/db_command.c:631
#3  db_fncall (dummy1=<optimized out>, dummy2=<optimized out>,
     dummy3=<optimized out>, dummy4=<optimized out>)
     at /usr/src/sys/ddb/db_command.c:679
#4  0xffffffff804f694a in db_command (last_cmdp=<optimized out>,
     cmd_table=<optimized out>, dopager=false)
     at /usr/src/sys/ddb/db_command.c:508
#5  0xffffffff804f69d6 in db_command_script (
     command=command@entry=0xffffffff81dda6a4 <db_recursion_data+68> "call doadump()") at /usr/src/sys/ddb/db_command.c:573
#6  0xffffffff804fca28 in db_script_exec (
     scriptname=scriptname@entry=0xfffffe010a53f060 "kdb.enter.panic",
     warnifnotfound=warnifnotfound@entry=0) at /usr/src/sys/ddb/db_script.c:301
#7  0xffffffff804fc912 in db_script_kdbenter (eventname=<optimized out>)
     at /usr/src/sys/ddb/db_script.c:323
#8  0xffffffff804fa0eb in db_trap (type=<optimized out>, code=<optimized out>)
     at /usr/src/sys/ddb/db_main.c:266
#9  0xffffffff80ceb6c5 in kdb_trap (type=type@entry=3, code=code@entry=0,
     tf=tf@entry=0xfffffe010a53f350) at /usr/src/sys/kern/subr_kdb.c:790
#10 0xffffffff811f9f61 in trap (frame=<optimized out>)
     at /usr/src/sys/amd64/amd64/trap.c:702
#11 <signal handler called>
#12 kdb_enter (why=<optimized out>, msg=<optimized out>)
     at /usr/src/sys/kern/subr_kdb.c:556
#13 0xffffffff80c997b9 in vpanic (fmt=<optimized out>,
     ap=ap@entry=0xfffffe010a53f580) at /usr/src/sys/kern/kern_shutdown.c:962
#14 0xffffffff80c99633 in panic (fmt=0x0)
     at /usr/src/sys/kern/kern_shutdown.c:887
#15 0xffffffff811fa648 in trap_fatal (frame=<optimized out>,
     eva=<optimized out>) at /usr/src/sys/amd64/amd64/trap.c:1031
#16 0xffffffff811fa648 in trap_pfault (frame=0xfffffe010a53f610,
     usermode=false, signo=<optimized out>, ucode=<optimized out>)
#17 <signal handler called>
#18 __mtx_lock_sleep (c=0xfffff800015e9ee0, v=<optimized out>)
     at /usr/src/sys/kern/kern_mutex.c:614
#19 0xffffffff80a84eb7 in usb_pause_mtx (mtx=mtx@entry=0xfffff800015e9ec8,
     timo=<optimized out>) at /usr/src/sys/dev/usb/usb_util.c:123
#20 0xffffffff80a7d521 in usbd_do_request_flags (
     udev=udev@entry=0xfffff80001cdd000, mtx=0xfffff800015e9ec8,
     req=req@entry=0xfffffe010a53f878, data=data@entry=0xfffffe010a53f874,
     flags=0, actlen=actlen@entry=0x0, timeout=<optimized out>)
     at /usr/src/sys/dev/usb/usb_request.c:734
#21 0xffffffff80a7d60e in usbd_do_request_proc (udev=0xfffff80001cdd000,
     pproc=pproc@entry=0xfffff800015e9c40, req=req@entry=0xfffffe010a53f878,
     data=data@entry=0xfffffe010a53f874, flags=flags@entry=0,
     actlen=actlen@entry=0x0, timeout=1000)
     at /usr/src/sys/dev/usb/usb_request.c:768
#22 0xffffffff84d3f550 in ure_ctl (sc=<optimized out>, rw=1 '\001', val=59656,
     index=256, buf=0xfffffe010a53f874, len=4)
     at /usr/src/sys/dev/usb/net/if_ure.c:261
#23 ure_read_mem (sc=<optimized out>, addr=59656, index=256,
     buf=0xfffffe010a53f874, len=4) at /usr/src/sys/dev/usb/net/if_ure.c:269
#24 ure_read_1 (sc=<optimized out>, reg=59656, index=256)
     at /usr/src/sys/dev/usb/net/if_ure.c:290
#25 ure_miibus_readreg (dev=<optimized out>, phy=<optimized out>, reg=59656)
     at /usr/src/sys/dev/usb/net/if_ure.c:419
#26 0xffffffff80780913 in MIIBUS_READREG (dev=<optimized out>,
     phy=<optimized out>, reg=<optimized out>) at ./miibus_if.h:28
#27 0xffffffff80780913 in rgephy_linkup (sc=<optimized out>)
#28 0xffffffff8077fe88 in rgephy_status (sc=0xfffff800015e9ee0)
     at /usr/src/sys/dev/mii/rgephy.c:318
#29 0xffffffff8077fe13 in rgephy_service (sc=0xfffff8027ad15880,
     mii=0xfffff8027ad15800, cmd=3) at /usr/src/sys/dev/mii/rgephy.c:262
#30 0xffffffff8077bd37 in mii_pollstat (mii=mii@entry=0xfffff8027ad15800)
     at /usr/src/sys/dev/mii/mii.c:616
#31 0xffffffff84d44def in ure_ifmedia_sts (ifp=<optimized out>,
     ifmr=0xfffffe010a53fa78) at /usr/src/sys/dev/usb/net/if_ure.c:1465
#32 0xffffffff80de892e in ifmedia_ioctl (ifp=0xfffff800015e9ee0,
     ifr=0xfffffe010a53fa78, ifm=0xfffff8027ad15800, cmd=<optimized out>)
     at /usr/src/sys/net/if_media.c:310
#33 0xffffffff80f1b04d in get_operstate_ether (ifp=0xfffff80001899400,
     pstate=<optimized out>) at /usr/src/sys/netlink/route/iface.c:126
#34 get_operstate (ifp=0xfffff80001899400, pstate=<optimized out>)
     at /usr/src/sys/netlink/route/iface.c:183
#35 dump_iface (nw=0xfffffe010a53fd78, ifp=0xfffff80001899400,
     hdr=<optimized out>, if_flags_mask=if_flags_mask@entry=0,
     ifname=ifname@entry=0x0) at /usr/src/sys/netlink/route/iface.c:312
#36 0xffffffff80f1d4bf in dump_cb (ifp=0x0, _arg=_arg@entry=0xfffffe010a53fba8)
     at /usr/src/sys/netlink/route/iface.c:444
#37 0xffffffff80dde357 in if_foreach_sleep (
     match_cb=0xffffffff80f1d430 <match_iface>,
     match_arg=match_arg@entry=0xfffffe010a53fbe8,
     cb=0xffffffff80f1d4a0 <dump_cb>, cb_arg=cb_arg@entry=0xfffffe010a53fba8)
     at /usr/src/sys/net/if.c:4479
#38 0xffffffff80f1bfaf in rtnl_handle_getlink (hdr=0xfffff8043737281c,
     nlp=0xfffff804371ed700, npt=<optimized out>)
     at /usr/src/sys/netlink/route/iface.c:514
#39 0xffffffff80f1a240 in rtnl_handle_message (
     hdr=hdr@entry=0xfffff8043737281c, npt=npt@entry=0xfffffe010a53fdb0)
     at /usr/src/sys/netlink/netlink_route.c:103
#40 0xffffffff80f18b6d in nl_receive_message (hdr=0xfffff8043737281c,
     remaining_length=<optimized out>, nlp=nlp@entry=0xfffff804371ed700,
     npt=npt@entry=0xfffffe010a53fdb0) at /usr/src/sys/netlink/netlink_io.c:294
#41 0xffffffff80f1833b in nl_process_nbuf (nb=0xfffff80437372800,
     nlp=0xfffff804371ed700) at /usr/src/sys/netlink/netlink_io.c:356
#42 nl_process_received_one (nlp=0xfffff804371ed700)
     at /usr/src/sys/netlink/netlink_io.c:122
#43 nl_process_received (nlp=0xfffff804371ed700)
     at /usr/src/sys/netlink/netlink_io.c:153
#44 nl_taskqueue_handler (_arg=0xfffff804371ed700, pending=<optimized out>)
     at /usr/src/sys/netlink/netlink_io.c:190
#45 0xffffffff80d0367b in taskqueue_run_locked (
     queue=queue@entry=0xfffff80051694600)
     at /usr/src/sys/kern/subr_taskqueue.c:531
#46 0xffffffff80d04932 in taskqueue_thread_loop (
     arg=arg@entry=0xfffff804371ed730) at /usr/src/sys/kern/subr_taskqueue.c:847
#47 0xffffffff80c4a7cb in fork_exit (
     callout=0xffffffff80d04870 <taskqueue_thread_loop>,
     arg=0xfffff804371ed730, frame=0xfffffe010a53ff40)
     at /usr/src/sys/kern/kern_fork.c:1220
#48 <signal handler called>
#49 0x0000240c3679e76c in ?? ()
Backtrace stopped: Cannot access memory at address 0x240c95c18b58

(kgdb)

------------------------------------------------------------------------
ps -axlww

ps: _nprocs: no such symbol

------------------------------------------------------------------------
vmstat -s

Segmentation fault (core dumped)

------------------------------------------------------------------------
vmstat -m

Segmentation fault (core dumped)

------------------------------------------------------------------------
vmstat -z

Segmentation fault (core dumped)

------------------------------------------------------------------------
vmstat -i

Segmentation fault (core dumped)

------------------------------------------------------------------------
pstat -T

pstat: undefined symbol: _constty
pstat: undefined symbol: _maxfiles
pstat: undefined symbol: _openfiles
pstat: undefined symbol: _tty_list

------------------------------------------------------------------------
pstat -s

pstat: undefined symbol: _constty
pstat: undefined symbol: _maxfiles
pstat: undefined symbol: _openfiles
pstat: undefined symbol: _tty_list

------------------------------------------------------------------------
iostat

iostat: readkmem: error reading value (kvm_read): invalid address (0x0)
devstat_checkversion: userland devstat version 6 is not the same as the kernel
devstat_checkversion: devstat version -1
devstat_checkversion: libdevstat newer than kernel


------------------------------------------------------------------------
ipcs -a

Message Queues:
T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP                 CBYTES                 QNUM               QBYTES        LSPID        LRPID STIME    RTIME    CTIME

Shared Memory:
T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP         NATTCH        SEGSZ         CPID         LPID ATIME    DTIME    CTIME

Semaphores:
T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP          NSEMS OTIME    CTIME


------------------------------------------------------------------------
ipcs -T

msginfo:
 	msgmax:        16384	(max characters in a message)
 	msgmni:           40	(# of message queues)
 	msgmnb:         2048	(max characters in a message queue)
 	msgtql:           40	(max # of messages in system)
 	msgssz:            8	(size of a message segment)
 	msgseg:         2048	(# of message segments in system)

shminfo:
 	shmmax:    536870912	(max shared memory segment size)
 	shmmin:            1	(min shared memory segment size)
 	shmmni:          192	(max number of shared memory identifiers)
 	shmseg:          128	(max shared memory segments per process)
 	shmall:       131072	(max amount of shared memory in pages)

seminfo:
 	semmni:           50	(# of semaphore identifiers)
 	semmns:          340	(# of semaphores in system)
 	semmnu:          150	(# of undo structures in system)
 	semmsl:          340	(max # of semaphores per id)
 	semopm:          100	(max # of operations per semop call)
 	semume:           50	(max # of undo entries per process)
 	semusz:          632	(size in bytes of undo structure)
 	semvmx:        32767	(semaphore maximum value)
 	semaem:        16384	(adjust on exit max value)


------------------------------------------------------------------------
netstat -s

tcp:
 	0 packets sent
 		0 data packets (0 bytes)
 		0 data packets (0 bytes) retransmitted
 		0 data packets unnecessarily retransmitted
 		0 resends initiated by MTU discovery
 		0 ack-only packets (0 delayed)
 		0 URG only packets
 		0 window probe packets
 		0 window update packets
 		0 control packets
 	0 packets received
 		0 acks (for 0 bytes)
 		0 duplicate acks
 		0 UDP tunneled pkts
 		0 UDP tunneled pkt cnt with errors
 		0 acks for data not yet sent
 		0 acks for data never been sent (ghost acks)
 		0 acks for data being too old
 		0 packets (0 bytes) received in-sequence
 		0 completely duplicate packets (0 bytes)
 		0 old duplicate packets
 		0 packets with some dup. data (0 bytes duped)
 		0 out-of-order packets (0 bytes)
 		0 packets (0 bytes) of data after window
 		0 window probes
 		0 window update packets
 		0 packets received with dsack
 		0 dsack bytes received (no TLP involved)
 		0 dsack bytes received (TLP responsible)
 		0 packets received after close
 		0 discarded for bad checksums
 		0 discarded for bad header offset fields
 		0 discarded because packet too short
 		0 discarded due to full reassembly queue
 	0 connection requests
 	0 connection accepts
 	0 bad connection attempts
 	0 listen queue overflows
 	0 ignored RSTs in the windows
 	0 connections established (including accepts)
 		0 times used RTT from hostcache
 		0 times used RTT variance from hostcache
 		0 times used slow-start threshold from hostcache
 	0 connections closed (including 0 drops)
 		0 connections updated cached RTT on close
 		0 connections updated cached RTT variance on close
 		0 connections updated cached ssthresh on close
 	0 embryonic connections dropped
 	0 segments updated rtt (of 0 attempts)
 	0 retransmit timeouts
 		0 connections dropped by rexmit timeout
 	0 persist timeouts
 		0 connections dropped by persist timeout
 	0 Connections (fin_wait_2) dropped because of timeout
 	0 keepalive timeouts
 		0 keepalive probes sent
 		0 connections dropped by keepalive
 	0 connections dropped due to exceeding progress time
 	0 correct ACK header predictions
 	0 correct data packet header predictions
 	0 syncache entries added
 		0 retransmitted
 		0 dupsyn
 		0 dropped
 		0 completed
 		0 bucket overflow
 		0 cache overflow
 		0 reset
 		0 stale
 		0 aborted
 		0 badack
 		0 unreach
 		0 zone failures
 	0 cookies sent
 		0 cookies received
 		0 spurious cookies rejected
 		0 failed cookies rejected
 	0 hostcache entries added
 		0 bucket overflow
 	0 SACK recovery episodes
 	0 segment rexmits in SACK recovery episodes
 	0 tso chunk rexmits in SACK recovery episodes
 	0 byte rexmits in SACK recovery episodes
 	0 SACK options (SACK blocks) received
 	0 SACK options (SACK blocks) sent
 	0 SACK retransmissions lost
 	0 SACK scoreboard overflow
 	0 packets received with ECN CE bit set
 	0 packets received with ECN ECT(0) bit set
 	0 packets received with ECN ECT(1) bit set
 	0 packets sent with ECN ECT(0) bit set
 	0 packets sent with ECN ECT(1) bit set
 	0 successful ECN handshakes
 	0 times ECN reduced the congestion window
 	0 ACE SYN packets with Non-ECT
 	0 ACE SYN packets with ECT0
 	0 ACE SYN packets with ECT1
 	0 ACE SYN packets with CE
 	0 packets with matching signature received
 	0 packets with bad signature received
 	0 times failed to make signature due to no SA
 	0 times unexpected signature received
 	0 times no signature provided by segment
 	0 Path MTU discovery black hole detection activations
 	0 Path MTU discovery black hole detection min MSS activations
 	0 Path MTU discovery black hole detection failures
 	0 times connection in TIME-WAIT responded with ACK
 	0 times connection in TIME-WAIT was actively recycled
 	0 times connection in TIME-WAIT responded with RST
TCP connection count by state:
 	0 connections in CLOSED state
 	0 connections in LISTEN state
 	0 connections in SYN_SENT state
 	0 connections in SYN_RCVD state
 	0 connections in ESTABLISHED state
 	0 connections in CLOSE_WAIT state
 	0 connections in FIN_WAIT_1 state
 	0 connections in CLOSING state
 	0 connections in LAST_ACK state
 	0 connections in FIN_WAIT_2 state
 	0 connections in TIME_WAIT state
udp:
 	0 datagrams received
 	0 with incomplete header
 	0 with bad data length field
 	0 with bad checksum
 	0 with no checksum
 	0 dropped due to no socket
 	0 broadcast/multicast datagrams undelivered
 	0 dropped due to full socket buffers
 	0 not for hashed pcb
 	0 delivered
 	0 datagrams output
 	0 times multicast source filter matched
ip:
 	0 total packets received
 	0 bad header checksums
 	0 with size smaller than minimum
 	0 with data size < data length
 	0 with ip length > max ip packet size
 	0 with header length < data size
 	0 with data length < header length
 	0 with bad options
 	0 with incorrect version number
 	0 fragments received
 	0 fragments dropped (dup or out of space)
 	0 fragments dropped after timeout
 	0 packets reassembled ok
 	0 packets for this host
 	0 packets for unknown/unsupported protocol
 	0 packets forwarded (0 packets fast forwarded)
 	0 packets not forwardable
 	0 packets received for unknown multicast group
 	0 redirects sent
 	0 packets sent from this host
 	0 packets sent with fabricated ip header
 	0 output packets dropped due to no bufs, etc.
 	0 output packets discarded due to no route
 	0 output datagrams fragmented
 	0 fragments created
 	0 datagrams that can't be fragmented
 	0 tunneling packets that can't find gif
 	0 datagrams with bad address in header
icmp:
 	0 calls to icmp_error
 	0 errors not generated in response to an icmp message
 	0 messages with bad code fields
 	0 messages less than the minimum length
 	0 messages with bad checksum
 	0 messages with bad length
 	0 multicast echo requests ignored
 	0 multicast timestamp requests ignored
 	0 message responses generated
 	0 invalid return addresses
 	0 no return routes
arp:
 	0 ARP requests sent
 	0 ARP requests failed to sent
 	0 ARP replies sent
 	0 ARP requests received
 	0 ARP replies received
 	0 ARP packets received
 	0 total packets dropped due to no ARP entry
 	0 ARP entrys timed out
 	0 Duplicate IPs seen
ip6:
 	0 total packets received
 	0 with size smaller than minimum
 	0 with data size < data length
 	0 with bad options
 	0 with incorrect version number
 	0 fragments received
 	0 fragments dropped (dup or out of space)
 	0 fragments dropped after timeout
 	0 fragments that exceeded limit
 	0 atomic fragments
 	0 packets reassembled ok
 	0 packets for this host
 	0 packets forwarded
 	0 packets not forwardable
 	0 redirects sent
 	0 packets sent from this host
 	0 packets sent with fabricated ip header
 	0 output packets dropped due to no bufs, etc.
 	0 output packets discarded due to no route
 	0 output datagrams fragmented
 	0 fragments created
 	0 datagrams that can't be fragmented
 	0 packets that violated scope rules
 	0 multicast packets which we don't join
 	Mbuf statistics:
 		0 one mbuf
 		0 one ext mbuf
 		0 two or more ext mbuf
 	0 packets whose headers are not contiguous
 	0 tunneling packets that can't find gif
 	0 packets discarded because of too many headers
 	0 failures of source address selection
icmp6:
 	0 calls to icmp6_error
 	0 errors not generated in response to an icmp6 message
 	0 errors not generated because of rate limitation
 	0 messages with bad code fields
 	0 messages < minimum length
 	0 bad checksums
 	0 messages with bad length
 	0 total packets dropped due to failed NDP resolution
 	Histogram of error messages to be generated:
 		0 no route
 		0 administratively prohibited
 		0 beyond scope
 		0 address unreachable
 		0 port unreachable
 		0 packet too big
 		0 time exceed transit
 		0 time exceed reassembly
 		0 erroneous header field
 		0 unrecognized next header
 		0 unrecognized option
 		0 redirect
 		0 unknown
 	0 message responses generated
 	0 messages with too many ND options
 	0 messages with bad ND options
 	0 bad neighbor solicitation messages
 	0 bad neighbor advertisement messages
 	0 bad router solicitation messages
 	0 bad router advertisement messages
 	0 bad redirect messages
 	0 default routers overflows
 	0 prefix overflows
 	0 neighbour entries overflows
 	0 redirect overflows
 	0 messages with invalid hop limit
 	0 path MTU changes
rip6:
 	0 messages received
 	0 checksum calculations on inbound
 	0 messages with bad checksum
 	0 messages dropped due to no socket
 	0 multicast messages dropped due to no socket
 	0 messages dropped due to full socket buffers
 	0 delivered
 	0 datagrams output
pfkey:
 	0 requests sent from userland
 	0 bytes sent from userland
 	0 messages with invalid length field
 	0 messages with invalid version field
 	0 messages with invalid message type field
 	0 messages too short
 	0 messages with memory allocation failure
 	0 messages with duplicate extension
 	0 messages with invalid extension type
 	0 messages with invalid sa type
 	0 messages with invalid address extension
 	0 requests sent to userland
 	0 bytes sent to userland
 	0 messages toward single socket
 	0 messages toward all sockets
 	0 messages toward registered sockets
 	0 messages with memory allocation failure

------------------------------------------------------------------------
netstat -m

netstat: memstat_kvm_all:

------------------------------------------------------------------------
netstat -anA


------------------------------------------------------------------------
netstat -aL


------------------------------------------------------------------------
fstat

fstat: procstat_getprocs()

------------------------------------------------------------------------
dmesg

dmesg: /boot/nvmekernel/kernel: msgbufp not found

------------------------------------------------------------------------
kernel config

options	CONFIG_AUTOGENERATED
ident	GENERIC
machine	amd64
cpu	HAMMER
makeoptions	WITH_CTF=1
makeoptions	DEBUG=-g
options	ALT_BREAK_TO_DEBUGGER
options	IICHID_SAMPLING
options	HID_DEBUG
options	EVDEV_SUPPORT
options	XENHVM
options	USB_DEBUG
options	IWN_DEBUG
options	AH_AR5416_INTERRUPT_MITIGATION
options	IEEE80211_SUPPORT_MESH
options	IEEE80211_DEBUG
options	SC_PIXEL_MODE
options	PPS_SYNC
options	COMPAT_LINUXKPI
options	PCI_IOV
options	PCI_HP
options	IOMMU
options	ACPI_DEBUG
options	SMP
options	NETGDB
options	NETDUMP
options	DEBUGNET
options	ZSTDIO
options	GZIO
options	EKCD
options	VERBOSE_SYSINIT=0
options	MALLOC_DEBUG_MAXZONES=8
options	QUEUE_MACRO_DEBUG_TRASH
options	DEADLKRES
options	GDB
options	FULL_BUF_TRACKING
options	DDB
options	BUF_TRACKING
options	KDB_TRACE
options	KDB
options	RCTL
options	RACCT_DEFAULT_TO_DISABLED
options	RACCT
options	INCLUDE_CONFIG_FILE
options	DDB_CTF
options	KDTRACE_HOOKS
options	KDTRACE_FRAME
options	MAC
options	CAPABILITIES
options	CAPABILITY_MODE
options	AUDIT
options	HWPMC_HOOKS
options	KBD_INSTALL_CDEV
options	PRINTF_BUFR_SIZE=128
options	_KPOSIX_PRIORITY_SCHEDULING
options	SYSVSEM
options	SYSVMSG
options	SYSVSHM
options	STACK
options	KTRACE
options	SCSI_DELAY=5000
options	COMPAT_FREEBSD14
options	COMPAT_FREEBSD13
options	COMPAT_FREEBSD12
options	COMPAT_FREEBSD11
options	COMPAT_FREEBSD10
options	COMPAT_FREEBSD9
options	COMPAT_FREEBSD7
options	COMPAT_FREEBSD6
options	COMPAT_FREEBSD5
options	COMPAT_FREEBSD4
options	COMPAT_FREEBSD32
options	EFIRT
options	GEOM_LABEL
options	GEOM_RAID
options	TMPFS
options	PSEUDOFS
options	PROCFS
options	CD9660
options	MSDOSFS
options	NFS_ROOT
options	NFSLOCKD
options	NFSD
options	NFSCL
options	MD_ROOT
options	QUOTA
options	UFS_GJOURNAL
options	UFS_DIRHASH
options	UFS_ACL
options	SOFTUPDATES
options	FFS
options	KERN_TLS
options	SCTP_SUPPORT
options	TCP_RFC7413
options	TCP_HHOOK
options	TCP_BLACKBOX
options	TCP_OFFLOAD
options	FIB_ALGO
options	IPSEC_SUPPORT
options	INET6
options	INET
options	VIMAGE
options	PREEMPTION
options	NUMA
options	SCHED_ULE
options	NETLINK
options	CC_CUBIC
options	GEOM_PART_GPT
options	GEOM_PART_MBR
options	GEOM_PART_EBR
options	GEOM_PART_BSD
options	EARLY_AP_STARTUP
options	EARLY_AP_STARTUP
device	isa
device	mem
device	io
device	uart_ns8250
device	cpufreq
device	acpi
device	smbios
device	pci
device	fdc
device	ahci
device	ata
device	mvs
device	siis
device	ahc
device	ahd
device	hptiop
device	isp
device	mpt
device	mps
device	mpr
device	sym
device	isci
device	ocs_fc
device	pvscsi
device	scbus
device	ch
device	da
device	sa
device	cd
device	pass
device	ses
device	arcmsr
device	ciss
device	ips
device	smartpqi
device	tws
device	aac
device	aacp
device	aacraid
device	ida
device	mfi
device	mlx
device	mrsas
device	pmspcv
device	nvme
device	nvd
device	vmd
device	atkbdc
device	atkbd
device	psm
device	kbdmux
device	vga
device	splash
device	sc
device	vt
device	vt_vga
device	vt_efifb
device	vt_vbefb
device	agp
device	cbb
device	cardbus
device	uart
device	ppc
device	ppbus
device	lpt
device	ppi
device	puc
device	iflib
device	em
device	igc
device	ix
device	ixv
device	ixl
device	iavf
device	ice
device	vmx
device	axp
device	bxe
device	ti
device	mlx5
device	mlxfw
device	mlx5en
device	mdio
device	miibus
device	ae
device	age
device	alc
device	ale
device	bce
device	bfe
device	bge
device	cas
device	dc
device	et
device	fxp
device	gem
device	jme
device	lge
device	msk
device	nfe
device	nge
device	re
device	rl
device	sge
device	sis
device	sk
device	ste
device	stge
device	vge
device	vr
device	xl
device	wlan
device	wlan_wep
device	wlan_ccmp
device	wlan_tkip
device	wlan_amrr
device	ath
device	ath_hal
device	ath_rate_sample
device	ipw
device	iwi
device	iwn
device	malo
device	mwl
device	ral
device	wpi
device	crypto
device	aesni
device	loop
device	rdrand_rng
device	ether
device	vlan
device	tuntap
device	md
device	gif
device	firmware
device	xz
device	bpf
device	uhci
device	ohci
device	ehci
device	xhci
device	usb
device	ukbd
device	umass
device	sound
device	snd_cmi
device	snd_csa
device	snd_emu10kx
device	snd_es137x
device	snd_hda
device	snd_ich
device	snd_via8233
device	mmc
device	mmcsd
device	sdhci
device	rtsx
device	virtio
device	virtio_pci
device	vtnet
device	virtio_blk
device	virtio_scsi
device	virtio_balloon
device	kvm_clock
device	hyperv
device	xenpci
device	xentimer
device	netmap
device	evdev
device	uinput
device	hid
device	firewire
device	dcons
device	dcons_crom

------------------------------------------------------------------------
ddb capture buffer

ddb: ddb_capture: kvm_nlist
smime.p7s (application/pkcs7-signature, 2.7 KB) - not displayed
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.