Bug#1064347: openssh-server: sshd crashes under heavy traffic
George Kissandrakis <[email protected]>
| Newsgroups | gmane.linux.debian.devel.ssh |
|---|---|
| Message-ID | <170844242742.109449.15843250325212864901.reportbug__7663.62552983395$1708442855$gmane$org@ecmif01.muc.domeus.com> |
Package: openssh-server Version: 1:8.4p1-5+deb11u3 Severity: normal X-Debbugs-Cc: [email protected] Dear Maintainer, * What led up to the situation? We have a public facing sftp server for our customers After upgrading Debian 10 to Debian 11, sshd is crashing under heavy traffic * What exactly did you do (or not do) that was effective (or ineffective)? I tried reconfigure timeouts, keepalives etc but none worked * What was the outcome of this action? No change * What outcome did you expect instead? Not sure Very similar (or the same) with https://bugs.launchpad.net/ubuntu/+source/openssh/+bug/2043114 -- System Information: Debian Release: 11.9 APT prefers oldstable-updates APT policy: (500, 'oldstable-updates'), (500, 'oldstable-security'), (500, 'oldstable') Architecture: amd64 (x86_64) Kernel: Linux 5.10.0-28-amd64 (SMP w/8 CPU threads) Locale: LANG=en_US, LC_CTYPE=en_US (charmap=UTF-8) (ignored: LC_ALL set to en_US.UTF-8), LANGUAGE=en_US:en Shell: /bin/sh linked to /bin/dash Init: systemd (via /run/systemd/system) LSM: AppArmor: enabled Versions of packages openssh-server depends on: ii adduser 3.118+deb11u1 ii debconf [debconf-2.0] 1.5.77 ii dpkg 1.20.13 ii libaudit1 1:3.0-2 ii libc6 2.31-13+deb11u8 ii libcom-err2 1.46.2-2 ii libcrypt1 1:4.4.18-4 ii libgssapi-krb5-2 1.18.3-6+deb11u4 ii libkrb5-3 1.18.3-6+deb11u4 ii libpam-modules 1.4.0-9+deb11u1 ii libpam-runtime 1.4.0-9+deb11u1 ii libpam0g 1.4.0-9+deb11u1 ii libselinux1 3.1-3 ii libssl1.1 1.1.1w-0+deb11u1 ii libsystemd0 247.3-7+deb11u4 ii libwrap0 7.6.q-31 ii lsb-base 11.1.0 ii openssh-client 1:8.4p1-5+deb11u3 ii openssh-sftp-server 1:8.4p1-5+deb11u3 ii procps 2:3.3.17-5 ii runit-helper 2.10.3 ii ucf 3.0043 ii zlib1g 1:1.2.11.dfsg-2+deb11u2 Versions of packages openssh-server recommends: ii libpam-systemd [logind] 247.3-7+deb11u4 ii ncurses-term 6.2+20201114-2+deb11u2 ii xauth 1:1.1-1 Versions of packages openssh-server suggests: pn molly-guard <none> pn monkeysphere <none> pn ssh-askpass <none> pn ufw <none> -- Configuration Files: /etc/pam.d/sshd changed [not included] -- debconf information excluded
sshd_logs.txt
(text/plain, 4.1 KB)
kern.log:Feb 19 22:29:40 ecmif01 kernel: [ 2288.914649] traps: sshd[72022] general protection fault ip:7f6b8116d3b7 sp:7fff87eb22f0 error:0 in libc-2.31.so[7f6b8110d000+159000] kern.log:Feb 19 22:46:04 ecmif01 kernel: [ 3272.826055] traps: sshd[98328] general protection fault ip:7f5e5c0433b7 sp:7fff4d3109f0 error:0 in libc-2.31.so[7f5e5bfe3000+159000] kern.log:Feb 19 23:14:08 ecmif01 kernel: [ 4956.789461] traps: sshd[152300] general protection fault ip:7f62249523b7 sp:7ffc761c4300 error:0 in libc-2.31.so[7f62248f2000+159000] kern.log:Feb 20 01:37:02 ecmif01 kernel: [13531.048898] sshd[437092]: segfault at 5618ab5283c8 ip 00007f5f0a4a937f sp 00007ffd30ac6640 error 4 in libc-2.31.so[7f5f0a449000+159000] kern.log:Feb 20 01:37:02 ecmif01 kernel: [13531.049177] Code: 00 00 eb a3 0f 1f 80 00 00 00 00 ff d0 eb c5 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 83 ec 08 48 8b 4f 08 48 89 c8 48 83 e0 f8 <48> 3b 04 07 0f 85 91 00 00 00 48 8b 47 10 48 8b 57 18 48 3b 78 18 kern.log:Feb 20 02:03:10 ecmif01 kernel: [15098.671459] traps: sshd[488901] general protection fault ip:7ff8c0fb23b7 sp:7ffdc8d60140 error:0 in libc-2.31.so[7ff8c0f52000+159000] kern.log:Feb 20 02:13:08 ecmif01 kernel: [15696.975972] sshd[496790]: segfault at 562609c87458 ip 00007f7645a4c37f sp 00007ffe0c52ee90 error 4 in libc-2.31.so[7f76459ec000+159000] kern.log:Feb 20 02:13:08 ecmif01 kernel: [15696.976252] Code: 00 00 eb a3 0f 1f 80 00 00 00 00 ff d0 eb c5 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 83 ec 08 48 8b 4f 08 48 89 c8 48 83 e0 f8 <48> 3b 04 07 0f 85 91 00 00 00 48 8b 47 10 48 8b 57 18 48 3b 78 18 kern.log:Feb 20 04:32:05 ecmif01 kernel: [24033.447133] traps: sshd[759145] general protection fault ip:7f6ebe48e3b7 sp:7ffe40a2cf30 error:0 in libc-2.31.so[7f6ebe42e000+159000] kern.log:Feb 20 04:46:01 ecmif01 kernel: [24869.466121] traps: sshd[804956] general protection fault ip:7f926c9863b7 sp:7fffdc0400a0 error:0 in libc-2.31.so[7f926c926000+159000] kern.log:Feb 20 05:16:14 ecmif01 kernel: [26682.432389] traps: sshd[871829] general protection fault ip:7f4ea598b3b7 sp:7ffd003bccf0 error:0 in libc-2.31.so[7f4ea592b000+159000] kern.log:Feb 20 05:58:09 ecmif01 kernel: [29197.006583] traps: sshd[978131] general protection fault ip:7f11eb09c3b7 sp:7ffefa5baaa0 error:0 in libc-2.31.so[7f11eb03c000+159000] kern.log:Feb 20 07:02:05 ecmif01 kernel: [33033.374881] traps: sshd[1111989] general protection fault ip:7fc463ef43b7 sp:7ffe79095300 error:0 in libc-2.31.so[7fc463e94000+159000] kern.log:Feb 20 07:28:04 ecmif01 kernel: [34591.766611] traps: sshd[1159773] general protection fault ip:7ff705eaf3b7 sp:7ffeda7a4a70 error:0 in libc-2.31.so[7ff705e4f000+159000] kern.log:Feb 20 07:43:06 ecmif01 kernel: [35494.141287] traps: sshd[1187041] general protection fault ip:7fb0d52733b7 sp:7ffe4f2feed0 error:0 in libc-2.31.so[7fb0d5213000+159000] kern.log:Feb 20 08:03:05 ecmif01 kernel: [36693.125865] traps: sshd[1233277] general protection fault ip:7fb5d11203b7 sp:7ffcc0a30a00 error:0 in libc-2.31.so[7fb5d10c0000+159000] kern.log:Feb 20 08:10:13 ecmif01 kernel: [37121.193921] traps: sshd[1235191] general protection fault ip:7ff6d12d23b7 sp:7ffd0ba8fba0 error:0 in libc-2.31.so[7ff6d1272000+159000] kern.log:Feb 20 09:14:01 ecmif01 kernel: [40949.428987] traps: sshd[1396212] general protection fault ip:7fcd362c13b7 sp:7ffc1fcb1c50 error:0 in libc-2.31.so[7fcd36261000+159000] kern.log:Feb 20 09:51:04 ecmif01 kernel: [43171.621958] sshd[1458137]: segfault at 564e518af968 ip 00007f36e653937f sp 00007ffed4b16e90 error 4 in libc-2.31.so[7f36e64d9000+159000] kern.log:Feb 20 09:51:04 ecmif01 kernel: [43171.625258] Code: 00 00 eb a3 0f 1f 80 00 00 00 00 ff d0 eb c5 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 83 ec 08 48 8b 4f 08 48 89 c8 48 83 e0 f8 <48> 3b 04 07 0f 85 91 00 00 00 48 8b 47 10 48 8b 57 18 48 3b 78 18 kern.log:Feb 20 11:20:15 ecmif01 kernel: [48523.413848] traps: sshd[1636274] general protection fault ip:7fdf166443b7 sp:7fffd2d00130 error:0 in libc-2.31.so[7fdf165e4000+159000] kern.log:Feb 20 11:37:02 ecmif01 kernel: [49530.237781] traps: sshd[1651031] general protection fault ip:7eff523f83b7 sp:7ffc5d48dfa0 error:0 in libc-2.31.so[7eff52398000+159000]
sshd_logs.txt
(text/plain, 4.1 KB)
kern.log:Feb 19 22:29:40 ecmif01 kernel: [ 2288.914649] traps: sshd[72022] general protection fault ip:7f6b8116d3b7 sp:7fff87eb22f0 error:0 in libc-2.31.so[7f6b8110d000+159000] kern.log:Feb 19 22:46:04 ecmif01 kernel: [ 3272.826055] traps: sshd[98328] general protection fault ip:7f5e5c0433b7 sp:7fff4d3109f0 error:0 in libc-2.31.so[7f5e5bfe3000+159000] kern.log:Feb 19 23:14:08 ecmif01 kernel: [ 4956.789461] traps: sshd[152300] general protection fault ip:7f62249523b7 sp:7ffc761c4300 error:0 in libc-2.31.so[7f62248f2000+159000] kern.log:Feb 20 01:37:02 ecmif01 kernel: [13531.048898] sshd[437092]: segfault at 5618ab5283c8 ip 00007f5f0a4a937f sp 00007ffd30ac6640 error 4 in libc-2.31.so[7f5f0a449000+159000] kern.log:Feb 20 01:37:02 ecmif01 kernel: [13531.049177] Code: 00 00 eb a3 0f 1f 80 00 00 00 00 ff d0 eb c5 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 83 ec 08 48 8b 4f 08 48 89 c8 48 83 e0 f8 <48> 3b 04 07 0f 85 91 00 00 00 48 8b 47 10 48 8b 57 18 48 3b 78 18 kern.log:Feb 20 02:03:10 ecmif01 kernel: [15098.671459] traps: sshd[488901] general protection fault ip:7ff8c0fb23b7 sp:7ffdc8d60140 error:0 in libc-2.31.so[7ff8c0f52000+159000] kern.log:Feb 20 02:13:08 ecmif01 kernel: [15696.975972] sshd[496790]: segfault at 562609c87458 ip 00007f7645a4c37f sp 00007ffe0c52ee90 error 4 in libc-2.31.so[7f76459ec000+159000] kern.log:Feb 20 02:13:08 ecmif01 kernel: [15696.976252] Code: 00 00 eb a3 0f 1f 80 00 00 00 00 ff d0 eb c5 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 83 ec 08 48 8b 4f 08 48 89 c8 48 83 e0 f8 <48> 3b 04 07 0f 85 91 00 00 00 48 8b 47 10 48 8b 57 18 48 3b 78 18 kern.log:Feb 20 04:32:05 ecmif01 kernel: [24033.447133] traps: sshd[759145] general protection fault ip:7f6ebe48e3b7 sp:7ffe40a2cf30 error:0 in libc-2.31.so[7f6ebe42e000+159000] kern.log:Feb 20 04:46:01 ecmif01 kernel: [24869.466121] traps: sshd[804956] general protection fault ip:7f926c9863b7 sp:7fffdc0400a0 error:0 in libc-2.31.so[7f926c926000+159000] kern.log:Feb 20 05:16:14 ecmif01 kernel: [26682.432389] traps: sshd[871829] general protection fault ip:7f4ea598b3b7 sp:7ffd003bccf0 error:0 in libc-2.31.so[7f4ea592b000+159000] kern.log:Feb 20 05:58:09 ecmif01 kernel: [29197.006583] traps: sshd[978131] general protection fault ip:7f11eb09c3b7 sp:7ffefa5baaa0 error:0 in libc-2.31.so[7f11eb03c000+159000] kern.log:Feb 20 07:02:05 ecmif01 kernel: [33033.374881] traps: sshd[1111989] general protection fault ip:7fc463ef43b7 sp:7ffe79095300 error:0 in libc-2.31.so[7fc463e94000+159000] kern.log:Feb 20 07:28:04 ecmif01 kernel: [34591.766611] traps: sshd[1159773] general protection fault ip:7ff705eaf3b7 sp:7ffeda7a4a70 error:0 in libc-2.31.so[7ff705e4f000+159000] kern.log:Feb 20 07:43:06 ecmif01 kernel: [35494.141287] traps: sshd[1187041] general protection fault ip:7fb0d52733b7 sp:7ffe4f2feed0 error:0 in libc-2.31.so[7fb0d5213000+159000] kern.log:Feb 20 08:03:05 ecmif01 kernel: [36693.125865] traps: sshd[1233277] general protection fault ip:7fb5d11203b7 sp:7ffcc0a30a00 error:0 in libc-2.31.so[7fb5d10c0000+159000] kern.log:Feb 20 08:10:13 ecmif01 kernel: [37121.193921] traps: sshd[1235191] general protection fault ip:7ff6d12d23b7 sp:7ffd0ba8fba0 error:0 in libc-2.31.so[7ff6d1272000+159000] kern.log:Feb 20 09:14:01 ecmif01 kernel: [40949.428987] traps: sshd[1396212] general protection fault ip:7fcd362c13b7 sp:7ffc1fcb1c50 error:0 in libc-2.31.so[7fcd36261000+159000] kern.log:Feb 20 09:51:04 ecmif01 kernel: [43171.621958] sshd[1458137]: segfault at 564e518af968 ip 00007f36e653937f sp 00007ffed4b16e90 error 4 in libc-2.31.so[7f36e64d9000+159000] kern.log:Feb 20 09:51:04 ecmif01 kernel: [43171.625258] Code: 00 00 eb a3 0f 1f 80 00 00 00 00 ff d0 eb c5 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 83 ec 08 48 8b 4f 08 48 89 c8 48 83 e0 f8 <48> 3b 04 07 0f 85 91 00 00 00 48 8b 47 10 48 8b 57 18 48 3b 78 18 kern.log:Feb 20 11:20:15 ecmif01 kernel: [48523.413848] traps: sshd[1636274] general protection fault ip:7fdf166443b7 sp:7fffd2d00130 error:0 in libc-2.31.so[7fdf165e4000+159000] kern.log:Feb 20 11:37:02 ecmif01 kernel: [49530.237781] traps: sshd[1651031] general protection fault ip:7eff523f83b7 sp:7ffc5d48dfa0 error:0 in libc-2.31.so[7eff52398000+159000]