[mlmmj] Odd message truncation with 1.4.0-rc2

Konstantin Ryabitsev <[email protected]> Wed, 08 Nov 2023 21:58:49 +0000

Newsgroups	org.mlmmj.mlmmj
Message-ID	<mg5alzflgvmkdvjy6sn3jpbnm5fcwy3bt4yx3ppccwlvmpwyq3@cb7xw4s4s64e>

Hi, all:

I had some bad corruption with 1.4.0-rc2 today -- I am trying to figure out
what happened, but I'm not sure I can easily narrow it down. Here's the
description, at least:

The same conversation was sent to 2 lists, both managed by rc2 (+1 commit in
the latest master):

- [email protected]
- [email protected]

They are both configured to invoke /opt/mlmmj/bin/mlmmj* commands, which is
where the rc2 is installed: 

    [email protected] mlmmjopt:ksummit.lists.linux.dev
    [email protected] mlmmjopt:users.linux.kernel.org

From master.cf:

    mlmmjopt  unix  -       n       n       -       -       pipe
        flags=Rhu user=mlmmj argv=/opt/mlmmj/bin/mlmmj-receive -F -L /var/spool/mlmmj/$nexthop

All other lists on that system still use mlmmj-1.3.0 that is in /usr/bin/*.
The only major difference between the two lists is that the users list is set
as "noarchive".

This is the thread in question:
https://lore.kernel.org/ksummit/CAL_Jsq+j1f_MkLaA3WBG-u1oA5gQra4PyoHmpta=gxB94Q1XrQ@mail.gmail.com/T/#m510ece017fcd0f5d413b5a2bb6ef054cede4a7c2

Note, that public-inbox reads the messages directly from the "archive"
directory, so you won't see problems in that thread, just Joe getting
progressively more frustrated because the messages he gets back from the list
are all truncated after this line:

    > BTW, you have joined some of the discussions to these patches in the past.

I can confirm that the same truncation was seen going out to the users@
mailing list, to which I am subscribed from a different address.

I also note that all 4 messages came out with the same ID (865) in the return path:

    Return-Path: <users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org>

So, not only the truncation happened, but the index was not updated between
deliveries, suggesting that the process probably terminated incorrectly.

I attach msg1-msg4, which you can compare to what we have in public-inbox
(which reads directly from the disk in archive/, remember):

msg1.txt: https://lore.kernel.org/ksummit/[email protected]/raw
msg2.txt: https://lore.kernel.org/ksummit/[email protected]/raw
msg3.txt: https://lore.kernel.org/ksummit/[email protected]/raw
msg4.txt: https://lore.kernel.org/ksummit/[email protected]/raw

I am happy to offer any further details or run any further tests, but at this
point I don't think rc2 is ready to go out.

-K

msg1.txt (text/plain, 6.2 KB)

Message-ID: <[email protected]>
Subject: Re: [workflows]Re: [workflows]RFC: switching "THE REST" in
 MAINTAINERS away from [email protected]
From: Joe Perches <[email protected]>
To: Steven Rostedt <[email protected]>
Cc: Mark Brown <[email protected]>, Konstantin Ryabitsev
	 <[email protected]>, [email protected], 
	[email protected]
Date: Wed, 08 Nov 2023 12:14:52 -0800
In-Reply-To: <[email protected]>
References: <20231106-venomous-raccoon-of-wealth-acc57c@nitro>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: quoted-printable
User-Agent: Evolution 3.48.4 (3.48.4-1.fc38) 
Precedence: bulk
MIME-Version: 1.0

On Wed, 2023-11-08 at 15:07 -0500, Steven Rostedt wrote:
> BTW, you have joined some of the discussions to these patches in the past=

msg2.txt (text/plain, 6.5 KB)

Message-ID: <[email protected]>
Subject: Re: [workflows]Re: [workflows]RFC: switching "THE REST" in
 MAINTAINERS away from [email protected]
From: Joe Perches <[email protected]>
To: Steven Rostedt <[email protected]>
Cc: Mark Brown <[email protected]>, Konstantin Ryabitsev
	 <[email protected]>, [email protected], 
	[email protected]
Date: Wed, 08 Nov 2023 12:36:54 -0800
In-Reply-To: <[email protected]>
References: <20231106-venomous-raccoon-of-wealth-acc57c@nitro>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: quoted-printable
User-Agent: Evolution 3.48.4 (3.48.4-1.fc38) 
Precedence: bulk
MIME-Version: 1.0

On Wed, 2023-11-08 at 12:14 -0800, Joe Perches wrote:
> On Wed, 2023-11-08 at 15:07 -0500, Steven Rostedt wrote:

<empty email?  evolution still sucks>

My sent email folder entry for this is:

On Wed, 2023-11-08 at 15:07 -0500, Steven Rostedt wrote:
> BTW, you have joined some of the discussions to these patches in the past=

msg3.txt (text/plain, 6.8 KB)

Return-Path: <users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org>
Delivered-To: [email protected]
Received: from mp10.migadu.com ([2001:41d0:403:4876::])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	by ms13.migadu.com with LMTPS
	id SF31MqDyS2UDhQEAG6o9tA:P1
	(envelope-from <users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org>)
	for <[email protected]>; Wed, 08 Nov 2023 21:42:09 +0100
Received: from aspmx1.migadu.com ([2001:41d0:403:4876::])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	by mp10.migadu.com with LMTPS
	id SF31MqDyS2UDhQEAG6o9tA
	(envelope-from <users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org>)
	for <[email protected]>; Wed, 08 Nov 2023 21:42:08 +0100
Received: from sv.mirrors.kernel.org (sv.mirrors.kernel.org [139.178.88.99])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256)
	(No client certificate requested)
	by aspmx1.migadu.com (Postfix) with ESMTPS id 6C1322244A
	for <[email protected]>; Wed,  8 Nov 2023 21:42:08 +0100 (CET)
Authentication-Results: aspmx1.migadu.com;
	dkim=none;
	dmarc=none;
	spf=pass (aspmx1.migadu.com: domain of "users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org" designates 139.178.88.99 as permitted sender) smtp.mailfrom="users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org"
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev;
	s=key1; t=1699476128;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references:list-id:
	 list-unsubscribe:list-subscribe;
	bh=Q/ufbCNMXkJmSR68W6MsoOhaGZf1oY0RZdWFde6QXEg=;
	b=XGjLu4meMhwjSNhkA2HPHaWerjvEGGaZfL/C2HyAwvXtl3euTQtDh1b36kpge3jJdLaxkp
	unLsPrZvLgn4HeLJU+xRFgffJyyq2xSPKwDzajxSQemoyDCvNkUQey9HC3+z8TEhjULcol
	XbhMiReDXGxxKMbjlpHWeKGWTU0YGME=
ARC-Authentication-Results: i=1;
	aspmx1.migadu.com;
	dkim=none;
	dmarc=none;
	spf=pass (aspmx1.migadu.com: domain of "users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org" designates 139.178.88.99 as permitted sender) smtp.mailfrom="users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org"
ARC-Seal: i=1; s=key1; d=linux.dev; t=1699476128; a=rsa-sha256; cv=none;
	b=ATr8YohMfvF3hR4IO1xwn4bL1ZyuT2Ct8gJO+b+US3nWLw+ZNXgdWG8Qdmbihn5JTtBQJ6
	yo97LJgBikTwDMGag/mXbxxXepG2TQrZQB6UzpcsanfAK2ui8hJP6UrtfQjM4u1Is3jXD6
	A0t819wOeQa6ZISmihLmVRgC1Q6s4KA=
Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by sv.mirrors.kernel.org (Postfix) with ESMTPS id 5AF042815E0
	for <[email protected]>; Wed,  8 Nov 2023 20:42:06 +0000 (UTC)
Received: from localhost.localdomain (localhost.localdomain [127.0.0.1])
	by smtp.subspace.kernel.org (Postfix) with ESMTP id 716C430F94;
	Wed,  8 Nov 2023 20:42:04 +0000 (UTC)
Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by smtp.subspace.kernel.org (Postfix) with ESMTPS id 98B393715F
	for <[email protected]>; Wed,  8 Nov 2023 20:42:01 +0000 (UTC)
Authentication-Results: smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=perches.com
Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=perches.com
Received: from omf07.hostedemail.com (a10.router.float.18 [10.200.18.1])
	by unirelay10.hostedemail.com (Postfix) with ESMTP id 08DC7C0C52;
	Wed,  8 Nov 2023 20:41:59 +0000 (UTC)
Received: from [HIDDEN] (Authenticated sender: [email protected]) by omf07.hostedemail.com (Postfix) with ESMTPA id DA35020024;
	Wed,  8 Nov 2023 20:41:56 +0000 (UTC)
Message-ID: <[email protected]>
Subject: Re: [workflows]Re: [workflows]RFC: switching "THE REST" in
 MAINTAINERS away from [email protected]
From: Joe Perches <[email protected]>
To: Steven Rostedt <[email protected]>
Cc: Mark Brown <[email protected]>, Konstantin Ryabitsev
	 <[email protected]>, [email protected], 
	[email protected]
Date: Wed, 08 Nov 2023 12:41:55 -0800
In-Reply-To: <[email protected]>
References: <20231106-venomous-raccoon-of-wealth-acc57c@nitro>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: quoted-printable
User-Agent: Evolution 3.48.4 (3.48.4-1.fc38) 
Precedence: bulk
X-Mailing-List: [email protected]
List-Id: <users.linux.kernel.org>
List-Subscribe: <mailto:[email protected]>
List-Unsubscribe: <mailto:[email protected]>
MIME-Version: 1.0
X-Rspamd-Server: rspamout03
X-Rspamd-Queue-Id: DA35020024
X-Stat-Signature: k3fpnyofdpfa1go1cwe4qx1r5dzgf8qq
X-Session-Marker: 6A6F6540706572636865732E636F6D
X-Session-ID: U2FsdGVkX18AZJeauIe8gsf6+XqfTrqV/JCMwRkJw0I=
X-HE-Tag: 1699476116-185375
X-HE-Meta: U2FsdGVkX1/i1uZ9DMu9qgMxF7OUBasMmiC+Yj4KBjyxNipepnS2bvmWox7raJZ7YnjsuOu3zKTXybZ4WZHs1Aclf6t6TErPMvMeahn19aCHIe/IAZBaU7oCq5VaFFXQ6WkBrUxYvQVKl4vW2uwffwD/aUA28URB273EjtEVbhuP9zi/dAML77UzucyKJvdo8fqX2Wxk/j52KTNRkVGaDqI1UNrxBErKmWEwtonERQWsK7bT1/RQ821XLPZcC7uC3NTbsf5JY8bN+X76++hGOjeHNlktlaHZhmMkgnzyK64PhbHywJ/y7BftaVJD2m6Q3q8BAKfXO0HhRcfkhfL9QDxntzMwnxXVgkCglfT8TR3iiaRfmAgGZiy2FFSJQfFwNRCNzybxOKY+Tm6nQS4L3fz9KCpvRxz/YmvP7QXDLkmw5J0GMBLMpw/TNqzKBP7r
X-Migadu-Flow: FLOW_IN
X-Migadu-Country: US
X-Migadu-Spam-Score: -6.57
X-Spam-Score: -6.57
X-Migadu-Queue-Id: 6C1322244A
X-Migadu-Scanner: mx10.migadu.com

On Wed, 2023-11-08 at 15:07 -0500, Steven Rostedt wrote:
> On Wed, 8 Nov 2023 14:34:47 -0500
> Steven Rostedt <[email protected]> wrote:
>=20
> > I use to only do discussions on LKML and have myself Cc'd (or Cc myself=
 in
> > the discussions), but then I couldn't manage the patches from my inbox.=
 So
> > I set up the mailing list and added that to be Cc'd too in MAINTAINERS,=
 so
> > that everything goes to the other mailing list as well. That would then=
 keep
> > the patches in patchwork, but the discussions would still be visible to=
 the
> > general audience on LKML.
>=20
> BTW, you have joined some of the discussions to these patches in the past=

msg4.txt (text/plain, 6.9 KB)

Return-Path: <users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org>
Delivered-To: [email protected]
Received: from mp10.migadu.com ([2001:41d0:303:e16b::])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	by ms13.migadu.com with LMTPS
	id CH9fI1b0S2VUBgAAG6o9tA:P1
	(envelope-from <users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org>)
	for <[email protected]>; Wed, 08 Nov 2023 21:49:26 +0100
Received: from aspmx1.migadu.com ([2001:41d0:303:e16b::])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	by mp10.migadu.com with LMTPS
	id CH9fI1b0S2VUBgAAG6o9tA
	(envelope-from <users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org>)
	for <[email protected]>; Wed, 08 Nov 2023 21:49:26 +0100
Received: from sy.mirrors.kernel.org (sy.mirrors.kernel.org [IPv6:2604:1380:40f1:3f00::1])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256)
	(No client certificate requested)
	by aspmx1.migadu.com (Postfix) with ESMTPS id 9DD5741E8E
	for <[email protected]>; Wed,  8 Nov 2023 21:49:25 +0100 (CET)
Authentication-Results: aspmx1.migadu.com;
	dkim=none;
	spf=pass (aspmx1.migadu.com: domain of "users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org" designates 2604:1380:40f1:3f00::1 as permitted sender) smtp.mailfrom="users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org";
	dmarc=none
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev;
	s=key1; t=1699476566;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references:list-id:
	 list-unsubscribe:list-subscribe;
	bh=uqj1YM9BxJ3EmsI0IpaFbLi0fhJJ7zRDuVYh5UsInYA=;
	b=M2IazwvlhaD0lSaiLboe+vUBoyNKJg1BjHJkAFPX7OwvU6arqAoJI81Cjwxaoe0fVQEcTH
	JO9iGV/HVQoHkasF4i+9/6NTkKwGgvSsP2I/th9tuPvFdVYpt36FKjUdroBlzFCd3+ukeE
	Pe9wdU3m1GGoSNN2ysyXh/EKA9KYYY4=
ARC-Authentication-Results: i=1;
	aspmx1.migadu.com;
	dkim=none;
	spf=pass (aspmx1.migadu.com: domain of "users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org" designates 2604:1380:40f1:3f00::1 as permitted sender) smtp.mailfrom="users+bounces-865-konstantin.ryabitsev=linux.dev@linux.kernel.org";
	dmarc=none
ARC-Seal: i=1; s=key1; d=linux.dev; t=1699476566; a=rsa-sha256; cv=none;
	b=upH4sDdJzsaYcnFaE2ClQHZ2afdbA0rNwVzzJkYIp8CEfG6wQ5sJD3aJc+PPr4WBAAOnOr
	5SmlHkb8f8iLM0fAZ1iVng2E4hTbM4msyD2f08sBxxUkxh/1VzZV8PBkgNsl/em2Q0ugEe
	r7haeDEqhM3xpmovw5rYP9UznEouhAo=
Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by sy.mirrors.kernel.org (Postfix) with ESMTPS id E4BDFB20CC6
	for <[email protected]>; Wed,  8 Nov 2023 20:49:22 +0000 (UTC)
Received: from localhost.localdomain (localhost.localdomain [127.0.0.1])
	by smtp.subspace.kernel.org (Postfix) with ESMTP id 0C0F332C80;
	Wed,  8 Nov 2023 20:49:20 +0000 (UTC)
Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by smtp.subspace.kernel.org (Postfix) with ESMTPS id 1C92632C65
	for <[email protected]>; Wed,  8 Nov 2023 20:49:17 +0000 (UTC)
Authentication-Results: smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=perches.com
Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=perches.com
Received: from omf09.hostedemail.com (a10.router.float.18 [10.200.18.1])
	by unirelay02.hostedemail.com (Postfix) with ESMTP id C4443120CD9;
	Wed,  8 Nov 2023 20:49:16 +0000 (UTC)
Received: from [HIDDEN] (Authenticated sender: [email protected]) by omf09.hostedemail.com (Postfix) with ESMTPA id C6EEC20028;
	Wed,  8 Nov 2023 20:49:14 +0000 (UTC)
Message-ID: <[email protected]>
Subject: Re: [workflows]Re: [workflows]RFC: switching "THE REST" in
 MAINTAINERS away from [email protected]
From: Joe Perches <[email protected]>
To: Steven Rostedt <[email protected]>
Cc: Mark Brown <[email protected]>, Konstantin Ryabitsev
	 <[email protected]>, [email protected], 
	[email protected]
Date: Wed, 08 Nov 2023 12:49:13 -0800
In-Reply-To: <[email protected]>
References: <20231106-venomous-raccoon-of-wealth-acc57c@nitro>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
	 <[email protected]>
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: quoted-printable
User-Agent: Evolution 3.48.4 (3.48.4-1.fc38) 
Precedence: bulk
X-Mailing-List: [email protected]
List-Id: <users.linux.kernel.org>
List-Subscribe: <mailto:[email protected]>
List-Unsubscribe: <mailto:[email protected]>
MIME-Version: 1.0
X-Stat-Signature: wggy5taj9mqmfuogtmx86hxuqtjersgu
X-Rspamd-Server: rspamout05
X-Rspamd-Queue-Id: C6EEC20028
X-Session-Marker: 6A6F6540706572636865732E636F6D
X-Session-ID: U2FsdGVkX18qiRppxu1mpwr+5NB2JHzz3NOuJetDjYA=
X-HE-Tag: 1699476554-505269
X-HE-Meta: U2FsdGVkX193d8Q2Sn59pLyTbcaJg32Oj+bO1gmFJ5JP2j6WyXvkSIb60cu1dhTm1WaWnt3WajwVKQdt/VTuQRUzLl3FRPXwBhIgPBsKmDh1aQ7rM5kltFh8Mo7s6pARtKMNsEAsrc6vzbub2rUN+aeUgyNklRmrv4ltzBP7Nmw/uQuHQZY/OgzqVW/yacl20Y+gRAHIdhzO7ubeV7TqZfeoxCGhcarNU2LJvyJrfqGNTOCA1Rqu13uAxLrsyUkp51sTb3zyolqr/itYIq5O0zdI13zZ+dqVfAsViWTek++gix15JbvgxvnS4cggUg+1z4SLWphq68NkNqdw3/MdefCraeAwApiaTKpEoMdfPa7Ml+iyxHDw0I8quBQJmPH1
X-Migadu-Flow: FLOW_IN
X-Migadu-Country: US
X-Migadu-Spam-Score: -7.22
X-Spam-Score: -7.22
X-Migadu-Queue-Id: 9DD5741E8E
X-Migadu-Scanner: mx13.migadu.com

fourth try, this time above the fold, no idea why these
are showing up on ksummit as blank.

Nope.

I'm not even subscribed to lkml and now rarely join discussions at all.

Basically I look at lore every now and again using keyword searches
then download messages of some threads manually.


On Wed, 2023-11-08 at 12:36 -0800, Joe Perches wrote:
> On Wed, 2023-11-08 at 12:14 -0800, Joe Perches wrote:
> > On Wed, 2023-11-08 at 15:07 -0500, Steven Rostedt wrote:
>=20
> <empty email?  evolution still sucks>
>=20
> My sent email folder entry for this is:
>=20
> On Wed, 2023-11-08 at 15:07 -0500, Steven Rostedt wrote:
> > BTW, you have joined some of the discussions to these patches in the pa=
st