Re: [mlmmj] Patches wanted for hashing/nesting archive directory (1M+ mails in list)

"Robin H. Johnson" <[email protected]> Tue, 23 Oct 2018 21:27:24 +0000

Newsgroups	org.mlmmj.mlmmj
Message-ID	<[email protected]>

(Sorry for the lag, busy month so far)

On Mon, Oct 01, 2018 at 02:45:00AM +0000, Chris Knadle wrote:
> Robin H. Johnson:
> > One of the larger gentoo.org lists recently passed 1M mails, and while
> > performance hasn't taken a noticeable hit, doing admin ops in such large
> > directories is painful.
> Mmm. Yeah that's a lot for one directory.
> 
> > Has anybody started on patches to use a nested directory structure for
> > archive? Ideally something that supports cleanly migrating from the old
> > flat layout.
> Not that I know of, but I think there's a reason.
> 
> Mlmmj doesn't include a "web archiver", so I think the only reason to keep old
> archives in the same directory is for getting previous messages from the list
> via email by sending mail to <listname>-get-N@<list-domain-name> where N is the
> number of the desired message.  It's very unlikely that a user would want to use
> this to retrieve very many messages.
Isn't the archive directory also used in the delayed/retry delivery
cases? (I need to check the moderation cases as well).

The get-N functionality does get usage in Gentoo, as we document it in
counterpart to the 'you missed some mail because your address was
bouncing'

For web-archiving, we do it entirely outside of mlmmj (subscribe the
archiver to the list, use get-N for missing mail, profit).

-- 
Robin Hugh Johnson
Gentoo Linux: Dev, Infra Lead, Foundation Treasurer
E-Mail   : [email protected]
GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85
GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136

signature.asc (application/pgp-signature, 1.1 KB)