Re: "Testkit" for exim?

On Thu, 14 May 2026, Leonardo Boselli via Exim-users wrote:

> On Wed, 13 May 2026, Jeremy Harris via Exim-users wrote:
>> -------- Original Message --------
>> To: Andreas Barth <[email protected]>
>> Subject: Re: [exim] "Testkit" for exim?
>>> does anybody know a tool to check exims configuration in a kind of
>>> regression test, i.e. that mails that should be accepted are accepted,
>>> that those that should be rejected are rejected etc?
> (…)
>> You could use that as a basis, adding
>> a (or several) new testcase using your
>> configuration and with your desired
>> subtests.
>
> I had the impression that the testkit Andrea wanted was to test his 
> configuration against standard binaries, not custom binary against standard 
> configuration.

The exim test suite tests against lots of partial configs,
to exercise a binary with any config we have thought of.
It bottom level it tests whatever binary you give it against
whatever config you give it.

If he writes tests that confirm that it does what wants it to do,
he can use it to test any binary config with any config.

The tests are written in a language that makes it easy(ish) to
give it messages and to say what should happen to them.
This will require some work, but it is a plausible starting point.

There is also SWAKS:
 	https://www.jetmore.org/john/code/swaks/
though he would need a running server with the config under test.

-- 
Andrew C. Aitchison                      Kendal, UK
                    [email protected]

-- 
## subscription configuration (requires account):
##   https://lists.exim.org/mailman3/postorius/lists/exim-users.lists.exim.org/
## unsubscribe (doesn't require an account):
##   [email protected]
## Exim details at https://www.exim.org/
## Please use the Wiki with this list - https://code.exim.org/exim/wiki/wiki