Re: Call for testing: 2.0.0 is close to the doors

Am 29.03.26 um 10:26 schrieb Baptiste Daroussin:
> I am close to have delivered all the features I intended to add as such I would like to stamp it with naming the next release: 2.0.0!

Hello,

thanks to this announcement, I start to update my mlmmj builds.

1.6.0 is running in prod
1.7.0 compile
1.7.1 compile & I enabled 'make check' -> all tests pass
1.8.0 compile but 'make check' fail

(the buildsystem is Debian/Trixie)

...

234/235 passed (1 failed)
===> Execution context
Current directory: /tmp
Environment variables:
     CFLAGS=-g -O2 -Werror=implicit-function-declaration -ffile-prefix-map=/=. -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection
     CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2
     CXXFLAGS=-g -O2 -ffile-prefix-map=/=. -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection
     FCFLAGS=-g -O2 -ffile-prefix-map=/=. -fstack-protector-strong -fstack-clash-protection -fcf-protection
     FFLAGS=-g -O2 -ffile-prefix-map=/=. -fstack-protector-strong -fstack-clash-protection -fcf-protection
     GCJFLAGS=
     HOME=/root
     HOSTNAME=8baa659f2c1b
     LDFLAGS=-Wl,-z,relro -Wl,-z,now
     MAKEFLAGS=
     MAKELEVEL=3
     MFLAGS=
     OBJCFLAGS=-g -O2 -ffile-prefix-map=/=. -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection
     OBJCXXFLAGS=-g -O2 -ffile-prefix-map=/=. -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection
     PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
     PWD=/tmp
     SHLVL=2
     VERSION=1.8.0
     _=/usr/bin/kyua
===> tests/mlmmj-receive:subrelease
Result:     failed: atf-check failed; see the output of the test for details
Start time: 2026-03-30T19:11:49.873919Z
End time:   2026-03-30T19:11:50.095029Z
Duration:   0.221s

Metadata:
     allowed_architectures is empty
     allowed_platforms is empty
     description is empty
     has_cleanup = false
     is_exclusive = false
     required_configs is empty
     required_disk_space = 0
     required_files is empty
     required_memory = 0
     required_programs is empty
     required_user is empty
     timeout = 300

Standard output:
Executing command [ /tmp/tests/fakesmtpd ]
Executing command [ /tmp/src/mlmmj-receive -L list -F ]
Executing command [ cat mail-1.txt ]
Executing command [ cat mail-1.txt ]
Executing command [ cat mail-1.txt ]
Executing command [ cat mail-1.txt ]
Executing command [ /tmp/src/mlmmj-receive -L list -F ]
Executing command [ cat list/subscribers.d/b ]
Executing command [ test -f list/archive/1 ]
Executing command [ sed -e /^Message-ID:/d; /^Date:/d; mail-2.txt ]

Standard error:
Fail: stdout does not match golden output
--- expected-release.txt	2026-03-30 19:11:50.087813040 +0000
+++ /tmp/kyua.nrwQgG/236/work/check.X23Y8G/stdout	2026-03-30 19:11:50.087813040 +0000
@@ -1,6 +1,6 @@
  EHLO heloname
-MAIL FROM:<test+bounces-1-bob=test@mlmmjtest>
-RCPT TO:<bob@test>
+MAIL FROM:<test+bounces-1-user=test@mlmmjtest>
+RCPT TO:<user@test>
  DATA
  From: bob@test
  To: test@mlmmjtest
@@ -9,8 +9,8 @@
  Let's go, first email
  
  .
-MAIL FROM:<test+bounces-1-user=test@mlmmjtest>
-RCPT TO:<user@test>
+MAIL FROM:<test+bounces-1-user2=test@mlmmjtest>
+RCPT TO:<user2@test>
  DATA
  From: bob@test
  To: test@mlmmjtest
@@ -19,8 +19,8 @@
  Let's go, first email
  
  .
-MAIL FROM:<test+bounces-1-user2=test@mlmmjtest>
-RCPT TO:<user2@test>
+MAIL FROM:<test+bounces-1-bob=test@mlmmjtest>
+RCPT TO:<bob@test>
  DATA
  From: bob@test
  To: test@mlmmjtest
Files left in work directory after failure: debugmail.txt, expected-release.txt, first, list, mail-1.txt, mail-2.txt, subrel
===> Failed tests
tests/mlmmj-receive:subrelease  ->  failed: atf-check failed; see the output of the test for details  [0.221s]
===> Summary
Results read from /root/.kyua/store/results.tmp.20260330-191140-863923.db
Test cases: 235 total, 6 skipped, 0 expected failures, 0 broken, 1 failed
Start time: 2026-03-30T19:11:40.871920Z
End time:   2026-03-30T19:11:52.421728Z
Total time: 11.243s

-----

is there a better place to report such failures?

Andreas