Re: Upcoming new test-suite release

Julian Mehnle <[email protected]> Wed, 20 Aug 2008 10:39:40 +0000
Newsgroups gmane.mail.spam.spf.devel
Message-ID <[email protected]>
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Stefano Bagnara wrote:
> Probably running java applications is difficult for you as running perl
> applications for me.
> How easy is for me (let's say I only understand java) to run the
> testsuite for other implementations?? Hard. It's not jSPF that is hard,
> it is simply that the test suite for a library is usually written in
> the library own language and using that very language testing
> methodologies. We use jUnit and we wrapped the yaml tests into jUnit
> tests, so it is really easy to run our test suite graphically in any
> jUnit compatible environment.
> 
> > So please don't be mad, but let's now try to get this resolved
> > instead.
>
> My complain is that either you publish a procedure that I will try to
> follow or you say that jSPF is compliant. It doesn't work and it's not
> fair for me that you say "I don't know Java so your implementation will
> not be listed".

We don't have a formal procedure, and I don't think establishing one will 
be worthwhile to any extent.  We should simply strive to be fair.  If we 
aren't, please hit us on the head.

The issue with your implementation wasn't that I don't _speak_ Java, but 
that there was no good documentation on how to set it up (cf. 
http://search.cpan.org/src/JMEHNLE/Mail-SPF-v2.006/INSTALL if you will) 
for someone who isn't familiar with know how to _use_ Java, Maven, and 
jUnit, and, even more importantly, the test output was incomprehensible 
to me.  Perhaps that has since changed, but back then that was just how 
it was.

Can you produce somethink like the following?

  http://julian.io.link-m.de/tmp/mail-spf-perl-rfc4408-tests.log

You'll see that this isn't exactly good proof that an implementation 
passes the test suite, but it at least demonstrates that the test suite 
has been run in some way.

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)

iEYEARECAAYFAkir9GwACgkQwL7PKlBZWjuJagCfYnpMHnUoz0aMjZuBdVpxHmAM
MJgAoLFZHUwmJck3W/GIgrxJ2Xp26xaj
=l5+w
-----END PGP SIGNATURE-----