Re: Jython 2.7 rc3 soft launch

It wasn't a stop the launch message, just reporting what I saw. I'm 
happy to go with others' judgement.

I am *instinctively* a bit uncomfortable that anything go out with 
failing or skipped tests. But my instincts have been shaped by the sort 
of subjects where just one counterexample proves you wrong, *not* by 
much experience launching software products. I'm interested in how this 
level of test conformance maps to user experience. I think Jython is 
pretty good now and that we won't be buried in bug reports.

I'd like to see testing give us a clearer result. At the moment it 
always fails and you have to work out what kind of failure to know where 
you stand. On the one hand I think defects should be visible and 
painful; on the other I'd like to have a test that only shouts when 
something unexpected happens. (And I'd like a build bot to do the 
shouting.)  Now I understand regrtest better (since the weekend!), and 
which parts we added, I think it offers a way of saying "everything is 
as expected (but don't forget these problems)", vs. "you just broke 
something", with only the latter being shouted. It's nearly there.

Jeff Allen

On 22/04/2015 00:22, Jim Baker wrote:
> Jeff, I have seen test_bytes fail with ArrayIndexOutOfBoundsException 
> in the test_repeat case, which is testing out of memory scenarios. 
> Although it  would be best not to see Java exceptions leak out to 
> Python code in this case, we have reported bugs for similar 
> "leakiness" that we have triaged to 2.7.1. Given that existing triage, 
> this means we haven't seen anything yet to hold the release.
>
> Frank, looks like we are good for a RC3 final, so we can get the 
> testing we need.
>
> - Jim
>
> On Tue, Apr 21, 2015 at 4:18 PM, Jeff Allen <[email protected] 
> <mailto:[email protected]>> wrote:
>
>     And on Java 8u45 these additional failures, repeatable at the prompt:
>
>          test_bz2
>          test_list_jy
>          test_marshal
>
>     Jeff
>
>     On 21/04/2015 21:27, Jeff Allen wrote:
>     > I installed this on Win7x64 with Java 7u60. It installs fine and
>     I ran
>     > regrtest -e.  My bottom line was this:
>     >
>     > 23 fails unexpected:
>     >       test___all__ test_classpathimporter test_file2k
>     test_httpservers
>     >       test_import test_import_pep328 test_jython_initializer
>     test_netrc
>     >       test_os_jy test_runpy test_select test_shutil test_slice
>     >       test_slots_jy test_smtpnet test_socket test_ssl test_sys
>     >       test_sys_jy test_tarfile test_urllib2 test_zipfile
>     >       test_zipimport_jy
>     >
>     > These tests worked ok when re-run at the prompt:
>     > #    test_select
>     > #    test_slice
>     > #    test_slots_jy
>     > #    test_smtpnet
>     > The last three failed every time in regrtest -v -f, but with an
>     > ArrayIndexOutOfBoundsException in regrtest itself, rather than a
>     proper
>     > test failure. Possibly I broke something when I worked on
>     regrtest last,
>     > but why always these 3 tests?
>     >
>     > These 10 are known failures on the tracker:
>     > #2308    test___all__
>     > #2309    test_classpathimporter
>     > #2312    test_file2k
>     > #2310    test_import
>     > #2314    test_shutil
>     > #2315    test_ssl
>     > #2312    test_sys_jy
>     > #2316    test_tarfile
>     > #2317    test_urllib2
>     > #2318    test_zipimport_jy
>     >
>     > These failed solidly in regrtest and at the prompt but are not
>     (I think)
>     > on the tracker. They are not all new, and some have been called
>     flakey.
>     > A couple are just unlink errors.
>     > test_httpservers  # bad file descriptor
>     > test_import_pep328
>     > test_jython_initializer
>     > test_netrc
>     > test_os_jy
>     > test_runpy    # unlink() error
>     > test_socket
>     > test_sys
>     > test_zipfile  # unlink() errors
>     >
>     >
>     > Jeff
>

------------------------------------------------------------------------------
BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF

_______________________________________________
Jython-dev mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/jython-dev