Re: [PHP-DEV] master/phpng has many Windows specific regressions (PHPT and Joomla)

Hi Matt,

Can you provide instruction how to install and run Joomla and Symfony unit
tests.

Thanks. Dmitry.


On Thu, Aug 21, 2014 at 10:27 PM, Matt Ficken <[email protected]>
wrote:

> Master (with PHPNG) builds on Windows (our snapshot build servers were
> never interrupted BTW), though extensions including  PDO, mysql and soap
> are disabled.
>
>
> Master on Windows now has 201 test failures(all sapi scenarios) while Linux
> (for me at least) only has about 20 failures, see:
>
> http://qa.php.net/reports/db/PHP_MASTER/r0ac3d8d/PHPT_CMP_PHP_5_6-5.6.0RC3-TS-X86-VC11_Local-FileSystem_MySQL-5.6_CLI_v_PHP_Master-r0ac3d8d-TS-X86-VC.html
> Master is now all RED on qa.php.net, see: http://qa.php.net/pftt.php
>
> Additionally, for the CLI sapi scenario, there are many regressions of
> Joomla's PhpUnit test suites: typically I get a ~72% pass rate but now only
> get ~60% pass rate.
> See:
>
> http://qa.php.net/reports/db/PHP_MASTER/r0ac3d8d/PhpUnit_CMP_Joomla-Platform-12.3_PHP_Master-r0ac3d8d-TS-X86-VC11_Local-FileSyste.html
> Looks like Joomla regressions are mostly because of the deprecation of
> `iconv.internal_encoding` and missing the PDO extension.
>
> Pass rate for Symfony remains unchanged (~93%), see:
>
> http://qa.php.net/reports/db/PHP_MASTER/r0ac3d8d/PhpUnit_CMP_Symfony-Standard-2.1.8_PHP_Master-r0ac3d8d-TS-X86-VC11_Local-FileSys.html
>
> See list below for PHPT failures and analysis. Apparently I can't attach
> the run-test.php output or Joomla output.
>
> Some tests fail because expected output has changed (sapi and file
> failures) which I don't believe are actual functionality problems. Unless
> anyone disagrees that those tests are not actually ok, I'm going to file
> bug reports and update them (creating -win32 fork if needed).
> Some tests (array, reflection, session) could be a major regression.
>
>
> ;
> ; expected output didn't include the character encoding, which is now
> included by builtin web server
> Sapi\cli\tests\006.phpt
> Sapi\cli\tests\bug43177.phpt
> Sapi\cli\tests\bug61977.phpt
> Sapi\cli\tests\bug65066_100.phpt
> Sapi\cli\tests\bug65066_422.phpt
> Sapi\cli\tests\bug65066_511.phpt
> Sapi\cli\tests\bug65633.phpt
> Sapi\cli\tests\bug66830.phpt
> Sapi\cli\tests\bug67429.phpt
> Sapi\cli\tests\php_cli_server_004.phpt
> Sapi\cli\tests\php_cli_server_005.phpt
> Sapi\cli\tests\php_cli_server_006.phpt
> Sapi\cli\tests\php_cli_server_007.phpt
> Sapi\cli\tests\php_cli_server_008.phpt
> Sapi\cli\tests\php_cli_server_009.phpt
> Sapi\cli\tests\php_cli_server_010.phpt
> Sapi\cli\tests\php_cli_server_012.phpt
> Sapi\cli\tests\php_cli_server_015.phpt
> Sapi\cli\tests\php_cli_server_017.phpt
> Sapi\cli\tests\php_cli_server_018.phpt
> Sapi\cli\tests\php_cli_server_019.phpt
> ;
> ; expected reference count has changed
> Zend\tests\001.phpt
> Zend\tests\002.phpt
> Zend\tests\003.phpt
> Zend\tests\bug24773.phpt
> Zend\tests\bug35393.phpt
> Zend\tests\bug38047.phpt
> Zend\tests\bug40815.phpt
> Zend\tests\bug52361.phpt
> Zend\tests\bug54013.phpt
> Zend\tests\bug60825.phpt
> Zend\tests\bug63635.phpt
> Zend\tests\bug64515.phpt
> Zend\tests\bug67436\bug67436_nohandler.phpt
> Zend\tests\call_user_func_004.phpt
> Zend\tests\call_user_func_005.phpt
> Zend\tests\closure_018.phpt
> Zend\tests\closure_019.phpt
> Zend\tests\closure_026.phpt
> Zend\tests\dereference_002.phpt
> Zend\tests\fr47160.phpt
> Zend\tests\gc_014.phpt
> Zend\tests\gc_029_zts.phpt
> Zend\tests\gc_030.phpt
> Zend\tests\gc_032.phpt
> Zend\tests\generators\errors\non_ref_generator_iterated_by_ref_error.phpt
> Zend\tests\generators\generator_rewind.phpt
> Zend\tests\objects_027.phpt
> ; returning false
> ext\date\tests\009_win32.phpt
> ext\date\tests\DateTimeZone_verify.phpt
> ext\date\tests\DateTime_verify.phpt
> ext\date\tests\bug41523.phpt
> ext\date\tests\bug51866.phpt
> ext\date\tests\bug65184.phpt
> ext\date\tests\gmstrftime_basic.phpt
> ext\date\tests\gmstrftime_variation1.phpt
> ext\date\tests\gmstrftime_variation2.phpt
> ext\date\tests\gmstrftime_variation21
> ext\date\tests\gmstrftime_variation3.phpt
> ext\date\tests\gmstrftime_variation4.phpt
> ext\date\tests\gmstrftime_variation5.phpt
> ext\date\tests\gmstrftime_variation6.phpt
> ext\date\tests\gmstrftime_variation7.phpt
> ext\date\tests\gmstrftime_variation8.phpt
> ext\date\tests\strftime_basic.phpt
> ext\date\tests\strftime_variation1.phpt
> ext\date\tests\strftime_variation2.phpt
> ext\date\tests\strftime_variation21.phpt
> ext\date\tests\strftime_variation23.phpt
> ext\date\tests\strftime_variation3.phpt
> ext\date\tests\strftime_variation4.phpt
> ext\date\tests\strftime_variation5.phpt
> ext\date\tests\strftime_variation6.phpt
> ext\date\tests\strftime_variation7.phpt
> ext\date\tests\strftime_variation8.phpt
> ext\hash\tests\hash_algos.phpt
> ext\hash\tests\hash_copy_001.phpt
> ext\iconv\tests\iconv_encoding_basic.phpt
> ext\iconv\tests\iconv_get_encoding_basic.phpt
> ext\iconv\tests\iconv_set_encoding_variation.phpt
> ext\iconv\tests\iconv_strpos_basic.phpt
> ext\iconv\tests\iconv_strpos_variation5.phpt
> ext\iconv\tests\iconv_strrpos_basic.phpt
> ext\pcre\tests\006.phpt
> ext\pcre\tests\recursion_limit.phpt
> ext\phar\tests\create_path_error.phpt
> ; ?
> ext\reflection\tests\009.phpt
> ext\reflection\tests\025.phpt
> ext\reflection\tests\ReflectionClass_getInterfaces_003.phpt
> ext\reflection\tests\ReflectionClass_getMethods_001.phpt
> ext\reflection\tests\ReflectionClass_getMethods_003.phpt
> ext\reflection\tests\ReflectionClass_getProperties_001.phpt
> ext\reflection\tests\ReflectionClass_getProperties_003.phpt
> ext\reflection\tests\ReflectionExtension_getClasses_basic.phpt
> ext\reflection\tests\ReflectionParameter_canBePassedByValue.phpt
> ext\reflection\tests\ReflectionProperty_setAccessible.phpt
> ext\reflection\tests\bug40431.phpt
> ext\reflection\tests\bug46064_2.phpt
> ext\reflection\tests\traits004.phpt
> ext\session\tests\016.phpt
> ext\session\tests\bug60634_error_1.phpt
> ext\session\tests\session_module_name_variation3.phpt
> ext\session\tests\session_save_path_variation2.phpt
> ext\session\tests\session_set_save_handler_basic.phpt
> ext\session\tests\session_set_save_handler_class_002.phpt
> ext\session\tests\session_set_save_handler_class_003.phpt
> ext\session\tests\session_set_save_handler_class_005.phpt
> ext\session\tests\session_set_save_handler_class_007.phpt
> ext\session\tests\session_set_save_handler_class_012.phpt
> ext\session\tests\session_set_save_handler_class_016.phpt
> ext\session\tests\session_set_save_handler_closures.phpt
> ext\session\tests\session_set_save_handler_error3.phpt
> ext\session\tests\session_set_save_handler_error4.phpt
> ext\session\tests\session_set_save_handler_iface_001.phpt
> ext\session\tests\session_set_save_handler_variation4.phpt
> ext\simplexml\tests\SimpleXMLElement_xpath.phpt
> ext\spl\tests\ArrayObject_unserialize_empty_string.phpt
> ext\spl\tests\SplObjectStorage_unserialize_invalid_parameter3.phpt
> ext\spl\tests\bug51532.phpt
> ext\spl\tests\bug60201.phpt
> ext\spl\tests\bug64782.phpt
> ext\spl\tests\iterator_042.phpt
> ;
> ; not clear why array functions fail
> ext\standard\tests\array\array_fill.phpt
> ext\standard\tests\array\array_fill_error.phpt
> ext\standard\tests\array\array_fill_variation2.phpt
> ext\standard\tests\array\array_filter_error.phpt
> ext\standard\tests\array\array_intersect_uassoc_variation10.phpt
> ext\standard\tests\array\array_intersect_ukey_variation9.phpt
> ext\standard\tests\array\bug24766.phpt
> ext\standard\tests\array\bug25708.phpt
> ext\standard\tests\array\bug26458.phpt
> ext\standard\tests\array\bug67693.phpt
> ext\standard\tests\array\extract_variation1.phpt
> ext\standard\tests\dir\closedir_variation2.phpt
> ext\standard\tests\dir\dir_basic.phpt
> ext\standard\tests\dir\rewinddir_variation2.phpt
> ;
> ; many tests fail because error messages changed slightly
> ext\standard\tests\file\007_basic.phpt
> ext\standard\tests\file\007_error.phpt
> ext\standard\tests\file\bug27508.phpt
> ext\standard\tests\file\bug41655_1.phpt
> ext\standard\tests\file\fclose_variation1.phpt
> ext\standard\tests\file\feof_basic.phpt
> ext\standard\tests\file\fgetc_variation2.phpt
> ext\standard\tests\file\fgets_error.phpt
> ext\standard\tests\file\fgets_variation2.phpt
> ext\standard\tests\file\fgetss.phpt
> ext\standard\tests\file\fgetss_error.phpt
> ext\standard\tests\file\flock.phpt
> ext\standard\tests\file\flock_error.phpt
> ext\standard\tests\file\fread_error.phpt
> ext\standard\tests\file\fscanf_error.phpt
> ext\standard\tests\file\fseek_ftell_rewind_error1.phpt
> ext\standard\tests\file\fseek_ftell_rewind_error2.phpt
> ext\standard\tests\file\fseek_ftell_rewind_error3.phpt
> ext\standard\tests\file\fstat.phpt
> ext\standard\tests\file\ftruncate_error.phpt
> ext\standard\tests\file\fwrite_error.phpt
> ext\standard\tests\file\glob_variation3.phpt
> ext\standard\tests\file\pathinfo_basic1-win32.phpt
> ext\standard\tests\file\pathinfo_basic2-win32.phpt
> ext\standard\tests\file\userwrapper.phpt
> ext\standard\tests\general_functions\bug29038.phpt
> ext\standard\tests\general_functions\bug44487.phpt
> ext\standard\tests\general_functions\call_user_func_return.phpt
> ext\standard\tests\general_functions\call_user_method.phpt
> ext\standard\tests\general_functions\call_user_method_002.phpt
> ext\standard\tests\general_functions\debug_zval_dump_b.phpt
> ext\standard\tests\general_functions\debug_zval_dump_v.phpt
> ext\standard\tests\general_functions\ini_get_all.phpt
> ext\standard\tests\math\pow_variation1.phpt
> ext\standard\tests\math\pow_variation2.phpt
> ext\standard\tests\network\setcookie.phpt
> ext\standard\tests\serialize\005.phpt
> ext\standard\tests\serialize\bug64146.phpt
> ext\standard\tests\serialize\bug67072_2.phpt
> ext\standard\tests\serialize\serialization_arrays_005.phpt
> ext\standard\tests\streams\bug40459.phpt
> ext\standard\tests\streams\bug54623.phpt
> ext\standard\tests\streams\stream_get_meta_data_file_error.phpt
> ext\standard\tests\streams\stream_set_timeout_error.phpt
> ext\standard\tests\strings\bug55871.phpt
> ext\standard\tests\strings\crypt.phpt
> ext\standard\tests\strings\str_pad_variation5.phpt
> ext\standard\tests\strings\strncasecmp_variation10.phpt
> ext\standard\tests\strings\strncasecmp_variation11.phpt
> ext\standard\tests\strings\strncasecmp_variation4.phpt
> ext\standard\tests\strings\strncmp_variation4.phpt
> ext\tokenizer\tests\bug60097.phpt
> ext\wddx\tests\bug48562.phpt
> ext\zlib\tests\bug67724.phpt
> ext\zlib\tests\gzclose_basic.phpt
> ext\zlib\tests\gzeof_variation1.phpt
> ;
> ; might expect phpng to break these
> tests\basic\024.phpt
> tests\basic\026.phpt
> tests\classes\inheritance_007.
> phpt
> tests\func\005a.phpt
> tests\lang\foreachLoop.013.phpt
> tests\lang\foreachLoop.014.phpt
> tests\lang\foreachLoop.015.phpt
> tests\lang\func_get_arg.001.phpt
> tests\lang\func_get_args.004.phpt
>