Re: Fwd: PROPOSED RESOLUTION: merge csswg-test into web-platform-tests

"L. David Baron" <[email protected]> Tue, 27 Sep 2016 12:24:43 -0700
Newsgroups gmane.comp.mozilla.devel.layout
Message-ID <[email protected]>
On Tuesday 2016-09-27 20:18 +0100, James Graham wrote:
> I think this argument is backwards. Today we don't run a recent copy of the
> CSS tests because there are technical issues preventing it from working with
> the reftest harness. It is not clear to me why this reorganisation would
> suddenly cause us to fix those issues when we could have done at any
> previous time with similar effort.

Because you were doing the work on the approach that uses your test
harness, and we didn't have anybody assigned to do the other work?

> On the other hand the change will allow
> us to run a copy of the CSS tests in wptrunner immediately for "free".
> Running more tests in wptrunner inevitably increases the chance of fixing
> issues with that harness both because it will be easier to prioritise the
> work and more people will be motivated to fix the issues.

I think running a large number of reftests in wptrunner will be an
unacceptable load on our CI infrastructure due to
https://bugzil.la/1265586 .

> Apologies for missing the bugs you pointed to at the time; I believe one of
> them has a solution and I will need to investigate the second issue (with
> debugger-related bugs I find it very helpful to get a set of steps to
> reproduce the problem).

I think those bugs are the very tip of an iceberg that involves many
person-months of work.

-David

-- 
𝄞   L. David Baron                         http://dbaron.org/   𝄂
𝄢   Mozilla                          https://www.mozilla.org/   𝄂
             Before I built a wall I'd ask to know
             What I was walling in or walling out,
             And to whom I was like to give offense.
               - Robert Frost, Mending Wall (1914)

_______________________________________________
dev-tech-layout mailing list
[email protected]
https://lists.mozilla.org/listinfo/dev-tech-layout
signature.asc (application/pgp-signature, 819 B)
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1

iQIcBAEBCAAGBQJX6sd5AAoJEO/hYSUPhPwhMBAP/i/KtDZ5lLojPjfvVq3IwX1x
GcPggNYA97O3MmGCdz87Ulf9sYFsYOTV7QkkzpaoXu36+EJ2GxDdQMmmTaUOVY2K
cro3xKq/9XuerME2ni0caJFjDr91SI1haNA2loEN58BgswTi7k7EJx61Rz32YEr1
0CNQLGWYfzYFl1Ny2XR7cXCB8Ta06bIw931Ge7DSeirQ22kZaaMY06pA+yastBwo
hsrKR3qUUjCNqvV3Ea2+QCqEx/d2fFOoE+Viz9h0khXu/7MA/dq4R8+KQz4b9rpf
VpxiZCUMG/DD1RgLEv2nuB8whoshMXpHqsmfMk16E9BHcGW8T2ZkBJcj1WAeyYjO
NrQu1Wts1gIEjKTbrgIeBcGCcXiFtsQ77C9aRafPRQQNGluGPKLqvVYA0p62NXyj
n4qOa201rq1GlPgEFIErjjuUociXy+P9DDUy7OXEVgrnPA72K3ZnL+RhYgF0m0Gg
EWXJUbiTwUnfKd+fllr70EROH9C9J08HU7jHCMB+dCc0E+yGEs7p9X6CwfrpdC95
UcqMtntaEPx2M25z8x+wdo5u6Z79MN/s+7pafGJWT/HmMpt3O3MawQZQG6cueIOx
cBnpARx+RlfUu/Guwgw1gH7rs0eHyZ71YGHI2bSBNq54D1xWaJQcq55CKvPjX07z
sVmJLYhLNRuuDyriShEx
=6xTn
-----END PGP SIGNATURE-----