New: QA Test Plan Sign-off Requirement

--===============3441777578003971616==
Content-Type: multipart/alternative; boundary="001a113a060cce1128055551e7f2"

--001a113a060cce1128055551e7f2
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

(cross posting to a few lists for visibility)


tl;dr Starting with the Firefox 57 release, test plans will require
sign-off from Engineering, Product and QA before testing begins.

Engineering, Product, and QA each have unique insights into risks
associated with feature development. We have the best chance of success
when we have a diverse set of feedback on our plans. For QA, we need that
feedback early while there is time to adjust our test plans. The intention
is to avoid last-minute surprises and misunderstandings about test scope
that has at times been problematic when reporting test results.

In order to ensure QA receives the feedback they need, we are adding a
sign-off requirement. What we=E2=80=99re really asking is that you take an =
active
role in the quality assurance of your work by taking time to read the test
plan and provide feedback.

Three points related to sign-offs:

1. Granting a sign-off means:

   -

   High level testing objectives and testing scope are understood
   -

   Contents of =E2=80=98Risk Assessment and Coverage=E2=80=99 and =E2=80=98=
Test Areas=E2=80=99 meet your
   expectations


2. Sign-off is expected 1 week after it is requested. (Should typically be
near the beginning of the Nightly cycle.)

3. Sign-offs will be captured in each QA test plan as shown in the QA Test
Plan Template <https://wiki.mozilla.org/QA/Test_Plan_Template>.

Thanks for your commitment to the quality of Firefox.

Lawrence

--001a113a060cce1128055551e7f2
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><p style=3D"line-height:1.38;margin-top:0pt;margin-bottom:=
0pt"><span style=3D"font-size:11pt;font-family:Arial;color:rgb(0,0,0);backg=
round-color:transparent;font-weight:400;font-style:normal;font-variant:norm=
al;text-decoration:none;vertical-align:baseline">(cross posting to a few li=
sts for visibility)<br></span></p><p style=3D"line-height:1.38;margin-top:0=
pt;margin-bottom:0pt"><span style=3D"font-size:11pt;font-family:Arial;color=
:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;=
font-variant:normal;text-decoration:none;vertical-align:baseline"><br></spa=
n></p><p dir=3D"ltr" style=3D"line-height:1.38;margin-top:0pt;margin-bottom=
:0pt"><span style=3D"font-size:11pt;font-family:Arial;color:rgb(0,0,0);back=
ground-color:transparent;font-weight:400;font-style:normal;font-variant:nor=
mal;text-decoration:none;vertical-align:baseline">tl;dr Starting with the F=
irefox 57 release, test plans will require sign-off from Engineering, Produ=
ct and QA before testing begins.</span></p><br><p dir=3D"ltr" style=3D"line=
-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style=3D"font-size:11p=
t;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weig=
ht:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-=
align:baseline">Engineering, Product, and QA each have unique insights into=
 risks associated with feature development. We have the best chance of succ=
ess when we have a diverse set of feedback on our plans. For QA, we need th=
at feedback early while there is time to adjust our test plans. The intenti=
on is to avoid last-minute surprises and misunderstandings about test scope=
 that has at times been problematic when reporting test results.</span></p>=
<br><p dir=3D"ltr" style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0=
pt"><span style=3D"font-size:11pt;font-family:Arial;color:rgb(0,0,0);backgr=
ound-color:transparent;font-weight:400;font-style:normal;font-variant:norma=
l;text-decoration:none;vertical-align:baseline">In order to ensure QA recei=
ves the feedback they need, we are adding a sign-off requirement. What we=
=E2=80=99re really asking is that you take an active role in the quality as=
surance of your work by taking time to read the test plan and provide feedb=
ack.</span></p><br><p dir=3D"ltr" style=3D"line-height:1.38;margin-top:0pt;=
margin-bottom:0pt"><span style=3D"font-size:11pt;font-family:Arial;color:rg=
b(0,0,0);background-color:transparent;font-weight:400;font-style:normal;fon=
t-variant:normal;text-decoration:none;vertical-align:baseline">Three points=
 related to sign-offs:</span></p><br><p dir=3D"ltr" style=3D"line-height:1.=
38;margin-top:0pt;margin-bottom:0pt"><span style=3D"font-size:11pt;font-fam=
ily:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;fon=
t-style:normal;font-variant:normal;text-decoration:none;vertical-align:base=
line">1. Granting a sign-off means:</span></p><ul style=3D"margin-top:0pt;m=
argin-bottom:0pt"><li dir=3D"ltr" style=3D"list-style-type:disc;font-size:1=
1pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-we=
ight:400;font-style:normal;font-variant:normal;text-decoration:none;vertica=
l-align:baseline"><p dir=3D"ltr" style=3D"line-height:1.38;margin-top:0pt;m=
argin-bottom:0pt"><span style=3D"font-size:11pt;font-family:Arial;color:rgb=
(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font=
-variant:normal;text-decoration:none;vertical-align:baseline">High level te=
sting objectives and testing scope are understood</span></p></li><li dir=3D=
"ltr" style=3D"list-style-type:disc;font-size:11pt;font-family:Arial;color:=
rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;f=
ont-variant:normal;text-decoration:none;vertical-align:baseline"><p dir=3D"=
ltr" style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span styl=
e=3D"font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:tra=
nsparent;font-weight:400;font-style:normal;font-variant:normal;text-decorat=
ion:none;vertical-align:baseline">Contents of =E2=80=98Risk Assessment and =
Coverage=E2=80=99 and =E2=80=98Test Areas=E2=80=99 meet your expectations</=
span></p></li></ul><br><p dir=3D"ltr" style=3D"line-height:1.38;margin-top:=
0pt;margin-bottom:0pt"><span style=3D"font-size:11pt;font-family:Arial;colo=
r:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal=
;font-variant:normal;text-decoration:none;vertical-align:baseline">2. Sign-=
off is expected 1 week after it is requested. (Should typically be near the=
 beginning of the Nightly cycle.)</span></p><br><p dir=3D"ltr" style=3D"lin=
e-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style=3D"font-size:11=
pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-wei=
ght:400;font-style:normal;font-variant:normal;text-decoration:none;vertical=
-align:baseline">3. Sign-offs will be captured in each QA test plan as show=
n in the </span><a href=3D"https://wiki.mozilla.org/QA/Test_Plan_Template" =
style=3D"text-decoration:none"><span style=3D"font-size:11pt;font-family:Ar=
ial;color:rgb(17,85,204);background-color:transparent;font-weight:400;font-=
style:normal;font-variant:normal;text-decoration:none;vertical-align:baseli=
ne">QA Test Plan Template</span></a><span style=3D"font-size:11pt;font-fami=
ly:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font=
-style:normal;font-variant:normal;text-decoration:none;vertical-align:basel=
ine">.</span></p><br><p dir=3D"ltr" style=3D"line-height:1.38;margin-top:0p=
t;margin-bottom:0pt"><span style=3D"font-size:11pt;font-family:Arial;color:=
rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;f=
ont-variant:normal;text-decoration:none;vertical-align:baseline">Thanks for=
 your commitment to the quality of Firefox.</span></p><br><p dir=3D"ltr" st=
yle=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style=3D"fo=
nt-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparen=
t;font-weight:400;font-style:normal;font-variant:normal;text-decoration:non=
e;vertical-align:baseline">Lawrence</span></p></div>

--001a113a060cce1128055551e7f2--

--===============3441777578003971616==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
mobile-firefox-dev mailing list
[email protected]
https://mail.mozilla.org/listinfo/mobile-firefox-dev

--===============3441777578003971616==--