Re: Global Shortcut Keys and Screen Reader Accessibility?
Amber Holladay <[email protected]> Wed, 29 Apr 2020 14:18:07 -0600
| Newsgroups | gmane.org.w3c.accessibility.general |
|---|---|
| Message-ID | <CAFs6RbEvf5Q=ZfXN0zi4foHW_tLWebCc2VFG2XfgoCzoHzshLw@mail.gmail.com> |
--0000000000002bd35505a473a62c Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Any time you use a keyboard shortcut, it is important to consider and include the following: * A way to turn the keyboard shortcut(s) off * An alternative (and accessible) way to access the same functionality without the keyboard (e.g. button elements on the page) * How the keyboard shortcut affects different assistive technologies * Whether it is useful to allow shortcuts to be turned on/off as a group as well as individually * An accessible way to teach all users how to use the keyboard shortcut(s) The spacebar is often used as a play/pause shortcut. On Tue, Apr 28, 2020 at 7:00 AM Taliesin Smith <[email protected]> wrote: > Hi Matt, > I agree, it will be awesome to make the hotkey customizable. I hope to > make that part of future research. > > For now we=E2=80=99ve got Alt + k implemented as the hotkey to toggle bet= ween > paused and playing states no matter where the learner=E2=80=99s current k= eyboard > focus is. > > Basically, once the action in the simulation has been started, i.e. once > the photons are firing at the molecule; the hotkey combination can be use= d > to pause and play the action without the learner needing to move their > focus to the actual Pause/Play button. > > As for role application, we only use it for custom interactions where a > native HTML option is not available. For example, we have successfully us= ed > role application to make a grabbed balloon moveable in four directions. A= s > the learner grabs the balloon with a native button interaction, role > application is launched creating a 4-way custom drag interaction, enablin= g > a learner to move the grabbed balloon in any direction. The learner can > then use the arrow keys (or alternative letter keys WASD) to move the > balloon to rub it against a sweater or a wall to explore how static > electricity works. The balloon is released in the same way to was grabbed= . > > From the beginning of our research on making interactive science > simulations accessible, we treaded very carefully with role application. > Our research with users tells us that our native and custom interactions > are quite intuitive and accessible to blind learners. That said, we have > found, thus far, that starting a custom interaction with a native one, li= ke > a button, works better for blind learners than immediately presenting a > custom interaction upon focus. > > The suggestions, advice, comments, perspectives I am exposed to on this > list are awesome. > > Taliesin > > ~.~.~ > Available off list at [email protected] > Inclusive Design Researcher > PhET Interactive Simulations > https://phet.colorado.edu/en/accessibility > Physics Department > University of Colorado, Boulder > > > On Apr 28, 2020, at 4:18 AM, Matt King <[email protected]> wrote: > > > > Customizable is definitely good. > > > > I'd recommend avoid using role application. Please carefully read the > spec for role application before deciding whether to go down that path. > > > > Matt > > > > -----Original Message----- > > From: Taliesin Smith <[email protected]> > > Sent: Wednesday, April 15, 2020 1:33 PM > > To: Karen Lewellen <[email protected]> > > Cc: WAI IG <[email protected]> > > Subject: Re: Global Shortcut Keys and Screen Reader Accessibility? > > > > Hi Karen, > > Great question. The answer, unfortunately is no. > > > > For our simulations (PhET Interactive Simulations) we test in these > three pairs (VO & Safari, NVDA & FF, and JAWS & Chrome). That said, while > presenting at the CSUN conference a couple of years ago a person in the > audience tweeted that the simulation I was demoing worked great in Orca o= n > Linux. > > > > I agree, the challenge is finding an intuitive combination that does > conflict with anything else. > > > > I liked Jonathan=E2=80=99s idea of making the shortcut customizable. We= are > currently doing research on adaptive features. > > > > Taliesin > > > >> On Apr 15, 2020, at 5:48 PM, Karen Lewellen <[email protected]> > wrote: > >> > >> Do you intend testing with Linux and its various screen reader > programs? > >> Your goals are terrific, with my one concern being finding a key > combination that is not used by one of the scores of screen readers a > person might choose for their individual accommodating needs. > >> Karen > >> > >> > >> > >> On Wed, 15 Apr 2020, Taliesin Smith wrote: > >> > >>> Hi Folks, > >>> I am looking into the feasibility of global hotkey or Keyboard > Shortcut that would toggle a Pause/Play button in a simulated learning > environment regardless of where the keyboard focus is currently at in the > application. > >>> > >>> While the Pause/Play button interaction is somewhat akin to how a > video player works, it is not exactly the same kind of experience in our > situation. > >>> > >>> We are currently working on a science simulation called Molecules and > Light < > https://phet-dev.colorado.edu/html/molecules-and-light/1.5.0-dev.44/phet/= molecules-and-light_en_phet.htm> > (note to hear the interactive descriptions you need to use a screen reade= r > - VO & Safari, NVDA & FF or JAWS & Chrome). > >>> > >>> In this simulated environment a learner turns a light source to fire > photons at a molecule. The learner can change the light source and the > molecule on the fly and observe what happens. > >>> > >>> Learners can also Pause the action (the firing of photons) without > turning the light source off. When the action is paused, the learner can > use a Step Forward button to move the action (the photons) forward little > by little to examine more closely what happens when a photon passes throu= gh > or is absorbed by the molecule. > >>> > >>> In interviews with blind learners, we found that learners were > confused by the Pause/Play and Step Forward buttons, especially when the > light source had not already been turned on. And if the simulation was se= t > to Pause, they were often temporarily confused why the light source butto= n > would no longer fire photons. > >>> > >>> We have made improvements to the descriptive experience by adding > aria-live alerts that indicate if the light source is off or if the sim i= s > paused, and why it might be useful to use the Step Forward button when th= e > Pause button is activated. We think these aria-live alerts will create a > much more intuitive experience (more user testing is pending). > >>> > >>> That said, a few learners requested a global keyboard shortcut to > quickly Pause and Play the action no matter where their focus was. My > question to the list is, does any one have any experience or resources on > making a global keyboard shortcut that does not rely on focus and works > when screen reader software is enabled. I am assuming we would need to us= e > a modifier key. Something like Control + k or Alt + k. > >>> > >>> This kind of Pause/Play and Step Forward interaction is used in many > of our interactive science simulations. A global hot key could be useful > for all learners whether they use screen readers or not. > >>> > >>> Thanks in advance for any resources on accessible global keyboard > shortcuts. I have read this great medium article by Sasha Maximova, J, K, > or How to choose keyboard shortcuts for web applications < > https://medium.com/@sashika/j-k-or-how-to-choose-keyboard-shortcuts-for-w= eb-applications-a7c3b7b408ee>, > several times, and am looking for more resources. > >>> > >>> Taliesin > >>> ~.~.~ > >>> Also available off list at: [email protected] Inclusive > >>> Design Researcher PhET Interactive Simulations > >>> https://phet.colorado.edu/en/accessibility > >>> Physics Department > >>> University of Colorado, Boulder > >>> > >>> > >>> > >>> > >>> > >>> > >>> > > > > > > > > > --0000000000002bd35505a473a62c Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr">Any time you use a keyboard shortcut, it is important to c= onsider and include the following:<div>=C2=A0* A way to turn the keyboard s= hortcut(s) off</div><div>=C2=A0* An alternative (and accessible) way to acc= ess the same functionality without the keyboard (e.g. button elements on th= e page)</div><div>=C2=A0* How the keyboard shortcut affects different assis= tive technologies=C2=A0</div><div>=C2=A0* Whether it is useful to allow sho= rtcuts to be turned on/off as a group as well as individually</div><div>=C2= =A0* An accessible way to teach all users how to use the keyboard shortcut(= s)=C2=A0</div><div><br></div><div>The spacebar is often used as a play/paus= e shortcut.</div><div><br></div><div>=C2=A0</div></div><br><div class=3D"gm= ail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Tue, Apr 28, 2020 at 7:= 00 AM Taliesin Smith <<a href=3D"mailto:[email protected]" target=3D"_b= lank">[email protected]</a>> wrote:<br></div><blockquote class=3D"gmail= _quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204= ,204);padding-left:1ex">Hi Matt,<br> I agree, it will be awesome to make the hotkey customizable. I hope to make= that part of future research.=C2=A0 <br> <br> For now we=E2=80=99ve got Alt + k implemented as the hotkey to toggle betwe= en paused and playing states no matter where the learner=E2=80=99s current = keyboard focus is. <br> <br> Basically, once the action in the simulation has been started, i.e. once th= e photons are firing at the molecule; the hotkey combination can be used to= pause and play the action without the learner needing to move their focus = to the actual Pause/Play button.<br> <br> As for role application, we only use it for custom interactions where a nat= ive HTML option is not available. For example, we have successfully used ro= le application to make a grabbed balloon moveable in four directions. As th= e learner grabs the balloon with a native button interaction, role applicat= ion is launched creating a 4-way custom drag interaction, enabling a learne= r to move the grabbed balloon in any direction. The learner can then use th= e arrow keys (or alternative letter keys WASD) to move the balloon to rub i= t against a sweater or a wall to explore how static electricity works. The = balloon is released in the same way to was grabbed.<br> <br> From the beginning of our research on making interactive science simulation= s accessible, we treaded very carefully with role application. Our research= with users tells us that our native and custom interactions are quite intu= itive and accessible to blind learners. That said, we have found, thus far,= that starting a custom interaction with a native one, like a button, works= better for blind learners than immediately presenting a custom interaction= upon focus.<br> <br> The suggestions, advice, comments, perspectives I am exposed to on this lis= t are awesome.<br> <br> Taliesin<br> <br> ~.~.~<br> Available off list at <a href=3D"mailto:[email protected]" target= =3D"_blank">[email protected]</a><br> Inclusive Design Researcher<br> PhET Interactive Simulations<br> <a href=3D"https://phet.colorado.edu/en/accessibility" rel=3D"noreferrer" t= arget=3D"_blank">https://phet.colorado.edu/en/accessibility</a><br> Physics Department<br> University of Colorado, Boulder<br> <br> > On Apr 28, 2020, at 4:18 AM, Matt King <<a href=3D"mailto:a11ythink= [email protected]" target=3D"_blank">[email protected]</a>> wrote:<br> > <br> > Customizable is definitely good.<br> > <br> > I'd recommend avoid using role application. Please carefully read = the spec for role application before deciding whether to go down that path.= <br> > <br> > Matt<br> > <br> > -----Original Message-----<br> > From: Taliesin Smith <<a href=3D"mailto:[email protected]" target= =3D"_blank">[email protected]</a>> <br> > Sent: Wednesday, April 15, 2020 1:33 PM<br> > To: Karen Lewellen <<a href=3D"mailto:[email protected]" tar= get=3D"_blank">[email protected]</a>><br> > Cc: WAI IG <<a href=3D"mailto:[email protected]" target=3D"_blank">= [email protected]</a>><br> > Subject: Re: Global Shortcut Keys and Screen Reader Accessibility?<br> > <br> > Hi Karen,<br> > Great question. The answer, unfortunately is no.<br> > <br> > For our simulations (PhET Interactive Simulations) we test in these th= ree pairs (VO & Safari, NVDA & FF, and JAWS & Chrome). That sai= d, while presenting at the CSUN conference a couple of years ago a person i= n the audience tweeted that the simulation I was demoing worked great in Or= ca on Linux.<br> > <br> > I agree, the challenge is finding an intuitive combination that does c= onflict with anything else.<br> > <br> > I liked Jonathan=E2=80=99s idea of making the shortcut customizable. W= e are currently doing research on adaptive features.<br> > <br> > Taliesin<br> > <br> >> On Apr 15, 2020, at 5:48 PM, Karen Lewellen <<a href=3D"mailto:= [email protected]" target=3D"_blank">[email protected]</a>>= ; wrote:<br> >> <br> >> Do you intend testing with Linux and its various=C2=A0 screen read= er programs?<br> >> Your goals are terrific, with my one concern being finding a key c= ombination that is not used by=C2=A0 one of the scores of screen readers a = person might choose=C2=A0 for their individual accommodating needs.<br> >> Karen<br> >> <br> >> <br> >> <br> >> On Wed, 15 Apr 2020, Taliesin Smith wrote:<br> >> <br> >>> Hi Folks,<br> >>> I am looking into the feasibility of global hotkey or Keyboard= Shortcut that would toggle a Pause/Play button in a simulated learning env= ironment regardless of where the keyboard focus is currently at in the appl= ication.<br> >>> <br> >>> While the Pause/Play button interaction is somewhat akin to ho= w a video player works, it is not exactly the same kind of experience in ou= r situation.<br> >>> <br> >>> We are currently working on a science simulation called Molecu= les and Light <<a href=3D"https://phet-dev.colorado.edu/html/molecules-a= nd-light/1.5.0-dev.44/phet/molecules-and-light_en_phet.htm" rel=3D"noreferr= er" target=3D"_blank">https://phet-dev.colorado.edu/html/molecules-and-ligh= t/1.5.0-dev.44/phet/molecules-and-light_en_phet.htm</a>> (note to hear t= he interactive descriptions you need to use a screen reader - VO & Safa= ri, NVDA & FF or JAWS & Chrome).<br> >>> <br> >>> In this simulated environment a learner turns a light source t= o fire photons at a molecule. The learner can change the light source and t= he molecule on the fly and observe what happens.<br> >>> <br> >>> Learners can also Pause the action (the firing of photons) wit= hout turning the light source off. When the action is paused, the learner c= an use a Step Forward button to move the action (the photons) forward littl= e by little to examine more closely what happens when a photon passes throu= gh or is absorbed by the molecule.<br> >>> <br> >>> In interviews with blind learners, we found that learners were= confused by the Pause/Play and Step Forward buttons, especially when the l= ight source had not already been turned on. And if the simulation was set t= o Pause, they were often temporarily confused why the light source button w= ould no longer fire photons.<br> >>> <br> >>> We have made improvements to the descriptive experience by add= ing aria-live alerts that indicate if the light source is off or if the sim= is paused, and why it might be useful to use the Step Forward button when = the Pause button is activated. We think these aria-live alerts will create = a much more intuitive experience (more user testing is pending).<br> >>> <br> >>> That said, a few learners requested a global keyboard shortcut= to quickly Pause and Play the action no matter where their focus was. My q= uestion to the list is, does any one have any experience or resources on ma= king a global keyboard shortcut that does not rely on focus and works when = screen reader software is enabled. I am assuming we would need to use a mod= ifier key. Something like Control + k or Alt + k.<br> >>> <br> >>> This kind of Pause/Play and Step Forward interaction is used i= n many of our interactive science simulations. A global hot key could be us= eful for all learners whether they use screen readers or not.<br> >>> <br> >>> Thanks in advance for any resources on accessible global keybo= ard shortcuts. I have read this great medium article by Sasha Maximova, J, = K, or How to choose keyboard shortcuts for web applications <<a href=3D"= https://medium.com/@sashika/j-k-or-how-to-choose-keyboard-shortcuts-for-web= -applications-a7c3b7b408ee" rel=3D"noreferrer" target=3D"_blank">https://me= dium.com/@sashika/j-k-or-how-to-choose-keyboard-shortcuts-for-web-applicati= ons-a7c3b7b408ee</a>>, several times, and am looking for more resources.= <br> >>> <br> >>> Taliesin<br> >>> ~.~.~<br> >>> Also available off list at: <a href=3D"mailto:Taliesin.Smith@c= olorado.edu" target=3D"_blank">[email protected]</a> Inclusive <b= r> >>> Design Researcher PhET Interactive Simulations <br> >>> <a href=3D"https://phet.colorado.edu/en/accessibility" rel=3D"= noreferrer" target=3D"_blank">https://phet.colorado.edu/en/accessibility</a= ><br> >>> Physics Department<br> >>> University of Colorado, Boulder<br> >>> <br> >>> <br> >>> <br> >>> <br> >>> <br> >>> <br> >>> <br> > <br> > <br> > <br> <br> <br> </blockquote></div> --0000000000002bd35505a473a62c--