Re: Global Shortcut Keys and Screen Reader Accessibility?
Taliesin Smith <[email protected]> Wed, 29 Apr 2020 22:12:29 -0230
| Newsgroups | gmane.org.w3c.accessibility.general |
|---|---|
| Message-ID | <[email protected]> |
--Apple-Mail=_325FB251-6C8C-4775-B51F-940DA74F4136 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Great advice Amber. Thanks for sharing. I hadn=E2=80=99t thought of =E2=80=9CA way to turn = keyboard shortcuts off.=E2=80=9D That is an interesting thing to consider. Taliesin > On Apr 29, 2020, at 5:48 PM, Amber Holladay = <[email protected]> wrote: >=20 > Any time you use a keyboard shortcut, it is important to consider and = include the following: > * A way to turn the keyboard shortcut(s) off > * An alternative (and accessible) way to access the same = functionality without the keyboard (e.g. button elements on the page) > * How the keyboard shortcut affects different assistive technologies=20= > * Whether it is useful to allow shortcuts to be turned on/off as a = group as well as individually > * An accessible way to teach all users how to use the keyboard = shortcut(s)=20 >=20 > The spacebar is often used as a play/pause shortcut. >=20 > =20 >=20 > On Tue, Apr 28, 2020 at 7:00 AM Taliesin Smith <[email protected] = <mailto:[email protected]>> wrote: > Hi Matt, > I agree, it will be awesome to make the hotkey customizable. I hope to = make that part of future research. =20 >=20 > For now we=E2=80=99ve got Alt + k implemented as the hotkey to toggle = between paused and playing states no matter where the learner=E2=80=99s = current keyboard focus is.=20 >=20 > Basically, once the action in the simulation has been started, i.e. = once the photons are firing at the molecule; the hotkey combination can = be used to pause and play the action without the learner needing to move = their focus to the actual Pause/Play button. >=20 > As for role application, we only use it for custom interactions where = a native HTML option is not available. For example, we have successfully = used role application to make a grabbed balloon moveable in four = directions. As the learner grabs the balloon with a native button = interaction, role application is launched creating a 4-way custom drag = interaction, enabling a learner to move the grabbed balloon in any = direction. The learner can then use the arrow keys (or alternative = letter keys WASD) to move the balloon to rub it against a sweater or a = wall to explore how static electricity works. The balloon is released in = the same way to was grabbed. >=20 > =46rom the beginning of our research on making interactive science = simulations accessible, we treaded very carefully with role application. = Our research with users tells us that our native and custom interactions = are quite intuitive and accessible to blind learners. That said, we have = found, thus far, that starting a custom interaction with a native one, = like a button, works better for blind learners than immediately = presenting a custom interaction upon focus. >=20 > The suggestions, advice, comments, perspectives I am exposed to on = this list are awesome. >=20 > Taliesin >=20 > ~.~.~ > Available off list at [email protected] = <mailto:[email protected]> > Inclusive Design Researcher > PhET Interactive Simulations > https://phet.colorado.edu/en/accessibility = <https://phet.colorado.edu/en/accessibility> > Physics Department > University of Colorado, Boulder >=20 > > On Apr 28, 2020, at 4:18 AM, Matt King <[email protected] = <mailto:[email protected]>> wrote: > >=20 > > Customizable is definitely good. > >=20 > > I'd recommend avoid using role application. Please carefully read = the spec for role application before deciding whether to go down that = path. > >=20 > > Matt > >=20 > > -----Original Message----- > > From: Taliesin Smith <[email protected] = <mailto:[email protected]>>=20 > > Sent: Wednesday, April 15, 2020 1:33 PM > > To: Karen Lewellen <[email protected] = <mailto:[email protected]>> > > Cc: WAI IG <[email protected] <mailto:[email protected]>> > > Subject: Re: Global Shortcut Keys and Screen Reader Accessibility? > >=20 > > Hi Karen, > > Great question. The answer, unfortunately is no. > >=20 > > For our simulations (PhET Interactive Simulations) we test in these = three pairs (VO & Safari, NVDA & FF, and JAWS & Chrome). That said, = while presenting at the CSUN conference a couple of years ago a person = in the audience tweeted that the simulation I was demoing worked great = in Orca on Linux. > >=20 > > I agree, the challenge is finding an intuitive combination that does = conflict with anything else. > >=20 > > I liked Jonathan=E2=80=99s idea of making the shortcut customizable. = We are currently doing research on adaptive features. > >=20 > > Taliesin > >=20 > >> On Apr 15, 2020, at 5:48 PM, Karen Lewellen = <[email protected] <mailto:[email protected]>> wrote: > >>=20 > >> Do you intend testing with Linux and its various screen reader = programs? > >> Your goals are terrific, with my one concern being finding a key = combination that is not used by one of the scores of screen readers a = person might choose for their individual accommodating needs. > >> Karen > >>=20 > >>=20 > >>=20 > >> On Wed, 15 Apr 2020, Taliesin Smith wrote: > >>=20 > >>> Hi Folks, > >>> I am looking into the feasibility of global hotkey or Keyboard = Shortcut that would toggle a Pause/Play button in a simulated learning = environment regardless of where the keyboard focus is currently at in = the application. > >>>=20 > >>> While the Pause/Play button interaction is somewhat akin to how a = video player works, it is not exactly the same kind of experience in our = situation. > >>>=20 > >>> We are currently working on a science simulation called Molecules = and Light = <https://phet-dev.colorado.edu/html/molecules-and-light/1.5.0-dev.44/phet/= molecules-and-light_en_phet.htm = <https://phet-dev.colorado.edu/html/molecules-and-light/1.5.0-dev.44/phet/= molecules-and-light_en_phet.htm>> (note to hear the interactive = descriptions you need to use a screen reader - VO & Safari, NVDA & FF or = JAWS & Chrome). > >>>=20 > >>> In this simulated environment a learner turns a light source to = fire photons at a molecule. The learner can change the light source and = the molecule on the fly and observe what happens. > >>>=20 > >>> Learners can also Pause the action (the firing of photons) without = turning the light source off. When the action is paused, the learner can = use a Step Forward button to move the action (the photons) forward = little by little to examine more closely what happens when a photon = passes through or is absorbed by the molecule. > >>>=20 > >>> In interviews with blind learners, we found that learners were = confused by the Pause/Play and Step Forward buttons, especially when the = light source had not already been turned on. And if the simulation was = set to Pause, they were often temporarily confused why the light source = button would no longer fire photons. > >>>=20 > >>> We have made improvements to the descriptive experience by adding = aria-live alerts that indicate if the light source is off or if the sim = is paused, and why it might be useful to use the Step Forward button = when the Pause button is activated. We think these aria-live alerts will = create a much more intuitive experience (more user testing is pending). > >>>=20 > >>> That said, a few learners requested a global keyboard shortcut to = quickly Pause and Play the action no matter where their focus was. My = question to the list is, does any one have any experience or resources = on making a global keyboard shortcut that does not rely on focus and = works when screen reader software is enabled. I am assuming we would = need to use a modifier key. Something like Control + k or Alt + k. > >>>=20 > >>> This kind of Pause/Play and Step Forward interaction is used in = many of our interactive science simulations. A global hot key could be = useful for all learners whether they use screen readers or not. > >>>=20 > >>> Thanks in advance for any resources on accessible global keyboard = shortcuts. I have read this great medium article by Sasha Maximova, J, = K, or How to choose keyboard shortcuts for web applications = <https://medium.com/@sashika/j-k-or-how-to-choose-keyboard-shortcuts-for-w= eb-applications-a7c3b7b408ee = <https://medium.com/@sashika/j-k-or-how-to-choose-keyboard-shortcuts-for-w= eb-applications-a7c3b7b408ee>>, several times, and am looking for more = resources. > >>>=20 > >>> Taliesin > >>> ~.~.~ > >>> Also available off list at: [email protected] = <mailto:[email protected]> Inclusive=20 > >>> Design Researcher PhET Interactive Simulations=20 > >>> https://phet.colorado.edu/en/accessibility = <https://phet.colorado.edu/en/accessibility> > >>> Physics Department > >>> University of Colorado, Boulder > >>>=20 > >>>=20 > >>>=20 > >>>=20 > >>>=20 > >>>=20 > >>>=20 > >=20 > >=20 > >=20 >=20 >=20 --Apple-Mail=_325FB251-6C8C-4775-B51F-940DA74F4136 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html; = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;" class=3D"">Great= advice Amber.<div class=3D"">Thanks for sharing. I hadn=E2=80=99t = thought of =E2=80=9CA way to turn keyboard shortcuts off.=E2=80=9D</div><d= iv class=3D"">That is an interesting thing to consider.</div><div = class=3D"">Taliesin<br class=3D""><div><br class=3D""><blockquote = type=3D"cite" class=3D""><div class=3D"">On Apr 29, 2020, at 5:48 PM, = Amber Holladay <<a href=3D"mailto:[email protected]" = class=3D"">[email protected]</a>> wrote:</div><br = class=3D"Apple-interchange-newline"><div class=3D""><div dir=3D"ltr" = class=3D"">Any time you use a keyboard shortcut, it is important to = consider and include the following:<div class=3D""> * A way to turn = the keyboard shortcut(s) off</div><div class=3D""> * An alternative = (and accessible) way to access the same functionality without the = keyboard (e.g. button elements on the page)</div><div class=3D""> * = How the keyboard shortcut affects different assistive = technologies </div><div class=3D""> * Whether it is useful to = allow shortcuts to be turned on/off as a group as well as = individually</div><div class=3D""> * An accessible way to teach all = users how to use the keyboard shortcut(s) </div><div class=3D""><br = class=3D""></div><div class=3D"">The spacebar is often used as a = play/pause shortcut.</div><div class=3D""><br class=3D""></div><div = class=3D""> </div></div><br class=3D""><div = class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Tue, Apr = 28, 2020 at 7:00 AM Taliesin Smith <<a = href=3D"mailto:[email protected]" target=3D"_blank" = class=3D"">[email protected]</a>> wrote:<br = class=3D""></div><blockquote class=3D"gmail_quote" style=3D"margin:0px = 0px 0px 0.8ex;border-left:1px solid = rgb(204,204,204);padding-left:1ex">Hi Matt,<br class=3D""> I agree, it will be awesome to make the hotkey customizable. I hope to = make that part of future research. <br class=3D""> <br class=3D""> For now we=E2=80=99ve got Alt + k implemented as the hotkey to toggle = between paused and playing states no matter where the learner=E2=80=99s = current keyboard focus is. <br class=3D""> <br class=3D""> Basically, once the action in the simulation has been started, i.e. once = the photons are firing at the molecule; the hotkey combination can be = used to pause and play the action without the learner needing to move = their focus to the actual Pause/Play button.<br class=3D""> <br class=3D""> As for role application, we only use it for custom interactions where a = native HTML option is not available. For example, we have successfully = used role application to make a grabbed balloon moveable in four = directions. As the learner grabs the balloon with a native button = interaction, role application is launched creating a 4-way custom drag = interaction, enabling a learner to move the grabbed balloon in any = direction. The learner can then use the arrow keys (or alternative = letter keys WASD) to move the balloon to rub it against a sweater or a = wall to explore how static electricity works. The balloon is released in = the same way to was grabbed.<br class=3D""> <br class=3D""> =46rom the beginning of our research on making interactive science = simulations accessible, we treaded very carefully with role application. = Our research with users tells us that our native and custom interactions = are quite intuitive and accessible to blind learners. That said, we have = found, thus far, that starting a custom interaction with a native one, = like a button, works better for blind learners than immediately = presenting a custom interaction upon focus.<br class=3D""> <br class=3D""> The suggestions, advice, comments, perspectives I am exposed to on this = list are awesome.<br class=3D""> <br class=3D""> Taliesin<br class=3D""> <br class=3D""> ~.~.~<br class=3D""> Available off list at <a href=3D"mailto:[email protected]" = target=3D"_blank" class=3D"">[email protected]</a><br = class=3D""> Inclusive Design Researcher<br class=3D""> PhET Interactive Simulations<br class=3D""> <a href=3D"https://phet.colorado.edu/en/accessibility" rel=3D"noreferrer" = target=3D"_blank" = class=3D"">https://phet.colorado.edu/en/accessibility</a><br class=3D""> Physics Department<br class=3D""> University of Colorado, Boulder<br class=3D""> <br class=3D""> > On Apr 28, 2020, at 4:18 AM, Matt King <<a = href=3D"mailto:[email protected]" target=3D"_blank" = class=3D"">[email protected]</a>> wrote:<br class=3D""> > <br class=3D""> > Customizable is definitely good.<br class=3D""> > <br class=3D""> > I'd recommend avoid using role application. Please carefully read = the spec for role application before deciding whether to go down that = path.<br class=3D""> > <br class=3D""> > Matt<br class=3D""> > <br class=3D""> > -----Original Message-----<br class=3D""> > From: Taliesin Smith <<a href=3D"mailto:[email protected]" = target=3D"_blank" class=3D"">[email protected]</a>> <br class=3D""> > Sent: Wednesday, April 15, 2020 1:33 PM<br class=3D""> > To: Karen Lewellen <<a href=3D"mailto:[email protected]" = target=3D"_blank" class=3D"">[email protected]</a>><br = class=3D""> > Cc: WAI IG <<a href=3D"mailto:[email protected]" target=3D"_blank"= class=3D"">[email protected]</a>><br class=3D""> > Subject: Re: Global Shortcut Keys and Screen Reader = Accessibility?<br class=3D""> > <br class=3D""> > Hi Karen,<br class=3D""> > Great question. The answer, unfortunately is no.<br class=3D""> > <br class=3D""> > For our simulations (PhET Interactive Simulations) we test in these = three pairs (VO & Safari, NVDA & FF, and JAWS & Chrome). = That said, while presenting at the CSUN conference a couple of years ago = a person in the audience tweeted that the simulation I was demoing = worked great in Orca on Linux.<br class=3D""> > <br class=3D""> > I agree, the challenge is finding an intuitive combination that = does conflict with anything else.<br class=3D""> > <br class=3D""> > I liked Jonathan=E2=80=99s idea of making the shortcut = customizable. We are currently doing research on adaptive features.<br = class=3D""> > <br class=3D""> > Taliesin<br class=3D""> > <br class=3D""> >> On Apr 15, 2020, at 5:48 PM, Karen Lewellen <<a = href=3D"mailto:[email protected]" target=3D"_blank" = class=3D"">[email protected]</a>> wrote:<br class=3D""> >> <br class=3D""> >> Do you intend testing with Linux and its various screen = reader programs?<br class=3D""> >> Your goals are terrific, with my one concern being finding a = key combination that is not used by one of the scores of screen = readers a person might choose for their individual accommodating = needs.<br class=3D""> >> Karen<br class=3D""> >> <br class=3D""> >> <br class=3D""> >> <br class=3D""> >> On Wed, 15 Apr 2020, Taliesin Smith wrote:<br class=3D""> >> <br class=3D""> >>> Hi Folks,<br class=3D""> >>> I am looking into the feasibility of global hotkey or = Keyboard Shortcut that would toggle a Pause/Play button in a simulated = learning environment regardless of where the keyboard focus is currently = at in the application.<br class=3D""> >>> <br class=3D""> >>> While the Pause/Play button interaction is somewhat akin to = how a video player works, it is not exactly the same kind of experience = in our situation.<br class=3D""> >>> <br class=3D""> >>> We are currently working on a science simulation called = Molecules and Light <<a = href=3D"https://phet-dev.colorado.edu/html/molecules-and-light/1.5.0-dev.4= 4/phet/molecules-and-light_en_phet.htm" rel=3D"noreferrer" = target=3D"_blank" = class=3D"">https://phet-dev.colorado.edu/html/molecules-and-light/1.5.0-de= v.44/phet/molecules-and-light_en_phet.htm</a>> (note to hear the = interactive descriptions you need to use a screen reader - VO & = Safari, NVDA & FF or JAWS & Chrome).<br class=3D""> >>> <br class=3D""> >>> In this simulated environment a learner turns a light = source to fire photons at a molecule. The learner can change the light = source and the molecule on the fly and observe what happens.<br = class=3D""> >>> <br class=3D""> >>> Learners can also Pause the action (the firing of photons) = without turning the light source off. When the action is paused, the = learner can use a Step Forward button to move the action (the photons) = forward little by little to examine more closely what happens when a = photon passes through or is absorbed by the molecule.<br class=3D""> >>> <br class=3D""> >>> In interviews with blind learners, we found that learners = were confused by the Pause/Play and Step Forward buttons, especially = when the light source had not already been turned on. And if the = simulation was set to Pause, they were often temporarily confused why = the light source button would no longer fire photons.<br class=3D""> >>> <br class=3D""> >>> We have made improvements to the descriptive experience by = adding aria-live alerts that indicate if the light source is off or if = the sim is paused, and why it might be useful to use the Step Forward = button when the Pause button is activated. We think these aria-live = alerts will create a much more intuitive experience (more user testing = is pending).<br class=3D""> >>> <br class=3D""> >>> That said, a few learners requested a global keyboard = shortcut to quickly Pause and Play the action no matter where their = focus was. My question to the list is, does any one have any experience = or resources on making a global keyboard shortcut that does not rely on = focus and works when screen reader software is enabled. I am assuming we = would need to use a modifier key. Something like Control + k or Alt + = k.<br class=3D""> >>> <br class=3D""> >>> This kind of Pause/Play and Step Forward interaction is = used in many of our interactive science simulations. A global hot key = could be useful for all learners whether they use screen readers or = not.<br class=3D""> >>> <br class=3D""> >>> Thanks in advance for any resources on accessible global = keyboard shortcuts. I have read this great medium article by Sasha = Maximova, J, K, or How to choose keyboard shortcuts for web applications = <<a = href=3D"https://medium.com/@sashika/j-k-or-how-to-choose-keyboard-shortcut= s-for-web-applications-a7c3b7b408ee" rel=3D"noreferrer" target=3D"_blank" = class=3D"">https://medium.com/@sashika/j-k-or-how-to-choose-keyboard-short= cuts-for-web-applications-a7c3b7b408ee</a>>, several times, and am = looking for more resources.<br class=3D""> >>> <br class=3D""> >>> Taliesin<br class=3D""> >>> ~.~.~<br class=3D""> >>> Also available off list at: <a = href=3D"mailto:[email protected]" target=3D"_blank" = class=3D"">[email protected]</a> Inclusive <br class=3D""> >>> Design Researcher PhET Interactive Simulations <br = class=3D""> >>> <a href=3D"https://phet.colorado.edu/en/accessibility" = rel=3D"noreferrer" target=3D"_blank" = class=3D"">https://phet.colorado.edu/en/accessibility</a><br class=3D""> >>> Physics Department<br class=3D""> >>> University of Colorado, Boulder<br class=3D""> >>> <br class=3D""> >>> <br class=3D""> >>> <br class=3D""> >>> <br class=3D""> >>> <br class=3D""> >>> <br class=3D""> >>> <br class=3D""> > <br class=3D""> > <br class=3D""> > <br class=3D""> <br class=3D""> <br class=3D""> </blockquote></div> </div></blockquote></div><br class=3D""></div></body></html>= --Apple-Mail=_325FB251-6C8C-4775-B51F-940DA74F4136--