Re: A Terible Problem with accessibility of Gnome

--===============3311982199113583164==
Content-Type: multipart/alternative; boundary="000000000000875e7205c367c87e"

--000000000000875e7205c367c87e
Content-Type: text/plain; charset="UTF-8"

Hi Shadyar,

Not an immediate solution at all, but I would say that AI (Machine
Learning) which snapshots the screen or window and is able to extract the
text from the snapshot image to then read it aloud, might be superior to
legacy accessibility API paradigms which rely on the application developers
to interleave "accessibility" (ARIA etc.) information in each and every
field.

Or at least as an augmentation that should be able to provide a really
great fallback to any ARIA-like paradigm.

It would be a project, sure, but it is really very accomplishable at this
time and age.

Hopefully one day our desktops will be more fluid than only providing voice
services on top a graphical interaction interface, but a lot can be done
till then by leveraging Computer Vision AI in this space. Sorry again that
this is not any immediate solution.

Matan

On Fri, May 28, 2021 at 4:04 AM Shadyar Khodayari via
gnome-accessibility-list <[email protected]> wrote:

> Hello
> I'm a blind computer engineer, a developer and familiar with OS
> Windows and Screen reader NVDA entirely.
> I recently installed Linux Ubuntu v20.4 using Orca.
> I read Accessibility section of Ubuntu documentation as well as Orca
> documentation.
> After logging in,
> 1. When I am at Desktop through either pressing Super key + D or
> holding Alt + CTRL and pressing Tab, next pressing arrow keys or Tab,
> Orca does not read desktop icons.
> 2. 3. When I open a windows Settings, I press Tab numerous times but
> Orca does not read the Setting categories like wireless, Bluetooth ETC
> in the window. It seems focus never moves on this part of the window.
> 3. When I open a windows like application files or file trash, I press
> Tab numerous times but Orca does not read the main part of the window.
> It seems focus never moves on this part of the window.
> 4. Should I do a specific config on Gnome?
> 5. should I install another desktop environment?
> I will be appreciate if you would help me.
> Thanks and Regards
> Shadyar KHodayari
> _______________________________________________
> gnome-accessibility-list mailing list
> [email protected]
> https://mail.gnome.org/mailman/listinfo/gnome-accessibility-list
>

--000000000000875e7205c367c87e
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div dir=3D"ltr"><div>Hi Shadyar,</div><div><br></div><div=
>Not an immediate solution at all, but I would say that AI (Machine Learnin=
g) which snapshots the screen or window and is able to extract the text fro=
m the snapshot image to then read it aloud, might be superior to legacy acc=
essibility API paradigms which rely on the application developers to interl=
eave &quot;accessibility&quot; (ARIA etc.) information in each and every fi=
eld.=C2=A0<br><br>Or at least as an augmentation that should be able to pro=
vide a really great fallback to any ARIA-like paradigm.=C2=A0</div><div><br=
></div><div>It would be a project, sure, but it is really very accomplishab=
le at this time and age.=C2=A0</div><div><br></div><div>Hopefully one day o=
ur desktops will be more fluid than only providing voice services on top a =
graphical interaction interface, but a lot can be done till then by leverag=
ing Computer Vision AI in this space. Sorry again that this is not any imme=
diate solution.=C2=A0</div><div><br></div><div>Matan<br></div></div><br><di=
v class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Fri, May 2=
8, 2021 at 4:04 AM Shadyar Khodayari via gnome-accessibility-list &lt;<a hr=
ef=3D"mailto:[email protected]">gnome-accessibility-list@g=
nome.org</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote" style=3D=
"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-le=
ft:1ex">Hello<br>
I&#39;m a blind computer engineer, a developer and familiar with OS<br>
Windows and Screen reader NVDA entirely.<br>
I recently installed Linux Ubuntu v20.4 using Orca.<br>
I read Accessibility section of Ubuntu documentation as well as Orca<br>
documentation.<br>
After logging in,<br>
1. When I am at Desktop through either pressing Super key + D or<br>
holding Alt + CTRL and pressing Tab, next pressing arrow keys or Tab,<br>
Orca does not read desktop icons.<br>
2. 3. When I open a windows Settings, I press Tab numerous times but<br>
Orca does not read the Setting categories like wireless, Bluetooth ETC<br>
in the window. It seems focus never moves on this part of the window.<br>
3. When I open a windows like application files or file trash, I press<br>
Tab numerous times but Orca does not read the main part of the window.<br>
It seems focus never moves on this part of the window.<br>
4. Should I do a specific config on Gnome?<br>
5. should I install another desktop environment?<br>
I will be appreciate if you would help me.<br>
Thanks and Regards<br>
Shadyar KHodayari<br>
_______________________________________________<br>
gnome-accessibility-list mailing list<br>
<a href=3D"mailto:[email protected]" target=3D"_blank">gno=
[email protected]</a><br>
<a href=3D"https://mail.gnome.org/mailman/listinfo/gnome-accessibility-list=
" rel=3D"noreferrer" target=3D"_blank">https://mail.gnome.org/mailman/listi=
nfo/gnome-accessibility-list</a><br>
</blockquote></div></div>

--000000000000875e7205c367c87e--

--===============3311982199113583164==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
gnome-accessibility-list mailing list
[email protected]
https://mail.gnome.org/mailman/listinfo/gnome-accessibility-list

--===============3311982199113583164==--