Combining AI and web accessibility
2018-11-28
Thread
AudioGames . net Forum — Off-topic room : oliver . edholm via Audiogames-reflector
Combining AI and web accessibility Hi!I'm a sighted machine learning researcher that recently have caught an eye on the field of web accessibility.Websites are primarily designed to be interacted with visually which is hard to do if you have a visual impairment. Here I think there's big potential for AI to help and look at the web page visually and then give correct and helpful information to the visually impaired user, in contrast to how many developers do it today.Things I think I know how to implement:* Visual analysis of web elements. What kind of icon is this? Is this a photograph or digital image? Is there text in this element that the screen reader can't detect?* Assigning labels to input fields / forms* Assigning heading levels to text elements.Are there any other problems that you think could be solved with AI?If anyone wants to check it out I also recently made a proof of concept browser extension that takes any information dense web page and transforms it to its essentials, which I guess could be helpful for screen reader users. The algorithm is slow but it's a proof of concept.Chrome: https://chrome.google.com/webstore/deta … gnnl?hl=svFirefox:https://addons.mozilla.org/sv-SE/firefo … ntializer/Any feedback is appreciated!Regards,Oliver URL: http://forum.audiogames.net/post/395642/#p395642 -- Audiogames-reflector mailing list Audiogames-reflector@sabahattin-gucukoglu.com https://sabahattin-gucukoglu.com/cgi-bin/mailman/listinfo/audiogames-reflector
Re: Combining AI and web accessibility
Re: Combining AI and web accessibility You make the claim that "websites are primarily designed to be interacted with visually". This seems like a huge blanket statement. Most websites may be designed for that purpose, or they may not -- there's no way to know since the internet consists of billions of them. But most websites, disregarding ones that are deliberately made inaccessible (i.e. by using so much _javascript_ your browser verges on crashing, or using no labels anywhere) (I don't consider using heading-less, frame documents to be within that category since their still perfectly navigable) are perfectly fine without AI. So I don't know where this would necessarily be useful. URL: http://forum.audiogames.net/post/395652/#p395652 -- Audiogames-reflector mailing list Audiogames-reflector@sabahattin-gucukoglu.com https://sabahattin-gucukoglu.com/cgi-bin/mailman/listinfo/audiogames-reflector
Re: Combining AI and web accessibility
Re: Combining AI and web accessibility Hello Oliver,I have not managed to understand how your extension is working... Also proposed shortcut is used for something else, at least in Firefox.I am a sighted programmer. And I try to help the community. On one side I am targeting practical usefulness more then pure research, on the other with sufficient effort and resource that can change the way the community is forced to use most modern programs: http://www.azslow.com/index.php?topic=437.0I have no time nor knowledge to advance AI part. I am just doing that part myself (but there is the second part, how to provide control for the interface with audition of relevant information, that part I already delegate to computer).Example: https://static.kvraudio.com/i/b/ni_dama … filter.jpgLook at the picture. You see knobs, faders, buttons, tabs on the left and the right side. And everything is labeled.Note that all text with corresponding positions is possible to get with OCR.But can you automatically detect there is a knob and distinguish it from let say a fader? Note that central knob is also just a knob.Can you detect that the whole left section is Equilizer controls, with 3 tabs in it? And that you probably can switch to some different view by pressing "Main" button on the right top corner, since currently highlighted is "EQ/Filters"?Challenging? Yes. But that is real thing. If you manage to interpret such interfaces (I mean any of them, not just one particular), that will be a big thing. Also I guess auto industry will offer you a good job in the self driving autos research departments URL: http://forum.audiogames.net/post/395659/#p395659 -- Audiogames-reflector mailing list Audiogames-reflector@sabahattin-gucukoglu.com https://sabahattin-gucukoglu.com/cgi-bin/mailman/listinfo/audiogames-reflector
Re: Combining AI and web accessibility
2018-11-29
Thread
AudioGames . net Forum — Off-topic room : oliver . edholm via Audiogames-reflector
Re: Combining AI and web accessibility Thanks for the replies!From the replies it seems like most websites are OK but the real problems lies in more _javascript_ intensive websites that are responsive and have a lot of custom elements. It seems like automatically assigning heading levels to pages without them could be something very useful. What would be the most convenient? Browser extension, NVDA add on, some background process in Windows...?Will definitely try using NVDA with a blindfold or something for some days to get more of a grasp of the problems that occur.I've looked a little bit into the OCR capabilities of screen readers and from what I've read they are good if the page is very inaccessible but the OCR program is still error prone and only detects text, no forms, buttons, links e.t.c? URL: http://forum.audiogames.net/post/395785/#p395785 -- Audiogames-reflector mailing list Audiogames-reflector@sabahattin-gucukoglu.com https://sabahattin-gucukoglu.com/cgi-bin/mailman/listinfo/audiogames-reflector
