a macroscopic web accessibility evaluation at different processing phases
TRANSCRIPT
![Page 1: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/1.jpg)
A macroscopic Web accessibility evaluation at different
processing phases
Nádia Fernandes, Luís Carriço
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
![Page 2: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/2.jpg)
Motivation
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
2
![Page 3: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/3.jpg)
Introduction
• The Web is being used by all kinds of people;
• Web sites must be accessible;
• Modern Web development transcends static HTML;
• A more real evaluation is necessary.
39th International Cross-Disciplinary Conference on Web Accessibility –
16/17th April 2012 – Lyon, France.
![Page 4: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/4.jpg)
Previous work
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
4
![Page 5: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/5.jpg)
QualWeb evaluator
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
5
Before
After
• Accessibility evaluation of Web pages:
– using WCAG 2.0 ,
• 18 HTML techniques;
– at different processing phases
• BEFORE and AFTERBrowser processing;
![Page 6: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/6.jpg)
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
6
QualWeb evaluator: execution
![Page 7: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/7.jpg)
Some improvements...
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
7
![Page 8: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/8.jpg)
• is a command-line tool that uses WebKit ,
• works like a WebKit-based Web browser (simulation);
• can be controlled using Javascript.
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
8
PhantomJs
![Page 9: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/9.jpg)
1. It avoids data injection at the browser level;
2. Evaluated Web page before and after browser processing is exactly the same;
3. Integration with a crawler.
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
9
Problems Solved!
![Page 10: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/10.jpg)
How do the macroscopic properties emerging from Web accessibility change in respect to the processing phase of
delivery?
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
10
Research Question
![Page 11: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/11.jpg)
• We evaluated a set of Web pages from a list provided by the Portuguese Web Archive (version of 2008);
• We used the QualWeb evaluator.
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
11
Experimental Study
![Page 12: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/12.jpg)
• Results of the evaluation are presented in terms of:
– PASS, WARN, and FAIL (Applicable = PASS + WARN + FAIL)
• Metrics used:
– rate conservative =
– rate optimistic =
– rate strict =
• The results are between accessible (100%) and not accessible (0%).
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
12
Metrics
![Page 13: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/13.jpg)
• 24, 462 Web pages evaluated.
• Total Number of HTML elements:
– before processing - 24,918,720
– after processing - 41,967,072
– (Ratio ≈ 1.7).
• Average Number of HTML elements per page:
– before processing - 1010
– after processing – 1710
– (Ratio ≈1.7).
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
13
Results
![Page 14: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/14.jpg)
The differences of an HTML document between both
Processing Phases were observed.
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
14
![Page 15: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/15.jpg)
• Successes– before processing - 9 elements
– after processing - 87 elements
– (Ratio ≈ 9.7).
• Failures– before processing - 46 elements
– after processing – 176 elements
– (Ratio ≈ 3.8).
• Warnings– before processing - 262 elements
– after processing – 451 elements
– (Ratio ≈ 1.7).
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
15
Results: Average Outcomes
![Page 16: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/16.jpg)
• Conservative rate:– The average quality increases after
processing.
– Accessibility quality between 60% and 90%disappeared after processing.
• Optimistic rate:– The average quality decreases after
processing.
– Some results lower than 20% disappearedafter processing.
– Decrease of higher accessibility quality,leading to a lower accessibility average.
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
16
Results: rates Before and After processing
![Page 17: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/17.jpg)
• Strict rate:– The average increased after processing.
– Results higher than 85% disappearedafter processing.
– Worse pages before processing get higherscores after processing.
– Better pages before processing areranked lower after processing.
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
17
Results: rates Before and After processing
![Page 18: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/18.jpg)
1. Techniques coverage
2. Dynamic content
3. Automatic evaluation
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
18
Limitations
![Page 19: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/19.jpg)
• Evaluations before processing clearly is not the best option!
• We used/percept/interact with the after processed version.
• Considering the rates…
– Web pages possess higher uniformity
– That can be explained with reusable code
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
19
Discussion
![Page 20: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/20.jpg)
• Impact on Designing Accessible Web Pages
– Importance of sharing reusable code;
– High quality reusable code produce better quality pages.
• Impact on the Perception of Accessibility
– Each metric identify different perspectives;
– It is important that evaluations assess what user perceive.
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
20
Discussion
![Page 21: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/21.jpg)
• We presented a large-scale study of accessibility on the Web.
• We were able to characterize some accessibility properties of the Web, pointing some differences between processing phases.
• The results obtained on the evaluation of pages after browser processing tend to be more homogeneous than before.
• Considering that the end-user interacts with the after processed pages then most studies about Web quality should be redone.
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
21
Conclusion
![Page 22: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/22.jpg)
1. Enlarge the coverage of WCAG 2.0 implemented tests
2. Evaluate Rich Internet applications
3. Perform a comparative set of studies
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
22
Future Work
![Page 23: A macroscopic web accessibility evaluation at different processing phases](https://reader033.vdocument.in/reader033/viewer/2022052601/55953d641a28abe2268b46c1/html5/thumbnails/23.jpg)
9th International Cross-Disciplinary Conference on Web Accessibility –16/17th April 2012 – Lyon, France.
23