The General Public Inclusive Infrastructure (GPII) for
Auto-Personalisation of Accessibility

Christophe Strobbe (HdM)Javier Hernndez (Emergya)

GPII Goals (1)

Enable accessibility by:adapting software to fit the user's needs

operating system settings: Windows, Linux GNOME, Android

assistive technology (AT) settings: Orca, on-screen keyboard,

browsers and web applications: Firefox,

third-party apps, e.g. Mobile Accessibility for Android (Code Factory)

GPII Goals (2)

Delivering AT that fits the user's needs

Finding alternative versions of content

e.g. captioned versions of video

Adapting embedded systems

ticketing machines, TV

Orca logoAccessibility logoNVDA logo

GPII = Infrastructure

"Global Public Inclusive Infrastructure"We don't build new AT

AT and other softwaregets adapted to connect to GPII

can then adapt to the user's settings

We build the framework to enable this

Contributing Projects

Led by Raising the Floor InternationalStarted by Prof. Gregg Vanderheiden

Cloud4all: EU-funded project, Nov 2011 Oct 2015

24 partners, including Trace Center (Wisconsin, US) & IDRC (Toronto, Ca)

Fluid & FLOE (Canada)

Research to Reality (US)

Preferences for Global Access (US DoE)

Major Components of GPII

Will something help me? What?

Getting access automatically, anywhere, on
any device

Tools to make it easier, lower-cost to create & market new solutions

User Awareness

Needs & PrefsDiscovery Aid

GPII Unified Listing& Marketplace

Prefs & PermServer

Real TimeMatching

DevelopersSpace

Users find out something existsfor them.

Users can find out
which types of
things help them

Find all solutions, AT
& Mainstreamdevice / feature / service

User needs & prefs stored securely andavailable anywhere

Prefs and context used to determine best fit; here, now.

User can call up any assistance anywhere

Free & commercialparts to speed dev,and lower costs

Consumers & ExpertsConnection

Experts, consumers,
testers etc to help
new developers

Delivery/Launch Management

Built-in + AT are auto-adjusted andlaunched, anywhere

ShoppingAid

Users can use their
profile to find just
what helps them

Micro-FinanceMicro-PaymentInfrastructure

Mechanism for Financing R&D and Service Del

GPII Unified Listing & Marketplace

Developers can
quickly, efficiently
market worldwide

ServiceCreation Tools

To make it easy to
Create AOD, Media,& Material service

Needs & Prefs Storage

Users can store
needs & preferences
info for later use

Assistance on Demand (AOD)

Media & Materials

Auto- augmentationtransformation and/or replacement

Cloud4all

US Dept of Ed

Updated by kasper: Jan 12, 2012

Will something help me? What?

User Awareness - Users find out something exists for them.

Needs & Preference Identification Tool (NAPIT) Wizard - users can find out which types of things help them.

Needs & Preference Profile - Users can store need and preference info for later use.

GPII Unified Listing and Marketplace (Master list and Basic list) - find all existing solutions, at once, commercial and free.

Shopping Aide (matching done before purchase of AT/mainstream prod) - Users can use profile to find just what helps them.

Getting access automatically, anywhere, on any device.

Preference and Permission Server - Securely stored and available anywhere

Real Time Matching (includes preference transformations) Preferences, permissions and context used to determine best fit

Delivery/Launch Management (anywhere/any time/any device) (and user real-time micro adjust) - built in + AT are auto adjusted and delivered anywhere

Media & Mtls (Augmentation/Transformation/Replacement) Automatic media augmentation, transformation and replacement

Assistance on Demand (commercial and volunteer) - User can call any assistance anywhere.

Tools to make it easier, lower-cost, to create and market new solutions.

Developers Space (parts, tools, bases, resources) Free & commercial parts to speed dev. and lower costs

Rich Expertise Resource for developers (Consumers, Experts, and materials) - Experts, consumers, testers etc to help new developers

Assistance on Demand Service Infrastructure - Infrastructure to make it easy to provide AOD service.

GPII Unified Listing & Marketplace - Developers can quickly, efficiently, market worldwide.

Demo: Transfer Adaptations

A set of preferences is created on Linux

User moves to Windows

Preferences are used to adapt Windows

Sammy (magnification & inverted colours):http://localhost:8081/user/sammy/login

http://localhost:8081/user/sammy/logout

Mikel Vargas (on-screen keyboard)http://localhost:8081/user/MikelVargas/login

http://localhost:8081/user/MikelVargas/logout

Demo: Android

Using Anode: Android port of Node.js

Customising settings is harder

Requires rooted phone!

Currently only:Settings system API, e.g. font size

Launch applications, Talkback screenreader

Good NFC support for logging in & out

Sensors for context-based adaptation

Architecture

Architecture diagram: The Flow Manager in the middle controls the flow between the following components: the User Listener, the Preferences Server, the Device Reporter, the Matchmaker (which consults the Solutions Registry) and the Lifecycle Manager, which uses the Lifecycle Handlers and the Settings Handlers.

User Listeners

user presents a "key"

using a USB drive

using an NFC tag

typing a special string on the keyboard

...

User Listener detects the key and sends it to the Flow Manager

NFC logoUSB keyQR code for mobile version of Wikipedia

Preferences

Flow Manager fetches preferences from Preference Server

Format = JSON

{ "http://registry.gpii.net/common/language": [ { "value": "fr-ca" } ], "http://registry.gpii.net/common/speechRate": [ { "value": 100 } ], "http://registry.gpii.net/common/repeatKeysRepeatRate": [ { "value": 0.5 } ], "http://registry.gpii.net/comon/repeatKeysAutomaticDelay": [ { "value": true } ]}

Device & Context Information

The device tells the Flow Manager

what operating system it is running

what assistive technologies are available

"context information" (ambient light, ambient noise)-> automatically adapt contrast depending on light

-> automatically increase sound or switch on captions depending on noise

early work on Android

Matchmaker & Solutions Registry

Flow Manager sends preferences and device info to the Matchmaker

Matchmaker infers settings for "new" OS or software

Matchmaker consults Solutions Registry for info on assistive technologies etc.

Launching and Stopping Solutions

Flow Manager sends settings to Lifecycle Manager

Snapshot of current settings

Set each application's settings

Launch application(s)

When user "logs out", restore original settings

More Info?

Project: www.cloud4all.info

GPII & contributing projects: www.gpii.net

Screenshot of the Cloud4all website

See Our Work?

Wiki: http://wiki.gpii.net/

Screenshot of the GPII wiki showing the page with installation instructions for the real-time framework

Want to Contribute?

Fork our code: http://github.com/GPII

Screenshot of the GPII repository on GitHub.com

Click to edit the title text format