visicast: virtual sign: capture, animation storage & transmission bda conference 2nd august 2000...
TRANSCRIPT
![Page 1: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/1.jpg)
![Page 2: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/2.jpg)
ViSiCAST:Virtual sign: Capture, Animation
Storage & Transmission
BDA Conference
2nd August 2000
Belfast
Dr John Low
RNID
![Page 3: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/3.jpg)
Notes on presentation
This was a user workshop which started with virtual reality examples, through general use of avatars with many video and CD viewer examples, before describing the project including examples of signing avatars. Quite interactive.
Feedback very mixed although our openness to listen was enthusiastically welcomed
![Page 4: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/4.jpg)
Virtual Reality
![Page 5: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/5.jpg)
Virtual Town Hall
![Page 6: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/6.jpg)
Avatars: Virtual humans
Films Internet Computer games
![Page 7: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/7.jpg)
Virtual Dancing
![Page 8: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/8.jpg)
Annanova
![Page 9: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/9.jpg)
![Page 10: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/10.jpg)
![Page 11: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/11.jpg)
annanova.com
![Page 12: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/12.jpg)
Vandrea
![Page 13: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/13.jpg)
The The ViSiCAST ViSiCAST ProjectProjectViVirtual rtual SiSigning: gning: CCapture, apture, AAnimation, nimation, SStorage & torage & TTransmissionransmission
IST Programme -1999-10500IST Programme -1999-10500
55th th Framework ProgramFramework ProgramKey Actions:Key Actions:
• Systems and services for citizen To meet the needs and expectations of European
citizens for high quality and affordable services
of general interest. RTD will be carried out in the
fields of health, persons with special needs
(including elderly and disabled), administrations,
environment and transport.
• Multimedia context and tools
Duration:Duration:36 months
![Page 14: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/14.jpg)
Advanced technology-based
Project statementProject statement
Information access and communicationof signing deaf people
Open choice
No proprietarysolutions
![Page 15: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/15.jpg)
Independent Television
Commission
The ViSiCAST Consortium
Televirtual
University of East Anglia
The Post Office
Royal Institute for Deaf People
Instituutvoor Doven
Hamburg University
Institut für Rundfunktechnik
Institut National des Télécommunications
![Page 16: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/16.jpg)
ViSiCAST Partners ITC, UK : Project co-ordination
IRT, Germany : Broadcast technology
TeleVirtual, UK : Avatar creation
IDGS, Germany : Sign language notation
UEA, UK : Processing of language, speech & signing
INT, France : Broadcast imaging & animation standards
IvD, Netherlands : Multimedia content creation
Post Office, UK : Face-to-face transaction systems
RNID, UK : Monitoring of signing and evaluation
![Page 17: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/17.jpg)
ViSiCAST Structure
WWW
Transactions
Broadcast
Language
Animation
![Page 18: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/18.jpg)
Multimedia and Internet applications
Adding signing services to multimedia improves access to information for leisure, learning and
communication
Browser plug-in accurate signing of existing content on the internet translation of own text to generate signed content on own
website
![Page 19: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/19.jpg)
Face-to-Face Transactions
Post Office, Advice Services, Shops Simple spoken phrases recognised and
translated to sign language
Television accessTelevision access
![Page 20: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/20.jpg)
Television and Broadcast
Developing transmission technology virtual signer in set-top boxes transmission of signing from text subtitles
![Page 21: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/21.jpg)
TV and broadcast
TV Capture Card
Teletext Stream
Audio/Video Stream
Avatar Software MixerComputer
![Page 22: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/22.jpg)
Current technology:Motion capture
![Page 23: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/23.jpg)
Motion Capture
Weather Forecast
ComputerSystem
Post-processing
![Page 24: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/24.jpg)
Display System
Weather Forecast
ComputerSystem
QuickTime™ and aMicrosoft Video 1 decompressorare needed to see this picture.
![Page 25: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/25.jpg)
Constrained System
AvatarSpeech to Text
UEA TV
Speech Playlist
acks
Tessa with GML
GML Parser
UEA
GML
acks
![Page 26: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/26.jpg)
New technology to be developed:Language and Notation
Translate English text to European sign languages: BSL, DGS, SLN
Define a an intermediate code between text and sign languages: “Gesture Markup Language” or GML
GML builds on the Hamburg Notation System, “HamNoSys” which codes hand shape and orientation, location, and movement
![Page 27: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/27.jpg)
English to Sign Translation via intermediate code: Discourse
Representation Structure (DRS)
English DRS
BSL (UK)
DGS (Germany)
SLN (Netherlands)
![Page 28: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/28.jpg)
RNID’s role Bridge between the project partners and the deaf
people who could benefit from the technology Wide dissemination of project aims Collation of feedback through visits to UK deaf
clubs and groups Evaluations of prototype systems by deaf people
to influence how systems can be improved
![Page 29: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/29.jpg)
ViSiCAST : Conclusion
Aims ambitious within 3 years Novel computational linguistics work to
generate and represent signing Advanced avatar technology for signing virtual
humans Input essential from deaf people so that the
technology develops to maximise benefits
![Page 30: ViSiCAST: Virtual sign: Capture, Animation Storage & Transmission BDA Conference 2nd August 2000 Belfast Dr John Low RNID](https://reader036.vdocument.in/reader036/viewer/2022062318/55160bfc55034694308b50fc/html5/thumbnails/30.jpg)
Thank you