march 9, 2008 vermelding onderdeel organisatie 1 searis'08 workshop ieeevr 2008, reno nv, usa...
Post on 21-Dec-2015
215 views
TRANSCRIPT
![Page 1: March 9, 2008 Vermelding onderdeel organisatie 1 SEARIS'08 Workshop IEEEVR 2008, Reno NV, USA Gerwin de Haan G. de Haan, F.H. Post Data Visualization Group](https://reader035.vdocument.in/reader035/viewer/2022062714/56649d6b5503460f94a4a06f/html5/thumbnails/1.jpg)
March 9, 2008
Vermelding onderdeel organisatie
1
SEARIS'08 Workshop
IEEEVR 2008, Reno NV, USA
Gerwin de Haan
G. de Haan,F.H. Post
Data Visualization Group & VRLabhttp://visualization.tudelft.nl/VRVis
Flexible Architecture for the Development of Real-Time Interaction Behavior (p.71)
![Page 2: March 9, 2008 Vermelding onderdeel organisatie 1 SEARIS'08 Workshop IEEEVR 2008, Reno NV, USA Gerwin de Haan G. de Haan, F.H. Post Data Visualization Group](https://reader035.vdocument.in/reader035/viewer/2022062714/56649d6b5503460f94a4a06f/html5/thumbnails/2.jpg)
March 9, 2008 2
G. de Haan, F.H. Post“Flexible Architecture for the Development
of Real-Time Interaction Behavior”SEARIS'08 Workshop
Real-Time Interaction Behavior
(VR) application behavior is interaction/event-based
Interaction Trends:• Multi – Object• Multi – User• Multi – Cursor• Multi – System
Interaction Trends:• Multi – Object• Multi – User• Multi – Cursor• Multi – System
Development Cycle:
• Implementation• Architecture• Interaction Model• Front-End• (Storyboard)
Unexpected complexity,
behavior, structure
Prototype, Experiment,
Analyse
![Page 3: March 9, 2008 Vermelding onderdeel organisatie 1 SEARIS'08 Workshop IEEEVR 2008, Reno NV, USA Gerwin de Haan G. de Haan, F.H. Post Data Visualization Group](https://reader035.vdocument.in/reader035/viewer/2022062714/56649d6b5503460f94a4a06f/html5/thumbnails/3.jpg)
March 9, 2008 3
G. de Haan, F.H. Post“Flexible Architecture for the Development
of Real-Time Interaction Behavior”SEARIS'08 Workshop
Work in Progress
Prototyping Interaction Software:
• Base Architecture: VRMeer
• Interaction Model: StateStream
• Run-time/Development Environment
-> Unifying through a dynamic language
![Page 4: March 9, 2008 Vermelding onderdeel organisatie 1 SEARIS'08 Workshop IEEEVR 2008, Reno NV, USA Gerwin de Haan G. de Haan, F.H. Post Data Visualization Group](https://reader035.vdocument.in/reader035/viewer/2022062714/56649d6b5503460f94a4a06f/html5/thumbnails/4.jpg)
March 9, 2008 4
G. de Haan, F.H. Post“Flexible Architecture for the Development
of Real-Time Interaction Behavior”SEARIS'08 Workshop
Architecture: VRMeer
[2] G.de Haan et. al. “Flexible Abstraction Layers for VR application development”
IEEE VR '07
![Page 5: March 9, 2008 Vermelding onderdeel organisatie 1 SEARIS'08 Workshop IEEEVR 2008, Reno NV, USA Gerwin de Haan G. de Haan, F.H. Post Data Visualization Group](https://reader035.vdocument.in/reader035/viewer/2022062714/56649d6b5503460f94a4a06f/html5/thumbnails/5.jpg)
March 9, 2008 5
G. de Haan, F.H. Post“Flexible Architecture for the Development
of Real-Time Interaction Behavior”SEARIS'08 Workshop
StateStream Model
Low-level design of techniques, relations
• Actors• Conceptual containers• e.g. VR Objects, Interactors, (Algorithms)
• Dual aproach for Interaction Modeling• Statemachine: Discrete behavior• Streammachine: Continuous exchange of data
[6] R.Jacob et. al. “A Software Model and Specification Language for Non-WIMP user interfaces”, ACM TOCHI '99
![Page 6: March 9, 2008 Vermelding onderdeel organisatie 1 SEARIS'08 Workshop IEEEVR 2008, Reno NV, USA Gerwin de Haan G. de Haan, F.H. Post Data Visualization Group](https://reader035.vdocument.in/reader035/viewer/2022062714/56649d6b5503460f94a4a06f/html5/thumbnails/6.jpg)
March 9, 2008 6
G. de Haan, F.H. Post“Flexible Architecture for the Development
of Real-Time Interaction Behavior”SEARIS'08 Workshop
StateStream Model: StateMachines
• StateCharts: Hierarchical, Concurrent Statemachines
• Functionality in callbacks of Events, Transitions
![Page 7: March 9, 2008 Vermelding onderdeel organisatie 1 SEARIS'08 Workshop IEEEVR 2008, Reno NV, USA Gerwin de Haan G. de Haan, F.H. Post Data Visualization Group](https://reader035.vdocument.in/reader035/viewer/2022062714/56649d6b5503460f94a4a06f/html5/thumbnails/7.jpg)
March 9, 2008 7
G. de Haan, F.H. Post“Flexible Architecture for the Development
of Real-Time Interaction Behavior”SEARIS'08 Workshop
StateStream Model: StreamMachines
• Data Flow Graph: Nodes, Connections, Ports• Functionality in callbacks of ports
![Page 8: March 9, 2008 Vermelding onderdeel organisatie 1 SEARIS'08 Workshop IEEEVR 2008, Reno NV, USA Gerwin de Haan G. de Haan, F.H. Post Data Visualization Group](https://reader035.vdocument.in/reader035/viewer/2022062714/56649d6b5503460f94a4a06f/html5/thumbnails/8.jpg)
March 9, 2008 8
G. de Haan, F.H. Post“Flexible Architecture for the Development
of Real-Time Interaction Behavior”SEARIS'08 Workshop
StateStream Model: Relations
![Page 9: March 9, 2008 Vermelding onderdeel organisatie 1 SEARIS'08 Workshop IEEEVR 2008, Reno NV, USA Gerwin de Haan G. de Haan, F.H. Post Data Visualization Group](https://reader035.vdocument.in/reader035/viewer/2022062714/56649d6b5503460f94a4a06f/html5/thumbnails/9.jpg)
March 9, 2008 9
G. de Haan, F.H. Post“Flexible Architecture for the Development
of Real-Time Interaction Behavior”SEARIS'08 Workshop
Integration with Python
• StateStream components are Python Classes• Methods: expressive functionality• Dynamic Typing: Flexible with restructuring• Inheritance: Derive and override• Introspection: run-time decisions, accessible• Mix-ins: Quick integration with base arch.• Instantiation: Create new components on-the-fly
• Python in control: Intercept and introspect “anywhere, anytime”
![Page 10: March 9, 2008 Vermelding onderdeel organisatie 1 SEARIS'08 Workshop IEEEVR 2008, Reno NV, USA Gerwin de Haan G. de Haan, F.H. Post Data Visualization Group](https://reader035.vdocument.in/reader035/viewer/2022062714/56649d6b5503460f94a4a06f/html5/thumbnails/10.jpg)
March 9, 2008 10
G. de Haan, F.H. Post“Flexible Architecture for the Development
of Real-Time Interaction Behavior”SEARIS'08 Workshop
Iterated Development• Challenges: containment, hierarchy, timing, order
• Gradual maturing• Model Extension• Transfer to Model• e.g. Templated sub-statemachines
• Complexity explosion unevitable• Supporting analysis tools (e.g. Visualisation,
logging)• Run-Time Environment• Towards end-user environment
![Page 11: March 9, 2008 Vermelding onderdeel organisatie 1 SEARIS'08 Workshop IEEEVR 2008, Reno NV, USA Gerwin de Haan G. de Haan, F.H. Post Data Visualization Group](https://reader035.vdocument.in/reader035/viewer/2022062714/56649d6b5503460f94a4a06f/html5/thumbnails/11.jpg)
March 9, 2008 11
G. de Haan, F.H. Post“Flexible Architecture for the Development
of Real-Time Interaction Behavior”SEARIS'08 Workshop
Run-Time Environment
• Python glue• ~ concurrent w. VR• GUI components• Introspection• Scripting• Mix event models
(d.tools)
[4] B. Hartmann, “Reflective Pysichal Prototyping through integrated design, test, and analysis”, UIST 2006
![Page 12: March 9, 2008 Vermelding onderdeel organisatie 1 SEARIS'08 Workshop IEEEVR 2008, Reno NV, USA Gerwin de Haan G. de Haan, F.H. Post Data Visualization Group](https://reader035.vdocument.in/reader035/viewer/2022062714/56649d6b5503460f94a4a06f/html5/thumbnails/12.jpg)
March 9, 2008 12
G. de Haan, F.H. Post“Flexible Architecture for the Development
of Real-Time Interaction Behavior”SEARIS'08 Workshop
Conclusions, Future Directions
• StateStream model and architecture• Work in progress• Visibility, flexibility, expressiveness• Speed up prototyping, development
• Future work• Extensible prototyping environment• (Semi-) Formal model properties• Serialization, Optimization, Distribution
• Multiple Python instances
![Page 13: March 9, 2008 Vermelding onderdeel organisatie 1 SEARIS'08 Workshop IEEEVR 2008, Reno NV, USA Gerwin de Haan G. de Haan, F.H. Post Data Visualization Group](https://reader035.vdocument.in/reader035/viewer/2022062714/56649d6b5503460f94a4a06f/html5/thumbnails/13.jpg)
March 9, 2008 13
G. de Haan, F.H. Post“Flexible Architecture for the Development
of Real-Time Interaction Behavior”SEARIS'08 Workshop
Questions ? Remarks !
[email protected] - http://visualisation.tudelft.nl/VRVis
!