bruce damer's presentation of digital spaces, an open source 3d simulation platform for space...

62
Bruce Damer, CEO DigitalSpace Corporation 343 Soquel Ave, Suite 70 Santa Cruz, CA 95062 Ph: 831 338 9400 Email: [email protected] Digital Spaces (DSS) An open source 3D simulation platform for space applications

Upload: bruce-damer

Post on 21-Nov-2014

1.720 views

Category:

Technology


0 download

DESCRIPTION

Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

TRANSCRIPT

Page 1: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Bruce Damer, CEODigitalSpace Corporation343 Soquel Ave, Suite 70Santa Cruz, CA 95062Ph: 831 338 9400Email: [email protected]

Digital Spaces (DSS)An open source 3D simulation platform for

space applications

Page 2: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Digital SpacesOpen Source Real-time 3D Modeling and Simulation

I. OverviewII. BeginnningsIII. Early Work

IV. Surface MobilityV. Demo – ESS STS-125

VI. Architectural OverviewAcknowledgements

Page 3: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

I. Overview• Development funded by: NASA Ames, HQ & NASA Centers, ESA, Raytheon, Boeing, Adobe & numerous smaller entities • Predecessor work: 1998-2002, DSS development from: June 2003• Public Developer Release: digitalspaces.net Nov 2007• Applications developed: 24 projects and additional under contract• Awards: Techbriefs, Spinoff, SBIR lead commendation• Ongoing Users: NASA, European Space Agency, Univ Toronto, sysRAND, Humanspace, JHU/APL

Page 4: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

II. Beginnings- In 1999-99, designing immersion through story in the Virtual Walk on the Moon with Apollo astronaut

Rusty Schweickart

Rusty Schweickart in Cyber Space - 1999

Rusty Schweickart in Outer Space - 1969

Page 5: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

On July 20, 1999 Rusty Schweickart entered an avatar space as our narrator to commemorate the 30th anniversary of the Apollo XI moon landing

Page 6: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)
Page 7: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)
Page 8: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)
Page 9: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

This work was presented to NASA leading to the funding of DigitalSpace and Digital Spaces (DSS)

and the following Portfolio of Projects

Page 10: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

III. Early work (2000-2003) - Modeling human/machine activities in Mars Analogs, BrahmsVE

utilizing Adobe Atmosphere, Clancey, Sierhuis, NASA ARC

Page 11: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

BrahmsVE/SimHabModeling process

Video and other activity capture

Geographic model: waypoints

Brahms agent model

Object, gesture and agent 3D models

Page 12: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

- Planning meeting, water tank filling, EVA prep

BrahmsVE/SimHab

Page 13: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

BrahmsVE/SimHab

Page 14: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

PSA Robot aboard a Virtual Space Station

Page 15: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

PSA Robot aboard a Virtual Space Station

Page 16: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Shuttle Operations and ISS Construction

- Training environment for STS-114 (NBL) 2004

Page 17: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Educational Spacewalk Simulation- STS-125 Hubble Servicing Mission (May

2009)

Page 18: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

IV. Surface Mobility- Mars surface modeling from orbital height data

and DriveOnMars MER simulation (2003-04)

Page 19: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

DriveOnMarsDigitalSpace training environment for NBL

“Drive On Mars” lighting for night-day transition, basic modeling of vehicle systems, RAT instrument deployment

Page 20: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Lunar Surface Robotics- NASA ARC, Colorado School of Mines

(2004-2006)

Colorado School of MinesPrototype Lunar Bucket Wheel Excavator

Page 21: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

DigitalSpace Lunar analog simulation of BWE

Lunar Bucket Wheel Excavator

Page 22: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Lunar Bucket Wheel Excavator

Page 23: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Raytheon CE&R studies- Telerobotically build a Lunar base (2004-2005)

Page 24: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Raytheon CE&R studies- Telerobotically build a Lunar base (2004-2005)

Page 25: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Telerobotic Lunar Outpost Construction – mission concept (animation)

Page 26: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Telerobotic Lunar Outpost Construction

Page 27: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Microsat Lander & LSAM Landing Dynamics

- NASA Ames Research Center, JSC (2006)

Page 28: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Microsat Lander & LSAM Landing Dynamics

Page 29: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Microsat Lander & LSAM Landing Dynamics

Page 30: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

• Crater Rim (Sunlight Area) Exploration– Imaging of site from surface—time data

collection to correlate with LRO orbital images of same conditions (pan every 2 hours over 1 year)

– Geotechnical properties of lunar regolith (bearing strength, soil composition, cohesiveness, block and slope populations)

– Biological effects of radiation, reduced gravity over 1 year

• Crater Floor (Dark Area) Exploration– Physical environment and geotechnical

properties (temperatures, soil characteristics, etc.)

– Examine both surface and subsurface of cold trap region

– Volatile deposits: elemental and molecular composition, species abundance, physical state, distribution and extent; number of samples from varied locations in crater floor; locations and settings documented

Find the LightFind the Light

Touch the IceTouch the Ice

RLEP2 Lunar Rover Polar Ice Mission- NASA MSFC, ARC, JPL/TeamX

Page 31: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Model: Dawes Crater

As imaged by Apollo XV

Design challenge: traverse steep

crater wall on the Lunar south pole

RLEP2 Lunar Rover Polar Ice Mission- NASA MSFC, ARC, JPL/TeamX

Page 32: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

RLEP2 Lunar Rover Polar Ice Mission- NASA MSFC, ARC, JPL/TeamX

Page 33: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

RLEP2 Lunar Rover Polar Ice Mission- Virtual Lunar Hazard Yard

Page 34: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

RLEP2 Lunar Rover Polar Ice Mission- Preliminary Design

Page 35: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

RLEP2 Lunar Rover Polar Ice Mission- Final vehicle in hazard yard

Page 36: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

2007 Project: Lunar Regolith Dig-Balovnev model, Matlab output

Page 37: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

2007 Project: Lunar Regolith DigSurface mesh deformation – Nader, University of Toronto

Page 38: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Constellation to NEO trade study- modeling, visualization

Page 39: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Constellation to NEO trade study- modeling, visualization

Page 40: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Constellation to NEO trade study- modeling, visualization

Page 41: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Constellation to NEO trade study- modeling, visualization

Page 42: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Constellation to NEO trade study- modeling, visualization

Page 43: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Constellation to NEO trade study- publicity

Page 44: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Constellation to NEO trade study- modeling, visualization

Page 45: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Educational Spacewalk Simulation- STS-125 Hubble Servicing Mission (May

2009)

V. Demo

Page 46: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Digital SpacesOpen Source Real-time 3D Modeling and Simulation

VI. Architectural Overviewwith Peter Newman

Page 47: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Digital Spaces Philosophy

• Leverage the experience of existing open source components

• Provide Digital Spaces for free to encourage adoption o Encourage engine development by individuals and

commercial interestso Encourage content development by individuals and

commercial interestso Provide services doing engine and content development for

commercial interests• Modular design for flexibility

o Provide back and future compatibility with clearly defined module interfaces

o Allow easy expansion and development, including component replacement, without breaking compatibility

Page 48: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Libraries used

• OGREo Cross platformo Multiple render systems for maximum compatibilityo Fast and efficient implementationo Free to develop and distribute

• ODEo Free to develop and distributeo Platform independent

• Pythono Cross platform o Wide range of additional librarieso Fast implementation

Page 49: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

3D Authoring Packages Used

• 3D Studio Max• Other packages with Ogre exporters

Page 50: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Modular design

• Implementation is abstracted, allowing future replacement without breakageo For example, Physics_Gangsta was replaced with

Physics_ODE• Modules wrap libraries, leveraging existing development and

allowing addition of compatibility/adapter code

Page 51: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Loosely heirachal design

• Allows programatic control over all aspects of the system• Provides useful midlevel interfaces for reducing complexity

Page 52: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Module descriptionScript_Python Embeds a Python interpreter in Digital Spaces to provide a Rapid Application Development layer for Space specific logic. AgentManager Implements the control logic for a range of predefined Agent types (semi autonomous conceptual entities).  SGManager Provides a higher level coordination between other Components that involve a 3D scene graph. Responsible for parsing Scene files, and for connecting physics to graphics. Physics_ODE Provides rigid body physics simulation. 3DVisuals_OGRE Provides 3D rendering, including model, texture and particle system loading (and others).

Page 53: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Module descriptionUserInput_DirectInput Provides user input to the system. This includes keyboard, mouse and joystick, or any other DirectX supported device.VehicleAgent_Control Connects user input to control of a specific type of Agent.GUI_CEGUI Provides a 2D overlay UI over 3DVisuals_OGRE. CorePerforms component loading, initial inter-component communication, and work scheduling.

Not shown: All file resources are loaded through DataResource module. Allows abstraction of resource locations and types. Integrated with Core to allow initial resource loading.

Page 54: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Visual Content Work Flow

How visual content is processed in Digital Spaces

Page 55: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Space file is parsed by CoreConfiguration data is passed to appropriate components.

Page 56: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Scene file is parsed by SGManagerBased on the configuration data, the SGManager uses the DataResource Manager to load the Scene file, and parses it.

Page 57: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Heirachal objects are createdAs the scene file is processed, heirachal objects are created in the SGManager, their representations are created in any component implementing DISGRepresentative, and configured with any type specific information.

Page 58: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Leaf objects are createdWhen the end of a heirachal branch is reached, "leaf" objects are created in the SGManager, their representations are created in anything inmplementing DISGRepresentative, and configured with any type specific information.

Page 59: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Visual object creation   Visual objects (such as meshes) are created as part of creating the SGManager leaf objects. The DataResource Manager is used to load any required model resources, and are parsed and instanced in OGRE.

Page 60: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Positional information is appliedInformation that is common to the SGManager objects, specifically positional, orientation and scale information, is applied to the SGObjects, and thus their representations.

Page 61: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

Summary:DigitalSpace DSS modular plug-in architecture(roadmap)

Page 62: Bruce Damer's presentation of Digital Spaces, an open source 3D simulation platform for space applications (NASA Ames, May 5, 2009)

This work was funded by NASA Ames Research Center and other NASA Centers through various federal and subcontractor contracts. Special thanks to Pete Worden for supporting the public outreach direction of this work.For further information and use please contact:Bruce Damer, CEODigitalSpace Corporation343 Soquel Ave, Suite 70Santa Cruz CA 95062Ph: 831 338 9400Email: [email protected]

Acknowledgements