sci-bus is supported by the fp7 capacities programme under contract nr ri-283481
DESCRIPTION
Workflow-Oriented Science Gateway for Astrophysical Visualization. Eva Sciacca M. Bandieramonte , U. Becciani , A. Costa , M. Krokos , P. Massimino , C. Petta , C. Pistagna , S. Riggi and F. Vitello [email protected]. - PowerPoint PPT PresentationTRANSCRIPT
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI-283481
Workflow-Oriented Science Gateway for Astrophysical
VisualizationEva Sciacca
M. Bandieramonte, U. Becciani , A. Costa , M. Krokos, P. Massimino ,
C. Petta, C. Pistagna , S. Riggi and F. [email protected]
MotivationsSeveral TBs are often generated by modern cosmological simulations and
large-scale astrophysical observations are stored in archives. Such large data volumes pose significant challenges in terms of data analysis, storage and access; a critical step forward in understanding, interpreting and verifying their intrinsic characteristics can be achieved trough visualization.DCIs access
Multiple users need to share visualization experiences, by interacting simultaneously with astrophysical datasets giving feedback on what other participants are doing/seeing. Collaborative environment
The reproduction of specific visualization results is a challenging task as selecting suitable visualization parameters may not be a straightforward process.Workflow-driven application
SCI-BUS ProjectSCI-BUS aims to create a generic-purpose gateway technology as a toolset to provide seamless access to major computing, data and networking infrastructures and services in Europe.
www.sci-bus.eu
Outline Background
• Science Gateway• Workflow System• WSPGrade/gUse
VisIVO Science Gateway• Visualization and Analysis Tools• Portlets and workflows
VisIVO Mobile Case Study Results
Science GatewayIt is a community-developed set of tools,
applications, and data collections that are integrated via a portal or a suite of applications.
Gateways provide access to a variety of capabilities including workflows, visualization, resource discovery and job execution services.
What is a Workflow?A workflow consists of a sequence of connected stepsScientific workflows allows scientists to model, design,
execute, debug, re-configure and re-run their analysis and visualization pipelines.
Part of the established scientific method is to create a record of the origins of a result: how it was obtained, datasets and experimental methods used, machine calibrations and parameters, etc.
Such information is useful for a scientist to interpret their workflow results and for other scientists to establish trust in the experimental result and re-use all the computational pipeline.
WorkflowsThe skeleton of a workflow is represented by a Graph.
Jobs denote the activities, which envelop insulated computations Channels are directed edges of a graph, directed from the output ports towards the input ports.
WSPgrade/gUse (grid and cloud User Support Environment) is a
DCI virtualization environment providing a scalable set of high-level services by which interoperation between DCIs and user communities can be achieved.
The WS-PGRADE Portal is a web portal of the gUSE. It supports development and submission of distributed applications executed on the computational resources of various distributed computing infrastructures including clusters, grids and clouds.
A web application framework constructed of functional units called portlets.
http://www.guse.huhttp://www.sourceforge.net/projects/guse
VisIVO Science GatewayThe VisIVO Science Gateway is designed as a
workflow enabled grid portal that is wrapped around WS-PGRADE providing visualization and data management services to the scientific community.
The gateway offers role-based authorization modules and supports login with user name and password.
Advanced User, can develop and configure workflow. All gUse functionalities are available.
Standard User uses Workflow developed by a “workflow developer” through an ASM.
Architecture
Visualization and Analysis Tools
11
Local or Remote (URL) User Data
VBT: VisIVO Binary Table
VisIVO Importer
VisIVO Filters
VisIVO Viewer
New VBT
https://sourceforge.net/projects/visivoserver
Navigation -- Zoom -- Palette -- Algorithms --
Data selection -- Picker op.
Visualization
Portlets…
… and workflows
VisIVO Mobile
A case study: Muon Portal
17
The Project: Exploring the container content searching for nuclear material (uranium, plutonium)
Prototype muon track deviation
Compute: coordinates and deviation angle that the muon track has when high-Z material element is in the path.
Results
Workflow
Filtered Dataset(Threshold filtering)
Un-Filtered Dataset
Input Datas
et
POCA
Dataset Processing
Isosurface Images
Filtered Dataset
Un-Filtered Dataset
Panoramic Movies
Filtered Dataset
Un-Filtered Dataset
Filtered Dataset
Tomographic Images
Un-Filtered Dataset
ConclusionsA workflow-oriented gateway allows scientists to
share their analysis workflows and identify best practices for investigating their datasets. More importantly, they can automate workflows for repeated analysis with changed parameters. This way scientists can focus on their core scientific discoveries as opposed to spending time in data analysis on inadequate resources.
Through the shareable workflows and reusable portlets of the gateway, not just astrophysicists but also other scientific fields scientists can exploit the developed technologies.
Thank you for your attention!
Development Tools
A free, open-source Integrated Development Environment for software developers.
A web application framework for Rich Internet Applications. It features a robust server-side architecture. It offers a large collection of UI components such as Buttons, Tables, Trees and Layouts. The components use events, listeners and data binding to communicate with each other and with the business logic.
VisIVO DCI Infrastructure- Trigrid Cluster - AMD Dual Opteron 280 2.4
GHz, 14 Blades with 4 cores with 8 GB RAM / Blade (52 CPU core) - Total storage: 3.7 TB (lsf)
- 2 X Server Intel Xeon 3060 2.4 GHz, Dual-Core, 2 GB RAM - Total storage: 23 TB
- Server Intel Xeon 3050 2.13 GHz, Dual-Core, 2 GB RAM - Total storage: 8 TB
- Hybrid system cpu-GPU, N 2: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 24 GB RAM DDR3-1333 NVIDIA TESLA C2070, 448 cuda core + 6 GBRam
- COMETA grid – gLite nodes ~1500 CPU/core (250 hosted at INAF-OACT) AMD Dual Opteron 280 2.4 GHz (jdl)
VisIVO Gateway:Infrastructures