the tardis framework a federated repository solution for raw diffraction datasets steve androulakis,...
TRANSCRIPT
![Page 1: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/1.jpg)
The TARDIS Framework
A Federated Repository Solution For Raw Diffraction Datasets
Steve Androulakis, Monash University, Melbourne Australia
I2S2 Workshop April 2011
![Page 2: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/2.jpg)
![Page 3: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/3.jpg)
TARDIS’ Internal Structure
Thanks to Alistair Grant
![Page 4: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/4.jpg)
Generic Parameter Support
Thanks to Alistair Grant
![Page 5: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/5.jpg)
Started in late 2007
Formerly.. Public Only Access to Raw Protein Crystallography Data
Formerly.. Fedora Commons Based
Federated Storage
Formerly.. Protein Crystallography Specific Code
![Page 6: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/6.jpg)
![Page 7: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/7.jpg)
Australian Synchrotron VBL Services..
Thanks Michael D’Silva @ VeRSI
![Page 8: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/8.jpg)
Australian Synchrotron VBL Services..
Thanks Michael D’Silva @ VeRSI
![Page 9: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/9.jpg)
Australian Synchrotron VBL Services..
Thanks Michael D’Silva @ VeRSI
![Page 10: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/10.jpg)
Data Store
myTARDIS
Data Store
myTARDIS
Data Store
myTARDIS
Data Store
myTARDIS
TARDIS.edu.au
download
download download
download
![Page 11: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/11.jpg)
From Capture to Publication
![Page 12: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/12.jpg)
![Page 13: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/13.jpg)
![Page 14: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/14.jpg)
![Page 15: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/15.jpg)
![Page 16: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/16.jpg)
![Page 17: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/17.jpg)
6 Datasets, 5140 Datafiles ~90GB
![Page 18: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/18.jpg)
Challenges..
How shall we manage the federation at the top level? (cache index vs ‘spider search’)
How much responsibility to we take over the underlying data stores and their integrity?
Exactly how ‘generic’ should the underlying structure be?
How do we encourage users to utilise the system with regularity?
![Page 19: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/19.jpg)
Molecular Biology Auto-Processing
Thanks Grischa Meyer
![Page 20: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/20.jpg)
SquirrelMyTARDIS For The Archival, Preservation and Eventual Publication of ALL Research Data
![Page 21: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/21.jpg)
![Page 22: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/22.jpg)
![Page 23: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/23.jpg)
![Page 24: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/24.jpg)
We’re now the ‘official solution’ for instruments at AS + ANSTO!
..so more instruments + facilities
“TARDIS/MyTARDIS system for high-end instrumentation data capture (e.g. X-ray diffraction images) has been chosen by both the Australian Synchrotron and ANSTO (Australian Nuclear Science and Technology Organisation) as the platform for metadata capture. Congratulations to the developers of TARDIS/MyTARDIS: Monash University biochemist, Associate Professor Ashley Buckle and software engineer Mr Steve Androulakis. (Support received from the Monash e-Research Centre, the Victorian eResearch Strategic Initiative, the Australian Synchrotron and the Australian National Data Service).”
![Page 25: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/25.jpg)
RMIT – Microscopy• 9 Microscopes• New ‘Filter’ Module Functionality• RMIT eResearch Office – Heinz Schmidt / Ian Thomas
The Ian Wark Research Institute – Particle Physics• Instrument Linkage• University of SA - Ryan Green
Peter Mac Institute – Next Gen Sequencing• Instrument Linkage• Courtesy of VeRSI – Lyle Winton
APS Chicago?!
Upcoming Projects
![Page 26: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/26.jpg)
MicroTARDISInitiative of the eResearch Office at RMIT University, for the RMIT Microscopy and Microanalysis Facility (RMMF) in the School of Applied Science.
eResearch Office:Prof Heinz Schmidt, Dr Ian Thomas, Mr Ravi Sreenivasamurthy, Mr Peter Wolynec.
RMMF: Prof. Dougal McCulloch, Mr Phil Francis.
Deployment and Customization of the myTARDIS meta-data repository for research scientists using microscopes in applied sciences
Thanks Ian Thomas (RMIT)
![Page 27: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/27.jpg)
Key Features- Backend connection to data from Phillips XL30 SEM, FEI Nova NanoSEM and FEI Quanta
microscopes.- Staging area to allow user-driven upload of experiment data- Automatic metadata extraction from instrument image files and ingestion
Thanks Ian Thomas (RMIT)
![Page 28: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/28.jpg)
R-2-6.tif
R-2-2.tif
![Page 29: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/29.jpg)
Thanks Ian Thomas (RMIT)
![Page 30: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/30.jpg)
Thanks Ian Thomas (RMIT)
![Page 31: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/31.jpg)
TARDIS: Internals
Lightweight Architecture
![Page 32: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/32.jpg)
TARDIS’ Modular Framework
MyTARDISMyTARDIS
SynchrotronSynchrotron
TARDIS.edu.auTARDIS.edu.au
MicroscopyMicroscopy
VBL DownloadVBL Authentication
Visual StyleParameter Schemas
Parameter ‘Filters’Visual Style
Parameter Schemas
Federated Storage SupportVisual Style and Templates
Parameter Schemas
http://code.google.com/p/mytardis/ (BSD)
MRtardisMRtardis
App for running distributed HPC jobs and storing the
results in TARDIS
![Page 33: The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop](https://reader035.vdocument.in/reader035/viewer/2022062423/56649e7b5503460f94b7d3d2/html5/thumbnails/33.jpg)