emma data storage ben shepherd magnetics and radiation sources group, astec emma commissioning...
TRANSCRIPT
EMMA Data Storage
Ben ShepherdMagnetics and Radiation Sources Group, ASTeC
EMMA Commissioning Workshop1-4 December 2009
View slides (with links): http://tinyurl.com/emma-bjas
Ben Shepherd – EMMA Data Storage 2/12http://tinyurl.com/emma-bjas
• What do we have on ALICE?– eLog– wiki– file storage
• What do we need on EMMA?– The same?– Or something different?
Overview
Ben Shepherd – EMMA Data Storage 3/12http://tinyurl.com/emma-bjas
• Web-based log: http://www.4gls.ac.uk/erlp/elog/alicelog/
• Uses ELOG server developed at PSI https://midas.psi.ch/elog/
• Visible to the world; need an account to edit• Anyone can request an account (must be
approved by an admin – me!)
ALICE eLog
Ben Shepherd – EMMA Data Storage 4/12http://tinyurl.com/emma-bjas
ALICE eLog
• http://www.4gls.ac.uk/erlp/elog/• Several logbooks defined on one server:
– shift log– fault notification– private files (passwords, phone numbers)– operations log (permits to work etc.)– logs for other groups (vertical test facility, health
physics, CBS, cryogenics)
Auto save (no need to refresh page) or manual save
Metadata to aid searching and find log entries at a glance
Javascript-based WYSIWYG rich text editor (FCKeditor)
Insertion of table of machine parameters (connects to EPICS via HTTP server)
Can add attachments (images etc.)
eLog features
Ben Shepherd – EMMA Data Storage 6/12http://tinyurl.com/emma-bjas
ALICE Wiki
• Information on how to operate ALICE is stored in the wiki: http://projects.astec.ac.uk/ERLPManual/
• MediaWiki server (like Wikipedia)• Visible to the world; need an account to edit• Simple account request/approval process• Non-WYSIWYG editor – uses wiki syntax
– (very shallow learning curve)
Ben Shepherd – EMMA Data Storage 7/12http://tinyurl.com/emma-bjas
Wiki FeaturesSimple syntax, e.g. ==Headlines== and [[Links]]
Automatic table of contents on each page
Inline images with captions
Equations in TeX markup
Tables
Pages organised in categories
Displayed page Wiki code
Ben Shepherd – EMMA Data Storage 8/12http://tinyurl.com/emma-bjas
ALICE File Server(s)• ALICE data files stored on a
local server (\\apsv4)• Read/write access for
anyone with an STFC login• Data for each shift stored inWork\YYYY\MM\DD\Shift N
Ben Shepherd – EMMA Data Storage 9/12http://tinyurl.com/emma-bjas
EMMA Data Storage
• For ALICE:– eLog for day-to-day logging– Wiki for reference information– Local file server to store images, documents, etc.
• For EMMA:– Requirements are pretty similar– Easy to set up eLog and wiki on existing servers– External access is also important – not everyone
working on the project has an STFC login id
Ben Shepherd – EMMA Data Storage 10/12http://tinyurl.com/emma-bjas
Access for external collaborators
• ELog and wiki are web-based systems with usernames and passwords; registration is approved by admin(s) at DL
• File storage is a bit different• It should be as transparent as possible for DL people• Allow read/write access for external people as well• The current solution (conform.ac.uk & engserve) is not
really ideal – two diverging document stores• Proposal: server with SFTP
Ben Shepherd – EMMA Data Storage 11/12http://tinyurl.com/emma-bjas
SFTP File Server• Proposal (implemented now!) from Chris Dean (DL IT)• Secure File Transfer Protocol• Secure login; read/write access from anywhere• Need FTP client – widely available, cross-platform (e.g.
FileZilla for Windows/Mac/Linux)• srgen2.dl.ac.uk (ex-SRS) has this facility and is currently
under-used• DL users would see as a normal network share (i.e. \\
dlfiles03\ASTeC\Projects\EMMA\...)• Consolidate files from
https://www.conform.ac.uk/documents/emma and \\engserve\CONFORM\EMMA (relevant stuff - obviously not sensitive information)