![Page 1: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/1.jpg)
FILE WORKFLOW MIT AREMA
IBM Spectrum Scale Experten Workshop
Ulrich Voigt, [email protected], Senior Architect Media & Entertainment, IBM Global Business Services
![Page 2: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/2.jpg)
File Workflow….
File Workflow
File
Lif
ecyc
le
![Page 3: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/3.jpg)
…mit AREMA
![Page 4: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/4.jpg)
IBM Archive and Essence Manager
(AREMA)
• AREMA is a highly approved media industry solution, used in many TV networks. Especially in Germany, there is a very high market coverage.
• AREMA has a strong storage background, manages long-term video-archives at WDR, ARTE, RTL, ProSiebenSat1, SRF and ORF.
• Workflow Orchestration of media data-centered processes.
• More than 140 media functions / services used to transport, transform, analyze and manipulate media data.
• Orchestrates external systems e.g. transcoder or IBM picture recognition software IMARS.
• AREMA as a middleware and integrational software – links different media systems, works as a bridge between (legacy) media systems.
• AREMA is a flexible solution, being able to provide its core competencies (workflow orchestration, media services, interfaces, simple expandability) to other industries that are processing media data.
• IBM AREMA media portal: media portal as an extension of AREMA for intuitive search, sighting and consolidation of media; downstream workflows (such as exports) are possible.
![Page 5: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/5.jpg)
Customers who decided for AREMA
![Page 6: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/6.jpg)
AREMA beim WDR
![Page 7: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/7.jpg)
Im Automobilbereich: AREMA zum Management der Testvideos
für die Tests zum Autonomen Fahren
AREMA AgentsAREMA EngineAREMA Interfaces
<SOAP REST OSLC
IBM Elastic Storage Server
IBM GPFS Software
LTFS Tape Library
Rational DOORS
Rational Quality Manager
Elektrobit ADTF
AREMA Clients
Other ADTF tools
Other testing tools
Spectrum Scale client OS
IBM IMARS
Flash Disk
HiL Station Tivoli Storage Manager (TSM)
IBM Spectrum Protect™
ASPERA
Site A
Site B
Site C
Job Management, Media PortalAutomatically Label Videos
ArchiveStorage & DistributionTest Execution
Development & Testing Environment
Manage & Control Video & Testing Workflow
![Page 8: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/8.jpg)
1. import 2. analysis 3. viewing 4. export• Format analysis• Screening for viruses• Transcoding &
Unwrap• Keyframe-extraction• Hash / fingerprint• Storage
• Picture analysis: Object & facial & person recognition
• Audio transcript • Geo tagging
• indexation• Search• Sighting• Annotation• Classification
• Transfer & forwarding
• DVD creation
classification
Learn & analyze
Mediainfo & EXIFToolclamAVFFMPEG
IBM AREMA ToolsBroadcast Transcoder
IBM AREMA FaceDetectIBM Watson Analytics
Fraunhofer AudioMiningAlchemy APIs
IBM AREMA Mediaportal
Aspera, Tixel, SigniantFTP/SFTP/SCP
RimageTSM/LTFS
Workflow orchestration (IBM AREMA)
AREMA im Sicherheitsbereich als
“Forensisches Multimediaportal”
![Page 9: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/9.jpg)
• AREMA has, besides a scene-based key frame extraction, an own face recognition based on OpenCV
• Faces are tagged in pictures. Those single pictures will then be extracted from the videos. Those serve
for a faster navigation in the video, in line with the scene based key frames.
• Soon, a person recognition will be added. Then, to each face a FID (Face Identifier) will be assigned.
Since those will be indexed in the portal, a search based on a face within the whole picture, respectively
video archive is possible.
• The person recognition is trainable by addition of external pictures, for example a picture data base.
AREMA im Sicherheitsbereich als
“Forensisches Multimediaportal”
Gesichtserkennung mit OpenCV
![Page 10: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/10.jpg)
• Recently, the Fraunhofer
Audiomining Tool was
integrated in AREMA.
• AREMA extracts the audio
track from different video
formats and transcribes each
sentence via Audiomining
(Speech-To-Text).
• The spoken word will be
indexed in the portal and
enables the user to search
directly for a specific word with
the exact link to the video
scene.
{"segments": […{"segmentNumber": 1,"startTime": 4480,"duration": 3190,"endTime": 7670,"speaker": 1,"gender": "female","transcript": "Hier ist das erste deutsche Fernsehen mit der Tagesschau."},
...{
"segmentNumber": 20,"startTime": 238980,"duration": 23620,"endTime": 262600,"speaker": 2,"gender": "male","transcript": "Großbritannien raus aus der Europäischen Union für viele
unvorstellbar das weiß auch der britische Premierminister Cameron und er nutzt es um die EU Partner unter Druck zu setzen entweder das Staatenbündnis ist zu Reformen bereit oder bei der geplanten Volksabstimmung über die EU Mitgliedschaft droht ein Nein heute hatte EU Ratspräsident Tosca ein Kompromisspapier vorgelegt dass die Briten besänftigen soll."
},
AREMA im Sicherheitsbereich als
“Forensisches Multimediaportal”
Integration mit Fraunhofer Audio Mining
![Page 11: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/11.jpg)
AREMA im Sicherheitsbereich als
“Forensisches Multimediaportal”
Media Portal am Beispiel DFL
![Page 12: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/12.jpg)
File inspection (malware analysis etc)
![Page 13: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/13.jpg)
Speichermanagement mit Metadaten aus der Ölindustrie
![Page 14: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/14.jpg)
AREMA Functional Overview
Agents (adapters)
API
Job Engine
Clients
Agents (full implementation)
Storage Management
Disk TSM LTFSFPD
DivaCloud
RulesQueue MgmtResource
MgmtStatistics
Job Templates
Interfaces
RESTSOAP
Watch-
folderFIMS Avid
Quan-
telVACP
…… ……130+ agent implementations
Notifications
… Jobs Agents UploadDash-
boardPlayer
Essen
ces
![Page 15: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/15.jpg)
Job Monitor – Flow Diagram
15
![Page 16: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/16.jpg)
AREMA Media Portal branded layout
![Page 17: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/17.jpg)
AREMA Media Portal standard layout
![Page 18: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/18.jpg)
AREMA Job Monitor – Step Details
![Page 19: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/19.jpg)
AREMA Job Monitor – Essenz Details
19
![Page 20: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/20.jpg)
AREMA File Upload
![Page 21: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/21.jpg)
AREMA Human Task Workflows
Extension of AREMA‘s workflow capabilities now include human task workflows
Human interaction is possible via Task Lists
Users can search or select to view all submitted/closed tasks
Users can select a task to open and fill out
Configurable Task View forms support workflow update entries for end users (i.e. for approval
workflows)
Task Views are accessible
via the AREMA Portal
![Page 22: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/22.jpg)
Dashboard – Job Typen
22
![Page 23: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/23.jpg)
AREMA Event App – Workflows create push messages
![Page 24: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/24.jpg)
AREMA Workflow Builder
![Page 25: IBM Spectrum Scale Experten Workshop FILE WORKFLOW MIT AREMAfiles.gpfsug.org/.../13-AREMA-FileWorkFlow-SpectrumScale-UVoigt-032016.pdf · • AREMA is a flexible solution, being able](https://reader030.vdocument.in/reader030/viewer/2022040812/5e57643239549a019741b032/html5/thumbnails/25.jpg)
AREMA in der Cloud
AREMA Gateway AREMA
IBM DB2 on Cloud
DeliveryPipeline
AREMAPortal
AREMAWorkflow
Builder
Mobile Push
Watson Cognitive Services
Ustream
Object Store Box Storage
Social Networks
ClearleapVideo Distribution
Browser Track & Plan
Active Archive
Firewall
MEDIA
PRODUCTION
TranscodingOn Softlayer
Images or Bare Metal
Firewall Aspera accelerated
transfer
Firewall