tony barbagallo caringo - snia · client applications — send scsp+ commands and receive...
TRANSCRIPT
![Page 1: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)](https://reader031.vdocument.in/reader031/viewer/2022013023/600dcc8f8b77107f3f2070ae/html5/thumbnails/1.jpg)
2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.
Scale-out Searchable Storage for the Cloud Age
Tony Barbagallo Caringo
![Page 2: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)](https://reader031.vdocument.in/reader031/viewer/2022013023/600dcc8f8b77107f3f2070ae/html5/thumbnails/2.jpg)
2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.
Endless Capacity Accessible Anywhere Always Available
Expectations of File Storage Have Changed
What I Want – When I Want It!
![Page 3: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)](https://reader031.vdocument.in/reader031/viewer/2022013023/600dcc8f8b77107f3f2070ae/html5/thumbnails/3.jpg)
2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.
Organization & Analytics at Scale
Scale-out Searchable Storage
Secure Multi-Tenant Cloud Storage services
Data Management Platform
Offload Legacy Storage
Multi-tenancy Public or Private
Metering and Quotas Access Controls
Multi-protocol Access
Metadata stored with Files Integrated Search
Content Portal Collections
Big Data Enabled No File System Limits
Transparent File Access No Application Changes
Streamline Backups Data is Continuously
Protected
![Page 4: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)](https://reader031.vdocument.in/reader031/viewer/2022013023/600dcc8f8b77107f3f2070ae/html5/thumbnails/4.jpg)
2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.
Architecture Overview
![Page 5: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)](https://reader031.vdocument.in/reader031/viewer/2022013023/600dcc8f8b77107f3f2070ae/html5/thumbnails/5.jpg)
2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.
Flexible Deployment
Storage nodes perform all functions
Fast proactive recovery
Darkive™ adaptive power conservation
Continuous Protection
Patented EC & replicated files on the same node
Feeds and subclusters for replication and DR
Complete Software Appliance
No file system, RAID, LUNs or DBMS required
Runs from RAM; 95% capacity for files
Scale-out Storage Platform Technical Overview
![Page 6: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)](https://reader031.vdocument.in/reader031/viewer/2022013023/600dcc8f8b77107f3f2070ae/html5/thumbnails/6.jpg)
2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.
Swarm Search Infrastructure
• Client Applications — send SCSP+ commands and
receive information to/from the Swarm cluster.
• Swarm Cluster — Connects to the
Elasticsearch(ES) servers through a Search Feed.
• Search Feed — Transmits the metadata from the
storage cluster to the ES servers and the search queries and replies.
• Elasticsearch servers — Index the metadata and service
search requests.
Client Apps
Elasticsearch Cluster
Swarm Storage Cluster
![Page 7: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)](https://reader031.vdocument.in/reader031/viewer/2022013023/600dcc8f8b77107f3f2070ae/html5/thumbnails/7.jpg)
2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.
Swarm Search
• Actionable insight — Targeted analysis
• Dynamic organization of content — Classification, key words, descriptive content — Multiple ways to track content
• No separate “Big Data” project required — Self-contained within the storage system
Find the Needle in a Very Large Haystack
List domain objects within a cluster: GET http://CLUSTER/?domains&format=json
List buckets within a domain: GET http://CLUSTER/?format=json
List objects within a bucket: GET http://CLUSTER/mybucket?format=xml
Search for objects with metadata matching: GET http://CLUSTER/?format=json&content type=image/jpeg
![Page 8: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)](https://reader031.vdocument.in/reader031/viewer/2022013023/600dcc8f8b77107f3f2070ae/html5/thumbnails/8.jpg)
2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.
Collections – Organization and Search at Scale
![Page 9: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)](https://reader031.vdocument.in/reader031/viewer/2022013023/600dcc8f8b77107f3f2070ae/html5/thumbnails/9.jpg)
2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.
Multi-tenant Management
• Secure — Connects to LDAP, Active
Directory, Linux PAM — Token-based authentication
• Robust system administration — RESTful API & via web portal — Flexible naming scheme, no
bucket limits — Use your domain
• Interoperable — HTTP, S3, HDFS,
NFS, SMB
![Page 10: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)](https://reader031.vdocument.in/reader031/viewer/2022013023/600dcc8f8b77107f3f2070ae/html5/thumbnails/10.jpg)
2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.
Limitless Storage at a Fraction of the Cost
Universal Access
Analysis at Scale
Ad Hoc Search & Query
Complete Software Appliance
Flexible Deployment
Enterprise Support
Continuous Protection
Data Service Enablement
Infrastructure Management
![Page 11: Tony Barbagallo Caringo - SNIA · Client Applications — send SCSP+ commands and receive information to/from the Swarm cluster. • Swarm Cluster — Connects to the Elasticsearch(ES)](https://reader031.vdocument.in/reader031/viewer/2022013023/600dcc8f8b77107f3f2070ae/html5/thumbnails/11.jpg)
2016 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.
Thank You facebook.com/caringostorage
www.caringo.com
@caringostorage
linkedin.com