an open source memory-centric distributed storage...
TRANSCRIPT
![Page 1: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/1.jpg)
Haoyuan Li, Tachyon Nexus & UC Berkeley
November 19, 2015 @ AMPCamp 6
An Open Source Memory-Centric Distributed Storage System
![Page 2: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/2.jpg)
Outline
• Open Source
• Introduction to Tachyon (Before 2015)
• Deployments and New Features
• Getting Involved
2
![Page 3: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/3.jpg)
Background • Started at UC Berkeley AMPLab – From summer 2012
• Open sourced – April 2013 (two and half years ago) – Apache License 2.0 – Latest Release: Version 0.8.2 (November 2015)
• Deployed at > 100 companies
3
![Page 4: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/4.jpg)
4
Tachyon: one of the Fastest GrowingBig Data Open Source Project
![Page 5: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/5.jpg)
Contributors Growth
5
v0.4!Feb ‘14
v0.3!Oct ‘13
v0.2 Apr ‘13
v0.1 Dec ‘12
v0.6!Mar ‘15
v0.5!Jul ‘14
v0.7!Jul ‘15
1 3 15
30
46
70
111
![Page 6: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/6.jpg)
Contributors Growth
6
> 170 Contributors (V0.8) (3x increment over the last AMPCamp)
> 50 Organizations
![Page 7: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/7.jpg)
Thanks to Contributors and Users!
7
h"p://tachyon-project.org/community/
![Page 8: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/8.jpg)
One Tachyon ProductionDeployment Example
• Baidu (Dominant Search Engine in China, ~ 50 Billion USD Market Cap)
• Framework: SparkSQL • Under Storage: Baidu’s File System • Storage Media: MEM + HDD • 100+ nodes deployment • 1PB+ managed space • 30x Performance Improvement
8
![Page 9: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/9.jpg)
Outline
• Open Source
• Introduction to Tachyon (Before 2015)
• New Features
• Getting Involved
9
![Page 10: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/10.jpg)
Tachyon is an Open Source
Memory-centricDistributed
Storage System 10
![Page 11: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/11.jpg)
11
Why Tachyon?
![Page 12: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/12.jpg)
Performance Trend: Memory is Fast
• RAM throughput increasing exponentially
• Disk throughput increasing slowly
12
Memory-locality key to interactive response times
![Page 13: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/13.jpg)
Price Trend: Memory is Cheaper
source:jcmit.com13
![Page 14: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/14.jpg)
Realized by many…
14
![Page 15: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/15.jpg)
15
Is the Problem Solved?
![Page 16: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/16.jpg)
16
Missing a Solution for the Storage Layer
![Page 17: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/17.jpg)
A Use Case Example with -
• Fast, in-memory data processing framework – Keep one in-memory copy inside JVM – Track lineage of operations used to derive data – Upon failure, use lineage to recompute data
map
filter map
join reduce
Lineage Tracking
17
![Page 18: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/18.jpg)
Issue 1
18
Data Sharing is the bottleneck in analytics pipeline:Slow writes to disk
Spark Job1
Spark mem block manager
block 1
block 3
Spark Job2
Spark mem block manager
block 3
block 1
HDFS / Amazon S3 block 1
block 3
block 2
block 4
storage engine & execution engine same process (slow writes)
![Page 19: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/19.jpg)
Issue 1
19
Spark Job
Spark mem block manager
block 1
block 3
Hadoop MR Job
YARN
HDFS / Amazon S3 block 1
block 3
block 2
block 4
Data Sharing is the bottleneck in analytics pipeline:Slow writes to disk
storage engine & execution engine same process (slow writes)
![Page 20: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/20.jpg)
Issue 1 resolved with Tachyon
20
Memory-speed data sharingamong jobs in different
frameworks execution engine & storage engine same process (fast writes)
Spark Job
Spark mem
Hadoop MR Job
YARN
HDFS / Amazon S3 block 1
block 3
block 2
block 4
HDFSdisk
block1
block3
block2
block4Tachyon!in-memory
block 1
block 3 block 4
![Page 21: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/21.jpg)
Issue 2
21
Spark Task
Spark memory block manager
block 1
block 3
HDFS / Amazon S3 block 1
block 3
block 2
block 4
execution engine & storage engine same process
Cache loss when process crashes
![Page 22: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/22.jpg)
Issue 2
22
crash
Spark memory block manager
block 1
block 3
HDFS / Amazon S3 block 1
block 3
block 2
block 4
execution engine & storage engine same process
Cache loss when process crashes
![Page 23: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/23.jpg)
HDFS / Amazon S3
Issue 2
23
block 1
block 3
block 2
block 4
execution engine & storage engine same process
crash
Cache loss when process crashes
![Page 24: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/24.jpg)
HDFS / Amazon S3 block 1
block 3
block 2
block 4 Tachyon!in-memory
block 1
block 3 block 4
Issue 2 resolved with Tachyon
24
Spark Task
Spark memory block manager
execution engine & storage engine same process
Keep in-memory data safe,even when a job crashes.
![Page 25: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/25.jpg)
Issue 2 resolved with Tachyon
25
HDFSdisk
block1
block3
block2
block4
execution engine & storage engine same process
Tachyon!in-memory
block 1
block 3 block 4
crash
HDFS / Amazon S3 block 1
block 3
block 2
block 4
Keep in-memory data safe,even when a job crashes.
![Page 26: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/26.jpg)
HDFS / Amazon S3
Issue 3
26
In-memory Data Duplication & Java Garbage Collection
Spark Job1
Spark mem block manager
block 1
block 3
Spark Job2
Spark mem block manager
block 3
block 1
block 1
block 3
block 2
block 4
execution engine & storage engine same process (duplication & GC)
![Page 27: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/27.jpg)
Issue 3 resolved with Tachyon
27
No in-memory data duplication,much less GC
Spark Job1
Spark mem
Spark Job2
Spark mem
HDFS / Amazon S3 block 1
block 3
block 2
block 4
execution engine & storage engine same process (no duplication & GC)
HDFSdisk
block1
block3
block2
block4Tachyon!in-memory
block 1
block 3 block 4
![Page 28: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/28.jpg)
Previously Mentioned
• A memory-centric storage architecture
• Push lineage down to storage layer
28
![Page 29: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/29.jpg)
Tachyon Memory-Centric Architecture
29
![Page 30: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/30.jpg)
Tachyon Memory-Centric Architecture
30
![Page 31: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/31.jpg)
Lineage in Tachyon
31
![Page 32: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/32.jpg)
Outline
• Open Source
• Introduction to Tachyon (Before 2015)
• Deployments and New Features
• Getting Involved
32
![Page 33: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/33.jpg)
1) Eco-system: Enable new workload in any storage;
Work with the framework of your choice;
33
![Page 34: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/34.jpg)
2) Tachyon running in production environments,
both in the Cloud and on Premise.
34
![Page 35: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/35.jpg)
Use Case: Baidu
• Framework: SparkSQL • Under Storage: Baidu’s File System • Storage Media: MEM + HDD • 100+ nodes deployment • 1PB+ managed space • 30x Performance Improvement
35
![Page 36: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/36.jpg)
Use Case: an Oil Company
• Framework: Spark
• Under Storage: GlusterFS
• Storage Media: MEM only
• Analyzing data in traditional storage
36
![Page 37: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/37.jpg)
Use Case: a SAAS Company
• Framework: Impala
• Under Storage: S3
• Storage Media: MEM + SSD
• 15x Performance Improvement
37
![Page 38: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/38.jpg)
Use Case: a Biotechnology Company
• Framework: Spark & MapReduce
• Under Storage: GlusterFS
• Storage Media: MEM and SSD
38
![Page 39: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/39.jpg)
Use Case: a SAAS Company
• Framework: Spark
• Under Storage: S3
• Storage Media: SSD only
• Elastic Tachyon deployment
39
![Page 40: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/40.jpg)
Use Case: a Retail Company
• Framework: Spark & MapReduce
• Under Storage: HDFS
• Storage Media: MEM
40
![Page 41: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/41.jpg)
Run Everywhere
41
Enable Faster Innovation in Storage Layer
![Page 42: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/42.jpg)
42
What if data size exceeds memory capacity?
![Page 43: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/43.jpg)
43
3) Tiered Storage:Tachyon Manages More Than DRAM
MEM SSD
HDD
Faster
Higher Capacity
![Page 44: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/44.jpg)
44
Configurable Storage Tiers
MEM only
MEM + HHD
SSD only
![Page 45: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/45.jpg)
45
4) Pluggable Data Management Policy
Evict stale data to lower tier
Promote hot data to upper tier
![Page 46: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/46.jpg)
46
Pin Data in Memory
![Page 47: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/47.jpg)
5) Transparent Naming
47
![Page 48: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/48.jpg)
6) Unified Namespace
48
![Page 49: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/49.jpg)
More Features
• 7) Remote Write Support • 8) Easy deployment with Mesos and Yarn • 9) Initial Security Support • 10) One Command Cluster Deployment • 11) Metrics Reporting for Clients, Workers,
and Master
49
![Page 50: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/50.jpg)
12) More Under Storage Supports
50
![Page 51: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/51.jpg)
Reported Tachyon Usage
51
![Page 52: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/52.jpg)
• Team consists of Tachyon creators, top contributors
• Series A ($7.5 million) from Andreessen Horowitz
• Committed to Tachyon Open Source
• http://www.tachyonnexus.com
52
![Page 53: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/53.jpg)
Outline
• Open Source
• Introduction to Tachyon (Before 2015)
• Deployments and New Features
• Getting Involved
53
![Page 54: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/54.jpg)
Memory-Centric Distributed Storage
Welcome to try, contact, and collaborate!
54
JIRA New Contributor Tasks
![Page 55: An Open Source Memory-Centric Distributed Storage Systemdocs.huihoo.com/alluxio/Tachyon-An-Open-Source-Memory-Centric... · An Open Source Memory-Centric Distributed Storage System](https://reader030.vdocument.in/reader030/viewer/2022020314/5a880c2e7f8b9afc5d8e3558/html5/thumbnails/55.jpg)
• Try Tachyon: http://tachyon-project.org
• Develop Tachyon: https://github.com/amplab/tachyon
• Meet Friends: http://www.meetup.com/Tachyon
• Get News: http://goo.gl/mwB2sX
• Tachyon Nexus: http://www.tachyonnexus.com • Contact us: [email protected]
55