enterprise sales engineer - sumo logic james …...deploying apache kafka exabyte scale data...
TRANSCRIPT
![Page 1: Enterprise Sales Engineer - Sumo Logic James …...Deploying Apache Kafka Exabyte Scale Data Coordination James Mountifield Enterprise Sales Engineer - Sumo Logic Sumo Logic Confidential](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8d40f13c1d060e6b019bd9/html5/thumbnails/1.jpg)
Deploying Apache KafkaExabyte Scale Data Coordination
James MountifieldEnterprise Sales Engineer - Sumo Logic
![Page 2: Enterprise Sales Engineer - Sumo Logic James …...Deploying Apache Kafka Exabyte Scale Data Coordination James Mountifield Enterprise Sales Engineer - Sumo Logic Sumo Logic Confidential](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8d40f13c1d060e6b019bd9/html5/thumbnails/2.jpg)
Sumo Logic Confidential
Agenda- Who am I- Who are Sumo Logic- Collection Architecture- Lessons Learned- Some Cool Stats
![Page 3: Enterprise Sales Engineer - Sumo Logic James …...Deploying Apache Kafka Exabyte Scale Data Coordination James Mountifield Enterprise Sales Engineer - Sumo Logic Sumo Logic Confidential](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8d40f13c1d060e6b019bd9/html5/thumbnails/3.jpg)
Who am I?
![Page 4: Enterprise Sales Engineer - Sumo Logic James …...Deploying Apache Kafka Exabyte Scale Data Coordination James Mountifield Enterprise Sales Engineer - Sumo Logic Sumo Logic Confidential](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8d40f13c1d060e6b019bd9/html5/thumbnails/4.jpg)
Who are Sumo Logic?
![Page 5: Enterprise Sales Engineer - Sumo Logic James …...Deploying Apache Kafka Exabyte Scale Data Coordination James Mountifield Enterprise Sales Engineer - Sumo Logic Sumo Logic Confidential](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8d40f13c1d060e6b019bd9/html5/thumbnails/5.jpg)
Scale: Exponential Growth
100+ Petabytes Analyzed
30+ Million Queries Run
500+ Trillion Records Examined
Daily Stats:
(100 petabytes) / (300 bytes) =~ 3.33... × 1014
Log events in the “live” dataset
![Page 6: Enterprise Sales Engineer - Sumo Logic James …...Deploying Apache Kafka Exabyte Scale Data Coordination James Mountifield Enterprise Sales Engineer - Sumo Logic Sumo Logic Confidential](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8d40f13c1d060e6b019bd9/html5/thumbnails/6.jpg)
Architecture Context Prerequisites- Cloud Native / SaaS Architecture built on AWS
- The service is NOT a public interface, because ...
- Constantly subject to new services, modifications of existing services, new technology
- EC2 -> Lambda- ELB -> ALB
- The “service” including it’s APIs are independent of its architecture
![Page 7: Enterprise Sales Engineer - Sumo Logic James …...Deploying Apache Kafka Exabyte Scale Data Coordination James Mountifield Enterprise Sales Engineer - Sumo Logic Sumo Logic Confidential](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8d40f13c1d060e6b019bd9/html5/thumbnails/7.jpg)
Architecture Context Prerequisites, Cont ...- Sumo Logic is deployed across several regions, all Availability
Zones- North America (North Virginia, Oregon, GovCloud)- Europe (Frankfurt, Dublin)- APAC (Sydney)
- True multi tenant with relevant security built in from the beginning
![Page 8: Enterprise Sales Engineer - Sumo Logic James …...Deploying Apache Kafka Exabyte Scale Data Coordination James Mountifield Enterprise Sales Engineer - Sumo Logic Sumo Logic Confidential](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8d40f13c1d060e6b019bd9/html5/thumbnails/8.jpg)
Our Collection Architecture
![Page 9: Enterprise Sales Engineer - Sumo Logic James …...Deploying Apache Kafka Exabyte Scale Data Coordination James Mountifield Enterprise Sales Engineer - Sumo Logic Sumo Logic Confidential](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8d40f13c1d060e6b019bd9/html5/thumbnails/9.jpg)
Our Collection Architecture
![Page 10: Enterprise Sales Engineer - Sumo Logic James …...Deploying Apache Kafka Exabyte Scale Data Coordination James Mountifield Enterprise Sales Engineer - Sumo Logic Sumo Logic Confidential](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8d40f13c1d060e6b019bd9/html5/thumbnails/10.jpg)
Our Collection Architecture
![Page 11: Enterprise Sales Engineer - Sumo Logic James …...Deploying Apache Kafka Exabyte Scale Data Coordination James Mountifield Enterprise Sales Engineer - Sumo Logic Sumo Logic Confidential](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8d40f13c1d060e6b019bd9/html5/thumbnails/11.jpg)
Our Collection Architecture
![Page 12: Enterprise Sales Engineer - Sumo Logic James …...Deploying Apache Kafka Exabyte Scale Data Coordination James Mountifield Enterprise Sales Engineer - Sumo Logic Sumo Logic Confidential](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8d40f13c1d060e6b019bd9/html5/thumbnails/12.jpg)
Demo Time
![Page 13: Enterprise Sales Engineer - Sumo Logic James …...Deploying Apache Kafka Exabyte Scale Data Coordination James Mountifield Enterprise Sales Engineer - Sumo Logic Sumo Logic Confidential](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8d40f13c1d060e6b019bd9/html5/thumbnails/13.jpg)
Thank You