serialization (avro, message pack, kryo)
TRANSCRIPT
![Page 1: Serialization (Avro, Message Pack, Kryo)](https://reader031.vdocument.in/reader031/viewer/2022020213/58887b041a28ab34788b634d/html5/thumbnails/1.jpg)
SerializationAvro, Message Pack, Kryo
Han O Seok
![Page 2: Serialization (Avro, Message Pack, Kryo)](https://reader031.vdocument.in/reader031/viewer/2022020213/58887b041a28ab34788b634d/html5/thumbnails/2.jpg)
What is Serialization?
![Page 3: Serialization (Avro, Message Pack, Kryo)](https://reader031.vdocument.in/reader031/viewer/2022020213/58887b041a28ab34788b634d/html5/thumbnails/3.jpg)
What is Serialization?
![Page 4: Serialization (Avro, Message Pack, Kryo)](https://reader031.vdocument.in/reader031/viewer/2022020213/58887b041a28ab34788b634d/html5/thumbnails/4.jpg)
![Page 5: Serialization (Avro, Message Pack, Kryo)](https://reader031.vdocument.in/reader031/viewer/2022020213/58887b041a28ab34788b634d/html5/thumbnails/5.jpg)
Avro
• Apache Foundation
• JSON defineded Schema
![Page 6: Serialization (Avro, Message Pack, Kryo)](https://reader031.vdocument.in/reader031/viewer/2022020213/58887b041a28ab34788b634d/html5/thumbnails/6.jpg)
Avro
• Created by Doug Cutting, the Creator of Hadoop
• Data is always accompanied by a schema- Support for dynamic typing-code generation is not required
![Page 7: Serialization (Avro, Message Pack, Kryo)](https://reader031.vdocument.in/reader031/viewer/2022020213/58887b041a28ab34788b634d/html5/thumbnails/7.jpg)
Performance of Avro
• Avro is not the fastest, But is in the top half
![Page 8: Serialization (Avro, Message Pack, Kryo)](https://reader031.vdocument.in/reader031/viewer/2022020213/58887b041a28ab34788b634d/html5/thumbnails/8.jpg)
Message Pack
• Rich data structures - JSON
• Interface Definition Language(IDL) - thrift
• Create Schema Based Annotaion
• RPC Sync, Async Support Event-Driven I/O
![Page 9: Serialization (Avro, Message Pack, Kryo)](https://reader031.vdocument.in/reader031/viewer/2022020213/58887b041a28ab34788b634d/html5/thumbnails/9.jpg)
Format of Message Pack
![Page 10: Serialization (Avro, Message Pack, Kryo)](https://reader031.vdocument.in/reader031/viewer/2022020213/58887b041a28ab34788b634d/html5/thumbnails/10.jpg)
Performance of Message Pack
![Page 11: Serialization (Avro, Message Pack, Kryo)](https://reader031.vdocument.in/reader031/viewer/2022020213/58887b041a28ab34788b634d/html5/thumbnails/11.jpg)
Kryo
• Google Code
• Easy to Collect Serializers Case By Class
• Support Compression
• Kryo TCP & UDP client/server library
![Page 12: Serialization (Avro, Message Pack, Kryo)](https://reader031.vdocument.in/reader031/viewer/2022020213/58887b041a28ab34788b634d/html5/thumbnails/12.jpg)
Benchmarking V2
• http://code.google.com/p/thrift-protobuf-compare/wiki/BenchmarkingV2
![Page 13: Serialization (Avro, Message Pack, Kryo)](https://reader031.vdocument.in/reader031/viewer/2022020213/58887b041a28ab34788b634d/html5/thumbnails/13.jpg)
Thanks :)