streaming benchmark
TRANSCRIPT
Howmanytweetsareprocessed/second?
Insertread_ts Insertwrite_ts
100tweets/second
Subsetof100tweets/second
Latency:
∑ (𝑤𝑟𝑖𝑡𝑒() − 𝑟𝑒𝑎𝑑())./010234./056786 /total_tweets_processed
winStart:windowstarttime;winEnd:windowEndtime
• Totalnumberoftweetsprocessedinstormaremore.•~41000in160sec(Flink:~18500in160sec)
•Noticedlowthroughputandhighlatencyinstorm.
•Thisisnottruealways.Performancetuningisrequired.
FewtuningsIconsidered
§Numberofcomputebolts
§Consumerbolts.
§Javaheapsize.Playsanimportantrole
§Tried2ofthegroupings.