Apache Flink

Flink Community Update

February 2015

Robert Metzger

rmetzger@apache.org

Flink Community Updates

• What happened in the Flink community?

check out the monthly newsletter on the

blog

Subscribe to news@flink.apache.org

1flink.apache.org

Whats new?

• Bugfix release: 0.8.1 (22 issues resolved)

• New committer: Max Michels

• Flink is participating in Google Summer of Code 2015

• Flink integration with Samoa (Machine learning on streams from Yahoo!) support is available as a patch.

• Direct support for running Flink on Google Compute cloud using Google’s ‘bdutil’ (in Google’s bdutil repository)

flink.apache.org 2

Now in master (0.9-SNAPSHOT)

• Graph API “Gelly”

• Expression API (presented here last time)

• “flink-hcatalog” (convenient access to

Hcatalog / Hive tables)

• Access to secured YARN clusters / HDFS

• A LOT of stability improvements (still, use

0.8.1 if you don’t need newer features)

flink.apache.org 3

Flink in the Web

• Blogpost: Flink Streaming [1]

• How Flink Became an Apache Top-Level Project [2]

• Stale Synchronous Parallelism: the New Frontier on Apache Flink?[3]

• Distributed data processing with Apache Flink [4]

• Ciao latency, hallo speed [5]

[1] http://flink.apache.org/news/2015/02/09/streaming-example.html

[2] http://dataconomy.com/how-flink-became-an-apache-top-level-project/

[3] https://www.linkedin.com/pulse/stale-synchronous-parallelism-new-frontier-apache-flink-nam-luc-tran

[4] http://www.hadoopsphere.com/2015/02/distributed-data-processing-with-apache.html

[5] http://www.hadoopsphere.com/2015/02/ciao-latency-hallo-speed.html

flink.apache.org 4

Python API: Call for Testers

• Python API pull request: https://github.com/apache/flink/pull/202

• Implement something, test it on your system and give feedback in the pull request!

• Steps to try it out:git clone https://github.com/zentol/incubator-flink.git

cd flink

git checkout papipr

mvn clean install –DskipTests

cd <dist>

./bin/pyflink2.sh ../resources/python/flink/example/WordCount.py

flink.apache.org 5

GitHub stats

flink.apache.org 6