This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/flink-web.git
commit 603b0be25c6d3466294e4e10c8317416da3163b4 Author: Robert Metzger <rmetz...@apache.org> AuthorDate: Wed Apr 1 10:15:22 2020 +0200 regenerate website --- content/blog/feed.xml | 226 ++++++++---- content/blog/index.html | 38 +- content/blog/page10/index.html | 39 ++- content/blog/page11/index.html | 25 ++ content/blog/page2/index.html | 38 +- content/blog/page3/index.html | 38 +- content/blog/page4/index.html | 40 ++- content/blog/page5/index.html | 38 +- content/blog/page6/index.html | 37 +- content/blog/page7/index.html | 39 ++- content/blog/page8/index.html | 38 +- content/blog/page9/index.html | 37 +- .../2020-03-30-flink-community-update_1.png | Bin 0 -> 74378 bytes .../2020-03-30-flink-community-update_2.png | Bin 0 -> 104660 bytes .../2020-03-30-flink-community-update_3.png | Bin 0 -> 957647 bytes content/index.html | 8 +- content/news/2020/04/01/community-update.html | 385 +++++++++++++++++++++ content/zh/index.html | 8 +- 18 files changed, 810 insertions(+), 224 deletions(-) diff --git a/content/blog/feed.xml b/content/blog/feed.xml index 6d57b1b..30aed9f 100644 --- a/content/blog/feed.xml +++ b/content/blog/feed.xml @@ -7,6 +7,160 @@ <atom:link href="https://flink.apache.org/blog/feed.xml" rel="self" type="application/rss+xml" /> <item> +<title>Flink Community Update - April'20</title> +<description><p>While things slow down around us, the Apache Flink community is privileged to remain as active as ever. This blogpost combs through the past few months to give you an update on the state of things in Flink — from core releases to Stateful Functions; from some good old community stats to a new development blog.</p> + +<p>And since now it’s more important than ever to keep up the spirits, we’d like to invite you to join the <a href="https://www.flink-forward.org/sf-2020">Flink Forward Virtual Conference</a>, on April 22-24 (see <a href="#upcoming-events">Upcoming Events</a>). Hope to see you there!</p> + +<div class="page-toc"> +<ul id="markdown-toc"> + <li><a href="#the-year-so-far-in-flink" id="markdown-toc-the-year-so-far-in-flink">The Year (so far) in Flink</a> <ul> + <li><a href="#flink-110-release" id="markdown-toc-flink-110-release">Flink 1.10 Release</a></li> + <li><a href="#stateful-functions-contribution-and-20-release" id="markdown-toc-stateful-functions-contribution-and-20-release">Stateful Functions Contribution and 2.0 Release</a></li> + <li><a href="#building-up-to-flink-111" id="markdown-toc-building-up-to-flink-111">Building up to Flink 1.11</a></li> + <li><a href="#new-committers-and-pmc-members" id="markdown-toc-new-committers-and-pmc-members">New Committers and PMC Members</a> <ul> + <li><a href="#new-pmc-members" id="markdown-toc-new-pmc-members">New PMC Members</a></li> + <li><a href="#new-committers" id="markdown-toc-new-committers">New Committers</a></li> + </ul> + </li> + </ul> + </li> + <li><a href="#the-bigger-picture" id="markdown-toc-the-bigger-picture">The Bigger Picture</a> <ul> + <li><a href="#a-look-into-the-flink-repository" id="markdown-toc-a-look-into-the-flink-repository">A Look into the Flink Repository</a></li> + <li><a href="#flink-community-packages" id="markdown-toc-flink-community-packages">Flink Community Packages</a></li> + <li><a href="#flink-engine-room" id="markdown-toc-flink-engine-room">Flink “Engine Room”</a></li> + </ul> + </li> + <li><a href="#upcoming-events" id="markdown-toc-upcoming-events">Upcoming Events</a> <ul> + <li><a href="#flink-forward-virtual-conference" id="markdown-toc-flink-forward-virtual-conference">Flink Forward Virtual Conference</a></li> + <li><a href="#others" id="markdown-toc-others">Others</a></li> + </ul> + </li> +</ul> + +</div> + +<h1 id="the-year-so-far-in-flink">The Year (so far) in Flink</h1> + +<h2 id="flink-110-release">Flink 1.10 Release</h2> + +<p>To kick off the new year, the Flink community <a href="https://flink.apache.org/news/2020/02/11/release-1.10.0.html">released Flink 1.10</a> with the record contribution of over 200 engineers. This release introduced significant improvements to the overall performance and stability of Flink jobs, a preview of native Kubernetes integration and advances in Python support (PyFlink). Flink 1.10 also marked the completion of the <a href="https://flink.ap [...] + +<p>The community is now discussing the <a href="http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Releasing-Flink-1-10-1-td38689.html#a38690">release of Flink 1.10.1</a>, covering some outstanding bugs from Flink 1.10.</p> + +<h2 id="stateful-functions-contribution-and-20-release">Stateful Functions Contribution and 2.0 Release</h2> + +<p>Last January, the first version of Stateful Functions (<a href="https://statefun.io/">statefun.io</a>) code was pushed to the <a href="https://github.com/apache/flink-statefun">Flink repository</a>. Stateful Functions started out as an API to build general purpose event-driven applications on Flink, taking advantage of its advanced state management mechanism to cut the “middleman” that usually handles state coordination in such applica [...] + +<p>In a <a href="http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Update-on-Flink-Stateful-Functions-what-are-the-next-steps-tp38646.html">recent update</a>, some new features were announced, like multi-language support (including a Python SDK), function unit testing and Stateful Functions’ own flavor of the <a href="https://ci.apache.org/projects/flink/flink-docs-stable/dev/libs/state_processor_api.html">State Processor A [...] + +<h2 id="building-up-to-flink-111">Building up to Flink 1.11</h2> + +<p>Amidst the usual outpour of discussion threads, JIRA tickets and FLIPs, the community is working full steam on bringing Flink 1.11 to life in the next few months. The feature freeze is currently scheduled for late April, so the release is expected around mid May. +The upcoming release will focus on new features and integrations that broaden the scope of Flink use cases, as well as core runtime enhancements to streamline the operations of complex deployments.</p> + +<p>Some of the plans on the use case side include support for changelog streams in the Table API/SQL (<a href="https://cwiki.apache.org/confluence/display/FLINK/FLIP-105%3A+Support+to+Interpret+and+Emit+Changelog+in+Flink+SQL">FLIP-105</a>), easy streaming data ingestion into Apache Hive (<a href="https://cwiki.apache.org/confluence/display/FLINK/FLIP-115%3A+Filesystem+connector+in+Table">FLIP-115</a>) and support for Pandas DataFrames in [...] + +<p>Throw into the mix improvements around type systems, the WebUI, metrics reporting and supported formats, this release is bound to keep the community busy. For a complete overview of the ongoing development, check <a href="http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Features-of-Apache-Flink-1-11-td38724.html#a38793">this discussion</a> and follow the weekly updates on the Flink <a href="https://flink.apache.org/community.ht [...] + +<h2 id="new-committers-and-pmc-members">New Committers and PMC Members</h2> + +<p>The Apache Flink community has welcomed <strong>1 PMC (Project Management Committee) Member</strong> and <strong>5 new Committers</strong> since the last update (September 2019):</p> + +<h3 id="new-pmc-members">New PMC Members</h3> +<div class="highlight"><pre><code>Jark Wu +</code></pre></div> + +<h3 id="new-committers">New Committers</h3> +<div class="highlight"><pre><code>Zili Chen, Jingsong Lee, Yu Li, Dian Fu, Zhu Zhu +</code></pre></div> + +<p>Congratulations to all and thank you for your hardworking commitment to Flink!</p> + +<h1 id="the-bigger-picture">The Bigger Picture</h1> + +<h2 id="a-look-into-the-flink-repository">A Look into the Flink Repository</h2> + +<p>In the <a href="https://flink.apache.org/news/2019/09/10/community-update.html">last update</a>, we shared some numbers around Flink releases and mailing list activity. This time, we’re looking into the activity in the Flink repository and how it’s evolving.</p> + +<center> +<img src="/img/blog/2020-03-30-flink-community-update/2020-03-30-flink-community-update_1.png" width="725px" alt="GitHub 1" /> +</center> + +<p>There is a clear upward trend in the number of contributions to the repository, based on the number of commits. This reflects the <strong>fast pace of development</strong> the project is experiencing and also the <strong>successful integration of the China-based Flink contributors</strong> started early last year. To complement these observations, the repository registered a <strong>1.5x increase in the number of individual contributors in 2019</ [...] + +<p>But did this increase in capacity produce any other measurable benefits?</p> + +<center> +<img src="/img/blog/2020-03-30-flink-community-update/2020-03-30-flink-community-update_2.png" width="725px" alt="GitHub 2" /> +</center> + +<p>If we look at the average time of Pull Request (PR) “resolution”, it seems like it did: <strong>the average time it takes to close a PR these days has been steadily decreasing</strong> since last year, sitting between 5-6 days for the past few months.</p> + +<p>These are great indicators of the health of Flink as an open source project!</p> + +<h2 id="flink-community-packages">Flink Community Packages</h2> + +<p>If you missed the launch of <a href="http://flink-packages.org/">flink-packages.org</a>, here’s a reminder! Ververica has <a href="https://www.ververica.com/blog/announcing-flink-community-packages">created (and open sourced)</a> a website that showcases the work of the community to push forward the ecosystem surrounding Flink. There, you can explore existing packages (like the Pravega and Pulsar Flink connectors, or the Flink Kubernet [...] + +<h2 id="flink-engine-room">Flink “Engine Room”</h2> + +<p>The community has recently launched the <a href="https://cwiki.apache.org/confluence/pages/viewrecentblogposts.action?key=FLINK">“Engine Room”</a>, a dedicated space in Flink’s Wiki for knowledge sharing between contributors. The goal of this initiative is to make ongoing development on Flink internals more transparent across different work streams, and also to help new contributors get on board with best practices. The first blogpost is already up and shed [...] + +<h1 id="upcoming-events">Upcoming Events</h1> + +<h2 id="flink-forward-virtual-conference">Flink Forward Virtual Conference</h2> + +<p>The organization of Flink Forward had to make the hard decision of cancelling this year’s event in San Francisco. But all is not lost! <strong>Flink Forward SF will be held online on April 22-24 and you can register (for free)</strong> <a href="https://www.flink-forward.org/sf-2020">here</a>. Join the community for interactive talks and Q&amp;A sessions with core Flink contributors and companies like Splunk, Lyft, Netflix or Google.</p> + +<h2 id="others">Others</h2> + +<p>Events across the globe have come to a halt due to the growing concerns around COVID-19, so this time we’ll leave you with some interesting content to read instead. In addition to this written content, you can also recap last year’s sessions from <a href="https://www.youtube.com/playlist?list=PLDX4T_cnKjD207Aa8b5CsZjc7Z_KRezGz">Flink Forward Berlin</a> and <a href="https://www.youtube.com/playlist?list=PLDX4T_cnKjD3ANoNinSx3Au-poZTHvbF5">Fli [...] + +<table class="table table-bordered"> + <thead> + <tr> + <th>Type</th> + <th>Links</th> + </tr> + </thead> + <tbody> + <tr> + <td><span class="glyphicon glyphicon glyphicon-bookmark" aria-hidden="true"></span> Blogposts</td> + <td><ul> + <li><a href="https://medium.com/bird-engineering/replayable-process-functions-in-flink-time-ordering-and-timers-28007a0210e1">Replayable Process Functions: Time, Ordering, and Timers @Bird</a></li> + <li><a href="https://engineering.salesforce.com/application-log-intelligence-performance-insights-at-salesforce-using-flink-92955f30573f">Application Log Intelligence &amp; Performance Insights at Salesforce Using Flink @Salesforce</a></li> + </ul> + <ul> + <li><a href="https://flink.apache.org/news/2020/01/29/state-unlocked-interacting-with-state-in-apache-flink.html">State Unlocked: Interacting with State in Apache Flink</a></li> + <li><a href="https://flink.apache.org/news/2020/01/15/demo-fraud-detection.html">Advanced Flink Application Patterns Vol.1: Case Study of a Fraud Detection System</a></li> + <li><a href="https://flink.apache.org/news/2020/03/24/demo-fraud-detection-2.html">Advanced Flink Application Patterns Vol.2: Dynamic Updates of Application Logic</a></li> + <li><a href="https://flink.apache.org/ecosystem/2020/02/22/apache-beam-how-beam-runs-on-top-of-flink.html">Apache Beam: How Beam Runs on Top of Flink</a></li> + <li><a href="https://flink.apache.org/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></li> + </ul> + </td> + </tr> + <tr> + <td><span class="glyphicon glyphicon-console" aria-hidden="true"></span> Tutorials</td> + <td><ul> + <li><a href="https://medium.com/@zjffdu/flink-on-zeppelin-part-3-streaming-5fca1e16754">Flink on Zeppelin — (Part 3). Streaming</a></li> + <li><a href="https://aws.amazon.com/blogs/big-data/streaming-etl-with-apache-flink-and-amazon-kinesis-data-analytics">Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics</a></li> + <li><a href="https://flink.apache.org/news/2020/02/20/ddl.html">No Java Required: Configuring Sources and Sinks in SQL</a></li> + <li><a href="https://flink.apache.org/news/2020/02/07/a-guide-for-unit-testing-in-apache-flink.html">A Guide for Unit Testing in Apache Flink</a></li> + </ul> + </td> + </tr> + </tbody> +</table> + +<p>If you’d like to keep a closer eye on what’s happening in the community, subscribe to the Flink <a href="https://flink.apache.org/community.html#mailing-lists">@community mailing list</a> to get fine-grained weekly updates, upcoming event announcements and more.</p> +</description> +<pubDate>Wed, 01 Apr 2020 10:00:00 +0200</pubDate> +<link>https://flink.apache.org/news/2020/04/01/community-update.html</link> +<guid isPermaLink="true">/news/2020/04/01/community-update.html</guid> +</item> + +<item> <title>Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</title> <description><p>In this blog post, you will learn our motivation behind the Flink-Hive integration, and how Flink 1.10 can help modernize your data warehouse.</p> @@ -16658,77 +16812,5 @@ Flink serialization system improved a lot over time and by now surpasses the cap <guid isPermaLink="true">/news/2014/11/18/hadoop-compatibility.html</guid> </item> -<item> -<title>Apache Flink 0.7.0 available</title> -<description><p>We are pleased to announce the availability of Flink 0.7.0. This release includes new user-facing features as well as performance and bug fixes, brings the Scala and Java APIs in sync, and introduces Flink Streaming. A total of 34 people have contributed to this release, a big thanks to all of them!</p> - -<p>Download Flink 0.7.0 <a href="http://flink.incubator.apache.org/downloads.html">here</a></p> - -<p>See the release changelog <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&amp;version=12327648">here</a></p> - -<h2 id="overview-of-major-new-features">Overview of major new features</h2> - -<p><strong>Flink Streaming:</strong> The gem of the 0.7.0 release is undoubtedly Flink Streaming. Available currently in alpha, Flink Streaming provides a Java API on top of Apache Flink that can consume streaming data sources (e.g., from Apache Kafka, Apache Flume, and others) and process them in real time. A dedicated blog post on Flink Streaming and its performance is coming up here soon. You can check out the Streaming programming guide <a href="http://ci.ap [...] - -<p><strong>New Scala API:</strong> The Scala API has been completely rewritten. The Java and Scala APIs have now the same syntax and transformations and will be kept from now on in sync in every future release. See the new Scala API <a href="http://ci.apache.org/projects/flink/flink-docs-release-0.7/programming_guide.html">here</a>.</p> - -<p><strong>Logical key expressions:</strong> You can now specify grouping and joining keys with logical names for member variables of POJO data types. For example, you can join two data sets as <code>persons.join(cities).where(“zip”).equalTo(“zipcode”)</code>. Read more <a href="http://ci.apache.org/projects/flink/flink-docs-release-0.7/programming_guide.html#specifying-keys">here</a>.</p> - -<p><strong>Hadoop MapReduce compatibility:</strong> You can run unmodified Hadoop Mappers and Reducers (mapred API) in Flink, use all Hadoop data types, and read data with all Hadoop InputFormats.</p> - -<p><strong>Collection-based execution backend:</strong> The collection-based execution backend enables you to execute a Flink job as a simple Java collections program, bypassing completely the Flink runtime and optimizer. This feature is extremely useful for prototyping, and embedding Flink jobs in projects in a very lightweight manner.</p> - -<p><strong>Record API deprecated:</strong> The (old) Stratosphere Record API has been marked as deprecated and is planned for removal in the 0.9.0 release.</p> - -<p><strong>BLOB service:</strong> This release contains a new service to distribute jar files and other binary data among the JobManager, TaskManagers and the client.</p> - -<p><strong>Intermediate data sets:</strong> A major rewrite of the system internals introduces intermediate data sets as first class citizens. The internal state machine that tracks the distributed tasks has also been completely rewritten for scalability. While this is not visible as a user-facing feature yet, it is the foundation for several upcoming exciting features.</p> - -<p><strong>Note:</strong> Currently, there is limited support for Java 8 lambdas when compiling and running from an IDE. The problem is due to type erasure and whether Java compilers retain type information. We are currently working with the Eclipse and OpenJDK communities to resolve this.</p> - -<h2 id="contributors">Contributors</h2> - -<ul> - <li>Tamas Ambrus</li> - <li>Mariem Ayadi</li> - <li>Marton Balassi</li> - <li>Daniel Bali</li> - <li>Ufuk Celebi</li> - <li>Hung Chang</li> - <li>David Eszes</li> - <li>Stephan Ewen</li> - <li>Judit Feher</li> - <li>Gyula Fora</li> - <li>Gabor Hermann</li> - <li>Fabian Hueske</li> - <li>Vasiliki Kalavri</li> - <li>Kristof Kovacs</li> - <li>Aljoscha Krettek</li> - <li>Sebastian Kruse</li> - <li>Sebastian Kunert</li> - <li>Matyas Manninger</li> - <li>Robert Metzger</li> - <li>Mingliang Qi</li> - <li>Till Rohrmann</li> - <li>Henry Saputra</li> - <li>Chesnay Schelper</li> - <li>Moritz Schubotz</li> - <li>Hung Sendoh Chang</li> - <li>Peter Szabo</li> - <li>Jonas Traub</li> - <li>Fabian Tschirschnitz</li> - <li>Artem Tsikiridis</li> - <li>Kostas Tzoumas</li> - <li>Timo Walther</li> - <li>Daniel Warneke</li> - <li>Tobias Wiens</li> - <li>Yingjun Wu</li> -</ul> -</description> -<pubDate>Tue, 04 Nov 2014 11:00:00 +0100</pubDate> -<link>https://flink.apache.org/news/2014/11/04/release-0.7.0.html</link> -<guid isPermaLink="true">/news/2014/11/04/release-0.7.0.html</guid> -</item> - </channel> </rss> diff --git a/content/blog/index.html b/content/blog/index.html index 011653e..7b643c0 100644 --- a/content/blog/index.html +++ b/content/blog/index.html @@ -185,6 +185,19 @@ <!-- Blog posts --> <article> + <h2 class="blog-title"><a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></h2> + + <p>01 Apr 2020 + Marta Paes (<a href="https://twitter.com/morsapaes">@morsapaes</a>)</p> + + <p>While things slow down around us, the Apache Flink community is privileged to remain as active as ever. This blogpost combs through the past few months to give you an update on the state of things in Flink — from core releases to Stateful Functions; from some good old community stats to a new development blog.</p> + + <p><a href="/news/2020/04/01/community-update.html">Continue reading »</a></p> + </article> + + <hr> + + <article> <h2 class="blog-title"><a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></h2> <p>27 Mar 2020 @@ -307,21 +320,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/news/2019/12/11/release-1.8.3.html">Apache Flink 1.8.3 Released</a></h2> - - <p>11 Dec 2019 - Hequn Cheng </p> - - <p><p>The Apache Flink community released the third bugfix version of the Apache Flink 1.8 series.</p> - -</p> - - <p><a href="/news/2019/12/11/release-1.8.3.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -354,6 +352,16 @@ <ul id="markdown-toc"> + <li><a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></li> + + + + + + + + + <li><a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></li> diff --git a/content/blog/page10/index.html b/content/blog/page10/index.html index b37734e..6813d2d 100644 --- a/content/blog/page10/index.html +++ b/content/blog/page10/index.html @@ -185,6 +185,20 @@ <!-- Blog posts --> <article> + <h2 class="blog-title"><a href="/news/2015/05/11/Juggling-with-Bits-and-Bytes.html">Juggling with Bits and Bytes</a></h2> + + <p>11 May 2015 by Fabian Hüske (<a href="https://twitter.com/">@fhueske</a>) + </p> + + <p><p>Nowadays, a lot of open-source systems for analyzing large data sets are implemented in Java or other JVM-based programming languages. The most well-known example is Apache Hadoop, but also newer frameworks such as Apache Spark, Apache Drill, and also Apache Flink run on JVMs. A common challenge that JVM-based data analysis engines face is to store large amounts of data in memory - both for caching and for efficient processing such as sorting and joining of data. Managing the [...] +<p>In this blog post we discuss how Apache Flink manages memory, talk about its custom data de/serialization stack, and show how it operates on binary data.</p></p> + + <p><a href="/news/2015/05/11/Juggling-with-Bits-and-Bytes.html">Continue reading »</a></p> + </article> + + <hr> + + <article> <h2 class="blog-title"><a href="/news/2015/04/13/release-0.9.0-milestone1.html">Announcing Flink 0.9.0-milestone1 preview release</a></h2> <p>13 Apr 2015 @@ -329,21 +343,6 @@ and offers a new API including definition of flexible windows.</p> <hr> - <article> - <h2 class="blog-title"><a href="/news/2014/11/04/release-0.7.0.html">Apache Flink 0.7.0 available</a></h2> - - <p>04 Nov 2014 - </p> - - <p><p>We are pleased to announce the availability of Flink 0.7.0. This release includes new user-facing features as well as performance and bug fixes, brings the Scala and Java APIs in sync, and introduces Flink Streaming. A total of 34 people have contributed to this release, a big thanks to all of them!</p> - -</p> - - <p><a href="/news/2014/11/04/release-0.7.0.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -376,6 +375,16 @@ and offers a new API including definition of flexible windows.</p> <ul id="markdown-toc"> + <li><a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></li> + + + + + + + + + <li><a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></li> diff --git a/content/blog/page11/index.html b/content/blog/page11/index.html index 62d1945..9f5bceb 100644 --- a/content/blog/page11/index.html +++ b/content/blog/page11/index.html @@ -185,6 +185,21 @@ <!-- Blog posts --> <article> + <h2 class="blog-title"><a href="/news/2014/11/04/release-0.7.0.html">Apache Flink 0.7.0 available</a></h2> + + <p>04 Nov 2014 + </p> + + <p><p>We are pleased to announce the availability of Flink 0.7.0. This release includes new user-facing features as well as performance and bug fixes, brings the Scala and Java APIs in sync, and introduces Flink Streaming. A total of 34 people have contributed to this release, a big thanks to all of them!</p> + +</p> + + <p><a href="/news/2014/11/04/release-0.7.0.html">Continue reading »</a></p> + </article> + + <hr> + + <article> <h2 class="blog-title"><a href="/news/2014/10/03/upcoming_events.html">Upcoming Events</a></h2> <p>03 Oct 2014 @@ -264,6 +279,16 @@ academic and open source project that Flink originates from.</p> <ul id="markdown-toc"> + <li><a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></li> + + + + + + + + + <li><a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></li> diff --git a/content/blog/page2/index.html b/content/blog/page2/index.html index 3de31b4..2d921ab 100644 --- a/content/blog/page2/index.html +++ b/content/blog/page2/index.html @@ -185,6 +185,21 @@ <!-- Blog posts --> <article> + <h2 class="blog-title"><a href="/news/2019/12/11/release-1.8.3.html">Apache Flink 1.8.3 Released</a></h2> + + <p>11 Dec 2019 + Hequn Cheng </p> + + <p><p>The Apache Flink community released the third bugfix version of the Apache Flink 1.8 series.</p> + +</p> + + <p><a href="/news/2019/12/11/release-1.8.3.html">Continue reading »</a></p> + </article> + + <hr> + + <article> <h2 class="blog-title"><a href="/news/2019/12/09/flink-kubernetes-kudo.html">Running Apache Flink on Kubernetes with KUDO</a></h2> <p>09 Dec 2019 @@ -310,19 +325,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/2019/06/26/broadcast-state.html">A Practical Guide to Broadcast State in Apache Flink</a></h2> - - <p>26 Jun 2019 - Fabian Hueske (<a href="https://twitter.com/fhueske">@fhueske</a>)</p> - - <p>Apache Flink has multiple types of operator state, one of which is called Broadcast State. In this post, we explain what Broadcast State is, and show an example of how it can be applied to an application that evaluates dynamic patterns on an event stream.</p> - - <p><a href="/2019/06/26/broadcast-state.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -355,6 +357,16 @@ <ul id="markdown-toc"> + <li><a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></li> + + + + + + + + + <li><a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></li> diff --git a/content/blog/page3/index.html b/content/blog/page3/index.html index a8131a3..643e30e 100644 --- a/content/blog/page3/index.html +++ b/content/blog/page3/index.html @@ -185,6 +185,19 @@ <!-- Blog posts --> <article> + <h2 class="blog-title"><a href="/2019/06/26/broadcast-state.html">A Practical Guide to Broadcast State in Apache Flink</a></h2> + + <p>26 Jun 2019 + Fabian Hueske (<a href="https://twitter.com/fhueske">@fhueske</a>)</p> + + <p>Apache Flink has multiple types of operator state, one of which is called Broadcast State. In this post, we explain what Broadcast State is, and show an example of how it can be applied to an application that evaluates dynamic patterns on an event stream.</p> + + <p><a href="/2019/06/26/broadcast-state.html">Continue reading »</a></p> + </article> + + <hr> + + <article> <h2 class="blog-title"><a href="/2019/06/05/flink-network-stack.html">A Deep-Dive into Flink's Network Stack</a></h2> <p>05 Jun 2019 @@ -309,21 +322,6 @@ for more details.</p> <hr> - <article> - <h2 class="blog-title"><a href="/news/2019/02/25/release-1.6.4.html">Apache Flink 1.6.4 Released</a></h2> - - <p>25 Feb 2019 - </p> - - <p><p>The Apache Flink community released the fourth bugfix version of the Apache Flink 1.6 series.</p> - -</p> - - <p><a href="/news/2019/02/25/release-1.6.4.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -356,6 +354,16 @@ for more details.</p> <ul id="markdown-toc"> + <li><a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></li> + + + + + + + + + <li><a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></li> diff --git a/content/blog/page4/index.html b/content/blog/page4/index.html index b5b5f31..ece1592 100644 --- a/content/blog/page4/index.html +++ b/content/blog/page4/index.html @@ -185,6 +185,21 @@ <!-- Blog posts --> <article> + <h2 class="blog-title"><a href="/news/2019/02/25/release-1.6.4.html">Apache Flink 1.6.4 Released</a></h2> + + <p>25 Feb 2019 + </p> + + <p><p>The Apache Flink community released the fourth bugfix version of the Apache Flink 1.6 series.</p> + +</p> + + <p><a href="/news/2019/02/25/release-1.6.4.html">Continue reading »</a></p> + </article> + + <hr> + + <article> <h2 class="blog-title"><a href="/news/2019/02/15/release-1.7.2.html">Apache Flink 1.7.2 Released</a></h2> <p>15 Feb 2019 @@ -319,21 +334,6 @@ Please check the <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa <hr> - <article> - <h2 class="blog-title"><a href="/news/2018/09/20/release-1.5.4.html">Apache Flink 1.5.4 Released</a></h2> - - <p>20 Sep 2018 - </p> - - <p><p>The Apache Flink community released the fourth bugfix version of the Apache Flink 1.5 series.</p> - -</p> - - <p><a href="/news/2018/09/20/release-1.5.4.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -366,6 +366,16 @@ Please check the <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa <ul id="markdown-toc"> + <li><a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></li> + + + + + + + + + <li><a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></li> diff --git a/content/blog/page5/index.html b/content/blog/page5/index.html index d6daf3b..c7fbf6f 100644 --- a/content/blog/page5/index.html +++ b/content/blog/page5/index.html @@ -185,6 +185,21 @@ <!-- Blog posts --> <article> + <h2 class="blog-title"><a href="/news/2018/09/20/release-1.5.4.html">Apache Flink 1.5.4 Released</a></h2> + + <p>20 Sep 2018 + </p> + + <p><p>The Apache Flink community released the fourth bugfix version of the Apache Flink 1.5 series.</p> + +</p> + + <p><a href="/news/2018/09/20/release-1.5.4.html">Continue reading »</a></p> + </article> + + <hr> + + <article> <h2 class="blog-title"><a href="/news/2018/08/21/release-1.5.3.html">Apache Flink 1.5.3 Released</a></h2> <p>21 Aug 2018 @@ -317,19 +332,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/features/2018/01/30/incremental-checkpointing.html">Managing Large State in Apache Flink: An Intro to Incremental Checkpointing</a></h2> - - <p>30 Jan 2018 - Stefan Ricther (<a href="https://twitter.com/StefanRRicther">@StefanRRicther</a>) & Chris Ward (<a href="https://twitter.com/chrischinch">@chrischinch</a>)</p> - - <p>Flink 1.3.0 introduced incremental checkpointing, making it possible for applications with large state to generate checkpoints more efficiently.</p> - - <p><a href="/features/2018/01/30/incremental-checkpointing.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -362,6 +364,16 @@ <ul id="markdown-toc"> + <li><a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></li> + + + + + + + + + <li><a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></li> diff --git a/content/blog/page6/index.html b/content/blog/page6/index.html index 9df436b..d10ae05 100644 --- a/content/blog/page6/index.html +++ b/content/blog/page6/index.html @@ -185,6 +185,19 @@ <!-- Blog posts --> <article> + <h2 class="blog-title"><a href="/features/2018/01/30/incremental-checkpointing.html">Managing Large State in Apache Flink: An Intro to Incremental Checkpointing</a></h2> + + <p>30 Jan 2018 + Stefan Ricther (<a href="https://twitter.com/StefanRRicther">@StefanRRicther</a>) & Chris Ward (<a href="https://twitter.com/chrischinch">@chrischinch</a>)</p> + + <p>Flink 1.3.0 introduced incremental checkpointing, making it possible for applications with large state to generate checkpoints more efficiently.</p> + + <p><a href="/features/2018/01/30/incremental-checkpointing.html">Continue reading »</a></p> + </article> + + <hr> + + <article> <h2 class="blog-title"><a href="/news/2017/12/21/2017-year-in-review.html">Apache Flink in 2017: Year in Review</a></h2> <p>21 Dec 2017 @@ -320,20 +333,6 @@ what’s coming in Flink 1.4.0 as well as a preview of what the Flink community <hr> - <article> - <h2 class="blog-title"><a href="/news/2017/04/04/dynamic-tables.html">Continuous Queries on Dynamic Tables</a></h2> - - <p>04 Apr 2017 by Fabian Hueske, Shaoxuan Wang, and Xiaowei Jiang - </p> - - <p><p>Flink's relational APIs, the Table API and SQL, are unified APIs for stream and batch processing, meaning that a query produces the same result when being evaluated on streaming or static data.</p> -<p>In this blog post we discuss the future of these APIs and introduce the concept of Dynamic Tables. Dynamic tables will significantly expand the scope of the Table API and SQL on streams and enable many more advanced use cases. We discuss how streams and dynamic tables relate to each other and explain the semantics of continuously evaluating queries on dynamic tables.</p></p> - - <p><a href="/news/2017/04/04/dynamic-tables.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -366,6 +365,16 @@ what’s coming in Flink 1.4.0 as well as a preview of what the Flink community <ul id="markdown-toc"> + <li><a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></li> + + + + + + + + + <li><a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></li> diff --git a/content/blog/page7/index.html b/content/blog/page7/index.html index b88aade..e359ffd 100644 --- a/content/blog/page7/index.html +++ b/content/blog/page7/index.html @@ -185,6 +185,20 @@ <!-- Blog posts --> <article> + <h2 class="blog-title"><a href="/news/2017/04/04/dynamic-tables.html">Continuous Queries on Dynamic Tables</a></h2> + + <p>04 Apr 2017 by Fabian Hueske, Shaoxuan Wang, and Xiaowei Jiang + </p> + + <p><p>Flink's relational APIs, the Table API and SQL, are unified APIs for stream and batch processing, meaning that a query produces the same result when being evaluated on streaming or static data.</p> +<p>In this blog post we discuss the future of these APIs and introduce the concept of Dynamic Tables. Dynamic tables will significantly expand the scope of the Table API and SQL on streams and enable many more advanced use cases. We discuss how streams and dynamic tables relate to each other and explain the semantics of continuously evaluating queries on dynamic tables.</p></p> + + <p><a href="/news/2017/04/04/dynamic-tables.html">Continue reading »</a></p> + </article> + + <hr> + + <article> <h2 class="blog-title"><a href="/news/2017/03/29/table-sql-api-update.html">From Streams to Tables and Back Again: An Update on Flink's Table & SQL API</a></h2> <p>29 Mar 2017 by Timo Walther (<a href="https://twitter.com/">@twalthr</a>) @@ -313,21 +327,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/news/2016/08/08/release-1.1.0.html">Announcing Apache Flink 1.1.0</a></h2> - - <p>08 Aug 2016 - </p> - - <p><div class="alert alert-success"><strong>Important</strong>: The Maven artifacts published with version 1.1.0 on Maven central have a Hadoop dependency issue. It is highly recommended to use <strong>1.1.1</strong> or <strong>1.1.1-hadoop1</strong> as the Flink version.</div> - -</p> - - <p><a href="/news/2016/08/08/release-1.1.0.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -360,6 +359,16 @@ <ul id="markdown-toc"> + <li><a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></li> + + + + + + + + + <li><a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></li> diff --git a/content/blog/page8/index.html b/content/blog/page8/index.html index f91f090..e9cf4da 100644 --- a/content/blog/page8/index.html +++ b/content/blog/page8/index.html @@ -185,6 +185,21 @@ <!-- Blog posts --> <article> + <h2 class="blog-title"><a href="/news/2016/08/08/release-1.1.0.html">Announcing Apache Flink 1.1.0</a></h2> + + <p>08 Aug 2016 + </p> + + <p><div class="alert alert-success"><strong>Important</strong>: The Maven artifacts published with version 1.1.0 on Maven central have a Hadoop dependency issue. It is highly recommended to use <strong>1.1.1</strong> or <strong>1.1.1-hadoop1</strong> as the Flink version.</div> + +</p> + + <p><a href="/news/2016/08/08/release-1.1.0.html">Continue reading »</a></p> + </article> + + <hr> + + <article> <h2 class="blog-title"><a href="/news/2016/05/24/stream-sql.html">Stream Processing for Everyone with SQL and Apache Flink</a></h2> <p>24 May 2016 by Fabian Hueske (<a href="https://twitter.com/">@fhueske</a>) @@ -314,19 +329,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/news/2015/12/11/storm-compatibility.html">Storm Compatibility in Apache Flink: How to run existing Storm topologies on Flink</a></h2> - - <p>11 Dec 2015 by Matthias J. Sax (<a href="https://twitter.com/">@MatthiasJSax</a>) - </p> - - <p>In this blog post, we describe Flink's compatibility package for <a href="https://storm.apache.org">Apache Storm</a> that allows to embed Spouts (sources) and Bolts (operators) in a regular Flink streaming job. Furthermore, the compatibility package provides a Storm compatible API in order to execute whole Storm topologies with (almost) no code adaption.</p> - - <p><a href="/news/2015/12/11/storm-compatibility.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -359,6 +361,16 @@ <ul id="markdown-toc"> + <li><a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></li> + + + + + + + + + <li><a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></li> diff --git a/content/blog/page9/index.html b/content/blog/page9/index.html index 9d3b031..762c162 100644 --- a/content/blog/page9/index.html +++ b/content/blog/page9/index.html @@ -185,6 +185,19 @@ <!-- Blog posts --> <article> + <h2 class="blog-title"><a href="/news/2015/12/11/storm-compatibility.html">Storm Compatibility in Apache Flink: How to run existing Storm topologies on Flink</a></h2> + + <p>11 Dec 2015 by Matthias J. Sax (<a href="https://twitter.com/">@MatthiasJSax</a>) + </p> + + <p>In this blog post, we describe Flink's compatibility package for <a href="https://storm.apache.org">Apache Storm</a> that allows to embed Spouts (sources) and Bolts (operators) in a regular Flink streaming job. Furthermore, the compatibility package provides a Storm compatible API in order to execute whole Storm topologies with (almost) no code adaption.</p> + + <p><a href="/news/2015/12/11/storm-compatibility.html">Continue reading »</a></p> + </article> + + <hr> + + <article> <h2 class="blog-title"><a href="/news/2015/12/04/Introducing-windows.html">Introducing Stream Windows in Apache Flink</a></h2> <p>04 Dec 2015 by Fabian Hueske (<a href="https://twitter.com/">@fhueske</a>) @@ -322,20 +335,6 @@ vertex-centric or gather-sum-apply to Flink dataflows.</p> <hr> - <article> - <h2 class="blog-title"><a href="/news/2015/05/11/Juggling-with-Bits-and-Bytes.html">Juggling with Bits and Bytes</a></h2> - - <p>11 May 2015 by Fabian Hüske (<a href="https://twitter.com/">@fhueske</a>) - </p> - - <p><p>Nowadays, a lot of open-source systems for analyzing large data sets are implemented in Java or other JVM-based programming languages. The most well-known example is Apache Hadoop, but also newer frameworks such as Apache Spark, Apache Drill, and also Apache Flink run on JVMs. A common challenge that JVM-based data analysis engines face is to store large amounts of data in memory - both for caching and for efficient processing such as sorting and joining of data. Managing the [...] -<p>In this blog post we discuss how Apache Flink manages memory, talk about its custom data de/serialization stack, and show how it operates on binary data.</p></p> - - <p><a href="/news/2015/05/11/Juggling-with-Bits-and-Bytes.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -368,6 +367,16 @@ vertex-centric or gather-sum-apply to Flink dataflows.</p> <ul id="markdown-toc"> + <li><a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></li> + + + + + + + + + <li><a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></li> diff --git a/content/img/blog/2020-03-30-flink-community-update/2020-03-30-flink-community-update_1.png b/content/img/blog/2020-03-30-flink-community-update/2020-03-30-flink-community-update_1.png new file mode 100644 index 0000000..4dcfe32 Binary files /dev/null and b/content/img/blog/2020-03-30-flink-community-update/2020-03-30-flink-community-update_1.png differ diff --git a/content/img/blog/2020-03-30-flink-community-update/2020-03-30-flink-community-update_2.png b/content/img/blog/2020-03-30-flink-community-update/2020-03-30-flink-community-update_2.png new file mode 100644 index 0000000..977fd21 Binary files /dev/null and b/content/img/blog/2020-03-30-flink-community-update/2020-03-30-flink-community-update_2.png differ diff --git a/content/img/blog/2020-03-30-flink-community-update/2020-03-30-flink-community-update_3.png b/content/img/blog/2020-03-30-flink-community-update/2020-03-30-flink-community-update_3.png new file mode 100644 index 0000000..23d8f2a Binary files /dev/null and b/content/img/blog/2020-03-30-flink-community-update/2020-03-30-flink-community-update_3.png differ diff --git a/content/index.html b/content/index.html index e584a71..d3fc48e 100644 --- a/content/index.html +++ b/content/index.html @@ -557,6 +557,9 @@ <dl> + <dt> <a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></dt> + <dd>While things slow down around us, the Apache Flink community is privileged to remain as active as ever. This blogpost combs through the past few months to give you an update on the state of things in Flink — from core releases to Stateful Functions; from some good old community stats to a new development blog.</dd> + <dt> <a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></dt> <dd><p>In this blog post, you will learn our motivation behind the Flink-Hive integration, and how Flink 1.10 can help modernize your data warehouse.</p> @@ -570,11 +573,6 @@ <dt> <a href="/news/2020/02/20/ddl.html">No Java Required: Configuring Sources and Sinks in SQL</a></dt> <dd>This post discusses the efforts of the Flink community as they relate to end to end applications with SQL in Apache Flink.</dd> - - <dt> <a href="/news/2020/02/11/release-1.10.0.html">Apache Flink 1.10.0 Release Announcement</a></dt> - <dd><p>The Apache Flink community is excited to hit the double digits and announce the release of Flink 1.10.0! As a result of the biggest community effort to date, with over 1.2k issues implemented and more than 200 contributors, this release introduces significant improvements to the overall performance and stability of Flink jobs, a preview of native Kubernetes integration and great advances in Python support (PyFlink).</p> - -</dd> </dl> diff --git a/content/news/2020/04/01/community-update.html b/content/news/2020/04/01/community-update.html new file mode 100644 index 0000000..acf3332 --- /dev/null +++ b/content/news/2020/04/01/community-update.html @@ -0,0 +1,385 @@ +<!DOCTYPE html> +<html lang="en"> + <head> + <meta charset="utf-8"> + <meta http-equiv="X-UA-Compatible" content="IE=edge"> + <meta name="viewport" content="width=device-width, initial-scale=1"> + <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags --> + <title>Apache Flink: Flink Community Update - April'20</title> + <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon"> + <link rel="icon" href="/favicon.ico" type="image/x-icon"> + + <!-- Bootstrap --> + <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.4.1/css/bootstrap.min.css"> + <link rel="stylesheet" href="/css/flink.css"> + <link rel="stylesheet" href="/css/syntax.css"> + + <!-- Blog RSS feed --> + <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" /> + + <!-- jQuery (necessary for Bootstrap's JavaScript plugins) --> + <!-- We need to load Jquery in the header for custom google analytics event tracking--> + <script src="/js/jquery.min.js"></script> + + <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries --> + <!-- WARNING: Respond.js doesn't work if you view the page via file:// --> + <!--[if lt IE 9]> + <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script> + <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script> + <![endif]--> + </head> + <body> + + + <!-- Main content. --> + <div class="container"> + <div class="row"> + + + <div id="sidebar" class="col-sm-3"> + + +<!-- Top navbar. --> + <nav class="navbar navbar-default"> + <!-- The logo. --> + <div class="navbar-header"> + <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1"> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + <div class="navbar-logo"> + <a href="/"> + <img alt="Apache Flink" src="/img/flink-header-logo.svg" width="147px" height="73px"> + </a> + </div> + </div><!-- /.navbar-header --> + + <!-- The navigation links. --> + <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1"> + <ul class="nav navbar-nav navbar-main"> + + <!-- First menu section explains visitors what Flink is --> + + <!-- What is Stream Processing? --> + <!-- + <li><a href="/streamprocessing1.html">What is Stream Processing?</a></li> + --> + + <!-- What is Flink? --> + <li><a href="/flink-architecture.html">What is Apache Flink?</a></li> + + + + <!-- Use cases --> + <li><a href="/usecases.html">Use Cases</a></li> + + <!-- Powered by --> + <li><a href="/poweredby.html">Powered By</a></li> + + + + <!-- Second menu section aims to support Flink users --> + + <!-- Downloads --> + <li><a href="/downloads.html">Downloads</a></li> + + <!-- Getting Started --> + <li> + <a href="https://ci.apache.org/projects/flink/flink-docs-release-1.10/getting-started/index.html" target="_blank">Getting Started <small><span class="glyphicon glyphicon-new-window"></span></small></a> + </li> + + <!-- Documentation --> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Documentation<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="https://ci.apache.org/projects/flink/flink-docs-release-1.10" target="_blank">1.10 (Latest stable release) <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> + <li><a href="https://ci.apache.org/projects/flink/flink-docs-master" target="_blank">Master (Latest Snapshot) <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> + </ul> + </li> + + <!-- getting help --> + <li><a href="/gettinghelp.html">Getting Help</a></li> + + <!-- Blog --> + <li class="active"><a href="/blog/"><b>Flink Blog</b></a></li> + + + <!-- Flink-packages --> + <li> + <a href="https://flink-packages.org" target="_blank">flink-packages.org <small><span class="glyphicon glyphicon-new-window"></span></small></a> + </li> + + + <!-- Third menu section aim to support community and contributors --> + + <!-- Community --> + <li><a href="/community.html">Community & Project Info</a></li> + + <!-- Roadmap --> + <li><a href="/roadmap.html">Roadmap</a></li> + + <!-- Contribute --> + <li><a href="/contributing/how-to-contribute.html">How to Contribute</a></li> + + + <!-- GitHub --> + <li> + <a href="https://github.com/apache/flink" target="_blank">Flink on GitHub <small><span class="glyphicon glyphicon-new-window"></span></small></a> + </li> + + + + <!-- Language Switcher --> + <li> + + + <!-- link to the Chinese home page when current is blog page --> + <a href="/zh">中文版</a> + + + </li> + + </ul> + + <ul class="nav navbar-nav navbar-bottom"> + <hr /> + + <!-- Twitter --> + <li><a href="https://twitter.com/apacheflink" target="_blank">@ApacheFlink <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> + + <!-- Visualizer --> + <li class=" hidden-md hidden-sm"><a href="/visualizer/" target="_blank">Plan Visualizer <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> + + <hr /> + + <li><a href="https://apache.org" target="_blank">Apache Software Foundation <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> + + <li> + <style> + .smalllinks:link { + display: inline-block !important; background: none; padding-top: 0px; padding-bottom: 0px; padding-right: 0px; min-width: 75px; + } + </style> + + <a class="smalllinks" href="https://www.apache.org/licenses/" target="_blank">License</a> <small><span class="glyphicon glyphicon-new-window"></span></small> + + <a class="smalllinks" href="https://www.apache.org/security/" target="_blank">Security</a> <small><span class="glyphicon glyphicon-new-window"></span></small> + + <a class="smalllinks" href="https://www.apache.org/foundation/sponsorship.html" target="_blank">Donate</a> <small><span class="glyphicon glyphicon-new-window"></span></small> + + <a class="smalllinks" href="https://www.apache.org/foundation/thanks.html" target="_blank">Thanks</a> <small><span class="glyphicon glyphicon-new-window"></span></small> + </li> + + </ul> + </div><!-- /.navbar-collapse --> + </nav> + + </div> + <div class="col-sm-9"> + <div class="row-fluid"> + <div class="col-sm-12"> + <div class="row"> + <h1>Flink Community Update - April'20</h1> + + <article> + <p>01 Apr 2020 Marta Paes (<a href="https://twitter.com/morsapaes">@morsapaes</a>)</p> + +<p>While things slow down around us, the Apache Flink community is privileged to remain as active as ever. This blogpost combs through the past few months to give you an update on the state of things in Flink — from core releases to Stateful Functions; from some good old community stats to a new development blog.</p> + +<p>And since now it’s more important than ever to keep up the spirits, we’d like to invite you to join the <a href="https://www.flink-forward.org/sf-2020">Flink Forward Virtual Conference</a>, on April 22-24 (see <a href="#upcoming-events">Upcoming Events</a>). Hope to see you there!</p> + +<div class="page-toc"> +<ul id="markdown-toc"> + <li><a href="#the-year-so-far-in-flink" id="markdown-toc-the-year-so-far-in-flink">The Year (so far) in Flink</a> <ul> + <li><a href="#flink-110-release" id="markdown-toc-flink-110-release">Flink 1.10 Release</a></li> + <li><a href="#stateful-functions-contribution-and-20-release" id="markdown-toc-stateful-functions-contribution-and-20-release">Stateful Functions Contribution and 2.0 Release</a></li> + <li><a href="#building-up-to-flink-111" id="markdown-toc-building-up-to-flink-111">Building up to Flink 1.11</a></li> + <li><a href="#new-committers-and-pmc-members" id="markdown-toc-new-committers-and-pmc-members">New Committers and PMC Members</a> <ul> + <li><a href="#new-pmc-members" id="markdown-toc-new-pmc-members">New PMC Members</a></li> + <li><a href="#new-committers" id="markdown-toc-new-committers">New Committers</a></li> + </ul> + </li> + </ul> + </li> + <li><a href="#the-bigger-picture" id="markdown-toc-the-bigger-picture">The Bigger Picture</a> <ul> + <li><a href="#a-look-into-the-flink-repository" id="markdown-toc-a-look-into-the-flink-repository">A Look into the Flink Repository</a></li> + <li><a href="#flink-community-packages" id="markdown-toc-flink-community-packages">Flink Community Packages</a></li> + <li><a href="#flink-engine-room" id="markdown-toc-flink-engine-room">Flink “Engine Room”</a></li> + </ul> + </li> + <li><a href="#upcoming-events" id="markdown-toc-upcoming-events">Upcoming Events</a> <ul> + <li><a href="#flink-forward-virtual-conference" id="markdown-toc-flink-forward-virtual-conference">Flink Forward Virtual Conference</a></li> + <li><a href="#others" id="markdown-toc-others">Others</a></li> + </ul> + </li> +</ul> + +</div> + +<h1 id="the-year-so-far-in-flink">The Year (so far) in Flink</h1> + +<h2 id="flink-110-release">Flink 1.10 Release</h2> + +<p>To kick off the new year, the Flink community <a href="https://flink.apache.org/news/2020/02/11/release-1.10.0.html">released Flink 1.10</a> with the record contribution of over 200 engineers. This release introduced significant improvements to the overall performance and stability of Flink jobs, a preview of native Kubernetes integration and advances in Python support (PyFlink). Flink 1.10 also marked the completion of the <a href="https://flink.apache.org/news/2019/08/22/release-1.9 [...] + +<p>The community is now discussing the <a href="http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Releasing-Flink-1-10-1-td38689.html#a38690">release of Flink 1.10.1</a>, covering some outstanding bugs from Flink 1.10.</p> + +<h2 id="stateful-functions-contribution-and-20-release">Stateful Functions Contribution and 2.0 Release</h2> + +<p>Last January, the first version of Stateful Functions (<a href="https://statefun.io/">statefun.io</a>) code was pushed to the <a href="https://github.com/apache/flink-statefun">Flink repository</a>. Stateful Functions started out as an API to build general purpose event-driven applications on Flink, taking advantage of its advanced state management mechanism to cut the “middleman” that usually handles state coordination in such applications (e.g. a database).</p> + +<p>In a <a href="http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Update-on-Flink-Stateful-Functions-what-are-the-next-steps-tp38646.html">recent update</a>, some new features were announced, like multi-language support (including a Python SDK), function unit testing and Stateful Functions’ own flavor of the <a href="https://ci.apache.org/projects/flink/flink-docs-stable/dev/libs/state_processor_api.html">State Processor API</a>. The release cycle will be independen [...] + +<h2 id="building-up-to-flink-111">Building up to Flink 1.11</h2> + +<p>Amidst the usual outpour of discussion threads, JIRA tickets and FLIPs, the community is working full steam on bringing Flink 1.11 to life in the next few months. The feature freeze is currently scheduled for late April, so the release is expected around mid May. +The upcoming release will focus on new features and integrations that broaden the scope of Flink use cases, as well as core runtime enhancements to streamline the operations of complex deployments.</p> + +<p>Some of the plans on the use case side include support for changelog streams in the Table API/SQL (<a href="https://cwiki.apache.org/confluence/display/FLINK/FLIP-105%3A+Support+to+Interpret+and+Emit+Changelog+in+Flink+SQL">FLIP-105</a>), easy streaming data ingestion into Apache Hive (<a href="https://cwiki.apache.org/confluence/display/FLINK/FLIP-115%3A+Filesystem+connector+in+Table">FLIP-115</a>) and support for Pandas DataFrames in PyFlink. On the operational side, the much antici [...] + +<p>Throw into the mix improvements around type systems, the WebUI, metrics reporting and supported formats, this release is bound to keep the community busy. For a complete overview of the ongoing development, check <a href="http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Features-of-Apache-Flink-1-11-td38724.html#a38793">this discussion</a> and follow the weekly updates on the Flink <a href="https://flink.apache.org/community.html#mailing-lists">@community mailing [...] + +<h2 id="new-committers-and-pmc-members">New Committers and PMC Members</h2> + +<p>The Apache Flink community has welcomed <strong>1 PMC (Project Management Committee) Member</strong> and <strong>5 new Committers</strong> since the last update (September 2019):</p> + +<h3 id="new-pmc-members">New PMC Members</h3> +<div class="highlight"><pre><code>Jark Wu +</code></pre></div> + +<h3 id="new-committers">New Committers</h3> +<div class="highlight"><pre><code>Zili Chen, Jingsong Lee, Yu Li, Dian Fu, Zhu Zhu +</code></pre></div> + +<p>Congratulations to all and thank you for your hardworking commitment to Flink!</p> + +<h1 id="the-bigger-picture">The Bigger Picture</h1> + +<h2 id="a-look-into-the-flink-repository">A Look into the Flink Repository</h2> + +<p>In the <a href="https://flink.apache.org/news/2019/09/10/community-update.html">last update</a>, we shared some numbers around Flink releases and mailing list activity. This time, we’re looking into the activity in the Flink repository and how it’s evolving.</p> + +<center> +<img src="/img/blog/2020-03-30-flink-community-update/2020-03-30-flink-community-update_1.png" width="725px" alt="GitHub 1" /> +</center> + +<p>There is a clear upward trend in the number of contributions to the repository, based on the number of commits. This reflects the <strong>fast pace of development</strong> the project is experiencing and also the <strong>successful integration of the China-based Flink contributors</strong> started early last year. To complement these observations, the repository registered a <strong>1.5x increase in the number of individual contributors in 2019</strong>, compared to the previous year.</p> + +<p>But did this increase in capacity produce any other measurable benefits?</p> + +<center> +<img src="/img/blog/2020-03-30-flink-community-update/2020-03-30-flink-community-update_2.png" width="725px" alt="GitHub 2" /> +</center> + +<p>If we look at the average time of Pull Request (PR) “resolution”, it seems like it did: <strong>the average time it takes to close a PR these days has been steadily decreasing</strong> since last year, sitting between 5-6 days for the past few months.</p> + +<p>These are great indicators of the health of Flink as an open source project!</p> + +<h2 id="flink-community-packages">Flink Community Packages</h2> + +<p>If you missed the launch of <a href="http://flink-packages.org/">flink-packages.org</a>, here’s a reminder! Ververica has <a href="https://www.ververica.com/blog/announcing-flink-community-packages">created (and open sourced)</a> a website that showcases the work of the community to push forward the ecosystem surrounding Flink. There, you can explore existing packages (like the Pravega and Pulsar Flink connectors, or the Flink Kubernetes operators developed by Google and Lyft) and als [...] + +<h2 id="flink-engine-room">Flink “Engine Room”</h2> + +<p>The community has recently launched the <a href="https://cwiki.apache.org/confluence/pages/viewrecentblogposts.action?key=FLINK">“Engine Room”</a>, a dedicated space in Flink’s Wiki for knowledge sharing between contributors. The goal of this initiative is to make ongoing development on Flink internals more transparent across different work streams, and also to help new contributors get on board with best practices. The first blogpost is already up and sheds light on the <a href="http [...] + +<h1 id="upcoming-events">Upcoming Events</h1> + +<h2 id="flink-forward-virtual-conference">Flink Forward Virtual Conference</h2> + +<p>The organization of Flink Forward had to make the hard decision of cancelling this year’s event in San Francisco. But all is not lost! <strong>Flink Forward SF will be held online on April 22-24 and you can register (for free)</strong> <a href="https://www.flink-forward.org/sf-2020">here</a>. Join the community for interactive talks and Q&A sessions with core Flink contributors and companies like Splunk, Lyft, Netflix or Google.</p> + +<h2 id="others">Others</h2> + +<p>Events across the globe have come to a halt due to the growing concerns around COVID-19, so this time we’ll leave you with some interesting content to read instead. In addition to this written content, you can also recap last year’s sessions from <a href="https://www.youtube.com/playlist?list=PLDX4T_cnKjD207Aa8b5CsZjc7Z_KRezGz">Flink Forward Berlin</a> and <a href="https://www.youtube.com/playlist?list=PLDX4T_cnKjD3ANoNinSx3Au-poZTHvbF5">Flink Forward China</a>!</p> + +<table class="table table-bordered"> + <thead> + <tr> + <th>Type</th> + <th>Links</th> + </tr> + </thead> + <tbody> + <tr> + <td><span class="glyphicon glyphicon glyphicon-bookmark" aria-hidden="true"></span> Blogposts</td> + <td><ul> + <li><a href="https://medium.com/bird-engineering/replayable-process-functions-in-flink-time-ordering-and-timers-28007a0210e1">Replayable Process Functions: Time, Ordering, and Timers @Bird</a></li> + <li><a href="https://engineering.salesforce.com/application-log-intelligence-performance-insights-at-salesforce-using-flink-92955f30573f">Application Log Intelligence & Performance Insights at Salesforce Using Flink @Salesforce</a></li> + </ul> + <ul> + <li><a href="https://flink.apache.org/news/2020/01/29/state-unlocked-interacting-with-state-in-apache-flink.html">State Unlocked: Interacting with State in Apache Flink</a></li> + <li><a href="https://flink.apache.org/news/2020/01/15/demo-fraud-detection.html">Advanced Flink Application Patterns Vol.1: Case Study of a Fraud Detection System</a></li> + <li><a href="https://flink.apache.org/news/2020/03/24/demo-fraud-detection-2.html">Advanced Flink Application Patterns Vol.2: Dynamic Updates of Application Logic</a></li> + <li><a href="https://flink.apache.org/ecosystem/2020/02/22/apache-beam-how-beam-runs-on-top-of-flink.html">Apache Beam: How Beam Runs on Top of Flink</a></li> + <li><a href="https://flink.apache.org/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></li> + </ul> + </td> + </tr> + <tr> + <td><span class="glyphicon glyphicon-console" aria-hidden="true"></span> Tutorials</td> + <td><ul> + <li><a href="https://medium.com/@zjffdu/flink-on-zeppelin-part-3-streaming-5fca1e16754">Flink on Zeppelin — (Part 3). Streaming</a></li> + <li><a href="https://aws.amazon.com/blogs/big-data/streaming-etl-with-apache-flink-and-amazon-kinesis-data-analytics">Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics</a></li> + <li><a href="https://flink.apache.org/news/2020/02/20/ddl.html">No Java Required: Configuring Sources and Sinks in SQL</a></li> + <li><a href="https://flink.apache.org/news/2020/02/07/a-guide-for-unit-testing-in-apache-flink.html">A Guide for Unit Testing in Apache Flink</a></li> + </ul> + </td> + </tr> + </tbody> +</table> + +<p>If you’d like to keep a closer eye on what’s happening in the community, subscribe to the Flink <a href="https://flink.apache.org/community.html#mailing-lists">@community mailing list</a> to get fine-grained weekly updates, upcoming event announcements and more.</p> + + </article> + </div> + + <div class="row"> + <div id="disqus_thread"></div> + <script type="text/javascript"> + /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */ + var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname + + /* * * DON'T EDIT BELOW THIS LINE * * */ + (function() { + var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true; + dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js'; + (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq); + })(); + </script> + </div> + </div> +</div> + </div> + </div> + + <hr /> + + <div class="row"> + <div class="footer text-center col-sm-12"> + <p>Copyright © 2014-2019 <a href="http://apache.org">The Apache Software Foundation</a>. All Rights Reserved.</p> + <p>Apache Flink, Flink®, Apache®, the squirrel logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation.</p> + <p><a href="/privacy-policy.html">Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p> + </div> + </div> + </div><!-- /.container --> + + <!-- Include all compiled plugins (below), or include individual files as needed --> + <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/js/bootstrap.min.js"></script> + <script src="https://cdnjs.cloudflare.com/ajax/libs/jquery.matchHeight/0.7.0/jquery.matchHeight-min.js"></script> + <script src="/js/codetabs.js"></script> + <script src="/js/stickysidebar.js"></script> + + <!-- Google Analytics --> + <script> + (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ + (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), + m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) + })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); + + ga('create', 'UA-52545728-1', 'auto'); + ga('send', 'pageview'); + </script> + </body> +</html> diff --git a/content/zh/index.html b/content/zh/index.html index 2e19403..0e1b963 100644 --- a/content/zh/index.html +++ b/content/zh/index.html @@ -554,6 +554,9 @@ <dl> + <dt> <a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></dt> + <dd>While things slow down around us, the Apache Flink community is privileged to remain as active as ever. This blogpost combs through the past few months to give you an update on the state of things in Flink — from core releases to Stateful Functions; from some good old community stats to a new development blog.</dd> + <dt> <a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></dt> <dd><p>In this blog post, you will learn our motivation behind the Flink-Hive integration, and how Flink 1.10 can help modernize your data warehouse.</p> @@ -567,11 +570,6 @@ <dt> <a href="/news/2020/02/20/ddl.html">No Java Required: Configuring Sources and Sinks in SQL</a></dt> <dd>This post discusses the efforts of the Flink community as they relate to end to end applications with SQL in Apache Flink.</dd> - - <dt> <a href="/news/2020/02/11/release-1.10.0.html">Apache Flink 1.10.0 Release Announcement</a></dt> - <dd><p>The Apache Flink community is excited to hit the double digits and announce the release of Flink 1.10.0! As a result of the biggest community effort to date, with over 1.2k issues implemented and more than 200 contributors, this release introduces significant improvements to the overall performance and stability of Flink jobs, a preview of native Kubernetes integration and great advances in Python support (PyFlink).</p> - -</dd> </dl>