This is an automated email from the ASF dual-hosted git repository. dannycranmer pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/flink-web.git
The following commit(s) were added to refs/heads/asf-site by this push: new 335155f19 Rebuild website 335155f19 is described below commit 335155f1965d769ae63e45af2cf30461af5e0e73 Author: Danny Cranmer <dannycran...@apache.org> AuthorDate: Fri Aug 4 16:27:35 2023 +0100 Rebuild website --- .../index.html | 359 +++++++++++---------- content/en/sitemap.xml | 7 +- content/index.html | 13 +- content/index.xml | 12 +- .../news/2023/08/04/externalized-connectors.html | 10 + content/posts/index.html | 57 ++-- content/posts/index.xml | 12 +- content/posts/page/10/index.html | 61 ++-- content/posts/page/11/index.html | 57 ++-- content/posts/page/12/index.html | 62 ++-- content/posts/page/13/index.html | 66 ++-- content/posts/page/14/index.html | 60 ++-- content/posts/page/15/index.html | 55 ++-- content/posts/page/16/index.html | 54 ++-- content/posts/page/17/index.html | 66 ++-- content/posts/page/18/index.html | 64 ++-- content/posts/page/19/index.html | 50 +-- content/posts/page/2/index.html | 57 ++-- content/posts/page/20/index.html | 49 +-- content/posts/page/21/index.html | 53 +-- content/posts/page/22/index.html | 59 ++-- content/posts/page/{22 => 23}/index.html | 193 +---------- content/posts/page/3/index.html | 59 ++-- content/posts/page/4/index.html | 64 ++-- content/posts/page/5/index.html | 71 ++-- content/posts/page/6/index.html | 67 ++-- content/posts/page/7/index.html | 58 ++-- content/posts/page/8/index.html | 57 ++-- content/posts/page/9/index.html | 61 ++-- content/sitemap.xml | 2 +- content/zh/index.html | 15 +- 31 files changed, 988 insertions(+), 942 deletions(-) diff --git a/content/index.html b/content/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/index.html similarity index 63% copy from content/index.html copy to content/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/index.html index 320b3303c..438253627 100644 --- a/content/index.html +++ b/content/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/index.html @@ -6,19 +6,20 @@ <meta name="generator" content="Hugo 0.113.0"> <meta charset="UTF-8"> <meta name="viewport" content="width=device-width, initial-scale=1.0"> -<meta name="description" content="Apache Flink® — Stateful Computations over Data Streams # All streaming use cases Event-driven Applications Stream & Batch Analytics Data Pipelines & ETL Learn more Guaranteed correctness Exactly-once state consistency Event-time processing Sophisticated late data handling Learn more Layered APIs SQL on Stream & Batch Data DataStream API & DataSet API ProcessFunction (Time & State) Learn more Operational Focus Flexible deployment High [...] -<meta name="theme-color" content="#FFFFFF"><meta property="og:title" content="Apache Flink® — Stateful Computations over Data Streams" /> -<meta property="og:description" content="" /> -<meta property="og:type" content="website" /> -<meta property="og:url" content="https://flink.apache.org/" /> -<title>Apache Flink® — Stateful Computations over Data Streams | Apache Flink</title> +<meta name="description" content="New connectors # We’re excited to announce that Apache Flink now supports three new connectors: Amazon DynamoDB, MongoDB and OpenSearch! The connectors are available for both the DataStream and Table/SQL APIs. +Amazon DynamoDB - This connector includes a sink that provides at-least-once delivery guarantees. MongoDB connector - This connector includes a source and sink that provide at-least-once guarantees. OpenSearch sink - This connector includes a sink that provides at-least-once guarantees."> +<meta name="theme-color" content="#FFFFFF"><meta property="og:title" content="Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization" /> +<meta property="og:description" content="New connectors # We’re excited to announce that Apache Flink now supports three new connectors: Amazon DynamoDB, MongoDB and OpenSearch! The connectors are available for both the DataStream and Table/SQL APIs. +Amazon DynamoDB - This connector includes a sink that provides at-least-once delivery guarantees. MongoDB connector - This connector includes a source and sink that provide at-least-once guarantees. OpenSearch sink - This connector includes a sink that provides at-least-once guarantees." /> +<meta property="og:type" content="article" /> +<meta property="og:url" content="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/" /><meta property="article:section" content="posts" /> +<meta property="article:published_time" content="2023-08-04T12:00:00+00:00" /> +<meta property="article:modified_time" content="2023-08-04T12:00:00+00:00" /> +<title>Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization | Apache Flink</title> <link rel="manifest" href="/manifest.json"> <link rel="icon" href="/favicon.png" type="image/x-icon"> -<link rel="alternate" hreflang="zh" href="https://flink.apache.org/zh/" title="Apache Flink Documentation"> - <link rel="stylesheet" href="/book.min.e3b33391dbc1f4b2cc47778e2f4b86c744ded3ccc82fdfb6f08caf91d8607f9a.css" integrity="sha256-47MzkdvB9LLMR3eOL0uGx0Te08zIL9+28Iyvkdhgf5o="> <script defer src="/en.search.min.8592fd2e43835d2ef6fab8eb9b8969ee6ad1bdb888a636e37e28032f8bd9887d.js" integrity="sha256-hZL9LkODXS72+rjrm4lp7mrRvbiIpjbjfigDL4vZiH0="></script> -<link rel="alternate" type="application/rss+xml" href="https://flink.apache.org/index.xml" title="Apache Flink" /> <!-- Made with Book Theme https://github.com/alex-shpak/hugo-book @@ -29,7 +30,7 @@ https://github.com/alex-shpak/hugo-book <link rel="stylesheet" type="text/css" href="/font-awesome/css/font-awesome.min.css"> <script src="/js/anchor.min.js"></script> <script src="/js/flink.js"></script> -<link rel="canonical" href="https://flink.apache.org/"> +<link rel="canonical" href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/"> <script> @@ -834,8 +835,6 @@ https://github.com/alex-shpak/hugo-book - - @@ -868,15 +867,44 @@ https://github.com/alex-shpak/hugo-book <img src="/svg/menu.svg" class="book-icon" alt="Menu" /> </label> - <strong>Apache Flink® — Stateful Computations over Data Streams</strong> + <strong>Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</strong> <label for="toc-control"> + <img src="/svg/toc.svg" class="book-icon" alt="Table of Contents" /> + </label> </div> + <aside class="hidden clearfix"> + + + +<nav id="TableOfContents"><h3>On This Page <button class="toc" onclick="collapseToc()"><i class="fa fa-compress" aria-hidden="true"></i></button></h3> + <ul> + <li> + <ul> + <li><a href="#new-connectors">New connectors</a> + <ul> + <li><a href="#list-of-contributors">List of Contributors</a></li> + </ul> + </li> + <li><a href="#externalized-connectors">Externalized connectors</a> + <ul> + <li><a href="#versioning">Versioning</a></li> + <li><a href="#contributing">Contributing</a></li> + </ul> + </li> + </ul> + </li> + </ul> +</nav> + + + </aside> + </header> @@ -886,181 +914,115 @@ https://github.com/alex-shpak/hugo-book - <article class="markdown"><!-- -Licensed to the Apache Software Foundation (ASF) under one -or more contributor license agreements. See the NOTICE file -distributed with this work for additional information -regarding copyright ownership. The ASF licenses this file -to you under the Apache License, Version 2.0 (the -"License"); you may not use this file except in compliance -with the License. You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - -Unless required by applicable law or agreed to in writing, -software distributed under the License is distributed on an -"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY -KIND, either express or implied. See the License for the -specific language governing permissions and limitations -under the License. ---> -<h1 id="apache-flinksupsup--stateful-computations-over-data-streams"> - Apache Flink<sup>®</sup> — Stateful Computations over Data Streams - <a class="anchor" href="#apache-flinksupsup--stateful-computations-over-data-streams">#</a> -</h1> - -<img - src="https://flink.apache.org/img/flink-home-graphic.png" - alt="" - width="800px" - style="display:block;margin-left:auto;margin-right:auto" -> -<div class="book-columns flex flex-wrap"> - - <div class="flex-even markdown-inner"> - <!-- begin columns block --> -<div class="panel panel-default"> - <div class="panel-heading"> - <span class="glyphicon glyphicon-th"></span> <b>All streaming use cases</b> - </div> - <div class="panel-body"> - <ul style="font-size: small;"> - <li>Event-driven Applications</li> - <li>Stream & Batch Analytics</li> - <li>Data Pipelines & ETL</li> - </ul> - <a href=/use-cases/>Learn more</a> - </div> -</div> - - </div> - - <div class="flex-even markdown-inner"> - <!-- magic separator, between columns --> -<div class="panel panel-default"> - <div class="panel-heading"> - <span class="glyphicon glyphicon-ok"></span> <b>Guaranteed correctness</b> - </div> - <div class="panel-body"> - <ul style="font-size: small;"> - <li>Exactly-once state consistency</li> - <li>Event-time processing</li> - <li>Sophisticated late data handling</li> - </ul> - <a href="/what-is-flink/flink-applications/#building-blocks-for-streaming-applications">Learn more</a> - </div> -</div> +<article class="markdown"> + <h1> + <a href="/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </h1> + + August 4, 2023 - - </div> - - <div class="flex-even markdown-inner"> - <!-- magic separator, between columns --> -<div class="panel panel-default"> - <div class="panel-heading"> - <span class="glyphicon glyphicon glyphicon-sort-by-attributes"></span> <b>Layered APIs</b> - </div> - <div class="panel-body"> - <ul style="font-size: small;"> - <li>SQL on Stream & Batch Data</li> - <li>DataStream API & DataSet API</li> - <li>ProcessFunction (Time & State)</li> - </ul> - <a href="/what-is-flink/flink-applications/#layered-apis">Learn more</a> - </div> -</div> - </div> - -</div> -<div class="book-columns flex flex-wrap"> - - <div class="flex-even markdown-inner"> - <!-- begin columns block --> -<div class="panel panel-default"> - <div class="panel-heading"> - <span class="glyphicon glyphicon-dashboard"></span> <b>Operational Focus</b> - </div> - <div class="panel-body"> - <ul style="font-size: small;"> - <li>Flexible deployment</li> - <li>High-availability setup</li> - <li>Savepoints</li> - </ul> - <a href="/what-is-flink/flink-operations/">Learn more</a> - </div> -</div> + Elphas Toringepi - </div> + <a href="https://twitter.com/elphastori">(@elphastori)</a> - <div class="flex-even markdown-inner"> - <!-- magic separator, between columns --> -<div class="panel panel-default"> - <div class="panel-heading"> - <span class="glyphicon glyphicon-fullscreen"></span> <b>Scales to any use case</b> - </div> - <div class="panel-body"> - <ul style="font-size: small;"> - <li>Scale-out architecture</li> - <li>Support for very large state</li> - <li>Incremental checkpointing</li> - </ul> - <a href="/what-is-flink/flink-architecture/#run-applications-at-any-scale">Learn more</a> - </div> -</div> - </div> - - <div class="flex-even markdown-inner"> - <!-- magic separator, between columns --> -<div class="panel panel-default"> - <div class="panel-heading"> - <span class="glyphicon glyphicon-flash"></span> <b>Excellent Performance</b> - </div> - <div class="panel-body"> - <ul style="font-size: small;"> - <li>Low latency</li> - <li>High throughput</li> - <li>In-Memory computing</li> - </ul> - <a href="/what-is-flink/flink-architecture/#leverage-in-memory-performance">Learn more</a> - </div> -</div> - </div> - -</div> -<h2 id="latest-blog-posts"> - Latest Blog Posts - <a class="anchor" href="#latest-blog-posts">#</a> + <p><h2 id="new-connectors"> + New connectors + <a class="anchor" href="#new-connectors">#</a> </h2> - - - - - <a href="/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a><br /> - Apache Flink received the 2023 SIGMOD Systems Award, which is awarded to an individual or set of individuals to recognize the development of a software or hardware system whose technical contributions have had significant impact on the theory or practice of large-scale data management systems: -The 2023 SIGMOD Systems Award goes to Apache Flink: -“Apache Flink greatly expanded the use of stream data-processing.” -Winning of SIGMOD Systems Award indicates the high recognition of Flink’s technological advancement and industry influence from academia. - <br /><br /> - - <a href="/2023/05/25/apache-flink-1.16.2-release-announcement/">Apache Flink 1.16.2 Release Announcement</a><br /> - The Apache Flink Community is pleased to announce the second bug fix release of the Flink 1.16 series. -This release includes 104 bug fixes, vulnerability fixes, and minor improvements for Flink 1.16. Below you will find a list of all bugfixes and improvements (excluding improvements to the build infrastructure and build stability). For a complete list of all changes see: JIRA. -We highly recommend all users upgrade to Flink 1.16.2. - <br /><br /> - - <a href="/2023/05/25/apache-flink-1.17.1-release-announcement/">Apache Flink 1.17.1 Release Announcement</a><br /> - The Apache Flink Community is pleased to announce the first bug fix release of the Flink 1.17 series. -This release includes 75 bug fixes, vulnerability fixes, and minor improvements for Flink 1.17. Below you will find a list of all bugfixes and improvements (excluding improvements to the build infrastructure and build stability). For a complete list of all changes see: JIRA. -We highly recommend all users upgrade to Flink 1.17.1. - <br /><br /> - - - - +<p>We’re excited to announce that Apache Flink now supports three new connectors: <a href="https://aws.amazon.com/dynamodb">Amazon DynamoDB</a>, <a href="https://www.mongodb.com/">MongoDB</a> and <a href="https://opensearch.org/">OpenSearch</a>! The connectors are available for both the <a href="https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/overview/">DataStream</a> and <a href="https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/t [...] +<ul> +<li><strong><a href="https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/dynamodb/">Amazon DynamoDB</a></strong> - This connector includes a sink that provides at-least-once delivery guarantees.</li> +<li><strong><a href="https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/mongodb/">MongoDB connector</a></strong> - This connector includes a source and sink that provide at-least-once guarantees.</li> +<li><strong><a href="https://github.com/apache/flink-connector-opensearch/blob/main/docs/content/docs/connectors/datastream/opensearch.md">OpenSearch sink</a></strong> - This connector includes a sink that provides at-least-once guarantees.</li> +</ul> +<table> +<thead> +<tr> +<th>Connector</th> +<th>Date Released</th> +<th>Supported Flink Versions</th> +</tr> +</thead> +<tbody> +<tr> +<td>Amazon DynamoDB sink</td> +<td>2022-12-02</td> +<td>1.15+</td> +</tr> +<tr> +<td>MongoDB connector</td> +<td>2023-03-31</td> +<td>1.16+</td> +</tr> +<tr> +<td>OpenSearch sink</td> +<td>2022-12-21</td> +<td>1.16+</td> +</tr> +</tbody> +</table> +<h3 id="list-of-contributors"> + List of Contributors + <a class="anchor" href="#list-of-contributors">#</a> +</h3> +<p>The Apache Flink community would like to express gratitude to all the new connector contributors:</p> +<p>Andriy Redko, Chesnay Schepler, Danny Cranmer, darenwkt, Hong Liang Teoh, Jiabao Sun, Leonid Ilyevsky, Martijn Visser, nir.tsruya, Sergey Nuyanzin, Weijie Guo, Yuri Gusev, Yuxin Tan</p> +<h2 id="externalized-connectors"> + Externalized connectors + <a class="anchor" href="#externalized-connectors">#</a> +</h2> +<p>The community has externalized connectors from <a href="https://github.com/apache/flink">Flink’s main repository</a>. This was driven to realise the following benefits:</p> +<ul> +<li><strong>Faster releases of connectors:</strong> New features can be added more quickly, bugs can be fixed immediately, and we can have faster security patches in case of direct or indirect (through dependencies) security flaws.</li> +<li><strong>Adding newer connector features to older Flink versions:</strong> By having stable connector APIs, the same connector artifact may be used with different Flink versions. Thus, new features can also immediately be used with older Flink versions.</li> +<li><strong>More activity and contributions around connectors:</strong> By easing the contribution and development process around connectors, we will see faster development and also more connectors.</li> +<li><strong>Documentation:</strong> Standardized documentation and user experience for the connectors, regardless of where they are maintained.</li> +<li><strong>A faster Flink CI:</strong> By not needing to build and test connectors, the Flink CI pipeline will be faster and Flink developers will experience fewer build instabilities (which mostly come from connectors). That should speed up Flink development.</li> +</ul> +<p>The following connectors have been moved to individual repositories:</p> +<ul> +<li><a href="https://github.com/apache/flink-connector-kafka">Kafka / Upsert-Kafka</a></li> +<li><a href="https://github.com/apache/flink-connector-cassandra">Cassandra</a></li> +<li><a href="https://github.com/apache/flink-connector-elasticsearch/">Elasticsearch</a></li> +<li><a href="https://github.com/apache/flink-connector-mongodb"><strong>MongoDB</strong></a></li> +<li><strong><a href="https://github.com/apache/flink-connector-opensearch">OpenSearch</a></strong></li> +<li><a href="https://github.com/apache/flink-connector-rabbitmq">RabbitMQ</a></li> +<li><a href="https://github.com/apache/flink-connector-gcp-pubsub">Google Cloud PubSub</a></li> +<li><a href="https://github.com/apache/flink-connector-pulsar/">Pulsar</a></li> +<li><a href="https://github.com/apache/flink-connector-jdbc">JDBC</a></li> +<li><a href="https://github.com/apache/flink-connector-hbase">HBase</a></li> +<li><a href="https://github.com/apache/flink-connector-hive">Hive</a></li> +<li><a href="https://github.com/apache/flink-connector-aws">AWS connectors</a>: +<ul> +<li>Firehose</li> +<li>Kinesis</li> +<li><strong>DynamoDB</strong></li> +</ul> +</li> +</ul> +<h3 id="versioning"> + Versioning + <a class="anchor" href="#versioning">#</a> +</h3> +<p>Connectors continue to use the same Maven dependency <code>groupId</code> and <code>artificatId</code>, however, the JAR artifact <code>version</code> has changed and now uses the format, <code><major>.<minor>.<patch>-<flink-major>.<flink-minor></code>. For example, to use the DynamoDB connector for Flink 1.17, add the following dependency to your project:</p> +<pre tabindex="0"><code><dependency> + <groupId>org.apache.flink</groupId> + <artifactId>flink-connector-dynamodb</artifactId> + <version>4.1.0-1.17</version> +</dependency> +</code></pre><p>You can find the maven dependency for a connector in the <a href="https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/datastream/overview">Flink connectors documentation</a> for a specific Flink version. Use the <a href="https://flink.apache.org/downloads">Flink Downloads page</a> to verify which version your connector is compatible with.</p> +<h3 id="contributing"> + Contributing + <a class="anchor" href="#contributing">#</a> +</h3> +<p>Similarly, when creating JIRAs to report issues or to contribute to externalized connectors, the <code>Affects Version/s</code> and <code>Fix Version/s</code> fields should now use the connector version instead of a Flink version. The format should be <code><connector-name>-<major>.<minor>.<patch></code> for example, use <code>opensearch-1.1.0</code> for the OpenSearch connector. All other fields in the JIRA like <code>Component/s</code> remain the same.</p> +<p>For more information on how to contribute to externalized connectors, see the <a href="https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development">Externalized Connector development wiki</a>.</p> +</p> </article> @@ -1071,6 +1033,13 @@ We highly recommend all users upgrade to Flink 1.17.1. + + +<a href="https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications">Want to contribute translation?</a> +<br><br> +<a href="//github.com/apache/flink-web/edit/asf-site/docs/content/posts/2023-08-04-externalized-connectors.md" style="color:black"><i class="fa fa-edit fa-fw"></i>Edit This Page</a> + + </footer> @@ -1087,6 +1056,38 @@ We highly recommend all users upgrade to Flink 1.17.1. </div> + <aside class="book-toc"> + + + +<nav id="TableOfContents"><h3>On This Page <button class="toc" onclick="collapseToc()"><i class="fa fa-compress" aria-hidden="true"></i></button></h3> + <ul> + <li> + <ul> + <li><a href="#new-connectors">New connectors</a> + <ul> + <li><a href="#list-of-contributors">List of Contributors</a></li> + </ul> + </li> + <li><a href="#externalized-connectors">Externalized connectors</a> + <ul> + <li><a href="#versioning">Versioning</a></li> + <li><a href="#contributing">Contributing</a></li> + </ul> + </li> + </ul> + </li> + </ul> +</nav> + + + </aside> + <aside class="expand-toc"> + <button class="toc" onclick="expandToc()"> + <i class="fa fa-expand" aria-hidden="true"></i> + </button> + </aside> + </main> diff --git a/content/en/sitemap.xml b/content/en/sitemap.xml index 46ad12b51..4a5ca0824 100644 --- a/content/en/sitemap.xml +++ b/content/en/sitemap.xml @@ -363,7 +363,7 @@ /> </url><url> <loc>https://flink.apache.org/posts/</loc> - <lastmod>2023-07-03T12:00:00+00:00</lastmod> + <lastmod>2023-08-04T12:00:00+00:00</lastmod> </url><url> <loc>https://flink.apache.org/flink-packages/</loc> <xhtml:link @@ -508,9 +508,12 @@ hreflang="en" href="https://flink.apache.org/how-to-contribute/improve-website/" /> + </url><url> + <loc>https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/</loc> + <lastmod>2023-08-04T12:00:00+00:00</lastmod> </url><url> <loc>https://flink.apache.org/</loc> - <lastmod>2023-07-03T12:00:00+00:00</lastmod> + <lastmod>2023-08-04T12:00:00+00:00</lastmod> <xhtml:link rel="alternate" hreflang="zh" diff --git a/content/index.html b/content/index.html index 320b3303c..5d3a93dc5 100644 --- a/content/index.html +++ b/content/index.html @@ -6,7 +6,7 @@ <meta name="generator" content="Hugo 0.113.0"> <meta charset="UTF-8"> <meta name="viewport" content="width=device-width, initial-scale=1.0"> -<meta name="description" content="Apache Flink® — Stateful Computations over Data Streams # All streaming use cases Event-driven Applications Stream & Batch Analytics Data Pipelines & ETL Learn more Guaranteed correctness Exactly-once state consistency Event-time processing Sophisticated late data handling Learn more Layered APIs SQL on Stream & Batch Data DataStream API & DataSet API ProcessFunction (Time & State) Learn more Operational Focus Flexible deployment High [...] +<meta name="description" content="Apache Flink® — Stateful Computations over Data Streams # All streaming use cases Event-driven Applications Stream & Batch Analytics Data Pipelines & ETL Learn more Guaranteed correctness Exactly-once state consistency Event-time processing Sophisticated late data handling Learn more Layered APIs SQL on Stream & Batch Data DataStream API & DataSet API ProcessFunction (Time & State) Learn more Operational Focus Flexible deployment High [...] <meta name="theme-color" content="#FFFFFF"><meta property="og:title" content="Apache Flink® — Stateful Computations over Data Streams" /> <meta property="og:description" content="" /> <meta property="og:type" content="website" /> @@ -1039,6 +1039,11 @@ under the License. + <a href="/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a><br /> + New connectors # We’re excited to announce that Apache Flink now supports three new connectors: Amazon DynamoDB, MongoDB and OpenSearch! The connectors are available for both the DataStream and Table/SQL APIs. +Amazon DynamoDB - This connector includes a sink that provides at-least-once delivery guarantees. MongoDB connector - This connector includes a source and sink that provide at-least-once guarantees. OpenSearch sink - This connector includes a sink that provides at-least-once guarantees. + <br /><br /> + <a href="/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a><br /> Apache Flink received the 2023 SIGMOD Systems Award, which is awarded to an individual or set of individuals to recognize the development of a software or hardware system whose technical contributions have had significant impact on the theory or practice of large-scale data management systems: The 2023 SIGMOD Systems Award goes to Apache Flink: @@ -1052,12 +1057,6 @@ This release includes 104 bug fixes, vulnerability fixes, and minor improvements We highly recommend all users upgrade to Flink 1.16.2. <br /><br /> - <a href="/2023/05/25/apache-flink-1.17.1-release-announcement/">Apache Flink 1.17.1 Release Announcement</a><br /> - The Apache Flink Community is pleased to announce the first bug fix release of the Flink 1.17 series. -This release includes 75 bug fixes, vulnerability fixes, and minor improvements for Flink 1.17. Below you will find a list of all bugfixes and improvements (excluding improvements to the build infrastructure and build stability). For a complete list of all changes see: JIRA. -We highly recommend all users upgrade to Flink 1.17.1. - <br /><br /> - diff --git a/content/index.xml b/content/index.xml index e50f0b370..87b2ac1df 100644 --- a/content/index.xml +++ b/content/index.xml @@ -6,7 +6,7 @@ <description>Recent content in Apache Flink® — Stateful Computations over Data Streams on Apache Flink</description> <generator>Hugo -- gohugo.io</generator> <language>en</language> - <lastBuildDate>Mon, 03 Jul 2023 12:00:00 +0000</lastBuildDate><atom:link href="https://flink.apache.org/index.xml" rel="self" type="application/rss+xml" /> + <lastBuildDate>Fri, 04 Aug 2023 12:00:00 +0000</lastBuildDate><atom:link href="https://flink.apache.org/index.xml" rel="self" type="application/rss+xml" /> <item> <title>Architecture</title> <link>https://flink.apache.org/what-is-flink/flink-architecture/</link> @@ -371,6 +371,16 @@ Informing visitors about Apache Flink and its features. Encouraging visitors to Obtain the website sources # The website of Apache Flink is hosted in a dedicated git repository which is mirrored to GitHub at https://github.</description> </item> + <item> + <title>Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</title> + <link>https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/</link> + <pubDate>Fri, 04 Aug 2023 12:00:00 +0000</pubDate> + + <guid>https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/</guid> + <description>New connectors # We&rsquo;re excited to announce that Apache Flink now supports three new connectors: Amazon DynamoDB, MongoDB and OpenSearch! The connectors are available for both the DataStream and Table/SQL APIs. +Amazon DynamoDB - This connector includes a sink that provides at-least-once delivery guarantees. MongoDB connector - This connector includes a source and sink that provide at-least-once guarantees. OpenSearch sink - This connector includes a sink that provides at-least-once guarantees.</description> + </item> + <item> <title>SIGMOD Systems Award for Apache Flink</title> <link>https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/</link> diff --git a/content/news/2023/08/04/externalized-connectors.html b/content/news/2023/08/04/externalized-connectors.html new file mode 100644 index 000000000..3d8d999e8 --- /dev/null +++ b/content/news/2023/08/04/externalized-connectors.html @@ -0,0 +1,10 @@ +<!DOCTYPE html> +<html lang="en"> + <head> + <title>https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/</title> + <link rel="canonical" href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/"> + <meta name="robots" content="noindex"> + <meta charset="utf-8"> + <meta http-equiv="refresh" content="0; url=https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/"> + </head> +</html> diff --git a/content/posts/index.html b/content/posts/index.html index e7b4573bc..e683fdc3e 100644 --- a/content/posts/index.html +++ b/content/posts/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,30 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </h3> + + August 4, 2023 - + + + + Elphas Toringepi + + <a href="https://twitter.com/elphastori">(@elphastori)</a> + + + + + <p>New connectors # We’re excited to announce that Apache Flink now supports three new connectors: Amazon DynamoDB, MongoDB and OpenSearch! The connectors are available for both the DataStream and Table/SQL APIs. +Amazon DynamoDB - This connector includes a sink that provides at-least-once delivery guarantees. MongoDB connector - This connector includes a source and sink that provide at-least-once guarantees. OpenSearch sink - This connector includes a sink that provides at-least-once guarantees. + <a href="/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">...</a> + + </p> + <a href="/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> @@ -1990,29 +2018,6 @@ With the addition of these algorithms, we believe Flink ML library is ready for <a href="/2023/03/23/announcing-the-release-of-apache-flink-1.17/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2023/03/15/apache-flink-1.15.4-release-announcement/">Apache Flink 1.15.4 Release Announcement</a> - </h3> - - March 15, 2023 - - - - - Danny Cranmer - - - - - <p>The Apache Flink Community is pleased to announce the fourth bug fix release of the Flink 1.15 series. -This release includes 53 bug fixes, vulnerability fixes, and minor improvements for Flink 1.15. Below you will find a list of all bugfixes and improvements (excluding improvements to the build infrastructure and build stability). For a complete list of all changes see: JIRA. -We highly recommend all users upgrade to Flink 1.15.4. - <a href="/2023/03/15/apache-flink-1.15.4-release-announcement/">...</a> - - </p> - <a href="/2023/03/15/apache-flink-1.15.4-release-announcement/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2041,7 +2046,7 @@ We highly recommend all users upgrade to Flink 1.15.4. <a href="/posts/page/2/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2070,6 +2075,10 @@ We highly recommend all users upgrade to Flink 1.15.4. <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/index.xml b/content/posts/index.xml index c2976a59f..c155c5296 100644 --- a/content/posts/index.xml +++ b/content/posts/index.xml @@ -6,7 +6,17 @@ <description>Recent content in Flink Blog on Apache Flink</description> <generator>Hugo -- gohugo.io</generator> <language>en</language> - <lastBuildDate>Mon, 03 Jul 2023 12:00:00 +0000</lastBuildDate><atom:link href="https://flink.apache.org/posts/index.xml" rel="self" type="application/rss+xml" /> + <lastBuildDate>Fri, 04 Aug 2023 12:00:00 +0000</lastBuildDate><atom:link href="https://flink.apache.org/posts/index.xml" rel="self" type="application/rss+xml" /> + <item> + <title>Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</title> + <link>https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/</link> + <pubDate>Fri, 04 Aug 2023 12:00:00 +0000</pubDate> + + <guid>https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/</guid> + <description>New connectors # We&rsquo;re excited to announce that Apache Flink now supports three new connectors: Amazon DynamoDB, MongoDB and OpenSearch! The connectors are available for both the DataStream and Table/SQL APIs. +Amazon DynamoDB - This connector includes a sink that provides at-least-once delivery guarantees. MongoDB connector - This connector includes a source and sink that provide at-least-once guarantees. OpenSearch sink - This connector includes a sink that provides at-least-once guarantees.</description> + </item> + <item> <title>SIGMOD Systems Award for Apache Flink</title> <link>https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/</link> diff --git a/content/posts/page/10/index.html b/content/posts/page/10/index.html index 8a142980c..d15639255 100644 --- a/content/posts/page/10/index.html +++ b/content/posts/page/10/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,33 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2020/09/17/apache-flink-1.11.2-released/">Apache Flink 1.11.2 Released</a> + </h3> + + September 17, 2020 - + + + + Zhu Zhu + + <a href="https://twitter.com/zhuzhv">(@zhuzhv)</a> + + + + + <p>The Apache Flink community released the second bugfix version of the Apache Flink 1.11 series. +This release includes 96 fixes and minor improvements for Flink 1.11.1. The list below includes a detailed list of all fixes and improvements. +We highly recommend all users to upgrade to Flink 1.11.2. +Updated Maven dependencies: +<dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.11.2</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.11.2</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <vers [...] + <a href="/2020/09/17/apache-flink-1.11.2-released/">...</a> + + </p> + <a href="/2020/09/17/apache-flink-1.11.2-released/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2020/09/04/flink-community-update-august20/">Flink Community Update - August'20</a> @@ -1996,30 +2027,6 @@ The Past Month in Flink # Flink Releases # Flink 1.11 # A couple of weeks ago, F <a href="/2020/07/29/flink-community-update-july20/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2020/07/28/flink-sql-demo-building-an-end-to-end-streaming-application/">Flink SQL Demo: Building an End-to-End Streaming Application</a> - </h3> - - July 28, 2020 - - - - - Jark Wu - - <a href="https://twitter.com/JarkWu">(@JarkWu)</a> - - - - - <p>Apache Flink 1.11 has released many exciting new features, including many developments in Flink SQL which is evolving at a fast pace. This article takes a closer look at how to quickly build streaming applications with Flink SQL from a practical point of view. -In the following sections, we describe how to integrate Kafka, MySQL, Elasticsearch, and Kibana with Flink SQL to analyze e-commerce user behavior in real-time. All exercises in this blogpost are performed in the Flink SQL CLI, and the entire process uses standard SQL syntax, without a single line of Java/Scala code or IDE installation. - <a href="/2020/07/28/flink-sql-demo-building-an-end-to-end-streaming-application/">...</a> - - </p> - <a href="/2020/07/28/flink-sql-demo-building-an-end-to-end-streaming-application/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2048,7 +2055,7 @@ In the following sections, we describe how to integrate Kafka, MySQL, Elasticsea <a href="/posts/page/11/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2077,6 +2084,10 @@ In the following sections, we describe how to integrate Kafka, MySQL, Elasticsea <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/11/index.html b/content/posts/page/11/index.html index b8c5d3560..75098805a 100644 --- a/content/posts/page/11/index.html +++ b/content/posts/page/11/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,30 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2020/07/28/flink-sql-demo-building-an-end-to-end-streaming-application/">Flink SQL Demo: Building an End-to-End Streaming Application</a> + </h3> + + July 28, 2020 - + + + + Jark Wu + + <a href="https://twitter.com/JarkWu">(@JarkWu)</a> + + + + + <p>Apache Flink 1.11 has released many exciting new features, including many developments in Flink SQL which is evolving at a fast pace. This article takes a closer look at how to quickly build streaming applications with Flink SQL from a practical point of view. +In the following sections, we describe how to integrate Kafka, MySQL, Elasticsearch, and Kibana with Flink SQL to analyze e-commerce user behavior in real-time. All exercises in this blogpost are performed in the Flink SQL CLI, and the entire process uses standard SQL syntax, without a single line of Java/Scala code or IDE installation. + <a href="/2020/07/28/flink-sql-demo-building-an-end-to-end-streaming-application/">...</a> + + </p> + <a href="/2020/07/28/flink-sql-demo-building-an-end-to-end-streaming-application/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2020/07/23/sharing-is-caring-catalogs-in-flink-sql/">Sharing is caring - Catalogs in Flink SQL</a> @@ -1994,29 +2022,6 @@ Note FLINK-16684 changed the builders of the StreamingFileSink to make them comp <a href="/2020/05/12/apache-flink-1.10.1-released/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2020/05/06/flink-community-update-may20/">Flink Community Update - May'20</a> - </h3> - - May 6, 2020 - - - - - Marta Paes - - <a href="https://twitter.com/morsapaes">(@morsapaes)</a> - - - - - <p>Can you smell it? It’s release month! It took a while, but now that we’re all caught up with the past, the Community Update is here to stay. This time around, we’re warming up for Flink 1.11 and peeping back to the month of April in the Flink community — with the release of Stateful Functions 2.0, a new self-paced Flink training and some efforts to improve the Flink documentation experience. - <a href="/2020/05/06/flink-community-update-may20/">...</a> - - </p> - <a href="/2020/05/06/flink-community-update-may20/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2045,7 +2050,7 @@ Note FLINK-16684 changed the builders of the StreamingFileSink to make them comp <a href="/posts/page/12/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2074,6 +2079,10 @@ Note FLINK-16684 changed the builders of the StreamingFileSink to make them comp <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/12/index.html b/content/posts/page/12/index.html index c8ec722a5..b6953de43 100644 --- a/content/posts/page/12/index.html +++ b/content/posts/page/12/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,29 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2020/05/06/flink-community-update-may20/">Flink Community Update - May'20</a> + </h3> + + May 6, 2020 - + + + + Marta Paes + + <a href="https://twitter.com/morsapaes">(@morsapaes)</a> + + + + + <p>Can you smell it? It’s release month! It took a while, but now that we’re all caught up with the past, the Community Update is here to stay. This time around, we’re warming up for Flink 1.11 and peeping back to the month of April in the Flink community — with the release of Stateful Functions 2.0, a new self-paced Flink training and some efforts to improve the Flink documentation experience. + <a href="/2020/05/06/flink-community-update-may20/">...</a> + + </p> + <a href="/2020/05/06/flink-community-update-may20/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2020/05/04/applying-to-google-season-of-docs-2020/">Applying to Google Season of Docs 2020</a> @@ -1995,35 +2022,6 @@ We intentionally omitted details of how the applied rules are initialized and wh <a href="/2020/03/24/advanced-flink-application-patterns-vol.2-dynamic-updates-of-application-logic/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2020/02/22/apache-beam-how-beam-runs-on-top-of-flink/">Apache Beam: How Beam Runs on Top of Flink</a> - </h3> - - February 22, 2020 - - - - - Maximilian Michels - - <a href="https://twitter.com/stadtlegende">(@stadtlegende)</a> - - - Markos Sfikas - - <a href="https://twitter.com/MarkSfik">(@MarkSfik)</a> - - - - - <p>Note: This blog post is based on the talk “Beam on Flink: How Does It Actually Work?”. -Apache Flink and Apache Beam are open-source frameworks for parallel, distributed data processing at scale. Unlike Flink, Beam does not come with a full-blown execution engine of its own but plugs into other execution engines, such as Apache Flink, Apache Spark, or Google Cloud Dataflow. In this blog post we discuss the reasons to use Flink together with Beam for your batch and stream processing needs. - <a href="/2020/02/22/apache-beam-how-beam-runs-on-top-of-flink/">...</a> - - </p> - <a href="/2020/02/22/apache-beam-how-beam-runs-on-top-of-flink/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2052,7 +2050,7 @@ Apache Flink and Apache Beam are open-source frameworks for parallel, distribute <a href="/posts/page/13/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2081,6 +2079,10 @@ Apache Flink and Apache Beam are open-source frameworks for parallel, distribute <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/13/index.html b/content/posts/page/13/index.html index 52a5e62aa..e4da15002 100644 --- a/content/posts/page/13/index.html +++ b/content/posts/page/13/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,35 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2020/02/22/apache-beam-how-beam-runs-on-top-of-flink/">Apache Beam: How Beam Runs on Top of Flink</a> + </h3> + + February 22, 2020 - + + + + Maximilian Michels + + <a href="https://twitter.com/stadtlegende">(@stadtlegende)</a> + + + Markos Sfikas + + <a href="https://twitter.com/MarkSfik">(@MarkSfik)</a> + + + + + <p>Note: This blog post is based on the talk “Beam on Flink: How Does It Actually Work?”. +Apache Flink and Apache Beam are open-source frameworks for parallel, distributed data processing at scale. Unlike Flink, Beam does not come with a full-blown execution engine of its own but plugs into other execution engines, such as Apache Flink, Apache Spark, or Google Cloud Dataflow. In this blog post we discuss the reasons to use Flink together with Beam for your batch and stream processing needs. + <a href="/2020/02/22/apache-beam-how-beam-runs-on-top-of-flink/">...</a> + + </p> + <a href="/2020/02/22/apache-beam-how-beam-runs-on-top-of-flink/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2020/02/20/no-java-required-configuring-sources-and-sinks-in-sql/">No Java Required: Configuring Sources and Sinks in SQL</a> @@ -1997,33 +2030,6 @@ A short intro to Apache Pulsar # Apache Pulsar is a flexible pub/sub messaging s <a href="/2019/11/06/running-apache-flink-on-kubernetes-with-kudo/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2019/10/18/apache-flink-1.9.1-released/">Apache Flink 1.9.1 Released</a> - </h3> - - October 18, 2019 - - - - - Jark Wu - - <a href="https://twitter.com/JarkWu">(@JarkWu)</a> - - - - - <p>The Apache Flink community released the first bugfix version of the Apache Flink 1.9 series. -This release includes 96 fixes and minor improvements for Flink 1.9.0. The list below includes a detailed list of all fixes and improvements. -We highly recommend all users to upgrade to Flink 1.9.1. -Updated Maven dependencies: -<dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.9.1</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.9.1</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <versio [...] - <a href="/2019/10/18/apache-flink-1.9.1-released/">...</a> - - </p> - <a href="/2019/10/18/apache-flink-1.9.1-released/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2052,7 +2058,7 @@ Updated Maven dependencies: <a href="/posts/page/14/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2081,6 +2087,10 @@ Updated Maven dependencies: <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/14/index.html b/content/posts/page/14/index.html index 5030ba3b6..3f25fe0d6 100644 --- a/content/posts/page/14/index.html +++ b/content/posts/page/14/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,33 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2019/10/18/apache-flink-1.9.1-released/">Apache Flink 1.9.1 Released</a> + </h3> + + October 18, 2019 - + + + + Jark Wu + + <a href="https://twitter.com/JarkWu">(@JarkWu)</a> + + + + + <p>The Apache Flink community released the first bugfix version of the Apache Flink 1.9 series. +This release includes 96 fixes and minor improvements for Flink 1.9.0. The list below includes a detailed list of all fixes and improvements. +We highly recommend all users to upgrade to Flink 1.9.1. +Updated Maven dependencies: +<dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.9.1</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.9.1</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <versio [...] + <a href="/2019/10/18/apache-flink-1.9.1-released/">...</a> + + </p> + <a href="/2019/10/18/apache-flink-1.9.1-released/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2019/09/13/the-state-processor-api-how-to-read-write-and-modify-the-state-of-flink-applications/">The State Processor API: How to Read, write and modify the state of Flink applications</a> @@ -1998,29 +2029,6 @@ In this post, we motivate the State TTL feature and discuss its use cases. <a href="/2019/05/17/state-ttl-in-flink-1.8.0-how-to-automatically-cleanup-application-state-in-apache-flink/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2019/05/14/flux-capacitor-huh-temporal-tables-and-joins-in-streaming-sql/">Flux capacitor, huh? Temporal Tables and Joins in Streaming SQL</a> - </h3> - - May 14, 2019 - - - - - Marta Paes - - <a href="https://twitter.com/morsapaes">(@morsapaes)</a> - - - - - <p>Figuring out how to manage and model temporal data for effective point-in-time analysis was a longstanding battle, dating as far back as the early 80’s, that culminated with the introduction of temporal tables in the SQL standard in 2011. Up to that point, users were doomed to implement this as part of the application logic, often hurting the length of the development lifecycle as well as the maintainability of the code. - <a href="/2019/05/14/flux-capacitor-huh-temporal-tables-and-joins-in-streaming-sql/">...</a> - - </p> - <a href="/2019/05/14/flux-capacitor-huh-temporal-tables-and-joins-in-streaming-sql/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2049,7 +2057,7 @@ In this post, we motivate the State TTL feature and discuss its use cases. <a href="/posts/page/15/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2078,6 +2086,10 @@ In this post, we motivate the State TTL feature and discuss its use cases. <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/15/index.html b/content/posts/page/15/index.html index 1161f6c82..6a5478cc2 100644 --- a/content/posts/page/15/index.html +++ b/content/posts/page/15/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,29 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2019/05/14/flux-capacitor-huh-temporal-tables-and-joins-in-streaming-sql/">Flux capacitor, huh? Temporal Tables and Joins in Streaming SQL</a> + </h3> + + May 14, 2019 - + + + + Marta Paes + + <a href="https://twitter.com/morsapaes">(@morsapaes)</a> + + + + + <p>Figuring out how to manage and model temporal data for effective point-in-time analysis was a longstanding battle, dating as far back as the early 80’s, that culminated with the introduction of temporal tables in the SQL standard in 2011. Up to that point, users were doomed to implement this as part of the application logic, often hurting the length of the development lifecycle as well as the maintainability of the code. + <a href="/2019/05/14/flux-capacitor-huh-temporal-tables-and-joins-in-streaming-sql/">...</a> + + </p> + <a href="/2019/05/14/flux-capacitor-huh-temporal-tables-and-joins-in-streaming-sql/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2019/05/03/when-flink-pulsar-come-together/">When Flink & Pulsar Come Together</a> @@ -1993,28 +2020,6 @@ A Unified Approach to Batch and Streaming # Since its early days, Apache Flink h <a href="/2019/02/13/batch-as-a-special-case-of-streaming-and-alibabas-contribution-of-blink/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2018/12/26/apache-flink-1.5.6-released/">Apache Flink 1.5.6 Released</a> - </h3> - - December 26, 2018 - - - - - - - <p>The Apache Flink community released the sixth and last bugfix version of the Apache Flink 1.5 series. -This release includes more than 47 fixes and minor improvements for Flink 1.5.5. The list below includes a detailed list of all fixes. -We highly recommend all users to upgrade to Flink 1.5.6. -Updated Maven dependencies: -<dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.5.6</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.5.6</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <versio [...] - <a href="/2018/12/26/apache-flink-1.5.6-released/">...</a> - - </p> - <a href="/2018/12/26/apache-flink-1.5.6-released/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2043,7 +2048,7 @@ Updated Maven dependencies: <a href="/posts/page/16/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2072,6 +2077,10 @@ Updated Maven dependencies: <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/16/index.html b/content/posts/page/16/index.html index 216c8597a..906e9327c 100644 --- a/content/posts/page/16/index.html +++ b/content/posts/page/16/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,28 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2018/12/26/apache-flink-1.5.6-released/">Apache Flink 1.5.6 Released</a> + </h3> + + December 26, 2018 - + + + + + + <p>The Apache Flink community released the sixth and last bugfix version of the Apache Flink 1.5 series. +This release includes more than 47 fixes and minor improvements for Flink 1.5.5. The list below includes a detailed list of all fixes. +We highly recommend all users to upgrade to Flink 1.5.6. +Updated Maven dependencies: +<dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.5.6</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.5.6</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <versio [...] + <a href="/2018/12/26/apache-flink-1.5.6-released/">...</a> + + </p> + <a href="/2018/12/26/apache-flink-1.5.6-released/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2018/12/22/apache-flink-1.6.3-released/">Apache Flink 1.6.3 Released</a> @@ -1979,28 +2005,6 @@ We encourage everyone to download the release and check out the documentation. <a href="/2018/08/09/apache-flink-1.6.0-release-announcement/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2018/07/31/apache-flink-1.5.2-released/">Apache Flink 1.5.2 Released</a> - </h3> - - July 31, 2018 - - - - - - - <p>The Apache Flink community released the second bugfix version of the Apache Flink 1.5 series. -This release includes more than 20 fixes and minor improvements for Flink 1.5.1. The list below includes a detailed list of all fixes. -We highly recommend all users to upgrade to Flink 1.5.2. -Updated Maven dependencies: -<dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.5.2</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.5.2</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <versio [...] - <a href="/2018/07/31/apache-flink-1.5.2-released/">...</a> - - </p> - <a href="/2018/07/31/apache-flink-1.5.2-released/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2029,7 +2033,7 @@ Updated Maven dependencies: <a href="/posts/page/17/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2058,6 +2062,10 @@ Updated Maven dependencies: <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/17/index.html b/content/posts/page/17/index.html index 36a33dbd3..67fbc4eae 100644 --- a/content/posts/page/17/index.html +++ b/content/posts/page/17/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,28 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2018/07/31/apache-flink-1.5.2-released/">Apache Flink 1.5.2 Released</a> + </h3> + + July 31, 2018 - + + + + + + <p>The Apache Flink community released the second bugfix version of the Apache Flink 1.5 series. +This release includes more than 20 fixes and minor improvements for Flink 1.5.1. The list below includes a detailed list of all fixes. +We highly recommend all users to upgrade to Flink 1.5.2. +Updated Maven dependencies: +<dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.5.2</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.5.2</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <versio [...] + <a href="/2018/07/31/apache-flink-1.5.2-released/">...</a> + + </p> + <a href="/2018/07/31/apache-flink-1.5.2-released/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2018/07/12/apache-flink-1.5.1-released/">Apache Flink 1.5.1 Released</a> @@ -2005,40 +2031,6 @@ We encourage everyone to download the release and check out the documentation. <a href="/2017/12/12/apache-flink-1.4.0-release-announcement/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2017/11/21/looking-ahead-to-apache-flink-1.4.0-and-1.5.0/">Looking Ahead to Apache Flink 1.4.0 and 1.5.0</a> - </h3> - - November 21, 2017 - - - - - Stephan Ewen - - <a href="https://twitter.com/StephanEwen">(@StephanEwen)</a> - - - Aljoscha Krettek - - <a href="https://twitter.com/aljoscha">(@aljoscha)</a> - - - Mike Winters - - <a href="https://twitter.com/wints">(@wints)</a> - - - - - <p>The Apache Flink 1.4.0 release is on track to happen in the next couple of weeks, and for all of the readers out there who haven’t been following the release discussion on Flink’s developer mailing list, we’d like to provide some details on what’s coming in Flink 1.4.0 as well as a preview of what the Flink community will save for 1.5.0. -Both releases include ambitious features that we believe will move Flink to an entirely new level in terms of the types of problems it can solve and applications it can support. - <a href="/2017/11/21/looking-ahead-to-apache-flink-1.4.0-and-1.5.0/">...</a> - - </p> - <a href="/2017/11/21/looking-ahead-to-apache-flink-1.4.0-and-1.5.0/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2067,7 +2059,7 @@ Both releases include ambitious features that we believe will move Flink to an e <a href="/posts/page/18/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2096,6 +2088,10 @@ Both releases include ambitious features that we believe will move Flink to an e <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/18/index.html b/content/posts/page/18/index.html index eb6d31092..5d8a1a16a 100644 --- a/content/posts/page/18/index.html +++ b/content/posts/page/18/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,40 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2017/11/21/looking-ahead-to-apache-flink-1.4.0-and-1.5.0/">Looking Ahead to Apache Flink 1.4.0 and 1.5.0</a> + </h3> + + November 21, 2017 - + + + + Stephan Ewen + + <a href="https://twitter.com/StephanEwen">(@StephanEwen)</a> + + + Aljoscha Krettek + + <a href="https://twitter.com/aljoscha">(@aljoscha)</a> + + + Mike Winters + + <a href="https://twitter.com/wints">(@wints)</a> + + + + + <p>The Apache Flink 1.4.0 release is on track to happen in the next couple of weeks, and for all of the readers out there who haven’t been following the release discussion on Flink’s developer mailing list, we’d like to provide some details on what’s coming in Flink 1.4.0 as well as a preview of what the Flink community will save for 1.5.0. +Both releases include ambitious features that we believe will move Flink to an entirely new level in terms of the types of problems it can solve and applications it can support. + <a href="/2017/11/21/looking-ahead-to-apache-flink-1.4.0-and-1.5.0/">...</a> + + </p> + <a href="/2017/11/21/looking-ahead-to-apache-flink-1.4.0-and-1.5.0/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2017/08/05/apache-flink-1.3.2-released/">Apache Flink 1.3.2 Released</a> @@ -1956,26 +1994,6 @@ This release includes critical fixes for HA recovery robustness, fault tolerance <a href="/2017/03/23/apache-flink-1.1.5-released/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2017/02/06/announcing-apache-flink-1.2.0/">Announcing Apache Flink 1.2.0</a> - </h3> - - February 6, 2017 - - - - - - - <p>The Apache Flink community is pleased to announce the 1.2.0 release. Over the past months, the Flink community has been working hard to resolve 650 issues. See the complete changelog for more detail. -This is the third major release in the 1.x.y series. It is API compatible with the other 1.x.y releases for APIs annotated with the @Public annotation. -We encourage everyone to download the release and check out the documentation. - <a href="/2017/02/06/announcing-apache-flink-1.2.0/">...</a> - - </p> - <a href="/2017/02/06/announcing-apache-flink-1.2.0/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2004,7 +2022,7 @@ We encourage everyone to download the release and check out the documentation. <a href="/posts/page/19/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2033,6 +2051,10 @@ We encourage everyone to download the release and check out the documentation. <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/19/index.html b/content/posts/page/19/index.html index 0e20d2d15..7a2eef5ba 100644 --- a/content/posts/page/19/index.html +++ b/content/posts/page/19/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,26 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2017/02/06/announcing-apache-flink-1.2.0/">Announcing Apache Flink 1.2.0</a> + </h3> + + February 6, 2017 - + + + + + + <p>The Apache Flink community is pleased to announce the 1.2.0 release. Over the past months, the Flink community has been working hard to resolve 650 issues. See the complete changelog for more detail. +This is the third major release in the 1.x.y series. It is API compatible with the other 1.x.y releases for APIs annotated with the @Public annotation. +We encourage everyone to download the release and check out the documentation. + <a href="/2017/02/06/announcing-apache-flink-1.2.0/">...</a> + + </p> + <a href="/2017/02/06/announcing-apache-flink-1.2.0/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2016/12/21/apache-flink-1.1.4-released/">Apache Flink 1.1.4 Released</a> @@ -1954,26 +1978,6 @@ Fixed Issues # Bug # [FLINK-3790] [streaming] Use proper hadoop config in rollin <a href="/2016/05/11/flink-1.0.3-released/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2016/04/22/flink-1.0.2-released/">Flink 1.0.2 Released</a> - </h3> - - April 22, 2016 - - - - - - - <p>Today, the Flink community released Flink version 1.0.2, the second bugfix release of the 1.0 series. -We recommend all users updating to this release by bumping the version of your Flink dependencies to 1.0.2 and updating the binaries on the server. You can find the binaries on the updated Downloads page. -Fixed Issues # Bug # [FLINK-3657] [dataSet] Change access of DataSetUtils.countElements() to ‘public’ [FLINK-3762] [core] Enable Kryo reference tracking [FLINK-3732] [core] Fix potential null deference in ExecutionConfig#equals() [FLINK-3760] Fix StateDescriptor. - <a href="/2016/04/22/flink-1.0.2-released/">...</a> - - </p> - <a href="/2016/04/22/flink-1.0.2-released/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2002,7 +2006,7 @@ Fixed Issues # Bug # [FLINK-3657] [dataSet] Change access of DataSetUtils.countE <a href="/posts/page/20/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2031,6 +2035,10 @@ Fixed Issues # Bug # [FLINK-3657] [dataSet] Change access of DataSetUtils.countE <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/2/index.html b/content/posts/page/2/index.html index 4bf686512..faf569945 100644 --- a/content/posts/page/2/index.html +++ b/content/posts/page/2/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,29 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2023/03/15/apache-flink-1.15.4-release-announcement/">Apache Flink 1.15.4 Release Announcement</a> + </h3> + + March 15, 2023 - + + + + Danny Cranmer + + + + + <p>The Apache Flink Community is pleased to announce the fourth bug fix release of the Flink 1.15 series. +This release includes 53 bug fixes, vulnerability fixes, and minor improvements for Flink 1.15. Below you will find a list of all bugfixes and improvements (excluding improvements to the build infrastructure and build stability). For a complete list of all changes see: JIRA. +We highly recommend all users upgrade to Flink 1.15.4. + <a href="/2023/03/15/apache-flink-1.15.4-release-announcement/">...</a> + + </p> + <a href="/2023/03/15/apache-flink-1.15.4-release-announcement/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2023/02/27/apache-flink-kubernetes-operator-1.4.0-release-announcement/">Apache Flink Kubernetes Operator 1.4.0 Release Announcement</a> @@ -2008,30 +2035,6 @@ Flink has become the leading role and factual standard of stream processing, and <a href="/2022/10/28/announcing-the-release-of-apache-flink-1.16/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2022/10/13/apache-flink-table-store-0.2.1-release-announcement/">Apache Flink Table Store 0.2.1 Release Announcement</a> - </h3> - - October 13, 2022 - - - - - Jingsong Lee - - - - - <p>The Apache Flink Community is pleased to announce the first bug fix release of the Flink Table Store 0.2 series. -This release includes 13 bug fixes, vulnerability fixes, and minor improvements for Flink Table Store 0.2. Below you will find a list of all bugfixes and improvements. For a complete list of all changes see: JIRA. -We highly recommend all users upgrade to Flink Table Store 0.2.1. -Release Artifacts # Binaries # You can find the binaries on the updated Downloads page. - <a href="/2022/10/13/apache-flink-table-store-0.2.1-release-announcement/">...</a> - - </p> - <a href="/2022/10/13/apache-flink-table-store-0.2.1-release-announcement/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2060,7 +2063,7 @@ Release Artifacts # Binaries # You can find the binaries on the updated Download <a href="/posts/page/3/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2089,6 +2092,10 @@ Release Artifacts # Binaries # You can find the binaries on the updated Download <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/20/index.html b/content/posts/page/20/index.html index da42d2445..76e006a4d 100644 --- a/content/posts/page/20/index.html +++ b/content/posts/page/20/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,26 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2016/04/22/flink-1.0.2-released/">Flink 1.0.2 Released</a> + </h3> + + April 22, 2016 - + + + + + + <p>Today, the Flink community released Flink version 1.0.2, the second bugfix release of the 1.0 series. +We recommend all users updating to this release by bumping the version of your Flink dependencies to 1.0.2 and updating the binaries on the server. You can find the binaries on the updated Downloads page. +Fixed Issues # Bug # [FLINK-3657] [dataSet] Change access of DataSetUtils.countElements() to ‘public’ [FLINK-3762] [core] Enable Kryo reference tracking [FLINK-3732] [core] Fix potential null deference in ExecutionConfig#equals() [FLINK-3760] Fix StateDescriptor. + <a href="/2016/04/22/flink-1.0.2-released/">...</a> + + </p> + <a href="/2016/04/22/flink-1.0.2-released/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2016/04/14/flink-forward-2016-call-for-submissions-is-now-open/">Flink Forward 2016 Call for Submissions Is Now Open</a> @@ -1947,25 +1971,6 @@ Issues fixed # [FLINK-2879] - Links in documentation are broken [FLINK-2938] - S <a href="/2015/11/27/flink-0.10.1-released/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2015/11/16/announcing-apache-flink-0.10.0/">Announcing Apache Flink 0.10.0</a> - </h3> - - November 16, 2015 - - - - - - - <p>The Apache Flink community is pleased to announce the availability of the 0.10.0 release. The community put significant effort into improving and extending Apache Flink since the last release, focusing on data stream processing and operational features. About 80 contributors provided bug fixes, improvements, and new features such that in total more than 400 JIRA issues could be resolved. -For Flink 0.10.0, the focus of the community was to graduate the DataStream API from beta and to evolve Apache Flink into a production-ready stream data processor with a competitive feature set. - <a href="/2015/11/16/announcing-apache-flink-0.10.0/">...</a> - - </p> - <a href="/2015/11/16/announcing-apache-flink-0.10.0/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -1994,7 +1999,7 @@ For Flink 0.10.0, the focus of the community was to graduate the DataStream API <a href="/posts/page/21/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2023,6 +2028,10 @@ For Flink 0.10.0, the focus of the community was to graduate the DataStream API <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/21/index.html b/content/posts/page/21/index.html index d46d18ffe..ff96f0a23 100644 --- a/content/posts/page/21/index.html +++ b/content/posts/page/21/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,25 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2015/11/16/announcing-apache-flink-0.10.0/">Announcing Apache Flink 0.10.0</a> + </h3> + + November 16, 2015 - + + + + + + <p>The Apache Flink community is pleased to announce the availability of the 0.10.0 release. The community put significant effort into improving and extending Apache Flink since the last release, focusing on data stream processing and operational features. About 80 contributors provided bug fixes, improvements, and new features such that in total more than 400 JIRA issues could be resolved. +For Flink 0.10.0, the focus of the community was to graduate the DataStream API from beta and to evolve Apache Flink into a production-ready stream data processor with a competitive feature set. + <a href="/2015/11/16/announcing-apache-flink-0.10.0/">...</a> + + </p> + <a href="/2015/11/16/announcing-apache-flink-0.10.0/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2015/09/16/off-heap-memory-in-apache-flink-and-the-curious-jit-compiler/">Off-heap Memory in Apache Flink and the curious JIT compiler</a> @@ -1949,24 +1972,6 @@ Learn about the internals of Flink # The community has started an effort to bett <a href="/2015/04/07/march-2015-in-the-flink-community/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2015/03/13/peeking-into-apache-flinks-engine-room/">Peeking into Apache Flink's Engine Room</a> - </h3> - - March 13, 2015 - - - - - - - <p>Join Processing in Apache Flink # Joins are prevalent operations in many data processing applications. Most data processing systems feature APIs that make joining data sets very easy. However, the internal algorithms for join processing are much more involved – especially if large data sets need to be efficiently handled. Therefore, join processing serves as a good example to discuss the salient design points and implementation details of a data processing system. - <a href="/2015/03/13/peeking-into-apache-flinks-engine-room/">...</a> - - </p> - <a href="/2015/03/13/peeking-into-apache-flinks-engine-room/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -1976,9 +1981,6 @@ Learn about the internals of Flink # The community has started an effort to bett <li class="page-item"> <a href="/posts/page/20/" aria-label="Previous" class="page-link" role="button"><span aria-hidden="true">«</span></a> </li> - <li class="page-item"> - <a href="/posts/page/18/" aria-label="Page 18" class="page-link" role="button">18</a> - </li> <li class="page-item"> <a href="/posts/page/19/" aria-label="Page 19" class="page-link" role="button">19</a> </li> @@ -1991,11 +1993,14 @@ Learn about the internals of Flink # The community has started an effort to bett <li class="page-item"> <a href="/posts/page/22/" aria-label="Page 22" class="page-link" role="button">22</a> </li> + <li class="page-item"> + <a href="/posts/page/23/" aria-label="Page 23" class="page-link" role="button">23</a> + </li> <li class="page-item"> <a href="/posts/page/22/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2024,6 +2029,10 @@ Learn about the internals of Flink # The community has started an effort to bett <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/22/index.html b/content/posts/page/22/index.html index 2f8b1fbf6..fcec41159 100644 --- a/content/posts/page/22/index.html +++ b/content/posts/page/22/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,24 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2015/03/13/peeking-into-apache-flinks-engine-room/">Peeking into Apache Flink's Engine Room</a> + </h3> + + March 13, 2015 - + + + + + + <p>Join Processing in Apache Flink # Joins are prevalent operations in many data processing applications. Most data processing systems feature APIs that make joining data sets very easy. However, the internal algorithms for join processing are much more involved – especially if large data sets need to be efficiently handled. Therefore, join processing serves as a good example to discuss the salient design points and implementation details of a data processing system. + <a href="/2015/03/13/peeking-into-apache-flinks-engine-room/">...</a> + + </p> + <a href="/2015/03/13/peeking-into-apache-flinks-engine-room/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2015/03/02/february-2015-in-the-flink-community/">February 2015 in the Flink community</a> @@ -1951,25 +1973,6 @@ Download the release today. <a href="/2014/09/26/apache-flink-0.6.1-available/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2014/08/26/apache-flink-0.6-available/">Apache Flink 0.6 available</a> - </h3> - - August 26, 2014 - - - - - - - <p>We are happy to announce the availability of Flink 0.6. This is the first release of the system inside the Apache Incubator and under the name Flink. Releases up to 0.5 were under the name Stratosphere, the academic and open source project that Flink originates from. -What is Flink? # Apache Flink is a general-purpose data processing engine for clusters. It runs on YARN clusters on top of data stored in Hadoop, as well as stand-alone. - <a href="/2014/08/26/apache-flink-0.6-available/">...</a> - - </p> - <a href="/2014/08/26/apache-flink-0.6-available/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -1979,9 +1982,6 @@ What is Flink? # Apache Flink is a general-purpose data processing engine for cl <li class="page-item"> <a href="/posts/page/21/" aria-label="Previous" class="page-link" role="button"><span aria-hidden="true">«</span></a> </li> - <li class="page-item"> - <a href="/posts/page/18/" aria-label="Page 18" class="page-link" role="button">18</a> - </li> <li class="page-item"> <a href="/posts/page/19/" aria-label="Page 19" class="page-link" role="button">19</a> </li> @@ -1994,11 +1994,14 @@ What is Flink? # Apache Flink is a general-purpose data processing engine for cl <li class="page-item active"> <a aria-current="page" aria-label="Page 22" class="page-link" role="button">22</a> </li> - <li class="page-item disabled"> - <a aria-disabled="true" aria-label="Next" class="page-link" role="button" tabindex="-1"><span aria-hidden="true">»</span></a> + <li class="page-item"> + <a href="/posts/page/23/" aria-label="Page 23" class="page-link" role="button">23</a> </li> - <li class="page-item disabled"> - <a aria-disabled="true" aria-label="Last" class="page-link" role="button" tabindex="-1"><span aria-hidden="true">»»</span></a> + <li class="page-item"> + <a href="/posts/page/23/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> + </li> + <li class="page-item"> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2027,6 +2030,10 @@ What is Flink? # Apache Flink is a general-purpose data processing engine for cl <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/22/index.html b/content/posts/page/23/index.html similarity index 92% copy from content/posts/page/22/index.html copy to content/posts/page/23/index.html index 2f8b1fbf6..5ba4c7544 100644 --- a/content/posts/page/22/index.html +++ b/content/posts/page/23/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,181 +1780,6 @@ https://github.com/alex-shpak/hugo-book - <article class="markdown book-post"> - <h3> - <a href="/2015/03/02/february-2015-in-the-flink-community/">February 2015 in the Flink community</a> - </h3> - - March 2, 2015 - - - - - - - <p>February might be the shortest month of the year, but this does not mean that the Flink community has not been busy adding features to the system and fixing bugs. Here’s a rundown of the activity in the Flink community last month. -0.8.1 release # Flink 0.8.1 was released. This bugfixing release resolves a total of 22 issues. -New committer # Max Michels has been voted a committer by the Flink PMC. - <a href="/2015/03/02/february-2015-in-the-flink-community/">...</a> - - </p> - <a href="/2015/03/02/february-2015-in-the-flink-community/">Continue reading »</a> - </article> - - <article class="markdown book-post"> - <h3> - <a href="/2015/02/09/introducing-flink-streaming/">Introducing Flink Streaming</a> - </h3> - - February 9, 2015 - - - - - - - <p>This post is the first of a series of blog posts on Flink Streaming, the recent addition to Apache Flink that makes it possible to analyze continuous data sources in addition to static files. Flink Streaming uses the pipelined Flink engine to process data streams in real time and offers a new API including definition of flexible windows. -In this post, we go through an example that uses the Flink Streaming API to compute statistics on stock market data that arrive continuously and combine the stock market data with Twitter streams. - <a href="/2015/02/09/introducing-flink-streaming/">...</a> - - </p> - <a href="/2015/02/09/introducing-flink-streaming/">Continue reading »</a> - </article> - - <article class="markdown book-post"> - <h3> - <a href="/2015/02/04/january-2015-in-the-flink-community/">January 2015 in the Flink community</a> - </h3> - - February 4, 2015 - - - - - - - <p>Happy 2015! Here is a (hopefully digestible) summary of what happened last month in the Flink community. -0.8.0 release # Flink 0.8.0 was released. See here for the release notes. -Flink roadmap # The community has published a roadmap for 2015 on the Flink wiki. Check it out to see what is coming up in Flink, and pick up an issue to contribute! -Articles in the press # The Apache Software Foundation announced Flink as a Top-Level Project. - <a href="/2015/02/04/january-2015-in-the-flink-community/">...</a> - - </p> - <a href="/2015/02/04/january-2015-in-the-flink-community/">Continue reading »</a> - </article> - - <article class="markdown book-post"> - <h3> - <a href="/2015/01/21/apache-flink-0.8.0-available/">Apache Flink 0.8.0 available</a> - </h3> - - January 21, 2015 - - - - - - - <p>We are pleased to announce the availability of Flink 0.8.0. This release includes new user-facing features as well as performance and bug fixes, extends the support for filesystems and introduces the Scala API and flexible windowing semantics for Flink Streaming. A total of 33 people have contributed to this release, a big thanks to all of them! -Download Flink 0.8.0 -See the release changelog -Overview of major new features # Extended filesystem support: The former DistributedFileSystem interface has been generalized to HadoopFileSystem now supporting all sub classes of org. - <a href="/2015/01/21/apache-flink-0.8.0-available/">...</a> - - </p> - <a href="/2015/01/21/apache-flink-0.8.0-available/">Continue reading »</a> - </article> - - <article class="markdown book-post"> - <h3> - <a href="/2015/01/06/december-2014-in-the-flink-community/">December 2014 in the Flink community</a> - </h3> - - January 6, 2015 - - - - - - - <p>This is the first blog post of a “newsletter” like series where we give a summary of the monthly activity in the Flink community. As the Flink project grows, this can serve as a “tl;dr” for people that are not following the Flink dev and user mailing lists, or those that are simply overwhelmed by the traffic. -Flink graduation # The biggest news is that the Apache board approved Flink as a top-level Apache project! - <a href="/2015/01/06/december-2014-in-the-flink-community/">...</a> - - </p> - <a href="/2015/01/06/december-2014-in-the-flink-community/">Continue reading »</a> - </article> - - <article class="markdown book-post"> - <h3> - <a href="/2014/11/18/hadoop-compatibility-in-flink/">Hadoop Compatibility in Flink</a> - </h3> - - November 18, 2014 - - - - - - - <p>Apache Hadoop is an industry standard for scalable analytical data processing. Many data analysis applications have been implemented as Hadoop MapReduce jobs and run in clusters around the world. Apache Flink can be an alternative to MapReduce and improves it in many dimensions. Among other features, Flink provides much better performance and offers APIs in Java and Scala, which are very easy to use. Similar to Hadoop, Flink’s APIs provide interfaces for Mapper and Reducer functio [...] - <a href="/2014/11/18/hadoop-compatibility-in-flink/">...</a> - - </p> - <a href="/2014/11/18/hadoop-compatibility-in-flink/">Continue reading »</a> - </article> - - <article class="markdown book-post"> - <h3> - <a href="/2014/11/04/apache-flink-0.7.0-available/">Apache Flink 0.7.0 available</a> - </h3> - - November 4, 2014 - - - - - - - <p>We are pleased to announce the availability of Flink 0.7.0. This release includes new user-facing features as well as performance and bug fixes, brings the Scala and Java APIs in sync, and introduces Flink Streaming. A total of 34 people have contributed to this release, a big thanks to all of them! -Download Flink 0.7.0 here -See the release changelog here -Overview of major new features # Flink Streaming: The gem of the 0. - <a href="/2014/11/04/apache-flink-0.7.0-available/">...</a> - - </p> - <a href="/2014/11/04/apache-flink-0.7.0-available/">Continue reading »</a> - </article> - - <article class="markdown book-post"> - <h3> - <a href="/2014/10/03/upcoming-events/">Upcoming Events</a> - </h3> - - October 3, 2014 - - - - - - - <p>We are happy to announce several upcoming Flink events both in Europe and the US. Starting with a Flink hackathon in Stockholm (Oct 8-9) and a talk about Flink at the Stockholm Hadoop User Group (Oct 8). This is followed by the very first Flink Meetup in Berlin (Oct 15). In the US, there will be two Flink Meetup talks: the first one at the Pasadena Big Data User Group (Oct 29) and the second one at Silicon Valley Hands On Programming Events (Nov 4). - <a href="/2014/10/03/upcoming-events/">...</a> - - </p> - <a href="/2014/10/03/upcoming-events/">Continue reading »</a> - </article> - - <article class="markdown book-post"> - <h3> - <a href="/2014/09/26/apache-flink-0.6.1-available/">Apache Flink 0.6.1 available</a> - </h3> - - September 26, 2014 - - - - - - - <p>We are happy to announce the availability of Flink 0.6.1. -0.6.1 is a maintenance release, which includes minor fixes across several parts of the system. We suggest all users of Flink to work with this newest version. -Download the release today. - </p> - <a href="/2014/09/26/apache-flink-0.6.1-available/">Continue reading »</a> - </article> - <article class="markdown book-post"> <h3> <a href="/2014/08/26/apache-flink-0.6-available/">Apache Flink 0.6 available</a> @@ -1977,10 +1806,7 @@ What is Flink? # Apache Flink is a general-purpose data processing engine for cl <a href="/posts/" aria-label="First" class="page-link" role="button"><span aria-hidden="true">««</span></a> </li> <li class="page-item"> - <a href="/posts/page/21/" aria-label="Previous" class="page-link" role="button"><span aria-hidden="true">«</span></a> - </li> - <li class="page-item"> - <a href="/posts/page/18/" aria-label="Page 18" class="page-link" role="button">18</a> + <a href="/posts/page/22/" aria-label="Previous" class="page-link" role="button"><span aria-hidden="true">«</span></a> </li> <li class="page-item"> <a href="/posts/page/19/" aria-label="Page 19" class="page-link" role="button">19</a> @@ -1991,8 +1817,11 @@ What is Flink? # Apache Flink is a general-purpose data processing engine for cl <li class="page-item"> <a href="/posts/page/21/" aria-label="Page 21" class="page-link" role="button">21</a> </li> + <li class="page-item"> + <a href="/posts/page/22/" aria-label="Page 22" class="page-link" role="button">22</a> + </li> <li class="page-item active"> - <a aria-current="page" aria-label="Page 22" class="page-link" role="button">22</a> + <a aria-current="page" aria-label="Page 23" class="page-link" role="button">23</a> </li> <li class="page-item disabled"> <a aria-disabled="true" aria-label="Next" class="page-link" role="button" tabindex="-1"><span aria-hidden="true">»</span></a> @@ -2027,6 +1856,10 @@ What is Flink? # Apache Flink is a general-purpose data processing engine for cl <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/3/index.html b/content/posts/page/3/index.html index a05bca84b..5b049e1ca 100644 --- a/content/posts/page/3/index.html +++ b/content/posts/page/3/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,30 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2022/10/13/apache-flink-table-store-0.2.1-release-announcement/">Apache Flink Table Store 0.2.1 Release Announcement</a> + </h3> + + October 13, 2022 - + + + + Jingsong Lee + + + + + <p>The Apache Flink Community is pleased to announce the first bug fix release of the Flink Table Store 0.2 series. +This release includes 13 bug fixes, vulnerability fixes, and minor improvements for Flink Table Store 0.2. Below you will find a list of all bugfixes and improvements. For a complete list of all changes see: JIRA. +We highly recommend all users upgrade to Flink Table Store 0.2.1. +Release Artifacts # Binaries # You can find the binaries on the updated Downloads page. + <a href="/2022/10/13/apache-flink-table-store-0.2.1-release-announcement/">...</a> + + </p> + <a href="/2022/10/13/apache-flink-table-store-0.2.1-release-announcement/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2022/10/07/apache-flink-kubernetes-operator-1.2.0-release-announcement/">Apache Flink Kubernetes Operator 1.2.0 Release Announcement</a> @@ -2001,31 +2029,6 @@ Implementation of support Checkpointing with Finished Tasks # As described in pa <a href="/2022/07/11/flip-147-support-checkpoints-after-tasks-finished-part-two/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2022/07/06/apache-flink-1.15.1-release-announcement/">Apache Flink 1.15.1 Release Announcement</a> - </h3> - - July 6, 2022 - - - - - David Anderson - - <a href="https://twitter.com/alpinegizmo">(@alpinegizmo)</a> - - - - - <p>The Apache Flink Community is pleased to announce the first bug fix release of the Flink 1.15 series. -This release includes 62 bug fixes, vulnerability fixes, and minor improvements for Flink 1.15. Below you will find a list of all bugfixes and improvements (excluding improvements to the build infrastructure and build stability). For a complete list of all changes see: JIRA. -We highly recommend all users upgrade to Flink 1.15.1. - <a href="/2022/07/06/apache-flink-1.15.1-release-announcement/">...</a> - - </p> - <a href="/2022/07/06/apache-flink-1.15.1-release-announcement/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2054,7 +2057,7 @@ We highly recommend all users upgrade to Flink 1.15.1. <a href="/posts/page/4/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2083,6 +2086,10 @@ We highly recommend all users upgrade to Flink 1.15.1. <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/4/index.html b/content/posts/page/4/index.html index 0f60c61bd..78f946c7b 100644 --- a/content/posts/page/4/index.html +++ b/content/posts/page/4/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,31 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2022/07/06/apache-flink-1.15.1-release-announcement/">Apache Flink 1.15.1 Release Announcement</a> + </h3> + + July 6, 2022 - + + + + David Anderson + + <a href="https://twitter.com/alpinegizmo">(@alpinegizmo)</a> + + + + + <p>The Apache Flink Community is pleased to announce the first bug fix release of the Flink 1.15 series. +This release includes 62 bug fixes, vulnerability fixes, and minor improvements for Flink 1.15. Below you will find a list of all bugfixes and improvements (excluding improvements to the build infrastructure and build stability). For a complete list of all changes see: JIRA. +We highly recommend all users upgrade to Flink 1.15.1. + <a href="/2022/07/06/apache-flink-1.15.1-release-announcement/">...</a> + + </p> + <a href="/2022/07/06/apache-flink-1.15.1-release-announcement/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2022/06/22/apache-flink-1.14.5-release-announcement/">Apache Flink 1.14.5 Release Announcement</a> @@ -2004,35 +2033,6 @@ Before Flink 1.15, Python user-defined functions will be executed in separate Py <a href="/2022/05/06/improvements-to-flink-operations-snapshots-ownership-and-savepoint-formats/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2022/05/05/announcing-the-release-of-apache-flink-1.15/">Announcing the Release of Apache Flink 1.15</a> - </h3> - - May 5, 2022 - - - - - Joe Moser - - <a href="https://twitter.com/JoemoeAT">(@JoemoeAT)</a> - - - Yun Gao - - <a href="https://twitter.com/YunGao16">(@YunGao16)</a> - - - - - <p>Thanks to our well-organized and open community, Apache Flink continues to grow as a technology and remain one of the most active projects in the Apache community. With the release of Flink 1.15, we are proud to announce a number of exciting changes. -One of the main concepts that makes Apache Flink stand out is the unification of batch (aka bounded) and stream (aka unbounded) data processing, which helps reduce the complexity of development. - <a href="/2022/05/05/announcing-the-release-of-apache-flink-1.15/">...</a> - - </p> - <a href="/2022/05/05/announcing-the-release-of-apache-flink-1.15/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2061,7 +2061,7 @@ One of the main concepts that makes Apache Flink stand out is the unification of <a href="/posts/page/5/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2090,6 +2090,10 @@ One of the main concepts that makes Apache Flink stand out is the unification of <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/5/index.html b/content/posts/page/5/index.html index 8dd5874cc..2070e7011 100644 --- a/content/posts/page/5/index.html +++ b/content/posts/page/5/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,35 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2022/05/05/announcing-the-release-of-apache-flink-1.15/">Announcing the Release of Apache Flink 1.15</a> + </h3> + + May 5, 2022 - + + + + Joe Moser + + <a href="https://twitter.com/JoemoeAT">(@JoemoeAT)</a> + + + Yun Gao + + <a href="https://twitter.com/YunGao16">(@YunGao16)</a> + + + + + <p>Thanks to our well-organized and open community, Apache Flink continues to grow as a technology and remain one of the most active projects in the Apache community. With the release of Flink 1.15, we are proud to announce a number of exciting changes. +One of the main concepts that makes Apache Flink stand out is the unification of batch (aka bounded) and stream (aka unbounded) data processing, which helps reduce the complexity of development. + <a href="/2022/05/05/announcing-the-release-of-apache-flink-1.15/">...</a> + + </p> + <a href="/2022/05/05/announcing-the-release-of-apache-flink-1.15/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2022/04/03/apache-flink-kubernetes-operator-0.1.0-release-announcement/">Apache Flink Kubernetes Operator 0.1.0 Release Announcement</a> @@ -2006,38 +2039,6 @@ This release involves a major refactor of the earlier Flink ML library and intro <a href="/2022/01/07/apache-flink-ml-2.0.0-release-announcement/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2022/01/04/how-we-improved-scheduler-performance-for-large-scale-jobs-part-one/">How We Improved Scheduler Performance for Large-scale Jobs - Part One</a> - </h3> - - January 4, 2022 - - - - - Zhilong Hong - - - Zhu Zhu - - - Daisy Tsang - - - Till Rohrmann - - <a href="https://twitter.com/stsffap">(@stsffap)</a> - - - - - <p>Introduction # When scheduling large-scale jobs in Flink 1.12, a lot of time is required to initialize jobs and deploy tasks. The scheduler also requires a large amount of heap memory in order to store the execution topology and host temporary deployment descriptors. For example, for a job with a topology that contains two vertices connected with an all-to-all edge and a parallelism of 10k (which means there are 10k source tasks and 10k sink tasks and every source task is connecte [...] - <a href="/2022/01/04/how-we-improved-scheduler-performance-for-large-scale-jobs-part-one/">...</a> - - </p> - <a href="/2022/01/04/how-we-improved-scheduler-performance-for-large-scale-jobs-part-one/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2066,7 +2067,7 @@ This release involves a major refactor of the earlier Flink ML library and intro <a href="/posts/page/6/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2095,6 +2096,10 @@ This release involves a major refactor of the earlier Flink ML library and intro <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/6/index.html b/content/posts/page/6/index.html index 89034088e..6a118c97c 100644 --- a/content/posts/page/6/index.html +++ b/content/posts/page/6/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,38 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2022/01/04/how-we-improved-scheduler-performance-for-large-scale-jobs-part-one/">How We Improved Scheduler Performance for Large-scale Jobs - Part One</a> + </h3> + + January 4, 2022 - + + + + Zhilong Hong + + + Zhu Zhu + + + Daisy Tsang + + + Till Rohrmann + + <a href="https://twitter.com/stsffap">(@stsffap)</a> + + + + + <p>Introduction # When scheduling large-scale jobs in Flink 1.12, a lot of time is required to initialize jobs and deploy tasks. The scheduler also requires a large amount of heap memory in order to store the execution topology and host temporary deployment descriptors. For example, for a job with a topology that contains two vertices connected with an all-to-all edge and a parallelism of 10k (which means there are 10k source tasks and 10k sink tasks and every source task is connecte [...] + <a href="/2022/01/04/how-we-improved-scheduler-performance-for-large-scale-jobs-part-one/">...</a> + + </p> + <a href="/2022/01/04/how-we-improved-scheduler-performance-for-large-scale-jobs-part-one/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2022/01/04/how-we-improved-scheduler-performance-for-large-scale-jobs-part-two/">How We Improved Scheduler Performance for Large-scale Jobs - Part Two</a> @@ -2008,31 +2044,6 @@ This release brings many new features and improvements in areas such as the SQL <a href="/2021/09/29/apache-flink-1.14.0-release-announcement/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2021/09/07/implementing-a-custom-source-connector-for-table-api-and-sql-part-one/">Implementing a Custom Source Connector for Table API and SQL - Part One </a> - </h3> - - September 7, 2021 - - - - - Ingo Buerk - - - Daisy Tsang - - - - - <p>Part one of this tutorial will teach you how to build and run a custom source connector to be used with Table API and SQL, two high-level abstractions in Flink. The tutorial comes with a bundled docker-compose setup that lets you easily run the connector. You can then try it out with Flink’s SQL client. -Introduction # Apache Flink is a data processing engine that aims to keep state locally in order to do computations efficiently. - <a href="/2021/09/07/implementing-a-custom-source-connector-for-table-api-and-sql-part-one/">...</a> - - </p> - <a href="/2021/09/07/implementing-a-custom-source-connector-for-table-api-and-sql-part-one/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2061,7 +2072,7 @@ Introduction # Apache Flink is a data processing engine that aims to keep state <a href="/posts/page/7/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2090,6 +2101,10 @@ Introduction # Apache Flink is a data processing engine that aims to keep state <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/7/index.html b/content/posts/page/7/index.html index 72347cb71..2f5d4275a 100644 --- a/content/posts/page/7/index.html +++ b/content/posts/page/7/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,31 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2021/09/07/implementing-a-custom-source-connector-for-table-api-and-sql-part-one/">Implementing a Custom Source Connector for Table API and SQL - Part One </a> + </h3> + + September 7, 2021 - + + + + Ingo Buerk + + + Daisy Tsang + + + + + <p>Part one of this tutorial will teach you how to build and run a custom source connector to be used with Table API and SQL, two high-level abstractions in Flink. The tutorial comes with a bundled docker-compose setup that lets you easily run the connector. You can then try it out with Flink’s SQL client. +Introduction # Apache Flink is a data processing engine that aims to keep state locally in order to do computations efficiently. + <a href="/2021/09/07/implementing-a-custom-source-connector-for-table-api-and-sql-part-one/">...</a> + + </p> + <a href="/2021/09/07/implementing-a-custom-source-connector-for-table-api-and-sql-part-one/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2021/09/07/implementing-a-custom-source-connector-for-table-api-and-sql-part-two/">Implementing a custom source connector for Table API and SQL - Part Two </a> @@ -2010,29 +2039,6 @@ Updated Maven dependencies: <a href="/2021/05/21/apache-flink-1.12.4-released/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2021/05/06/scaling-flink-automatically-with-reactive-mode/">Scaling Flink automatically with Reactive Mode</a> - </h3> - - May 6, 2021 - - - - - Robert Metzger - - <a href="https://twitter.com/rmetzger_">(@rmetzger_)</a> - - - - - <p>Introduction # Streaming jobs which run for several days or longer usually experience variations in workload during their lifetime. These variations can originate from seasonal spikes, such as day vs. night, weekdays vs. weekend or holidays vs. non-holidays, sudden events or simply the growing popularity of your product. Although some of these variations are more predictable than others, in all cases there is a change in job resource demand that needs to be addressed if you want t [...] - <a href="/2021/05/06/scaling-flink-automatically-with-reactive-mode/">...</a> - - </p> - <a href="/2021/05/06/scaling-flink-automatically-with-reactive-mode/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2061,7 +2067,7 @@ Updated Maven dependencies: <a href="/posts/page/8/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2090,6 +2096,10 @@ Updated Maven dependencies: <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/8/index.html b/content/posts/page/8/index.html index fd760759c..3d0ee2f85 100644 --- a/content/posts/page/8/index.html +++ b/content/posts/page/8/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,29 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2021/05/06/scaling-flink-automatically-with-reactive-mode/">Scaling Flink automatically with Reactive Mode</a> + </h3> + + May 6, 2021 - + + + + Robert Metzger + + <a href="https://twitter.com/rmetzger_">(@rmetzger_)</a> + + + + + <p>Introduction # Streaming jobs which run for several days or longer usually experience variations in workload during their lifetime. These variations can originate from seasonal spikes, such as day vs. night, weekdays vs. weekend or holidays vs. non-holidays, sudden events or simply the growing popularity of your product. Although some of these variations are more predictable than others, in all cases there is a change in job resource demand that needs to be addressed if you want t [...] + <a href="/2021/05/06/scaling-flink-automatically-with-reactive-mode/">...</a> + + </p> + <a href="/2021/05/06/scaling-flink-automatically-with-reactive-mode/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2021/05/03/apache-flink-1.13.0-release-announcement/">Apache Flink 1.13.0 Release Announcement</a> @@ -2002,30 +2029,6 @@ Attention: Using unaligned checkpoints in Flink 1.12.0 combined with two/multipl <a href="/2021/01/18/using-rocksdb-state-backend-in-apache-flink-when-and-how/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2021/01/11/exploring-fine-grained-recovery-of-bounded-data-sets-on-flink/">Exploring fine-grained recovery of bounded data sets on Flink</a> - </h3> - - January 11, 2021 - - - - - Robert Metzger - - <a href="https://twitter.com/rmetzger_">(@rmetzger_)</a> - - - - - <p>Apache Flink is a very versatile tool for all kinds of data processing workloads. It can process incoming data within a few milliseconds or crunch through petabytes of bounded datasets (also known as batch processing). -Processing efficiency is not the only parameter users of data processing systems care about. In the real world, system outages due to hardware or software failure are expected to happen all the time. For unbounded (or streaming) workloads, Flink is using periodic checkpoints to allow for reliable and correct recovery. - <a href="/2021/01/11/exploring-fine-grained-recovery-of-bounded-data-sets-on-flink/">...</a> - - </p> - <a href="/2021/01/11/exploring-fine-grained-recovery-of-bounded-data-sets-on-flink/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2054,7 +2057,7 @@ Processing efficiency is not the only parameter users of data processing systems <a href="/posts/page/9/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2083,6 +2086,10 @@ Processing efficiency is not the only parameter users of data processing systems <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/posts/page/9/index.html b/content/posts/page/9/index.html index a0b7d4de5..724d40e3f 100644 --- a/content/posts/page/9/index.html +++ b/content/posts/page/9/index.html @@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> @@ -1776,6 +1780,30 @@ https://github.com/alex-shpak/hugo-book + <article class="markdown book-post"> + <h3> + <a href="/2021/01/11/exploring-fine-grained-recovery-of-bounded-data-sets-on-flink/">Exploring fine-grained recovery of bounded data sets on Flink</a> + </h3> + + January 11, 2021 - + + + + Robert Metzger + + <a href="https://twitter.com/rmetzger_">(@rmetzger_)</a> + + + + + <p>Apache Flink is a very versatile tool for all kinds of data processing workloads. It can process incoming data within a few milliseconds or crunch through petabytes of bounded datasets (also known as batch processing). +Processing efficiency is not the only parameter users of data processing systems care about. In the real world, system outages due to hardware or software failure are expected to happen all the time. For unbounded (or streaming) workloads, Flink is using periodic checkpoints to allow for reliable and correct recovery. + <a href="/2021/01/11/exploring-fine-grained-recovery-of-bounded-data-sets-on-flink/">...</a> + + </p> + <a href="/2021/01/11/exploring-fine-grained-recovery-of-bounded-data-sets-on-flink/">Continue reading »</a> + </article> + <article class="markdown book-post"> <h3> <a href="/2021/01/07/whats-new-in-the-pulsar-flink-connector-2.7.0/">What's New in the Pulsar Flink Connector 2.7.0</a> @@ -2005,33 +2033,6 @@ Despite all these great properties, Flink’s checkpointing method has an Ac <a href="/2020/09/28/stateful-functions-2.2.0-release-announcement/">Continue reading »</a> </article> - <article class="markdown book-post"> - <h3> - <a href="/2020/09/17/apache-flink-1.11.2-released/">Apache Flink 1.11.2 Released</a> - </h3> - - September 17, 2020 - - - - - Zhu Zhu - - <a href="https://twitter.com/zhuzhv">(@zhuzhv)</a> - - - - - <p>The Apache Flink community released the second bugfix version of the Apache Flink 1.11 series. -This release includes 96 fixes and minor improvements for Flink 1.11.1. The list below includes a detailed list of all fixes and improvements. -We highly recommend all users to upgrade to Flink 1.11.2. -Updated Maven dependencies: -<dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</artifactId> <version>1.11.2</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-java_2.11</artifactId> <version>1.11.2</version> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_2.11</artifactId> <vers [...] - <a href="/2020/09/17/apache-flink-1.11.2-released/">...</a> - - </p> - <a href="/2020/09/17/apache-flink-1.11.2-released/">Continue reading »</a> - </article> - <ul class="pagination pagination-default"> @@ -2060,7 +2061,7 @@ Updated Maven dependencies: <a href="/posts/page/10/" aria-label="Next" class="page-link" role="button"><span aria-hidden="true">»</span></a> </li> <li class="page-item"> - <a href="/posts/page/22/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> + <a href="/posts/page/23/" aria-label="Last" class="page-link" role="button"><span aria-hidden="true">»»</span></a> </li> </ul> @@ -2089,6 +2090,10 @@ Updated Maven dependencies: <nav> <ul> + <li> + <a href="https://flink.apache.org/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a> + </li> + <li> <a href="https://flink.apache.org/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a> </li> diff --git a/content/sitemap.xml b/content/sitemap.xml index 926584e90..67aa9d55a 100644 --- a/content/sitemap.xml +++ b/content/sitemap.xml @@ -4,7 +4,7 @@ <sitemap> <loc>https://flink.apache.org/en/sitemap.xml</loc> - <lastmod>2023-07-03T12:00:00+00:00</lastmod> + <lastmod>2023-08-04T12:00:00+00:00</lastmod> </sitemap> diff --git a/content/zh/index.html b/content/zh/index.html index e68cff894..f6839dafe 100644 --- a/content/zh/index.html +++ b/content/zh/index.html @@ -6,8 +6,8 @@ <meta name="generator" content="Hugo 0.113.0"> <meta charset="UTF-8"> <meta name="viewport" content="width=device-width, initial-scale=1.0"> -<meta name="description" content="Apache Flink® - 数据流上的有状态计算 # 所有流式场景 事件驱动应用 流批分析 数据管道 & ETL 了解更多 正确性保证 Exactly-once 状态一致性 事件时间处理 成熟的迟到数据处理 了解更多 分层 API SQL on Stream & Batch Data DataStream API & DataSet API ProcessFunction (Time & State) 了解更多 聚焦运维 灵活部署 高可用 保存点 了解更多 大规模计算 水平扩展架构 支持超大状态 增量检查点机制 了解更多 性能卓越 低延迟 高吞吐 内存计算 了解更多 最新博客列表 # SIGMOD Systems Award for Apache Flink -Apache Flink received the 2023 SIGMOD Systems Award, which is awarded to an individual or set of individuals to recognize the development of a software or hardware system whose technical contributions have had significant impact on the theory or practice of large-scale data management systems: The 2023 SIGMOD Systems Award goes to Apache Flink: “Apache Flink greatly expanded the use of stream data-processing."> +<meta name="description" content="Apache Flink® - 数据流上的有状态计算 # 所有流式场景 事件驱动应用 流批分析 数据管道 & ETL 了解更多 正确性保证 Exactly-once 状态一致性 事件时间处理 成熟的迟到数据处理 了解更多 分层 API SQL on Stream & Batch Data DataStream API & DataSet API ProcessFunction (Time & State) 了解更多 聚焦运维 灵活部署 高可用 保存点 了解更多 大规模计算 水平扩展架构 支持超大状态 增量检查点机制 了解更多 性能卓越 低延迟 高吞吐 内存计算 了解更多 最新博客列表 # Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization +New connectors # We’re excited to announce that Apache Flink now supports three new connectors: Amazon DynamoDB, MongoDB and OpenSearch!"> <meta name="theme-color" content="#FFFFFF"><meta property="og:title" content="Apache Flink Documentation" /> <meta property="og:description" content="" /> <meta property="og:type" content="website" /> @@ -1040,6 +1040,11 @@ under the License. + <a href="/2023/08/04/announcing-three-new-apache-flink-connectors-the-new-connector-versioning-strategy-and-externalization/">Announcing three new Apache Flink connectors, the new connector versioning strategy and externalization</a><br /> + New connectors # We’re excited to announce that Apache Flink now supports three new connectors: Amazon DynamoDB, MongoDB and OpenSearch! The connectors are available for both the DataStream and Table/SQL APIs. +Amazon DynamoDB - This connector includes a sink that provides at-least-once delivery guarantees. MongoDB connector - This connector includes a source and sink that provide at-least-once guarantees. OpenSearch sink - This connector includes a sink that provides at-least-once guarantees. + <br /><br /> + <a href="/2023/07/03/sigmod-systems-award-for-apache-flink/">SIGMOD Systems Award for Apache Flink</a><br /> Apache Flink received the 2023 SIGMOD Systems Award, which is awarded to an individual or set of individuals to recognize the development of a software or hardware system whose technical contributions have had significant impact on the theory or practice of large-scale data management systems: The 2023 SIGMOD Systems Award goes to Apache Flink: @@ -1053,12 +1058,6 @@ This release includes 104 bug fixes, vulnerability fixes, and minor improvements We highly recommend all users upgrade to Flink 1.16.2. <br /><br /> - <a href="/2023/05/25/apache-flink-1.17.1-release-announcement/">Apache Flink 1.17.1 Release Announcement</a><br /> - The Apache Flink Community is pleased to announce the first bug fix release of the Flink 1.17 series. -This release includes 75 bug fixes, vulnerability fixes, and minor improvements for Flink 1.17. Below you will find a list of all bugfixes and improvements (excluding improvements to the build infrastructure and build stability). For a complete list of all changes see: JIRA. -We highly recommend all users upgrade to Flink 1.17.1. - <br /><br /> -