Re: Flink Query Optimizer

Hi Albert, Calcite provides a rule-based optimizer (as a framework), which means users can customize it by adding rules. That’s exactly what Flink did. From the logical plan to the physical plan, the translations are triggered by different sets of rules, according to which the relational

Re: Flink Query Optimizer

Hi Albert, First I guess the query optimizer you mentioned is about Flink table & sql (for batch API there is another optimizer which is implemented by Flink). Yes, now for table & sql, Flink use Apache Calcite's query optimizer to translate into a Calcite plan which is then optimized according

[jira] [Created] (FLINK-9849) Upgrade hbase version to 2.0.1 for hbase connector

Ted Yu created FLINK-9849: - Summary: Upgrade hbase version to 2.0.1 for hbase connector Key: FLINK-9849 URL: https://issues.apache.org/jira/browse/FLINK-9849 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] Apache Flink 1.5.1 released

Excellent! Thanks to Chesnay, great work! Yaz > On Jul 13, 2018, at 8:37 AM, Dawid Wysakowicz wrote: > > Good job everyone and Chesnay for being the release manager! > > > On 13/07/18 14:34, Hequn Cheng wrote: >> Cool, thanks to Chesnay! >> >> Best, Hequn >> >> On Fri, Jul 13, 2018 at 8:25

Re: [VOTE] Release 1.5.1, release candidate #3

Hi Till, Thanks for reply! For version 1.4.x when Parallelism > Available task Slots has been selected, Flink throw bellow error immediately as you said NoResourceAvailableException: Not enough free slots available to run the job but for version 1.5.x there are two different behaviors:

[jira] [Created] (FLINK-9848) When Parallelism more than available task slots Flink stays idle

Yazdan Shirvany created FLINK-9848: -- Summary: When Parallelism more than available task slots Flink stays idle Key: FLINK-9848 URL: https://issues.apache.org/jira/browse/FLINK-9848 Project: Flink

Flink Query Optimizer

Hello, I am just wondering, does Flink use Apache Calcite's query optimizer to generate an optimal logical plan, or does it have its own query optimizer? >From what I observed so far, the Flink's query optimizer only groups operator together without changing the order of aggregation operators

[jira] [Created] (FLINK-9847) OneInputStreamTaskTest.testWatermarksNotForwardedWithinChainWhenIdle unstable

Till Rohrmann created FLINK-9847: Summary: OneInputStreamTaskTest.testWatermarksNotForwardedWithinChainWhenIdle unstable Key: FLINK-9847 URL: https://issues.apache.org/jira/browse/FLINK-9847 Project:

[jira] [Created] (FLINK-9846) Add a Kafka table sink factory

Timo Walther created FLINK-9846: --- Summary: Add a Kafka table sink factory Key: FLINK-9846 URL: https://issues.apache.org/jira/browse/FLINK-9846 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-9845) Make InternalTimerService's timer processing interruptible/abortable

Till Rohrmann created FLINK-9845: Summary: Make InternalTimerService's timer processing interruptible/abortable Key: FLINK-9845 URL: https://issues.apache.org/jira/browse/FLINK-9845 Project: Flink

Re: [ANNOUNCE] Apache Flink 1.5.1 released

Good job everyone and Chesnay for being the release manager! On 13/07/18 14:34, Hequn Cheng wrote: > Cool, thanks to Chesnay! > > Best, Hequn > > On Fri, Jul 13, 2018 at 8:25 PM, vino yang > wrote: > > Thanks Chesnay, great job! > > Thanks, > Vino > >

Re: [ANNOUNCE] Apache Flink 1.5.1 released

Cool, thanks to Chesnay! Best, Hequn On Fri, Jul 13, 2018 at 8:25 PM, vino yang wrote: > Thanks Chesnay, great job! > > Thanks, > Vino > > 2018-07-13 20:20 GMT+08:00 Till Rohrmann : > >> Great to hear. Big thank you to the community for the hard work and to >> Chesnay for being our release

Re: [ANNOUNCE] Apache Flink 1.5.1 released

Thanks Chesnay, great job! Thanks, Vino 2018-07-13 20:20 GMT+08:00 Till Rohrmann : > Great to hear. Big thank you to the community for the hard work and to > Chesnay for being our release manager. > > Cheers, > Till > > On Fri, Jul 13, 2018 at 12:05 PM Chesnay Schepler > wrote: > >> The Apache

Re: [ANNOUNCE] Apache Flink 1.5.1 released

Great to hear. Big thank you to the community for the hard work and to Chesnay for being our release manager. Cheers, Till On Fri, Jul 13, 2018 at 12:05 PM Chesnay Schepler wrote: > The Apache Flink community is very happy to announce the release of Apache > Flink 1.5.1, which is the first

[ANNOUNCE] Apache Flink 1.5.1 released

The Apache Flink community is very happy to announce the release of Apache Flink 1.5.1, which is the first bugfix release for the Apache Flink 1.5 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming

[jira] [Created] (FLINK-9844) PackagedProgram does not close URLClassLoader

Chesnay Schepler created FLINK-9844: --- Summary: PackagedProgram does not close URLClassLoader Key: FLINK-9844 URL: https://issues.apache.org/jira/browse/FLINK-9844 Project: Flink Issue

[jira] [Created] (FLINK-9843) Build website automatically

Chesnay Schepler created FLINK-9843: --- Summary: Build website automatically Key: FLINK-9843 URL: https://issues.apache.org/jira/browse/FLINK-9843 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-9842) Job submission fails via CLI with SSL enabled

Nico Kruber created FLINK-9842: -- Summary: Job submission fails via CLI with SSL enabled Key: FLINK-9842 URL: https://issues.apache.org/jira/browse/FLINK-9842 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9841) Web UI only show partial taskmanager log

vinoyang created FLINK-9841: --- Summary: Web UI only show partial taskmanager log Key: FLINK-9841 URL: https://issues.apache.org/jira/browse/FLINK-9841 Project: Flink Issue Type: Bug Affects

[DISCUSS] Improve broadcast serialization

Hi all, In current implementation, the RecordSerializer is created separately for each subpartition in RecordWriter, that means the number of serializers equals to the number of subpartitions. For broadcast partitioner, every record will be serialized many times in all the subpartitions, and

[jira] [Created] (FLINK-9840) Remove Scala dependency from Flink's Mesos integration

Till Rohrmann created FLINK-9840: Summary: Remove Scala dependency from Flink's Mesos integration Key: FLINK-9840 URL: https://issues.apache.org/jira/browse/FLINK-9840 Project: Flink Issue

[jira] [Created] (FLINK-9839) End-to-end test: Streaming job with SSL

Nico Kruber created FLINK-9839: -- Summary: End-to-end test: Streaming job with SSL Key: FLINK-9839 URL: https://issues.apache.org/jira/browse/FLINK-9839 Project: Flink Issue Type: Sub-task