Re: [VOTE] Release 1.5.0, release candidate #1

2018-04-05 Thread Till Rohrmann
I could reproduce the problem Simone reported with the provided batch job. It is definitely a regression with respect to Flink 1.4.2. I suspect that it has something to do with spilling because it is independent of Flip-6 and only occurs if the input data size is big enough. Moreover, we made some

Re: Adding a part suffix setter to the BucketingSink

2018-04-05 Thread Lakshmi Gururaja Rao
I can see two ways of achieving this: 1. Setting a suffix* **only*** for the completed part files. I don't necessarily think the suffix should be added for the intermediate files (as intermediate files should not really be ready for consumption by a downstream process?) 2. Be able to override this

Re: [VOTE] Release 1.5.0, release candidate #1

2018-04-05 Thread Till Rohrmann
Hi Simone, thanks for testing the RC and reporting the issue. I will investigate the problem with the code you've provided. @Bowen, I will take a look at Flink-8837. Cheers, Till On Thu, Apr 5, 2018 at 8:54 AM, Bowen Li wrote: > Hi Till, > > FLINK-8837

Re: Trying to restart Flink jobs from savepoint with Avro Schema change

2018-04-05 Thread Till Rohrmann
Hi Dhvanan, could you provide us with a little example program to reproduce the problem? I've pulled Gordon in who might know more about the limitations of Avro schema evolution. Cheers, Till On Wed, Apr 4, 2018 at 2:36 AM, Dhvanan Shah wrote: > Hello! > > I have a Flink job that reads an Even

[jira] [Created] (FLINK-9142) Lower the minimum number of buffers for incoming channels to 1

2018-04-05 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9142: -- Summary: Lower the minimum number of buffers for incoming channels to 1 Key: FLINK-9142 URL: https://issues.apache.org/jira/browse/FLINK-9142 Project: Flink Iss

[jira] [Created] (FLINK-9141) Calling getSideOutput() and split() on one DataStream causes NPE

2018-04-05 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9141: --- Summary: Calling getSideOutput() and split() on one DataStream causes NPE Key: FLINK-9141 URL: https://issues.apache.org/jira/browse/FLINK-9141 Project: Flink

[jira] [Created] (FLINK-9140) simplify scalastyle configurations

2018-04-05 Thread Bowen Li (JIRA)
Bowen Li created FLINK-9140: --- Summary: simplify scalastyle configurations Key: FLINK-9140 URL: https://issues.apache.org/jira/browse/FLINK-9140 Project: Flink Issue Type: Improvement Comp