Re: Merging PR to release branches during RC voting

2018-05-24 Thread Tzu-Li (Gordon) Tai
Hi Piotr, Thanks for bringing the issue up. I agree that this is something we should look into improving. Strictly speaking, I don’t think it is an issue only limited to after a RC vote has started. Taking 1.5.0 as an example, release-1.5 was branched out at the announcement for feature

Re: Flink 1.5 - Job fails to execute in multiple taskmanagers (parallelism > 1)

2018-05-24 Thread Edward Rojas
Regarding heap, the only configurations I do explicitly are /`jobmanager.heap.mb`/, /`taskmanager.heap.mb`/ and /`taskmanager.memory.preallocate: false`/. All other settings for memory have their default value. I just tested and it fails only when SSL is enabled. -- Sent from:

Re: Increasing Disk Read Throughput and IOPS

2018-05-24 Thread Stephan Ewen
One thing that you can always to is disable fsync, because Flink does not rely on RocksDBs fsync for persistence. If you disable incremental checkpoints, does that help? If yes, it could be an issue with too many small SSTable files due to incremental checkpoints (an issue we have on the roadmap

Re: Flink 1.5 - Job fails to execute in multiple taskmanagers (parallelism > 1)

2018-05-24 Thread Stephan Ewen
Two quick questions: - do you explicitly configure Flink memory onheap / offheap? - can you check whether this also happens when SSL is disabled? On Thu, May 24, 2018 at 6:21 PM, Edward Rojas wrote: > Hi all, > > I was testing Flink 1.5 rc5 and I found this

[VOTE] Release 1.5.0, release candidate #6

2018-05-24 Thread Till Rohrmann
Hi everyone, Please review and vote on the release candidate #6 for the version 1.5.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

Flink 1.5 - Job fails to execute in multiple taskmanagers (parallelism > 1)

2018-05-24 Thread Edward Rojas
Hi all, I was testing Flink 1.5 rc5 and I found this issue. I'm running a cluster in HA mode with one jobmanager, several taskmanagers, each one with two task slots and default parallelism set to 2. I'm running two jobs, one simple one with a kafka consumer, a filter and a sink. The other a

[jira] [Created] (FLINK-9435) Remove per-key selection Tuple instantiation via reflection in KeySelectorUtil#ComparableKeySelector

2018-05-24 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9435: -- Summary: Remove per-key selection Tuple instantiation via reflection in KeySelectorUtil#ComparableKeySelector Key: FLINK-9435 URL: https://issues.apache.org/jira/browse/FLINK-9435

[jira] [Created] (FLINK-9434) Test instability in YARNSessionCapacitySchedulerITCase#

2018-05-24 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9434: -- Summary: Test instability in YARNSessionCapacitySchedulerITCase# Key: FLINK-9434 URL: https://issues.apache.org/jira/browse/FLINK-9434 Project: Flink Issue

Re: [VOTE] Release 1.5.0, release candidate #5

2018-05-24 Thread Till Rohrmann
Thanks for reporting the issues Timo. I think both of them are not blocking the release and should be addressed for the following releases. Cheers, Till On Thu, May 24, 2018 at 10:52 AM, Timo Walther wrote: > I tried to build the relase locally but 3 tests failed. 2 are

Re: Increasing Disk Read Throughput and IOPS

2018-05-24 Thread Piotr Nowojski
Hi, This issue might have something to do with compaction. Problems with compaction can especially degrade reads performance (or just increase reads IO). Have you tried to further enforce more compactions or change CompactionStyle? Have you taken a look on

[jira] [Created] (FLINK-9433) SystemProcessingTimeService does not work properly

2018-05-24 Thread Ruidong Li (JIRA)
Ruidong Li created FLINK-9433: - Summary: SystemProcessingTimeService does not work properly Key: FLINK-9433 URL: https://issues.apache.org/jira/browse/FLINK-9433 Project: Flink Issue Type:

Merging PR to release branches during RC voting

2018-05-24 Thread Piotr Nowojski
Hey, I would like to raise an issue that happensa at couple of times during 1.5.0 RCx votings. There were some bug fixes like: https://issues.apache.org/jira/browse/FLINK-9349 https://issues.apache.org/jira/browse/FLINK-9295

[jira] [Created] (FLINK-9432) Support extract epoch, decade, millisecond, microsecond

2018-05-24 Thread Sergey Nuyanzin (JIRA)
Sergey Nuyanzin created FLINK-9432: -- Summary: Support extract epoch, decade, millisecond, microsecond Key: FLINK-9432 URL: https://issues.apache.org/jira/browse/FLINK-9432 Project: Flink

[jira] [Created] (FLINK-9431) Introduce TimeEnd State to flink cep

2018-05-24 Thread aitozi (JIRA)
aitozi created FLINK-9431: - Summary: Introduce TimeEnd State to flink cep Key: FLINK-9431 URL: https://issues.apache.org/jira/browse/FLINK-9431 Project: Flink Issue Type: Improvement

Re: [VOTE] Release 1.5.0, release candidate #5

2018-05-24 Thread Timo Walther
I tried to build the relase locally but 3 tests failed. 2 are related to the evironment in which the tests are executed (see [1]) and the other should have been caught by Travis which did not happen (see last comments in [2]). [1] https://issues.apache.org/jira/browse/FLINK-9424 [2]