[GitHub] flink pull request #5465: [FLINK-8639][State Backends]Fix always need to see...

2018-02-21 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5465#discussion_r169620794 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBMapState.java --- @@ -319,6 +321,9 @@ pri

[jira] [Created] (FLINK-8727) Test instability in SlotPoolRpcTest.testCancelSlotAllocationWithoutResourceManager

2018-02-21 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8727: --- Summary: Test instability in SlotPoolRpcTest.testCancelSlotAllocationWithoutResourceManager Key: FLINK-8727 URL: https://issues.apache.org/jira/browse/FLINK-8727 Projec

[jira] [Created] (FLINK-8728) Fail new worker requests immediately in Standalone mode

2018-02-21 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8728: Summary: Fail new worker requests immediately in Standalone mode Key: FLINK-8728 URL: https://issues.apache.org/jira/browse/FLINK-8728 Project: Flink Issue T

[GitHub] flink pull request #5528: [FLINK-6489] [FLINK-8696] [shell scripts] Remove J...

2018-02-21 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5528#discussion_r169622022 --- Diff: flink-dist/src/main/flink-bin/bin/start-cluster.bat --- @@ -0,0 +1,77 @@ +::

[jira] [Commented] (FLINK-6489) Rework 'start-local.bat' to 'start-local-cluster.bat'

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371322#comment-16371322 ] ASF GitHub Bot commented on FLINK-6489: --- Github user zentol commented on a diff in t

[GitHub] flink pull request #5541: [FLINK-8728] [flip6] Fail new worker requests imme...

2018-02-21 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5541 [FLINK-8728] [flip6] Fail new worker requests immediately in standalone mode ## What is the purpose of the change Let the StandaloneResourceManager throw a ResourceManagerException in c

[jira] [Commented] (FLINK-8728) Fail new worker requests immediately in Standalone mode

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371326#comment-16371326 ] ASF GitHub Bot commented on FLINK-8728: --- GitHub user tillrohrmann opened a pull requ

[GitHub] flink issue #5535: [FLINK-8703][tests] Migrate tests from LocalFlinkMiniClus...

2018-02-21 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5535 will merge this, as is, once travis gives a green light. The commits have the rather nice property that they don't require changes to other classes (like the MiniClusterResource); wouldn't want to des

[jira] [Commented] (FLINK-8703) Migrate tests from LocalFlinkMiniCluster to MiniClusterResource

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371333#comment-16371333 ] ASF GitHub Bot commented on FLINK-8703: --- Github user zentol commented on the issue:

[GitHub] flink pull request #5542: [FLINK-8703][tests] Migrate tests from LocalFlinkM...

2018-02-21 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5542#discussion_r169623190 --- Diff: flink-tests/src/test/java/org/apache/flink/test/streaming/runtime/BigUserProgramJobSubmitITCase.java --- @@ -43,40 +40,27 @@ /** * Integ

[GitHub] flink pull request #5542: [FLINK-8703][tests] Migrate tests from LocalFlinkM...

2018-02-21 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/5542 [FLINK-8703][tests] Migrate tests from LocalFlinkMiniCluster to MiniClusterResource ## What is the purpose of the change This PR contains the second batch of test ports from `LocalFlinkMini

[jira] [Commented] (FLINK-8703) Migrate tests from LocalFlinkMiniCluster to MiniClusterResource

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371336#comment-16371336 ] ASF GitHub Bot commented on FLINK-8703: --- GitHub user zentol opened a pull request:

[jira] [Commented] (FLINK-8703) Migrate tests from LocalFlinkMiniCluster to MiniClusterResource

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371338#comment-16371338 ] ASF GitHub Bot commented on FLINK-8703: --- Github user zentol commented on a diff in t

[GitHub] flink issue #5465: [FLINK-8639][State Backends]Fix always need to seek multi...

2018-02-21 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5465 Thanks for your comment for the `AutoCloseable` proposal, I agreed that the disadvantages are more than advantages ---

[jira] [Commented] (FLINK-8639) Fix always need to seek multiple times when iterator RocksDBMapState

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371340#comment-16371340 ] ASF GitHub Bot commented on FLINK-8639: --- Github user sihuazhou commented on the issu

[jira] [Closed] (FLINK-8727) Test instability in SlotPoolRpcTest.testCancelSlotAllocationWithoutResourceManager

2018-02-21 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-8727. Resolution: Duplicate > Test instability in > SlotPoolRpcTest.testCancelSlotAllocationWithoutResour

[GitHub] flink issue #5542: [FLINK-8703][tests] Migrate tests from LocalFlinkMiniClus...

2018-02-21 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5542 Together with #5535 this should cover all usages of `LocalFlinkMiniCluster` that we can port in isolation. ---

[GitHub] flink issue #5465: [FLINK-8639][State Backends]Fix always need to seek multi...

2018-02-21 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5465 I have addressed all the comments. One thing that I am not 100 sure: I change the size of the `cacheEntries` to the fixed value `CACHE_SIZE_LIMIT` (128). @StefanRRichter Could you please have a loo

[jira] [Commented] (FLINK-8703) Migrate tests from LocalFlinkMiniCluster to MiniClusterResource

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371344#comment-16371344 ] ASF GitHub Bot commented on FLINK-8703: --- Github user zentol commented on the issue:

[jira] [Commented] (FLINK-8639) Fix always need to seek multiple times when iterator RocksDBMapState

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371345#comment-16371345 ] ASF GitHub Bot commented on FLINK-8639: --- Github user sihuazhou commented on the issu

[GitHub] flink issue #5534: [FLINK-8713][tests] Ensure outdated mod time is smaller t...

2018-02-21 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5534 merging. ---

[jira] [Commented] (FLINK-8713) FileInputFormatTest.testGetStatisticsMultipleOneFileWithCachedVersion unstable on Travis

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371346#comment-16371346 ] ASF GitHub Bot commented on FLINK-8713: --- Github user zentol commented on the issue:

[jira] [Updated] (FLINK-8601) Introduce PartitionedBloomFilter for Approximate calculation and other situations of performance optimization

2018-02-21 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou updated FLINK-8601: -- Affects Version/s: (was: 1.4.0) 1.5.0 > Introduce PartitionedBloomFilter for

[jira] [Updated] (FLINK-8602) Accelerate recover from failover when use incremental checkpoint

2018-02-21 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou updated FLINK-8602: -- Affects Version/s: (was: 1.4.0) 1.5.0 > Accelerate recover from failover when

[GitHub] flink pull request #5497: Propose fixing some typos

2018-02-21 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5497#discussion_r169626782 --- Diff: docs/dev/migration.md --- @@ -145,16 +145,16 @@ public class BufferingSink implements SinkFunction>, bufferedElements.add(value);

[GitHub] flink issue #5497: Propose fixing some typos

2018-02-21 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5497 It's fine, I'll merge it and add the spaces back while doing so. ---

[jira] [Commented] (FLINK-8726) Code highlighting partially broken

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371362#comment-16371362 ] ASF GitHub Bot commented on FLINK-8726: --- Github user zentol commented on a diff in t

[GitHub] flink issue #5518: [FLINK-8679][State Backends]Fix RocksDBKeyedBackend.getKe...

2018-02-21 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5518 I have addressed all the comments, could you please have a look again? cc @StefanRRichter @aljoscha ---

[jira] [Commented] (FLINK-8679) RocksDBKeyedBackend.getKeys(stateName, namespace) doesn't filter data with namespace

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371366#comment-16371366 ] ASF GitHub Bot commented on FLINK-8679: --- Github user sihuazhou commented on the issu

[GitHub] flink pull request #5465: [FLINK-8639][State Backends]Fix always need to see...

2018-02-21 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5465#discussion_r169627770 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBMapState.java --- @@ -520,7 +

[jira] [Commented] (FLINK-8639) Fix always need to seek multiple times when iterator RocksDBMapState

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371367#comment-16371367 ] ASF GitHub Bot commented on FLINK-8639: --- Github user StefanRRichter commented on a d

[GitHub] flink issue #5465: [FLINK-8639][State Backends]Fix always need to seek multi...

2018-02-21 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/5465 While `128` is maybe already up to 128x better, a scientific approach for finding the constant would be to try out for very small entries from which point you have diminishing returns for high

[jira] [Commented] (FLINK-8639) Fix always need to seek multiple times when iterator RocksDBMapState

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371379#comment-16371379 ] ASF GitHub Bot commented on FLINK-8639: --- Github user StefanRRichter commented on the

[GitHub] flink pull request #5465: [FLINK-8639][State Backends]Fix always need to see...

2018-02-21 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5465#discussion_r169631205 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBMapState.java --- @@ -520,7 +527,7

[jira] [Commented] (FLINK-8639) Fix always need to seek multiple times when iterator RocksDBMapState

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371388#comment-16371388 ] ASF GitHub Bot commented on FLINK-8639: --- Github user sihuazhou commented on a diff i

[jira] [Updated] (FLINK-8715) RocksDB does not propagate reconfiguration of serializer to the states

2018-02-21 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-8715: Priority: Blocker (was: Major) > RocksDB does not propagate reconfiguration of serializer to the st

[jira] [Commented] (FLINK-8715) RocksDB does not propagate reconfiguration of serializer to the states

2018-02-21 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371392#comment-16371392 ] Stephan Ewen commented on FLINK-8715: - [~aljoscha] and [~srichter] and [~tzulitai] - w

[jira] [Updated] (FLINK-8707) Excessive amount of files opened by flink task manager

2018-02-21 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-8707: Description: The job manager has less FDs than the task manager.   Hi A support alert indicated t

[jira] [Updated] (FLINK-8707) Excessive amount of files opened by flink task manager

2018-02-21 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-8707: Component/s: (was: JobManager) TaskManager > Excessive amount of files opened b

[GitHub] flink pull request #5543: [FLINK-8596][CLI] Also catch NoClassDefFoundErrors

2018-02-21 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/5543 [FLINK-8596][CLI] Also catch NoClassDefFoundErrors ## What is the purpose of the change This PR modifies the CliFrontend to also catch `NoClassDefFoundErrors` when loading the YARN CLI, as o

[jira] [Commented] (FLINK-8596) Custom command line code does not correctly catch errors

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371396#comment-16371396 ] ASF GitHub Bot commented on FLINK-8596: --- GitHub user zentol opened a pull request:

[jira] [Updated] (FLINK-8721) Client blocks indefinitely if job archiving fails

2018-02-21 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-8721: Priority: Blocker (was: Major) > Client blocks indefinitely if job archiving fails > --

[GitHub] flink issue #5465: [FLINK-8639][State Backends]Fix always need to seek multi...

2018-02-21 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5465 Aha, for now I would like to leave it to 128 ... Even I can't find a best value, but this value is not a bad value and is also a safety value.. If I found any another value that is better than it

[jira] [Commented] (FLINK-8639) Fix always need to seek multiple times when iterator RocksDBMapState

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371399#comment-16371399 ] ASF GitHub Bot commented on FLINK-8639: --- Github user sihuazhou commented on the issu

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

2018-02-21 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371401#comment-16371401 ] Stephan Ewen commented on FLINK-8707: - If I understand this correctly, the FDs should

[jira] [Commented] (FLINK-8543) Output Stream closed at org.apache.hadoop.fs.s3a.S3AOutputStream.checkOpen

2018-02-21 Thread chris snow (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371403#comment-16371403 ] chris snow commented on FLINK-8543: --- Sorry for the delay. I've added the debug statement

[jira] [Created] (FLINK-8729) Migrate JSONGenerator from Slink to Jackson

2018-02-21 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8729: --- Summary: Migrate JSONGenerator from Slink to Jackson Key: FLINK-8729 URL: https://issues.apache.org/jira/browse/FLINK-8729 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-8543) Output Stream closed at org.apache.hadoop.fs.s3a.S3AOutputStream.checkOpen

2018-02-21 Thread chris snow (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371405#comment-16371405 ] chris snow commented on FLINK-8543: --- [~aljoscha] The failures seem to be happening for a

[jira] [Comment Edited] (FLINK-8543) Output Stream closed at org.apache.hadoop.fs.s3a.S3AOutputStream.checkOpen

2018-02-21 Thread chris snow (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371403#comment-16371403 ] chris snow edited comment on FLINK-8543 at 2/21/18 1:33 PM: So

[jira] [Assigned] (FLINK-8645) Support convenient extension of parent-first ClassLoader patterns

2018-02-21 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-8645: --- Assignee: Chesnay Schepler > Support convenient extension of parent-first ClassLoader

[GitHub] flink issue #5543: [FLINK-8596][CLI] Also catch NoClassDefFoundErrors

2018-02-21 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5543 +1 to merge ---

[jira] [Commented] (FLINK-8596) Custom command line code does not correctly catch errors

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371420#comment-16371420 ] ASF GitHub Bot commented on FLINK-8596: --- Github user aljoscha commented on the issue

[jira] [Commented] (FLINK-8715) RocksDB does not propagate reconfiguration of serializer to the states

2018-02-21 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371427#comment-16371427 ] Aljoscha Krettek commented on FLINK-8715: - I think it is an issue but I don't see

[GitHub] flink pull request #5544: [FLINK-8645][configuration] Split classloader.pare...

2018-02-21 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/5544 [FLINK-8645][configuration] Split classloader.parent-first-patterns into "base" and "append ## What is the purpose of the change This PR splits the `classloader.parent-first-patterns` optio

[jira] [Commented] (FLINK-8645) Support convenient extension of parent-first ClassLoader patterns

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371441#comment-16371441 ] ASF GitHub Bot commented on FLINK-8645: --- GitHub user zentol opened a pull request:

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-21 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r169638326 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@ -336,1697 +

[jira] [Commented] (FLINK-8720) Logging exception with S3 connector and BucketingSink

2018-02-21 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371442#comment-16371442 ] Stephan Ewen commented on FLINK-8720: - That looks like a classloading / class duplicat

[jira] [Commented] (FLINK-8543) Output Stream closed at org.apache.hadoop.fs.s3a.S3AOutputStream.checkOpen

2018-02-21 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371445#comment-16371445 ] Aljoscha Krettek commented on FLINK-8543: - Ok, this confirms my suspicion. The pro

[GitHub] flink pull request #5540: [FLINK-8723] Remove existing broadcast state examp...

2018-02-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5540 ---

[jira] [Commented] (FLINK-8723) Remove existing BroadcastState examples.

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371451#comment-16371451 ] ASF GitHub Bot commented on FLINK-8723: --- Github user asfgit closed the pull request

[GitHub] flink pull request #5542: [FLINK-8703][tests] Migrate tests from LocalFlinkM...

2018-02-21 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/5542#discussion_r169647902 --- Diff: flink-tests/src/test/java/org/apache/flink/test/streaming/runtime/BigUserProgramJobSubmitITCase.java --- @@ -43,40 +40,27 @@ /** * Int

[jira] [Commented] (FLINK-8723) Remove existing BroadcastState examples.

2018-02-21 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371454#comment-16371454 ] Kostas Kloudas commented on FLINK-8723: --- Merged at 2fa8a158640ab9a46c2bfb6610766e245

[jira] [Commented] (FLINK-8703) Migrate tests from LocalFlinkMiniCluster to MiniClusterResource

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371455#comment-16371455 ] ASF GitHub Bot commented on FLINK-8703: --- Github user aljoscha commented on a diff in

[jira] [Closed] (FLINK-8723) Remove existing BroadcastState examples.

2018-02-21 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas Kloudas closed FLINK-8723. - Resolution: Fixed Merged at 2fa8a158640ab9a46c2bfb6610766e2458ebe7a2 > Remove existing BroadcastS

[GitHub] flink pull request #5542: [FLINK-8703][tests] Migrate tests from LocalFlinkM...

2018-02-21 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/5542#discussion_r169648970 --- Diff: flink-tests/src/test/java/org/apache/flink/test/streaming/runtime/BigUserProgramJobSubmitITCase.java --- @@ -43,40 +40,27 @@ /** * Int

[jira] [Commented] (FLINK-8703) Migrate tests from LocalFlinkMiniCluster to MiniClusterResource

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371461#comment-16371461 ] ASF GitHub Bot commented on FLINK-8703: --- Github user aljoscha commented on a diff in

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-21 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r169649287 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@ -336,1

[jira] [Created] (FLINK-8730) Make SerializedThrowable deserialized from JSON re-throwable

2018-02-21 Thread Gary Yao (JIRA)
Gary Yao created FLINK-8730: --- Summary: Make SerializedThrowable deserialized from JSON re-throwable Key: FLINK-8730 URL: https://issues.apache.org/jira/browse/FLINK-8730 Project: Flink Issue Type:

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-21 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r169651017 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@ -336,1697 +

[jira] [Updated] (FLINK-8718) Non-parallel DataStreamSource does not set max parallelism

2018-02-21 Thread Gary Yao (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Yao updated FLINK-8718: Component/s: (was: Core) > Non-parallel DataStreamSource does not set max parallelism >

[jira] [Updated] (FLINK-8718) Non-parallel DataStreamSource does not set max parallelism

2018-02-21 Thread Gary Yao (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Yao updated FLINK-8718: Component/s: DataStream API > Non-parallel DataStreamSource does not set max parallelism > -

[jira] [Updated] (FLINK-8718) Non-parallel DataStreamSource does not set max parallelism

2018-02-21 Thread Gary Yao (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Yao updated FLINK-8718: Component/s: Streaming > Non-parallel DataStreamSource does not set max parallelism > --

[jira] [Assigned] (FLINK-8729) Migrate JSONGenerator from Sling to Jackson

2018-02-21 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-8729: --- Assignee: Chesnay Schepler > Migrate JSONGenerator from Sling to Jackson > --

[jira] [Updated] (FLINK-8729) Migrate JSONGenerator from Sling to Jackson

2018-02-21 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-8729: Summary: Migrate JSONGenerator from Sling to Jackson (was: Migrate JSONGenerator from Slink

[jira] [Assigned] (FLINK-8704) Migrate tests from TestingCluster to MiniClusterResource

2018-02-21 Thread mingleizhang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingleizhang reassigned FLINK-8704: --- Assignee: mingleizhang > Migrate tests from TestingCluster to MiniClusterResource > -

[jira] [Commented] (FLINK-8718) Non-parallel DataStreamSource does not set max parallelism

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371477#comment-16371477 ] ASF GitHub Bot commented on FLINK-8718: --- GitHub user GJL opened a pull request:

[GitHub] flink pull request #5545: [FLINK-8718][DataStream] Set maxParallelism on non...

2018-02-21 Thread GJL
GitHub user GJL opened a pull request: https://github.com/apache/flink/pull/5545 [FLINK-8718][DataStream] Set maxParallelism on non-parallel DataStreamSource ## What is the purpose of the change *Set maxParallelism to 1 on `org.apache.flink.streaming.api.datastream.DataStre

[jira] [Assigned] (FLINK-8730) Make SerializedThrowable deserialized from JSON re-throwable

2018-02-21 Thread Gary Yao (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Yao reassigned FLINK-8730: --- Assignee: Gary Yao > Make SerializedThrowable deserialized from JSON re-throwable > -

[jira] [Commented] (FLINK-8543) Output Stream closed at org.apache.hadoop.fs.s3a.S3AOutputStream.checkOpen

2018-02-21 Thread chris snow (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371485#comment-16371485 ] chris snow commented on FLINK-8543: --- Unfortunately, commenting out the call to super.clo

[GitHub] flink issue #5544: [FLINK-8645][configuration] Split classloader.parent-firs...

2018-02-21 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5544 Good change in principle, but I think "base" and "append" are not a great choice of names for the parameters. Probably not very intuitive for users. How about calling them `default` and `

[jira] [Commented] (FLINK-8645) Support convenient extension of parent-first ClassLoader patterns

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371503#comment-16371503 ] ASF GitHub Bot commented on FLINK-8645: --- Github user StephanEwen commented on the is

[GitHub] flink pull request #5544: [FLINK-8645][configuration] Split classloader.pare...

2018-02-21 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/5544#discussion_r169660742 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/CoreOptions.java --- @@ -86,11 +86,42 @@ * */ public static

[jira] [Commented] (FLINK-8645) Support convenient extension of parent-first ClassLoader patterns

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371505#comment-16371505 ] ASF GitHub Bot commented on FLINK-8645: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request #5546: [FLINK-8730][REST] JSON serialize entire Serialize...

2018-02-21 Thread GJL
GitHub user GJL opened a pull request: https://github.com/apache/flink/pull/5546 [FLINK-8730][REST] JSON serialize entire SerializedThrowable ## What is the purpose of the change *For the JSON representation, do not only serialize the serialized exception but the entire Ser

[jira] [Commented] (FLINK-8730) Make SerializedThrowable deserialized from JSON re-throwable

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371522#comment-16371522 ] ASF GitHub Bot commented on FLINK-8730: --- GitHub user GJL opened a pull request:

[GitHub] flink pull request #5547: [FLINK-8704] [tests] Port AccumulatorLiveITCase to...

2018-02-21 Thread zhangminglei
GitHub user zhangminglei opened a pull request: https://github.com/apache/flink/pull/5547 [FLINK-8704] [tests] Port AccumulatorLiveITCase to MiniClusterResource ## What is the purpose of the change This PR contains the first batch of test ports from ```TestingCluster``` to ```Mi

[jira] [Commented] (FLINK-8704) Migrate tests from TestingCluster to MiniClusterResource

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371530#comment-16371530 ] ASF GitHub Bot commented on FLINK-8704: --- GitHub user zhangminglei opened a pull requ

[jira] [Commented] (FLINK-8717) Flink seems to deadlock due to buffer starvation when iterating

2018-02-21 Thread Ken Krugler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371539#comment-16371539 ] Ken Krugler commented on FLINK-8717: Hi [~rrevol] - sadly the iteration improvements (

[jira] [Commented] (FLINK-8717) Flink seems to deadlock due to buffer starvation when iterating

2018-02-21 Thread Romain Revol (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371542#comment-16371542 ] Romain Revol commented on FLINK-8717: - Hi, sadly indeed. Did you finally find a workar

[jira] [Commented] (FLINK-8543) Output Stream closed at org.apache.hadoop.fs.s3a.S3AOutputStream.checkOpen

2018-02-21 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371570#comment-16371570 ] Aljoscha Krettek commented on FLINK-8543: - Regarding IBM COS S3: Yes, that sounds

[jira] [Created] (FLINK-8731) TwoInputStreamTaskTest flaky on travis

2018-02-21 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8731: --- Summary: TwoInputStreamTaskTest flaky on travis Key: FLINK-8731 URL: https://issues.apache.org/jira/browse/FLINK-8731 Project: Flink Issue Type: Improv

[jira] [Updated] (FLINK-8731) TwoInputStreamTaskTest flaky on travis

2018-02-21 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-8731: Labels: test-stability (was: ) > TwoInputStreamTaskTest flaky on travis > -

[jira] [Updated] (FLINK-8732) Cancel scheduling operation when cancelling the ExecutionGraph

2018-02-21 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-8732: - Labels: flip-6 (was: ) > Cancel scheduling operation when cancelling the ExecutionGraph > ---

[jira] [Created] (FLINK-8732) Cancel scheduling operation when cancelling the ExecutionGraph

2018-02-21 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8732: Summary: Cancel scheduling operation when cancelling the ExecutionGraph Key: FLINK-8732 URL: https://issues.apache.org/jira/browse/FLINK-8732 Project: Flink

[jira] [Assigned] (FLINK-8732) Cancel scheduling operation when cancelling the ExecutionGraph

2018-02-21 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann reassigned FLINK-8732: Assignee: Till Rohrmann > Cancel scheduling operation when cancelling the ExecutionGraph >

[jira] [Updated] (FLINK-8732) Cancel scheduling operation when cancelling the ExecutionGraph

2018-02-21 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-8732: - Description: With the Flip-6 changes and the support for queued scheduling, the {{ExecutionGraph}

[jira] [Updated] (FLINK-8731) TwoInputStreamTaskTest flaky on travis

2018-02-21 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8731: Priority: Blocker (was: Major) > TwoInputStreamTaskTest flaky on travis > -

[jira] [Updated] (FLINK-8731) TwoInputStreamTaskTest flaky on travis

2018-02-21 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8731: Fix Version/s: 1.5.0 > TwoInputStreamTaskTest flaky on travis >

[GitHub] flink pull request #5548: [FLINK-8732] [flip6] Cancel ongoing scheduling ope...

2018-02-21 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5548 [FLINK-8732] [flip6] Cancel ongoing scheduling operation ## What is the purpose of the change Keeps track of ongoing scheduling operations in the ExecutionGraph and cancels them in

[jira] [Commented] (FLINK-8732) Cancel scheduling operation when cancelling the ExecutionGraph

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371597#comment-16371597 ] ASF GitHub Bot commented on FLINK-8732: --- GitHub user tillrohrmann opened a pull requ

<    1   2   3   4   >