[jira] [Updated] (FLINK-8532) RebalancePartitioner should use Random value for its first partition

2018-01-30 Thread Yuta Morisawa (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuta Morisawa updated FLINK-8532: - Description: In some conditions, RebalancePartitioner doesn't balance data correctly because it

[jira] [Commented] (FLINK-8357) enable rolling in default log settings

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346376#comment-16346376 ] ASF GitHub Bot commented on FLINK-8357: --- Github user zhangminglei commented on the issue:

[jira] [Created] (FLINK-8532) RebalancePartitioner should use Random value for its first partition

2018-01-30 Thread Yuta Morisawa (JIRA)
Yuta Morisawa created FLINK-8532: Summary: RebalancePartitioner should use Random value for its first partition Key: FLINK-8532 URL: https://issues.apache.org/jira/browse/FLINK-8532 Project: Flink

[jira] [Updated] (FLINK-8532) RebalancePartitioner should use Random value for its first partition

2018-01-30 Thread Yuta Morisawa (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuta Morisawa updated FLINK-8532: - Description: In some conditions, RebalancePartitioner doesn't balance data correctly because it

[GitHub] flink issue #5371: [FLINK-8357] [conf] Enable rolling in default log setting...

2018-01-30 Thread zhangminglei
Github user zhangminglei commented on the issue: https://github.com/apache/flink/pull/5371 I watched and the Travis error does not relevant to this issue. ---

[jira] [Commented] (FLINK-7095) Add proper command line parsing tool to TaskManagerRunner.main

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346366#comment-16346366 ] ASF GitHub Bot commented on FLINK-7095: --- Github user zhangminglei commented on the issue:

[GitHub] flink issue #5375: [FLINK-7095] [TaskManager] Add Command line parsing tool ...

2018-01-30 Thread zhangminglei
Github user zhangminglei commented on the issue: https://github.com/apache/flink/pull/5375 @tillrohrmann It seems that now there is not any ```Option``` be registered for later parse the ```configDir ``` parameter I just checked. I either register the ```configDir``` parameter in

[jira] [Commented] (FLINK-8407) Setting the parallelism after a partitioning operation should be forbidden

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346348#comment-16346348 ] ASF GitHub Bot commented on FLINK-8407: --- Github user xccui commented on the issue:

[GitHub] flink issue #5369: [FLINK-8407][DataStream]Setting the parallelism after a p...

2018-01-30 Thread xccui
Github user xccui commented on the issue: https://github.com/apache/flink/pull/5369 Ah ha, it doesn't matter. 😄 The test has been updated. Actually, I wanted to ensure that all the partitioning methods should cause the exception. However, that would be fussy and thus I only kept

[jira] [Commented] (FLINK-8101) Elasticsearch 6.x support

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346320#comment-16346320 ] ASF GitHub Bot commented on FLINK-8101: --- Github user yew1eb commented on a diff in the pull request:

[GitHub] flink pull request #5374: [FLINK-8101][flink-connectors] Elasticsearch 5.3+ ...

2018-01-30 Thread yew1eb
Github user yew1eb commented on a diff in the pull request: https://github.com/apache/flink/pull/5374#discussion_r164961589 --- Diff: flink-connectors/flink-connector-elasticsearch-base/src/main/java/org/apache/flink/streaming/connectors/elasticsearch/ElasticsearchSinkBase.java ---

[jira] [Commented] (FLINK-8516) FlinkKinesisConsumer does not balance shards over subtasks

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346257#comment-16346257 ] ASF GitHub Bot commented on FLINK-8516: --- Github user tweise commented on a diff in the pull request:

[GitHub] flink pull request #5393: [FLINK-8516] Allow for custom hash function for sh...

2018-01-30 Thread tweise
Github user tweise commented on a diff in the pull request: https://github.com/apache/flink/pull/5393#discussion_r164952695 --- Diff: flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/FlinkKinesisConsumer.java --- @@ -93,6 +93,12

[jira] [Commented] (FLINK-8357) enable rolling in default log settings

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346201#comment-16346201 ] ASF GitHub Bot commented on FLINK-8357: --- Github user zhangminglei commented on the issue:

[GitHub] flink issue #5371: [FLINK-8357] [conf] Enable rolling in default log setting...

2018-01-30 Thread zhangminglei
Github user zhangminglei commented on the issue: https://github.com/apache/flink/pull/5371 I have changed the code, @StephanEwen @XuMingmin Welcome to review those codes ~ Thanks. I make the ```MaxFileSize``` to 200MB and storage for 30 days now. ---

[jira] [Comment Edited] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-01-30 Thread yanxiaobin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346180#comment-16346180 ] yanxiaobin edited comment on FLINK-8500 at 1/31/18 3:09 AM: hi,[~aljoscha] ,

[jira] [Comment Edited] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-01-30 Thread yanxiaobin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346180#comment-16346180 ] yanxiaobin edited comment on FLINK-8500 at 1/31/18 3:01 AM: hi,[~aljoscha] ,

[jira] [Commented] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-01-30 Thread yanxiaobin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346180#comment-16346180 ] yanxiaobin commented on FLINK-8500: --- hi,[~aljoscha] , thank you for your reply!Please look at the next

[jira] [Updated] (FLINK-8526) When use parallelism equals to half of the number of cpu, join and shuffle operators will easly cause deadlock.

2018-01-30 Thread zhu.qing (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhu.qing updated FLINK-8526: Description: The next program attached will stuck at some special parallelism in some situation. When

[jira] [Updated] (FLINK-8526) When use parallelism equals to half of the number of cpu, join and shuffle operators will easly cause deadlock.

2018-01-30 Thread zhu.qing (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhu.qing updated FLINK-8526: Description: The next program attached will stuck at some special parallelism in some situation. When

[jira] [Updated] (FLINK-8526) When use parallelism equals to half of the taskslot, join and shuffle operators will easly cause deadlock.

2018-01-30 Thread zhu.qing (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhu.qing updated FLINK-8526: Description: The next program attached will stuck at some special parallelism in some situation. When

[jira] [Updated] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-01-30 Thread yanxiaobin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yanxiaobin updated FLINK-8500: -- Attachment: image-2018-01-31-10-48-59-633.png > Get the timestamp of the Kafka message from kafka

[jira] [Updated] (FLINK-8526) When use parallelism equals to half of the number of cpu, join and shuffle operators will easly cause deadlock.

2018-01-30 Thread zhu.qing (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhu.qing updated FLINK-8526: Summary: When use parallelism equals to half of the number of cpu, join and shuffle operators will easly

[jira] [Updated] (FLINK-8526) When use parallelism equals to half of the taskslot, join and shuffle operators will easly cause deadlock.

2018-01-30 Thread zhu.qing (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhu.qing updated FLINK-8526: Summary: When use parallelism equals to half of the taskslot, join and shuffle operators will easly cause

[jira] [Updated] (FLINK-8526) When use parallelism equals to half of the taskslot, join and shuffle operators will easly caused deadlock.

2018-01-30 Thread zhu.qing (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhu.qing updated FLINK-8526: Summary: When use parallelism equals to half of the taskslot, join and shuffle operators will easly caused

[jira] [Updated] (FLINK-8526) When use parallelism equals to half of the taskslot, join and shuffle operator will easly caused deadlock.

2018-01-30 Thread zhu.qing (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhu.qing updated FLINK-8526: Summary: When use parallelism equals to half of the taskslot, join and shuffle operator will easly caused

[jira] [Commented] (FLINK-8357) enable rolling in default log settings

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346161#comment-16346161 ] ASF GitHub Bot commented on FLINK-8357: --- Github user zhangminglei commented on a diff in the pull

[jira] [Commented] (FLINK-8357) enable rolling in default log settings

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346159#comment-16346159 ] ASF GitHub Bot commented on FLINK-8357: --- Github user zhangminglei commented on a diff in the pull

[jira] [Commented] (FLINK-8357) enable rolling in default log settings

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346162#comment-16346162 ] ASF GitHub Bot commented on FLINK-8357: --- Github user zhangminglei commented on a diff in the pull

[GitHub] flink pull request #5371: [FLINK-8357] [conf] Enable rolling in default log ...

2018-01-30 Thread zhangminglei
Github user zhangminglei commented on a diff in the pull request: https://github.com/apache/flink/pull/5371#discussion_r164940131 --- Diff: flink-dist/src/main/flink-bin/conf/logback-yarn.xml --- @@ -17,7 +17,7 @@ --> - + --- End diff --

[GitHub] flink pull request #5371: [FLINK-8357] [conf] Enable rolling in default log ...

2018-01-30 Thread zhangminglei
Github user zhangminglei commented on a diff in the pull request: https://github.com/apache/flink/pull/5371#discussion_r164940108 --- Diff: flink-dist/src/main/flink-bin/conf/log4j.properties --- @@ -31,10 +31,11 @@ log4j.logger.org.apache.hadoop=INFO

[GitHub] flink pull request #5371: [FLINK-8357] [conf] Enable rolling in default log ...

2018-01-30 Thread zhangminglei
Github user zhangminglei commented on a diff in the pull request: https://github.com/apache/flink/pull/5371#discussion_r164940066 --- Diff: flink-dist/src/main/flink-bin/conf/log4j-cli.properties --- @@ -19,10 +19,11 @@ log4j.rootLogger=INFO, file # Log all infos in

[jira] [Commented] (FLINK-8516) FlinkKinesisConsumer does not balance shards over subtasks

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346124#comment-16346124 ] ASF GitHub Bot commented on FLINK-8516: --- Github user tweise closed the pull request at:

[GitHub] flink pull request #5393: [FLINK-8516] Allow for custom hash function for sh...

2018-01-30 Thread tweise
Github user tweise closed the pull request at: https://github.com/apache/flink/pull/5393 ---

[jira] [Commented] (FLINK-8516) FlinkKinesisConsumer does not balance shards over subtasks

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346121#comment-16346121 ] ASF GitHub Bot commented on FLINK-8516: --- GitHub user tweise opened a pull request:

[GitHub] flink pull request #5393: [FLINK-8516] Allow for custom hash function for sh...

2018-01-30 Thread tweise
GitHub user tweise opened a pull request: https://github.com/apache/flink/pull/5393 [FLINK-8516] Allow for custom hash function for shard to subtask mapping in Kinesis consumer *Thank you very much for contributing to Apache Flink - we are happy that you want to

[jira] [Updated] (FLINK-7775) Remove unreferenced method PermanentBlobCache#getNumberOfCachedJobs

2018-01-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-7775: -- Description: {code} public int getNumberOfCachedJobs() { return jobRefCounters.size(); } {code} The

[jira] [Updated] (FLINK-7917) The return of taskInformationOrBlobKey should be placed inside synchronized in ExecutionJobVertex

2018-01-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-7917: -- Component/s: Local Runtime > The return of taskInformationOrBlobKey should be placed inside synchronized > in

[jira] [Commented] (FLINK-3089) State API Should Support Data Expiration (State TTL)

2018-01-30 Thread Bowen Li (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345958#comment-16345958 ] Bowen Li commented on FLINK-3089: - I wrote [this brief design

[jira] [Commented] (FLINK-7795) Utilize error-prone to discover common coding mistakes

2018-01-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345955#comment-16345955 ] Ted Yu commented on FLINK-7795: --- error-prone has JDK 8 dependency. > Utilize error-prone to discover common

[jira] [Updated] (FLINK-8037) Missing cast in integer arithmetic in TransactionalIdsGenerator#generateIdsToAbort

2018-01-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-8037: -- Labels: kafka-connect (was: ) > Missing cast in integer arithmetic in >

[jira] [Commented] (FLINK-8335) Upgrade hbase connector dependency to 1.4.0

2018-01-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345946#comment-16345946 ] Ted Yu commented on FLINK-8335: --- 1.4.1 RC is being voted. Once it passes, we can upgrade to 1.4.1 >

[jira] [Commented] (FLINK-8357) enable rolling in default log settings

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345905#comment-16345905 ] ASF GitHub Bot commented on FLINK-8357: --- Github user XuMingmin commented on a diff in the pull

[jira] [Commented] (FLINK-8357) enable rolling in default log settings

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345907#comment-16345907 ] ASF GitHub Bot commented on FLINK-8357: --- Github user XuMingmin commented on a diff in the pull

[jira] [Commented] (FLINK-8357) enable rolling in default log settings

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345906#comment-16345906 ] ASF GitHub Bot commented on FLINK-8357: --- Github user XuMingmin commented on a diff in the pull

[GitHub] flink pull request #5371: [FLINK-8357] [conf] Enable rolling in default log ...

2018-01-30 Thread XuMingmin
Github user XuMingmin commented on a diff in the pull request: https://github.com/apache/flink/pull/5371#discussion_r164895415 --- Diff: flink-dist/src/main/flink-bin/conf/log4j-cli.properties --- @@ -19,10 +19,11 @@ log4j.rootLogger=INFO, file # Log all infos in

[GitHub] flink pull request #5371: [FLINK-8357] [conf] Enable rolling in default log ...

2018-01-30 Thread XuMingmin
Github user XuMingmin commented on a diff in the pull request: https://github.com/apache/flink/pull/5371#discussion_r164895503 --- Diff: flink-dist/src/main/flink-bin/conf/log4j.properties --- @@ -31,10 +31,11 @@ log4j.logger.org.apache.hadoop=INFO

[GitHub] flink pull request #5371: [FLINK-8357] [conf] Enable rolling in default log ...

2018-01-30 Thread XuMingmin
Github user XuMingmin commented on a diff in the pull request: https://github.com/apache/flink/pull/5371#discussion_r164895963 --- Diff: flink-dist/src/main/flink-bin/conf/logback-yarn.xml --- @@ -17,7 +17,7 @@ --> - + --- End diff --

[jira] [Commented] (FLINK-8504) TaskExecutor does not properly deregisters JobManager from JobLeaderService

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345880#comment-16345880 ] ASF GitHub Bot commented on FLINK-8504: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5361: [FLINK-8504] [flip6] Deregister jobs from the JobL...

2018-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5361 ---

[jira] [Closed] (FLINK-8504) TaskExecutor does not properly deregisters JobManager from JobLeaderService

2018-01-30 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-8504. Resolution: Fixed Fixed via e94a488dd78e7c2efdf55a67cea886ee15a641a6 > TaskExecutor does not

[jira] [Created] (FLINK-8531) Support separation of "Exclusive", "Shared" and "Task owned" state

2018-01-30 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8531: --- Summary: Support separation of "Exclusive", "Shared" and "Task owned" state Key: FLINK-8531 URL: https://issues.apache.org/jira/browse/FLINK-8531 Project: Flink

[jira] [Resolved] (FLINK-5823) Store Checkpoint Root Metadata in StateBackend (not in HA custom store)

2018-01-30 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-5823. - Resolution: Fixed Fixed via edc6f1000704a492629d7bdf8cbfa5ba5c45bb1f > Store Checkpoint Root

[jira] [Closed] (FLINK-5823) Store Checkpoint Root Metadata in StateBackend (not in HA custom store)

2018-01-30 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-5823. --- > Store Checkpoint Root Metadata in StateBackend (not in HA custom store) >

[jira] [Created] (FLINK-8530) Enable detached job submission for RestClusterClient

2018-01-30 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8530: Summary: Enable detached job submission for RestClusterClient Key: FLINK-8530 URL: https://issues.apache.org/jira/browse/FLINK-8530 Project: Flink Issue

[jira] [Commented] (FLINK-8522) DefaultOperatorStateBackend writes data in checkpoint that is never read.

2018-01-30 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345395#comment-16345395 ] Kostas Kloudas commented on FLINK-8522: --- There is a commit for this here:

[jira] [Commented] (FLINK-8345) Iterate over keyed state on broadcast side of connect with broadcast.

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345394#comment-16345394 ] ASF GitHub Bot commented on FLINK-8345: --- Github user kl0u commented on the issue:

[GitHub] flink issue #5230: [FLINK-8345] Add iterator of keyed state on broadcast sid...

2018-01-30 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5230 @aljoscha and @tzulitai ready for another review. ---

[jira] [Updated] (FLINK-8411) HeapListState#add(null) will wipe out entire list state

2018-01-30 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8411: Fix Version/s: (was: 1.4.1) > HeapListState#add(null) will wipe out entire list state >

[jira] [Reopened] (FLINK-8411) HeapListState#add(null) will wipe out entire list state

2018-01-30 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened FLINK-8411: - Reopen to change fixVersion because I'm reverting on 1.4.x because it is a semantical change

[jira] [Commented] (FLINK-8407) Setting the parallelism after a partitioning operation should be forbidden

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345369#comment-16345369 ] ASF GitHub Bot commented on FLINK-8407: --- Github user aljoscha commented on the issue:

[GitHub] flink issue #5369: [FLINK-8407][DataStream]Setting the parallelism after a p...

2018-01-30 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5369 Ah dammit, you are right that you we can't actually test that the method works correctly because there is no such method. That was stupid, sorry for that! 😅 ---

[jira] [Commented] (FLINK-4812) Report Watermark metrics in all operators

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345340#comment-16345340 ] ASF GitHub Bot commented on FLINK-4812: --- Github user aljoscha commented on the issue:

[GitHub] flink issue #5155: [FLINK-4812][metrics] Expose currentLowWatermark for all ...

2018-01-30 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5155 I like this a lot now! 👍 One last comment/idea I had is this: I don't like that `StreamTask` has `getInputWatermarkGauge()` for the only reason that we need it in the `OperatorChain`

[jira] [Commented] (FLINK-7608) LatencyGauge change to histogram metric

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345247#comment-16345247 ] ASF GitHub Bot commented on FLINK-7608: --- Github user aljoscha commented on a diff in the pull

[GitHub] flink pull request #5161: [FLINK-7608][metric] Refactor latency statistics m...

2018-01-30 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/5161#discussion_r164780848 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/AbstractStreamOperator.java --- @@ -194,14 +190,20 @@ public void

[jira] [Commented] (FLINK-7608) LatencyGauge change to histogram metric

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345237#comment-16345237 ] ASF GitHub Bot commented on FLINK-7608: --- Github user aljoscha commented on the issue:

[GitHub] flink issue #5161: [FLINK-7608][metric] Refactor latency statistics metric

2018-01-30 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5161 @yew1eb by `operatorName`, do you mean the `name()` or `uid()`, I think both of these could make sense. ---

[jira] [Commented] (FLINK-8525) Improve queryable state code examples

2018-01-30 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345234#comment-16345234 ] Kostas Kloudas commented on FLINK-8525: --- Yes, this is something that is not included in the

[jira] [Commented] (FLINK-8525) Improve queryable state code examples

2018-01-30 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345221#comment-16345221 ] Chesnay Schepler commented on FLINK-8525: - One thing that should be shown is how to actually

[jira] [Commented] (FLINK-8479) Implement time-bounded inner join of streams as a TwoInputStreamOperator

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345220#comment-16345220 ] ASF GitHub Bot commented on FLINK-8479: --- Github user kl0u commented on a diff in the pull request:

[GitHub] flink pull request #5342: [FLINK-8479] Timebounded stream join

2018-01-30 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5342#discussion_r164776439 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/TimeBoundedStreamJoinOperator.java --- @@ -0,0 +1,398 @@ +/* + *

[jira] [Closed] (FLINK-4765) Migrate ConfigConstants to ConfigOptions

2018-01-30 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-4765. --- Resolution: Fixed Fix Version/s: 1.5.0 The majority of options have been ported, a few

[jira] [Assigned] (FLINK-4767) Migrate JobManager configuration options

2018-01-30 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-4767: --- Assignee: (was: Chesnay Schepler) > Migrate JobManager configuration options >

[jira] [Closed] (FLINK-4767) Migrate JobManager configuration options

2018-01-30 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-4767. --- Resolution: Fixed Fix Version/s: 1.5.0 Was fixed in the mean-time. > Migrate

[jira] [Assigned] (FLINK-4767) Migrate JobManager configuration options

2018-01-30 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-4767: --- Assignee: Chesnay Schepler > Migrate JobManager configuration options >

[jira] [Commented] (FLINK-8479) Implement time-bounded inner join of streams as a TwoInputStreamOperator

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345206#comment-16345206 ] ASF GitHub Bot commented on FLINK-8479: --- Github user fhueske commented on a diff in the pull

[GitHub] flink pull request #5342: [FLINK-8479] Timebounded stream join

2018-01-30 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/5342#discussion_r164773927 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/TimeBoundedStreamJoinOperator.java --- @@ -0,0 +1,398 @@ +/*

[jira] [Commented] (FLINK-8475) Move remaining sections to generated tables

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345198#comment-16345198 ] ASF GitHub Bot commented on FLINK-8475: --- GitHub user zentol opened a pull request:

[GitHub] flink pull request #5392: [FLINK-8475][config][docs] Integrate JM options

2018-01-30 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/5392 [FLINK-8475][config][docs] Integrate JM options ## What is the purpose of the change This PR integrates the JobManager `ConfigOptions` into the configuration docs generator. ##

[jira] [Commented] (FLINK-8475) Move remaining sections to generated tables

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345185#comment-16345185 ] ASF GitHub Bot commented on FLINK-8475: --- GitHub user zentol opened a pull request:

[GitHub] flink pull request #5391: [FLINK-8475][config][docs] Integrate BlobServer op...

2018-01-30 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/5391 [FLINK-8475][config][docs] Integrate BlobServer options ## What is the purpose of the change This PR adds the BlobServer `ConfigOptions` to the full configuration reference. ##

[jira] [Commented] (FLINK-8476) ConfigConstants#DEFAULT_HA_JOB_MANAGER_PORT unused

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345170#comment-16345170 ] ASF GitHub Bot commented on FLINK-8476: --- Github user asfgit closed the pull request at:

[jira] [Closed] (FLINK-6623) BlobCacheSuccessTest fails on Windows

2018-01-30 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-6623. --- Resolution: Fixed Fix Version/s: 1.5.0 master:

[jira] [Commented] (FLINK-8479) Implement time-bounded inner join of streams as a TwoInputStreamOperator

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345166#comment-16345166 ] ASF GitHub Bot commented on FLINK-8479: --- Github user kl0u commented on a diff in the pull request:

[GitHub] flink pull request #5351: [FLINK-6623][Blob] BlobServer#putBuffer moves file...

2018-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5351 ---

[jira] [Commented] (FLINK-8494) Migrate CC#DEFAULT_PARALLELISM_KEY

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345172#comment-16345172 ] ASF GitHub Bot commented on FLINK-8494: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-6623) BlobCacheSuccessTest fails on Windows

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345171#comment-16345171 ] ASF GitHub Bot commented on FLINK-6623: --- Github user asfgit closed the pull request at:

[jira] [Closed] (FLINK-6464) Metric name is not stable

2018-01-30 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-6464. --- Resolution: Fixed Fix Version/s: (was: 1.4.1) master:

[jira] [Commented] (FLINK-6464) Metric name is not stable

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345169#comment-16345169 ] ASF GitHub Bot commented on FLINK-6464: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5338: [FLINK-8476][config][HA] Deprecate HA config const...

2018-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5338 ---

[jira] [Closed] (FLINK-5659) FileBaseUtils#deleteFileOrDirectory not thread-safe on Windows

2018-01-30 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-5659. --- Resolution: Fixed Fix Version/s: 1.5.0 master:

[GitHub] flink pull request #5377: [FLINK-8494][config] Migrate CC#DEFAULT_PARALLELIS...

2018-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5377 ---

[GitHub] flink pull request #5332: [FLINK-6464][streaming] Stabilize default window o...

2018-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5332 ---

[jira] [Closed] (FLINK-8476) ConfigConstants#DEFAULT_HA_JOB_MANAGER_PORT unused

2018-01-30 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-8476. --- Resolution: Fixed master: 83eb8e143ef64e56974a334ca96e10c011f4a32c >

[GitHub] flink pull request #5342: [FLINK-8479] Timebounded stream join

2018-01-30 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5342#discussion_r164766198 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/TimeBoundedStreamJoinOperator.java --- @@ -0,0 +1,398 @@ +/* + *

[jira] [Closed] (FLINK-8494) Migrate CC#DEFAULT_PARALLELISM_KEY

2018-01-30 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-8494. --- Resolution: Fixed master: 0e20b613087e1b326e05674e3d532ea4aa444bc3 > Migrate

[jira] [Commented] (FLINK-8407) Setting the parallelism after a partitioning operation should be forbidden

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345158#comment-16345158 ] ASF GitHub Bot commented on FLINK-8407: --- Github user xccui commented on the issue:

[jira] [Commented] (FLINK-8475) Move remaining sections to generated tables

2018-01-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345155#comment-16345155 ] ASF GitHub Bot commented on FLINK-8475: --- Github user aljoscha commented on the issue:

[GitHub] flink issue #5369: [FLINK-8407][DataStream]Setting the parallelism after a p...

2018-01-30 Thread xccui
Github user xccui commented on the issue: https://github.com/apache/flink/pull/5369 That makes sense to me. I just wonder what do you mean by "add a test for the Java API"... ---

  1   2   3   >