[jira] [Updated] (FLINK-7611) add metrics to measure the data drop by watermark

2017-09-11 Thread aitozi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] aitozi updated FLINK-7611: -- Affects Version/s: 1.3.0 > add metrics to measure the data drop by watermark >

[jira] [Commented] (FLINK-2395) Check Scala catch blocks for Throwable

2017-09-11 Thread mingleizhang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162401#comment-16162401 ] mingleizhang commented on FLINK-2395: - The link was broken. 404 error. > Check Scala catch blocks for

[jira] [Updated] (FLINK-7611) add metrics to measure the data drop by watermark

2017-09-11 Thread aitozi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] aitozi updated FLINK-7611: -- Affects Version/s: 1.2.0 > add metrics to measure the data drop by watermark >

[jira] [Closed] (FLINK-2428) Clean up unused properties in StreamConfig

2017-09-11 Thread Hai Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hai Zhou closed FLINK-2428. --- Resolution: Fixed > Clean up unused properties in StreamConfig > -- >

[jira] [Commented] (FLINK-3542) FlinkKafkaConsumer09 cannot handle changing number of partitions

2017-09-11 Thread Hai Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162054#comment-16162054 ] Hai Zhou commented on FLINK-3542: - [~till.rohrmann] In flink 1.3.x, FlinkKafkaConsumer08 also have this

[jira] [Comment Edited] (FLINK-6703) Document how to take a savepoint on YARN

2017-09-11 Thread Bowen Li (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161996#comment-16161996 ] Bowen Li edited comment on FLINK-6703 at 9/11/17 9:09 PM: -- I tested on our

[jira] [Commented] (FLINK-6703) Document how to take a savepoint on YARN

2017-09-11 Thread Bowen Li (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161996#comment-16161996 ] Bowen Li commented on FLINK-6703: - I tested on our Flink-YARN cluster, and {{-m yarn-cluster}} is actually

[jira] [Issue Comment Deleted] (FLINK-6703) Document how to take a savepoint on YARN

2017-09-11 Thread Bowen Li (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Li updated FLINK-6703: Comment: was deleted (was: [~Zentol] is this still valid? is the above savepoint command for Flink job

[jira] [Commented] (FLINK-6957) WordCountTable example cannot be run

2017-09-11 Thread Bowen Li (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161843#comment-16161843 ] Bowen Li commented on FLINK-6957: - [~Zentol] I'm able to run this example after running a build fot the

[jira] [Commented] (FLINK-7609) WindowWordCount example doesn't print countWindow output with default configs

2017-09-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161656#comment-16161656 ] ASF GitHub Bot commented on FLINK-7609: --- Github user bowenli86 commented on the issue:

[GitHub] flink issue #4662: [FLINK-7609][examples] WindowWordCount example doesn't pr...

2017-09-11 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/4662 There's no output with 100/50 either, because the default text we use at WordCountData.WORDS is not very long and cannot satisfy the count window size. There's only 11 window ouputs even with

[jira] [Commented] (FLINK-4047) Fix documentation about determinism of KeySelectors

2017-09-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161616#comment-16161616 ] ASF GitHub Bot commented on FLINK-4047: --- Github user zentol commented on the issue:

[GitHub] flink issue #4659: [FLINK-4047] Fix documentation about determinism of KeySe...

2017-09-11 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/4659 +1. ---

[jira] [Commented] (FLINK-7521) Remove the 10MB limit from the current REST implementation.

2017-09-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161611#comment-16161611 ] ASF GitHub Bot commented on FLINK-7521: --- Github user zentol commented on the issue:

[GitHub] flink issue #4654: [FLINK-7521] Add config option to set the content length ...

2017-09-11 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/4654 The actual solution that I'm thinking of currently is to have a modified `HttpObjectAggregator` implementation that spills larger messages to disk. ---

[GitHub] flink pull request #4647: [FLINK-7575] [WEB-DASHBOARD] Display "Fetching..."...

2017-09-11 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/4647#discussion_r138133547 --- Diff: flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/utils/MutableIOMetrics.java --- @@ -72,13 +72,54 @@ public void

[jira] [Commented] (FLINK-7575) Dashboard jobs/tasks metrics display 0 when metrics are not yet available

2017-09-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161608#comment-16161608 ] ASF GitHub Bot commented on FLINK-7575: --- Github user zentol commented on a diff in the pull request:

[jira] [Commented] (FLINK-7575) Dashboard jobs/tasks metrics display 0 when metrics are not yet available

2017-09-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161607#comment-16161607 ] ASF GitHub Bot commented on FLINK-7575: --- Github user zentol commented on a diff in the pull request:

[jira] [Commented] (FLINK-7575) Dashboard jobs/tasks metrics display 0 when metrics are not yet available

2017-09-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161609#comment-16161609 ] ASF GitHub Bot commented on FLINK-7575: --- Github user zentol commented on a diff in the pull request:

[GitHub] flink pull request #4647: [FLINK-7575] [WEB-DASHBOARD] Display "Fetching..."...

2017-09-11 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/4647#discussion_r138133369 --- Diff: flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/utils/MutableIOMetrics.java --- @@ -72,13 +72,54 @@ public void

[GitHub] flink pull request #4647: [FLINK-7575] [WEB-DASHBOARD] Display "Fetching..."...

2017-09-11 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/4647#discussion_r138133763 --- Diff: flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/utils/MutableIOMetrics.java --- @@ -99,11 +140,35 @@ public void

[jira] [Commented] (FLINK-7609) WindowWordCount example doesn't print countWindow output with default configs

2017-09-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161598#comment-16161598 ] ASF GitHub Bot commented on FLINK-7609: --- Github user zentol commented on the issue:

[GitHub] flink issue #4662: [FLINK-7609][examples] WindowWordCount example doesn't pr...

2017-09-11 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/4662 Aren't these values a bit too low? (I'm specifically worried about cases where users supply their own data) Would 100/50 maybe work? ---

[jira] [Commented] (FLINK-5944) Flink should support reading Snappy Files

2017-09-11 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161590#comment-16161590 ] Chesnay Schepler commented on FLINK-5944: - Option 2/3 are out imo as they extend the existing API

[jira] [Commented] (FLINK-4831) Implement a slf4j metric reporter

2017-09-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161582#comment-16161582 ] ASF GitHub Bot commented on FLINK-4831: --- Github user zentol commented on the issue:

[GitHub] flink issue #4661: [FLINK-4831] Implement a slf4j metric reporter

2017-09-11 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/4661 Really nice that you figured out to rename the package to slf4j :) I'll check this out in more detail next week. ---

[jira] [Commented] (FLINK-6549) Improve error message for type mismatches with side outputs

2017-09-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161573#comment-16161573 ] ASF GitHub Bot commented on FLINK-6549: --- Github user zentol commented on the issue:

[GitHub] flink issue #4663: [FLINK-6549] [DataStream API] Improve error message for t...

2017-09-11 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/4663 I think this looks good. ---

[jira] [Commented] (FLINK-7562) uploaded jars sort by upload-time on dashboard page

2017-09-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161570#comment-16161570 ] ASF GitHub Bot commented on FLINK-7562: --- Github user zentol commented on the issue:

[GitHub] flink issue #4664: [FLINK-7562] Show uploaded-jars descending by upload time

2017-09-11 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/4664 Ill check this out sometime next week. ---

[jira] [Commented] (FLINK-7521) Remove the 10MB limit from the current REST implementation.

2017-09-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161568#comment-16161568 ] ASF GitHub Bot commented on FLINK-7521: --- Github user zentol commented on the issue:

[GitHub] flink issue #4654: [FLINK-7521] Add config option to set the content length ...

2017-09-11 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/4654 removing the object aggregator will break the remaining pipeline, so that option is out too. As for the client upload, that's exactly whats being done right now. The jar is uploaded to the

[jira] [Created] (FLINK-7611) add metrics to measure the data drop by watermark

2017-09-11 Thread aitozi (JIRA)
aitozi created FLINK-7611: - Summary: add metrics to measure the data drop by watermark Key: FLINK-7611 URL: https://issues.apache.org/jira/browse/FLINK-7611 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-7606) Memory leak on NestedMapsStateTable

2017-09-11 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161200#comment-16161200 ] Kostas Kloudas commented on FLINK-7606: --- Hi Matteo, Thanks for reporting this! Any additional

[jira] [Commented] (FLINK-6444) Add a check that '@VisibleForTesting' methods are only used in tests

2017-09-11 Thread Hai Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161119#comment-16161119 ] Hai Zhou commented on FLINK-6444: - I already have an idea. When I am not busy with work;), I will go to

[jira] [Commented] (FLINK-4319) Rework Cluster Management (FLIP-6)

2017-09-11 Thread Ashish Pokharel (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161107#comment-16161107 ] Ashish Pokharel commented on FLINK-4319: Thanks Till - this ia great. > Rework Cluster Management

[jira] [Commented] (FLINK-7001) Improve performance of Sliding Time Window with pane optimization

2017-09-11 Thread Philipp Grulich (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161075#comment-16161075 ] Philipp Grulich commented on FLINK-7001: Hey, what is the current state of this? Over the last

[jira] [Commented] (FLINK-6444) Add a check that '@VisibleForTesting' methods are only used in tests

2017-09-11 Thread mingleizhang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160925#comment-16160925 ] mingleizhang commented on FLINK-6444: - Hello, [~StephanEwen] . I would like work on this. But I need

[jira] [Commented] (FLINK-4319) Rework Cluster Management (FLIP-6)

2017-09-11 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160890#comment-16160890 ] Till Rohrmann commented on FLINK-4319: -- Hi Ashish, great to hear that things are working so far :-)

[jira] [Commented] (FLINK-4796) Add new Sink interface with access to more meta data

2017-09-11 Thread Erik van Oosten (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160810#comment-16160810 ] Erik van Oosten commented on FLINK-4796: A workaround is to override {{setRuntimeContext}} (make