[jira] [Commented] (FLINK-8689) Add runtime support of distinct filter using MapView

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372422#comment-16372422 ] ASF GitHub Bot commented on FLINK-8689: --- GitHub user walterddr opened a pull request:

[GitHub] flink pull request #5555: [FLINK-8689][table]Add runtime support of distinct...

2018-02-21 Thread walterddr
GitHub user walterddr opened a pull request: https://github.com/apache/flink/pull/ [FLINK-8689][table]Add runtime support of distinct filter using MapView for codegen ## What is the purpose of the change - Adding in runtime support using distinct aggregation

[jira] [Commented] (FLINK-8704) Migrate tests from TestingCluster to MiniClusterResource

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372419#comment-16372419 ] ASF GitHub Bot commented on FLINK-8704: --- Github user zhangminglei closed the pull request at:

[GitHub] flink pull request #5547: [FLINK-8704] [tests] Port AccumulatorLiveITCase to...

2018-02-21 Thread zhangminglei
Github user zhangminglei closed the pull request at: https://github.com/apache/flink/pull/5547 ---

[jira] [Commented] (FLINK-8704) Migrate tests from TestingCluster to MiniClusterResource

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372417#comment-16372417 ] ASF GitHub Bot commented on FLINK-8704: --- Github user zhangminglei commented on the issue:

[GitHub] flink pull request #5547: [FLINK-8704] [tests] Port AccumulatorLiveITCase to...

2018-02-21 Thread zhangminglei
GitHub user zhangminglei reopened a pull request: https://github.com/apache/flink/pull/5547 [FLINK-8704] [tests] Port AccumulatorLiveITCase to MiniClusterResource ## What is the purpose of the change This PR contains the first batch of test ports from ```TestingCluster``` to

[jira] [Commented] (FLINK-8704) Migrate tests from TestingCluster to MiniClusterResource

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372418#comment-16372418 ] ASF GitHub Bot commented on FLINK-8704: --- GitHub user zhangminglei reopened a pull request:

[GitHub] flink issue #5547: [FLINK-8704] [tests] Port AccumulatorLiveITCase to MiniCl...

2018-02-21 Thread zhangminglei
Github user zhangminglei commented on the issue: https://github.com/apache/flink/pull/5547 @aljoscha Okay. thanks. I will follow those issues. ---

[jira] [Updated] (FLINK-8689) Add runtime support of distinct filter using MapView

2018-02-21 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-8689: - Summary: Add runtime support of distinct filter using MapView (was: Add runtime support of distinct

[jira] [Commented] (FLINK-8560) add KeyedProcessFunction to expose the key in onTimer() and other methods

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372176#comment-16372176 ] ASF GitHub Bot commented on FLINK-8560: --- Github user bowenli86 commented on the issue:

[GitHub] flink issue #5481: [FLINK-8560] Access to the current key in ProcessFunction...

2018-02-21 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5481 Thanks for the review and suggestions. And your comment on `DataStream#process(KeyedProcessFunction)` makes sense, I've removed it. (btw, I feel https://github.com/apache/flink/pull/5500

[jira] [Commented] (FLINK-8632) Generalize SavepointHandlers to be used for other asynchronous operations

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372161#comment-16372161 ] ASF GitHub Bot commented on FLINK-8632: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-8705) Integrate Remote(Stream)Environment with Flip-6 cluster

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372155#comment-16372155 ] ASF GitHub Bot commented on FLINK-8705: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-8631) Add support for generic response types to RestClient

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372160#comment-16372160 ] ASF GitHub Bot commented on FLINK-8631: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-7714) Port JarPlanHandler to new REST endpoint

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372159#comment-16372159 ] ASF GitHub Bot commented on FLINK-7714: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-7712) Port JarDeleteHandler to new REST endpoint

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372157#comment-16372157 ] ASF GitHub Bot commented on FLINK-7712: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-8710) AbstractYarnClusterDescriptor doesn't use pre-defined configs in Hadoop's YarnConfiguration

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372156#comment-16372156 ] ASF GitHub Bot commented on FLINK-8710: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-8711) Flink with YARN uses wrong SlotsPerTaskManager

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372158#comment-16372158 ] ASF GitHub Bot commented on FLINK-8711: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5533: [FLINK-7714][flip6] Port JarPlanHandler to new RES...

2018-02-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5533 ---

[GitHub] flink pull request #5532: [FLINK-8711] [yarn] Remove code which auto-magical...

2018-02-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5532 ---

[GitHub] flink pull request #5522: [FLINK-8710] [YARN] AbstractYarnClusterDescriptor ...

2018-02-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5522 ---

[GitHub] flink pull request #5527: [FLINK-8705] [flip6] Add Flip-6 support to Remote(...

2018-02-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5527 ---

[GitHub] flink pull request #5450: [FLINK-8631] [rest] Add support for generic types ...

2018-02-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5450 ---

[GitHub] flink pull request #5451: [FLINK-8632] [flip6] Introduce generalized asynchr...

2018-02-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5451 ---

[GitHub] flink pull request #5529: [FLINK-7712][flip6] Port JarDeleteHandler to new R...

2018-02-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5529 ---

[jira] [Created] (FLINK-8740) Job-level metrics lost during job re-submission in HA mode

2018-02-21 Thread Joshua DeWald (JIRA)
Joshua DeWald created FLINK-8740: Summary: Job-level metrics lost during job re-submission in HA mode Key: FLINK-8740 URL: https://issues.apache.org/jira/browse/FLINK-8740 Project: Flink

[jira] [Created] (FLINK-8739) Optimize runtime support for distinct filter to reuse same distinct accumulator for filtering

2018-02-21 Thread Rong Rong (JIRA)
Rong Rong created FLINK-8739: Summary: Optimize runtime support for distinct filter to reuse same distinct accumulator for filtering Key: FLINK-8739 URL: https://issues.apache.org/jira/browse/FLINK-8739

[jira] [Updated] (FLINK-8690) Update logical rule set to generate FlinkLogicalAggregate explicitly allow distinct agg on DataStream

2018-02-21 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-8690: - Description: **Currently, *FlinkLogicalAggregate* does not allow distinct aggregate. We are propose to

[jira] [Updated] (FLINK-8690) Update logical rule set to generate FlinkLogicalAggregate explicitly allow distinct agg on DataStream

2018-02-21 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-8690: - Description: **Currently, *FlinkLogicalAggregate* does not allow distinct aggregate. We are proposing to

[jira] [Updated] (FLINK-8689) Add runtime support of distinct filter using MapView for GenerateAggregation

2018-02-21 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-8689: - Description: This ticket should cover distinct aggregate function support to codegen for

[jira] [Updated] (FLINK-8690) Update logical rule set to generate FlinkLogicalAggregate explicitly allow distinct agg on DataStream

2018-02-21 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-8690: - Summary: Update logical rule set to generate FlinkLogicalAggregate explicitly allow distinct agg on

[jira] [Updated] (FLINK-8689) Add runtime support of distinct filter using MapView for GenerateAggregation

2018-02-21 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-8689: - Description: This should add distinct aggregate function support to codegen for `AggregateCall`, where

[jira] [Updated] (FLINK-8689) Add runtime support of distinct filter using MapView for GenerateAggregation

2018-02-21 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-8689: - Description: This ticket should cover distinct aggregate function support to codegen for

[jira] [Updated] (FLINK-8689) Add runtime support of distinct filter using MapView for GenerateAggregation

2018-02-21 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-8689: - Description: This should add distinct aggregate function support to codegen for `AggregateCall`, where

[jira] [Commented] (FLINK-8735) Add savepoint migration ITCase that covers operator state

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371842#comment-16371842 ] ASF GitHub Bot commented on FLINK-8735: --- Github user zentol commented on a diff in the pull request:

[jira] [Commented] (FLINK-8718) Non-parallel DataStreamSource does not set max parallelism

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372076#comment-16372076 ] ASF GitHub Bot commented on FLINK-8718: --- Github user tillrohrmann commented on the issue:

[GitHub] flink issue #5545: [FLINK-8718][DataStream] Set maxParallelism on non-parall...

2018-02-21 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/5545 Shouldn't it always be possible to merge n key groups into a single key group? Maybe this could be the backwards compatibility path. Moreover, which sources use keyed state? Don't

[jira] [Commented] (FLINK-8707) Excessive amount of files opened by flink task manager

2018-02-21 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372028#comment-16372028 ] Stephan Ewen commented on FLINK-8707: - If I understood the description by [~imogard] correct, then

[jira] [Closed] (FLINK-6489) Rework 'start-local.bat' to 'start-local-cluster.bat'

2018-02-21 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-6489. --- > Rework 'start-local.bat' to 'start-local-cluster.bat' >

[jira] [Resolved] (FLINK-6489) Rework 'start-local.bat' to 'start-local-cluster.bat'

2018-02-21 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-6489. - Resolution: Fixed Fix Version/s: 1.5.0 Fixed in c68f95c3e5e4fa0bce39915238209b238a8036a9

[jira] [Closed] (FLINK-8696) Remove JobManager local mode from the Unix Shell Scripts

2018-02-21 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-8696. --- > Remove JobManager local mode from the Unix Shell Scripts >

[jira] [Resolved] (FLINK-8696) Remove JobManager local mode from the Unix Shell Scripts

2018-02-21 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-8696. - Resolution: Fixed Fixed via d61664ca64bcb82c4e8ddf03a2ed38fe8edafa98 > Remove JobManager local

[jira] [Resolved] (FLINK-8738) Converge runtime dependency versions for 'scala-lang' and for 'com.typesafe:config'

2018-02-21 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-8738. - Resolution: Fixed Fixed in a844cd89207747a27535e8cb7cd8d6f4a332d8ed > Converge runtime

[jira] [Commented] (FLINK-6489) Rework 'start-local.bat' to 'start-local-cluster.bat'

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372016#comment-16372016 ] ASF GitHub Bot commented on FLINK-6489: --- Github user StephanEwen closed the pull request at:

[jira] [Commented] (FLINK-6489) Rework 'start-local.bat' to 'start-local-cluster.bat'

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372015#comment-16372015 ] ASF GitHub Bot commented on FLINK-6489: --- Github user StephanEwen commented on the issue:

[jira] [Closed] (FLINK-8738) Converge runtime dependency versions for 'scala-lang' and for 'com.typesafe:config'

2018-02-21 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-8738. --- > Converge runtime dependency versions for 'scala-lang' and for > 'com.typesafe:config' >

[GitHub] flink issue #5528: [FLINK-6489] [FLINK-8696] [shell scripts] Remove JobManag...

2018-02-21 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5528 Merged in 74c5570c9fa94d35e47899b0dcdc74a5d18750f6 ---

[GitHub] flink pull request #5528: [FLINK-6489] [FLINK-8696] [shell scripts] Remove J...

2018-02-21 Thread StephanEwen
Github user StephanEwen closed the pull request at: https://github.com/apache/flink/pull/5528 ---

[GitHub] flink pull request #5552: [FLINK-8735] Add new StatefulJobSavepointMigration...

2018-02-21 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5552#discussion_r169741935 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/utils/StatefulJobSavepointMigrationITCase.java --- @@ -0,0 +1,658 @@ +/* + *

[jira] [Commented] (FLINK-8543) Output Stream closed at org.apache.hadoop.fs.s3a.S3AOutputStream.checkOpen

2018-02-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371870#comment-16371870 ] Steve Loughran commented on FLINK-8543: --- There's no truncate operation in the S3 protocol; so not in

[GitHub] flink pull request #5552: [FLINK-8735] Add new StatefulJobSavepointMigration...

2018-02-21 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5552#discussion_r169734512 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/utils/StatefulJobSavepointMigrationITCase.java --- @@ -0,0 +1,658 @@ +/* + *

[jira] [Commented] (FLINK-8735) Add savepoint migration ITCase that covers operator state

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371867#comment-16371867 ] ASF GitHub Bot commented on FLINK-8735: --- Github user zentol commented on a diff in the pull request:

[GitHub] flink pull request #5552: [FLINK-8735] Add new StatefulJobSavepointMigration...

2018-02-21 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/flink/pull/5552 [FLINK-8735] Add new StatefulJobSavepointMigrationITCase R: @kl0u, and this is also relevant for your related PR that adds support for broadcast state. I think you would have to build on this new

[GitHub] flink pull request #5552: [FLINK-8735] Add new StatefulJobSavepointMigration...

2018-02-21 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5552#discussion_r169742676 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/utils/StatefulJobSavepointMigrationITCase.java --- @@ -0,0 +1,658 @@ +/* + *

[jira] [Commented] (FLINK-8735) Add savepoint migration ITCase that covers operator state

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371795#comment-16371795 ] ASF GitHub Bot commented on FLINK-8735: --- GitHub user aljoscha opened a pull request:

[GitHub] flink pull request #5554: [FLINK-8729][streaming] Refactor JSONGenerator to ...

2018-02-21 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/5554 [FLINK-8729][streaming] Refactor JSONGenerator to use jackson ## What is the purpose of the change This PR ports the `JSONGenerator` to rely on jackson instead of `org.apache.sling`.

[jira] [Commented] (FLINK-8543) Output Stream closed at org.apache.hadoop.fs.s3a.S3AOutputStream.checkOpen

2018-02-21 Thread chris snow (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371882#comment-16371882 ] chris snow commented on FLINK-8543: --- So all files being accompanied by .valid-length is expected

[jira] [Commented] (FLINK-8543) Output Stream closed at org.apache.hadoop.fs.s3a.S3AOutputStream.checkOpen

2018-02-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371976#comment-16371976 ] Steve Loughran commented on FLINK-8543: --- bq. So all files being accompanied by .valid-length is

[GitHub] flink issue #5544: [FLINK-8645][configuration] Split classloader.parent-firs...

2018-02-21 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5544 Looks good to me. Would be nice to have another opinion on the config key names. After all, I just suggested my personal opinion... ---

[jira] [Commented] (FLINK-8735) Add savepoint migration ITCase that covers operator state

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371866#comment-16371866 ] ASF GitHub Bot commented on FLINK-8735: --- Github user zentol commented on a diff in the pull request:

[jira] [Commented] (FLINK-8735) Add savepoint migration ITCase that covers operator state

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371843#comment-16371843 ] ASF GitHub Bot commented on FLINK-8735: --- Github user zentol commented on a diff in the pull request:

[jira] [Created] (FLINK-8738) Converge runtime dependency versions for 'scala-lang' and for 'com.typesafe:config'

2018-02-21 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8738: --- Summary: Converge runtime dependency versions for 'scala-lang' and for 'com.typesafe:config' Key: FLINK-8738 URL: https://issues.apache.org/jira/browse/FLINK-8738

[GitHub] flink issue #5552: [FLINK-8735] Add new StatefulJobSavepointMigrationITCase

2018-02-21 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5552 The sister PR for `release-1.4` is #5553 . ---

[jira] [Commented] (FLINK-8645) Support convenient extension of parent-first ClassLoader patterns

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371807#comment-16371807 ] ASF GitHub Bot commented on FLINK-8645: --- Github user StephanEwen commented on the issue:

[jira] [Commented] (FLINK-8735) Add savepoint migration ITCase that covers operator state

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371796#comment-16371796 ] ASF GitHub Bot commented on FLINK-8735: --- GitHub user aljoscha opened a pull request:

[jira] [Commented] (FLINK-8735) Add savepoint migration ITCase that covers operator state

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371869#comment-16371869 ] ASF GitHub Bot commented on FLINK-8735: --- Github user zentol commented on a diff in the pull request:

[jira] [Commented] (FLINK-8543) Output Stream closed at org.apache.hadoop.fs.s3a.S3AOutputStream.checkOpen

2018-02-21 Thread chris snow (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371855#comment-16371855 ] chris snow commented on FLINK-8543: --- Does Flink running on EMR using S3 have the same issue?  If not,

[jira] [Updated] (FLINK-8719) add README for flink-contrib to clarify its purpose

2018-02-21 Thread Bowen Li (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Li updated FLINK-8719: Summary: add README for flink-contrib to clarify its purpose (was: add module description for

[GitHub] flink pull request #5552: [FLINK-8735] Add new StatefulJobSavepointMigration...

2018-02-21 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5552#discussion_r169743891 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/utils/StatefulJobSavepointMigrationITCase.java --- @@ -0,0 +1,658 @@ +/* + *

[GitHub] flink pull request #5552: [FLINK-8735] Add new StatefulJobSavepointMigration...

2018-02-21 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5552#discussion_r169741385 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/utils/StatefulJobSavepointMigrationITCase.java --- @@ -0,0 +1,658 @@ +/* + *

[jira] [Comment Edited] (FLINK-8543) Output Stream closed at org.apache.hadoop.fs.s3a.S3AOutputStream.checkOpen

2018-02-21 Thread chris snow (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371882#comment-16371882 ] chris snow edited comment on FLINK-8543 at 2/21/18 7:42 PM: So all files being

[jira] [Commented] (FLINK-8729) Migrate JSONGenerator from Sling to Jackson

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371962#comment-16371962 ] ASF GitHub Bot commented on FLINK-8729: --- GitHub user zentol opened a pull request:

[jira] [Updated] (FLINK-8729) Migrate JSONGenerator from Sling to Jackson

2018-02-21 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-8729: Component/s: Build System > Migrate JSONGenerator from Sling to Jackson >

[GitHub] flink pull request #5552: [FLINK-8735] Add new StatefulJobSavepointMigration...

2018-02-21 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5552#discussion_r169745602 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/utils/LegacyStatefulJobSavepointMigrationITCase.java --- @@ -0,0 +1,663 @@ +/*

[jira] [Commented] (FLINK-8735) Add savepoint migration ITCase that covers operator state

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371876#comment-16371876 ] ASF GitHub Bot commented on FLINK-8735: --- Github user zentol commented on a diff in the pull request:

[GitHub] flink pull request #5552: [FLINK-8735] Add new StatefulJobSavepointMigration...

2018-02-21 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5552#discussion_r169740338 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/utils/StatefulJobSavepointMigrationITCase.java --- @@ -0,0 +1,658 @@ +/* + *

[jira] [Commented] (FLINK-8735) Add savepoint migration ITCase that covers operator state

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371868#comment-16371868 ] ASF GitHub Bot commented on FLINK-8735: --- Github user zentol commented on a diff in the pull request:

[jira] [Commented] (FLINK-8735) Add savepoint migration ITCase that covers operator state

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371865#comment-16371865 ] ASF GitHub Bot commented on FLINK-8735: --- Github user zentol commented on a diff in the pull request:

[GitHub] flink pull request #5552: [FLINK-8735] Add new StatefulJobSavepointMigration...

2018-02-21 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5552#discussion_r169738273 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/utils/LegacyStatefulJobSavepointMigrationITCase.java --- @@ -0,0 +1,663 @@ +/*

[jira] [Commented] (FLINK-8735) Add savepoint migration ITCase that covers operator state

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371797#comment-16371797 ] ASF GitHub Bot commented on FLINK-8735: --- Github user aljoscha commented on the issue:

[GitHub] flink pull request #5553: [FLINK-8735] Add new StatefulJobSavepointMigration...

2018-02-21 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/flink/pull/5553 [FLINK-8735] Add new StatefulJobSavepointMigrationITCase (release-1.4) Sister PR to #5552 for the release-1.4 branch. You can merge this pull request into a Git repository by running: $ git

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371780#comment-16371780 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371785#comment-16371785 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a diff in the pull

[GitHub] flink issue #5545: [FLINK-8718][DataStream] Set maxParallelism on non-parall...

2018-02-21 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5545 I'm not sure we can do this change since it breaks compatibility for savepoints because previous versions of Flink hat some `maxParallelism` setting for sources which would be incompatible with the

[jira] [Commented] (FLINK-8718) Non-parallel DataStreamSource does not set max parallelism

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371789#comment-16371789 ] ASF GitHub Bot commented on FLINK-8718: --- Github user aljoscha commented on the issue:

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371786#comment-16371786 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371784#comment-16371784 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371783#comment-16371783 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371787#comment-16371787 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371781#comment-16371781 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371782#comment-16371782 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a diff in the pull

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-21 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r169728016 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/SnapshotDirectory.java --- @@ -0,0 +1,172 @@ +/* + * Licensed to the

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-21 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r169726507 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/DirectoryStateHandle.java --- @@ -0,0 +1,101 @@ +/* + * Licensed to the

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-21 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r169727620 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/SnapshotDirectory.java --- @@ -0,0 +1,172 @@ +/* + * Licensed to the

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-21 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r169723987 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-21 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r169725430 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/CheckpointStreamWithResultProvider.java --- @@ -172,4 +167,30 @@ public

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-21 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r169727315 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/SnapshotDirectory.java --- @@ -0,0 +1,172 @@ +/* + * Licensed to the

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-21 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r169724637 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@ -2123,9

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-21 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r169726050 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/DirectoryKeyedStateHandle.java --- @@ -0,0 +1,105 @@ +/* + * Licensed to

[jira] [Commented] (FLINK-8543) Output Stream closed at org.apache.hadoop.fs.s3a.S3AOutputStream.checkOpen

2018-02-21 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371773#comment-16371773 ] Aljoscha Krettek commented on FLINK-8543: - Yes, this is what I would expect since the Hadoop S3A

  1   2   3   4   >