[GitHub] flink pull request #5447: [FLINK-8423] OperatorChain#pushToOperator catch bl...

2018-02-10 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5447#discussion_r167392891 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/OperatorChain.java --- @@ -591,16 +591,18 @@ public void collect(Stream

[jira] [Commented] (FLINK-8423) OperatorChain#pushToOperator catch block may fail with NPE

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359327#comment-16359327 ] ASF GitHub Bot commented on FLINK-8423: --- Github user zentol commented on a diff in t

[GitHub] flink pull request #5447: [FLINK-8423] OperatorChain#pushToOperator catch bl...

2018-02-10 Thread zhangminglei
Github user zhangminglei commented on a diff in the pull request: https://github.com/apache/flink/pull/5447#discussion_r167393568 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/OperatorChain.java --- @@ -591,16 +591,18 @@ public void collect(

[jira] [Commented] (FLINK-8423) OperatorChain#pushToOperator catch block may fail with NPE

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359336#comment-16359336 ] ASF GitHub Bot commented on FLINK-8423: --- Github user zhangminglei commented on a dif

[GitHub] flink pull request #5447: [FLINK-8423] OperatorChain#pushToOperator catch bl...

2018-02-10 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5447#discussion_r167395295 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/OperatorChain.java --- @@ -591,16 +591,18 @@ public void collect(Stream

[jira] [Commented] (FLINK-8423) OperatorChain#pushToOperator catch block may fail with NPE

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359363#comment-16359363 ] ASF GitHub Bot commented on FLINK-8423: --- Github user zentol commented on a diff in t

[GitHub] flink pull request #5447: [FLINK-8423] OperatorChain#pushToOperator catch bl...

2018-02-10 Thread zhangminglei
Github user zhangminglei commented on a diff in the pull request: https://github.com/apache/flink/pull/5447#discussion_r167395827 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/OperatorChain.java --- @@ -591,16 +591,18 @@ public void collect(

[jira] [Commented] (FLINK-8423) OperatorChain#pushToOperator catch block may fail with NPE

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359369#comment-16359369 ] ASF GitHub Bot commented on FLINK-8423: --- Github user zhangminglei commented on a dif

[jira] [Updated] (FLINK-8487) State loss after multiple restart attempts

2018-02-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-8487: --- Fix Version/s: (was: 1.4.1) 1.4.2 > State loss after multiple r

[jira] [Updated] (FLINK-8308) Update yajl-ruby dependency to 1.3.1 or higher

2018-02-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-8308: --- Fix Version/s: (was: 1.4.1) 1.4.2 > Update yajl-ruby dependency

[jira] [Updated] (FLINK-8303) Update Savepoint Compatibility Table for 1.4

2018-02-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-8303: --- Fix Version/s: (was: 1.4.1) 1.4.2 > Update Savepoint Compatibil

[jira] [Updated] (FLINK-8477) Add api to support for user to skip the first incomplete window data

2018-02-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-8477: --- Fix Version/s: (was: 1.4.1) 1.4.2 > Add api to support for user

[jira] [Updated] (FLINK-8498) GetExecutionPlan fails with IllegalArgumentException in Comparator

2018-02-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-8498: --- Fix Version/s: (was: 1.4.1) 1.4.2 > GetExecutionPlan fails with

[GitHub] flink pull request #4826: [FLINK-7608][metric] Refactor latency statistics m...

2018-02-10 Thread yew1eb
Github user yew1eb closed the pull request at: https://github.com/apache/flink/pull/4826 ---

[jira] [Commented] (FLINK-7608) LatencyGauge change to histogram metric

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359443#comment-16359443 ] ASF GitHub Bot commented on FLINK-7608: --- Github user yew1eb closed the pull request

[jira] [Created] (FLINK-8630) To support JSON schema to TypeInformation conversion

2018-02-10 Thread Xingcan Cui (JIRA)
Xingcan Cui created FLINK-8630: -- Summary: To support JSON schema to TypeInformation conversion Key: FLINK-8630 URL: https://issues.apache.org/jira/browse/FLINK-8630 Project: Flink Issue Type: N

[jira] [Updated] (FLINK-8630) To support JSON schema to TypeInformation conversion

2018-02-10 Thread Xingcan Cui (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingcan Cui updated FLINK-8630: --- Issue Type: Sub-task (was: New Feature) Parent: FLINK-8558 > To support JSON schema to TypeIn

[jira] [Updated] (FLINK-8394) Lack of synchronization accessing expectedRecord in ReceiverThread#shutdown

2018-02-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-8394: -- Description: {code} public void shutdown() { running = false; interrupt(); expectedRecord.complete

[jira] [Commented] (FLINK-8626) Introduce BackPressureStatsTracker interface

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359654#comment-16359654 ] ASF GitHub Bot commented on FLINK-8626: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request #5443: [FLINK-8626] Introduce BackPressureStatsTracker in...

2018-02-10 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5443#discussion_r167412781 --- Diff: flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/WebRuntimeMonitor.java --- @@ -143,7 +143,7 @@ private fina

[GitHub] flink pull request #5443: [FLINK-8626] Introduce BackPressureStatsTracker in...

2018-02-10 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5443#discussion_r167412844 --- Diff: flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/WebRuntimeMonitor.java --- @@ -143,7 +143,7 @@ private fina

[GitHub] flink pull request #5443: [FLINK-8626] Introduce BackPressureStatsTracker in...

2018-02-10 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5443#discussion_r167412847 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/legacy/backpressure/VoidBackPressureStatsTracker.java --- @@ -0,0 +1,36 @@

[jira] [Commented] (FLINK-8626) Introduce BackPressureStatsTracker interface

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359656#comment-16359656 ] ASF GitHub Bot commented on FLINK-8626: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8626) Introduce BackPressureStatsTracker interface

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359655#comment-16359655 ] ASF GitHub Bot commented on FLINK-8626: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request #5443: [FLINK-8626] Introduce BackPressureStatsTracker in...

2018-02-10 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5443#discussion_r167413109 --- Diff: flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/WebRuntimeMonitor.java --- @@ -143,7 +143,7 @@ private final Stac

[GitHub] flink pull request #5443: [FLINK-8626] Introduce BackPressureStatsTracker in...

2018-02-10 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5443#discussion_r167412925 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/rest/handler/legacy/JobVertexBackPressureHandlerTest.java --- @@ -57,7 +57,7 @@ public void te

[jira] [Commented] (FLINK-8626) Introduce BackPressureStatsTracker interface

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359659#comment-16359659 ] ASF GitHub Bot commented on FLINK-8626: --- Github user zentol commented on a diff in t

[jira] [Commented] (FLINK-8626) Introduce BackPressureStatsTracker interface

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359658#comment-16359658 ] ASF GitHub Bot commented on FLINK-8626: --- Github user zentol commented on a diff in t

[jira] [Closed] (FLINK-7124) Allow to rescale JobGraph on JobManager

2018-02-10 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-7124. Resolution: Fixed Fix Version/s: 1.5.0 Fixed via  5fe31cbf26f35ae6921d543d362d2d9f006f45db

[GitHub] flink pull request #4510: [FLINK-7124] [flip-6] Add test to verify rescaling...

2018-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/4510 ---

[jira] [Commented] (FLINK-7124) Allow to rescale JobGraph on JobManager

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359662#comment-16359662 ] ASF GitHub Bot commented on FLINK-7124: --- Github user asfgit closed the pull request

[jira] [Created] (FLINK-8631) Add support for generic response types to RestClient

2018-02-10 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8631: Summary: Add support for generic response types to RestClient Key: FLINK-8631 URL: https://issues.apache.org/jira/browse/FLINK-8631 Project: Flink Issue Type

[GitHub] flink pull request #5450: [FLINK-8631] [rest] Add support for generic types ...

2018-02-10 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5450 [FLINK-8631] [rest] Add support for generic types to the RestClient ## What is the purpose of the change This commit allows the Restclient to receive generic response types. In order

[jira] [Commented] (FLINK-8631) Add support for generic response types to RestClient

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359669#comment-16359669 ] ASF GitHub Bot commented on FLINK-8631: --- GitHub user tillrohrmann opened a pull requ

[jira] [Created] (FLINK-8632) Generalize SavepointHandlers to be used for other asynchronous operations

2018-02-10 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8632: Summary: Generalize SavepointHandlers to be used for other asynchronous operations Key: FLINK-8632 URL: https://issues.apache.org/jira/browse/FLINK-8632 Project: Flin

[GitHub] flink pull request #5451: [FLINK-8632] [flip6] Introduce generalized asynchr...

2018-02-10 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5451 [FLINK-8632] [flip6] Introduce generalized asynchronous operation handlers ## What is the purpose of the change The asynchronous operation handlers are the generalization of the Savepo

[jira] [Commented] (FLINK-8632) Generalize SavepointHandlers to be used for other asynchronous operations

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359678#comment-16359678 ] ASF GitHub Bot commented on FLINK-8632: --- GitHub user tillrohrmann opened a pull requ

[jira] [Created] (FLINK-8633) Expose JobMaster#rescaleJob via the Dispatcher

2018-02-10 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8633: Summary: Expose JobMaster#rescaleJob via the Dispatcher Key: FLINK-8633 URL: https://issues.apache.org/jira/browse/FLINK-8633 Project: Flink Issue Type: Impr

[GitHub] flink pull request #5452: [FLINK-8633] [flip6] Expose rescaling of jobs via ...

2018-02-10 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5452 [FLINK-8633] [flip6] Expose rescaling of jobs via the Dispatcher ## What is the purpose of the change This commit exposes the JobMaster#rescaleJob via the Dispatcher. This will allo

[jira] [Commented] (FLINK-8633) Expose JobMaster#rescaleJob via the Dispatcher

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359680#comment-16359680 ] ASF GitHub Bot commented on FLINK-8633: --- GitHub user tillrohrmann opened a pull requ

[jira] [Created] (FLINK-8634) Add asynchronous rescaling REST handlers

2018-02-10 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8634: Summary: Add asynchronous rescaling REST handlers Key: FLINK-8634 URL: https://issues.apache.org/jira/browse/FLINK-8634 Project: Flink Issue Type: New Featur

[GitHub] flink pull request #5453: [FLINK-8634] [rest] Introduce job rescaling REST h...

2018-02-10 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5453 [FLINK-8634] [rest] Introduce job rescaling REST handler ## What is the purpose of the change Add rescaling REST handler as a sub class of the `AbstractAsynchronousOperationHandlers`.

[jira] [Commented] (FLINK-8634) Add asynchronous rescaling REST handlers

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359683#comment-16359683 ] ASF GitHub Bot commented on FLINK-8634: --- GitHub user tillrohrmann opened a pull requ

[jira] [Updated] (FLINK-8634) Implement asynchronous rescaling REST handlers

2018-02-10 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-8634: - Summary: Implement asynchronous rescaling REST handlers (was: Add asynchronous rescaling REST han

[jira] [Created] (FLINK-8635) Register asynchronous rescaling handler at WebMonitorEndpoint

2018-02-10 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8635: Summary: Register asynchronous rescaling handler at WebMonitorEndpoint Key: FLINK-8635 URL: https://issues.apache.org/jira/browse/FLINK-8635 Project: Flink

[jira] [Commented] (FLINK-8635) Register asynchronous rescaling handler at WebMonitorEndpoint

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359687#comment-16359687 ] ASF GitHub Bot commented on FLINK-8635: --- GitHub user tillrohrmann opened a pull requ

[GitHub] flink pull request #5454: [FLINK-8635] [rest] Register rescaling handlers at...

2018-02-10 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5454 [FLINK-8635] [rest] Register rescaling handlers at web endpoint ## What is the purpose of the change Registers the recaling handlers at the `WebMonitorEndpoint` This PR is base

[jira] [Updated] (FLINK-7897) Consider using nio.Files for file deletion in TransientBlobCleanupTask

2018-02-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-7897: -- Description: nio.Files#delete() provides better clue as to why the deletion may fail: https://docs.oracle.com/j

[jira] [Commented] (FLINK-8423) OperatorChain#pushToOperator catch block may fail with NPE

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359714#comment-16359714 ] ASF GitHub Bot commented on FLINK-8423: --- Github user zhangminglei commented on the i

[GitHub] flink issue #5447: [FLINK-8423] OperatorChain#pushToOperator catch block may...

2018-02-10 Thread zhangminglei
Github user zhangminglei commented on the issue: https://github.com/apache/flink/pull/5447 @zentol I have corrected the code, please helps to review. Thank you very much! ---

[jira] [Commented] (FLINK-6161) Retry connection in case of a ResourceManager heartbeat timeout

2018-02-10 Thread mingleizhang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359733#comment-16359733 ] mingleizhang commented on FLINK-6161: - Hi, [~zjwang] Are you still working on this ?

[jira] [Assigned] (FLINK-8560) Access to the current key in ProcessFunction after keyBy()

2018-02-10 Thread Bowen Li (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Li reassigned FLINK-8560: --- Assignee: Bowen Li > Access to the current key in ProcessFunction after keyBy() > ---

[GitHub] flink issue #5405: [FLINK-8477][Window]Add api to support user to skip serva...

2018-02-10 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5405 I commented on the issue: https://issues.apache.org/jira/browse/FLINK-8477?focusedCommentId=16359834&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16359834 ---

[jira] [Commented] (FLINK-8212) Pull EnvironmentInformation out of TaskManagerServices

2018-02-10 Thread mingleizhang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359833#comment-16359833 ] mingleizhang commented on FLINK-8212: - Hi, [~till.rohrmann] I have a question. If we d

[jira] [Commented] (FLINK-8477) Add api to support for user to skip the first incomplete window data

2018-02-10 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359834#comment-16359834 ] Aljoscha Krettek commented on FLINK-8477: - I think skipping windows by counting th

[jira] [Commented] (FLINK-8477) Add api to support for user to skip the first incomplete window data

2018-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359835#comment-16359835 ] ASF GitHub Bot commented on FLINK-8477: --- Github user aljoscha commented on the issue