[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014886#comment-17014886 ] Yuan Mei commented on FLINK-14163: --   Thanks [~azagrebin] and [~zhuzh]! I do not have a strong opinion

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-13 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014845#comment-17014845 ] Zhu Zhu commented on FLINK-14163: - +1 to fix it with a simple check first. As long as we are call

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-13 Thread Andrey Zagrebin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014376#comment-17014376 ] Andrey Zagrebin commented on FLINK-14163: - Thanks [~zjwang] and [~ym] ! The question is how long

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014147#comment-17014147 ] Yuan Mei commented on FLINK-14163: --   Synced up with [~zjwang] offline.    In general, I would

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-12 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014085#comment-17014085 ] zhijiang commented on FLINK-14163: -- Thanks for the above good suggestions from you guys! Sorry for

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-10 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013353#comment-17013353 ] Yuan Mei commented on FLINK-14163: -- PR: pull request #10832 > Execution#producedPartitions is possibly

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-10 Thread Andrey Zagrebin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012601#comment-17012601 ] Andrey Zagrebin commented on FLINK-14163: - [~chesnay] [~zhuzh] [~ym] I think we should still

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-09 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012507#comment-17012507 ] Yuan Mei commented on FLINK-14163: -- Hey, [~chesnay], [~zhuzh], [~azagrebin] and [~gjy], thank you so

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-09 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012426#comment-17012426 ] Yuan Mei commented on FLINK-14163: -- Hey, [~chesnay], [~zhuzh] and [~azagrebin], thank you so much for

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-09 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012427#comment-17012427 ] Yuan Mei commented on FLINK-14163: -- Hey, [~chesnay], [~zhuzh] and [~azagrebin], thank you so much for

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011944#comment-17011944 ] Zhu Zhu commented on FLINK-14163: - Oh I understand what your mean. Previously [~azagrebin] & Till had

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-09 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011892#comment-17011892 ] Chesnay Schepler commented on FLINK-14163: -- Fair enough, if the task is cancelled/failed before

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-09 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011886#comment-17011886 ] Chesnay Schepler commented on FLINK-14163: -- Hold on; what I meant is that, for now, we'll just

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011878#comment-17011878 ] Zhu Zhu commented on FLINK-14163: - Thanks [~chesnay] for the update! Then we are now taking the option

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-09 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011841#comment-17011841 ] Chesnay Schepler commented on FLINK-14163: -- Right. So [~gjy], [~azagrebin] and me have had an

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011692#comment-17011692 ] Zhu Zhu commented on FLINK-14163: - [~chesnay] The deployment issue can happen with ng scheduler since it

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-09 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011689#comment-17011689 ] Chesnay Schepler commented on FLINK-14163: -- Can someone explain to me where exactly a task is

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-09 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011657#comment-17011657 ] Yuan Mei commented on FLINK-14163: -- [~zhuzh] Thank you sooo much. I prefer option 3 better as well,

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011647#comment-17011647 ] Zhu Zhu commented on FLINK-14163: - Thanks [~ym] for trying out the solutions. I'd prefer option 3 which

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-09 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011568#comment-17011568 ] Yuan Mei commented on FLINK-14163: -- Thanks for assigning the task to me!   I have written a first

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-07 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010280#comment-17010280 ] Yuan Mei commented on FLINK-14163: -- That's a good point: fail loudly if acting in an unexpected way for

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009799#comment-17009799 ] Zhu Zhu commented on FLINK-14163: - Makes sense. Unexpected blocked main thread can be hard to

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-07 Thread Andrey Zagrebin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009710#comment-17009710 ] Andrey Zagrebin commented on FLINK-14163: - One more thing to add after talking to [~trohrmann],

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009471#comment-17009471 ] Zhu Zhu commented on FLINK-14163: - +1 to the solution proposed by [~azagrebin]. The fix should be simple

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-07 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009452#comment-17009452 ] Yuan Mei commented on FLINK-14163: -- Accidentally navigating here when digging into the ShuffleMaster

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-06 Thread Andrey Zagrebin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008965#comment-17008965 ] Andrey Zagrebin commented on FLINK-14163: - Thanks for analysis [~zhuzh]. Indeed, this is a

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-06 Thread Gary Yao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008929#comment-17008929 ] Gary Yao commented on FLINK-14163: -- Since there is no issue when using the NettyShuffleMaster (the only

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-06 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008606#comment-17008606 ] Zhu Zhu commented on FLINK-14163: - Thanks [~zjwang] for the feedbacks. I think partition releasing could

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-05 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008582#comment-17008582 ] zhijiang commented on FLINK-14163: -- In addition, no matter which way we take to solve this issue, I

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-05 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008580#comment-17008580 ] zhijiang commented on FLINK-14163: -- Thanks for reporting this potential issue [~zhuzh]! After double