[jira] [Comment Edited] (FLINK-21707) Job is possible to hang when restarting a FINISHED task with POINTWISE BLOCKING consumers

2021-03-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298809#comment-17298809 ] Zhu Zhu edited comment on FLINK-21707 at 3/10/21, 12:56 PM: [~mapohl] Sorry

[jira] [Commented] (FLINK-21707) Job is possible to hang when restarting a FINISHED task with POINTWISE BLOCKING consumers

2021-03-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298809#comment-17298809 ] Zhu Zhu commented on FLINK-21707: - [~mapohl] Sorry for the confusing. It is not related to

[jira] [Closed] (FLINK-13056) Optimize region failover performance on calculating vertices to restart

2021-03-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-13056. --- Resolution: Duplicate > Optimize region failover performance on calculating vertices to restart >

[jira] [Commented] (FLINK-19142) Investigate slot hijacking from preceding pipelined regions after failover

2021-03-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298779#comment-17298779 ] Zhu Zhu commented on FLINK-19142: - Thanks for the confirmation! [~trohrmann] Agreed to throw an

[jira] [Updated] (FLINK-21707) Job is possible to hang when restarting a FINISHED task with POINTWISE BLOCKING consumers

2021-03-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-21707: Description: Job is possible to hang when restarting a FINISHED task with POINTWISE BLOCKING consumers.

[jira] [Comment Edited] (FLINK-21707) Job is possible to hang when restarting a FINISHED task with POINTWISE BLOCKING consumers

2021-03-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298608#comment-17298608 ] Zhu Zhu edited comment on FLINK-21707 at 3/10/21, 7:56 AM: --- cc [~trohrmann]

[jira] [Commented] (FLINK-21707) Job is possible to hang when restarting a FINISHED task with POINTWISE BLOCKING consumers

2021-03-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298608#comment-17298608 ] Zhu Zhu commented on FLINK-21707: - cc [~trohrmann][~mapohl] > Job is possible to hang when restarting a

[jira] [Created] (FLINK-21707) Job is possible to hang when restarting a FINISHED task with POINTWISE BLOCKING consumers

2021-03-09 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-21707: --- Summary: Job is possible to hang when restarting a FINISHED task with POINTWISE BLOCKING consumers Key: FLINK-21707 URL: https://issues.apache.org/jira/browse/FLINK-21707

[jira] [Updated] (FLINK-21524) Improve the stability of scheduler benchmarks

2021-03-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-21524: Labels: (was: pull-request-available) > Improve the stability of scheduler benchmarks >

[jira] [Closed] (FLINK-21524) Improve the stability of scheduler benchmarks

2021-03-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-21524. --- Resolution: Fixed > Improve the stability of scheduler benchmarks >

[jira] [Comment Edited] (FLINK-21526) Replace scheduler benchmarks with wrapper classes

2021-03-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297839#comment-17297839 ] Zhu Zhu edited comment on FLINK-21526 at 3/9/21, 5:46 AM: -- done via

[jira] [Closed] (FLINK-21526) Replace scheduler benchmarks with wrapper classes

2021-03-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-21526. --- Resolution: Fixed > Replace scheduler benchmarks with wrapper classes >

[jira] [Reopened] (FLINK-21526) Replace scheduler benchmarks with wrapper classes

2021-03-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reopened FLINK-21526: - > Replace scheduler benchmarks with wrapper classes > - > >

[jira] [Closed] (FLINK-21526) Replace scheduler benchmarks with wrapper classes

2021-03-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-21526. --- Resolution: Fixed done via mainThreadExecutor.getMainThreadExecutor() > Replace scheduler benchmarks with

[jira] [Closed] (FLINK-21525) Move scheduler benchmarks to Flink

2021-03-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-21525. --- Resolution: Fixed Done via c7c054d312f9c05e9a651eac209740629665 > Move scheduler benchmarks to Flink >

[jira] [Comment Edited] (FLINK-19142) Investigate slot hijacking from preceding pipelined regions after failover

2021-03-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297082#comment-17297082 ] Zhu Zhu edited comment on FLINK-19142 at 3/8/21, 6:59 AM: -- [~trohrmann] do you

[jira] [Comment Edited] (FLINK-19142) Investigate slot hijacking from preceding pipelined regions after failover

2021-03-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297082#comment-17297082 ] Zhu Zhu edited comment on FLINK-19142 at 3/8/21, 6:58 AM: -- [~trohrmann] do you

[jira] [Comment Edited] (FLINK-19142) Investigate slot hijacking from preceding pipelined regions after failover

2021-03-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297082#comment-17297082 ] Zhu Zhu edited comment on FLINK-19142 at 3/8/21, 5:44 AM: -- [~trohrmann] do you

[jira] [Commented] (FLINK-19142) Investigate slot hijacking from preceding pipelined regions after failover

2021-03-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297082#comment-17297082 ] Zhu Zhu commented on FLINK-19142: - [~trohrmann] do you mean a case like this? - Previously bulk_1 uses

[jira] [Commented] (FLINK-19142) Investigate slot hijacking from preceding pipelined regions after failover

2021-03-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295945#comment-17295945 ] Zhu Zhu commented on FLINK-19142: - In my understanding, the problem is that

[jira] [Closed] (FLINK-21576) Remove ExecutionVertex#getPreferredLocations

2021-03-03 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-21576. --- Resolution: Done Done via 2233cb2ebad5908464e36ac890f0ab54bd57d35a > Remove

[jira] [Assigned] (FLINK-21576) Remove ExecutionVertex#getPreferredLocations

2021-03-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-21576: --- Assignee: Zhu Zhu > Remove ExecutionVertex#getPreferredLocations >

[jira] [Created] (FLINK-21576) Remove ExecutionVertex#getPreferredLocations

2021-03-02 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-21576: --- Summary: Remove ExecutionVertex#getPreferredLocations Key: FLINK-21576 URL: https://issues.apache.org/jira/browse/FLINK-21576 Project: Flink Issue Type: Improvement

[jira] [Assigned] (FLINK-21526) Replace scheduler benchmarks with wrapper classes

2021-03-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-21526: --- Assignee: Zhilong Hong > Replace scheduler benchmarks with wrapper classes >

[jira] [Assigned] (FLINK-21525) Move scheduler benchmarks to Flink and add unit tests

2021-03-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-21525: --- Assignee: Zhilong Hong > Move scheduler benchmarks to Flink and add unit tests >

[jira] [Updated] (FLINK-21524) Improve the stability of scheduler benchmarks

2021-03-01 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-21524: Priority: Critical (was: Major) > Improve the stability of scheduler benchmarks >

[jira] [Assigned] (FLINK-21524) Improve the stability of scheduler benchmarks

2021-03-01 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-21524: --- Assignee: Zhilong Hong > Improve the stability of scheduler benchmarks >

[jira] [Comment Edited] (FLINK-16069) Creation of TaskDeploymentDescriptor can block main thread for long time

2021-02-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291607#comment-17291607 ] Zhu Zhu edited comment on FLINK-16069 at 2/26/21, 12:14 PM: I had a PoC to

[jira] [Comment Edited] (FLINK-16069) Creation of TaskDeploymentDescriptor can block main thread for long time

2021-02-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291607#comment-17291607 ] Zhu Zhu edited comment on FLINK-16069 at 2/26/21, 12:13 PM: I had a PoC to

[jira] [Updated] (FLINK-16069) Creation of TaskDeploymentDescriptor can block main thread for long time

2021-02-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-16069: Attachment: FLINK-16069-POC-results > Creation of TaskDeploymentDescriptor can block main thread for long

[jira] [Commented] (FLINK-16069) Creation of TaskDeploymentDescriptor can block main thread for long time

2021-02-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291607#comment-17291607 ] Zhu Zhu commented on FLINK-16069: - I had a PoC to verify the idea to cache and reuse ShuffleDescriptor

[jira] [Assigned] (FLINK-19142) Investigate slot hijacking from preceding pipelined regions after failover

2021-02-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-19142: --- Assignee: Zhu Zhu > Investigate slot hijacking from preceding pipelined regions after failover >

[jira] [Commented] (FLINK-19142) Investigate slot hijacking from preceding pipelined regions after failover

2021-02-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291576#comment-17291576 ] Zhu Zhu commented on FLINK-19142: - [~chesnay] Yes I will look into it. > Investigate slot hijacking

[jira] [Closed] (FLINK-18454) Add a code contribution section about how to look for what to contribute

2021-02-24 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-18454. --- Resolution: Done done via: 6c778cb8e85f1ea2b200fec82fa6e7036ef7b947

[jira] [Closed] (FLINK-20612) Add benchmarks for scheduler

2021-02-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-20612. --- Resolution: Fixed Close this ticket because the curve so far looks good without large variations. I also

[jira] [Closed] (FLINK-10320) Introduce JobMaster schedule micro-benchmark

2021-02-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-10320. --- Resolution: Duplicate > Introduce JobMaster schedule micro-benchmark >

[jira] [Commented] (FLINK-10320) Introduce JobMaster schedule micro-benchmark

2021-02-12 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283914#comment-17283914 ] Zhu Zhu commented on FLINK-10320: - I think it is a duplicate and we can close it since FLINK-20612 is

[jira] [Comment Edited] (FLINK-20612) Add benchmarks for scheduler

2021-02-12 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283906#comment-17283906 ] Zhu Zhu edited comment on FLINK-20612 at 2/12/21, 6:48 PM: --- [~pnowojski] The

[jira] [Commented] (FLINK-20612) Add benchmarks for scheduler

2021-02-12 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283906#comment-17283906 ] Zhu Zhu commented on FLINK-20612: - [~pnowojski] The main problem in scheduler performance is that large

[jira] [Assigned] (FLINK-21331) Optimize calculating tasks to restart in RestartPipelinedRegionFailoverStrategy

2021-02-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-21331: --- Assignee: Zhilong Hong > Optimize calculating tasks to restart in >

[jira] [Assigned] (FLINK-21332) Optimize releasing result partitions in RegionPartitionReleaseStrategy

2021-02-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-21332: --- Assignee: Zhilong Hong > Optimize releasing result partitions in RegionPartitionReleaseStrategy >

[jira] [Assigned] (FLINK-21326) Optimize building topology when initializing ExecutionGraph

2021-02-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-21326: --- Assignee: Zhilong Hong > Optimize building topology when initializing ExecutionGraph >

[jira] [Assigned] (FLINK-21330) Optimize the initialization of PipelinedRegionSchedulingStrategy

2021-02-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-21330: --- Assignee: Zhilong Hong > Optimize the initialization of PipelinedRegionSchedulingStrategy >

[jira] [Assigned] (FLINK-21328) Optimize the initialization of DefaultExecutionTopology

2021-02-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-21328: --- Assignee: Zhilong Hong > Optimize the initialization of DefaultExecutionTopology >

[jira] [Commented] (FLINK-20612) Add benchmarks for scheduler

2021-02-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281166#comment-17281166 ] Zhu Zhu commented on FLINK-20612: - The PR is merged: fa61585879aacc3b5f7650a229613b3d944ec59e

[jira] [Comment Edited] (FLINK-17726) Scheduler should take care of tasks directly canceled by TaskManager

2021-02-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280409#comment-17280409 ] Zhu Zhu edited comment on FLINK-17726 at 2/7/21, 8:23 AM: -- Thanks for

[jira] [Comment Edited] (FLINK-17726) Scheduler should take care of tasks directly canceled by TaskManager

2021-02-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280409#comment-17280409 ] Zhu Zhu edited comment on FLINK-17726 at 2/7/21, 8:23 AM: -- Thanks for

[jira] [Commented] (FLINK-17726) Scheduler should take care of tasks directly canceled by TaskManager

2021-02-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280409#comment-17280409 ] Zhu Zhu commented on FLINK-17726: - Thanks for relaunching this discussion and proposing a solution. I'd

[jira] [Updated] (FLINK-21273) Remove unused ExecutionVertexSchedulingRequirements

2021-02-06 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-21273: Affects Version/s: 1.12.0 > Remove unused ExecutionVertexSchedulingRequirements >

[jira] [Closed] (FLINK-21273) Remove unused ExecutionVertexSchedulingRequirements

2021-02-06 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-21273. --- Fix Version/s: 1.13.0 Resolution: Done Done via 04a45ab3c24fa80a987f1409c521c8857cc35155 > Remove

[jira] [Updated] (FLINK-21273) Remove unused ExecutionVertexSchedulingRequirements

2021-02-06 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-21273: Issue Type: Improvement (was: Bug) > Remove unused ExecutionVertexSchedulingRequirements >

[jira] [Commented] (FLINK-21110) Optimize Scheduler Performance for Large-Scale Jobs

2021-02-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278666#comment-17278666 ] Zhu Zhu commented on FLINK-21110: - [~Thesharing] It's better to open different JIRA tickets for these

[jira] [Commented] (FLINK-21273) Remove unused ExecutionVertexSchedulingRequirements

2021-02-03 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278592#comment-17278592 ] Zhu Zhu commented on FLINK-21273: - Thanks for firing this ticket! [~karmagyz] I have assigned you the

[jira] [Assigned] (FLINK-21273) Remove unused ExecutionVertexSchedulingRequirements

2021-02-03 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-21273: --- Assignee: Yangze Guo > Remove unused ExecutionVertexSchedulingRequirements >

[jira] [Commented] (FLINK-21030) Broken job restart for job with disjoint graph

2021-02-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277769#comment-17277769 ] Zhu Zhu commented on FLINK-21030: - I guess I had misunderstood the protocol of

[jira] [Commented] (FLINK-21030) Broken job restart for job with disjoint graph

2021-02-01 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276920#comment-17276920 ] Zhu Zhu commented on FLINK-21030: - Sounds good to me. [~yunta] would you also take a look at [~mapohl]'s

[jira] [Commented] (FLINK-21030) Broken job restart for job with disjoint graph

2021-02-01 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276846#comment-17276846 ] Zhu Zhu commented on FLINK-21030: - Thanks for the investigation! [~mapohl] Does this mean that the

[jira] [Closed] (FLINK-16017) Improve attachJobGraph Performance

2021-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-16017. --- Resolution: Duplicate > Improve attachJobGraph Performance > -- > >

[jira] [Commented] (FLINK-16017) Improve attachJobGraph Performance

2021-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275554#comment-17275554 ] Zhu Zhu commented on FLINK-16017: - [~rmetzger] yes it is already fixed via FLINK-17180. Will close it.

[jira] [Updated] (FLINK-21110) Optimize Scheduler Performance for Large-Scale Jobs

2021-01-24 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-21110: Description: According to the result of scheduler benchmarks we implemented in FLINK-20612, the

[jira] [Closed] (FLINK-10429) Redesign Flink Scheduling, introducing dedicated Scheduler component

2021-01-24 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-10429. --- Resolution: Done > Redesign Flink Scheduling, introducing dedicated Scheduler component >

[jira] [Closed] (FLINK-15626) Remove legacy scheduler

2021-01-24 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-15626. --- Resolution: Done > Remove legacy scheduler > --- > > Key: FLINK-15626 >

[jira] [Commented] (FLINK-15626) Remove legacy scheduler

2021-01-24 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271074#comment-17271074 ] Zhu Zhu commented on FLINK-15626: - [~trohrmann] in the future we may want to factor all the actions out

[jira] [Closed] (FLINK-20931) Remove globalModVersion from ExecutionGraph

2021-01-20 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-20931. --- Resolution: Done Done via 759d7347ddccc576b4f039e99ac27af1df9ab260 > Remove globalModVersion from

[jira] [Commented] (FLINK-21030) Broken job restart for job with disjoint graph

2021-01-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268409#comment-17268409 ] Zhu Zhu commented on FLINK-21030: - Agreed to trigger a global failover to bring FINISHED tasks back to

[jira] [Comment Edited] (FLINK-21030) Broken job restart for job with disjoint graph

2021-01-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268409#comment-17268409 ] Zhu Zhu edited comment on FLINK-21030 at 1/20/21, 7:21 AM: --- Agreed to trigger

[jira] [Created] (FLINK-20931) Remove globalModVersion from ExecutionGraph

2021-01-11 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-20931: --- Summary: Remove globalModVersion from ExecutionGraph Key: FLINK-20931 URL: https://issues.apache.org/jira/browse/FLINK-20931 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-20930) Remove AbstractExecutionSlotAllocator

2021-01-11 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-20930: --- Summary: Remove AbstractExecutionSlotAllocator Key: FLINK-20930 URL: https://issues.apache.org/jira/browse/FLINK-20930 Project: Flink Issue Type: Sub-task

[jira] [Reopened] (FLINK-19922) Remove SlotProvider from SchedulerNG

2021-01-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reopened FLINK-19922: - > Remove SlotProvider from SchedulerNG > > > Key:

[jira] [Closed] (FLINK-19922) Remove SlotProvider from SchedulerNG

2021-01-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19922. --- Resolution: Fixed > Remove SlotProvider from SchedulerNG > > >

[jira] [Closed] (FLINK-19922) Remove SlotProvider from SchedulerNG

2021-01-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19922. --- Resolution: Duplicate > Remove SlotProvider from SchedulerNG > > >

[jira] [Commented] (FLINK-20850) Analyze whether CoLocationConstraints and CoLocationGroup can be removed

2021-01-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260456#comment-17260456 ] Zhu Zhu commented on FLINK-20850: - Agreed that `CoLocationConstraint` is no longer needed after

[jira] [Closed] (FLINK-20439) Simplifying scheduleOrUpdateConsumers

2020-12-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-20439. --- Resolution: Done Done via 2c6521a0a62ba302cd821f1fecb12191e6e913e7 1aa9074e8a14765825f56e84caca806d4c17e227

[jira] [Commented] (FLINK-20659) YARNSessionCapacitySchedulerITCase.perJobYarnClusterOffHeap test failed with NPE

2020-12-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254025#comment-17254025 ] Zhu Zhu commented on FLINK-20659: - another instance:

[jira] [Comment Edited] (FLINK-20721) Remove unknown input channels and process to update partitions

2020-12-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254023#comment-17254023 ] Zhu Zhu edited comment on FLINK-20721 at 12/23/20, 10:56 AM: - Closing this

[jira] [Closed] (FLINK-20721) Remove unknown input channels and process to update partitions

2020-12-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-20721. --- Resolution: Won't Do Closing this ticket because UnknownInputChannel are still needed at the moment if

[jira] [Updated] (FLINK-20439) Simplifying scheduleOrUpdateConsumers

2020-12-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-20439: Description: JobMaster#scheduleOrUpdateConsumers() was used to schedule a vertex when its PIPELINED

[jira] [Updated] (FLINK-20439) Simplifying scheduleOrUpdateConsumers

2020-12-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-20439: Summary: Simplifying scheduleOrUpdateConsumers (was: Consider simplifying or removing mechanism to

[jira] [Created] (FLINK-20721) Remove unknown input channels and process to update partitions

2020-12-22 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-20721: --- Summary: Remove unknown input channels and process to update partitions Key: FLINK-20721 URL: https://issues.apache.org/jira/browse/FLINK-20721 Project: Flink Issue

[jira] [Updated] (FLINK-20721) Remove unknown input channels and process to update partitions

2020-12-22 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-20721: Description: With the latest pipelined region scheduling, Flink no longer launch a task before knowing

[jira] [Comment Edited] (FLINK-20721) Remove unknown input channels and process to update partitions

2020-12-22 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253458#comment-17253458 ] Zhu Zhu edited comment on FLINK-20721 at 12/22/20, 12:31 PM: - cc

[jira] [Commented] (FLINK-20721) Remove unknown input channels and process to update partitions

2020-12-22 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253458#comment-17253458 ] Zhu Zhu commented on FLINK-20721: - cc [~trohrmann][~pnowojski] > Remove unknown input channels and

[jira] [Assigned] (FLINK-20439) Consider simplifying or removing mechanism to scheduleOrUpdateConsumers

2020-12-22 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-20439: --- Assignee: Zhu Zhu > Consider simplifying or removing mechanism to scheduleOrUpdateConsumers >

[jira] [Updated] (FLINK-20619) Remove InputDependencyConstraint and InputDependencyConstraintChecker

2020-12-21 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-20619: Description: InputDependencyConstraint was used by legacy scheduler and lazy-from-sources scheduling

[jira] [Closed] (FLINK-17760) Rework tests to not rely on legacy scheduling logics in ExecutionGraph anymore

2020-12-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-17760. --- Resolution: Done done via e6f888e62741ec0301411b73eea7c94f5e58db20 bc80c443c07aa79c4097e03ef847f28c717dd56f

[jira] [Closed] (FLINK-19919) Remove legacy scheduling in ExecutionGraph components

2020-12-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19919. --- Resolution: Done done via e707433a648fd48deca64f4e6f02ee2af3a7c607 > Remove legacy scheduling in

[jira] [Closed] (FLINK-19920) Remove legacy FailoverStrategy

2020-12-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19920. --- Resolution: Done done via 16d3894e8253c826504710285dee012be2b3fbd5 > Remove legacy FailoverStrategy >

[jira] [Closed] (FLINK-19921) Remove legacy RestartStrategy

2020-12-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19921. --- Resolution: Done done via 6f931dda40d0303268bf8c3bc6e5f1717ed30a17 > Remove legacy RestartStrategy >

[jira] [Updated] (FLINK-20612) Add benchmarks for scheduler

2020-12-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-20612: Component/s: Runtime / Coordination > Add benchmarks for scheduler > > >

[jira] [Assigned] (FLINK-20612) Add benchmarks for scheduler

2020-12-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-20612: --- Assignee: Zhilong Hong > Add benchmarks for scheduler > > >

[jira] [Updated] (FLINK-20612) Add benchmarks for scheduler

2020-12-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-20612: Fix Version/s: 1.13.0 > Add benchmarks for scheduler > > >

[jira] [Updated] (FLINK-20612) Add benchmarks for scheduler

2020-12-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-20612: Component/s: (was: Runtime / Coordination) Benchmarks > Add benchmarks for scheduler

[jira] [Commented] (FLINK-20612) Add benchmarks for scheduler

2020-12-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251062#comment-17251062 ] Zhu Zhu commented on FLINK-20612: - I have assigned you the ticket [~Thesharing]. Feel free to open a PR.

[jira] [Closed] (FLINK-20626) Canceling a job when it is failing will result in job hanging in CANCELING state

2020-12-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-20626. --- Resolution: Fixed Fixed via master: 58cc2a5fbd419d6a9e4f9c251ac01ecf59a8c5a2 release-1.12:

[jira] [Commented] (FLINK-20612) Add benchmarks for scheduler

2020-12-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250863#comment-17250863 ] Zhu Zhu commented on FLINK-20612: - Thanks for proposing this [~Thesharing] and sharing the statistics.

[jira] [Commented] (FLINK-20254) HiveTableSourceITCase.testStreamPartitionReadByCreateTime times out

2020-12-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250768#comment-17250768 ] Zhu Zhu commented on FLINK-20254: - another instance:

[jira] [Commented] (FLINK-20389) UnalignedCheckpointITCase failure caused by NullPointerException

2020-12-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250767#comment-17250767 ] Zhu Zhu commented on FLINK-20389: - another instance:

[jira] [Created] (FLINK-20626) Canceling a job when it is failing will result in job hanging in CANCELING state

2020-12-16 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-20626: --- Summary: Canceling a job when it is failing will result in job hanging in CANCELING state Key: FLINK-20626 URL: https://issues.apache.org/jira/browse/FLINK-20626 Project:

[jira] [Created] (FLINK-20619) Remove InputDependencyConstraint and InputDependencyConstraintChecker

2020-12-15 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-20619: --- Summary: Remove InputDependencyConstraint and InputDependencyConstraintChecker Key: FLINK-20619 URL: https://issues.apache.org/jira/browse/FLINK-20619 Project: Flink

[jira] [Updated] (FLINK-20439) Consider simplifying or removing mechanism to scheduleOrUpdateConsumers

2020-12-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-20439: Parent: FLINK-20589 Issue Type: Sub-task (was: Task) > Consider simplifying or removing

<    6   7   8   9   10   11   12   13   14   15   >