[jira] [Created] (FLINK-35293) FLIP-445: Support dynamic parallelism inference for HiveSource

xingbe created FLINK-35293: -- Summary: FLIP-445: Support dynamic parallelism inference for HiveSource Key: FLINK-35293 URL: https://issues.apache.org/jira/browse/FLINK-35293 Project: Flink Issue Typ

[jira] [Resolved] (FLINK-35293) FLIP-445: Support dynamic parallelism inference for HiveSource

[ https://issues.apache.org/jira/browse/FLINK-35293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xingbe resolved FLINK-35293. Fix Version/s: 1.20.0 Release Note: In Flink 1.20, we have introduced support for dynamic source para

[jira] [Commented] (FLINK-35293) FLIP-445: Support dynamic parallelism inference for HiveSource

[ https://issues.apache.org/jira/browse/FLINK-35293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846276#comment-17846276 ] xingbe commented on FLINK-35293: Thank you [~zhuzh]  for helping to review the PR! I wil

[jira] [Commented] (FLINK-35293) FLIP-445: Support dynamic parallelism inference for HiveSource

[ https://issues.apache.org/jira/browse/FLINK-35293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17848426#comment-17848426 ] xingbe commented on FLINK-35293: [~fanrui] Sorry for my late reply. I have documented FL

[jira] [Created] (FLINK-35426) Change the distribution of DynamicFilteringDataCollector to Broadcast

xingbe created FLINK-35426: -- Summary: Change the distribution of DynamicFilteringDataCollector to Broadcast Key: FLINK-35426 URL: https://issues.apache.org/jira/browse/FLINK-35426 Project: Flink Is

[jira] [Commented] (FLINK-35426) Change the distribution of DynamicFilteringDataCollector to Broadcast

[ https://issues.apache.org/jira/browse/FLINK-35426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17848800#comment-17848800 ] xingbe commented on FLINK-35426: [~zhuzh] Could you please assign this ticket to me? Tha

[jira] [Created] (FLINK-35522) The source task may get stuck after a failover occurs in batch jobs

xingbe created FLINK-35522: -- Summary: The source task may get stuck after a failover occurs in batch jobs Key: FLINK-35522 URL: https://issues.apache.org/jira/browse/FLINK-35522 Project: Flink Issu

[jira] [Commented] (FLINK-35522) The source task may get stuck after a failover occurs in batch jobs

[ https://issues.apache.org/jira/browse/FLINK-35522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852240#comment-17852240 ] xingbe commented on FLINK-35522: I have a solution to fix it, Could you please assign th

[jira] [Commented] (FLINK-35522) The source task may get stuck after a failover occurs in batch jobs

[ https://issues.apache.org/jira/browse/FLINK-35522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852625#comment-17852625 ] xingbe commented on FLINK-35522: [~zhuzh] Sure, I have opened 2 PRS of 1.18 and 1.19, PT

[jira] [Created] (FLINK-35635) Release Testing: Verify FLIP-445: Support dynamic parallelism inference for HiveSource

xingbe created FLINK-35635: -- Summary: Release Testing: Verify FLIP-445: Support dynamic parallelism inference for HiveSource Key: FLINK-35635 URL: https://issues.apache.org/jira/browse/FLINK-35635 Project: F

[jira] [Updated] (FLINK-35635) Release Testing: Verify FLIP-445: Support dynamic parallelism inference for HiveSource

[ https://issues.apache.org/jira/browse/FLINK-35635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xingbe updated FLINK-35635: --- Description: This issue aims to verify FLIP-445. The Hive Source now supports dynamic parallelism inference

[jira] [Created] (FLINK-35656) Hive Source has issues setting max parallelism in dynamic inference mode

xingbe created FLINK-35656: -- Summary: Hive Source has issues setting max parallelism in dynamic inference mode Key: FLINK-35656 URL: https://issues.apache.org/jira/browse/FLINK-35656 Project: Flink

[jira] [Commented] (FLINK-35669) Release Testing: Verify FLIP-383: Support Job Recovery from JobMaster Failures for Batch Jobs

[ https://issues.apache.org/jira/browse/FLINK-35669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17860301#comment-17860301 ] xingbe commented on FLINK-35669: Hi [~JunRuiLi] , I'd like to take this ticket. > Relea

[jira] [Commented] (FLINK-35669) Release Testing: Verify FLIP-383: Support Job Recovery from JobMaster Failures for Batch Jobs

[ https://issues.apache.org/jira/browse/FLINK-35669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863200#comment-17863200 ] xingbe commented on FLINK-35669: I have conducted tests for both scenarios as instructed

[jira] [Created] (FLINK-30558) The metric 'numRestarts' reported in SchedulerBase will be overridden by metric 'fullRestarts'

xingbe created FLINK-30558: -- Summary: The metric 'numRestarts' reported in SchedulerBase will be overridden by metric 'fullRestarts' Key: FLINK-30558 URL: https://issues.apache.org/jira/browse/FLINK-30558 Pr

[jira] [Commented] (FLINK-30558) The metric 'numRestarts' reported in SchedulerBase will be overridden by metric 'fullRestarts'

[ https://issues.apache.org/jira/browse/FLINK-30558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17654380#comment-17654380 ] xingbe commented on FLINK-30558: I'd like to work on this issue, Could I be assigned thi

[jira] [Updated] (FLINK-30558) The metric 'numRestarts' reported in SchedulerBase will be overridden by metric 'fullRestarts'

[ https://issues.apache.org/jira/browse/FLINK-30558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xingbe updated FLINK-30558: --- Description: The method SchedulerBase#registerJobMetrics register metrics 'numRestarts' and 'fullRestarts'

[jira] [Created] (FLINK-30707) Let speculative execution takes input number bytes into account when detecting slow tasks

xingbe created FLINK-30707: -- Summary: Let speculative execution takes input number bytes into account when detecting slow tasks Key: FLINK-30707 URL: https://issues.apache.org/jira/browse/FLINK-30707 Project

[jira] [Updated] (FLINK-30707) Let speculative execution takes input data amount into account when detecting slow tasks

[ https://issues.apache.org/jira/browse/FLINK-30707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xingbe updated FLINK-30707: --- Summary: Let speculative execution takes input data amount into account when detecting slow tasks (was: Let

[jira] [Commented] (FLINK-30707) Let speculative execution takes input data amount into account when detecting slow tasks

[ https://issues.apache.org/jira/browse/FLINK-30707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677583#comment-17677583 ] xingbe commented on FLINK-30707: [~zhuzh] Could you please assign this ticket to me? Tha

[jira] [Commented] (FLINK-30904) Update the documentation and configuration description of slow task detector

[ https://issues.apache.org/jira/browse/FLINK-30904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684470#comment-17684470 ] xingbe commented on FLINK-30904: I'd like to continue this work, please assign this tick

[jira] [Commented] (FLINK-31071) Release Testing: Verify FLIP-283 Use adaptive batch scheduler as default scheduler for batch jobs

[ https://issues.apache.org/jira/browse/FLINK-31071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1763#comment-1763 ] xingbe commented on FLINK-31071: hi [~wanglijie] ,  I'd like to do this testing work. Co

[jira] [Commented] (FLINK-31071) Release Testing: Verify FLIP-283 Use adaptive batch scheduler as default scheduler for batch jobs

[ https://issues.apache.org/jira/browse/FLINK-31071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691064#comment-17691064 ] xingbe commented on FLINK-31071: Hi  [~wanglijie] ,     I have done the testing work acc

[jira] [Commented] (FLINK-31071) Release Testing: Verify FLIP-283 Use adaptive batch scheduler as default scheduler for batch jobs

[ https://issues.apache.org/jira/browse/FLINK-31071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691330#comment-17691330 ] xingbe commented on FLINK-31071: Thanks [~wanglijie] and [~JunRuiLi] , it looks good to

[jira] [Commented] (FLINK-30246) Registering the same metric object with different name and group will conflict in metric reporter

[ https://issues.apache.org/jira/browse/FLINK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644592#comment-17644592 ] xingbe commented on FLINK-30246: Hi, I would like to work on this issue, could you assig

[jira] [Commented] (FLINK-30246) Registering the same metric object with different name and group will conflict in metric reporter

[ https://issues.apache.org/jira/browse/FLINK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17647870#comment-17647870 ] xingbe commented on FLINK-30246: I found that the access level of maps in AbstractReport

[jira] [Commented] (FLINK-30480) Add benchmarks for adaptive batch scheduler

[ https://issues.apache.org/jira/browse/FLINK-30480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651065#comment-17651065 ] xingbe commented on FLINK-30480: Hi, I would like to work on this issue, could you assig

[jira] [Commented] (FLINK-30480) Add benchmarks for adaptive batch scheduler

[ https://issues.apache.org/jira/browse/FLINK-30480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651194#comment-17651194 ] xingbe commented on FLINK-30480: Thank you very much for  your reminder [~Weijie Guo] !

[jira] [Created] (FLINK-32288) Improve the scheduling performance of AdaptiveBatchScheduler

xingbe created FLINK-32288: -- Summary: Improve the scheduling performance of AdaptiveBatchScheduler Key: FLINK-32288 URL: https://issues.apache.org/jira/browse/FLINK-32288 Project: Flink Issue Type:

[jira] [Commented] (FLINK-32306) Multiple batch scheduler performance regressions

[ https://issues.apache.org/jira/browse/FLINK-32306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731458#comment-17731458 ] xingbe commented on FLINK-32306: Hi [~martijnvisser] , Thanks for reporting this! As [~

[jira] [Commented] (FLINK-34229) Duplicate entry in InnerClasses attribute in class file FusionStreamOperator

[ https://issues.apache.org/jira/browse/FLINK-34229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17813613#comment-17813613 ] xingbe commented on FLINK-34229: [~FrankZou] Thanks for resolving this. I have checked t

[jira] [Commented] (FLINK-34287) Release Testing Instructions: Verify FLINK-33768 Support dynamic source parallelism inference for batch jobs

[ https://issues.apache.org/jira/browse/FLINK-34287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814154#comment-17814154 ] xingbe commented on FLINK-34287: This issue aims to verify [FLIP-379|https://cwiki.apac

[jira] [Commented] (FLINK-34377) Release Testing: Verify FLINK-33297 Support standard YAML for FLINK configuration

[ https://issues.apache.org/jira/browse/FLINK-34377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17820549#comment-17820549 ] xingbe commented on FLINK-34377: I'd like to take this ticket. [~zhuzh] Could you help t

[jira] [Commented] (FLINK-34377) Release Testing: Verify FLINK-33297 Support standard YAML for FLINK configuration

[ https://issues.apache.org/jira/browse/FLINK-34377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17821257#comment-17821257 ] xingbe commented on FLINK-34377: Hi [~zhuzh] [~lincoln.86xy] , I've completed the testin

[jira] [Created] (FLINK-34143) Modify the effective strategy of `execution.batch.adaptive.auto-parallelism.default-source-parallelism`

xingbe created FLINK-34143: -- Summary: Modify the effective strategy of `execution.batch.adaptive.auto-parallelism.default-source-parallelism` Key: FLINK-34143 URL: https://issues.apache.org/jira/browse/FLINK-34143

[jira] [Created] (FLINK-34144) Update the documentation and configuration description about dynamic source parallelism inference

xingbe created FLINK-34144: -- Summary: Update the documentation and configuration description about dynamic source parallelism inference Key: FLINK-34144 URL: https://issues.apache.org/jira/browse/FLINK-34144

[jira] [Commented] (FLINK-34144) Update the documentation and configuration description about dynamic source parallelism inference

[ https://issues.apache.org/jira/browse/FLINK-34144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808100#comment-17808100 ] xingbe commented on FLINK-34144: [~zhuzh] please assign this ticket to me, thanks! > Up

[jira] [Commented] (FLINK-34143) Modify the effective strategy of `execution.batch.adaptive.auto-parallelism.default-source-parallelism`

[ https://issues.apache.org/jira/browse/FLINK-34143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808099#comment-17808099 ] xingbe commented on FLINK-34143: [~zhuzh] please assign this ticket to me, thanks! > Mo

[jira] [Created] (FLINK-34145) File source connector support dynamic source parallelism inference in batch jobs

xingbe created FLINK-34145: -- Summary: File source connector support dynamic source parallelism inference in batch jobs Key: FLINK-34145 URL: https://issues.apache.org/jira/browse/FLINK-34145 Project: Flink

[jira] [Created] (FLINK-34229) Duplicate entry in InnerClasses attribute in class file FusionStreamOperator

xingbe created FLINK-34229: -- Summary: Duplicate entry in InnerClasses attribute in class file FusionStreamOperator Key: FLINK-34229 URL: https://issues.apache.org/jira/browse/FLINK-34229 Project: Flink

[jira] [Commented] (FLINK-34229) Duplicate entry in InnerClasses attribute in class file FusionStreamOperator

[ https://issues.apache.org/jira/browse/FLINK-34229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810747#comment-17810747 ] xingbe commented on FLINK-34229: [~lsy] I checked that after reverting the [PR|https://

[jira] [Commented] (FLINK-34206) CacheITCase.testRetryOnCorruptedClusterDataset(Path) failed

[ https://issues.apache.org/jira/browse/FLINK-34206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17811227#comment-17811227 ] xingbe commented on FLINK-34206:  [~mapohl] [~lincoln.86xy] [~zhuzh] We have located the

[jira] [Updated] (FLINK-34229) Duplicate entry in InnerClasses attribute in class file FusionStreamOperator

[ https://issues.apache.org/jira/browse/FLINK-34229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xingbe updated FLINK-34229: --- Attachment: taskmanager_log.txt > Duplicate entry in InnerClasses attribute in class file FusionStreamOperat

[jira] [Commented] (FLINK-34229) Duplicate entry in InnerClasses attribute in class file FusionStreamOperator

[ https://issues.apache.org/jira/browse/FLINK-34229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17811321#comment-17811321 ] xingbe commented on FLINK-34229: [~FrankZou] Sure, I have uploaded all the debug logs fr

[jira] [Closed] (FLINK-33768) FLIP-379: Support dynamic source parallelism inference for batch jobs

[ https://issues.apache.org/jira/browse/FLINK-33768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xingbe closed FLINK-33768. -- Release Note: In Flink 1.19, we have supported dynamic source parallelism inference for batch jobs, which all

[jira] [Created] (FLINK-33768) Support dynamic source parallelism inference for batch jobs

xingbe created FLINK-33768: -- Summary: Support dynamic source parallelism inference for batch jobs Key: FLINK-33768 URL: https://issues.apache.org/jira/browse/FLINK-33768 Project: Flink Issue Type:

[jira] [Updated] (FLINK-33768) Support dynamic source parallelism inference for batch jobs

[ https://issues.apache.org/jira/browse/FLINK-33768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xingbe updated FLINK-33768: --- Description: Currently, for JobVertices without parallelism configured, the AdaptiveBatchScheduler dynamica

[jira] [Created] (FLINK-32586) Enable input locality in SimpleExecutionSlotAllocator

xingbe created FLINK-32586: -- Summary: Enable input locality in SimpleExecutionSlotAllocator Key: FLINK-32586 URL: https://issues.apache.org/jira/browse/FLINK-32586 Project: Flink Issue Type: Improve

[jira] [Created] (FLINK-31652) Flink should handle the delete event if the pod was deleted while pending

xingbe created FLINK-31652: -- Summary: Flink should handle the delete event if the pod was deleted while pending Key: FLINK-31652 URL: https://issues.apache.org/jira/browse/FLINK-31652 Project: Flink

[jira] [Commented] (FLINK-31652) Flink should handle the delete event if the pod was deleted while pending

[ https://issues.apache.org/jira/browse/FLINK-31652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17706247#comment-17706247 ] xingbe commented on FLINK-31652: Hi [~xtsong] , could you please help to take a look at

[jira] [Commented] (FLINK-31652) Flink should handle the delete event if the pod was deleted while pending

[ https://issues.apache.org/jira/browse/FLINK-31652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17706374#comment-17706374 ] xingbe commented on FLINK-31652: [~xtsong] Thanks for the reply! I am glad to take this

[jira] [Created] (FLINK-36159) FLIP-470: Support Adaptive Broadcast Join

xingbe created FLINK-36159: -- Summary: FLIP-470: Support Adaptive Broadcast Join Key: FLINK-36159 URL: https://issues.apache.org/jira/browse/FLINK-36159 Project: Flink Issue Type: New Feature

[jira] [Updated] (FLINK-36159) FLIP-470: Support Adaptive Broadcast Join

[ https://issues.apache.org/jira/browse/FLINK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xingbe updated FLINK-36159: --- Description: This is the umbrella ticket for FLIP-470 https://cwiki.apache.org/confluence/display/FLINK/FLIP