[jira] [Closed] (FLINK-30823) Enable speculative execution for some of the typical built-in sinks

2023-01-31 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-30823. --- Resolution: Done Done via 7894fe56cd92d423a20302ea488b075507c20bbd 886b1f155313207128ddb2a242c2d1587c6d8642

[jira] [Commented] (FLINK-30826) HashAggITCase.testLeadLag is failing

2023-01-31 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17682430#comment-17682430 ] Zhu Zhu commented on FLINK-30826: - [~Sergey Nuyanzin] is the problem still happening with JDK11 when

[jira] [Reopened] (FLINK-30826) HashAggITCase.testLeadLag is failing

2023-01-31 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reopened FLINK-30826: - > HashAggITCase.testLeadLag is failing > > > Key:

[jira] [Closed] (FLINK-30826) HashAggITCase.testLeadLag is failing

2023-01-31 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-30826. --- Resolution: Duplicate > HashAggITCase.testLeadLag is failing > > >

[jira] [Commented] (FLINK-30826) HashAggITCase.testLeadLag is failing

2023-01-31 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17682427#comment-17682427 ] Zhu Zhu commented on FLINK-30826: - This problem should have been fixed in FLINK-30828. The failed test

[jira] [Assigned] (FLINK-30842) Add document for sink supports speculative execution

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30842: --- Assignee: Biao Liu > Add document for sink supports speculative execution >

[jira] [Assigned] (FLINK-30823) Enable speculative execution for some of the typical built-in sinks

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30823: --- Assignee: Biao Liu > Enable speculative execution for some of the typical built-in sinks >

[jira] [Assigned] (FLINK-30838) Update documentation about the AdaptiveBatchScheduler

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30838: --- Assignee: Junrui Li > Update documentation about the AdaptiveBatchScheduler >

[jira] [Commented] (FLINK-30828) SortAggITCase.testLeadLag failed

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17682371#comment-17682371 ] Zhu Zhu commented on FLINK-30828: - I opened a separate ticket FLINK-30834 to track the issue that

[jira] [Created] (FLINK-30834) SortAggITCase.testLeadLag is unstable in ALL_EXCHANGES_BLOCKING mode

2023-01-30 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-30834: --- Summary: SortAggITCase.testLeadLag is unstable in ALL_EXCHANGES_BLOCKING mode Key: FLINK-30834 URL: https://issues.apache.org/jira/browse/FLINK-30834 Project: Flink

[jira] [Closed] (FLINK-30828) SortAggITCase.testLeadLag failed

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-30828. --- Fix Version/s: 1.17.0 Resolution: Fixed Fixed via 9a5c2dbb85f1143c2ae24f92cd7033d8e35c69d9 >

[jira] [Closed] (FLINK-30798) Make OutputFormat support speculative execution for batch jobs

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-30798. --- Resolution: Done Done via 642d28ec83c915ddc29037737d89f6698f99161e f6694ca057ed01221968e4fdedec9dc4e3fc62e5

[jira] [Commented] (FLINK-30624) Performance regression in stateBackends.FS / FS_ASYNC / MEMORY on 05.01.2023

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17682183#comment-17682183 ] Zhu Zhu commented on FLINK-30624: - Fix 21e844b6c00b1796fdfc00136ca26d90e889b149 is merged. Will leave

[jira] [Assigned] (FLINK-30828) SortAggITCase.testLeadLag failed

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30828: --- Assignee: Zhu Zhu > SortAggITCase.testLeadLag failed > > >

[jira] [Commented] (FLINK-30826) HashAggITCase.testLeadLag is failing

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17682179#comment-17682179 ] Zhu Zhu commented on FLINK-30826: - I think it has the same cause of FLINK-30828. The test is a bit

[jira] [Commented] (FLINK-30828) SortAggITCase.testLeadLag failed

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17682176#comment-17682176 ] Zhu Zhu commented on FLINK-30828: - I can re-produce this problem locally. This problem started to appear

[jira] [Updated] (FLINK-30826) HashAggITCase.testLeadLag is failing

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-30826: Summary: HashAggITCase.testLeadLag is failing (was: HashAggITCase.testLeadLag is failing with jdk 11) >

[jira] [Commented] (FLINK-30727) JoinReorderITCase.testBushyTreeJoinReorder failed due to IOException

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17682083#comment-17682083 ] Zhu Zhu commented on FLINK-30727: -

[jira] [Updated] (FLINK-15325) Ignores the input locations of a ConsumePartitionGroup if the corresponding ConsumerVertexGroup is too large

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-15325: Summary: Ignores the input locations of a ConsumePartitionGroup if the corresponding ConsumerVertexGroup

[jira] [Closed] (FLINK-15325) Input location preference which affects task distribution may make certain job performance worse

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-15325. --- Fix Version/s: 1.17.0 Resolution: Done Done via c0bfb0b04bb38411c390813fea1ff93f6638f409

[jira] [Closed] (FLINK-30683) Make adaptive batch scheduler as the default batch scheduler

2023-01-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-30683. --- Resolution: Done Done via 143464d82814e342aa845f3ac976ae2854fc892f > Make adaptive batch scheduler as the

[jira] [Closed] (FLINK-30707) Let speculative execution take input data amount into account when detecting slow tasks

2023-01-29 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-30707. --- Fix Version/s: 1.17.0 Resolution: Done Done via 02b09eac6238fe059b6cb0ddbe791b761962dd14 > Let

[jira] [Closed] (FLINK-30799) Make SinkFunction support speculative execution for batch jobs

2023-01-29 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-30799. --- Resolution: Done Done via: 6e445064f6a20caed16b99b3d06398a51c404e84 > Make SinkFunction support

[jira] [Closed] (FLINK-30808) MultipleInputITCase failed with AdaptiveBatch Scheduler

2023-01-29 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-30808. --- Fix Version/s: 1.16.2 Resolution: Fixed master: a55ae1c6b426acdf499fc4df766fc43daa2dcce4

[jira] [Updated] (FLINK-30815) BatchTestBase/BatchAbstractTestBase are using JUnit4 while some child tests are using JUnit5

2023-01-28 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-30815: Summary: BatchTestBase/BatchAbstractTestBase are using JUnit4 while some child tests are using JUnit5

[jira] [Created] (FLINK-30815) BatchTestBase/BatchAbstractTestBase are using Junit4 while some child tests are using JUnit5

2023-01-28 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-30815: --- Summary: BatchTestBase/BatchAbstractTestBase are using Junit4 while some child tests are using JUnit5 Key: FLINK-30815 URL: https://issues.apache.org/jira/browse/FLINK-30815

[jira] [Updated] (FLINK-30814) The parallelism of sort after a global partitioning is not forced to be 1

2023-01-28 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-30814: Description: The parallelism of sort after a global partitioning is not forced to be 1. The may lead to

[jira] [Updated] (FLINK-30814) The parallelism of sort after a global partitioning is not forced to be 1

2023-01-28 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-30814: Summary: The parallelism of sort after a global partitioning is not forced to be 1 (was: The parallelism

[jira] [Created] (FLINK-30814) The parallelism of sort after a global partitioning is forced to be 1

2023-01-28 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-30814: --- Summary: The parallelism of sort after a global partitioning is forced to be 1 Key: FLINK-30814 URL: https://issues.apache.org/jira/browse/FLINK-30814 Project: Flink

[jira] [Assigned] (FLINK-30808) MultipleInputITCase failed with AdaptiveBatch Scheduler

2023-01-27 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30808: --- Assignee: Junrui Li > MultipleInputITCase failed with AdaptiveBatch Scheduler >

[jira] [Closed] (FLINK-30755) Make SinkV2 support speculative execution for batch jobs

2023-01-27 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-30755. --- Resolution: Done 833c4d25c884a2657fdf4bbdf4127a44faede7ae 2690fb17ea380d6102e53e2985617bef8e517659

[jira] [Assigned] (FLINK-30725) FLIP-281: Sink Supports Speculative Execution For Batch Job

2023-01-27 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30725: --- Assignee: Biao Liu > FLIP-281: Sink Supports Speculative Execution For Batch Job >

[jira] [Assigned] (FLINK-30755) Make SinkV2 support speculative execution for batch jobs

2023-01-27 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30755: --- Assignee: Biao Liu (was: Zhu Zhu) > Make SinkV2 support speculative execution for batch jobs >

[jira] [Assigned] (FLINK-30798) Make OutputFormat support speculative execution for batch jobs

2023-01-27 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30798: --- Assignee: Biao Liu > Make OutputFormat support speculative execution for batch jobs >

[jira] [Assigned] (FLINK-30799) Make SinkFunction support speculative execution for batch jobs

2023-01-27 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30799: --- Assignee: Biao Liu > Make SinkFunction support speculative execution for batch jobs >

[jira] [Assigned] (FLINK-30755) Make SinkV2 support speculative execution for batch jobs

2023-01-27 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30755: --- Assignee: Zhu Zhu > Make SinkV2 support speculative execution for batch jobs >

[jira] [Commented] (FLINK-15325) Input location preference which affects task distribution may make certain job performance worse

2023-01-20 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679249#comment-17679249 ] Zhu Zhu commented on FLINK-15325: - I created a pull request to resolve this problem. For a consumer

[jira] [Updated] (FLINK-15325) Input location preference which affects task distribution may make certain job performance worse

2023-01-20 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-15325: Affects Version/s: 1.15.3 1.14.6 1.16.0

[jira] [Assigned] (FLINK-15325) Input location preference which affects task distribution may make certain job performance worse

2023-01-20 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-15325: --- Assignee: Zhu Zhu > Input location preference which affects task distribution may make certain >

[jira] [Updated] (FLINK-15325) Input location preference which affects task distribution may make certain job performance worse

2023-01-20 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-15325: Labels: (was: auto-deprioritized-major auto-deprioritized-minor) > Input location preference which

[jira] [Updated] (FLINK-15325) Input location preference which affects task distribution may make certain job performance worse

2023-01-20 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-15325: Priority: Major (was: Not a Priority) > Input location preference which affects task distribution may

[jira] [Updated] (FLINK-30707) Let speculative execution take input data amount into account when detecting slow tasks

2023-01-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-30707: Summary: Let speculative execution take input data amount into account when detecting slow tasks (was:

[jira] [Commented] (FLINK-30707) Let speculative execution takes input data amount into account when detecting slow tasks

2023-01-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677584#comment-17677584 ] Zhu Zhu commented on FLINK-30707: - Thanks for the proposal! [~xiasun] I have assigned you the ticket. >

[jira] [Assigned] (FLINK-30707) Let speculative execution takes input data amount into account when detecting slow tasks

2023-01-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30707: --- Assignee: xingbe > Let speculative execution takes input data amount into account when detecting

[jira] [Assigned] (FLINK-30683) Make adaptive batch scheduler as the default batch scheduler

2023-01-13 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30683: --- Assignee: Junrui Li > Make adaptive batch scheduler as the default batch scheduler >

[jira] [Assigned] (FLINK-30685) Support mark the transformations whose parallelism is infected by the input transformation

2023-01-13 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30685: --- Assignee: Junrui Li > Support mark the transformations whose parallelism is infected by the input

[jira] [Assigned] (FLINK-30686) Simplify the configuration of adaptive batch scheduler

2023-01-13 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30686: --- Assignee: Junrui Li > Simplify the configuration of adaptive batch scheduler >

[jira] [Assigned] (FLINK-30684) Use the default parallelism as a flag for vertices that can automatically derive parallelism.

2023-01-13 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30684: --- Assignee: Junrui Li > Use the default parallelism as a flag for vertices that can automatically >

[jira] [Assigned] (FLINK-30682) FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

2023-01-13 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30682: --- Assignee: Junrui Li > FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs >

[jira] [Commented] (FLINK-30108) ZooKeeperLeaderElectionConnectionHandlingTest.testLoseLeadershipOnLostConnectionIfTolerateSuspendedConnectionsIsEnabled times out

2023-01-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17656512#comment-17656512 ] Zhu Zhu commented on FLINK-30108: - In the test logs, I can see that {code:java} 00:59:45,201 [

[jira] [Commented] (FLINK-30108) ZooKeeperLeaderElectionConnectionHandlingTest.testLoseLeadershipOnLostConnectionIfTolerateSuspendedConnectionsIsEnabled times out

2023-01-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655241#comment-17655241 ] Zhu Zhu commented on FLINK-30108: - Thanks for the input! [~mapohl] I can see tens of thousands occurring

[jira] [Commented] (FLINK-30108) flink-core module tests exited with code 143

2023-01-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17654892#comment-17654892 ] Zhu Zhu commented on FLINK-30108: - The case seems to be the {{grantLeadership}} did not succeed in

[jira] [Updated] (FLINK-30461) Some rocksdb sst files will remain forever

2023-01-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-30461: Component/s: Runtime / State Backends > Some rocksdb sst files will remain forever >

[jira] [Closed] (FLINK-30454) Inconsistent class hierarchy in TaskIOMetricGroup

2023-01-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-30454. --- Resolution: Fixed > Inconsistent class hierarchy in TaskIOMetricGroup >

[jira] [Closed] (FLINK-30558) The metric 'numRestarts' reported in SchedulerBase will be overridden by metric 'fullRestarts'

2023-01-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-30558. --- Resolution: Fixed master: b50f42673fcd44bdd6de73f77d646df5c2ad1eed 1.16:

[jira] [Updated] (FLINK-30558) The metric 'numRestarts' reported in SchedulerBase will be overridden by metric 'fullRestarts'

2023-01-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-30558: Affects Version/s: 1.16.0 > The metric 'numRestarts' reported in SchedulerBase will be overridden by >

[jira] [Updated] (FLINK-30558) The metric 'numRestarts' reported in SchedulerBase will be overridden by metric 'fullRestarts'

2023-01-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-30558: Fix Version/s: 1.16.1 > The metric 'numRestarts' reported in SchedulerBase will be overridden by >

[jira] [Commented] (FLINK-30558) The metric 'numRestarts' reported in SchedulerBase will be overridden by metric 'fullRestarts'

2023-01-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17654382#comment-17654382 ] Zhu Zhu commented on FLINK-30558: - Yes this is a problem, especially considering that {{fullRestarts}}

[jira] [Assigned] (FLINK-30558) The metric 'numRestarts' reported in SchedulerBase will be overridden by metric 'fullRestarts'

2023-01-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30558: --- Assignee: xingbe > The metric 'numRestarts' reported in SchedulerBase will be overridden by >

[jira] [Updated] (FLINK-30108) flink-core module tests exited with code 143

2022-12-29 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-30108: Component/s: Runtime / Coordination (was: API / Core) > flink-core module tests

[jira] [Commented] (FLINK-30108) flink-core module tests exited with code 143

2022-12-29 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652779#comment-17652779 ] Zhu Zhu commented on FLINK-30108: - The stuck case is ZooKeeperLeaderElectionConnectionHandlingTest.

[jira] [Closed] (FLINK-29660) Show all attempts of subtasks in WebUI

2022-12-29 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-29660. --- Resolution: Won't Fix In FLINK-30358, the taskmanager IDs of failed tasks are now displayed the exception

[jira] [Updated] (FLINK-30102) Unstable test EventTimeWindowCheckpointingITCase.testPreAggregatedSlidingTimeWindow failed runs on azure

2022-12-29 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-30102: Component/s: Runtime / State Backends > Unstable test >

[jira] [Commented] (FLINK-30102) Unstable test EventTimeWindowCheckpointingITCase.testPreAggregatedSlidingTimeWindow failed runs on azure

2022-12-29 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652770#comment-17652770 ] Zhu Zhu commented on FLINK-30102: - I can see exception below: {code:java} 2022-11-20T06:01:49.7205648Z

[jira] [Commented] (FLINK-30131) flink iterate will suspend when record is a bit large

2022-12-29 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652765#comment-17652765 ] Zhu Zhu commented on FLINK-30131: - [~landlord] do you have any updates for this issue? > flink iterate

[jira] [Closed] (FLINK-30364) Job failed without exception stack

2022-12-29 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-30364. --- Resolution: Not A Problem > Job failed without exception stack > -- > >

[jira] [Commented] (FLINK-30364) Job failed without exception stack

2022-12-29 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652759#comment-17652759 ] Zhu Zhu commented on FLINK-30364: - Close this ticket for now because it's likely to be the case

[jira] [Closed] (FLINK-30334) SourceCoordinator error splitRequest check cause HybridSource loss of data and hang

2022-12-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-30334. --- Resolution: Fixed master: 6e4e6c68a4a179d932dacafb2771cc84f730bbc0 1.16:

[jira] [Closed] (FLINK-30358) Show the task manager id on the exception history page

2022-12-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-30358. --- Fix Version/s: 1.17.0 Resolution: Done master: d4f9656d56cc495e1df78eaf1f25f82c18640e02

[jira] [Commented] (FLINK-30443) Expand list of sensitive keys

2022-12-22 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651148#comment-17651148 ] Zhu Zhu commented on FLINK-30443: - I think adding a Flink configuration, e.g. security.sensitive-keys,

[jira] [Commented] (FLINK-30480) Add benchmarks for adaptive batch scheduler

2022-12-21 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651066#comment-17651066 ] Zhu Zhu commented on FLINK-30480: - Thanks for volunteering. [~xiasun] I have assigned you the ticket. >

[jira] [Assigned] (FLINK-30480) Add benchmarks for adaptive batch scheduler

2022-12-21 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30480: --- Assignee: xingbe > Add benchmarks for adaptive batch scheduler >

[jira] [Created] (FLINK-30480) Add benchmarks for adaptive batch scheduler

2022-12-21 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-30480: --- Summary: Add benchmarks for adaptive batch scheduler Key: FLINK-30480 URL: https://issues.apache.org/jira/browse/FLINK-30480 Project: Flink Issue Type: Improvement

[jira] (FLINK-15325) Input location preference which affects task distribution may make certain job performance worse

2022-12-20 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15325 ] Zhu Zhu deleted comment on FLINK-15325: - was (Author: flink-jira-bot): This issue was labeled "stale-minor" 7 days ago and has not received any updates so it is being deprioritized. If this

[jira] (FLINK-15325) Input location preference which affects task distribution may make certain job performance worse

2022-12-20 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15325 ] Zhu Zhu deleted comment on FLINK-15325: - was (Author: flink-jira-bot): This issue was labeled "stale-major" 7 ago and has not received any updates so it is being deprioritized. If this ticket

[jira] (FLINK-15325) Input location preference which affects task distribution may make certain job performance worse

2022-12-20 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15325 ] Zhu Zhu deleted comment on FLINK-15325: - was (Author: flink-jira-bot): This major issue is unassigned and itself and all of its Sub-Tasks have not been updated for 30 days. So, it has been

[jira] (FLINK-15325) Input location preference which affects task distribution may make certain job performance worse

2022-12-20 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15325 ] Zhu Zhu deleted comment on FLINK-15325: - was (Author: flink-jira-bot): I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community manage its development. I see

[jira] [Comment Edited] (FLINK-30364) Job failed without exception stack

2022-12-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17647918#comment-17647918 ] Zhu Zhu edited comment on FLINK-30364 at 12/15/22 8:41 AM: --- [~dianfu] is there

[jira] [Commented] (FLINK-30364) Job failed without exception stack

2022-12-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17647918#comment-17647918 ] Zhu Zhu commented on FLINK-30364: - [~dianfu] is there a way to reproduce this issue? > Job failed

[jira] [Comment Edited] (FLINK-30246) Registering the same metric object with different name and group will conflict in metric reporter

2022-12-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17647898#comment-17647898 ] Zhu Zhu edited comment on FLINK-30246 at 12/15/22 7:57 AM: --- You are right.

[jira] [Updated] (FLINK-30246) Registering the same metric object with different name and group will conflict in metric reporter

2022-12-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-30246: Fix Version/s: 2.0.0 > Registering the same metric object with different name and group will > conflict

[jira] [Commented] (FLINK-30246) Registering the same metric object with different name and group will conflict in metric reporter

2022-12-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17647898#comment-17647898 ] Zhu Zhu commented on FLINK-30246: - You are right. Unfortunately, we cannot change the protected fields

[jira] [Commented] (FLINK-30198) Support AdaptiveBatchScheduler to set per-task size for reducer task

2022-12-13 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17646961#comment-17646961 ] Zhu Zhu commented on FLINK-30198: - In our experience, map tasks are also possible to be heavy, depending

[jira] [Commented] (FLINK-30358) Show the task manager id on the exception history page

2022-12-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645714#comment-17645714 ] Zhu Zhu commented on FLINK-30358: - This sounds a good improvement. Thanks for proposing this!

[jira] [Assigned] (FLINK-30358) Show the task manager id on the exception history page

2022-12-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30358: --- Assignee: JunRui Li > Show the task manager id on the exception history page >

[jira] [Updated] (FLINK-30334) SourceCoordinator error splitRequest check cause HybridSource loss of data and hang

2022-12-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-30334: Fix Version/s: 1.16.1 > SourceCoordinator error splitRequest check cause HybridSource loss of data > and

[jira] [Updated] (FLINK-30334) SourceCoordinator error splitRequest check cause HybridSource loss of data and hang

2022-12-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-30334: Fix Version/s: 1.17.0 > SourceCoordinator error splitRequest check cause HybridSource loss of data > and

[jira] [Commented] (FLINK-30334) SourceCoordinator error splitRequest check cause HybridSource loss of data and hang

2022-12-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645220#comment-17645220 ] Zhu Zhu commented on FLINK-30334: - Thanks for volunteering to fix it. [~lemonjing] I have assigned you

[jira] [Assigned] (FLINK-30334) SourceCoordinator error splitRequest check cause HybridSource loss of data and hang

2022-12-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30334: --- Assignee: Ran Tao > SourceCoordinator error splitRequest check cause HybridSource loss of data >

[jira] [Commented] (FLINK-30334) SourceCoordinator error splitRequest check cause HybridSource loss of data and hang

2022-12-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645062#comment-17645062 ] Zhu Zhu commented on FLINK-30334: - Thanks for reporting this issue! [~lemonjing] It is unexpected that

[jira] [Closed] (FLINK-28982) Start TaskInterrupter when task switch from DEPLOYING to CANCELING

2022-12-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-28982. --- Resolution: Not A Bug > Start TaskInterrupter when task switch from DEPLOYING to CANCELING >

[jira] [Commented] (FLINK-28982) Start TaskInterrupter when task switch from DEPLOYING to CANCELING

2022-12-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644693#comment-17644693 ] Zhu Zhu commented on FLINK-28982: - The related remote shuffle service problem is already fixed:

[jira] [Commented] (FLINK-28982) Start TaskInterrupter when task switch from DEPLOYING to CANCELING

2022-12-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644688#comment-17644688 ] Zhu Zhu commented on FLINK-28982: - This is an intentional behavior because Flink does not want to

[jira] [Assigned] (FLINK-30246) Registering the same metric object with different name and group will conflict in metric reporter

2022-12-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-30246: --- Assignee: xingbe > Registering the same metric object with different name and group will >

[jira] [Commented] (FLINK-30246) Registering the same metric object with different name and group will conflict in metric reporter

2022-12-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644595#comment-17644595 ] Zhu Zhu commented on FLINK-30246: - Thanks for volunteering to take this ticket! I have assigned you the

[jira] [Closed] (FLINK-29809) REST API for running a Flink job

2022-12-01 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-29809. --- Resolution: Invalid > REST API for running a Flink job > > >

[jira] [Commented] (FLINK-29167) Time out-of-order optimization for merging multiple data streams into one data stream

2022-12-01 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641771#comment-17641771 ] Zhu Zhu commented on FLINK-29167: - The record orders are retained if they are from the same source and

[jira] [Closed] (FLINK-29167) Time out-of-order optimization for merging multiple data streams into one data stream

2022-12-01 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-29167. --- Resolution: Not A Problem Closing the ticket because it does not seem to be a problem and is not active

[jira] [Updated] (FLINK-29167) Time out-of-order optimization for merging multiple data streams into one data stream

2022-12-01 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-29167: Fix Version/s: (was: 1.14.2) > Time out-of-order optimization for merging multiple data streams into

[jira] [Updated] (FLINK-30072) Cannot assign instance of SerializedLambda to field KeyGroupStreamPartitioner.keySelector

2022-12-01 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-30072: Component/s: Runtime / Task (was: Runtime / Coordination) > Cannot assign instance

<    1   2   3   4   5   6   7   8   9   10   >