[jira] [Commented] (FLINK-34528) Disconnect TM in JM when TM was killed to further reduce the job restart time

2024-02-27 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821132#comment-17821132 ] Lijie Wang commented on FLINK-34528: Does this exception always mean that the TM is killed or

[jira] [Comment Edited] (FLINK-34358) flink-connector-jdbc nightly fails with "Expecting code to raise a throwable"

2024-02-18 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818346#comment-17818346 ] Lijie Wang edited comment on FLINK-34358 at 2/19/24 6:15 AM: - The test

[jira] [Commented] (FLINK-34358) flink-connector-jdbc nightly fails with "Expecting code to raise a throwable"

2024-02-18 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818347#comment-17818347 ] Lijie Wang commented on FLINK-34358: The exception stack in 1.18: {code:java}

[jira] [Assigned] (FLINK-34358) flink-connector-jdbc nightly fails with "Expecting code to raise a throwable"

2024-02-18 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-34358: -- Assignee: Lijie Wang > flink-connector-jdbc nightly fails with "Expecting code to raise a

[jira] [Commented] (FLINK-34358) flink-connector-jdbc nightly fails with "Expecting code to raise a throwable"

2024-02-18 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818346#comment-17818346 ] Lijie Wang commented on FLINK-34358: The test passes in flink 1.18 but fails in flink 1.19. The root

[jira] [Closed] (FLINK-34365) [docs] Delete repeated pages in Chinese Flink website and correct the Paimon url

2024-02-06 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-34365. -- Resolution: Fixed > [docs] Delete repeated pages in Chinese Flink website and correct the Paimon >

[jira] [Commented] (FLINK-34365) [docs] Delete repeated pages in Chinese Flink website and correct the Paimon url

2024-02-06 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815053#comment-17815053 ] Lijie Wang commented on FLINK-34365: Fixed via branch asf-site(flink-web):

[jira] [Assigned] (FLINK-34365) [docs] Delete repeated pages in Chinese Flink website and correct the Paimon url

2024-02-05 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-34365: -- Assignee: Waterking > [docs] Delete repeated pages in Chinese Flink website and correct the

[jira] [Commented] (FLINK-34365) [docs] Delete repeated pages in Chinese Flink website and correct the Paimon url

2024-02-05 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814628#comment-17814628 ] Lijie Wang commented on FLINK-34365: Assigned to you [~waterking] :) > [docs] Delete repeated pages

[jira] [Commented] (FLINK-34132) Batch WordCount job fails when run with AdaptiveBatch scheduler

2024-01-17 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807697#comment-17807697 ] Lijie Wang commented on FLINK-34132: [~prabhujoseph] AFAIK, adaptive batch scheduler does not

[jira] [Commented] (FLINK-34025) Show data skew score on Flink Dashboard

2024-01-09 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17804720#comment-17804720 ] Lijie Wang commented on FLINK-34025: Hi [~iemre], I think your proposal needs to be discussed on the

[jira] [Updated] (FLINK-33968) Compute the number of subpartitions when initializing executon job vertices

2024-01-02 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-33968: --- Description: Currently, when using dynamic graphs, the subpartition-num of a task is lazily

[jira] [Created] (FLINK-33968) Compute the number of subpartitions when initializing executon job vertices

2024-01-02 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-33968: -- Summary: Compute the number of subpartitions when initializing executon job vertices Key: FLINK-33968 URL: https://issues.apache.org/jira/browse/FLINK-33968 Project:

[jira] [Assigned] (FLINK-33892) FLIP-383: Support Job Recovery for Batch Jobs

2024-01-02 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33892: -- Assignee: Junrui Li (was: Lijie Wang) > FLIP-383: Support Job Recovery for Batch Jobs >

[jira] [Commented] (FLINK-33943) Apache flink: Issues after configuring HA (using zookeeper setting)

2023-12-26 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800679#comment-17800679 ] Lijie Wang commented on FLINK-33943: Maybe you can see the comments in FLINK-19358 and

[jira] [Closed] (FLINK-33943) Apache flink: Issues after configuring HA (using zookeeper setting)

2023-12-26 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-33943. -- Resolution: Not A Bug > Apache flink: Issues after configuring HA (using zookeeper setting) >

[jira] [Commented] (FLINK-33943) Apache flink: Issues after configuring HA (using zookeeper setting)

2023-12-26 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800676#comment-17800676 ] Lijie Wang commented on FLINK-33943: I 'll close this issue because it's not a bug. cc

[jira] [Commented] (FLINK-33943) Apache flink: Issues after configuring HA (using zookeeper setting)

2023-12-26 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800671#comment-17800671 ] Lijie Wang commented on FLINK-33943: [~vrang...@in.ibm.com] I think it should work if you use

[jira] [Commented] (FLINK-33943) Apache flink: Issues after configuring HA (using zookeeper setting)

2023-12-26 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800668#comment-17800668 ] Lijie Wang commented on FLINK-33943: Hi [~vrang...@in.ibm.com], currently, HA in Application Mode is

[jira] [Closed] (FLINK-31650) Incorrect busyMsTimePerSecond metric value for FINISHED task

2023-12-25 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-31650. -- Fix Version/s: 1.19.0 1.18.1 1.17.3 Resolution: Fixed >

[jira] [Commented] (FLINK-31650) Incorrect busyMsTimePerSecond metric value for FINISHED task

2023-12-25 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800398#comment-17800398 ] Lijie Wang commented on FLINK-31650: Fixed via: master(1.19) : 

[jira] [Assigned] (FLINK-33905) FLIP-382: Unify the Provision of Diverse Metadata for Context-like APIs

2023-12-23 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33905: -- Assignee: Wencong Liu > FLIP-382: Unify the Provision of Diverse Metadata for Context-like

[jira] [Assigned] (FLINK-33892) FLIP-383: Support Job Recovery for Batch Jobs

2023-12-19 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33892: -- Assignee: (was: Lijie Wang) > FLIP-383: Support Job Recovery for Batch Jobs >

[jira] [Assigned] (FLINK-33892) FLIP-383: Support Job Recovery for Batch Jobs

2023-12-19 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33892: -- Assignee: Lijie Wang > FLIP-383: Support Job Recovery for Batch Jobs >

[jira] [Assigned] (FLINK-33892) FLIP-383: Support Job Recovery for Batch Jobs

2023-12-19 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33892: -- Assignee: Lijie Wang > FLIP-383: Support Job Recovery for Batch Jobs >

[jira] [Created] (FLINK-33892) FLIP-383: Support Job Recovery for Batch Jobs

2023-12-19 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-33892: -- Summary: FLIP-383: Support Job Recovery for Batch Jobs Key: FLINK-33892 URL: https://issues.apache.org/jira/browse/FLINK-33892 Project: Flink Issue Type: New

[jira] [Assigned] (FLINK-33713) Deprecate RuntimeContext#getExecutionConfig

2023-12-01 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33713: -- Assignee: Junrui Li > Deprecate RuntimeContext#getExecutionConfig >

[jira] [Assigned] (FLINK-33714) Update documentation about the usage of RuntimeContext#getExecutionConfig

2023-12-01 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33714: -- Assignee: Junrui Li > Update documentation about the usage of

[jira] [Assigned] (FLINK-33721) Extend BashJavaUtils to Support Reading and Writing Standard YAML Files

2023-12-01 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33721: -- Assignee: Junrui Li > Extend BashJavaUtils to Support Reading and Writing Standard YAML

[jira] [Assigned] (FLINK-33581) FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-16 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33581: -- Assignee: Junrui Li > FLIP-381: Deprecate configuration getters/setters that return/set

[jira] [Assigned] (FLINK-33576) Introduce new Flink conf file "config.yaml" supporting standard YAML syntax

2023-11-16 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33576: -- Assignee: Junrui Li > Introduce new Flink conf file "config.yaml" supporting standard YAML

[jira] [Assigned] (FLINK-33577) Make "conf.yaml" as the default Flink configuration file

2023-11-16 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33577: -- Assignee: Junrui Li > Make "conf.yaml" as the default Flink configuration file >

[jira] [Commented] (FLINK-33356) The navigation bar on Flink’s official website is messed up.

2023-11-01 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781986#comment-17781986 ] Lijie Wang commented on FLINK-33356: The website is normal now, thanks [~JunRuiLi] [~Wencong Liu] :D

[jira] [Closed] (FLINK-33356) The navigation bar on Flink’s official website is messed up.

2023-10-31 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-33356. -- Fix Version/s: 1.19.0 Resolution: Fixed > The navigation bar on Flink’s official website is

[jira] [Commented] (FLINK-33356) The navigation bar on Flink’s official website is messed up.

2023-10-31 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781274#comment-17781274 ] Lijie Wang commented on FLINK-33356: Fixed via master 780a673d8e2c3845d685c86d95166d9169601726 >

[jira] [Assigned] (FLINK-33364) Introduce standard YAML for flink configuration

2023-10-25 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33364: -- Assignee: Junrui Li > Introduce standard YAML for flink configuration >

[jira] [Commented] (FLINK-33356) The navigation bar on Flink’s official website is messed up.

2023-10-25 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779345#comment-17779345 ] Lijie Wang commented on FLINK-33356: [~Wencong Liu] Assigned to you. > The navigation bar on

[jira] [Assigned] (FLINK-33356) The navigation bar on Flink’s official website is messed up.

2023-10-25 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33356: -- Assignee: Wencong Liu > The navigation bar on Flink’s official website is messed up. >

[jira] [Commented] (FLINK-32974) RestClusterClient always leaks flink-rest-client-jobgraphs* directories

2023-09-20 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17767357#comment-17767357 ] Lijie Wang commented on FLINK-32974: Fix via master: 6034d5ff335dc970672c290851811235399452fb

[jira] [Resolved] (FLINK-32974) RestClusterClient always leaks flink-rest-client-jobgraphs* directories

2023-09-20 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang resolved FLINK-32974. Fix Version/s: 1.18.0 1.17.2 Resolution: Fixed > RestClusterClient

[jira] [Updated] (FLINK-32974) RestClusterClient always leaks flink-rest-client-jobgraphs* directories

2023-09-19 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32974: --- Description: After FLINK-32226, a temporary directory(named {{flink-rest-client-jobgraphs*}}) is

[jira] [Updated] (FLINK-32974) RestClusterClient always leaks flink-rest-client-jobgraphs* directories

2023-09-18 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32974: --- Affects Version/s: 1.17.2 > RestClusterClient always leaks flink-rest-client-jobgraphs* directories

[jira] [Updated] (FLINK-32974) RestClusterClient always leaks flink-rest-client-jobgraphs* directories

2023-09-18 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32974: --- Priority: Critical (was: Major) > RestClusterClient always leaks flink-rest-client-jobgraphs*

[jira] [Assigned] (FLINK-33084) Migrate globalJobParameter in ExecutionConfig to configuration instance

2023-09-13 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33084: -- Assignee: Junrui Li > Migrate globalJobParameter in ExecutionConfig to configuration

[jira] [Assigned] (FLINK-33080) The checkpoint storage configured in the job level by config option will not take effect

2023-09-13 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-33080: -- Assignee: Junrui Li > The checkpoint storage configured in the job level by config option

[jira] [Assigned] (FLINK-32974) RestClusterClient always leaks flink-rest-client-jobgraphs* directories

2023-09-05 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-32974: -- Assignee: Lijie Wang > RestClusterClient always leaks flink-rest-client-jobgraphs*

[jira] [Closed] (FLINK-32865) DynamicFilteringDataCollectorOperator can't chain with the upstream operator when the parallelism is inconsistent

2023-08-30 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-32865. -- Assignee: Lijie Wang Resolution: Fixed > DynamicFilteringDataCollectorOperator can't chain with

[jira] [Updated] (FLINK-32865) DynamicFilteringDataCollectorOperator can't chain with the upstream operator when the parallelism is inconsistent

2023-08-30 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32865: --- Fix Version/s: 1.19.0 > DynamicFilteringDataCollectorOperator can't chain with the upstream

[jira] [Commented] (FLINK-32865) DynamicFilteringDataCollectorOperator can't chain with the upstream operator when the parallelism is inconsistent

2023-08-30 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760389#comment-17760389 ] Lijie Wang commented on FLINK-32865: Fixed via: master(1.19):

[jira] [Commented] (FLINK-31650) Incorrect busyMsTimePerSecond metric value for FINISHED task

2023-08-29 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760197#comment-17760197 ] Lijie Wang commented on FLINK-31650: Assigned to you [~Zhanghao Chen]  > Incorrect

[jira] [Assigned] (FLINK-31650) Incorrect busyMsTimePerSecond metric value for FINISHED task

2023-08-29 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-31650: -- Assignee: Zhanghao Chen (was: Junrui Li) > Incorrect busyMsTimePerSecond metric value for

[jira] [Updated] (FLINK-32974) RestClusterClient always leaks flink-rest-client-jobgraphs* directories

2023-08-28 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32974: --- Summary: RestClusterClient always leaks flink-rest-client-jobgraphs* directories (was:

[jira] [Created] (FLINK-32974) RestClusterClient leaks flink-rest-client-jobgraphs* directories

2023-08-28 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-32974: -- Summary: RestClusterClient leaks flink-rest-client-jobgraphs* directories Key: FLINK-32974 URL: https://issues.apache.org/jira/browse/FLINK-32974 Project: Flink

[jira] [Closed] (FLINK-32831) RuntimeFilterProgram should aware join type when looking for the build side

2023-08-27 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-32831. -- Fix Version/s: 1.18.0 1.19.0 Resolution: Fixed > RuntimeFilterProgram

[jira] [Commented] (FLINK-32831) RuntimeFilterProgram should aware join type when looking for the build side

2023-08-27 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759405#comment-17759405 ] Lijie Wang commented on FLINK-32831: Fixed via master: 43bcf319ff6104e1af829e34ae8a430c6417622d

[jira] [Updated] (FLINK-32780) Release Testing: Verify FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-08-25 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32780: --- Description: This issue aims to verify FLIP-324:

[jira] [Assigned] (FLINK-32780) Release Testing: Verify FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-08-24 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-32780: -- Assignee: dalongliu > Release Testing: Verify FLIP-324: Introduce Runtime Filter for Flink

[jira] [Commented] (FLINK-32827) Operator fusion codegen may not take effect when enable runtime filter

2023-08-23 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758317#comment-17758317 ] Lijie Wang commented on FLINK-32827: Fixed via master: 679436390db2ac1b54584dbafb6e1091f2f16ada

[jira] [Closed] (FLINK-32827) Operator fusion codegen may not take effect when enable runtime filter

2023-08-23 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-32827. -- Fix Version/s: 1.18.0 Resolution: Fixed > Operator fusion codegen may not take effect when

[jira] [Closed] (FLINK-32844) Runtime Filter should not be applied if the field is already filtered by DPP

2023-08-16 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-32844. -- Fix Version/s: 1.18.0 Resolution: Fixed > Runtime Filter should not be applied if the field is

[jira] [Commented] (FLINK-32844) Runtime Filter should not be applied if the field is already filtered by DPP

2023-08-16 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754890#comment-17754890 ] Lijie Wang commented on FLINK-32844: Fix via master(1.18): 6b7d6d67808b7fcdd6fc93222c6c7055c4343475

[jira] [Assigned] (FLINK-32876) ExecutionTimeBasedSlowTaskDetector treats unscheduled tasks as slow tasks and causes speculative execution to fail.

2023-08-15 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-32876: -- Assignee: Junrui Li > ExecutionTimeBasedSlowTaskDetector treats unscheduled tasks as slow

[jira] [Assigned] (FLINK-32844) Runtime Filter should not be applied if the field is already filtered by DPP

2023-08-11 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-32844: -- Assignee: Lijie Wang > Runtime Filter should not be applied if the field is already filtered

[jira] [Created] (FLINK-32844) Runtime Filter should not be applied if the field is already filtered by DPP

2023-08-11 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-32844: -- Summary: Runtime Filter should not be applied if the field is already filtered by DPP Key: FLINK-32844 URL: https://issues.apache.org/jira/browse/FLINK-32844 Project:

[jira] [Assigned] (FLINK-32831) RuntimeFilterProgram should aware join type when looking for the build side

2023-08-10 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-32831: -- Assignee: Lijie Wang > RuntimeFilterProgram should aware join type when looking for the

[jira] [Updated] (FLINK-32831) RuntimeFilterProgram should aware join type when looking for the build side

2023-08-10 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32831: --- Description: Currently, runtime filter program will try to look for an {{Exchange}} as build side

[jira] [Created] (FLINK-32831) RuntimeFilterProgram should aware join type when looking for the build side

2023-08-10 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-32831: -- Summary: RuntimeFilterProgram should aware join type when looking for the build side Key: FLINK-32831 URL: https://issues.apache.org/jira/browse/FLINK-32831 Project:

[jira] [Assigned] (FLINK-32827) Operator fusion codegen may not take effect when enable runtime filter

2023-08-10 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-32827: -- Assignee: dalongliu > Operator fusion codegen may not take effect when enable runtime filter

[jira] [Commented] (FLINK-32827) Operator fusion codegen may not take effect when enable runtime filter

2023-08-10 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752724#comment-17752724 ] Lijie Wang commented on FLINK-32827: cc [~lsy] > Operator fusion codegen may not take effect when

[jira] [Created] (FLINK-32827) Operator fusion codegen may not take effect when enable runtime filter

2023-08-10 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-32827: -- Summary: Operator fusion codegen may not take effect when enable runtime filter Key: FLINK-32827 URL: https://issues.apache.org/jira/browse/FLINK-32827 Project: Flink

[jira] [Assigned] (FLINK-32788) SpeculativeScheduler do not handle allocate task errors when schedule speculative tasks may causes resource leakage.

2023-08-08 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-32788: -- Assignee: Junrui Li > SpeculativeScheduler do not handle allocate task errors when schedule

[jira] [Updated] (FLINK-32768) SpeculativeSchedulerITCase.testSpeculativeExecutionOfInputFormatSource times out

2023-08-07 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32768: --- Priority: Blocker (was: Critical) >

[jira] [Closed] (FLINK-32680) Job vertex names get messed up once there is a source vertex chained with a MultipleInput vertex in job graph

2023-08-01 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-32680. -- Fix Version/s: 1.18.0 1.16.3 1.17.2 Resolution: Fixed >

[jira] [Commented] (FLINK-32680) Job vertex names get messed up once there is a source vertex chained with a MultipleInput vertex in job graph

2023-08-01 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749791#comment-17749791 ] Lijie Wang commented on FLINK-32680: Fixed via: master(1.18):

[jira] [Closed] (FLINK-32486) FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-07-27 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-32486. -- Release Note: We introduce runtime filter for batch jobs in 1.18, which is designed to improve join

[jira] [Commented] (FLINK-32486) FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-07-27 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17747806#comment-17747806 ] Lijie Wang commented on FLINK-32486: Thanks for reminder [~knaufk]. This feature is a performance

[jira] [Assigned] (FLINK-32680) Job vertex names get messed up once there is a source vertex chained with a MultipleInput vertex in job graph

2023-07-26 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-32680: -- Assignee: Junrui Li > Job vertex names get messed up once there is a source vertex chained

[jira] [Commented] (FLINK-32680) Job vertex names get messed up once there is a source vertex chained with a MultipleInput vertex in job graph

2023-07-26 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17747411#comment-17747411 ] Lijie Wang commented on FLINK-32680: Thanks [~JunRuiLi] , assiged to you. > Job vertex names get

[jira] [Updated] (FLINK-32680) Job vertex names get messed up once there is a source vertex chained with a MultipleInput vertex in job graph

2023-07-26 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32680: --- Description: Take the following test(put it to {{MultipleInputITCase}}) as example: {code:java}

[jira] [Updated] (FLINK-32680) Job vertex names get messed up once there is a source vertex chained with a MultipleInput vertex in job graph

2023-07-26 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32680: --- Attachment: (was: image-2023-07-26-15-01-51-886.png) > Job vertex names get messed up once

[jira] [Updated] (FLINK-32680) Job vertex names get messed up once there is a source vertex chained with a MultipleInput vertex in job graph

2023-07-26 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32680: --- Description: Take the following test(put it to {{{}MultipleInputITCase{}}}) as example: {code:java}

[jira] [Created] (FLINK-32680) Job vertex names get messed up once there is a source vertex chained with a MultipleInput vertex in job graph

2023-07-26 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-32680: -- Summary: Job vertex names get messed up once there is a source vertex chained with a MultipleInput vertex in job graph Key: FLINK-32680 URL:

[jira] [Commented] (FLINK-32492) Introduce FlinkRuntimeFilterProgram to inject runtime filter

2023-07-23 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746058#comment-17746058 ] Lijie Wang commented on FLINK-32492: Done via master(1.18): 8659dd788d0e9bc5e534377fd065f925a3e33bbb

[jira] [Closed] (FLINK-32492) Introduce FlinkRuntimeFilterProgram to inject runtime filter

2023-07-23 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-32492. -- Resolution: Done > Introduce FlinkRuntimeFilterProgram to inject runtime filter >

[jira] [Updated] (FLINK-32045) optimize task deployment performance for large-scale jobs

2023-07-23 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32045: --- Fix Version/s: 1.18.0 > optimize task deployment performance for large-scale jobs >

[jira] [Updated] (FLINK-32386) Add ShuffleDescriptorsCache in TaskExecutor to cache ShuffleDescriptors

2023-07-23 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32386: --- Fix Version/s: 1.18.0 > Add ShuffleDescriptorsCache in TaskExecutor to cache ShuffleDescriptors >

[jira] [Closed] (FLINK-32387) InputGateDeploymentDescriptor uses cache to avoid deserializing shuffle descriptors multiple times

2023-07-23 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-32387. -- Fix Version/s: 1.18.0 Resolution: Done > InputGateDeploymentDescriptor uses cache to avoid

[jira] [Commented] (FLINK-32387) InputGateDeploymentDescriptor uses cache to avoid deserializing shuffle descriptors multiple times

2023-07-23 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746040#comment-17746040 ] Lijie Wang commented on FLINK-32387: Done via master(1.18): 7a9efbff0a2ea3e4e736c48a57a362cc9c5bbf37

[jira] [Updated] (FLINK-32385) Introduce a struct SerializedShuffleDescriptorAndIndices to identify a group of ShuffleDescriptorAndIndex

2023-07-23 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32385: --- Fix Version/s: 1.18.0 > Introduce a struct SerializedShuffleDescriptorAndIndices to identify a

[jira] [Closed] (FLINK-32386) Add ShuffleDescriptorsCache in TaskExecutor to cache ShuffleDescriptors

2023-07-23 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-32386. -- Resolution: Done > Add ShuffleDescriptorsCache in TaskExecutor to cache ShuffleDescriptors >

[jira] [Commented] (FLINK-32386) Add ShuffleDescriptorsCache in TaskExecutor to cache ShuffleDescriptors

2023-07-23 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746039#comment-17746039 ] Lijie Wang commented on FLINK-32386: Done via master(1.18): 4d642635c9409883724bd0127f2a00ef14993bf0

[jira] [Closed] (FLINK-32385) Introduce a struct SerializedShuffleDescriptorAndIndices to identify a group of ShuffleDescriptorAndIndex

2023-07-23 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-32385. -- Resolution: Done > Introduce a struct SerializedShuffleDescriptorAndIndices to identify a group > of

[jira] [Commented] (FLINK-32385) Introduce a struct SerializedShuffleDescriptorAndIndices to identify a group of ShuffleDescriptorAndIndex

2023-07-23 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746038#comment-17746038 ] Lijie Wang commented on FLINK-32385: Done via master(1.18): fa4518960fd009531a584ca5450604649e94bac0

[jira] [Closed] (FLINK-32491) Introduce RuntimeFilterOperator to support runtime filter which can reduce the shuffle data size before shuffle join

2023-07-21 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-32491. -- Resolution: Done > Introduce RuntimeFilterOperator to support runtime filter which can reduce > the

[jira] [Commented] (FLINK-32491) Introduce RuntimeFilterOperator to support runtime filter which can reduce the shuffle data size before shuffle join

2023-07-21 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17745872#comment-17745872 ] Lijie Wang commented on FLINK-32491: Done via master(1.18): 59850a91f96ddb5c58d8554b76e46bc6245dda7b

[jira] [Closed] (FLINK-32493) Introduce RuntimeFilterBuilderOperator to build a BloomFilter from build side data of shuffle join

2023-07-21 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-32493. -- Resolution: Done > Introduce RuntimeFilterBuilderOperator to build a BloomFilter from build side >

[jira] [Commented] (FLINK-32493) Introduce RuntimeFilterBuilderOperator to build a BloomFilter from build side data of shuffle join

2023-07-21 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17745467#comment-17745467 ] Lijie Wang commented on FLINK-32493: Done via master(1.18) 47596ea9250415bc333fa612c6b1ec5c7407fdd6

[jira] [Updated] (FLINK-32632) Run Kubernetes test is unstable on AZP

2023-07-20 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-32632: --- Priority: Blocker (was: Critical) > Run Kubernetes test is unstable on AZP >

[jira] [Commented] (FLINK-32632) Run Kubernetes test is unstable on AZP

2023-07-20 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17745367#comment-17745367 ] Lijie Wang commented on FLINK-32632:

[jira] [Assigned] (FLINK-32491) Introduce RuntimeFilterOperator to support runtime filter which can reduce the shuffle data size before shuffle join

2023-07-17 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang reassigned FLINK-32491: -- Assignee: Lijie Wang (was: dalongliu) > Introduce RuntimeFilterOperator to support runtime

  1   2   3   4   5   6   7   >