[GitHub] [flink] WencongLiu commented on a diff in pull request #20451: [FLINK-28162][sql-gateway]Introduce the operation related API for REST endpoint

2022-08-04 Thread GitBox
WencongLiu commented on code in PR #20451: URL: https://github.com/apache/flink/pull/20451#discussion_r938468545 ## flink-table/flink-sql-gateway-api/src/main/java/org/apache/flink/table/gateway/api/results/ExceptionInfo.java: ## @@ -0,0 +1,64 @@ +/* + * Licensed to the Apache

[GitHub] [flink] WencongLiu commented on a diff in pull request #20451: [FLINK-28162][sql-gateway]Introduce the operation related API for REST endpoint

2022-08-04 Thread GitBox
WencongLiu commented on code in PR #20451: URL: https://github.com/apache/flink/pull/20451#discussion_r938463223 ## flink-table/flink-sql-gateway/src/main/java/org/apache/flink/table/gateway/rest/message/statement/ExecuteStatementResponseBody.java: ## @@ -0,0 +1,53 @@ +/* + *

[GitHub] [flink] WencongLiu commented on a diff in pull request #20451: [FLINK-28162][sql-gateway]Introduce the operation related API for REST endpoint

2022-08-04 Thread GitBox
WencongLiu commented on code in PR #20451: URL: https://github.com/apache/flink/pull/20451#discussion_r938462535 ## flink-table/flink-sql-gateway/src/main/java/org/apache/flink/table/gateway/rest/message/statement/ExecuteStatementResponseBody.java: ## @@ -0,0 +1,53 @@ +/* + *

[GitHub] [flink] WencongLiu commented on a diff in pull request #20451: [FLINK-28162][sql-gateway]Introduce the operation related API for REST endpoint

2022-08-04 Thread GitBox
WencongLiu commented on code in PR #20451: URL: https://github.com/apache/flink/pull/20451#discussion_r938460160 ## flink-table/flink-sql-gateway/src/main/java/org/apache/flink/table/gateway/rest/handler/util/GetApiVersionHandler.java: ## @@ -0,0 +1,58 @@ +/* + * Licensed to

[GitHub] [flink] WencongLiu commented on a diff in pull request #20451: [FLINK-28162][sql-gateway]Introduce the operation related API for REST endpoint

2022-08-04 Thread GitBox
WencongLiu commented on code in PR #20451: URL: https://github.com/apache/flink/pull/20451#discussion_r938461762 ## flink-table/flink-sql-gateway/src/main/java/org/apache/flink/table/gateway/rest/message/statement/ExecuteStatementRequestBody.java: ## @@ -0,0 +1,59 @@ +/* + *

[GitHub] [flink] WencongLiu commented on a diff in pull request #20451: [FLINK-28162][sql-gateway]Introduce the operation related API for REST endpoint

2022-08-04 Thread GitBox
WencongLiu commented on code in PR #20451: URL: https://github.com/apache/flink/pull/20451#discussion_r938461506 ## flink-table/flink-sql-gateway/src/main/java/org/apache/flink/table/gateway/rest/handler/statement/ExecuteStatementHandler.java: ## @@ -0,0 +1,89 @@ +/* + *

[GitHub] [flink] WencongLiu commented on a diff in pull request #20451: [FLINK-28162][sql-gateway]Introduce the operation related API for REST endpoint

2022-08-04 Thread GitBox
WencongLiu commented on code in PR #20451: URL: https://github.com/apache/flink/pull/20451#discussion_r938460160 ## flink-table/flink-sql-gateway/src/main/java/org/apache/flink/table/gateway/rest/handler/util/GetApiVersionHandler.java: ## @@ -0,0 +1,58 @@ +/* + * Licensed to

[GitHub] [flink] WencongLiu commented on a diff in pull request #20451: [FLINK-28162][sql-gateway]Introduce the operation related API for REST endpoint

2022-08-04 Thread GitBox
WencongLiu commented on code in PR #20451: URL: https://github.com/apache/flink/pull/20451#discussion_r938459685 ## flink-table/flink-sql-gateway/src/main/java/org/apache/flink/table/gateway/rest/handler/operation/AbstractOperationHandler.java: ## @@ -0,0 +1,91 @@ +/* + *

[GitHub] [flink] TanYuxin-tyx commented on pull request #20457: [FLINK-28373][network] Read a full buffer of data per file IO read request for sort-shuffle

2022-08-04 Thread GitBox
TanYuxin-tyx commented on PR #20457: URL: https://github.com/apache/flink/pull/20457#issuecomment-1206062673 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (FLINK-26721) PulsarSourceITCase.testSavepoint failed on azure pipeline

2022-08-04 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575585#comment-17575585 ] lincoln lee commented on FLINK-26721: -

[GitHub] [flink-kubernetes-operator] gyfora merged pull request #335: [hotfix] Clean up code warnings and remove some unnecessary bits + en…

2022-08-04 Thread GitBox
gyfora merged PR #335: URL: https://github.com/apache/flink-kubernetes-operator/pull/335 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-28548) The commit partition base path is not created when no data is sent which may cause FileNotFoundException

2022-08-04 Thread Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575577#comment-17575577 ] Liu commented on FLINK-28548: - [~jark] Do you have time to review it? Thanks. > The commit partition base

[jira] [Commented] (FLINK-28003) Hive sql is wrongly modified by SqlCompleter in SQL client when using -f {file}

2022-08-04 Thread Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575578#comment-17575578 ] Liu commented on FLINK-28003: - [~shengkai] Do you have time to review it? Thanks. > Hive sql is wrongly

[GitHub] [flink] lincoln-lil commented on pull request #20393: [FLINK-28570][table-planner] Introduces a StreamNonDeterministicPlanResolver to validate and try to solve (lookup join only) the non-det

2022-08-04 Thread GitBox
lincoln-lil commented on PR #20393: URL: https://github.com/apache/flink/pull/20393#issuecomment-1206049870 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Closed] (FLINK-28781) Hybrid Shuffle should support compression

2022-08-04 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28781. Resolution: Fixed master (1.16): 2edc43c6e469a3e16ee01a1373cf52523eb96b01 > Hybrid Shuffle

[GitHub] [flink] xintongsong closed pull request #20426: [FLINK-28781][network] Hybrid Shuffle should support compression

2022-08-04 Thread GitBox
xintongsong closed pull request #20426: [FLINK-28781][network] Hybrid Shuffle should support compression URL: https://github.com/apache/flink/pull/20426 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [flink] wsry commented on pull request #20350: [FLINK-28663][runtime] Allow multiple downstream consumer job vertices sharing the same intermediate dataset at scheduler side

2022-08-04 Thread GitBox
wsry commented on PR #20350: URL: https://github.com/apache/flink/pull/20350#issuecomment-1206038365 @zhuzhurk @TanYuxin-tyx Thanks for the review and feedbacks. I have updated the PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [flink] flinkbot commented on pull request #20457: [FLINK-28373][network] Read a full buffer of data per file IO read request for sort-shuffle

2022-08-04 Thread GitBox
flinkbot commented on PR #20457: URL: https://github.com/apache/flink/pull/20457#issuecomment-1206032692 ## CI report: * de7978f6de19c2f45a745e17a22423affb3c3964 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] TanYuxin-tyx commented on pull request #20457: [FLINK-28373][network] Read a full buffer of data per file IO read request for sort-shuffle

2022-08-04 Thread GitBox
TanYuxin-tyx commented on PR #20457: URL: https://github.com/apache/flink/pull/20457#issuecomment-1206030608 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [flink] lincoln-lil commented on a diff in pull request #20359: [FLINK-28682][table-planner] support join hint in batch rules

2022-08-04 Thread GitBox
lincoln-lil commented on code in PR #20359: URL: https://github.com/apache/flink/pull/20359#discussion_r938431641 ## flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/plan/optimize/JoinHintResolver.scala: ## @@ -0,0 +1,211 @@ +/* + * Licensed to the

[GitHub] [flink] zoltar9264 commented on a diff in pull request #20152: [FLINK-27155][changelog] Reduce multiple reads to the same Changelog …

2022-08-04 Thread GitBox
zoltar9264 commented on code in PR #20152: URL: https://github.com/apache/flink/pull/20152#discussion_r938431052 ## flink-dstl/flink-dstl-dfs/src/main/java/org/apache/flink/changelog/fs/ChangelogStreamHandleReaderWithCache.java: ## @@ -0,0 +1,203 @@ +/* + * Licensed to the

[GitHub] [flink] zoltar9264 commented on a diff in pull request #20152: [FLINK-27155][changelog] Reduce multiple reads to the same Changelog …

2022-08-04 Thread GitBox
zoltar9264 commented on code in PR #20152: URL: https://github.com/apache/flink/pull/20152#discussion_r938430639 ## flink-dstl/flink-dstl-dfs/src/main/java/org/apache/flink/changelog/fs/ChangelogStreamHandleReaderWithCache.java: ## @@ -0,0 +1,203 @@ +/* + * Licensed to the

[GitHub] [flink] TanYuxin-tyx opened a new pull request, #20457: [FLINK-28373][network] Read a full buffer of data per file IO read request for sort-shuffle

2022-08-04 Thread GitBox
TanYuxin-tyx opened a new pull request, #20457: URL: https://github.com/apache/flink/pull/20457 ## What is the purpose of the change Currently, for sort blocking shuffle, the corresponding data readers read shuffle data in buffer granularity. Before compression, each buffer

[jira] [Updated] (FLINK-28630) Allow to GetSchemas in the HiveServer2 Endpoint

2022-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28630: --- Labels: pull-request-available (was: ) > Allow to GetSchemas in the HiveServer2 Endpoint >

[GitHub] [flink] fsk119 commented on a diff in pull request #20401: [FLINK-28630][sql-gateway][hive] Allow to getSchemas in the HiveServer2 Endpoint.

2022-08-04 Thread GitBox
fsk119 commented on code in PR #20401: URL: https://github.com/apache/flink/pull/20401#discussion_r938387937 ## flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/endpoint/hive/HiveServer2Endpoint.java: ## @@ -422,7 +426,76 @@ public TGetCatalogsResp

[GitHub] [flink] gaoyunhaii closed pull request #18486: [Test Only] Checks the memory usage for flink-table/flink-table-planner ci pipeline

2022-08-04 Thread GitBox
gaoyunhaii closed pull request #18486: [Test Only] Checks the memory usage for flink-table/flink-table-planner ci pipeline URL: https://github.com/apache/flink/pull/18486 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [flink] gaoyunhaii closed pull request #18494: [FLINK-25307][DEBUG-ONLY] Add debug message

2022-08-04 Thread GitBox
gaoyunhaii closed pull request #18494: [FLINK-25307][DEBUG-ONLY] Add debug message URL: https://github.com/apache/flink/pull/18494 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [flink] luoyuxia commented on a diff in pull request #20415: [FLINK-28711] Hive connector implements SupportsDynamicFiltering interface

2022-08-04 Thread GitBox
luoyuxia commented on code in PR #20415: URL: https://github.com/apache/flink/pull/20415#discussion_r938399637 ## flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/connectors/hive/HiveSourceDynamicFileEnumerator.java: ## @@ -0,0 +1,218 @@ +/* + * Licensed to

[jira] [Updated] (FLINK-28324) JUnit5 Migration] Module: flink-sql-client

2022-08-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-28324: Priority: Major (was: Minor) > JUnit5 Migration] Module: flink-sql-client >

[jira] (FLINK-28324) JUnit5 Migration] Module: flink-sql-client

2022-08-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28324 ] Zhu Zhu deleted comment on FLINK-28324: - was (Author: flink-jira-bot): I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community manage its development. I see

[jira] [Updated] (FLINK-28324) JUnit5 Migration] Module: flink-sql-client

2022-08-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-28324: Labels: pull-request-available (was: pull-request-available stale-assigned) > JUnit5 Migration] Module:

[jira] [Updated] (FLINK-28801) Upgrade OSS SDK Version

2022-08-04 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-28801: - Fix Version/s: 1.16.0 > Upgrade OSS SDK Version > --- > >

[jira] [Commented] (FLINK-28801) Upgrade OSS SDK Version

2022-08-04 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575543#comment-17575543 ] Jingsong Lee commented on FLINK-28801: -- master: d9e6721ac724409b2d4276374959db89287e90c5 > Upgrade

[jira] [Closed] (FLINK-28801) Upgrade OSS SDK Version

2022-08-04 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-28801. Assignee: wujinhu Resolution: Fixed > Upgrade OSS SDK Version > --- > >

[GitHub] [flink] JingsongLi merged pull request #20450: [FLINK-28801][fs] Bump OSS SDK to 3.13.2

2022-08-04 Thread GitBox
JingsongLi merged PR #20450: URL: https://github.com/apache/flink/pull/20450 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink-kubernetes-operator] SteNicholas commented on pull request #337: [FLINK-28763] Make savepoint format configurable for upgrades/savepoint operations

2022-08-04 Thread GitBox
SteNicholas commented on PR #337: URL: https://github.com/apache/flink-kubernetes-operator/pull/337#issuecomment-1205995421 @gyfora , sorry to miss adding the unit tests for this change. I have added the tests to verify whether to configure the `SavepointFormatType` to trigger savepoint

[jira] [Closed] (FLINK-27862) FLIP-235: Hybrid Shuffle Mode

2022-08-04 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-27862. Release Note: We have introduced a new Hybrid Shuffle Mode for batch executions. It combines the

[jira] [Commented] (FLINK-28821) Adjust join cost for dpp query pattern which could help more plans use dpp

2022-08-04 Thread Yunhong Zheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575526#comment-17575526 ] Yunhong Zheng commented on FLINK-28821: --- Hi, [~godfreyhe] , can you assign this to me. Thanks! >

[jira] [Created] (FLINK-28821) Adjust join cost for dpp query pattern which could help more plans use dpp

2022-08-04 Thread godfrey he (Jira)
godfrey he created FLINK-28821: -- Summary: Adjust join cost for dpp query pattern which could help more plans use dpp Key: FLINK-28821 URL: https://issues.apache.org/jira/browse/FLINK-28821 Project:

[jira] [Created] (FLINK-28820) Pulsar Connector PulsarSink performance issue when delivery guarantee is not NONE

2022-08-04 Thread Simon Su (Jira)
Simon Su created FLINK-28820: Summary: Pulsar Connector PulsarSink performance issue when delivery guarantee is not NONE Key: FLINK-28820 URL: https://issues.apache.org/jira/browse/FLINK-28820 Project:

[GitHub] [flink] yangjunhan closed pull request #19712: [FLINK-26207][runtime-web] make web ui's components depend on injected configurable object

2022-08-04 Thread GitBox
yangjunhan closed pull request #19712: [FLINK-26207][runtime-web] make web ui's components depend on injected configurable object URL: https://github.com/apache/flink/pull/19712 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [flink] xintongsong commented on a diff in pull request #20451: [FLINK-28162][sql-gateway]Introduce the operation related API for REST endpoint

2022-08-04 Thread GitBox
xintongsong commented on code in PR #20451: URL: https://github.com/apache/flink/pull/20451#discussion_r938390193 ## flink-table/flink-sql-gateway/src/main/java/org/apache/flink/table/gateway/rest/message/statement/FetchResultsRequestBody.java: ## @@ -0,0 +1,47 @@ +/* + *

[GitHub] [flink] xintongsong commented on a diff in pull request #20451: [FLINK-28162][sql-gateway]Introduce the operation related API for REST endpoint

2022-08-04 Thread GitBox
xintongsong commented on code in PR #20451: URL: https://github.com/apache/flink/pull/20451#discussion_r938390193 ## flink-table/flink-sql-gateway/src/main/java/org/apache/flink/table/gateway/rest/message/statement/FetchResultsRequestBody.java: ## @@ -0,0 +1,47 @@ +/* + *

[jira] [Updated] (FLINK-28819) The natural time of day TTL

2022-08-04 Thread zck (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zck updated FLINK-28819: Description: When new energy vehicles are monitored for parts, in order to reduce the push of abnormal

[jira] [Closed] (FLINK-28795) Unstable test for HiveDialectQueryITCase#testInsertDirectory

2022-08-04 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang closed FLINK-28795. - Resolution: Fixed Merged into master: 5f620d29787abad2036a28373e80429026e29f21   > Unstable

[jira] [Assigned] (FLINK-28795) Unstable test for HiveDialectQueryITCase#testInsertDirectory

2022-08-04 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang reassigned FLINK-28795: - Assignee: luoyuxia > Unstable test for HiveDialectQueryITCase#testInsertDirectory >

[jira] [Comment Edited] (FLINK-24302) Direct buffer memory leak on Pulsar connector with Java 11

2022-08-04 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575319#comment-17575319 ] Yufan Sheng edited comment on FLINK-24302 at 8/5/22 1:59 AM: - [~chesnay]

[GitHub] [flink] fsk119 merged pull request #20446: [FLINK-28795][hive] Fix unstable test for HiveDialectQueryITCase#testInsertDirectory

2022-08-04 Thread GitBox
fsk119 merged PR #20446: URL: https://github.com/apache/flink/pull/20446 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (FLINK-28819) The natural time of day TTL

2022-08-04 Thread zck (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zck updated FLINK-28819: Summary: The natural time of day TTL (was: state Time of day TTL ) > The natural time of day TTL >

[jira] [Closed] (FLINK-27909) Add document and tests for hybrid shuffle mode

2022-08-04 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-27909. Fix Version/s: 1.16.0 Resolution: Done master (1.16):

[jira] [Created] (FLINK-28819) state Time of day TTL

2022-08-04 Thread zck (Jira)
zck created FLINK-28819: --- Summary: state Time of day TTL Key: FLINK-28819 URL: https://issues.apache.org/jira/browse/FLINK-28819 Project: Flink Issue Type: New Feature Components: API /

[jira] [Commented] (FLINK-24302) Direct buffer memory leak on Pulsar connector with Java 11

2022-08-04 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575517#comment-17575517 ] Yufan Sheng commented on FLINK-24302: - [~chesnay] Yep, this would be released on Pulsar 2.11.0,

[jira] [Commented] (FLINK-28818) KafkaSinkITCase.testWriteRecordsToKafkaWithExactlyOnceGuarantee failed with AssertionFailedError

2022-08-04 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575511#comment-17575511 ] Huang Xingbo commented on FLINK-28818: -- cc [~renqs] >

[GitHub] [flink] xintongsong closed pull request #20433: [FLINK-27909][doc] Add document for hybrid shuffle

2022-08-04 Thread GitBox
xintongsong closed pull request #20433: [FLINK-27909][doc] Add document for hybrid shuffle URL: https://github.com/apache/flink/pull/20433 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Updated] (FLINK-24302) Direct buffer memory leak on Pulsar connector with Java 11

2022-08-04 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-24302: Description: Running the Pulsar connector with multiple split readers on Java 11 could throw {{a 

[jira] [Comment Edited] (FLINK-24302) Direct buffer memory leak on Pulsar connector with Java 11

2022-08-04 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575319#comment-17575319 ] Yufan Sheng edited comment on FLINK-24302 at 8/5/22 1:56 AM: - [~chesnay]

[jira] [Closed] (FLINK-27908) Introduce HsResultPartition and HsSubpartitionView

2022-08-04 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-27908. Resolution: Fixed Fixed in master (1.16) 2dd51f644da14a88914cc7aeeb021f824a28ee48 > Introduce

[GitHub] [flink] xintongsong closed pull request #20445: [FLINK-27908][network] HsSubpartitionView should calculate backlog no less than true value

2022-08-04 Thread GitBox
xintongsong closed pull request #20445: [FLINK-27908][network] HsSubpartitionView should calculate backlog no less than true value URL: https://github.com/apache/flink/pull/20445 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Updated] (FLINK-28795) Unstable test for HiveDialectQueryITCase#testInsertDirectory

2022-08-04 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huang Xingbo updated FLINK-28795: - Priority: Critical (was: Major) > Unstable test for HiveDialectQueryITCase#testInsertDirectory

[jira] [Commented] (FLINK-28795) Unstable test for HiveDialectQueryITCase#testInsertDirectory

2022-08-04 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575512#comment-17575512 ] Huang Xingbo commented on FLINK-28795: --

[GitHub] [flink] Sxnan commented on pull request #20147: [FLINK-27524][datastream] Introduce cache API to DataStream

2022-08-04 Thread GitBox
Sxnan commented on PR #20147: URL: https://github.com/apache/flink/pull/20147#issuecomment-1205952295 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Created] (FLINK-28818) KafkaSinkITCase.testWriteRecordsToKafkaWithExactlyOnceGuarantee failed with AssertionFailedError

2022-08-04 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-28818: Summary: KafkaSinkITCase.testWriteRecordsToKafkaWithExactlyOnceGuarantee failed with AssertionFailedError Key: FLINK-28818 URL: https://issues.apache.org/jira/browse/FLINK-28818

[GitHub] [flink] lincoln-lil commented on pull request #20393: [FLINK-28570][table-planner] Introduces a StreamNonDeterministicPlanResolver to validate and try to solve (lookup join only) the non-det

2022-08-04 Thread GitBox
lincoln-lil commented on PR #20393: URL: https://github.com/apache/flink/pull/20393#issuecomment-1205950009 rebase master to resolve failed e2e case (4e790646c Revert [FLINK-28373]) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [flink] lsyldliu commented on a diff in pull request #20361: [FLINK-27790][Table SQL / API] Port ADD JAR /SHOW JARS syntax implementation from SqlClient to TableEnvironment side

2022-08-04 Thread GitBox
lsyldliu commented on code in PR #20361: URL: https://github.com/apache/flink/pull/20361#discussion_r938372682 ## flink-end-to-end-tests/flink-end-to-end-tests-sql/src/test/java/org/apache/flink/table/sql/codegen/SqlITCaseBase.java: ## @@ -0,0 +1,178 @@ +/* + * Licensed to the

[GitHub] [flink] wsry commented on a diff in pull request #20350: [FLINK-28663][runtime] Allow multiple downstream consumer job vertices sharing the same intermediate dataset at scheduler side

2022-08-04 Thread GitBox
wsry commented on code in PR #20350: URL: https://github.com/apache/flink/pull/20350#discussion_r938361767 ## flink-runtime/src/test/java/org/apache/flink/runtime/executiongraph/ExecutionGraphTestUtils.java: ## @@ -528,4 +546,150 @@ public static void

[jira] [Created] (FLINK-28817) NullPointerException in HybridSource when restoring from checkpoint

2022-08-04 Thread Michael (Jira)
Michael created FLINK-28817: --- Summary: NullPointerException in HybridSource when restoring from checkpoint Key: FLINK-28817 URL: https://issues.apache.org/jira/browse/FLINK-28817 Project: Flink

[jira] [Closed] (FLINK-28504) Local-Global aggregation causes watermark alignment (table.exec.source.idle-timeout) of idle partition invalid

2022-08-04 Thread nyingping (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nyingping closed FLINK-28504. - Resolution: Not A Bug > Local-Global aggregation causes watermark alignment >

[GitHub] [flink] nyingping closed pull request #20337: [FLINK-28504][streaming] Update watermarks across multiple oneinputstreams.

2022-08-04 Thread GitBox
nyingping closed pull request #20337: [FLINK-28504][streaming] Update watermarks across multiple oneinputstreams. URL: https://github.com/apache/flink/pull/20337 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [flink] nyingping commented on pull request #20337: [FLINK-28504][streaming] Update watermarks across multiple oneinputstreams.

2022-08-04 Thread GitBox
nyingping commented on PR #20337: URL: https://github.com/apache/flink/pull/20337#issuecomment-1205909162 @pnowojski @MartijnVisser Thanks for your time.close this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Commented] (FLINK-28816) Include some metrics for the pod created in operator

2022-08-04 Thread Aitozi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575495#comment-17575495 ] Aitozi commented on FLINK-28816: cc [~gyfora] [~wangyang0918] Do you think it's suitable to add this in

[jira] [Created] (FLINK-28816) Include some metrics for the pod created in operator

2022-08-04 Thread Aitozi (Jira)
Aitozi created FLINK-28816: -- Summary: Include some metrics for the pod created in operator Key: FLINK-28816 URL: https://issues.apache.org/jira/browse/FLINK-28816 Project: Flink Issue Type:

[jira] [Commented] (FLINK-28765) Create a doc for protobuf format

2022-08-04 Thread Hui Yang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575493#comment-17575493 ] Hui Yang commented on FLINK-28765: -- [~maosuhan] when is this protobuf support ready to use? I found the

[GitHub] [flink] wujinhu commented on pull request #20450: [FLINK-28801][fs] Bump OSS SDK to 3.13.2

2022-08-04 Thread GitBox
wujinhu commented on PR #20450: URL: https://github.com/apache/flink/pull/20450#issuecomment-1205898580 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-26548) the source parallelism is not set correctly with AdaptiveBatchScheduler

2022-08-04 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-26548: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the

[jira] [Updated] (FLINK-26182) E2E test for PulsarSink on new Flink sink testing tools

2022-08-04 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-26182: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the

[jira] [Updated] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

2022-08-04 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-26803: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the

[jira] [Updated] (FLINK-27745) ClientUtilsTest.uploadAndSetUserArtifacts failed with NoClassDefFoundError

2022-08-04 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-27745: --- Labels: stale-assigned test-stability (was: test-stability) I am the [Flink Jira

[jira] [Updated] (FLINK-27640) Flink not compiling, flink-connector-hive_2.12 is missing jhyde pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde

2022-08-04 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-27640: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the

[jira] [Updated] (FLINK-27074) python_job.py should write to TEST_DATA_DIR

2022-08-04 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-27074: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the

[jira] [Updated] (FLINK-27492) Flink table scala example does not including the scala-api jars

2022-08-04 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-27492: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the

[jira] [Updated] (FLINK-27199) Bump Pulsar to 2.10.0 for fixing the unstable Pulsar test environment.

2022-08-04 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-27199: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the

[jira] [Updated] (FLINK-27944) IO metrics collision happens if a task has union inputs

2022-08-04 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-27944: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the

[jira] [Updated] (FLINK-28324) JUnit5 Migration] Module: flink-sql-client

2022-08-04 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-28324: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the

[jira] [Updated] (FLINK-28407) Make Jenkins benchmark script more autonomous

2022-08-04 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-28407: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the

[jira] [Closed] (FLINK-28804) Use proper stand-ins for missing metrics groups

2022-08-04 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-28804. Resolution: Fixed master: fd26e088a43a9426ad5f0b94237495d50d78656b > Use proper

[GitHub] [flink] zentol merged pull request #20449: [FLINK-28804][formats] Use proper stand-ins for missing metric groups

2022-08-04 Thread GitBox
zentol merged PR #20449: URL: https://github.com/apache/flink/pull/20449 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] zentol commented on pull request #20449: [FLINK-28804][formats] Use proper stand-ins for missing metric groups

2022-08-04 Thread GitBox
zentol commented on PR #20449: URL: https://github.com/apache/flink/pull/20449#issuecomment-1205786492 >It's a separate change--but what do you think about adding warning logs to UnregisteredMetricGroup to emit a log that says a metric may not be reported I'm not a fan of warnings if

[jira] [Commented] (FLINK-24302) Direct buffer memory leak on Pulsar connector with Java 11

2022-08-04 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575445#comment-17575445 ] Chesnay Schepler commented on FLINK-24302: -- The linked PR was noted merged to 1.10. The merged

[GitHub] [flink-kubernetes-operator] gyfora commented on pull request #339: [FLINK-28749] Include resource type in KubernetesOperatorResourceNamespaceMetricGroup

2022-08-04 Thread GitBox
gyfora commented on PR #339: URL: https://github.com/apache/flink-kubernetes-operator/pull/339#issuecomment-1205694216 cc @morhidi -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Updated] (FLINK-28749) Add resource type to KubernetesResourceNamespaceMetricGroup scope

2022-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28749: --- Labels: pull-request-available (was: ) > Add resource type to

[GitHub] [flink-kubernetes-operator] gyfora opened a new pull request, #339: [FLINK-28749] Include resource type in KubernetesOperatorResourceNamespaceMetricGroup

2022-08-04 Thread GitBox
gyfora opened a new pull request, #339: URL: https://github.com/apache/flink-kubernetes-operator/pull/339 ## What is the purpose of the change This PR should be merged only after https://github.com/apache/flink-kubernetes-operator/pull/338 Include the resource class name

[GitHub] [flink-kubernetes-operator] gyfora opened a new pull request, #338: [FLINK-28792] Upgrade to JOSDK 3.1.0

2022-08-04 Thread GitBox
gyfora opened a new pull request, #338: URL: https://github.com/apache/flink-kubernetes-operator/pull/338 ## What is the purpose of the change Upgrade josdk to 3.1.0 ## Verifying this change This change is already covered by existing tests ## Does this pull

[jira] [Updated] (FLINK-28792) Upgrade to JOSDK 3.1.0

2022-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28792: --- Labels: pull-request-available (was: ) > Upgrade to JOSDK 3.1.0 > -- >

[GitHub] [flink-kubernetes-operator] gyfora commented on pull request #338: [FLINK-28792] Upgrade to JOSDK 3.1.0

2022-08-04 Thread GitBox
gyfora commented on PR #338: URL: https://github.com/apache/flink-kubernetes-operator/pull/338#issuecomment-1205692146 cc @morhidi -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [flink] reswqa commented on pull request #20433: [FLINK-27909][doc] Add document for hybrid shuffle

2022-08-04 Thread GitBox
reswqa commented on PR #20433: URL: https://github.com/apache/flink/pull/20433#issuecomment-1205652641 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [flink] rkhachatryan commented on a diff in pull request #20152: [FLINK-27155][changelog] Reduce multiple reads to the same Changelog …

2022-08-04 Thread GitBox
rkhachatryan commented on code in PR #20152: URL: https://github.com/apache/flink/pull/20152#discussion_r938060565 ## flink-dstl/flink-dstl-dfs/src/main/java/org/apache/flink/changelog/fs/ChangelogStreamHandleReaderWithCache.java: ## @@ -0,0 +1,203 @@ +/* + * Licensed to the

[GitHub] [flink] wsry commented on a diff in pull request #20350: [FLINK-28663][runtime] Allow multiple downstream consumer job vertices sharing the same intermediate dataset at scheduler side

2022-08-04 Thread GitBox
wsry commented on code in PR #20350: URL: https://github.com/apache/flink/pull/20350#discussion_r938069755 ## flink-runtime/src/test/java/org/apache/flink/runtime/executiongraph/IntermediateResultPartitionTest.java: ## @@ -251,11 +279,24 @@ public static ExecutionGraph

[GitHub] [flink] Cyberness opened a new pull request, #20257: [FLINK-24943][Connectors / Kinesis] Explicitly create KryoSerializer for SequenceNumber class in Kinesis Consumer

2022-08-04 Thread GitBox
Cyberness opened a new pull request, #20257: URL: https://github.com/apache/flink/pull/20257 ### What is the purpose of the change Create `KryoSerializer` for `SequenceNumber` class explicitly to allow disabling of Generic Types via disableGenericTypes() call. ### Brief change log

[GitHub] [flink] Cyberness closed pull request #20257: [FLINK-24943][Connectors / Kinesis] Explicitly create KryoSerializer for SequenceNumber class in Kinesis Consumer

2022-08-04 Thread GitBox
Cyberness closed pull request #20257: [FLINK-24943][Connectors / Kinesis] Explicitly create KryoSerializer for SequenceNumber class in Kinesis Consumer URL: https://github.com/apache/flink/pull/20257 -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [flink] wsry commented on a diff in pull request #20350: [FLINK-28663][runtime] Allow multiple downstream consumer job vertices sharing the same intermediate dataset at scheduler side

2022-08-04 Thread GitBox
wsry commented on code in PR #20350: URL: https://github.com/apache/flink/pull/20350#discussion_r938058776 ## flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/IntermediateResultPartition.java: ## @@ -47,6 +49,15 @@ public class IntermediateResultPartition {

  1   2   3   4   >