[jira] [Comment Edited] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-03-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698227#comment-17698227 ] Yue Ma edited comment on FLINK-31238 at 3/9/23 7:55 AM: [~yunta] Thanks for

[GitHub] [flink] zhuzhurk commented on a diff in pull request #22098: [FLINK-31144][coordination] Modify the judgment logic of whether to ignore the input locations of a ConsumePartitionGroup if the c

2023-03-08 Thread via GitHub
zhuzhurk commented on code in PR #22098: URL: https://github.com/apache/flink/pull/22098#discussion_r1130607703 ## flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/DefaultPreferredLocationsRetrieverTest.java: ## @@ -81,16 +81,6 @@ void testInputLocations() {

[jira] [Commented] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-03-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698227#comment-17698227 ] Yue Ma commented on FLINK-31238: [~yunta] Thanks for replying ~ Yes, in the current implementation both

[jira] [Updated] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-03-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-31238: --- Attachment: image-2023-03-09-15-50-04-281.png > Use IngestDB to speed up Rocksdb rescaling recovery >

[jira] [Updated] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-03-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-31238: --- Attachment: image-2023-03-09-15-46-01-176.png > Use IngestDB to speed up Rocksdb rescaling recovery >

[jira] [Updated] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-03-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-31238: --- Attachment: image-2023-03-09-15-45-56-081.png > Use IngestDB to speed up Rocksdb rescaling recovery >

[GitHub] [flink] flinkbot commented on pull request #22136: [WIP][table] Support LATERAL/JOIN LATERAL temporal table join

2023-03-08 Thread via GitHub
flinkbot commented on PR #22136: URL: https://github.com/apache/flink/pull/22136#issuecomment-1461493973 ## CI report: * c7160f860d0960a5186c3472dbb6bd3d22dbdf71 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-03-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-31238: --- Attachment: image-2023-03-09-15-41-08-379.png > Use IngestDB to speed up Rocksdb rescaling recovery >

[jira] [Updated] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-03-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-31238: --- Attachment: image-2023-03-09-15-41-03-074.png > Use IngestDB to speed up Rocksdb rescaling recovery >

[jira] [Created] (FLINK-31376) CSVReader for streaming does not support splittable

2023-03-08 Thread ramkrishna.s.vasudevan (Jira)
ramkrishna.s.vasudevan created FLINK-31376: -- Summary: CSVReader for streaming does not support splittable Key: FLINK-31376 URL: https://issues.apache.org/jira/browse/FLINK-31376 Project:

[GitHub] [flink] cshuo opened a new pull request, #22136: [FLINK-XXXX][table] Support LATERAL/JOIN LATERAL temporal table join

2023-03-08 Thread via GitHub
cshuo opened a new pull request, #22136: URL: https://github.com/apache/flink/pull/22136 ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transferring them on

[jira] [Updated] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-03-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-31238: --- Attachment: image-2023-03-09-15-28-32-363.png > Use IngestDB to speed up Rocksdb rescaling recovery >

[jira] [Updated] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-03-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-31238: --- Attachment: image-2023-03-09-15-26-12-314.png > Use IngestDB to speed up Rocksdb rescaling recovery >

[jira] [Commented] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-03-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698215#comment-17698215 ] Yue Ma commented on FLINK-31238: [~masteryhx]  Thanks for the reply, I understand your concerns. It's a

[jira] [Updated] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-03-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-31238: --- Attachment: image-2023-03-09-15-23-30-581.png > Use IngestDB to speed up Rocksdb rescaling recovery >

[GitHub] [flink] PatrickRen commented on pull request #22100: [FLINK-31208][Connectors / Kafka] KafkaSourceReader overrides meaning…

2023-03-08 Thread via GitHub
PatrickRen commented on PR #22100: URL: https://github.com/apache/flink/pull/22100#issuecomment-1461451782 Thanks for the patch @loserwang1024 ! LGTM. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Assigned] (FLINK-31240) Reduce the overhead of conversion between DataStream and Table

2023-03-08 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reassigned FLINK-31240: Assignee: Jiang Xin > Reduce the overhead of conversion between DataStream and Table >

[jira] [Updated] (FLINK-31375) the values of map are truncated by the CASE WHEN function.

2023-03-08 Thread jeff-zou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeff-zou updated FLINK-31375: - Description: the values of map are truncated by the CASE WHEN function. {code:java} // sql create table

[jira] [Updated] (FLINK-31375) the values of map are truncated by the CASE WHEN function.

2023-03-08 Thread jeff-zou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeff-zou updated FLINK-31375: - Description: the values of map are truncated by the CASE WHEN function. {code:java} // sql create table

[jira] [Updated] (FLINK-31375) the values of map are truncated by the CASE WHEN function.

2023-03-08 Thread jeff-zou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeff-zou updated FLINK-31375: - Description: the values of map are truncated by the CASE WHEN function. {code:java} // sql create table

[jira] [Updated] (FLINK-31375) the values of map are truncated by the CASE WHEN function.

2023-03-08 Thread jeff-zou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeff-zou updated FLINK-31375: - Description: the values of map are truncated by the CASE WHEN function. {code:java} // sql create table

[jira] [Created] (FLINK-31375) the values of map are truncated by the CASE WHEN function.

2023-03-08 Thread jeff-zou (Jira)
jeff-zou created FLINK-31375: Summary: the values of map are truncated by the CASE WHEN function. Key: FLINK-31375 URL: https://issues.apache.org/jira/browse/FLINK-31375 Project: Flink Issue

[GitHub] [flink] Aitozi commented on a diff in pull request #21522: [FLINK-29585][hive] Migrate TableSchema to Schema for Hive connector

2023-03-08 Thread via GitHub
Aitozi commented on code in PR #21522: URL: https://github.com/apache/flink/pull/21522#discussion_r1130546283 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/api/Schema.java: ## @@ -611,7 +611,9 @@ private void addResolvedColumns(List columns) {

[GitHub] [flink] LadyForest commented on pull request #21452: [FLINK-30282] Fix Logical type ROW lost inner field's nullability after converting to RelDataType

2023-03-08 Thread via GitHub
LadyForest commented on PR #21452: URL: https://github.com/apache/flink/pull/21452#issuecomment-1461375359 One concern is that for a nullable row type, does it make sense to let the inner field not be null? In other words, should we not support `ROW`? WDYT @snuyanzin -- This is

[jira] [Updated] (FLINK-27018) timestamp missing end zero when outputing to kafka

2023-03-08 Thread jeff-zou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeff-zou updated FLINK-27018: - Description: the bug is described as follows:   {code:java} data in source:  2022-04-02 03:34:21.260

[GitHub] [flink] felixzh2020 commented on pull request #22118: [FLINK-31335][sql-gateway] When submit job to yarn, support kerberos

2023-03-08 Thread via GitHub
felixzh2020 commented on PR #22118: URL: https://github.com/apache/flink/pull/22118#issuecomment-1461344401 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (FLINK-30513) HA storage dir leaks on cluster termination

2023-03-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698192#comment-17698192 ] Weijie Guo commented on FLINK-30513: master(1.18) via 13779ab8e4f5539ca311d9f233d031d818af6450. >

[jira] [Comment Edited] (FLINK-30513) HA storage dir leaks on cluster termination

2023-03-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698192#comment-17698192 ] Weijie Guo edited comment on FLINK-30513 at 3/9/23 6:08 AM: master(1.18) via

[GitHub] [flink] reswqa commented on pull request #21673: [FLINK-30513] Cleanup HA storage path on cluster termination

2023-03-08 Thread via GitHub
reswqa commented on PR #21673: URL: https://github.com/apache/flink/pull/21673#issuecomment-1461341895 @X-czh merged. Could you open a backport pr to release-1.17? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [flink] reswqa closed pull request #21673: [FLINK-30513] Cleanup HA storage path on cluster termination

2023-03-08 Thread via GitHub
reswqa closed pull request #21673: [FLINK-30513] Cleanup HA storage path on cluster termination URL: https://github.com/apache/flink/pull/21673 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Updated] (FLINK-31298) ConnectionUtilsTest.testFindConnectingAddressWhenGetLocalHostThrows swallows IllegalArgumentException

2023-03-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-31298: --- Fix Version/s: 1.17.0 1.16.2 >

[jira] [Closed] (FLINK-31298) ConnectionUtilsTest.testFindConnectingAddressWhenGetLocalHostThrows swallows IllegalArgumentException

2023-03-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-31298. -- Resolution: Fixed > ConnectionUtilsTest.testFindConnectingAddressWhenGetLocalHostThrows swallows >

[jira] [Comment Edited] (FLINK-31298) ConnectionUtilsTest.testFindConnectingAddressWhenGetLocalHostThrows swallows IllegalArgumentException

2023-03-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697743#comment-17697743 ] Weijie Guo edited comment on FLINK-31298 at 3/9/23 6:00 AM: master(1.18) via

[GitHub] [flink] reswqa merged pull request #22129: [FLINK-31298] backport to branch release-1.17

2023-03-08 Thread via GitHub
reswqa merged PR #22129: URL: https://github.com/apache/flink/pull/22129 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] reswqa merged pull request #22128: [FLINK-31298] backport to branch release-1.16

2023-03-08 Thread via GitHub
reswqa merged PR #22128: URL: https://github.com/apache/flink/pull/22128 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] lightzhao commented on pull request #22126: [Bug][FLINK-31363]KafkaSink failed to commit transactions under EXACTLY_ONCE semantics.

2023-03-08 Thread via GitHub
lightzhao commented on PR #22126: URL: https://github.com/apache/flink/pull/22126#issuecomment-1461330269 @fapaul @AHeise PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [flink-ml] lindong28 commented on a diff in pull request #218: [FLINK-31306] Add Servable for PipelineModel

2023-03-08 Thread via GitHub
lindong28 commented on code in PR #218: URL: https://github.com/apache/flink-ml/pull/218#discussion_r1130375623 ## flink-ml-core/src/test/java/org/apache/flink/ml/api/ExampleStages.java: ## @@ -110,6 +111,10 @@ public static SumModel load(StreamTableEnvironment tEnv, String

[GitHub] [flink] X-czh commented on pull request #21673: [FLINK-30513] Cleanup HA storage path on cluster termination

2023-03-08 Thread via GitHub
X-czh commented on PR #21673: URL: https://github.com/apache/flink/pull/21673#issuecomment-1461279033 @reswqa Kindly remind. Could you help merge the PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Comment Edited] (FLINK-31346) Batch shuffle IO scheduler does not throw TimeoutException if numRequestedBuffers is greater than 0

2023-03-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697402#comment-17697402 ] Weijie Guo edited comment on FLINK-31346 at 3/9/23 4:21 AM: master(1.18) via

[jira] [Closed] (FLINK-31346) Batch shuffle IO scheduler does not throw TimeoutException if numRequestedBuffers is greater than 0

2023-03-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-31346. -- Fix Version/s: 1.16.2 Resolution: Fixed > Batch shuffle IO scheduler does not throw

[jira] [Updated] (FLINK-31346) Batch shuffle IO scheduler does not throw TimeoutException if numRequestedBuffers is greater than 0

2023-03-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-31346: --- Affects Version/s: 1.17.0 > Batch shuffle IO scheduler does not throw TimeoutException if >

[GitHub] [flink] reswqa merged pull request #22123: [BP-1.16][FLINK-31346][runtime] IO scheduler does not throw TimeoutException if numRequestedBuffers is greater than 0.

2023-03-08 Thread via GitHub
reswqa merged PR #22123: URL: https://github.com/apache/flink/pull/22123 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Comment Edited] (FLINK-31351) HiveServer2EndpointITCase.testExecuteStatementInSyncModeWithRuntimeException2 times out on CI

2023-03-08 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697859#comment-17697859 ] Shengkai Fang edited comment on FLINK-31351 at 3/9/23 3:16 AM: --- Merged

[jira] [Closed] (FLINK-31351) HiveServer2EndpointITCase.testExecuteStatementInSyncModeWithRuntimeException2 times out on CI

2023-03-08 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang closed FLINK-31351. - Resolution: Fixed >

[jira] [Comment Edited] (FLINK-31351) HiveServer2EndpointITCase.testExecuteStatementInSyncModeWithRuntimeException2 times out on CI

2023-03-08 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697859#comment-17697859 ] Shengkai Fang edited comment on FLINK-31351 at 3/9/23 3:15 AM: --- Merged

[GitHub] [flink] fsk119 merged pull request #22133: [FLINK-31351][sql-gateway] Don't stop the stuck thread by force

2023-03-08 Thread via GitHub
fsk119 merged PR #22133: URL: https://github.com/apache/flink/pull/22133 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] fsk119 merged pull request #22132: [FLINK-31351][sql-gateway] Don't stop the stuck thread by force

2023-03-08 Thread via GitHub
fsk119 merged PR #22132: URL: https://github.com/apache/flink/pull/22132 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink-ml] zhipeng93 commented on a diff in pull request #220: [FLINK-31325] Improve performance of Swing

2023-03-08 Thread via GitHub
zhipeng93 commented on code in PR #220: URL: https://github.com/apache/flink-ml/pull/220#discussion_r1130294319 ## flink-ml-lib/src/test/java/org/apache/flink/ml/recommendation/SwingTest.java: ## @@ -140,6 +141,7 @@ public void testParam() { assertEquals(5,

[GitHub] [flink] LadyForest commented on a diff in pull request #21452: [FLINK-30282] Fix Logical type ROW lost inner field's nullability after converting to RelDataType

2023-03-08 Thread via GitHub
LadyForest commented on code in PR #21452: URL: https://github.com/apache/flink/pull/21452#discussion_r1130310752 ## flink-table/flink-sql-client/src/test/resources/sql/table.q: ## @@ -964,7 +998,7 @@ CREATE TABLE IF NOT EXISTS daily_orders ( PRIMARY KEY(dt, `user`) NOT

[GitHub] [flink] liuyongvs commented on pull request #21993: [FLINK-31166][table] Fix array_contains does not support null argumen…

2023-03-08 Thread via GitHub
liuyongvs commented on PR #21993: URL: https://github.com/apache/flink/pull/21993#issuecomment-1461165977 hi @snuyanzin ,thanks for your review and i learned a lot -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [flink] liuyongvs commented on a diff in pull request #21993: [FLINK-31166][table] Fix array_contains does not support null argumen…

2023-03-08 Thread via GitHub
liuyongvs commented on code in PR #21993: URL: https://github.com/apache/flink/pull/21993#discussion_r1130305597 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/CollectionFunctionsITCase.java: ## @@ -102,6 +105,16 @@ Stream

[GitHub] [flink] liuyongvs commented on a diff in pull request #21993: [FLINK-31166][table] Fix array_contains does not support null argumen…

2023-03-08 Thread via GitHub
liuyongvs commented on code in PR #21993: URL: https://github.com/apache/flink/pull/21993#discussion_r1130306112 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/inference/strategies/ArrayElementArgumentTypeStrategy.java: ## @@ -42,9 +42,14 @@ public

[GitHub] [flink] ruanhang1993 closed pull request #17815: [FLINK-22702][tests] Add test data supplier which provide null timestamp field to kafka connector tests

2023-03-08 Thread via GitHub
ruanhang1993 closed pull request #17815: [FLINK-22702][tests] Add test data supplier which provide null timestamp field to kafka connector tests URL: https://github.com/apache/flink/pull/17815 -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [flink] ruanhang1993 closed pull request #18497: [FLINK-25290][tests] add table tests for connector testframe

2023-03-08 Thread via GitHub
ruanhang1993 closed pull request #18497: [FLINK-25290][tests] add table tests for connector testframe URL: https://github.com/apache/flink/pull/18497 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [flink-table-store] zhangjun0x01 commented on pull request #584: [FLINK-31338] support infer parallelism for flink table store

2023-03-08 Thread via GitHub
zhangjun0x01 commented on PR #584: URL: https://github.com/apache/flink-table-store/pull/584#issuecomment-1461145922 > @zhangjun0x01 Can we consider to use bucket number as streaming default parallelism? And use parallelism inference only for batch source. I updated it, and disabled

[GitHub] [flink-table-store] zhangjun0x01 commented on pull request #584: [FLINK-31338] support infer parallelism for flink table store

2023-03-08 Thread via GitHub
zhangjun0x01 commented on PR #584: URL: https://github.com/apache/flink-table-store/pull/584#issuecomment-1461142959 > The same problem of E2E test I have met before. I've pushed some commits to try to solve the problem. You can rebase master. yeah,I resubmitted --

[jira] [Created] (FLINK-31374) ProxyStreamPartitioner should implement ConfigurableStreamPartitioner

2023-03-08 Thread Zhipeng Zhang (Jira)
Zhipeng Zhang created FLINK-31374: - Summary: ProxyStreamPartitioner should implement ConfigurableStreamPartitioner Key: FLINK-31374 URL: https://issues.apache.org/jira/browse/FLINK-31374 Project:

[jira] [Updated] (FLINK-31373) PerRoundWrapperOperator should carry epoch information in watermark

2023-03-08 Thread Zhipeng Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhipeng Zhang updated FLINK-31373: -- Description: Currently we use PerRoundWrapperOperator to wrap the normal flink operators

[jira] [Created] (FLINK-31373) PerRoundWrapperOperator should carry epoch information in watermark

2023-03-08 Thread Zhipeng Zhang (Jira)
Zhipeng Zhang created FLINK-31373: - Summary: PerRoundWrapperOperator should carry epoch information in watermark Key: FLINK-31373 URL: https://issues.apache.org/jira/browse/FLINK-31373 Project: Flink

[GitHub] [flink] snuyanzin commented on a diff in pull request #21993: [FLINK-31166][table] Fix array_contains does not support null argumen…

2023-03-08 Thread via GitHub
snuyanzin commented on code in PR #21993: URL: https://github.com/apache/flink/pull/21993#discussion_r1130032947 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/CollectionFunctionsITCase.java: ## @@ -102,6 +105,16 @@ Stream

[GitHub] [flink] snuyanzin commented on a diff in pull request #21993: [FLINK-31166][table] Fix array_contains does not support null argumen…

2023-03-08 Thread via GitHub
snuyanzin commented on code in PR #21993: URL: https://github.com/apache/flink/pull/21993#discussion_r1130031361 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/inference/strategies/ArrayElementArgumentTypeStrategy.java: ## @@ -42,9 +42,14 @@ public

[GitHub] [flink] flinkbot commented on pull request #22135: [FLINK-31369][sql-gateway] Harden modifiers in tests for sql-gateway module

2023-03-08 Thread via GitHub
flinkbot commented on PR #22135: URL: https://github.com/apache/flink/pull/22135#issuecomment-1460876245 ## CI report: * 7c1d6079a4ba2323b410cf4209695b468ec735fd UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-31369) Harden modifiers for sql-gateway module

2023-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-31369: --- Labels: pull-request-available (was: ) > Harden modifiers for sql-gateway module >

[GitHub] [flink] snuyanzin opened a new pull request, #22135: [FLINK-31369][sql-gateway] Harden modifiers in tests for sql-gateway module

2023-03-08 Thread via GitHub
snuyanzin opened a new pull request, #22135: URL: https://github.com/apache/flink/pull/22135 ## What is the purpose of the change The PR hardens modifiers for junit5 tests as a follow up for https://github.com/apache/flink/pull/22127#discussion_r1129192778 ## Verifying

[jira] [Updated] (FLINK-31133) PartiallyFinishedSourcesITCase hangs if a checkpoint fails

2023-03-08 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-31133: -- Fix Version/s: 1.15.4 (was: 1.15.5) > PartiallyFinishedSourcesITCase

[jira] [Updated] (FLINK-27169) PartiallyFinishedSourcesITCase.test hangs on azure

2023-03-08 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-27169: -- Fix Version/s: 1.15.4 (was: 1.15.5) >

[jira] [Updated] (FLINK-29729) Fix credential info configured in flink-conf.yaml is lost during creating ParquetReader

2023-03-08 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-29729: -- Fix Version/s: 1.18.0 > Fix credential info configured in flink-conf.yaml is lost during

[jira] [Updated] (FLINK-31272) Duplicate operators appear in the StreamGraph for Python DataStream API jobs

2023-03-08 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-31272: -- Fix Version/s: 1.15.4 (was: 1.15.5) > Duplicate operators appear in

[jira] [Updated] (FLINK-29729) Fix credential info configured in flink-conf.yaml is lost during creating ParquetReader

2023-03-08 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-29729: -- Fix Version/s: 1.15.4 (was: 1.18.0) (was:

[jira] [Updated] (FLINK-31286) Python processes are still alive when shutting down a session cluster directly without stopping the jobs

2023-03-08 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-31286: -- Fix Version/s: 1.15.4 (was: 1.15.5) > Python processes are still alive

[jira] [Updated] (FLINK-31372) Memory Leak in prometheus HTTPMetricHandler when reporting fails

2023-03-08 Thread Krzysztof Dziolak (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krzysztof Dziolak updated FLINK-31372: -- Summary: Memory Leak in prometheus HTTPMetricHandler when reporting fails (was:

[jira] [Updated] (FLINK-31372) Memory Leak in HTTPMetricHandler when reporting fails

2023-03-08 Thread Krzysztof Dziolak (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krzysztof Dziolak updated FLINK-31372: -- Description: We've identified a memory leak, that occurs when any of the metric

[jira] [Updated] (FLINK-31372) Memory Leak in HTTPMetricHandler when reporting fails

2023-03-08 Thread Krzysztof Dziolak (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krzysztof Dziolak updated FLINK-31372: -- Affects Version/s: 1.16.1 1.15.4 1.17.1

[jira] [Created] (FLINK-31372) Memory Leak in HTTPMetricHandler when reporting fails

2023-03-08 Thread Krzysztof Dziolak (Jira)
Krzysztof Dziolak created FLINK-31372: - Summary: Memory Leak in HTTPMetricHandler when reporting fails Key: FLINK-31372 URL: https://issues.apache.org/jira/browse/FLINK-31372 Project: Flink

[jira] [Updated] (FLINK-31372) Memory Leak in HTTPMetricHandler when reporting fails

2023-03-08 Thread Krzysztof Dziolak (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krzysztof Dziolak updated FLINK-31372: -- Priority: Minor (was: Major) > Memory Leak in HTTPMetricHandler when reporting fails

[jira] [Updated] (FLINK-31371) Stream failure if the topic doesn't exist

2023-03-08 Thread Enzo Dechaene (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enzo Dechaene updated FLINK-31371: -- Description: *Describe the bug* With a Pulsar 2.8.4 server, a Flink stream containing Pulsar

[jira] [Created] (FLINK-31371) Stream failure if the topic doesn't exist

2023-03-08 Thread Enzo Dechaene (Jira)
Enzo Dechaene created FLINK-31371: - Summary: Stream failure if the topic doesn't exist Key: FLINK-31371 URL: https://issues.apache.org/jira/browse/FLINK-31371 Project: Flink Issue Type: Bug

[jira] [Closed] (FLINK-31345) Trim autoscaler configMap to not exceed 1mb size limit

2023-03-08 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-31345. -- Resolution: Fixed Merged to main: f88cbf3fd1b99a574a1ed8b8a2869b96d932e521

[GitHub] [flink-kubernetes-operator] gyfora merged pull request #547: [FLINK-31345] Reduce AutoScalerInfo size by rounding metrics and compression

2023-03-08 Thread via GitHub
gyfora merged PR #547: URL: https://github.com/apache/flink-kubernetes-operator/pull/547 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] dmvk commented on pull request #22134: [FLINK-31370] Prevent more timers from being fired if the StreamTask…

2023-03-08 Thread via GitHub
dmvk commented on PR #22134: URL: https://github.com/apache/flink/pull/22134#issuecomment-1460402364 Thanks for the review, @pnowojski! I've added the same logic for the processing time timers. It would be super helpful if you could verify the change against benchmarks. -- This is an

[GitHub] [flink] snuyanzin commented on a diff in pull request #21452: [FLINK-30282] Fix Logical type ROW lost inner field's nullability after converting to RelDataType

2023-03-08 Thread via GitHub
snuyanzin commented on code in PR #21452: URL: https://github.com/apache/flink/pull/21452#discussion_r1129506976 ## flink-table/flink-sql-client/src/test/resources/sql/table.q: ## @@ -964,7 +998,7 @@ CREATE TABLE IF NOT EXISTS daily_orders ( PRIMARY KEY(dt, `user`) NOT

[GitHub] [flink] RyanSkraba commented on a diff in pull request #22082: [FLINK-31300][table] TRY_CAST for constructed types

2023-03-08 Thread via GitHub
RyanSkraba commented on code in PR #22082: URL: https://github.com/apache/flink/pull/22082#discussion_r1129649372 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/functions/casting/CastRule.java: ## @@ -46,7 +46,9 @@ CastExecutor create(

[GitHub] [flink] liuyongvs commented on a diff in pull request #21993: [FLINK-31166][table] Fix array_contains does not support null argumen…

2023-03-08 Thread via GitHub
liuyongvs commented on code in PR #21993: URL: https://github.com/apache/flink/pull/21993#discussion_r1129607127 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/inference/strategies/ArrayElementArgumentTypeStrategy.java: ## @@ -42,7 +42,7 @@ public

[GitHub] [flink] Aitozi commented on a diff in pull request #21522: [FLINK-29585][hive] Migrate TableSchema to Schema for Hive connector

2023-03-08 Thread via GitHub
Aitozi commented on code in PR #21522: URL: https://github.com/apache/flink/pull/21522#discussion_r1129605975 ## flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/planner/delegation/hive/parse/HiveParserDDLSemanticAnalyzer.java: ## @@ -1966,61 +1982,60

[GitHub] [flink] pnowojski commented on a diff in pull request #22134: [FLINK-31370] Prevent more timers from being fired if the StreamTask…

2023-03-08 Thread via GitHub
pnowojski commented on code in PR #22134: URL: https://github.com/apache/flink/pull/22134#discussion_r1129592490 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/InternalTimerServiceImpl.java: ## @@ -296,7 +302,9 @@ public void

[GitHub] [flink] Aitozi commented on a diff in pull request #21522: [FLINK-29585][hive] Migrate TableSchema to Schema for Hive connector

2023-03-08 Thread via GitHub
Aitozi commented on code in PR #21522: URL: https://github.com/apache/flink/pull/21522#discussion_r1129582760 ## flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/planner/delegation/hive/copy/HiveParserBaseSemanticAnalyzer.java: ## @@ -2106,7 +2111,7 @@

[GitHub] [flink] echauchot commented on pull request #22124: [FLINK-30805] Ask for a new split when one has finished in SourceReader default implementation

2023-03-08 Thread via GitHub
echauchot commented on PR #22124: URL: https://github.com/apache/flink/pull/22124#issuecomment-1460260004 @MartijnVisser CI tests pass -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (FLINK-30805) SplitEnumerator#handleSplitRequest() should be called automatically

2023-03-08 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697925#comment-17697925 ] Etienne Chauchot commented on FLINK-30805: -- [~MartijnVisser] can you assign this ticket to me ?

[GitHub] [flink] snuyanzin commented on a diff in pull request #21452: [FLINK-30282] Fix Logical type ROW lost inner field's nullability after converting to RelDataType

2023-03-08 Thread via GitHub
snuyanzin commented on code in PR #21452: URL: https://github.com/apache/flink/pull/21452#discussion_r1129506976 ## flink-table/flink-sql-client/src/test/resources/sql/table.q: ## @@ -964,7 +998,7 @@ CREATE TABLE IF NOT EXISTS daily_orders ( PRIMARY KEY(dt, `user`) NOT

[GitHub] [flink] snuyanzin commented on a diff in pull request #21993: [FLINK-31166][table] Fix array_contains does not support null argumen…

2023-03-08 Thread via GitHub
snuyanzin commented on code in PR #21993: URL: https://github.com/apache/flink/pull/21993#discussion_r1129483531 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/inference/strategies/ArrayElementArgumentTypeStrategy.java: ## @@ -42,7 +42,7 @@ public

[GitHub] [flink] flinkbot commented on pull request #22134: [FLINK-31370] Prevent more timers from being fired if the StreamTask…

2023-03-08 Thread via GitHub
flinkbot commented on PR #22134: URL: https://github.com/apache/flink/pull/22134#issuecomment-1460212176 ## CI report: * 4eac832e73fb0a8ca8ee44338f9ff30ca0dcfe34 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] snuyanzin commented on a diff in pull request #21993: [FLINK-31166][table] Fix array_contains does not support null argumen…

2023-03-08 Thread via GitHub
snuyanzin commented on code in PR #21993: URL: https://github.com/apache/flink/pull/21993#discussion_r1129483531 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/inference/strategies/ArrayElementArgumentTypeStrategy.java: ## @@ -42,7 +42,7 @@ public

[jira] [Updated] (FLINK-31370) Cancellation of the StreamTask should prevent more timers from being fired

2023-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-31370: --- Labels: pull-request-available (was: ) > Cancellation of the StreamTask should prevent

[GitHub] [flink] dmvk opened a new pull request, #22134: [FLINK-31370] Prevent more timers from being fired if the StreamTask…

2023-03-08 Thread via GitHub
dmvk opened a new pull request, #22134: URL: https://github.com/apache/flink/pull/22134 https://issues.apache.org/jira/browse/FLINK-31370 If the task is canceled while the watermark progresses, it may be stuck in the Cancelling state for a long time (e.g., when many windows are

[jira] [Updated] (FLINK-31370) Cancellation of the StreamTask should prevent more timers from being fired

2023-03-08 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-31370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Morávek updated FLINK-31370: -- Description: If the task is canceled while the watermark progresses, it may be stuck in the

[jira] [Updated] (FLINK-31370) Cancellation of the StreamTask should prevent more timers from being fired

2023-03-08 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-31370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Morávek updated FLINK-31370: -- Description: If the task is being canceled while the watermark is progressing, it may be

[jira] [Created] (FLINK-31370) Cancellation of the StreamTask should prevent more timers from being fired

2023-03-08 Thread Jira
David Morávek created FLINK-31370: - Summary: Cancellation of the StreamTask should prevent more timers from being fired Key: FLINK-31370 URL: https://issues.apache.org/jira/browse/FLINK-31370

[GitHub] [flink] echauchot commented on pull request #22124: [FLINK-30805] Ask for a new split when one has finished in SourceReader default implementation

2023-03-08 Thread via GitHub
echauchot commented on PR #22124: URL: https://github.com/apache/flink/pull/22124#issuecomment-1460166102 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [flink] LadyForest commented on pull request #21452: [FLINK-30282] Fix Logical type ROW lost inner field's nullability after converting to RelDataType

2023-03-08 Thread via GitHub
LadyForest commented on PR #21452: URL: https://github.com/apache/flink/pull/21452#issuecomment-1460103874 Hi @snuyanzin, could you mind taking a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (FLINK-31368) Move operation execution logic out from TableEnvironmentImpl

2023-03-08 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697868#comment-17697868 ] lincoln lee commented on FLINK-31368: - [~jark] +1 for this refactoring, it will prevent the

  1   2   >