Re: [PR] [FLINK-35039][rest] Use PUT method supported by YARN web proxy instead of POST [flink]

2024-04-29 Thread via GitHub
yeezychao commented on PR #24689: URL: https://github.com/apache/flink/pull/24689#issuecomment-2084432438 Hi @yuchen-ecnu, I agreee with you,so I created issues [YARN-11691](https://issues.apache.org/jira/browse/YARN-11691) to the YARN community. -- This is an automated message from

[jira] [Commented] (FLINK-35192) operator oom

2024-04-29 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842249#comment-17842249 ] Gyula Fora commented on FLINK-35192: That makes sense [~bgeng777] this would be a good improvement

Re: [PR] [FLINK-32002] Adjust autoscaler defaults for release [flink-kubernetes-operator]

2024-04-29 Thread via GitHub
gyfora commented on code in PR #586: URL: https://github.com/apache/flink-kubernetes-operator/pull/586#discussion_r1584144759 ## flink-kubernetes-operator-autoscaler/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/config/AutoScalerOptions.java: ## @@ -68,15

[jira] [Commented] (FLINK-34380) Strange RowKind and records about intermediate output when using minibatch join

2024-04-29 Thread Roman Boyko (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842243#comment-17842243 ] Roman Boyko commented on FLINK-34380: - [~xuyangzhong] , [~xu_shuai_] , what do you think? May I

[jira] [Commented] (FLINK-32622) Do not add mini-batch assigner operator if it is useless

2024-04-29 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842242#comment-17842242 ] Jing Ge commented on FLINK-32622: - 1.19: c370b20c8e2d1ea55dd1fc4c283430832d9f9aae > Do not add

Re: [PR] [BP-1.19][FLINK-32622][table-planner] Optimize mini-batch assignment (#23470) [flink]

2024-04-29 Thread via GitHub
JingGe merged PR #24746: URL: https://github.com/apache/flink/pull/24746 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [FLINK-35184][table-runtime] fix minibatch join hash collision release-1.19 [flink]

2024-04-29 Thread via GitHub
flinkbot commented on PR #24749: URL: https://github.com/apache/flink/pull/24749#issuecomment-2084336643 ## CI report: * cba2e44d01b250e2de4619ba40af17709feb4786 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-35184) Hash collision inside MiniBatchStreamingJoin operator

2024-04-29 Thread Roman Boyko (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842232#comment-17842232 ] Roman Boyko commented on FLINK-35184: - [~lsy] , done - https://github.com/apache/flink/pull/24749 >

[PR] [FLINK-35184][table-runtime] fix minibatch join hash collision release-1.19 [flink]

2024-04-29 Thread via GitHub
rovboyko opened a new pull request, #24749: URL: https://github.com/apache/flink/pull/24749 ## What is the purpose of the change This change fixes the possible error because of hash collision in MiniBatchStreamingJoinOperator ## Brief change log Currently

[jira] [Commented] (FLINK-35039) Create Profiling JobManager/TaskManager Instance failed

2024-04-29 Thread Yu Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842230#comment-17842230 ] Yu Chen commented on FLINK-35039: - Hi [~wczhu] , sorry for the late response. It does surprise me that

Re: [PR] [FLINK-35165][runtime/coordination] AdaptiveBatch Scheduler should not restrict the default source parall… [flink]

2024-04-29 Thread via GitHub
venkata91 commented on PR #24736: URL: https://github.com/apache/flink/pull/24736#issuecomment-2084313431 cc @SinBex and @JunRuiLee for reviews. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Updated] (FLINK-35039) Create Profiling JobManager/TaskManager Instance failed

2024-04-29 Thread Yu Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Chen updated FLINK-35039: Attachment: image-2024-04-30-11-14-44-335.png > Create Profiling JobManager/TaskManager Instance failed >

[jira] [Updated] (FLINK-35039) Create Profiling JobManager/TaskManager Instance failed

2024-04-29 Thread Yu Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Chen updated FLINK-35039: Attachment: image-2024-04-30-11-12-34-734.png > Create Profiling JobManager/TaskManager Instance failed >

Re: [PR] [FLINK-35030][runtime] Introduce Epoch Manager for under async execution [flink]

2024-04-29 Thread via GitHub
flinkbot commented on PR #24748: URL: https://github.com/apache/flink/pull/24748#issuecomment-2084288856 ## CI report: * 9f3239c4bebe6a60ae8db7892e7df1a58fc868f0 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35030) Introduce Epoch Manager for under async execution

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35030: --- Labels: pull-request-available (was: ) > Introduce Epoch Manager for under async

[PR] [FLINK-35030][runtime] Introduce Epoch Manager for under async execution [flink]

2024-04-29 Thread via GitHub
fredia opened a new pull request, #24748: URL: https://github.com/apache/flink/pull/24748 ## What is the purpose of the change This PR introduces Epoch Manager to handle watermark and watermark status processing under async execution. Epoch manager segments inputs into

Re: [PR] [FLINK-35039][rest] Use PUT method supported by YARN web proxy instead of POST [flink]

2024-04-29 Thread via GitHub
yuchen-ecnu commented on PR #24689: URL: https://github.com/apache/flink/pull/24689#issuecomment-2084282176 Hi @yeezychao , sorry for the late response. It's not enough to just change the request type on the front end, you also need to modify the type of the corresponding REST interface

[jira] [Updated] (FLINK-35249) Support DataGeneratorSource in PyFlink

2024-04-29 Thread Wei Yuan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yuan updated FLINK-35249: - Description: I notice DataGeneratorSource with Java has submitted in

[jira] [Updated] (FLINK-30586) Fix calcCodeGen failed if calc with like condition contains double quotation mark

2024-04-29 Thread Benchao Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benchao Li updated FLINK-30586: --- Fix Version/s: 1.16.1 > Fix calcCodeGen failed if calc with like condition contains double

[jira] [Resolved] (FLINK-35228) DynamicKafkaSource does not read re-added topic for the same cluster

2024-04-29 Thread Mason Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mason Chen resolved FLINK-35228. Resolution: Fixed CI passes > DynamicKafkaSource does not read re-added topic for the same

[jira] [Updated] (FLINK-35228) DynamicKafkaSource does not read re-added topic for the same cluster

2024-04-29 Thread Mason Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mason Chen updated FLINK-35228: --- Fix Version/s: kafka-3.3.0 > DynamicKafkaSource does not read re-added topic for the same cluster >

[jira] [Updated] (FLINK-34379) table.optimizer.dynamic-filtering.enabled lead to OutOfMemoryError

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu updated FLINK-34379: -- Fix Version/s: 1.19.1 > table.optimizer.dynamic-filtering.enabled lead to OutOfMemoryError >

[jira] [Commented] (FLINK-34379) table.optimizer.dynamic-filtering.enabled lead to OutOfMemoryError

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842220#comment-17842220 ] dalongliu commented on FLINK-34379: --- Release-1.19: f321970111cfb6f340bd2eb0795cf24b81d583a6 >

Re: [PR] [BP-1.17][FLINK-34379][table] Fix OutOfMemoryError with large queries [flink]

2024-04-29 Thread via GitHub
lsyldliu commented on PR #24743: URL: https://github.com/apache/flink/pull/24743#issuecomment-2084206324 The CI is failed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [BP-1.18][FLINK-34379][table] Fix OutOfMemoryError with large queries [flink]

2024-04-29 Thread via GitHub
lsyldliu commented on PR #24744: URL: https://github.com/apache/flink/pull/24744#issuecomment-2084205892 The CI is failed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [BP-1.19][FLINK-34379][table] Fix OutOfMemoryError with large queries [flink]

2024-04-29 Thread via GitHub
lsyldliu merged PR #24745: URL: https://github.com/apache/flink/pull/24745 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (FLINK-35184) Hash collision inside MiniBatchStreamingJoin operator

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu resolved FLINK-35184. --- Resolution: Fixed > Hash collision inside MiniBatchStreamingJoin operator >

[jira] [Updated] (FLINK-35184) Hash collision inside MiniBatchStreamingJoin operator

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu updated FLINK-35184: -- Fix Version/s: 1.20.0 > Hash collision inside MiniBatchStreamingJoin operator >

[jira] [Commented] (FLINK-35184) Hash collision inside MiniBatchStreamingJoin operator

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842219#comment-17842219 ] dalongliu commented on FLINK-35184: --- [~rovboyko] Can you help create a backport pr to release-1.19? >

[jira] [Commented] (FLINK-35184) Hash collision inside MiniBatchStreamingJoin operator

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842218#comment-17842218 ] dalongliu commented on FLINK-35184: --- Merged in master: f543cc543e9b0eb05415095190e86d3b22cdf1a4 >

[jira] [Assigned] (FLINK-35184) Hash collision inside MiniBatchStreamingJoin operator

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu reassigned FLINK-35184: - Assignee: Roman Boyko > Hash collision inside MiniBatchStreamingJoin operator >

Re: [PR] [FLINK-35184][table-runtime] fix minibatch join hash collision [flink]

2024-04-29 Thread via GitHub
lsyldliu closed pull request #24703: [FLINK-35184][table-runtime] fix minibatch join hash collision URL: https://github.com/apache/flink/pull/24703 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (FLINK-35272) Pipeline Transform job supports omitting / renaming calculation column

2024-04-29 Thread yux (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842212#comment-17842212 ] yux commented on FLINK-35272: - [~renqs] I'm willing to implement this. > Pipeline Transform job supports

[jira] [Created] (FLINK-35272) Pipeline Transform job supports omitting / renaming calculation column

2024-04-29 Thread yux (Jira)
yux created FLINK-35272: --- Summary: Pipeline Transform job supports omitting / renaming calculation column Key: FLINK-35272 URL: https://issues.apache.org/jira/browse/FLINK-35272 Project: Flink Issue

[jira] [Resolved] (FLINK-35191) Support alter materialized table related syntaxes: suspend, resume, refresh, set and reset

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu resolved FLINK-35191. --- Resolution: Fixed > Support alter materialized table related syntaxes: suspend, resume, refresh, >

[jira] [Commented] (FLINK-35191) Support alter materialized table related syntaxes: suspend, resume, refresh, set and reset

2024-04-29 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842211#comment-17842211 ] dalongliu commented on FLINK-35191: --- Merged in master: 330f524d185d575ceb679a6c587e9c39612e844c >

Re: [PR] [FLINK-35191][table] Support alter materialized table related syntaxes: suspend, resume, refresh, set and reset [flink]

2024-04-29 Thread via GitHub
lsyldliu commented on PR #24737: URL: https://github.com/apache/flink/pull/24737#issuecomment-2084089129 Sorry for forgetting to approve, +1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [FLINK-35191][table] Support alter materialized table related syntaxes: suspend, resume, refresh, set and reset [flink]

2024-04-29 Thread via GitHub
lsyldliu closed pull request #24737: [FLINK-35191][table] Support alter materialized table related syntaxes: suspend, resume, refresh, set and reset URL: https://github.com/apache/flink/pull/24737 -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [FLINK-35194][table] Support describe job with job id [flink]

2024-04-29 Thread via GitHub
xuyangzhong commented on PR #24728: URL: https://github.com/apache/flink/pull/24728#issuecomment-2084076648 The doc jira is: https://issues.apache.org/jira/browse/FLINK-35271 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Created] (FLINK-35271) Add doc for syntax `describe job 'xxx'`

2024-04-29 Thread xuyang (Jira)
xuyang created FLINK-35271: -- Summary: Add doc for syntax `describe job 'xxx'` Key: FLINK-35271 URL: https://issues.apache.org/jira/browse/FLINK-35271 Project: Flink Issue Type: Sub-task

Re: [PR] [FLINK-35228][Connectors/Kafka] Fix: DynamicKafkaSource does not read re-added topic for the same cluster [flink-connector-kafka]

2024-04-29 Thread via GitHub
boring-cyborg[bot] commented on PR #97: URL: https://github.com/apache/flink-connector-kafka/pull/97#issuecomment-2083840330 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] [FLINK-35228][Connectors/Kafka] Fix: DynamicKafkaSource does not read re-added topic for the same cluster [flink-connector-kafka]

2024-04-29 Thread via GitHub
mas-chen merged PR #97: URL: https://github.com/apache/flink-connector-kafka/pull/97 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [FLINK-34549][API] Introduce config, context and processingTimerService for DataStream API V2 [flink]

2024-04-29 Thread via GitHub
jeyhunkarimov commented on code in PR #24541: URL: https://github.com/apache/flink/pull/24541#discussion_r1583695410 ## flink-core-api/src/main/java/org/apache/flink/api/common/operators/SlotSharingGroupDescriptor.java: ## @@ -0,0 +1,238 @@ +/* + * Licensed to the Apache

Re: [PR] [FLINK-32002] Adjust autoscaler defaults for release [flink-kubernetes-operator]

2024-04-29 Thread via GitHub
trystanj commented on code in PR #586: URL: https://github.com/apache/flink-kubernetes-operator/pull/586#discussion_r1583828939 ## flink-kubernetes-operator-autoscaler/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/config/AutoScalerOptions.java: ## @@ -68,15

Re: [PR] [FLINK-32002] Adjust autoscaler defaults for release [flink-kubernetes-operator]

2024-04-29 Thread via GitHub
trystanj commented on code in PR #586: URL: https://github.com/apache/flink-kubernetes-operator/pull/586#discussion_r1583828939 ## flink-kubernetes-operator-autoscaler/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/config/AutoScalerOptions.java: ## @@ -68,15

Re: [PR] [FLINK-32002] Adjust autoscaler defaults for release [flink-kubernetes-operator]

2024-04-29 Thread via GitHub
trystanj commented on code in PR #586: URL: https://github.com/apache/flink-kubernetes-operator/pull/586#discussion_r1583828939 ## flink-kubernetes-operator-autoscaler/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/config/AutoScalerOptions.java: ## @@ -68,15

Re: [PR] [FLINK-32002] Adjust autoscaler defaults for release [flink-kubernetes-operator]

2024-04-29 Thread via GitHub
trystanj commented on code in PR #586: URL: https://github.com/apache/flink-kubernetes-operator/pull/586#discussion_r1583828939 ## flink-kubernetes-operator-autoscaler/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/config/AutoScalerOptions.java: ## @@ -68,15

[jira] [Commented] (FLINK-34071) Deadlock in AWS Kinesis Data Streams AsyncSink connector

2024-04-29 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842153#comment-17842153 ] Ahmed Hamdy commented on FLINK-34071: - Additionally the timeout configuration setup is addressed in

[jira] [Commented] (FLINK-34071) Deadlock in AWS Kinesis Data Streams AsyncSink connector

2024-04-29 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842152#comment-17842152 ] Ahmed Hamdy commented on FLINK-34071: - [~a.pilipenko] Could we follow up and update Exception

[jira] [Updated] (FLINK-33212) Introduce job status changed listener for lineage

2024-04-29 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-33212: -- Affects Version/s: 1.20.0 (was: 1.19.0) > Introduce job status

[jira] [Assigned] (FLINK-33212) Introduce job status changed listener for lineage

2024-04-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Márton Balassi reassigned FLINK-33212: -- Assignee: Zhenqiu Huang > Introduce job status changed listener for lineage >

Re: [PR] [FLINK-33211][table] support flink table lineage [flink]

2024-04-29 Thread via GitHub
HuangZhenQiu commented on PR #24618: URL: https://github.com/apache/flink/pull/24618#issuecomment-2083346268 @davidradl Thanks for reviewing this PR. This PR is mainly to handle with source/sink level lineage, column level lineage will be need a further discussion in community.

Re: [PR] [FLINK-33211][table] support flink table lineage [flink]

2024-04-29 Thread via GitHub
HuangZhenQiu commented on code in PR #24618: URL: https://github.com/apache/flink/pull/24618#discussion_r1583476719 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/connector/source/ValuesSource.java: ## @@ -52,7 +60,9 @@ * must be 1. RowData is not

Re: [PR] [FLINK-33211][table] support flink table lineage [flink]

2024-04-29 Thread via GitHub
HuangZhenQiu commented on code in PR #24618: URL: https://github.com/apache/flink/pull/24618#discussion_r1583475226 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/lineage/ModifyType.java: ## @@ -0,0 +1,34 @@ +/* + * Licensed to the Apache

Re: [PR] [FLINK-35098][ORC] Fix incorrect results with literal first expressions [flink]

2024-04-29 Thread via GitHub
jeyhunkarimov commented on code in PR #24659: URL: https://github.com/apache/flink/pull/24659#discussion_r1583468743 ## flink-formats/flink-orc/src/test/java/org/apache/flink/orc/OrcFileSystemITCase.java: ## @@ -208,6 +208,15 @@ void testOrcFilterPushDown() throws

Re: [PR] [FLINK-35270]Enrich information in logs, making it easier for debugging [flink]

2024-04-29 Thread via GitHub
flinkbot commented on PR #24747: URL: https://github.com/apache/flink/pull/24747#issuecomment-2083291280 ## CI report: * 9a53729a7c3d968977bcbae010246a28269f9359 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-35098][ORC] Fix incorrect results with literal first expressions [flink]

2024-04-29 Thread via GitHub
jeyhunkarimov commented on PR #24659: URL: https://github.com/apache/flink/pull/24659#issuecomment-2083288208 Hi @empathy87 sorry for the late reply. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [FLINK-35270]Enrich information in logs, making it easier for debugging [flink]

2024-04-29 Thread via GitHub
HCTommy commented on PR #24747: URL: https://github.com/apache/flink/pull/24747#issuecomment-2083286683 Hi @zhuzhurk , I optimized some logs, which I think is helpful for people to debug in production environment. Could you please review in your available time. -- This is an automated

[PR] [FLINK-35270]Enrich information in logs, making it easier for debugging [flink]

2024-04-29 Thread via GitHub
HCTommy opened a new pull request, #24747: URL: https://github.com/apache/flink/pull/24747 ## What is the purpose of the change This pull request is to show more info in some logs, which helps a lot when debugging in production environment ## Does this pull request

Re: [PR] [FLINK-33211][table] support flink table lineage [flink]

2024-04-29 Thread via GitHub
HuangZhenQiu commented on code in PR #24618: URL: https://github.com/apache/flink/pull/24618#discussion_r1583451354 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/lineage/TableColumnLineageEdge.java: ## @@ -0,0 +1,45 @@ +/* + * Licensed to the

[jira] [Updated] (FLINK-35270) Enrich information in logs, making it easier for debugging

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35270: --- Labels: pull-request-available (was: ) > Enrich information in logs, making it easier for

[jira] [Created] (FLINK-35270) Enrich information in logs, making it easier for debugging

2024-04-29 Thread Haifei Chen (Jira)
Haifei Chen created FLINK-35270: --- Summary: Enrich information in logs, making it easier for debugging Key: FLINK-35270 URL: https://issues.apache.org/jira/browse/FLINK-35270 Project: Flink

Re: [PR] [FLINK-33211][table] support flink table lineage [flink]

2024-04-29 Thread via GitHub
HuangZhenQiu commented on code in PR #24618: URL: https://github.com/apache/flink/pull/24618#discussion_r1583446509 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/lineage/LineageGraph.java: ## @@ -20,13 +20,12 @@ package

Re: [PR] [FLINK-33211][table] support flink table lineage [flink]

2024-04-29 Thread via GitHub
HuangZhenQiu commented on code in PR #24618: URL: https://github.com/apache/flink/pull/24618#discussion_r1583447345 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/transformations/OneInputTransformation.java: ## @@ -42,7 +42,7 @@ * @param The type of the

Re: [PR] [FLINK-35269] Log information about failed records as warnings instead of debug for Kinesis and Firehose sinks [flink-connector-aws]

2024-04-29 Thread via GitHub
hlteoh37 commented on code in PR #139: URL: https://github.com/apache/flink-connector-aws/pull/139#discussion_r1583398674 ## flink-connector-aws/flink-connector-aws-kinesis-firehose/src/main/java/org/apache/flink/connector/firehose/sink/KinesisFirehoseSinkWriter.java: ## @@

[jira] [Commented] (FLINK-34071) Deadlock in AWS Kinesis Data Streams AsyncSink connector

2024-04-29 Thread Aleksandr Pilipenko (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842055#comment-17842055 ] Aleksandr Pilipenko commented on FLINK-34071: - We found that one of the causes of this -

[jira] [Updated] (FLINK-35269) Fix logging level for errors in AWS connector sinks

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35269: --- Labels: pull-request-available (was: ) > Fix logging level for errors in AWS connector

[PR] [FLINK-35269] Log information about failed records as warnings instead of debug for Kinesis and Firehose sinks [flink-connector-aws]

2024-04-29 Thread via GitHub
z3d1k opened a new pull request, #139: URL: https://github.com/apache/flink-connector-aws/pull/139 ## Purpose of the change Change logging level for information about records failed to be written by Kinesis and Firehose sinks from `debug` to `warn`. Similar configuration is

[jira] [Commented] (FLINK-19059) Support to consume retractions for OVER WINDOW operator

2024-04-29 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842052#comment-17842052 ] Martijn Visser commented on FLINK-19059: A relatively simple reproducer: {code:sql} CREATE OR

[jira] (FLINK-27969) StreamPhysicalOverAggregate doesn't support consuming update and delete changes

2024-04-29 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27969 ] Martijn Visser deleted comment on FLINK-27969: was (Author: martijnvisser): A relatively simple reproducer: {code:sql} CREATE OR REPLACE TABLE orders ( order_number BIGINT,

[jira] [Commented] (FLINK-27969) StreamPhysicalOverAggregate doesn't support consuming update and delete changes

2024-04-29 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842051#comment-17842051 ] Martijn Visser commented on FLINK-27969: A relatively simple reproducer: {code:sql} CREATE OR

[jira] [Closed] (FLINK-27969) StreamPhysicalOverAggregate doesn't support consuming update and delete changes

2024-04-29 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser closed FLINK-27969. -- Resolution: Delivered > StreamPhysicalOverAggregate doesn't support consuming update and

[jira] [Closed] (FLINK-26802) StreamPhysicalOverAggregate doesn't support consuming update and delete changes which is produced by node Deduplicate

2024-04-29 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser closed FLINK-26802. -- Resolution: Duplicate > StreamPhysicalOverAggregate doesn't support consuming update and

[jira] [Created] (FLINK-35269) Fix logging level for errors in AWS connector sinks

2024-04-29 Thread Aleksandr Pilipenko (Jira)
Aleksandr Pilipenko created FLINK-35269: --- Summary: Fix logging level for errors in AWS connector sinks Key: FLINK-35269 URL: https://issues.apache.org/jira/browse/FLINK-35269 Project: Flink

Re: [PR] [FLINK-35217] Add missing fsync to #closeForCommit in some subclasses of RecoverableFsDataOutputStream. [flink]

2024-04-29 Thread via GitHub
rkhachatryan commented on PR #24722: URL: https://github.com/apache/flink/pull/24722#issuecomment-2083081066 Thanks for updating the PR, LGTM (please re-format the code and commit history before merging) -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] [FLINK-35233] Fix lookup cache reuse RowData object problem [flink-connector-hbase]

2024-04-29 Thread via GitHub
MartijnVisser merged PR #47: URL: https://github.com/apache/flink-connector-hbase/pull/47 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-35232) Support for retry settings on GCS connector

2024-04-29 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841999#comment-17841999 ] Galen Warren commented on FLINK-35232: -- [~xtsong] You helped with the original implementation of

Re: [PR] [FLINK-34902][table] Fix IndexOutOfBoundsException for VALUES [flink]

2024-04-29 Thread via GitHub
jeyhunkarimov commented on PR #24724: URL: https://github.com/apache/flink/pull/24724#issuecomment-2082785290 Hi @twalthr thanks a lot for your review. Could you please recheck in your available time? Thanks -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (FLINK-32212) Job restarting indefinitely after an IllegalStateException from BlobLibraryCacheManager

2024-04-29 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841985#comment-17841985 ] Robert Metzger commented on FLINK-32212: Thanks [~rickysaltzer]. Have you figured out what

Re: [PR] [FLINK-35191][table] Support alter materialized table related syntaxes: suspend, resume, refresh, set and reset [flink]

2024-04-29 Thread via GitHub
lsyldliu commented on code in PR #24737: URL: https://github.com/apache/flink/pull/24737#discussion_r1583020783 ## flink-table/flink-sql-parser/src/main/java/org/apache/flink/sql/parser/ddl/SqlAlterMaterializedTableFreshness.java: ## @@ -0,0 +1,60 @@ +/* + * Licensed to the

[jira] [Updated] (FLINK-35232) Support for retry settings on GCS connector

2024-04-29 Thread Oleksandr Nitavskyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleksandr Nitavskyi updated FLINK-35232: Description: https://issues.apache.org/jira/browse/FLINK-32877 is tracking

[jira] [Updated] (FLINK-35232) Support for retry settings on GCS connector

2024-04-29 Thread Oleksandr Nitavskyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleksandr Nitavskyi updated FLINK-35232: Description: https://issues.apache.org/jira/browse/FLINK-32877 is tracking

Re: [PR] [FLINK-35194][table] Support describe job with job id [flink]

2024-04-29 Thread via GitHub
xuyangzhong commented on code in PR #24728: URL: https://github.com/apache/flink/pull/24728#discussion_r1583035157 ## flink-table/flink-sql-gateway/src/test/java/org/apache/flink/table/gateway/service/SqlGatewayServiceITCase.java: ## @@ -511,6 +511,57 @@ void

Re: [PR] [FLINK-35194][table] Support describe job with job id [flink]

2024-04-29 Thread via GitHub
xuyangzhong commented on code in PR #24728: URL: https://github.com/apache/flink/pull/24728#discussion_r1583029959 ## flink-table/flink-sql-gateway/src/test/java/org/apache/flink/table/gateway/service/SqlGatewayServiceITCase.java: ## @@ -511,6 +511,57 @@ void

[jira] [Commented] (FLINK-35264) Flink CDC Pipeline transform rules do not take effect

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841969#comment-17841969 ] Qingsheng Ren commented on FLINK-35264: --- flink-cdc master:

[jira] [Resolved] (FLINK-35264) Flink CDC Pipeline transform rules do not take effect

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren resolved FLINK-35264. --- Fix Version/s: cdc-3.1.0 Resolution: Fixed > Flink CDC Pipeline transform rules do

[jira] [Assigned] (FLINK-35264) Flink CDC Pipeline transform rules do not take effect

2024-04-29 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren reassigned FLINK-35264: - Assignee: yux > Flink CDC Pipeline transform rules do not take effect >

Re: [PR] [BP-1.19][FLINK-32622][table-planner] Optimize mini-batch assignment (#23470) [flink]

2024-04-29 Thread via GitHub
flinkbot commented on PR #24746: URL: https://github.com/apache/flink/pull/24746#issuecomment-2082589152 ## CI report: * 4c4543f67eb113899c6de49e3fe5d366d5d83a52 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [BP-1.19][FLINK-34379][table] Fix OutOfMemoryError with large queries [flink]

2024-04-29 Thread via GitHub
flinkbot commented on PR #24745: URL: https://github.com/apache/flink/pull/24745#issuecomment-2082571132 ## CI report: * 4ebf21ce7604d3e211b1a52bda6ae3904e05994e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [BP-1.18][FLINK-34379][table] Fix OutOfMemoryError with large queries [flink]

2024-04-29 Thread via GitHub
flinkbot commented on PR #24744: URL: https://github.com/apache/flink/pull/24744#issuecomment-2082557953 ## CI report: * 9c761f895f0bf3b54833281f11b578ce2a0e32a8 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [BP-1.19][FLINK-34379][table] Fix OutOfMemoryError with large queries [flink]

2024-04-29 Thread via GitHub
jeyhunkarimov opened a new pull request, #24745: URL: https://github.com/apache/flink/pull/24745 This is 1.19 backport for commit https://github.com/apache/flink/commit/cca14d4210634d481cacb11354e870807d570561 -- This is an automated message from the Apache Git Service. To respond to the

[PR] [BP-1.18][FLINK-34379][table] Fix OutOfMemoryError with large queries [flink]

2024-04-29 Thread via GitHub
jeyhunkarimov opened a new pull request, #24744: URL: https://github.com/apache/flink/pull/24744 This is 1.18 backport for commit https://github.com/apache/flink/commit/cca14d4210634d481cacb11354e870807d570561 -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Closed] (FLINK-34997) PyFlink YARN per-job on Docker test failed on azure

2024-04-29 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger closed FLINK-34997. -- Resolution: Won't Fix > PyFlink YARN per-job on Docker test failed on azure >

[jira] [Commented] (FLINK-34997) PyFlink YARN per-job on Docker test failed on azure

2024-04-29 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841960#comment-17841960 ] Robert Metzger commented on FLINK-34997: > The issue seems to be that docker-compose binaries

Re: [PR] [BP-1.17][FLINK-34379][table] Fix OutOfMemoryError with large queries [flink]

2024-04-29 Thread via GitHub
flinkbot commented on PR #24743: URL: https://github.com/apache/flink/pull/24743#issuecomment-2082545377 ## CI report: * 6a2d5aaa02492acb37a4d2cae21771c255eb2a3f UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [BP-1.17][FLINK-34379][table] Fix OutOfMemoryError with large queries [flink]

2024-04-29 Thread via GitHub
jeyhunkarimov opened a new pull request, #24743: URL: https://github.com/apache/flink/pull/24743 This is 1.17 backport for commit https://github.com/apache/flink/commit/cca14d4210634d481cacb11354e870807d570561 -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (FLINK-35265) Implement FlinkStateSnapshot custom resource

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35265: --- Labels: pull-request-available (was: ) > Implement FlinkStateSnapshot custom resource >

[PR] [FLINK-35265] Implement FlinkStateSnapshot custom resource [flink-kubernetes-operator]

2024-04-29 Thread via GitHub
mateczagany opened a new pull request, #821: URL: https://github.com/apache/flink-kubernetes-operator/pull/821 This PR is still in early development, please keep that in mind. Notes: - In case of a periodic snapshots, the Operator will create new `FlinkStateSnapshot` CRs, and the

[jira] [Commented] (FLINK-31223) sql-client.sh fails to start with ssl enabled

2024-04-29 Thread david radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841957#comment-17841957 ] david radley commented on FLINK-31223: -- I have raised backport prs: #24741 for 1.18

[jira] [Commented] (FLINK-35012) ChangelogNormalizeRestoreTest.testRestore failure

2024-04-29 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841956#comment-17841956 ] Robert Metzger commented on FLINK-35012: [~bvarghese] it looks like you've "recently" added this

  1   2   >