[jira] [Updated] (FLINK-35103) [Plugin] Enhancing Flink Failure Management in Kubernetes with Dynamic Termination Log Integration

2024-04-15 Thread SwathiChandrashekar (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SwathiChandrashekar updated FLINK-35103: Description: Currently, whenever we have flink failures, we need to manually do th

[jira] [Created] (FLINK-35103) [Plugin] Enhancing Flink Failure Management in Kubernetes with Dynamic Termination Log Integration

2024-04-15 Thread SwathiChandrashekar (Jira)
SwathiChandrashekar created FLINK-35103: --- Summary: [Plugin] Enhancing Flink Failure Management in Kubernetes with Dynamic Termination Log Integration Key: FLINK-35103 URL: https://issues.apache.org/jira/brow

[jira] [Updated] (FLINK-35103) [Plugin] Enhancing Flink Failure Management in Kubernetes with Dynamic Termination Log Integration

2024-04-15 Thread SwathiChandrashekar (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SwathiChandrashekar updated FLINK-35103: Description: Currently, whenever we have flink failures, we need to manually do th

Re: [PR] [FLINK-34961][BP v.1.1] Use dedicated CI name for MongoDB connector to differentiate it in infra-reports [flink-connector-mongodb]

2024-04-15 Thread via GitHub
snuyanzin merged PR #34: URL: https://github.com/apache/flink-connector-mongodb/pull/34 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr.

[jira] [Updated] (FLINK-35103) [Plugin] Enhancing Flink Failure Management in Kubernetes with Dynamic Termination Log Integration

2024-04-15 Thread SwathiChandrashekar (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SwathiChandrashekar updated FLINK-35103: Description: Currently, whenever we have flink failures, we need to manually do th

[jira] [Resolved] (FLINK-34962) flink-connector-pulsa starts failed due to incorrect use of Pulsar API: LookupService. getPartitionedTopicMetadata

2024-04-15 Thread Zili Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zili Chen resolved FLINK-34962. --- Fix Version/s: pulsar-4.2.0 Resolution: Fixed master via https://github.com/apache/flink-con

[jira] [Updated] (FLINK-34962) flink-connector-pulsa starts failed due to incorrect use of Pulsar API: LookupService. getPartitionedTopicMetadata

2024-04-15 Thread Zili Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zili Chen updated FLINK-34962: -- Affects Version/s: (was: pulsar-4.1.1) > flink-connector-pulsa starts failed due to incorrect use

[jira] [Updated] (FLINK-34962) flink-connector-pulsa starts failed due to incorrect use of Pulsar API: LookupService. getPartitionedTopicMetadata

2024-04-15 Thread Zili Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zili Chen updated FLINK-34962: -- Affects Version/s: (was: pulsar-4.2.0) > flink-connector-pulsa starts failed due to incorrect use

[jira] [Created] (FLINK-35104) Add kafka pipeline data source connector

2024-04-15 Thread melin (Jira)
melin created FLINK-35104: - Summary: Add kafka pipeline data source connector Key: FLINK-35104 URL: https://issues.apache.org/jira/browse/FLINK-35104 Project: Flink Issue Type: New Feature

[jira] [Updated] (FLINK-35104) Add kafka pipeline data source connector

2024-04-15 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35104: -- Description: First collect cdc data in real time and write it to kafka, then write it to multiple different d

[jira] [Updated] (FLINK-35104) Add kafka pipeline data source connector

2024-04-15 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35104: -- Description: There is already a [kafka pipeline data sink connector|[https://github.com/apache/flink-cdc/pull

[jira] [Updated] (FLINK-35104) Add kafka pipeline data source connector

2024-04-15 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35104: -- Description: There is already a kafka pipeline data sink connector : [https://github.com/apache/flink-cdc/pul

Re: [PR] [FLINK-34987][state] Introduce Internal State for Async State API [flink]

2024-04-15 Thread via GitHub
masteryhx commented on code in PR #24651: URL: https://github.com/apache/flink/pull/24651#discussion_r1565293565 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/v2/StateDescriptor.java: ## @@ -0,0 +1,167 @@ +/* + * Licensed to the Apache Software Foundation (ASF) u

[jira] [Created] (FLINK-35105) Support setting default Autoscaler options at autoscaler standalone level

2024-04-15 Thread Rui Fan (Jira)
Rui Fan created FLINK-35105: --- Summary: Support setting default Autoscaler options at autoscaler standalone level Key: FLINK-35105 URL: https://issues.apache.org/jira/browse/FLINK-35105 Project: Flink

[jira] [Updated] (FLINK-35104) Add kafka pipeline data source connector

2024-04-15 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35104: -- Description: There is already a kafka pipeline data sink connector : [https://github.com/apache/flink-cdc/pul

[jira] [Updated] (FLINK-35104) Add kafka pipeline data source connector

2024-04-15 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35104: -- Description: There is already a kafka pipeline data sink connector, and there should also be a kafka pipeline

[jira] [Updated] (FLINK-35104) Add kafka pipeline data source connector

2024-04-15 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35104: -- Description: There is already a kafka pipeline data sink connector, and there should also be a kafka pipeline

[jira] [Commented] (FLINK-35037) Optimize uniqueKeys and upsertKeys inference of windows with ROW_NUMBER

2024-04-15 Thread yisha zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837095#comment-17837095 ] yisha zhou commented on FLINK-35037: [~libenchao]  The PR has been submitted. Please

[PR] [FLINK-35105][autoscaler] Support setting default Autoscaler options at autoscaler standalone level [flink-kubernetes-operator]

2024-04-15 Thread via GitHub
1996fanrui opened a new pull request, #814: URL: https://github.com/apache/flink-kubernetes-operator/pull/814 ## What is the purpose of the change Currently, autoscaler standalone doesn't support set [autoscaler options](https://nightlies.apache.org/flink/flink-kubernetes-operator-doc

[jira] [Updated] (FLINK-35105) Support setting default Autoscaler options at autoscaler standalone level

2024-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35105: --- Labels: pull-request-available (was: ) > Support setting default Autoscaler options at auto

Re: [PR] [FLINK-34987][state] Introduce Internal State for Async State API [flink]

2024-04-15 Thread via GitHub
masteryhx commented on code in PR #24651: URL: https://github.com/apache/flink/pull/24651#discussion_r1565310323 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/v2/StateDescriptor.java: ## @@ -0,0 +1,166 @@ +/* + * Licensed to the Apache Software Foundation (ASF) u

Re: [PR] [hotfix][runtime]Fix the missing methed parameter annotation problem [flink]

2024-04-15 Thread via GitHub
reswqa commented on PR #24662: URL: https://github.com/apache/flink/pull/24662#issuecomment-2055922902 Wait a minute, you shouldn't only change the title of github pull request. Commit message should be aligned with this also. -- This is an automated message from the Apache Git Service.

Re: [PR] [FLINK-34987][state] Introduce Internal State for Async State API [flink]

2024-04-15 Thread via GitHub
masteryhx commented on code in PR #24651: URL: https://github.com/apache/flink/pull/24651#discussion_r1565315084 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/v2/InternalKeyedState.java: ## @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] [FLINK-34936][Checkpointing] Register reused shared state handle to FileMergingSnapshotManager [flink]

2024-04-15 Thread via GitHub
fredia commented on code in PR #24644: URL: https://github.com/apache/flink/pull/24644#discussion_r1565310108 ## flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/snapshot/RocksIncrementalSnapshotStrategy.java: ## @@ -349,6 +3

[jira] [Created] (FLINK-35106) Kubernetes Operator ignores checkpoint type configuration

2024-04-15 Thread Mate Czagany (Jira)
Mate Czagany created FLINK-35106: Summary: Kubernetes Operator ignores checkpoint type configuration Key: FLINK-35106 URL: https://issues.apache.org/jira/browse/FLINK-35106 Project: Flink Iss

[jira] [Commented] (FLINK-35064) Flink sql connector pulsar/hive com.fasterxml.jackson.annotation.JsonFormat$Value conflict

2024-04-15 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837107#comment-17837107 ] Yufan Sheng commented on FLINK-35064: - AFAICS, the {{pulsar-client-all}} should be r

Re: [PR] [FLINK-20625][pubsub,e2e] Add PubSubSource connector using FLIP-27 [flink-connector-gcp-pubsub]

2024-04-15 Thread via GitHub
snuyanzin commented on PR #2: URL: https://github.com/apache/flink-connector-gcp-pubsub/pull/2#issuecomment-2056067269 @dchristle thanks for the review May I ask you to have another iteration review for this PR? -- This is an automated message from the Apache Git Service. To respond to

Re: [PR] [hotfix] Update dependencies [flink-connector-gcp-pubsub]

2024-04-15 Thread via GitHub
boring-cyborg[bot] commented on PR #24: URL: https://github.com/apache/flink-connector-gcp-pubsub/pull/24#issuecomment-2056080694 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This

Re: [PR] [FLINK-34987][state] Introduce Internal State for Async State API [flink]

2024-04-15 Thread via GitHub
fredia commented on code in PR #24651: URL: https://github.com/apache/flink/pull/24651#discussion_r1565352484 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/v2/StateDescriptor.java: ## @@ -0,0 +1,166 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[jira] [Created] (FLINK-35107) rename flink-connector-datagen-test module folder to flink-connector-datagen-tests

2024-04-15 Thread xleoken (Jira)
xleoken created FLINK-35107: --- Summary: rename flink-connector-datagen-test module folder to flink-connector-datagen-tests Key: FLINK-35107 URL: https://issues.apache.org/jira/browse/FLINK-35107 Project: Fli

Re: [PR] [FLINK-34987][state] Introduce Internal State for Async State API [flink]

2024-04-15 Thread via GitHub
fredia commented on code in PR #24651: URL: https://github.com/apache/flink/pull/24651#discussion_r1565354167 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/v2/InternalKeyedState.java: ## @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software Foundation (ASF) un

[PR] [FLINK-35107] Rename flink-connector-datagen-test module folder to flink-connector-datagen-tests [flink]

2024-04-15 Thread via GitHub
xleoken opened a new pull request, #24665: URL: https://github.com/apache/flink/pull/24665 ## What is the purpose of the change Rename flink-connector-datagen-test module folder to flink-connector-datagen-tests. ## Brief change log *(for example:)* - *Th

[jira] [Updated] (FLINK-35107) rename flink-connector-datagen-test module folder to flink-connector-datagen-tests

2024-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35107: --- Labels: pull-request-available (was: ) > rename flink-connector-datagen-test module folder

Re: [PR] [hotfix][runtime]Fix the missing methed parameter annotation problem [flink]

2024-04-15 Thread via GitHub
chenyu-opensource commented on PR #24662: URL: https://github.com/apache/flink/pull/24662#issuecomment-2056154528 > Wait a minute, you shouldn't only change the title of github pull request. Commit message should be aligned with this also. Sorry about that. May I close the current PR

Re: [PR] [FLINK-35107] Rename flink-connector-datagen-test module folder to flink-connector-datagen-tests [flink]

2024-04-15 Thread via GitHub
flinkbot commented on PR #24665: URL: https://github.com/apache/flink/pull/24665#issuecomment-2056169433 ## CI report: * fedce03e26e8f925d2fa5297f8fda9ca6c06d151 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-35046][state] Introduce AsyncKeyedStateBackend supporting to create StateExecutor [flink]

2024-04-15 Thread via GitHub
masteryhx commented on code in PR #24663: URL: https://github.com/apache/flink/pull/24663#discussion_r1565377484 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/StateBackend.java: ## @@ -104,6 +104,25 @@ default String getName() { CheckpointableKeyedStateBack

Re: [PR] [hotfix][runtime]Fix the missing methed parameter annotation problem [flink]

2024-04-15 Thread via GitHub
chenyu-opensource closed pull request #24662: [hotfix][runtime]Fix the missing methed parameter annotation problem URL: https://github.com/apache/flink/pull/24662 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[jira] [Created] (FLINK-35108) Deployment recovery is triggered on terminal jobs after jm shutdown ttl

2024-04-15 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-35108: -- Summary: Deployment recovery is triggered on terminal jobs after jm shutdown ttl Key: FLINK-35108 URL: https://issues.apache.org/jira/browse/FLINK-35108 Project: Flink

[jira] [Updated] (FLINK-35103) [Plugin] Enhancing Flink Failure Management in Kubernetes with Dynamic Termination Log Integration

2024-04-15 Thread SwathiChandrashekar (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SwathiChandrashekar updated FLINK-35103: Labels: pull-request-available (was: ) > [Plugin] Enhancing Flink Failure Managem

[PR] [hotfix][runtime]Fix the missing methed parameter annotation problem [flink]

2024-04-15 Thread via GitHub
chenyu-opensource opened a new pull request, #24666: URL: https://github.com/apache/flink/pull/24666 ## What is the purpose of the change This pull request fixs the problem of missing methed parameter annotation. ## Brief change log Add the parameter annotatio

Re: [PR] [hotfix][runtime]Fix the missing methed parameter annotation problem [flink]

2024-04-15 Thread via GitHub
chenyu-opensource commented on PR #24662: URL: https://github.com/apache/flink/pull/24662#issuecomment-2056223652 > Wait a minute, you shouldn't only change the title of github pull request. Commit message should be aligned with this also. I had close this pr and create a new one. ht

Re: [PR] [FLINK-34936][Checkpointing] Register reused shared state handle to FileMergingSnapshotManager [flink]

2024-04-15 Thread via GitHub
ljz2051 commented on code in PR #24644: URL: https://github.com/apache/flink/pull/24644#discussion_r1562362549 ## flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/filemerging/FileMergingSnapshotManagerBase.java: ## @@ -70,6 +72,9 @@ public abstract class FileMergi

Re: [PR] [FLINK-33859] Support OpenSearch v2 [flink-connector-opensearch]

2024-04-15 Thread via GitHub
snuyanzin commented on PR #38: URL: https://github.com/apache/flink-connector-opensearch/pull/38#issuecomment-2056231334 this is in my todo list for today/tomorrow -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [PR] [hotfix][runtime]Fix the missing methed parameter annotation problem [flink]

2024-04-15 Thread via GitHub
reswqa commented on PR #24666: URL: https://github.com/apache/flink/pull/24666#issuecomment-2056235051 You could just force push it, github can take care of this. But you've opened a new PR, let's move our eyes here. 😉 -- This is an automated message from the Apache Git Service. To respo

Re: [PR] [hotfix][runtime]Fix the missing methed parameter annotation problem [flink]

2024-04-15 Thread via GitHub
reswqa commented on PR #24666: URL: https://github.com/apache/flink/pull/24666#issuecomment-2056237176 I will merge this after CI passed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] [hotfix][runtime]Fix the missing methed parameter annotation problem [flink]

2024-04-15 Thread via GitHub
flinkbot commented on PR #24666: URL: https://github.com/apache/flink/pull/24666#issuecomment-2056241215 ## CI report: * b0404b8f421f5920d958ff4ad3fdad170d4f56e4 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-34694) Delete num of associations for streaming outer join

2024-04-15 Thread Roman Boyko (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Boyko updated FLINK-34694: Attachment: image-2024-04-15-15-45-51-027.png > Delete num of associations for streaming outer joi

[jira] [Updated] (FLINK-34694) Delete num of associations for streaming outer join

2024-04-15 Thread Roman Boyko (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Boyko updated FLINK-34694: Attachment: image-2024-04-15-15-46-17-671.png > Delete num of associations for streaming outer joi

[jira] [Assigned] (FLINK-35022) Add TypeInformed Element Converter for DynamoDbSink

2024-04-15 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer reassigned FLINK-35022: - Assignee: Ahmed Hamdy > Add TypeInformed Element Converter for DynamoDbSink > -

Re: [PR] [hotfix][runtime]Fix the missing methed parameter annotation problem [flink]

2024-04-15 Thread via GitHub
chenyu-opensource commented on PR #24666: URL: https://github.com/apache/flink/pull/24666#issuecomment-2056282707 > I will merge this after CI passed. This is my first time contributing to this project. Thank you so much for your patience. I will continue to pay attention to the commu

Re: [PR] [hotfix][runtime]Fix the missing methed parameter annotation problem [flink]

2024-04-15 Thread via GitHub
reswqa commented on PR #24666: URL: https://github.com/apache/flink/pull/24666#issuecomment-2056324276 welcome to on board 👍 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (FLINK-35022) Add TypeInformed Element Converter for DynamoDbSink

2024-04-15 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837132#comment-17837132 ] Danny Cranmer commented on FLINK-35022: --- Hey [~chalixar], thanks for the contribut

[jira] [Comment Edited] (FLINK-35022) Add TypeInformed Element Converter for DynamoDbSink

2024-04-15 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837132#comment-17837132 ] Danny Cranmer edited comment on FLINK-35022 at 4/15/24 9:19 AM: --

[jira] [Updated] (FLINK-35109) Add support for Flink 1.20-SNAPSHOT in Flink Kafka connector and drop support for 1.17 and 1.18

2024-04-15 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-35109: --- Summary: Add support for Flink 1.20-SNAPSHOT in Flink Kafka connector and drop support for 1

Re: [PR] [FLINK-35022] Add TypeInformed DDB Element Converter [flink-connector-aws]

2024-04-15 Thread via GitHub
dannycranmer commented on PR #136: URL: https://github.com/apache/flink-connector-aws/pull/136#issuecomment-2056352344 Please change commit message to include the component: `[FLINK-35022][Connectors/DynamoDB]` -- This is an automated message from the Apache Git Service. To respond to th

[jira] [Created] (FLINK-35109) Drop support for Flink 1.17 and 1.18 in Flink Kafka connector

2024-04-15 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-35109: -- Summary: Drop support for Flink 1.17 and 1.18 in Flink Kafka connector Key: FLINK-35109 URL: https://issues.apache.org/jira/browse/FLINK-35109 Project: Flink

Re: [PR] [FLINK-34903][MySQL][Feature] Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary tables [flink-cdc]

2024-04-15 Thread via GitHub
PatrickRen commented on code in PR #3186: URL: https://github.com/apache/flink-cdc/pull/3186#discussion_r1565458476 ## docs/content.zh/docs/connectors/mysql.md: ## @@ -107,6 +107,14 @@ pipeline: 需要注意的是,点号(.)被视为数据库和表名的分隔符。 如果需要在正则表达式中使用点(.)来匹配任何字符,必须使用反斜杠对点进行转义。

Re: [PR] [FLINK-32732][Connectors/Kafka] auto offset reset should be exposed t… [flink-connector-kafka]

2024-04-15 Thread via GitHub
MartijnVisser closed pull request #43: [FLINK-32732][Connectors/Kafka] auto offset reset should be exposed t… URL: https://github.com/apache/flink-connector-kafka/pull/43 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] [FLINK-32732][Connectors/Kafka] auto offset reset should be exposed t… [flink-connector-kafka]

2024-04-15 Thread via GitHub
MartijnVisser commented on PR #43: URL: https://github.com/apache/flink-connector-kafka/pull/43#issuecomment-2056370919 No activity on the PR, closing as invalid -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Closed] (FLINK-32732) auto offset reset should be exposed to user

2024-04-15 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser closed FLINK-32732. -- Resolution: Invalid > auto offset reset should be exposed to user > --

[jira] [Updated] (FLINK-34470) Transactional message + Table api kafka source with 'latest-offset' scan bound mode causes indefinitely hanging

2024-04-15 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-34470: --- Affects Version/s: kafka-3.1.0 (was: 1.17.1) > Transactional mess

Re: [PR] [FLINK-35022] Add TypeInformed DDB Element Converter [flink-connector-aws]

2024-04-15 Thread via GitHub
dannycranmer commented on code in PR #136: URL: https://github.com/apache/flink-connector-aws/pull/136#discussion_r1565419487 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbTypeInformedElementConverter.java: ## @@

Re: [PR] [FLINK-35022] Add TypeInformed DDB Element Converter [flink-connector-aws]

2024-04-15 Thread via GitHub
dannycranmer commented on PR #136: URL: https://github.com/apache/flink-connector-aws/pull/136#issuecomment-2056383239 I have left a comment regarding the need for this on the Jira: https://issues.apache.org/jira/browse/FLINK-35022 -- This is an automated message from the Apache Git Serv

[PR] [FLINK-35026][runtime][config] Introduce async execution configurations [flink]

2024-04-15 Thread via GitHub
fredia opened a new pull request, #24667: URL: https://github.com/apache/flink/pull/24667 ## What is the purpose of the change As part of the async execution model of disaggregated state management, this PR introduce async execution configurations. ## Brief change l

[jira] [Updated] (FLINK-35026) Introduce async execution configurations

2024-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35026: --- Labels: pull-request-available (was: ) > Introduce async execution configurations > ---

Re: [PR] [FLINK-35075][table] Migrate TwoStageOptimizedAggregateRule to java [flink]

2024-04-15 Thread via GitHub
liuyongvs commented on PR #24650: URL: https://github.com/apache/flink/pull/24650#issuecomment-2056391409 hi @snuyanzin will you help review it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[jira] [Assigned] (FLINK-30388) Add support for ElementConverted open() method for KDS/KDF/DDB

2024-04-15 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer reassigned FLINK-30388: - Assignee: Ahmed Hamdy > Add support for ElementConverted open() method for KDS/KDF/DDB

[jira] [Commented] (FLINK-35022) Add TypeInformed Element Converter for DynamoDbSink

2024-04-15 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837140#comment-17837140 ] Ahmed Hamdy commented on FLINK-35022: - Hi [~dannycranmer]  Thanks for the reply, I a

[jira] [Updated] (FLINK-30388) Add support for ElementConverted open() method for KDS/KDF/DDB

2024-04-15 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-30388: -- Fix Version/s: aws-connector-4.3.0 > Add support for ElementConverted open() method for KDS/KD

Re: [PR] [FLINK-35062][table] Migrate RewriteMultiJoinConditionRule to java [flink]

2024-04-15 Thread via GitHub
liuyongvs commented on PR #24648: URL: https://github.com/apache/flink/pull/24648#issuecomment-2056392924 hi @snuyanzin will you help review it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] [FLINK-35026][runtime][config] Introduce async execution configurations [flink]

2024-04-15 Thread via GitHub
flinkbot commented on PR #24667: URL: https://github.com/apache/flink/pull/24667#issuecomment-2056402383 ## CI report: * aea56668e33e7062e6b18dac4086a2f05dc36fc1 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-30388) Add support for ElementConverted open() method for KDS/KDF/DDB

2024-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30388: --- Labels: pull-request-available (was: ) > Add support for ElementConverted open() method for

[jira] [Commented] (FLINK-35075) Migrate TwoStageOptimizedAggregateRule

2024-04-15 Thread Jacky Lau (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837146#comment-17837146 ] Jacky Lau commented on FLINK-35075: --- hi [~snuyanzin] will you help review this? > Mig

[jira] [Commented] (FLINK-34436) Avro schema evolution and compatibility issues in Pulsar connector

2024-04-15 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837148#comment-17837148 ] Yufan Sheng commented on FLINK-34436: - If you want to consume all the messages with

[jira] [Commented] (FLINK-34091) Flink pulsar connect add automatic failover capability

2024-04-15 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837152#comment-17837152 ] Yufan Sheng commented on FLINK-34091: - Since this is a requirement from Pulsar side.

Re: [PR] [FLINK-35022] Add TypeInformed DDB Element Converter [flink-connector-aws]

2024-04-15 Thread via GitHub
vahmed-hamdy commented on code in PR #136: URL: https://github.com/apache/flink-connector-aws/pull/136#discussion_r1565513965 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbTypeInformedElementConverter.java: ## @@

[jira] [Commented] (FLINK-33729) Events are getting lost when an exception occurs within a processing function

2024-04-15 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837157#comment-17837157 ] Yufan Sheng commented on FLINK-33729: - [~Weijie Guo] Yep, this is a valid ticket. Bu

[jira] [Commented] (FLINK-33486) Pulsar Client Send Timeout Terminates TaskManager

2024-04-15 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837160#comment-17837160 ] Yufan Sheng commented on FLINK-33486: - The retry logic is internally provided by the

[jira] [Created] (FLINK-35110) Modify the spelling mistakes in the taskmanager html

2024-04-15 Thread JJJJude (Jira)
ude created FLINK-35110: --- Summary: Modify the spelling mistakes in the taskmanager html Key: FLINK-35110 URL: https://issues.apache.org/jira/browse/FLINK-35110 Project: Flink Issue Type: Improv

[jira] [Created] (FLINK-35111) Modify the spelling mistakes in the taskmanager html

2024-04-15 Thread JJJJude (Jira)
ude created FLINK-35111: --- Summary: Modify the spelling mistakes in the taskmanager html Key: FLINK-35111 URL: https://issues.apache.org/jira/browse/FLINK-35111 Project: Flink Issue Type: Improv

Re: [PR] [FLINK-35025][Runtime/State] Abstract stream operators for async state processing [flink]

2024-04-15 Thread via GitHub
fredia commented on code in PR #24657: URL: https://github.com/apache/flink/pull/24657#discussion_r1565516972 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/asyncprocessing/AbstractAsyncStateStreamOperator.java: ## @@ -0,0 +1,134 @@ +/* + * Li

[jira] [Commented] (FLINK-33136) Flink Pulsar Connector RoundRobinTopicRouter Generates Invalid Error Message

2024-04-15 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837161#comment-17837161 ] Yufan Sheng commented on FLINK-33136: - Yep, I think you are right. We should use mor

[jira] [Created] (FLINK-35112) Membership for Row class does not include field names

2024-04-15 Thread Wouter Zorgdrager (Jira)
Wouter Zorgdrager created FLINK-35112: - Summary: Membership for Row class does not include field names Key: FLINK-35112 URL: https://issues.apache.org/jira/browse/FLINK-35112 Project: Flink

Re: [PR] [FLINK-34961] Use dedicated CI name for Opensearch connector to differentiate it in infra-reports [flink-connector-opensearch]

2024-04-15 Thread via GitHub
snuyanzin merged PR #43: URL: https://github.com/apache/flink-connector-opensearch/pull/43 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubs

[jira] [Commented] (FLINK-32645) Flink pulsar sink is having poor performance

2024-04-15 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837162#comment-17837162 ] Yufan Sheng commented on FLINK-32645: - [~tison] I think we can close this issue now.

[jira] [Resolved] (FLINK-32645) Flink pulsar sink is having poor performance

2024-04-15 Thread Zili Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zili Chen resolved FLINK-32645. --- Resolution: Fixed > Flink pulsar sink is having poor performance > -

Re: [PR] [FLINK-25537][JUnit5 Migration] Module: flink-core with,Package: Configuration [flink]

2024-04-15 Thread via GitHub
Jiabao-Sun commented on code in PR #24612: URL: https://github.com/apache/flink/pull/24612#discussion_r1565548513 ## flink-core/src/test/java/org/apache/flink/configuration/MemorySizePrettyPrintingTest.java: ## @@ -45,13 +46,13 @@ public static Object[][] parameters() {

Re: [PR] Fix pubsub topic name javadoc [flink-connector-gcp-pubsub]

2024-04-15 Thread via GitHub
snuyanzin commented on PR #23: URL: https://github.com/apache/flink-connector-gcp-pubsub/pull/23#issuecomment-2056554166 ci fails because of dependency convergence issue which is going to be fixed within https://github.com/apache/flink-connector-gcp-pubsub/pull/24 -- This is an autom

Re: [PR] [FLINK-34961][BP v.1.1] Use dedicated CI name for Opensearch connector to differentiate it in infra-reports [flink-connector-opensearch]

2024-04-15 Thread via GitHub
snuyanzin merged PR #44: URL: https://github.com/apache/flink-connector-opensearch/pull/44 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubs

Re: [PR] [FLINK-25537][JUnit5 Migration] Module: flink-core with,Package: Configuration [flink]

2024-04-15 Thread via GitHub
GOODBOY008 commented on code in PR #24612: URL: https://github.com/apache/flink/pull/24612#discussion_r1565637869 ## flink-core/src/test/java/org/apache/flink/configuration/ReadableWritableConfigurationTest.java: ## @@ -169,7 +170,7 @@ void testGetOptionalFromObject() {

Re: [PR] [FLINK-25537][JUnit5 Migration] Module: flink-core with,Package: Configuration [flink]

2024-04-15 Thread via GitHub
GOODBOY008 commented on code in PR #24612: URL: https://github.com/apache/flink/pull/24612#discussion_r1565642234 ## flink-core/src/test/java/org/apache/flink/configuration/GlobalConfigurationTest.java: ## @@ -42,57 +42,48 @@ class GlobalConfigurationTest { @TempDir private

Re: [PR] [FLINK-25537][JUnit5 Migration] Module: flink-core with,Package: Configuration [flink]

2024-04-15 Thread via GitHub
GOODBOY008 commented on code in PR #24612: URL: https://github.com/apache/flink/pull/24612#discussion_r1565637869 ## flink-core/src/test/java/org/apache/flink/configuration/ReadableWritableConfigurationTest.java: ## @@ -169,7 +170,7 @@ void testGetOptionalFromObject() {

[PR] [FLINK-34961] Use dedicated CI name for Pulsar connector to differentiate it in infra-reports [flink-connector-pulsar]

2024-04-15 Thread via GitHub
snuyanzin opened a new pull request, #89: URL: https://github.com/apache/flink-connector-pulsar/pull/89 ## Purpose of the change The PR will allow to differentiate between Pulsar connector statistics and others with name ci ## Brief change log GHA name change

[PR] [FLINK-35108] Do not trigger deployment recovery for finished/failed jobs [flink-kubernetes-operator]

2024-04-15 Thread via GitHub
gyfora opened a new pull request, #815: URL: https://github.com/apache/flink-kubernetes-operator/pull/815 ## What is the purpose of the change The deployment recovery mechanism is incorrectly triggered for terminal jobs once the JM deployment is deleted after the TTL period. Th

[jira] [Updated] (FLINK-35108) Deployment recovery is triggered on terminal jobs after jm shutdown ttl

2024-04-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35108: --- Labels: pull-request-available (was: ) > Deployment recovery is triggered on terminal jobs

Re: [PR] [FLINK-34947] Only scale down JM in Foreground deletion propagation and reduce timeout [flink-kubernetes-operator]

2024-04-15 Thread via GitHub
gyfora merged PR #806: URL: https://github.com/apache/flink-kubernetes-operator/pull/806 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr

Re: [PR] [FLINK-30388] Move Lazy Initialization of AWS element converters to SinkWriter open() method [flink-connector-aws]

2024-04-15 Thread via GitHub
dannycranmer merged PR #135: URL: https://github.com/apache/flink-connector-aws/pull/135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr

[jira] [Resolved] (FLINK-30388) Add support for ElementConverted open() method for KDS/KDF/DDB

2024-04-15 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer resolved FLINK-30388. --- Resolution: Fixed > Add support for ElementConverted open() method for KDS/KDF/DDB > ---

[jira] [Commented] (FLINK-30388) Add support for ElementConverted open() method for KDS/KDF/DDB

2024-04-15 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837204#comment-17837204 ] Danny Cranmer commented on FLINK-30388: --- Merged commit [{{8cafbbc}}|https://githu

[jira] [Updated] (FLINK-35113) Bump org.apache.commons:commons-compress from 1.25.0 to 1.26.1 for Flink AWS connectors

2024-04-15 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-35113: -- Fix Version/s: aws-connector-4.3.0 (was: kafka-4.0.0)

  1   2   3   >