[jira] [Updated] (FLINK-35905) Flink physical operator replacement support

2024-07-29 Thread Wang Qilong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Qilong updated FLINK-35905: Description: Does Flinksql provide some SPI implementations that support custom physical operators

Re: [PR] [docs][minor] Add transform piece for pipeline example [flink-cdc]

2024-07-29 Thread via GitHub
leonardBang merged PR #3496: URL: https://github.com/apache/flink-cdc/pull/3496 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Updated] (FLINK-35921) Flink SQL physical operator replacement support

2024-07-29 Thread Wang Qilong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Qilong updated FLINK-35921: Description:   Does Flinksql provide some SPI implementations that support custom physical opera

[jira] [Updated] (FLINK-35905) Flink physical operator replacement support

2024-07-29 Thread Wang Qilong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Qilong updated FLINK-35905: Description: Does Flinksql provide some SPI implementations that support custom physical operators

[jira] [Updated] (FLINK-35921) Flink SQL physical operator replacement support

2024-07-29 Thread Wang Qilong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Qilong updated FLINK-35921: Description:   Does Flinksql provide some SPI implementations that support custom physical opera

[jira] [Commented] (FLINK-35905) Flink physical operator replacement support

2024-07-29 Thread Wang Qilong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869537#comment-17869537 ] Wang Qilong commented on FLINK-35905: - Thank you for your reply. We would like to ad

[jira] [Assigned] (FLINK-35893) Add state compatibility for Serializer of TableChangeInfo

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-35893: -- Assignee: LvYanquan (was: yux) > Add state compatibility for Serializer of TableChangeInfo

[jira] [Assigned] (FLINK-34638) Support default value of table column.

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-34638: -- Assignee: LvYanquan > Support default value of table column. > --

Re: [PR] [FLINK-35893][cdc-connector][paimon] support dynamic bucket. [flink-cdc]

2024-07-29 Thread via GitHub
leonardBang commented on PR #3499: URL: https://github.com/apache/flink-cdc/pull/3499#issuecomment-2257532560 The issue id is wrong, plz correct it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Assigned] (FLINK-35893) Add state compatibility for Serializer of TableChangeInfo

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-35893: -- Assignee: yux > Add state compatibility for Serializer of TableChangeInfo >

[jira] [Updated] (FLINK-35220) the error of mysql cdc

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-35220: --- Priority: Major (was: Blocker) > the error of mysql cdc > --- > >

Re: [PR] FLINK-35924: delay the SplitReader closure to until all the emitted records are processed. [flink]

2024-07-29 Thread via GitHub
flinkbot commented on PR #25130: URL: https://github.com/apache/flink/pull/25130#issuecomment-2257502590 ## CI report: * 962860ef286f7e3bf626245c2385aeb50318fb66 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-07-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35924: --- Labels: pull-request-available (was: ) > Improve the SourceReaderBase to support the Record

[PR] FLINK-35924: delay the SplitReader closure to until all the emitted records are processed. [flink]

2024-07-29 Thread via GitHub
becketqin opened a new pull request, #25130: URL: https://github.com/apache/flink/pull/25130 ## What is the purpose of the change This patch changes the `SplitFetcher` in the base implementation of the new source to delay the closure of `SplitReader` to until all the previous emitted

[jira] [Commented] (FLINK-35628) Translate “DataGen Connector" of "DataStream Connectors" into Chinese

2024-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-35628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869510#comment-17869510 ] 毛新伟 commented on FLINK-35628: - solved > Translate “DataGen Connector" of "DataStream Connec

Re: [PR] [FLINK-35925] remove hive connector from main repo [flink]

2024-07-29 Thread via GitHub
flinkbot commented on PR #25129: URL: https://github.com/apache/flink/pull/25129#issuecomment-2257435045 ## CI report: * 5f29ae2b88162260f5d6b7414172bb2434ea8be5 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35925) Remove hive connector from Flink main repo

2024-07-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35925: --- Labels: pull-request-available (was: ) > Remove hive connector from Flink main repo > -

[PR] [FLINK-35925] remove hive connector from main repo [flink]

2024-07-29 Thread via GitHub
HuangZhenQiu opened a new pull request, #25129: URL: https://github.com/apache/flink/pull/25129 ## What is the purpose of the change Remove hive connector from main repo as it is moved to standalone hive connector repo. ## Brief change log - Clean hive related mod

[jira] [Updated] (FLINK-35925) Remove hive connector from Flink main repo

2024-07-29 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-35925: -- Description: Given we have moved hive connector to standalone repo, we should remove the it f

[jira] [Created] (FLINK-35925) Remove hive connector from Flink main repo

2024-07-29 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-35925: - Summary: Remove hive connector from Flink main repo Key: FLINK-35925 URL: https://issues.apache.org/jira/browse/FLINK-35925 Project: Flink Issue Type: Tech

[jira] (FLINK-35220) the error of mysql cdc

2024-07-29 Thread wangkang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35220 ] wangkang deleted comment on FLINK-35220: -- was (Author: wangkang): I encountered a similar problem, have you solved it now? > the error of mysql cdc > --- > >

[jira] [Commented] (FLINK-33696) FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

2024-07-29 Thread Yubin Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869503#comment-17869503 ] Yubin Li commented on FLINK-33696: -- Is there any progress? looking forward to such valu

[jira] [Updated] (FLINK-35920) Add PRINTF function

2024-07-29 Thread Dylan He (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dylan He updated FLINK-35920: - Description: Add PRINTF function as the same in Spark & Hive. Returns a formatted string from print

[jira] [Updated] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thorne updated FLINK-35919: --- Description: !image-2024-07-30-11-37-11-346.png!  op_type option is easier to understand  was:op_type op

[jira] [Updated] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thorne updated FLINK-35919: --- Attachment: image-2024-07-30-11-37-11-346.png > The rowkind keyword option for MySQL connector metadata shou

[jira] [Resolved] (FLINK-33386) Support tasks balancing at slot level for Default Scheduler

2024-07-29 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan resolved FLINK-33386. - Fix Version/s: 2.0.0 Resolution: Fixed > Support tasks balancing at slot level for Default Schedu

[jira] [Commented] (FLINK-33386) Support tasks balancing at slot level for Default Scheduler

2024-07-29 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869497#comment-17869497 ] Rui Fan commented on FLINK-33386: - Merged to master(2.0.0) via: 76049d09e40a82f1222ed8a2

Re: [PR] [FLINK-33386][runtime] Support tasks balancing at slot level for Default Scheduler [flink]

2024-07-29 Thread via GitHub
1996fanrui merged PR #23635: URL: https://github.com/apache/flink/pull/23635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.ap

[jira] [Commented] (FLINK-35905) Flink physical operator replacement support

2024-07-29 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869486#comment-17869486 ] xuyang commented on FLINK-35905: Furthermore, I think this is not a bug, at most an impr

[jira] [Commented] (FLINK-35905) Flink physical operator replacement support

2024-07-29 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869485#comment-17869485 ] xuyang commented on FLINK-35905: A short answer: No. What is the reason and background

[jira] [Commented] (FLINK-35220) the error of mysql cdc

2024-07-29 Thread wangkang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869482#comment-17869482 ] wangkang commented on FLINK-35220: -- I encountered a similar problem, have you solved it

[jira] [Updated] (FLINK-35736) Add E2e migration scripts for Flink CDC

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-35736: --- Fix Version/s: cdc-3.2.0 > Add E2e migration scripts for Flink CDC > ---

[jira] [Assigned] (FLINK-35736) Add E2e migration scripts for Flink CDC

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-35736: -- Assignee: yux (was: Leonard Xu) > Add E2e migration scripts for Flink CDC >

[jira] [Resolved] (FLINK-35736) Add E2e migration scripts for Flink CDC

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-35736. Resolution: Implemented via master: 5917f787040cf39dcf51ecfc7605597aa89feb65 > Add E2e migration

[jira] [Updated] (FLINK-35736) Add E2e migration scripts for Flink CDC

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-35736: --- Affects Version/s: cdc-3.1.1 > Add E2e migration scripts for Flink CDC > ---

Re: [PR] [FLINK-35736][tests] Add migration test scripts & CI workflows [flink-cdc]

2024-07-29 Thread via GitHub
leonardBang merged PR #3447: URL: https://github.com/apache/flink-cdc/pull/3447 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Assigned] (FLINK-35736) Add E2e migration scripts for Flink CDC

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-35736: -- Assignee: Leonard Xu > Add E2e migration scripts for Flink CDC >

[PR] hotfix: using reflection to resolve constructor conflicts [flink-connector-jdbc]

2024-07-29 Thread via GitHub
whhe opened a new pull request, #134: URL: https://github.com/apache/flink-connector-jdbc/pull/134 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscri

Re: [PR] [FLINK-30481][FLIP-277] GlueCatalog Implementation [flink-connector-aws]

2024-07-29 Thread via GitHub
foxus commented on PR #47: URL: https://github.com/apache/flink-connector-aws/pull/47#issuecomment-2257035809 > Thank you @foxus for the review . > > this PR was opened long ago. Let me try to address all the comments and test it again e2e . > > this PR will be ready for rev

Re: [PR] [FLINK-34440][formats][protobuf-confluent] Protobuf confluent dynamic format [flink]

2024-07-29 Thread via GitHub
klam-shop commented on PR #25114: URL: https://github.com/apache/flink/pull/25114#issuecomment-2256927532 @rmetzger @anupamaggarwal do you have time to review? Since you were involved in the Protobuf Confluent Format discussions earlier. -- This is an automated message from the Apache Gi

Re: [PR] [FLINK-35847][release] Add release note for version 1.20 [flink]

2024-07-29 Thread via GitHub
Samrat002 commented on code in PR #25091: URL: https://github.com/apache/flink/pull/25091#discussion_r1695742537 ## docs/content.zh/release-notes/flink-1.20.md: ## @@ -0,0 +1,433 @@ +--- +title: "Release Notes - Flink 1.20" +--- + + +# Release notes - Flink 1.20 + +These release

[jira] [Updated] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-07-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-35924: - Fix Version/s: 2.0.0 > Improve the SourceReaderBase to support the RecordsWithSplitIds share >

[jira] [Updated] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-07-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-35924: - Description: Recently, we saw corrupted {{RecordsWithSplitIds}} in one of our Iceberg source im

[jira] [Assigned] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-07-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-35924: Assignee: Jiangjie Qin > Improve the SourceReaderBase to support the RecordsWithSplitIds

[jira] [Created] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-07-29 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-35924: Summary: Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader. Key: FLINK-35924 URL: https://issues.apache.org/jira/browse/FLINK-

[jira] [Created] (FLINK-35923) Add CompiledPlan annotations to BatchExecSort

2024-07-29 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35923: -- Summary: Add CompiledPlan annotations to BatchExecSort Key: FLINK-35923 URL: https://issues.apache.org/jira/browse/FLINK-35923 Project: Flink Issue Type: Sub-tas

[jira] [Resolved] (FLINK-35798) Implement a BatchRestoreTestBase

2024-07-29 Thread Jim Hughes (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Hughes resolved FLINK-35798. Fix Version/s: 2.0.0 Resolution: Fixed > Implement a BatchRestoreTestBase > ---

[jira] [Updated] (FLINK-35798) Implement a BatchRestoreTestBase

2024-07-29 Thread Jim Hughes (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Hughes updated FLINK-35798: --- Description: * The goal of BatchRestoreTestBase has two goals: 1. Take TableTestPrograms and produce

[jira] [Updated] (FLINK-35798) Implement a BatchRestoreTestBase

2024-07-29 Thread Jim Hughes (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Hughes updated FLINK-35798: --- Summary: Implement a BatchRestoreTestBase (was: Implement a BatchCompiledPlanTestBase) > Implement

[jira] [Commented] (FLINK-35798) Implement a BatchRestoreTestBase

2024-07-29 Thread Jim Hughes (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869414#comment-17869414 ] Jim Hughes commented on FLINK-35798: This was implemented in https://github.com/apa

Re: [PR] [FLINK-26351][k8s/web ui] After scaling a flink task running on k8s, … [flink]

2024-07-29 Thread via GitHub
qiunanx closed pull request #18915: [FLINK-26351][k8s/web ui] After scaling a flink task running on k8s, … URL: https://github.com/apache/flink/pull/18915 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] [FLINK-25413][filesystems] Use append dfs.nameservices hadoop config to replace override [flink]

2024-07-29 Thread via GitHub
qiunanx closed pull request #18187: [FLINK-25413][filesystems] Use append dfs.nameservices hadoop config to replace override URL: https://github.com/apache/flink/pull/18187 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Created] (FLINK-35922) Add configuration options related to hive

2024-07-29 Thread Qiu (Jira)
Qiu created FLINK-35922: --- Summary: Add configuration options related to hive Key: FLINK-35922 URL: https://issues.apache.org/jira/browse/FLINK-35922 Project: Flink Issue Type: Improvement Com

Re: [PR] [FLINK-22748] Allow dynamic target topic selection in SQL Kafka sinks [flink-connector-kafka]

2024-07-29 Thread via GitHub
klam-shop commented on code in PR #109: URL: https://github.com/apache/flink-connector-kafka/pull/109#discussion_r1695246585 ## flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/table/KafkaConnectorOptions.java: ## @@ -118,8 +118,8 @@ public class

Re: [PR] [FLINK-22748] Allow dynamic target topic selection in SQL Kafka sinks [flink-connector-kafka]

2024-07-29 Thread via GitHub
klam-shop commented on code in PR #109: URL: https://github.com/apache/flink-connector-kafka/pull/109#discussion_r1695246585 ## flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/table/KafkaConnectorOptions.java: ## @@ -118,8 +118,8 @@ public class

Re: [PR] [FLINK-22748] Allow dynamic target topic selection in SQL Kafka sinks [flink-connector-kafka]

2024-07-29 Thread via GitHub
klam-shop commented on code in PR #109: URL: https://github.com/apache/flink-connector-kafka/pull/109#discussion_r1695244304 ## flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/table/DynamicKafkaRecordSerializationSchema.java: ## @@ -144,14 +147,3

Re: [PR] [FLINK-22748] Allow dynamic target topic selection in SQL Kafka sinks [flink-connector-kafka]

2024-07-29 Thread via GitHub
klam-shop commented on code in PR #109: URL: https://github.com/apache/flink-connector-kafka/pull/109#discussion_r1695240882 ## flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/table/KafkaDynamicSink.java: ## @@ -251,6 +251,8 @@ public DataStreamS

[jira] [Commented] (FLINK-35898) When running Flink on Yarn, if the log file path contains a space, the startup will fail.

2024-07-29 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869333#comment-17869333 ] Ferenc Csaky commented on FLINK-35898: -- AFAIK what you describe cannot happen. The

Re: [PR] [FLINK-35660] Adding parent-child shard ordering for DDB Streams source [flink-connector-aws]

2024-07-29 Thread via GitHub
karubian commented on code in PR #151: URL: https://github.com/apache/flink-connector-aws/pull/151#discussion_r1694985819 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/enumerator/DynamoDbStreamsSourceEnumerator.java: ##

[jira] [Created] (FLINK-35921) Flink SQL physical operator replacement support

2024-07-29 Thread Wang Qilong (Jira)
Wang Qilong created FLINK-35921: --- Summary: Flink SQL physical operator replacement support Key: FLINK-35921 URL: https://issues.apache.org/jira/browse/FLINK-35921 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-35907) Inconsistent handling of bit and bit(n) types in Flink CDC PostgreSQL Connector

2024-07-29 Thread jiangcheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangcheng updated FLINK-35907: --- Environment: I use the following maven settings. {code:java}     com.ververica     flink-connector-

[jira] [Updated] (FLINK-35906) Inconsistent timestamp precision handling in Flink CDC PostgreSQL Connector

2024-07-29 Thread jiangcheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangcheng updated FLINK-35906: --- Description: I have encountered an inconsistency issue with the Flink CDC PostgreSQL Connector when

[jira] [Created] (FLINK-35920) Add PRINTF function

2024-07-29 Thread Dylan He (Jira)
Dylan He created FLINK-35920: Summary: Add PRINTF function Key: FLINK-35920 URL: https://issues.apache.org/jira/browse/FLINK-35920 Project: Flink Issue Type: Sub-task Components: Table

[jira] [Comment Edited] (FLINK-35913) The issue of using StreamExecutioneEnvironment to execute multiple jobs in a program on Flink CDC

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869289#comment-17869289 ] Thorne edited comment on FLINK-35913 at 7/29/24 11:19 AM: -- I do

[jira] [Updated] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thorne updated FLINK-35919: --- Description: op_type option is easier to understand  (was: The op_type option is easier to understand ) >

[jira] [Updated] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thorne updated FLINK-35919: --- Description: The op_type option is easier to understand > The rowkind keyword option for MySQL connector met

[jira] [Updated] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thorne updated FLINK-35919: --- Description: The op_type option is easier to understand  (was: The op_type option is easier to understand)

[jira] [Updated] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thorne updated FLINK-35919: --- Summary: The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword (was:

[jira] [Created] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to the op_type keyword

2024-07-29 Thread Thorne (Jira)
Thorne created FLINK-35919: -- Summary: The rowkind keyword option for MySQL connector metadata should be changed to the op_type keyword Key: FLINK-35919 URL: https://issues.apache.org/jira/browse/FLINK-35919

[jira] [Commented] (FLINK-35914) Flink 1.18 runtime not supporting java 17

2024-07-29 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869319#comment-17869319 ] Ahmed Hamdy commented on FLINK-35914: - [~sushil_karwasra]  you could check [https://

[jira] [Created] (FLINK-35918) Migrate the Time to Duration for the flink-runtime module.

2024-07-29 Thread RocMarshal (Jira)
RocMarshal created FLINK-35918: -- Summary: Migrate the Time to Duration for the flink-runtime module. Key: FLINK-35918 URL: https://issues.apache.org/jira/browse/FLINK-35918 Project: Flink Issue

[jira] [Commented] (FLINK-35914) Flink 1.18 runtime not supporting java 17

2024-07-29 Thread sushil_karwasra (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869295#comment-17869295 ] sushil_karwasra commented on FLINK-35914: - [~chalixar] can you please let me kno

Re: [PR] [FLINK-35628][Documentation] Provide a Chinese translation of datagen.md [flink]

2024-07-29 Thread via GitHub
flinkbot commented on PR #25128: URL: https://github.com/apache/flink/pull/25128#issuecomment-2255484076 ## CI report: * 3aa7d57b9c7eff3a2c605c60013c23aaa0d8a92a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35628) Translate “DataGen Connector" of "DataStream Connectors" into Chinese

2024-07-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35628: --- Labels: pull-request-available (was: ) > Translate “DataGen Connector" of "DataStream Conne

[jira] [Commented] (FLINK-35913) The issue of using StreamExecutioneEnvironment to execute multiple jobs in a program on Flink CDC

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869289#comment-17869289 ] Thorne commented on FLINK-35913: I don't recommend  that starting  a flink's job with sp

[jira] [Comment Edited] (FLINK-35909) JdbcFilterPushdownPreparedStatementVisitorTest fails

2024-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-35909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869284#comment-17869284 ] João Boto edited comment on FLINK-35909 at 7/29/24 9:33 AM:

[jira] [Comment Edited] (FLINK-35909) JdbcFilterPushdownPreparedStatementVisitorTest fails

2024-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-35909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869284#comment-17869284 ] João Boto edited comment on FLINK-35909 at 7/29/24 9:32 AM:

[PR] feature: Provide a Chinese translation of datagen.md [flink]

2024-07-29 Thread via GitHub
BigDataMao opened a new pull request, #25128: URL: https://github.com/apache/flink/pull/25128 ## What is the purpose of the change Provide a Chinese translation of datagen.md ## Verifying this change Please make sure both new and modified tests in this PR foll

[jira] [Commented] (FLINK-35909) JdbcFilterPushdownPreparedStatementVisitorTest fails

2024-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-35909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869284#comment-17869284 ] João Boto commented on FLINK-35909: --- [~linshangquan], [~Leonard] can you help here? I

[jira] [Updated] (FLINK-35909) JdbcFilterPushdownPreparedStatementVisitorTest fails

2024-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-35909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto updated FLINK-35909: -- Attachment: screenshot-2.png > JdbcFilterPushdownPreparedStatementVisitorTest fails >

[jira] [Assigned] (FLINK-22059) add a new option is rocksdb statebackend to enable job threads setting

2024-07-29 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi reassigned FLINK-22059: - Assignee: zhongyou.lee (was: xiaogang zhou) > add a new option is rocksdb statebackend

Re: [PR] [FLINK-34876][transform] Support UDF functions in transform [flink-cdc]

2024-07-29 Thread via GitHub
ruanhang1993 commented on code in PR #3465: URL: https://github.com/apache/flink-cdc/pull/3465#discussion_r1694814738 ## flink-cdc-runtime/src/test/java/org/apache/flink/cdc/runtime/parser/JaninoCompilerTest.java: ## @@ -118,7 +119,7 @@ public void testJaninoTimestampFunction()

Re: [PR] [FLINK-34853] Draft: Submit CDC Job To Flink K8S Native Application Mode [flink-cdc]

2024-07-29 Thread via GitHub
yuxiqian commented on code in PR #3093: URL: https://github.com/apache/flink-cdc/pull/3093#discussion_r1677720046 ## Dockerfile: ## @@ -0,0 +1,33 @@ +#/* +# * Licensed to the Apache Software Foundation (ASF) under one or more +# * contributor license agreements. See the NOTICE

Re: [PR] [FLINK-35910][Table SQL / API] Add BTRIM function [flink]

2024-07-29 Thread via GitHub
dylanhz commented on PR #25127: URL: https://github.com/apache/flink/pull/25127#issuecomment-2255392100 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] [FLINK-34853] Draft: Submit CDC Job To Flink K8S Native Application Mode [flink-cdc]

2024-07-29 Thread via GitHub
yuxiqian commented on code in PR #3093: URL: https://github.com/apache/flink-cdc/pull/3093#discussion_r1677720046 ## Dockerfile: ## @@ -0,0 +1,33 @@ +#/* +# * Licensed to the Apache Software Foundation (ASF) under one or more +# * contributor license agreements. See the NOTICE

[jira] [Updated] (FLINK-35917) Failed to deserialize data of EventHeaderV4

2024-07-29 Thread wangkang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangkang updated FLINK-35917: - Description: I tried to upgrade flink cdc version  to 3.1.x in paimon   [https://github.com/apache/paimo

[jira] [Assigned] (FLINK-35391) Bump dependency of Paimon Pipeline connector to 0.8.0

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-35391: -- Assignee: wangjunbo > Bump dependency of Paimon Pipeline connector to 0.8.0 > ---

[jira] [Resolved] (FLINK-35391) Bump dependency of Paimon Pipeline connector to 0.8.0

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-35391. Resolution: Implemented Implemented in master(3.2-SNAOSHOT) via b15a226ccdb485822a604c3bd441e6bb0a

Re: [PR] [FLINK-35391][cdc-connector][paimon] Bump dependency of Paimon Pipeline connector to 0.8.0 [flink-cdc]

2024-07-29 Thread via GitHub
leonardBang merged PR #3335: URL: https://github.com/apache/flink-cdc/pull/3335 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Commented] (FLINK-35914) Flink 1.18 runtime not supporting java 17

2024-07-29 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869271#comment-17869271 ] Ahmed Hamdy commented on FLINK-35914: - [~sushil_karwasra] I believe it might be bett

Re: [PR] [FLINK-34572] Support OceanBase Jdbc Catalog [flink-connector-jdbc]

2024-07-29 Thread via GitHub
whhe commented on PR #109: URL: https://github.com/apache/flink-connector-jdbc/pull/109#issuecomment-2255336080 > @whhe can you rebase please, and move the related code to the new OceanBase module. we just merge a part of [FLIP-449](https://cwiki.apache.org/confluence/display/FLINK/FLIP-44

[jira] [Updated] (FLINK-35917) Failed to deserialize data of EventHeaderV4

2024-07-29 Thread wangkang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangkang updated FLINK-35917: - Attachment: FLINK-35917.txt > Failed to deserialize data of EventHeaderV4 >

Re: [PR] [FLINK-34572] Support OceanBase Jdbc Catalog [flink-connector-jdbc]

2024-07-29 Thread via GitHub
eskabetxe commented on PR #109: URL: https://github.com/apache/flink-connector-jdbc/pull/109#issuecomment-2255329759 @whhe can you rebase please, and move the related code to the new OceanBase module. we just merge a part of [FLIP-449](https://cwiki.apache.org/confluence/display/FLINK/F

[jira] [Assigned] (FLINK-35909) JdbcFilterPushdownPreparedStatementVisitorTest fails

2024-07-29 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan reassigned FLINK-35909: --- Assignee: João Boto > JdbcFilterPushdownPreparedStatementVisitorTest fails > --

[jira] [Commented] (FLINK-35909) JdbcFilterPushdownPreparedStatementVisitorTest fails

2024-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-35909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869267#comment-17869267 ] João Boto commented on FLINK-35909: --- [~fanrui] sure, can you assign it to me? as I ca

[jira] [Updated] (FLINK-35917) Failed to deserialize data of EventHeaderV4

2024-07-29 Thread wangkang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangkang updated FLINK-35917: - Description: I tried to upgrade flink cdc version  to 3.1.x in paimon   [https://github.com/apache/paimo

[jira] [Updated] (FLINK-35909) JdbcFilterPushdownPreparedStatementVisitorTest fails

2024-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-35909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto updated FLINK-35909: -- Attachment: screenshot-1.png > JdbcFilterPushdownPreparedStatementVisitorTest fails >

[jira] [Updated] (FLINK-35893) Add state compatibility for Serializer of TableChangeInfo

2024-07-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35893: --- Labels: pull-request-available (was: ) > Add state compatibility for Serializer of TableCha

[jira] [Created] (FLINK-35917) Failed to deserialize data of EventHeaderV4

2024-07-29 Thread wangkang (Jira)
wangkang created FLINK-35917: Summary: Failed to deserialize data of EventHeaderV4 Key: FLINK-35917 URL: https://issues.apache.org/jira/browse/FLINK-35917 Project: Flink Issue Type: Bug

Re: [PR] [FLINK-35432]Support catch modify event for the mysql. [flink-cdc]

2024-07-29 Thread via GitHub
ruanhang1993 commented on code in PR #3352: URL: https://github.com/apache/flink-cdc/pull/3352#discussion_r1694788416 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/src/main/java/org/apache/flink/cdc/connectors/mysql/source/parser/CustomAlterTableP

  1   2   >