Re: [PR] FLINK-35924: delay the SplitReader closure to until all the emitted records are processed. [flink]

2024-07-29 Thread via GitHub
flinkbot commented on PR #25130: URL: https://github.com/apache/flink/pull/25130#issuecomment-2257502590 ## CI report: * 962860ef286f7e3bf626245c2385aeb50318fb66 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-07-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35924: --- Labels: pull-request-available (was: ) > Improve the SourceReaderBase to support the

[PR] FLINK-35924: delay the SplitReader closure to until all the emitted records are processed. [flink]

2024-07-29 Thread via GitHub
becketqin opened a new pull request, #25130: URL: https://github.com/apache/flink/pull/25130 ## What is the purpose of the change This patch changes the `SplitFetcher` in the base implementation of the new source to delay the closure of `SplitReader` to until all the previous emitted

[jira] [Commented] (FLINK-35628) Translate “DataGen Connector" of "DataStream Connectors" into Chinese

2024-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-35628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869510#comment-17869510 ] 毛新伟 commented on FLINK-35628: - solved > Translate “DataGen Connector" of "DataStream Connectors" into

Re: [PR] [FLINK-35925] remove hive connector from main repo [flink]

2024-07-29 Thread via GitHub
flinkbot commented on PR #25129: URL: https://github.com/apache/flink/pull/25129#issuecomment-2257435045 ## CI report: * 5f29ae2b88162260f5d6b7414172bb2434ea8be5 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35925) Remove hive connector from Flink main repo

2024-07-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35925: --- Labels: pull-request-available (was: ) > Remove hive connector from Flink main repo >

[PR] [FLINK-35925] remove hive connector from main repo [flink]

2024-07-29 Thread via GitHub
HuangZhenQiu opened a new pull request, #25129: URL: https://github.com/apache/flink/pull/25129 ## What is the purpose of the change Remove hive connector from main repo as it is moved to standalone hive connector repo. ## Brief change log - Clean hive related

[jira] [Updated] (FLINK-35925) Remove hive connector from Flink main repo

2024-07-29 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-35925: -- Description: Given we have moved hive connector to standalone repo, we should remove the it

[jira] [Created] (FLINK-35925) Remove hive connector from Flink main repo

2024-07-29 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-35925: - Summary: Remove hive connector from Flink main repo Key: FLINK-35925 URL: https://issues.apache.org/jira/browse/FLINK-35925 Project: Flink Issue Type:

[jira] (FLINK-35220) the error of mysql cdc

2024-07-29 Thread wangkang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35220 ] wangkang deleted comment on FLINK-35220: -- was (Author: wangkang): I encountered a similar problem, have you solved it now? > the error of mysql cdc > --- > >

[jira] [Commented] (FLINK-33696) FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

2024-07-29 Thread Yubin Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869503#comment-17869503 ] Yubin Li commented on FLINK-33696: -- Is there any progress? looking forward to such valuable feature. >

[jira] [Updated] (FLINK-35920) Add PRINTF function

2024-07-29 Thread Dylan He (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dylan He updated FLINK-35920: - Description: Add PRINTF function as the same in Spark & Hive. Returns a formatted string from

[jira] [Updated] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thorne updated FLINK-35919: --- Description: !image-2024-07-30-11-37-11-346.png!  op_type option is easier to understand  was:op_type

[jira] [Updated] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thorne updated FLINK-35919: --- Attachment: image-2024-07-30-11-37-11-346.png > The rowkind keyword option for MySQL connector metadata

[jira] [Resolved] (FLINK-33386) Support tasks balancing at slot level for Default Scheduler

2024-07-29 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan resolved FLINK-33386. - Fix Version/s: 2.0.0 Resolution: Fixed > Support tasks balancing at slot level for Default

[jira] [Commented] (FLINK-33386) Support tasks balancing at slot level for Default Scheduler

2024-07-29 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869497#comment-17869497 ] Rui Fan commented on FLINK-33386: - Merged to master(2.0.0) via: 76049d09e40a82f1222ed8a2e8279eda183f43f5

Re: [PR] [FLINK-33386][runtime] Support tasks balancing at slot level for Default Scheduler [flink]

2024-07-29 Thread via GitHub
1996fanrui merged PR #23635: URL: https://github.com/apache/flink/pull/23635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-35905) Flink physical operator replacement support

2024-07-29 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869486#comment-17869486 ] xuyang commented on FLINK-35905: Furthermore, I think this is not a bug, at most an improvement, right?

[jira] [Commented] (FLINK-35905) Flink physical operator replacement support

2024-07-29 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869485#comment-17869485 ] xuyang commented on FLINK-35905: A short answer: No. What is the reason and background for you to

[jira] [Commented] (FLINK-35220) the error of mysql cdc

2024-07-29 Thread wangkang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869482#comment-17869482 ] wangkang commented on FLINK-35220: -- I encountered a similar problem, have you solved it now? > the

[jira] [Updated] (FLINK-35736) Add E2e migration scripts for Flink CDC

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-35736: --- Fix Version/s: cdc-3.2.0 > Add E2e migration scripts for Flink CDC >

[jira] [Assigned] (FLINK-35736) Add E2e migration scripts for Flink CDC

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-35736: -- Assignee: yux (was: Leonard Xu) > Add E2e migration scripts for Flink CDC >

[jira] [Resolved] (FLINK-35736) Add E2e migration scripts for Flink CDC

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-35736. Resolution: Implemented via master: 5917f787040cf39dcf51ecfc7605597aa89feb65 > Add E2e migration

[jira] [Updated] (FLINK-35736) Add E2e migration scripts for Flink CDC

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-35736: --- Affects Version/s: cdc-3.1.1 > Add E2e migration scripts for Flink CDC >

Re: [PR] [FLINK-35736][tests] Add migration test scripts & CI workflows [flink-cdc]

2024-07-29 Thread via GitHub
leonardBang merged PR #3447: URL: https://github.com/apache/flink-cdc/pull/3447 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Assigned] (FLINK-35736) Add E2e migration scripts for Flink CDC

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-35736: -- Assignee: Leonard Xu > Add E2e migration scripts for Flink CDC >

[PR] hotfix: using reflection to resolve constructor conflicts [flink-connector-jdbc]

2024-07-29 Thread via GitHub
whhe opened a new pull request, #134: URL: https://github.com/apache/flink-connector-jdbc/pull/134 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [FLINK-30481][FLIP-277] GlueCatalog Implementation [flink-connector-aws]

2024-07-29 Thread via GitHub
foxus commented on PR #47: URL: https://github.com/apache/flink-connector-aws/pull/47#issuecomment-2257035809 > Thank you @foxus for the review . > > this PR was opened long ago. Let me try to address all the comments and test it again e2e . > > this PR will be ready for

Re: [PR] [FLINK-34440][formats][protobuf-confluent] Protobuf confluent dynamic format [flink]

2024-07-29 Thread via GitHub
klam-shop commented on PR #25114: URL: https://github.com/apache/flink/pull/25114#issuecomment-2256927532 @rmetzger @anupamaggarwal do you have time to review? Since you were involved in the Protobuf Confluent Format discussions earlier. -- This is an automated message from the Apache

Re: [PR] [FLINK-35847][release] Add release note for version 1.20 [flink]

2024-07-29 Thread via GitHub
Samrat002 commented on code in PR #25091: URL: https://github.com/apache/flink/pull/25091#discussion_r1695742537 ## docs/content.zh/release-notes/flink-1.20.md: ## @@ -0,0 +1,433 @@ +--- +title: "Release Notes - Flink 1.20" +--- + + +# Release notes - Flink 1.20 + +These

[jira] [Updated] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-07-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-35924: - Fix Version/s: 2.0.0 > Improve the SourceReaderBase to support the RecordsWithSplitIds share >

[jira] [Updated] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-07-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-35924: - Description: Recently, we saw corrupted {{RecordsWithSplitIds}} in one of our Iceberg source

[jira] [Assigned] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-07-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-35924: Assignee: Jiangjie Qin > Improve the SourceReaderBase to support the RecordsWithSplitIds

[jira] [Created] (FLINK-35924) Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader.

2024-07-29 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-35924: Summary: Improve the SourceReaderBase to support the RecordsWithSplitIds share internal buffer from SplitReader. Key: FLINK-35924 URL:

[jira] [Created] (FLINK-35923) Add CompiledPlan annotations to BatchExecSort

2024-07-29 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35923: -- Summary: Add CompiledPlan annotations to BatchExecSort Key: FLINK-35923 URL: https://issues.apache.org/jira/browse/FLINK-35923 Project: Flink Issue Type:

[jira] [Resolved] (FLINK-35798) Implement a BatchRestoreTestBase

2024-07-29 Thread Jim Hughes (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Hughes resolved FLINK-35798. Fix Version/s: 2.0.0 Resolution: Fixed > Implement a BatchRestoreTestBase >

[jira] [Updated] (FLINK-35798) Implement a BatchRestoreTestBase

2024-07-29 Thread Jim Hughes (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Hughes updated FLINK-35798: --- Description: * The goal of BatchRestoreTestBase has two goals: 1. Take TableTestPrograms and

[jira] [Updated] (FLINK-35798) Implement a BatchRestoreTestBase

2024-07-29 Thread Jim Hughes (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Hughes updated FLINK-35798: --- Summary: Implement a BatchRestoreTestBase (was: Implement a BatchCompiledPlanTestBase) >

[jira] [Commented] (FLINK-35798) Implement a BatchRestoreTestBase

2024-07-29 Thread Jim Hughes (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869414#comment-17869414 ] Jim Hughes commented on FLINK-35798: This was implemented in

Re: [PR] [FLINK-26351][k8s/web ui] After scaling a flink task running on k8s, … [flink]

2024-07-29 Thread via GitHub
qiunanx closed pull request #18915: [FLINK-26351][k8s/web ui] After scaling a flink task running on k8s, … URL: https://github.com/apache/flink/pull/18915 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [FLINK-25413][filesystems] Use append dfs.nameservices hadoop config to replace override [flink]

2024-07-29 Thread via GitHub
qiunanx closed pull request #18187: [FLINK-25413][filesystems] Use append dfs.nameservices hadoop config to replace override URL: https://github.com/apache/flink/pull/18187 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Created] (FLINK-35922) Add configuration options related to hive

2024-07-29 Thread Qiu (Jira)
Qiu created FLINK-35922: --- Summary: Add configuration options related to hive Key: FLINK-35922 URL: https://issues.apache.org/jira/browse/FLINK-35922 Project: Flink Issue Type: Improvement

Re: [PR] [FLINK-22748] Allow dynamic target topic selection in SQL Kafka sinks [flink-connector-kafka]

2024-07-29 Thread via GitHub
klam-shop commented on code in PR #109: URL: https://github.com/apache/flink-connector-kafka/pull/109#discussion_r1695246585 ## flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/table/KafkaConnectorOptions.java: ## @@ -118,8 +118,8 @@ public class

Re: [PR] [FLINK-22748] Allow dynamic target topic selection in SQL Kafka sinks [flink-connector-kafka]

2024-07-29 Thread via GitHub
klam-shop commented on code in PR #109: URL: https://github.com/apache/flink-connector-kafka/pull/109#discussion_r1695246585 ## flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/table/KafkaConnectorOptions.java: ## @@ -118,8 +118,8 @@ public class

Re: [PR] [FLINK-22748] Allow dynamic target topic selection in SQL Kafka sinks [flink-connector-kafka]

2024-07-29 Thread via GitHub
klam-shop commented on code in PR #109: URL: https://github.com/apache/flink-connector-kafka/pull/109#discussion_r1695244304 ## flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/table/DynamicKafkaRecordSerializationSchema.java: ## @@ -144,14

Re: [PR] [FLINK-22748] Allow dynamic target topic selection in SQL Kafka sinks [flink-connector-kafka]

2024-07-29 Thread via GitHub
klam-shop commented on code in PR #109: URL: https://github.com/apache/flink-connector-kafka/pull/109#discussion_r1695240882 ## flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/table/KafkaDynamicSink.java: ## @@ -251,6 +251,8 @@ public

[jira] [Commented] (FLINK-35898) When running Flink on Yarn, if the log file path contains a space, the startup will fail.

2024-07-29 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869333#comment-17869333 ] Ferenc Csaky commented on FLINK-35898: -- AFAIK what you describe cannot happen. The Yarn

Re: [PR] [FLINK-35660] Adding parent-child shard ordering for DDB Streams source [flink-connector-aws]

2024-07-29 Thread via GitHub
karubian commented on code in PR #151: URL: https://github.com/apache/flink-connector-aws/pull/151#discussion_r1694985819 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/enumerator/DynamoDbStreamsSourceEnumerator.java:

[jira] [Created] (FLINK-35921) Flink SQL physical operator replacement support

2024-07-29 Thread Wang Qilong (Jira)
Wang Qilong created FLINK-35921: --- Summary: Flink SQL physical operator replacement support Key: FLINK-35921 URL: https://issues.apache.org/jira/browse/FLINK-35921 Project: Flink Issue Type:

[jira] [Updated] (FLINK-35907) Inconsistent handling of bit and bit(n) types in Flink CDC PostgreSQL Connector

2024-07-29 Thread jiangcheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangcheng updated FLINK-35907: --- Environment: I use the following maven settings. {code:java}     com.ververica    

[jira] [Updated] (FLINK-35906) Inconsistent timestamp precision handling in Flink CDC PostgreSQL Connector

2024-07-29 Thread jiangcheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangcheng updated FLINK-35906: --- Description: I have encountered an inconsistency issue with the Flink CDC PostgreSQL Connector

[jira] [Created] (FLINK-35920) Add PRINTF function

2024-07-29 Thread Dylan He (Jira)
Dylan He created FLINK-35920: Summary: Add PRINTF function Key: FLINK-35920 URL: https://issues.apache.org/jira/browse/FLINK-35920 Project: Flink Issue Type: Sub-task Components: Table

[jira] [Comment Edited] (FLINK-35913) The issue of using StreamExecutioneEnvironment to execute multiple jobs in a program on Flink CDC

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869289#comment-17869289 ] Thorne edited comment on FLINK-35913 at 7/29/24 11:19 AM: -- I don't recommend  

[jira] [Updated] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thorne updated FLINK-35919: --- Description: op_type option is easier to understand  (was: The op_type option is easier to understand ) >

[jira] [Updated] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thorne updated FLINK-35919: --- Description: The op_type option is easier to understand > The rowkind keyword option for MySQL connector

[jira] [Updated] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thorne updated FLINK-35919: --- Description: The op_type option is easier to understand  (was: The op_type option is easier to understand)

[jira] [Updated] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thorne updated FLINK-35919: --- Summary: The rowkind keyword option for MySQL connector metadata should be changed to op_type keyword

[jira] [Created] (FLINK-35919) The rowkind keyword option for MySQL connector metadata should be changed to the op_type keyword

2024-07-29 Thread Thorne (Jira)
Thorne created FLINK-35919: -- Summary: The rowkind keyword option for MySQL connector metadata should be changed to the op_type keyword Key: FLINK-35919 URL: https://issues.apache.org/jira/browse/FLINK-35919

[jira] [Commented] (FLINK-35914) Flink 1.18 runtime not supporting java 17

2024-07-29 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869319#comment-17869319 ] Ahmed Hamdy commented on FLINK-35914: - [~sushil_karwasra]  you could check

[jira] [Created] (FLINK-35918) Migrate the Time to Duration for the flink-runtime module.

2024-07-29 Thread RocMarshal (Jira)
RocMarshal created FLINK-35918: -- Summary: Migrate the Time to Duration for the flink-runtime module. Key: FLINK-35918 URL: https://issues.apache.org/jira/browse/FLINK-35918 Project: Flink Issue

[jira] [Commented] (FLINK-35914) Flink 1.18 runtime not supporting java 17

2024-07-29 Thread sushil_karwasra (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869295#comment-17869295 ] sushil_karwasra commented on FLINK-35914: - [~chalixar] can you please let me know how to reach

Re: [PR] [FLINK-35628][Documentation] Provide a Chinese translation of datagen.md [flink]

2024-07-29 Thread via GitHub
flinkbot commented on PR #25128: URL: https://github.com/apache/flink/pull/25128#issuecomment-2255484076 ## CI report: * 3aa7d57b9c7eff3a2c605c60013c23aaa0d8a92a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35628) Translate “DataGen Connector" of "DataStream Connectors" into Chinese

2024-07-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35628: --- Labels: pull-request-available (was: ) > Translate “DataGen Connector" of "DataStream

[jira] [Commented] (FLINK-35913) The issue of using StreamExecutioneEnvironment to execute multiple jobs in a program on Flink CDC

2024-07-29 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869289#comment-17869289 ] Thorne commented on FLINK-35913: I don't recommend  that starting  a flink's job with spring boot ,it's

[jira] [Comment Edited] (FLINK-35909) JdbcFilterPushdownPreparedStatementVisitorTest fails

2024-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-35909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869284#comment-17869284 ] João Boto edited comment on FLINK-35909 at 7/29/24 9:33 AM: [~linshangquan],

[jira] [Comment Edited] (FLINK-35909) JdbcFilterPushdownPreparedStatementVisitorTest fails

2024-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-35909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869284#comment-17869284 ] João Boto edited comment on FLINK-35909 at 7/29/24 9:32 AM: [~linshangquan],

[PR] feature: Provide a Chinese translation of datagen.md [flink]

2024-07-29 Thread via GitHub
BigDataMao opened a new pull request, #25128: URL: https://github.com/apache/flink/pull/25128 ## What is the purpose of the change Provide a Chinese translation of datagen.md ## Verifying this change Please make sure both new and modified tests in this PR

[jira] [Commented] (FLINK-35909) JdbcFilterPushdownPreparedStatementVisitorTest fails

2024-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-35909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869284#comment-17869284 ] João Boto commented on FLINK-35909: --- [~linshangquan], [~Leonard] can you help here? I believe that in

[jira] [Updated] (FLINK-35909) JdbcFilterPushdownPreparedStatementVisitorTest fails

2024-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-35909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto updated FLINK-35909: -- Attachment: screenshot-2.png > JdbcFilterPushdownPreparedStatementVisitorTest fails >

[jira] [Assigned] (FLINK-22059) add a new option is rocksdb statebackend to enable job threads setting

2024-07-29 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi reassigned FLINK-22059: - Assignee: zhongyou.lee (was: xiaogang zhou) > add a new option is rocksdb

Re: [PR] [FLINK-34876][transform] Support UDF functions in transform [flink-cdc]

2024-07-29 Thread via GitHub
ruanhang1993 commented on code in PR #3465: URL: https://github.com/apache/flink-cdc/pull/3465#discussion_r1694814738 ## flink-cdc-runtime/src/test/java/org/apache/flink/cdc/runtime/parser/JaninoCompilerTest.java: ## @@ -118,7 +119,7 @@ public void testJaninoTimestampFunction()

Re: [PR] [FLINK-34853] Draft: Submit CDC Job To Flink K8S Native Application Mode [flink-cdc]

2024-07-29 Thread via GitHub
yuxiqian commented on code in PR #3093: URL: https://github.com/apache/flink-cdc/pull/3093#discussion_r1677720046 ## Dockerfile: ## @@ -0,0 +1,33 @@ +#/* +# * Licensed to the Apache Software Foundation (ASF) under one or more +# * contributor license agreements. See the NOTICE

Re: [PR] [FLINK-35910][Table SQL / API] Add BTRIM function [flink]

2024-07-29 Thread via GitHub
dylanhz commented on PR #25127: URL: https://github.com/apache/flink/pull/25127#issuecomment-2255392100 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [FLINK-34853] Draft: Submit CDC Job To Flink K8S Native Application Mode [flink-cdc]

2024-07-29 Thread via GitHub
yuxiqian commented on code in PR #3093: URL: https://github.com/apache/flink-cdc/pull/3093#discussion_r1677720046 ## Dockerfile: ## @@ -0,0 +1,33 @@ +#/* +# * Licensed to the Apache Software Foundation (ASF) under one or more +# * contributor license agreements. See the NOTICE

[jira] [Updated] (FLINK-35917) Failed to deserialize data of EventHeaderV4

2024-07-29 Thread wangkang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangkang updated FLINK-35917: - Description: I tried to upgrade flink cdc version  to 3.1.x in paimon  

[jira] [Assigned] (FLINK-35391) Bump dependency of Paimon Pipeline connector to 0.8.0

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-35391: -- Assignee: wangjunbo > Bump dependency of Paimon Pipeline connector to 0.8.0 >

[jira] [Resolved] (FLINK-35391) Bump dependency of Paimon Pipeline connector to 0.8.0

2024-07-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-35391. Resolution: Implemented Implemented in master(3.2-SNAOSHOT) via

Re: [PR] [FLINK-35391][cdc-connector][paimon] Bump dependency of Paimon Pipeline connector to 0.8.0 [flink-cdc]

2024-07-29 Thread via GitHub
leonardBang merged PR #3335: URL: https://github.com/apache/flink-cdc/pull/3335 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-35914) Flink 1.18 runtime not supporting java 17

2024-07-29 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869271#comment-17869271 ] Ahmed Hamdy commented on FLINK-35914: - [~sushil_karwasra] I believe it might be better to ask the

Re: [PR] [FLINK-34572] Support OceanBase Jdbc Catalog [flink-connector-jdbc]

2024-07-29 Thread via GitHub
whhe commented on PR #109: URL: https://github.com/apache/flink-connector-jdbc/pull/109#issuecomment-2255336080 > @whhe can you rebase please, and move the related code to the new OceanBase module. we just merge a part of

[jira] [Updated] (FLINK-35917) Failed to deserialize data of EventHeaderV4

2024-07-29 Thread wangkang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangkang updated FLINK-35917: - Attachment: FLINK-35917.txt > Failed to deserialize data of EventHeaderV4 >

Re: [PR] [FLINK-34572] Support OceanBase Jdbc Catalog [flink-connector-jdbc]

2024-07-29 Thread via GitHub
eskabetxe commented on PR #109: URL: https://github.com/apache/flink-connector-jdbc/pull/109#issuecomment-2255329759 @whhe can you rebase please, and move the related code to the new OceanBase module. we just merge a part of

[jira] [Assigned] (FLINK-35909) JdbcFilterPushdownPreparedStatementVisitorTest fails

2024-07-29 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan reassigned FLINK-35909: --- Assignee: João Boto > JdbcFilterPushdownPreparedStatementVisitorTest fails >

[jira] [Commented] (FLINK-35909) JdbcFilterPushdownPreparedStatementVisitorTest fails

2024-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-35909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869267#comment-17869267 ] João Boto commented on FLINK-35909: --- [~fanrui] sure, can you assign it to me? as I can see this is a

[jira] [Updated] (FLINK-35917) Failed to deserialize data of EventHeaderV4

2024-07-29 Thread wangkang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangkang updated FLINK-35917: - Description: I tried to upgrade flink cdc version  to 3.1.x in paimon  

[jira] [Updated] (FLINK-35909) JdbcFilterPushdownPreparedStatementVisitorTest fails

2024-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-35909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto updated FLINK-35909: -- Attachment: screenshot-1.png > JdbcFilterPushdownPreparedStatementVisitorTest fails >

[jira] [Updated] (FLINK-35893) Add state compatibility for Serializer of TableChangeInfo

2024-07-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35893: --- Labels: pull-request-available (was: ) > Add state compatibility for Serializer of

[jira] [Created] (FLINK-35917) Failed to deserialize data of EventHeaderV4

2024-07-29 Thread wangkang (Jira)
wangkang created FLINK-35917: Summary: Failed to deserialize data of EventHeaderV4 Key: FLINK-35917 URL: https://issues.apache.org/jira/browse/FLINK-35917 Project: Flink Issue Type: Bug

Re: [PR] [FLINK-35432]Support catch modify event for the mysql. [flink-cdc]

2024-07-29 Thread via GitHub
ruanhang1993 commented on code in PR #3352: URL: https://github.com/apache/flink-cdc/pull/3352#discussion_r1694788416 ##

Re: [PR] [FLINK-35432]Support catch modify event for the mysql. [flink-cdc]

2024-07-29 Thread via GitHub
ruanhang1993 commented on code in PR #3352: URL: https://github.com/apache/flink-cdc/pull/3352#discussion_r1694788416 ##

Re: [PR] [FLINK-35910][Table SQL / API] Add BTRIM function [flink]

2024-07-29 Thread via GitHub
dylanhz commented on PR #25127: URL: https://github.com/apache/flink/pull/25127#issuecomment-2255285626 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Created] (FLINK-35916) AbstractJdbcRowConverter: type conversion to string

2024-07-29 Thread Evgeniy (Jira)
Evgeniy created FLINK-35916: --- Summary: AbstractJdbcRowConverter: type conversion to string Key: FLINK-35916 URL: https://issues.apache.org/jira/browse/FLINK-35916 Project: Flink Issue Type:

[jira] [Updated] (FLINK-35908) Flink log can not output method name and line number.

2024-07-29 Thread yiheng tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yiheng tang updated FLINK-35908: Priority: Blocker (was: Minor) > Flink log can not output method name and line number. >

[jira] [Comment Edited] (FLINK-35898) When running Flink on Yarn, if the log file path contains a space, the startup will fail.

2024-07-29 Thread yiheng tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869254#comment-17869254 ] yiheng tang edited comment on FLINK-35898 at 7/29/24 7:38 AM: -- If my

[jira] [Commented] (FLINK-35898) When running Flink on Yarn, if the log file path contains a space, the startup will fail.

2024-07-29 Thread yiheng tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869254#comment-17869254 ] yiheng tang commented on FLINK-35898: - If my log.file named as "/data08/yarn/userlogs/application

[jira] [Resolved] (FLINK-35779) Update documentation for PubSubSinkV2

2024-07-29 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-35779. - Resolution: Fixed > Update documentation for PubSubSinkV2 >

[jira] [Commented] (FLINK-35779) Update documentation for PubSubSinkV2

2024-07-29 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17869250#comment-17869250 ] Sergey Nuyanzin commented on FLINK-35779: - Merged as

Re: [PR] [FLINK-35779][Connectors/Google PubSub] Update documentation for PubSubSinkV2 [flink-connector-gcp-pubsub]

2024-07-29 Thread via GitHub
snuyanzin merged PR #29: URL: https://github.com/apache/flink-connector-gcp-pubsub/pull/29 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Assigned] (FLINK-35779) Update documentation for PubSubSinkV2

2024-07-29 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin reassigned FLINK-35779: --- Assignee: Ahmed Hamdy > Update documentation for PubSubSinkV2 >

Re: [PR] [FLINK-35472] Improve tests for Elasticsearch 8 connector [flink-connector-elasticsearch]

2024-07-29 Thread via GitHub
snuyanzin commented on PR #105: URL: https://github.com/apache/flink-connector-elasticsearch/pull/105#issuecomment-2255067000 thanks for the contribution @liuml07 the ci is still failing, can you please have a look ? -- This is an automated message from the Apache Git Service. To

  1   2   >