Re: [PR] [FLINK-35072][cdc][doris] Support applying compatible `AlterColumnTypeEvent` to Doris sink [flink-cdc]

2024-04-14 Thread via GitHub
yuxiqian commented on code in PR #3215: URL: https://github.com/apache/flink-cdc/pull/3215#discussion_r1565211096 ##

[jira] [Commented] (FLINK-34962) flink-connector-pulsa starts failed due to incorrect use of Pulsar API: LookupService. getPartitionedTopicMetadata

2024-04-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837080#comment-17837080 ] Yufan Sheng commented on FLINK-34962: - [~Tison] This issue should be marked resolved. >

Re: [PR] [FLINK-35024][Runtime/State] Implement the record buffer of AsyncExecutionController [flink]

2024-04-14 Thread via GitHub
fredia merged PR #24633: URL: https://github.com/apache/flink/pull/24633 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-34414) EXACTLY_ONCE guarantee doesn't work properly for Flink/Pulsar connector

2024-04-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837079#comment-17837079 ] Yufan Sheng commented on FLINK-34414: - I don't think this is a issue from my side. First of all

Re: [PR] [FLINK-35072][cdc][doris] Support applying compatible `AlterColumnTypeEvent` to Doris sink [flink-cdc]

2024-04-14 Thread via GitHub
yuxiqian commented on code in PR #3215: URL: https://github.com/apache/flink-cdc/pull/3215#discussion_r1565211096 ##

Re: [PR] [FLINK-35072][cdc][doris] Support applying compatible `AlterColumnTypeEvent` to Doris sink [flink-cdc]

2024-04-14 Thread via GitHub
yuxiqian commented on code in PR #3215: URL: https://github.com/apache/flink-cdc/pull/3215#discussion_r1565211096 ##

[jira] [Resolved] (FLINK-33884) Update Pulsar dependency to 3.0.2 in Pulsar Connector

2024-04-14 Thread Zili Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zili Chen resolved FLINK-33884. --- Fix Version/s: pulsar-4.2.0 Resolution: Fixed Master via

Re: [PR] [FLINK-33884] Update Pulsar dependency to 3.0.2 in Pulsar Connector [flink-connector-pulsar]

2024-04-14 Thread via GitHub
tisonkun merged PR #72: URL: https://github.com/apache/flink-connector-pulsar/pull/72 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (FLINK-34629) Pulsar source lost topic subscribe

2024-04-14 Thread Zili Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zili Chen resolved FLINK-34629. --- Fix Version/s: pulsar-4.2.0 Resolution: Fixed Master via

[jira] [Commented] (FLINK-34436) Avro schema evolution and compatibility issues in Pulsar connector

2024-04-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837073#comment-17837073 ] Yufan Sheng commented on FLINK-34436: - I think this is not a issue. It's just a design on purpose.

Re: [PR] [FLINK-34629] Fix invalid subtask assignment for non-partitioned topics [flink-connector-pulsar]

2024-04-14 Thread via GitHub
boring-cyborg[bot] commented on PR #85: URL: https://github.com/apache/flink-connector-pulsar/pull/85#issuecomment-2055403591 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] [FLINK-34629] Fix invalid subtask assignment for non-partitioned topics [flink-connector-pulsar]

2024-04-14 Thread via GitHub
tisonkun merged PR #85: URL: https://github.com/apache/flink-connector-pulsar/pull/85 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [FLINK-25537][JUnit5 Migration] Module: flink-core with,Package: Configuration [flink]

2024-04-14 Thread via GitHub
Jiabao-Sun commented on code in PR #24612: URL: https://github.com/apache/flink/pull/24612#discussion_r1565204190 ## flink-core/src/test/java/org/apache/flink/configuration/ConfigurationConversionsTest.java: ## @@ -52,7 +51,9 @@ public class ConfigurationConversionsTest {

[jira] [Commented] (FLINK-35064) Flink sql connector pulsar/hive com.fasterxml.jackson.annotation.JsonFormat$Value conflict

2024-04-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837068#comment-17837068 ] Yufan Sheng commented on FLINK-35064: - I have made a comment in the related PR. I just copy/paste it

Re: [PR] [FLINK-35064] Update Pulsar dependency to solve the conflict of com.f… [flink-connector-pulsar]

2024-04-14 Thread via GitHub
syhily commented on PR #88: URL: https://github.com/apache/flink-connector-pulsar/pull/88#issuecomment-2055283881 The root cause is from pulsar client side with the Jackson shading issues. Shade a jackson causes a lot of issues. I think we should ask pulsar client not to shade the

Re: [PR] [FLINK-34629] Fix non-partition topic subscribe lost. [flink-connector-pulsar]

2024-04-14 Thread via GitHub
syhily commented on PR #84: URL: https://github.com/apache/flink-connector-pulsar/pull/84#issuecomment-2055266431 I'm in favor of the https://github.com/apache/flink-connector-pulsar/pull/85, maybe we can continue the review progress on that PR and close this PR instead. WDT @minchowang ?

Re: [PR] [FLINK-33884] Update Pulsar dependency to 3.0.2 in Pulsar Connector [flink-connector-pulsar]

2024-04-14 Thread via GitHub
syhily commented on PR #72: URL: https://github.com/apache/flink-connector-pulsar/pull/72#issuecomment-2055251321 Thanks, there are no issues from my side. @tisonkun Can you help me double check this PR? -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] [FLINK-35064] Update Pulsar dependency to solve the conflict of com.f… [flink-connector-pulsar]

2024-04-14 Thread via GitHub
syhily commented on PR #88: URL: https://github.com/apache/flink-connector-pulsar/pull/88#issuecomment-2055227659 Sorry, I don't think this PR is accepted, indeed. IIUC, the `pulsar-client-all` bundle a Jackson internally with a package named `org.apache.pulsar.shade.com.fasterxml`. The

Re: [PR] Allow specifying the ServerSocket port for the collect function when accessing the TaskManager from the client. [flink]

2024-04-14 Thread via GitHub
hzjhjjyy closed pull request #23254: Allow specifying the ServerSocket port for the collect function when accessing the TaskManager from the client. URL: https://github.com/apache/flink/pull/23254 -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [FLINK-35072][cdc][doris] Support applying compatible `AlterColumnTypeEvent` to Doris sink [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #3215: URL: https://github.com/apache/flink-cdc/pull/3215#discussion_r1565182494 ##

Re: [PR] [FLINK-34987][state] Introduce Internal State for Async State API [flink]

2024-04-14 Thread via GitHub
fredia commented on code in PR #24651: URL: https://github.com/apache/flink/pull/24651#discussion_r1565164680 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/v2/StateDescriptor.java: ## @@ -0,0 +1,166 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] [FLINK-34987][state] Introduce Internal State for Async State API [flink]

2024-04-14 Thread via GitHub
Zakelly commented on code in PR #24651: URL: https://github.com/apache/flink/pull/24651#discussion_r1565167042 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/v2/StateDescriptor.java: ## @@ -0,0 +1,167 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] [FLINK-34936][Checkpointing] Register reused shared state handle to FileMergingSnapshotManager [flink]

2024-04-14 Thread via GitHub
Zakelly commented on code in PR #24644: URL: https://github.com/apache/flink/pull/24644#discussion_r1565161944 ## flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/filemerging/FileMergingSnapshotManagerBase.java: ## @@ -459,13 +470,28 @@ public void

Re: [PR] [FLINK-34987][state] Introduce Internal State for Async State API [flink]

2024-04-14 Thread via GitHub
masteryhx commented on code in PR #24651: URL: https://github.com/apache/flink/pull/24651#discussion_r1565160755 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/v2/StateDescriptor.java: ## @@ -0,0 +1,167 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] [FLINK-35046][state] Introduce AsyncKeyedStateBackend supporting to create StateExecutor [flink]

2024-04-14 Thread via GitHub
Zakelly commented on code in PR #24663: URL: https://github.com/apache/flink/pull/24663#discussion_r1565158902 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/StateBackend.java: ## @@ -104,6 +104,25 @@ default String getName() {

Re: [PR] [FLINK-32440][checkpoint] Introduce file merging configurations [flink]

2024-04-14 Thread via GitHub
Zakelly commented on code in PR #22973: URL: https://github.com/apache/flink/pull/22973#discussion_r1565156390 ## docs/layouts/shortcodes/generated/checkpointing_configuration.html: ## @@ -44,6 +44,42 @@ String The default directory used for storing

Re: [PR] [FLINK-25537][JUnit5 Migration] Module: flink-core with,Package: Configuration [flink]

2024-04-14 Thread via GitHub
1996fanrui commented on code in PR #24612: URL: https://github.com/apache/flink/pull/24612#discussion_r1565149231 ## flink-core/src/test/java/org/apache/flink/configuration/FilesystemSchemeConfigTest.java: ## @@ -21,83 +21,79 @@ import org.apache.flink.core.fs.FileSystem;

[jira] [Updated] (FLINK-34987) Introduce Internal State Interface for Async State API

2024-04-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-34987: --- Labels: pull-request-available (was: ) > Introduce Internal State Interface for Async

Re: [PR] [FLINK-34987][state] Introduce Internal State for Async State API [flink]

2024-04-14 Thread via GitHub
Zakelly commented on code in PR #24651: URL: https://github.com/apache/flink/pull/24651#discussion_r1565148947 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/v2/InternalKeyedState.java: ## @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] [FLINK-35064] Update Pulsar dependency to solve the conflict of com.f… [flink-connector-pulsar]

2024-04-14 Thread via GitHub
elon-X commented on PR #88: URL: https://github.com/apache/flink-connector-pulsar/pull/88#issuecomment-2054774574 @MartijnVisser @syhily Could you please help approve this PR when you have some free time? Thank you very much. -- This is an automated message from the Apache Git Service.

Re: [PR] [FLINK-35102][doris] Fix Doris connector type mapping issues [flink-cdc]

2024-04-14 Thread via GitHub
yuxiqian commented on PR #3224: URL: https://github.com/apache/flink-cdc/pull/3224#issuecomment-2054696577 cc @PatrickRen @lvyanquan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Updated] (FLINK-35102) Incorret Type mapping for Flink CDC Doris connector

2024-04-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35102: --- Labels: pull-request-available (was: ) > Incorret Type mapping for Flink CDC Doris

Re: [PR] [hotfix][runtime]Fix the missing methed parameter annotation problem [flink]

2024-04-14 Thread via GitHub
chenyu-opensource commented on PR #24662: URL: https://github.com/apache/flink/pull/24662#issuecomment-2054684404 > Thanks for the quick fix, looks good to me. > > I just think a hotfix commit should be good enough, would you mind renaming this to `[hotfix][runtime]x`?

[jira] [Created] (FLINK-35102) Incorret Type mapping for Flink CDC Doris connector

2024-04-14 Thread Xiqian YU (Jira)
Xiqian YU created FLINK-35102: - Summary: Incorret Type mapping for Flink CDC Doris connector Key: FLINK-35102 URL: https://issues.apache.org/jira/browse/FLINK-35102 Project: Flink Issue Type:

Re: [PR] [minor][cdc][docs] Optimize styles of the Flink CDC website docs home… [flink-cdc]

2024-04-14 Thread via GitHub
leonardBang merged PR #3208: URL: https://github.com/apache/flink-cdc/pull/3208 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [minor][docs] Optimize markdown styles in quickstart doc [flink-cdc]

2024-04-14 Thread via GitHub
xleoken commented on PR #3223: URL: https://github.com/apache/flink-cdc/pull/3223#issuecomment-2054589844 cc @GOODBOY008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] [minor][docs] Optimize markdown styles in quickstart doc [flink-cdc]

2024-04-14 Thread via GitHub
xleoken opened a new pull request, #3223: URL: https://github.com/apache/flink-cdc/pull/3223 ![image](https://github.com/apache/flink-cdc/assets/95013770/038dda76-0ede-432d-9abf-c29d1cf256b0)

Re: [PR] [FLINK-35046][state] Introduce AsyncKeyedStateBackend supporting to create StateExecutor [flink]

2024-04-14 Thread via GitHub
flinkbot commented on PR #24663: URL: https://github.com/apache/flink/pull/24663#issuecomment-2054586620 ## CI report: * b551d919ce3a63501e9ebc6f8769bd56f0c74d0c UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-35101][runtime]Fix the missing methed parameter annotation problem [flink]

2024-04-14 Thread via GitHub
flinkbot commented on PR #24662: URL: https://github.com/apache/flink/pull/24662#issuecomment-2054585372 ## CI report: * 0260e42af4748141a97fc036dc42b87623829b36 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-35040) The performance of serializerHeavyString regresses since April 3

2024-04-14 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837041#comment-17837041 ] Rui Fan commented on FLINK-35040: - Thanks [~slfan1989] and [~rmetzger] for the comment! I didn't find

[jira] [Assigned] (FLINK-35046) Introduce New KeyedStateBackend related Async interfaces

2024-04-14 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-35046: Assignee: Hangxiang Yu > Introduce New KeyedStateBackend related Async interfaces >

[jira] [Updated] (FLINK-35046) Introduce New KeyedStateBackend related Async interfaces

2024-04-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35046: --- Labels: pull-request-available (was: ) > Introduce New KeyedStateBackend related Async

[PR] [FLINK-35046][state] Introduce AsyncKeyedStateBackend supporting to create StateExecutor [flink]

2024-04-14 Thread via GitHub
masteryhx opened a new pull request, #24663: URL: https://github.com/apache/flink/pull/24663 ## What is the purpose of the change Introduce AsyncKeyedStateBackend which supports to create StateExecutor ## Brief change log - Introduce a new interface called

[jira] [Commented] (FLINK-35101) Missing method parameter annotation for ResourceManagerGateway.sendSlotReport

2024-04-14 Thread chenyu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837040#comment-17837040 ] chenyu commented on FLINK-35101: [~Weijie Guo] Thank you so much for your review. > Missing method

[jira] [Updated] (FLINK-35101) Missing method parameter annotation for ResourceManagerGateway.sendSlotReport

2024-04-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35101: --- Labels: pull-request-available (was: ) > Missing method parameter annotation for

[PR] [FLINK-35101][runtime]Fix the missing methed parameter annotation problem [flink]

2024-04-14 Thread via GitHub
chenyu-opensource opened a new pull request, #24662: URL: https://github.com/apache/flink/pull/24662 ## What is the purpose of the change This pull request fixs the problem of missing methed parameter annotation. ## Brief change log Add the parameter

[jira] [Assigned] (FLINK-35093) Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot.

2024-04-14 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-35093: -- Assignee: Hongshun Wang > Postgres source connector support SPECIFIC_OFFSETS start up mode

[jira] [Commented] (FLINK-35101) Missing method parameter annotation for ResourceManagerGateway.sendSlotReport

2024-04-14 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837038#comment-17837038 ] Weijie Guo commented on FLINK-35101: Just feel free to open a hotfix PR. > Missing method parameter

[jira] [Updated] (FLINK-35101) Missing method parameter annotation for ResourceManagerGateway.sendSlotReport

2024-04-14 Thread chenyu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenyu updated FLINK-35101: --- Component/s: Table SQL / Runtime > Missing method parameter annotation for

[jira] [Updated] (FLINK-35101) Missing method parameter annotation for ResourceManagerGateway.sendSlotReport

2024-04-14 Thread chenyu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenyu updated FLINK-35101: --- Fix Version/s: (was: 1.18.0) > Missing method parameter annotation for

[jira] [Commented] (FLINK-35101) Missing method parameter annotation for ResourceManagerGateway.sendSlotReport

2024-04-14 Thread chenyu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837036#comment-17837036 ] chenyu commented on FLINK-35101: Please, assign this issue to me. I can fix it. > Missing method

[jira] [Updated] (FLINK-35101) Missing method parameter annotation for ResourceManagerGateway.sendSlotReport

2024-04-14 Thread chenyu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenyu updated FLINK-35101: --- Affects Version/s: 1.19.0 1.18.0 > Missing method parameter annotation for

[jira] [Updated] (FLINK-35101) Missing method parameter annotation for ResourceManagerGateway.sendSlotReport

2024-04-14 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35101: --- Affects Version/s: 1.20.0 > Missing method parameter annotation for

[jira] [Closed] (FLINK-35101) Missing method parameter annotation for ResourceManagerGateway.sendSlotReport

2024-04-14 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-35101. -- Resolution: Fixed > Missing method parameter annotation for ResourceManagerGateway.sendSlotReport >

[jira] [Updated] (FLINK-35101) Missing method parameter annotation for ResourceManagerGateway.sendSlotReport

2024-04-14 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35101: --- Component/s: Runtime / Coordination (was: Table SQL / Runtime) > Missing

[jira] [Updated] (FLINK-35101) Missing method parameter annotation for ResourceManagerGateway.sendSlotReport

2024-04-14 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35101: --- Fix Version/s: 1.20.0 (was: 1.19.0) > Missing method parameter annotation

[jira] [Commented] (FLINK-35101) Missing method parameter annotation for ResourceManagerGateway.sendSlotReport

2024-04-14 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837037#comment-17837037 ] Weijie Guo commented on FLINK-35101: Yeap, this should be aligned. A hot-fix is good enough, I will

[jira] [Commented] (FLINK-34273) git fetch fails

2024-04-14 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837034#comment-17837034 ] Weijie Guo commented on FLINK-34273:

[jira] [Created] (FLINK-35101) Missing method parameter annotation for ResourceManagerGateway.sendSlotReport

2024-04-14 Thread chenyu (Jira)
chenyu created FLINK-35101: -- Summary: Missing method parameter annotation for ResourceManagerGateway.sendSlotReport Key: FLINK-35101 URL: https://issues.apache.org/jira/browse/FLINK-35101 Project: Flink

[jira] [Commented] (FLINK-18476) PythonEnvUtilsTest#testStartPythonProcess fails

2024-04-14 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837035#comment-17837035 ] Weijie Guo commented on FLINK-18476: 1.20 jdk17

[jira] [Updated] (FLINK-35100) Quickstarts Java nightly end-to-end test failed on Azure

2024-04-14 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35100: --- Description: {code:java} java.lang.IllegalStateException: Trying to open gateway for unseen

[jira] [Comment Edited] (FLINK-34273) git fetch fails

2024-04-14 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837034#comment-17837034 ] Weijie Guo edited comment on FLINK-34273 at 4/15/24 2:15 AM: -

[jira] [Created] (FLINK-35100) Quickstarts Java nightly end-to-end test failed on Azure

2024-04-14 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35100: -- Summary: Quickstarts Java nightly end-to-end test failed on Azure Key: FLINK-35100 URL: https://issues.apache.org/jira/browse/FLINK-35100 Project: Flink Issue

Re: [PR] [FLINK-35097][table] Fix 'raw' format deserialization [flink]

2024-04-14 Thread via GitHub
kumar-mallikarjuna commented on PR #24661: URL: https://github.com/apache/flink/pull/24661#issuecomment-2054358863 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Updated] (FLINK-35093) Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot.

2024-04-14 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35093: -- Description: Current, Postgres source connector  only support INITIAL and LATEST mode.

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#issuecomment-2054304285 Thanks @yuxiqian for those comments, I've addressed it and resubmitted. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1565075579 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/v2/PaimonCommitter.java:

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1565069967 ##

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1565072387 ## docs/content/pipelines/paimon-pipeline(ZH).md: ## @@ -0,0 +1,209 @@ +# Paimon Pipeline 连接器 + +Paimon Pipeline 连接器可以用作 Pipeline 的 *Data

Re: [PR] [FLINK-34969][cdc-cli]Add support for both new and old Flink config files in Flink… [flink-cdc]

2024-04-14 Thread via GitHub
skymilong commented on code in PR #3194: URL: https://github.com/apache/flink-cdc/pull/3194#discussion_r1565044902 ## flink-cdc-common/src/main/java/org/apache/flink/cdc/common/utils/MemorySize.java: ## @@ -0,0 +1,421 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[jira] [Created] (FLINK-35099) Support for multiple datasources

2024-04-14 Thread melin (Jira)
melin created FLINK-35099: - Summary: Support for multiple datasources Key: FLINK-35099 URL: https://issues.apache.org/jira/browse/FLINK-35099 Project: Flink Issue Type: New Feature

[jira] [Comment Edited] (FLINK-34470) Transactional message + Table api kafka source with 'latest-offset' scan bound mode causes indefinitely hanging

2024-04-14 Thread dongwoo.kim (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837027#comment-17837027 ] dongwoo.kim edited comment on FLINK-34470 at 4/15/24 1:15 AM: -- Hello

[jira] [Commented] (FLINK-34470) Transactional message + Table api kafka source with 'latest-offset' scan bound mode causes indefinitely hanging

2024-04-14 Thread dongwoo.kim (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837027#comment-17837027 ] dongwoo.kim commented on FLINK-34470: - Hello [~m.orazow], I'm glad that you're interested in

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
yuxiqian commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1565028345 ## docs/content/pipelines/paimon-pipeline(ZH).md: ## @@ -0,0 +1,209 @@ +# Paimon Pipeline 连接器 + +Paimon Pipeline 连接器可以用作 Pipeline 的 *Data

Re: [PR] [FLINK-35098][orc] Fix incorrect results in thanEquals filters [flink]

2024-04-14 Thread via GitHub
snuyanzin commented on PR #24658: URL: https://github.com/apache/flink/pull/24658#issuecomment-2054184159 Yep, you're right probably i was not aware of the context I was judging only by timestamps I'm really sorry in case I offended in any way I would suggest in case you are

Re: [PR] [FLINK-34942][connectors/opensearch] Add support for Flink 1.19+ [flink-connector-opensearch]

2024-04-14 Thread via GitHub
snuyanzin merged PR #42: URL: https://github.com/apache/flink-connector-opensearch/pull/42 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [FLINK-34942][connectors/opensearch] Add support for Flink 1.19+ [flink-connector-opensearch]

2024-04-14 Thread via GitHub
snuyanzin commented on PR #42: URL: https://github.com/apache/flink-connector-opensearch/pull/42#issuecomment-2054124759 Thanks for taking a look -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1564775105 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/v2/TableSchemaInfo.java:

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1564773416 ##

Re: [PR] [FLINK-33859] Support OpenSearch v2 [flink-connector-opensearch]

2024-04-14 Thread via GitHub
snuyanzin commented on PR #38: URL: https://github.com/apache/flink-connector-opensearch/pull/38#issuecomment-2054094757 first this should be reviewed/approved/merged https://github.com/apache/flink-connector-opensearch/pull/42 then we could continue with this PR -- This is an

[jira] [Comment Edited] (FLINK-35097) Table API Filesystem connector with 'raw' format repeats last line

2024-04-14 Thread Kumar Mallikarjuna (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836959#comment-17836959 ] Kumar Mallikarjuna edited comment on FLINK-35097 at 4/14/24 3:05 PM: -

Re: [PR] [FLINK-35098][ORC] Fix incorrect results with literal first expressions [flink]

2024-04-14 Thread via GitHub
empathy87 commented on PR #24659: URL: https://github.com/apache/flink/pull/24659#issuecomment-2054089997 > Hi @empathy87 thanks a lot for driving this PR. It looks good to me. Could you please add tests for each changelog in 'OrcFilters.java' ? Thanks! Sure! I reworked the tests to

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
yuxiqian commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1564742486 ## docs/content/pipelines/paimon-pipeline.md: ## @@ -0,0 +1,209 @@ +# Paimon Pipeline Connector + +The Paimon Pipeline connector can be used as the *Data Sink* of

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1564741797 ## docs/content/pipelines/paimon-pipeline.md: ## @@ -0,0 +1,209 @@ +# Paimon Pipeline Connector + +The Paimon Pipeline connector can be used as the *Data Sink* of

Re: [PR] [pipeline-connector][paimon] add paimon pipeline data sink connector. [flink-cdc]

2024-04-14 Thread via GitHub
lvyanquan commented on code in PR #2916: URL: https://github.com/apache/flink-cdc/pull/2916#discussion_r1564741417 ## docs/content/pipelines/paimon-pipeline(ZH).md: ## @@ -0,0 +1,209 @@ +# Paimon Pipeline 连接器 + +Paimon Pipeline 连接器可以用作 Pipeline 的 *Data

Re: [PR] [FLINK-35097][table] Fix 'raw' format deserialization [flink]

2024-04-14 Thread via GitHub
flinkbot commented on PR #24661: URL: https://github.com/apache/flink/pull/24661#issuecomment-2054068968 ## CI report: * b3c8502a9ca370eab1c023588571f6f3fc18addd UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-35097) Table API Filesystem connector with 'raw' format repeats last line

2024-04-14 Thread Kumar Mallikarjuna (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836959#comment-17836959 ] Kumar Mallikarjuna commented on FLINK-35097: [~david.perkins] , I've raised a fix here:

[PR] [FLINK-35097][table] Fix 'raw' format deserialization [flink]

2024-04-14 Thread via GitHub
kumar-mallikarjuna opened a new pull request, #24661: URL: https://github.com/apache/flink/pull/24661 ## What is the purpose of the change Fixes broken deserialization of the `raw` format. ## Brief change log The existing `reuse` attribute is returned by the

[jira] [Updated] (FLINK-35097) Table API Filesystem connector with 'raw' format repeats last line

2024-04-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35097: --- Labels: pull-request-available (was: ) > Table API Filesystem connector with 'raw' format

[jira] [Commented] (FLINK-35097) Table API Filesystem connector with 'raw' format repeats last line

2024-04-14 Thread Kumar Mallikarjuna (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836952#comment-17836952 ] Kumar Mallikarjuna commented on FLINK-35097: > assuming this effects 1.18 and 1.19. This is

[jira] [Updated] (FLINK-34903) Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary tables

2024-04-14 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thorne updated FLINK-34903: --- Summary: Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary tables (was: Add

[jira] [Updated] (FLINK-34903) Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary tables

2024-04-14 Thread Thorne (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thorne updated FLINK-34903: --- Release Note: [features] Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary

Re: [PR] [FLINK-30687][table] Support pushdown for aggregate filters [flink]

2024-04-14 Thread via GitHub
flinkbot commented on PR #24660: URL: https://github.com/apache/flink/pull/24660#issuecomment-2054018936 ## CI report: * e5e78f553679c92f336b4f4fdccb31b95dd7bad9 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-34903][MySQL][Feature] Add mysql-pipeline-connector with table.exclude.list option to exclude unnecessary tables [flink-cdc]

2024-04-14 Thread via GitHub
shiyiky commented on PR #3186: URL: https://github.com/apache/flink-cdc/pull/3186#issuecomment-2054018232 @PatrickRen I have done it .Please review it if u have free time ,tks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[PR] [FLINK-30687][table] Support pushdown for aggregate filters [flink]

2024-04-14 Thread via GitHub
jeyhunkarimov opened a new pull request, #24660: URL: https://github.com/apache/flink/pull/24660 ## What is the purpose of the change This PR supports pushing down filters for aggregate expressions. Not that this optimization works if there is single aggregate expression with

[jira] [Updated] (FLINK-30687) FILTER not effect in count(*)

2024-04-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30687: --- Labels: pull-request-available (was: ) > FILTER not effect in count(*) >

Re: [PR] [DRAFT][FLINK-34440][formats][protobuf-confluent] add support for protobuf-confluent [flink]

2024-04-14 Thread via GitHub
anupamaggarwal commented on code in PR #24482: URL: https://github.com/apache/flink/pull/24482#discussion_r1564640169 ## flink-formats/flink-protobuf-confluent-registry/src/main/java/org/apache/flink/formats/protobuf/registry/confluent/SchemaCoderProviders.java: ## @@ -0,0

Re: [PR] [DRAFT][FLINK-34440][formats][protobuf-confluent] add support for protobuf-confluent [flink]

2024-04-14 Thread via GitHub
anupamaggarwal commented on code in PR #24482: URL: https://github.com/apache/flink/pull/24482#discussion_r1564639354 ## flink-formats/flink-protobuf-confluent-registry/src/test/java/org/apache/flink/formats/protobuf/registry/confluent/utils/FlinkToProtoSchemaConverterTest.java:

[jira] [Comment Edited] (FLINK-31992) FlinkKafkaConsumer API is suggested to use as part of documentation, when that API is deprecated for flink version 1.14

2024-04-14 Thread Sandesh Mendan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17756352#comment-17756352 ] Sandesh Mendan edited comment on FLINK-31992 at 4/14/24 11:07 AM: --

Re: [PR] [FLINK-33859] Support OpenSearch v2 [flink-connector-opensearch]

2024-04-14 Thread via GitHub
joshbsemperis commented on PR #38: URL: https://github.com/apache/flink-connector-opensearch/pull/38#issuecomment-2054001884 Can this be resolved and pushed? Is there a reason why it hasnt? -- This is an automated message from the Apache Git Service. To respond to the message, please

  1   2   >