Re: [PR] [FLINK-36437][hive] Exclude hive connector [flink]

2024-10-08 Thread via GitHub
Sxnan merged PR #25462: URL: https://github.com/apache/flink/pull/25462 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.

Re: [PR] [FLINK-36192][autocaler] Autocaler supports adjusting the parallelism of source vertex based on the number of partitions in Kafka or pulsars [flink-kubernetes-operator]

2024-10-08 Thread via GitHub
1996fanrui commented on code in PR #879: URL: https://github.com/apache/flink-kubernetes-operator/pull/879#discussion_r1792893091 ## flink-autoscaler/src/test/java/org/apache/flink/autoscaler/JobVertexScalerTest.java: ## @@ -775,11 +931,119 @@ public void testSendingIneffectiv

Re: [PR] [Flink 36245] Remove legacy SourceFunction / SinkFunction / Sink V1 API in 2.0 [flink]

2024-10-08 Thread via GitHub
ruanwenjun commented on PR #25331: URL: https://github.com/apache/flink/pull/25331#issuecomment-2401375174 > > @lvyanquan Hi, I find some examples under `flink-examples-streaming` cannot work due to the `flink-connector-kafka` version `3.0.0-1.17` still rely on `StatefulSink`. Is this expec

[jira] [Commented] (FLINK-36437) Hive connector failed to compile with JDK 11

2024-10-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887773#comment-17887773 ] Weijie Guo commented on FLINK-36437: > the ci is already build with jdk 11 by defau

[jira] [Comment Edited] (FLINK-36437) Hive connector failed to compile with JDK 11

2024-10-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887773#comment-17887773 ] Weijie Guo edited comment on FLINK-36437 at 10/9/24 5:49 AM: -

[jira] [Resolved] (FLINK-36180) Flink pulsar connector when restoring from the state, the unconsumed messages of the first batch will be lost

2024-10-08 Thread Zili Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zili Chen resolved FLINK-36180. --- Assignee: Wenbing Shen Resolution: Fixed master via https://github.com/apache/flink-connector

Re: [PR] [FLINK-36180] Fix batch message data loss [flink-connector-pulsar]

2024-10-08 Thread via GitHub
boring-cyborg[bot] commented on PR #95: URL: https://github.com/apache/flink-connector-pulsar/pull/95#issuecomment-2401357054 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] [FLINK-36180] Fix batch message data loss [flink-connector-pulsar]

2024-10-08 Thread via GitHub
tisonkun merged PR #95: URL: https://github.com/apache/flink-connector-pulsar/pull/95 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...

[jira] [Updated] (FLINK-36447) Add .java-version(generated by jenv) to git igonre

2024-10-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36447: --- Description: Many java developers use jenv for java multi-version management, and since flink suppor

[jira] [Created] (FLINK-36447) Add .java-version(generated by jenv) to git igonre

2024-10-08 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-36447: -- Summary: Add .java-version(generated by jenv) to git igonre Key: FLINK-36447 URL: https://issues.apache.org/jira/browse/FLINK-36447 Project: Flink Issue Type: Im

Re: [PR] [FLINK-36444] Fix unstable test case SimpleRecoveryITCaseBase#testFailedRunThenSuccessfulRun [flink]

2024-10-08 Thread via GitHub
flinkbot commented on PR #25466: URL: https://github.com/apache/flink/pull/25466#issuecomment-2401270045 ## CI report: * 9ad457c7f73bc376ae1bd0ab1d626ff823ea5e4c UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Assigned] (FLINK-36444) unstable test case SimpleRecoveryITCaseBase#testFailedRunThenSuccessfulRun

2024-10-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-36444: -- Assignee: xuhuang > unstable test case SimpleRecoveryITCaseBase#testFailedRunThenSuccessfulRu

[jira] [Updated] (FLINK-36444) unstable test case SimpleRecoveryITCaseBase#testFailedRunThenSuccessfulRun

2024-10-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36444: --- Labels: pull-request-available (was: ) > unstable test case SimpleRecoveryITCaseBase#testFa

[PR] [FLINK-36444] Fix unstable test case SimpleRecoveryITCaseBase#testFailedRunThenSuccessfulRun [flink]

2024-10-08 Thread via GitHub
codenohup opened a new pull request, #25466: URL: https://github.com/apache/flink/pull/25466 ## What is the purpose of the change Fix unstable test case SimpleRecoveryITCaseBase#testFailedRunThenSuccessfulRun ## Verifying this change This change is already co

[jira] [Closed] (FLINK-36261) Revisit all breaking changes before Flink 2.0 Preview

2024-10-08 Thread Xuannan Su (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuannan Su closed FLINK-36261. -- Resolution: Fixed > Revisit all breaking changes before Flink 2.0 Preview > --

[jira] [Comment Edited] (FLINK-36261) Revisit all breaking changes before Flink 2.0 Preview

2024-10-08 Thread Xuannan Su (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887756#comment-17887756 ] Xuannan Su edited comment on FLINK-36261 at 10/9/24 3:55 AM: -

[jira] [Commented] (FLINK-36261) Revisit all breaking changes before Flink 2.0 Preview

2024-10-08 Thread Xuannan Su (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887756#comment-17887756 ] Xuannan Su commented on FLINK-36261: All the breaking changes have been listed in th

Re: [PR] [FLINK-36192][autocaler] Autocaler supports adjusting the parallelism of source vertex based on the number of partitions in Kafka or pulsars [flink-kubernetes-operator]

2024-10-08 Thread via GitHub
huyuanfeng2018 commented on PR #879: URL: https://github.com/apache/flink-kubernetes-operator/pull/879#issuecomment-2401214877 > For example, introducing an additional option and try to rounding up based on ` if (numKeyGroupsOrPartitions / p < numKeyGroupsOrPartitions / newParallelism)

[jira] [Updated] (FLINK-36158) Refactor Job Recovery Process to Use ExecutionPlan Instead of JobGraph

2024-10-08 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-36158: -- Description: Change the existing JobGraphStore to ExecutionPlanStore support storing ExecutionPlans,

Re: [PR] [FLINK-36437][hive] Fix hive connector complie error in JDK11 [flink]

2024-10-08 Thread via GitHub
luoyuxia commented on PR #25465: URL: https://github.com/apache/flink/pull/25465#issuecomment-2401212176 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-36158) Refactor Job Recovery Process to Use ExecutionPlan Instead of JobGraph

2024-10-08 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-36158: -- Summary: Refactor Job Recovery Process to Use ExecutionPlan Instead of JobGraph (was: Support for Str

[jira] [Created] (FLINK-36446) Refactor Job Submission Process to Use ExecutionPlan Instead of JobGraph

2024-10-08 Thread Junrui Li (Jira)
Junrui Li created FLINK-36446: - Summary: Refactor Job Submission Process to Use ExecutionPlan Instead of JobGraph Key: FLINK-36446 URL: https://issues.apache.org/jira/browse/FLINK-36446 Project: Flink

[jira] [Updated] (FLINK-36444) unstable test case SimpleRecoveryITCaseBase#testFailedRunThenSuccessfulRun

2024-10-08 Thread xuhuang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuhuang updated FLINK-36444: Description: The instability of the test case is attributed to the uneven distribution of data from the so

[jira] [Created] (FLINK-36445) Introducing an ExecutionPlan interface

2024-10-08 Thread Junrui Li (Jira)
Junrui Li created FLINK-36445: - Summary: Introducing an ExecutionPlan interface Key: FLINK-36445 URL: https://issues.apache.org/jira/browse/FLINK-36445 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-36444) unstable test case SimpleRecoveryITCaseBase#testFailedRunThenSuccessfulRun

2024-10-08 Thread xuhuang (Jira)
xuhuang created FLINK-36444: --- Summary: unstable test case SimpleRecoveryITCaseBase#testFailedRunThenSuccessfulRun Key: FLINK-36444 URL: https://issues.apache.org/jira/browse/FLINK-36444 Project: Flink

Re: [PR] [FLINK-35165][runtime/coordination] AdaptiveBatch Scheduler should not restrict the default source parall… [flink]

2024-10-08 Thread via GitHub
JunRuiLee commented on PR #24736: URL: https://github.com/apache/flink/pull/24736#issuecomment-2401197362 Sorry for the delayed response due to the National Day holiday in China. Currently, there are three key fields related to parallelism: 1. defaultMaxParallelism: This comes f

[jira] [Commented] (FLINK-36437) Hive connector failed to compile with JDK 11

2024-10-08 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887750#comment-17887750 ] luoyuxia commented on FLINK-36437: -- Although Hive donesn't fully support jdk11, hive co

Re: [PR] [FLINK-36437][hive] Fix hive connector complie error in JDK11 [flink]

2024-10-08 Thread via GitHub
flinkbot commented on PR #25465: URL: https://github.com/apache/flink/pull/25465#issuecomment-2401185269 ## CI report: * e7d93555ebbbeb68fd1224dc341e15341adb6eef UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-36437) Hive connector failed to compile with JDK 11

2024-10-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36437: --- Labels: pull-request-available (was: ) > Hive connector failed to compile with JDK 11 > ---

[PR] [FLINK-36437][hive] Fix hive connector complie error in JDK11 [flink]

2024-10-08 Thread via GitHub
luoyuxia opened a new pull request, #25465: URL: https://github.com/apache/flink/pull/25465 ## What is the purpose of the change To fix hive connector complie error in JDK11 ## Brief change log Remove `@javax.annotation.Generated` in hive connector ## Verif

[jira] [Assigned] (FLINK-36350) IllegalAccessError detected in JDK17+ runs

2024-10-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-36350: -- Assignee: xuhuang > IllegalAccessError detected in JDK17+ runs >

[jira] [Updated] (FLINK-36223) SplitFetcher thread 0 received unexpected exception while polling the records

2024-10-08 Thread zjf (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zjf updated FLINK-36223: Fix Version/s: cdc-3.1.1 > SplitFetcher thread 0 received unexpected exception while polling the records > ---

[jira] [Updated] (FLINK-36435) Shaded Hadoop S3A with credentials provider end-to-end test failed

2024-10-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36435: --- Labels: pull-request-available (was: ) > Shaded Hadoop S3A with credentials provider end-to

Re: [PR] [hotfix] Remove minor unused deprecated method/class [flink]

2024-10-08 Thread via GitHub
reswqa merged PR #25458: URL: https://github.com/apache/flink/pull/25458 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[jira] [Updated] (FLINK-36223) SplitFetcher thread 0 received unexpected exception while polling the records

2024-10-08 Thread zjf (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zjf updated FLINK-36223: Labels: pull-request-available (was: ) > SplitFetcher thread 0 received unexpected exception while polling the re

Re: [PR] [FLINK-36009] Architecture tests refactor and fixes [flink-connector-jdbc]

2024-10-08 Thread via GitHub
RocMarshal commented on code in PR #140: URL: https://github.com/apache/flink-connector-jdbc/pull/140#discussion_r1792677288 ## flink-connector-jdbc-core/src/main/java/org/apache/flink/connector/jdbc/core/util/VisibleForTest.java: ## @@ -0,0 +1,20 @@ +package org.apache.flink.c

Re: [PR] [FLINK-36399][table] Fix incorrect cast behavior. [flink]

2024-10-08 Thread via GitHub
liuyongvs commented on PR #25418: URL: https://github.com/apache/flink/pull/25418#issuecomment-2401110763 hi @davidradl will you look it again? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Updated] (FLINK-36132) Remove codes that references TableSource and TableSink directly at the API level.

2024-10-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36132: --- Fix Version/s: 2.0.0 (was: 2.0-preview) > Remove codes that references TableS

Re: [PR] [FLINK-36009] Architecture tests refactor and fixes [flink-connector-jdbc]

2024-10-08 Thread via GitHub
RocMarshal commented on code in PR #140: URL: https://github.com/apache/flink-connector-jdbc/pull/140#discussion_r1792677288 ## flink-connector-jdbc-core/src/main/java/org/apache/flink/connector/jdbc/core/util/VisibleForTest.java: ## @@ -0,0 +1,20 @@ +package org.apache.flink.c

Re: [PR] [hotfix] Fixed flaky-test: StateTtlHintTest#testJoinStateTtlHintWithView [flink]

2024-10-08 Thread via GitHub
flinkbot commented on PR #25464: URL: https://github.com/apache/flink/pull/25464#issuecomment-2401046430 ## CI report: * 1b289036cc1731c6ae08f25913b155fb0b774402 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Resolved] (FLINK-36435) Shaded Hadoop S3A with credentials provider end-to-end test failed

2024-10-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo resolved FLINK-36435. Resolution: Fixed master(1.20) via 35d1c25b537aaa00282b6fdf8df82c6be0505d7d. > Shaded Hadoop S3A

Re: [PR] [FLINK-36435] Fix shaded hadoop S3A with credentials provider end-to-end test failed [flink]

2024-10-08 Thread via GitHub
reswqa merged PR #25461: URL: https://github.com/apache/flink/pull/25461 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

Re: [PR] [FLINK-36009] Architecture tests refactor and fixes [flink-connector-jdbc]

2024-10-08 Thread via GitHub
RocMarshal commented on PR #140: URL: https://github.com/apache/flink-connector-jdbc/pull/140#issuecomment-2401103241 > @RocMarshal thanks for your review.. > > I think I could change this to 2 PRs... one with the new architecture module and another with changes to fix the "Connector

Re: [PR] [FLINK-35747][yarn]Fix customer ‘rest.bind-address' config overwrite … [flink]

2024-10-08 Thread via GitHub
DNCBA commented on PR #25013: URL: https://github.com/apache/flink/pull/25013#issuecomment-2401065511 > ~@DNCBA Would you mind updating the PR to point against master and adding some unit tests as well?~ > > NVM, closing this because it is a duplicate of #24775. thank you repl

[PR] Fixed flaky-test: StateTtlHintTest#testJoinStateTtlHintWithView [flink]

2024-10-08 Thread via GitHub
hermya opened a new pull request, #25464: URL: https://github.com/apache/flink/pull/25464 ## What is the purpose of the change **This pull request identifies a flaky-test and proposes a fix.** ## Brief change log The following method asserts a flaky test:

Re: [PR] [mysql][oracle] Quote primary key when split snapshot [flink-cdc]

2024-10-08 Thread via GitHub
github-actions[bot] commented on PR #1709: URL: https://github.com/apache/flink-cdc/pull/1709#issuecomment-2401016197 This pull request has been automatically marked as stale because it has not had recent activity for 60 days. It will be closed in 30 days if no further activity occurs. --

Re: [PR] [FLINK-35360] Submit Flink CDC pipeline job yarn Application mode [flink-cdc]

2024-10-08 Thread via GitHub
github-actions[bot] commented on PR #3366: URL: https://github.com/apache/flink-cdc/pull/3366#issuecomment-2401016083 This pull request has been automatically marked as stale because it has not had recent activity for 60 days. It will be closed in 30 days if no further activity occurs. --

Re: [PR] [FLINK-34865][pipeline-connector]support sync table and column comments [flink-cdc]

2024-10-08 Thread via GitHub
github-actions[bot] commented on PR #3482: URL: https://github.com/apache/flink-cdc/pull/3482#issuecomment-2401016021 This pull request has been automatically marked as stale because it has not had recent activity for 60 days. It will be closed in 30 days if no further activity occurs. --

Re: [PR] Final [flink-connector-gcp-pubsub]

2024-10-08 Thread via GitHub
boring-cyborg[bot] commented on PR #32: URL: https://github.com/apache/flink-connector-gcp-pubsub/pull/32#issuecomment-2400813249 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This

[PR] Final [flink-connector-gcp-pubsub]

2024-10-08 Thread via GitHub
clmccart opened a new pull request, #32: URL: https://github.com/apache/flink-connector-gcp-pubsub/pull/32 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

[jira] [Commented] (FLINK-29797) can't run a job on yarn, if set fs.default-scheme

2024-10-08 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887678#comment-17887678 ] Ferenc Csaky commented on FLINK-29797: -- [~Adrian Z] can you pls. open another PR po

Re: [PR] [FLINK-36441] Ensure producers are not leaked [flink-connector-kafka]

2024-10-08 Thread via GitHub
AHeise commented on code in PR #126: URL: https://github.com/apache/flink-connector-kafka/pull/126#discussion_r1792410015 ## flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer.java: ## @@ -1246,8 +1230,18 @@ private Set generateNe

Re: [PR] [FLINK-36441] Ensure producers are not leaked [flink-connector-kafka]

2024-10-08 Thread via GitHub
AHeise commented on code in PR #126: URL: https://github.com/apache/flink-connector-kafka/pull/126#discussion_r1792410015 ## flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer.java: ## @@ -1246,8 +1230,18 @@ private Set generateNe

[jira] [Updated] (FLINK-36441) Resource leaks in Kafka connector (Tests)

2024-10-08 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36441: Description: Producers are leaked in quite a few tests. For non-transactional producers, there is

[jira] [Updated] (FLINK-36441) Resource leaks in Kafka connector (Tests)

2024-10-08 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36441: Summary: Resource leaks in Kafka connector (Tests) (was: Resource leaks in Kafka Tests) > Resour

Re: [PR] [FLINK-35016] catalog changes for model resource [flink]

2024-10-08 Thread via GitHub
jeff303 commented on PR #25211: URL: https://github.com/apache/flink/pull/25211#issuecomment-2400598480 This PR replaces #25036. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] [FLINK-29797][flink-yarn] Fix fs.default-scheme will accidentally cau… [flink]

2024-10-08 Thread via GitHub
ferenc-csaky commented on PR #24733: URL: https://github.com/apache/flink/pull/24733#issuecomment-2400587142 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[jira] [Assigned] (FLINK-29797) can't run a job on yarn, if set fs.default-scheme

2024-10-08 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky reassigned FLINK-29797: Assignee: slankka > can't run a job on yarn, if set fs.default-scheme > -

[jira] [Updated] (FLINK-29797) can't run a job on yarn, if set fs.default-scheme

2024-10-08 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky updated FLINK-29797: - Affects Version/s: 1.19.1 1.20.0 1.18.1

Re: [PR] [FLINK-35747][yarn]Fix customer ‘rest.bind-address' config overwrite … [flink]

2024-10-08 Thread via GitHub
ferenc-csaky closed pull request #25013: [FLINK-35747][yarn]Fix customer ‘rest.bind-address' config overwrite … URL: https://github.com/apache/flink/pull/25013 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (FLINK-29797) can't run a job on yarn, if set fs.default-scheme

2024-10-08 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky updated FLINK-29797: - Fix Version/s: 2.0.0 1.20.1 > can't run a job on yarn, if set fs.default-sche

[jira] [Assigned] (FLINK-35332) Manually setting rest.bind-address does not work for Flink running on Hadoop Yarn dual network environment

2024-10-08 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky reassigned FLINK-35332: Assignee: Yao Zhang > Manually setting rest.bind-address does not work for Flink running

[jira] [Updated] (FLINK-35332) Manually setting rest.bind-address does not work for Flink running on Hadoop Yarn dual network environment

2024-10-08 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky updated FLINK-35332: - Affects Version/s: 1.19.1 1.20.0 (was: 1.15.4)

Re: [PR] [FLINK-35332][yarn] Removed setting rest.address to the actual IP add… [flink]

2024-10-08 Thread via GitHub
ferenc-csaky commented on PR #24775: URL: https://github.com/apache/flink/pull/24775#issuecomment-2400563518 @paul8263 Logic LGTM, but pls. add a unit test to `YarnEntrypointUtilsTest` that validates we keep the preconfigured value. -- This is an automated message from the Apache Git Serv

[jira] [Closed] (FLINK-35747) customer ‘rest.bind-address' config overwrite by code

2024-10-08 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky closed FLINK-35747. Assignee: (was: dncba) Resolution: Duplicate > customer ‘rest.bind-address' config over

[jira] [Assigned] (FLINK-35747) customer ‘rest.bind-address' config overwrite by code

2024-10-08 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky reassigned FLINK-35747: Assignee: dncba > customer ‘rest.bind-address' config overwrite by code > --

Re: [PR] [FLINK-35747][yarn]Fix customer ‘rest.bind-address' config overwrite … [flink]

2024-10-08 Thread via GitHub
ferenc-csaky commented on PR #25013: URL: https://github.com/apache/flink/pull/25013#issuecomment-2400545817 @DNCBA Would you mind updating the PR to point against master and adding some unit tests as well? -- This is an automated message from the Apache Git Service. To respond to the mes

Re: [PR] [FLINK-30899][connector-files] Fix FileSystemTableSource incorrectly selecting fields on partitioned tables [flink]

2024-10-08 Thread via GitHub
ferenc-csaky commented on code in PR #21885: URL: https://github.com/apache/flink/pull/21885#discussion_r1792320298 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/connector/file/table/FileSystemTableSourceWithPartitionsITCase.java: ## @@ -0,0 +1,146 @@ +/* + *

[jira] [Updated] (FLINK-30899) FileSystemTableSource with CSV format incorrectly selects fields if filtering for partition

2024-10-08 Thread Mate Czagany (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mate Czagany updated FLINK-30899: - Affects Version/s: 1.20.0 1.19.0 2.0.0 > FileSyste

[jira] [Updated] (FLINK-35661) MiniBatchGroupAggFunction can silently drop records under certain conditions

2024-10-08 Thread William Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Lin updated FLINK-35661: Attachment: image.png > MiniBatchGroupAggFunction can silently drop records under certain conditio

Re: [PR] [Flink 36245] Remove legacy SourceFunction / SinkFunction / Sink V1 API in 2.0 [flink]

2024-10-08 Thread via GitHub
lvyanquan commented on PR #25331: URL: https://github.com/apache/flink/pull/25331#issuecomment-2400340174 > @lvyanquan Hi, I find some examples under `flink-examples-streaming` cannot work due to the `flink-connector-kafka` version `3.0.0-1.17` still rely on `StatefulSink`. Is this expected

[jira] [Created] (FLINK-36443) Flaky Test: assertEquals in PushPartitionIntoTableSourceScanRuleTest.testWithUdf

2024-10-08 Thread William Lin (Jira)
William Lin created FLINK-36443: --- Summary: Flaky Test: assertEquals in PushPartitionIntoTableSourceScanRuleTest.testWithUdf Key: FLINK-36443 URL: https://issues.apache.org/jira/browse/FLINK-36443 Projec

[jira] [Updated] (FLINK-36441) Resource leaks in Kafka Tests

2024-10-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36441: --- Labels: pull-request-available (was: ) > Resource leaks in Kafka Tests > --

[PR] Bump org.apache.avro:avro from 1.11.3 to 1.11.4 [flink-connector-aws]

2024-10-08 Thread via GitHub
dependabot[bot] opened a new pull request, #175: URL: https://github.com/apache/flink-connector-aws/pull/175 Bumps org.apache.avro:avro from 1.11.3 to 1.11.4. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=org.

Re: [PR] [FLINK-36441] Ensure producers are not leaked [flink-connector-kafka]

2024-10-08 Thread via GitHub
fapaul commented on code in PR #126: URL: https://github.com/apache/flink-connector-kafka/pull/126#discussion_r1792038018 ## flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer.java: ## @@ -1246,8 +1230,18 @@ private Set generateNe

[jira] [Updated] (FLINK-20092) [Java 11] Multi-thread Flink compilation not working

2024-10-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-20092: --- Labels: auto-deprioritized-major auto-deprioritized-minor pull-request-available (was: auto

Re: [PR] [FLINK-20092] Bump maven-shade-plugin to 3.5.3 and maven-remote-resource-plugin to 3.2.0 [flink]

2024-10-08 Thread via GitHub
snuyanzin merged PR #25460: URL: https://github.com/apache/flink/pull/25460 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[jira] [Updated] (FLINK-35661) MiniBatchGroupAggFunction can silently drop records under certain conditions

2024-10-08 Thread Ivan Burmistrov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Burmistrov updated FLINK-35661: Priority: Blocker (was: Critical) > MiniBatchGroupAggFunction can silently drop records u

Re: [PR] Support config yaml [flink-kubernetes-operator]

2024-10-08 Thread via GitHub
ctrlaltdilj commented on code in PR #848: URL: https://github.com/apache/flink-kubernetes-operator/pull/848#discussion_r1786292910 ## helm/flink-kubernetes-operator/values.yaml: ## @@ -154,6 +154,9 @@ defaultConfiguration: # If set to false, loads just the overrides as in (2

[jira] [Commented] (FLINK-36442) Add option to handle insert-only changeless in Postgres CDC connector

2024-10-08 Thread Nandor Soma Abonyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887580#comment-17887580 ] Nandor Soma Abonyi commented on FLINK-36442: There's an existing PR that aim

[jira] [Updated] (FLINK-36442) Add option to handle insert-only changeless in Postgres CDC connector

2024-10-08 Thread Nandor Soma Abonyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Soma Abonyi updated FLINK-36442: --- Description: In the Postgres CDC connector, insert-only changelogs are incorrectly t

[jira] [Created] (FLINK-36442) Add option to handle insert-only changeless in Postgres CDC connector

2024-10-08 Thread Nandor Soma Abonyi (Jira)
Nandor Soma Abonyi created FLINK-36442: -- Summary: Add option to handle insert-only changeless in Postgres CDC connector Key: FLINK-36442 URL: https://issues.apache.org/jira/browse/FLINK-36442 Pro

[jira] [Created] (FLINK-36441) Resource leaks in Kafka Tests

2024-10-08 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-36441: --- Summary: Resource leaks in Kafka Tests Key: FLINK-36441 URL: https://issues.apache.org/jira/browse/FLINK-36441 Project: Flink Issue Type: Bug Affects Versi

[jira] [Commented] (FLINK-36435) Shaded Hadoop S3A with credentials provider end-to-end test failed

2024-10-08 Thread xuhuang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887562#comment-17887562 ] xuhuang commented on FLINK-36435: - I discovered that the reason for the test case failur

[jira] [Created] (FLINK-36440) Bump log4j from 2.17.1 to 2.23.1

2024-10-08 Thread Siddharth R (Jira)
Siddharth R created FLINK-36440: --- Summary: Bump log4j from 2.17.1 to 2.23.1 Key: FLINK-36440 URL: https://issues.apache.org/jira/browse/FLINK-36440 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-36171) Remove APIs about ManagedTable

2024-10-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-36171: --- Fix Version/s: 2.0.0 (was: 2.0-preview) > Remove APIs about ManagedTable > --

[jira] [Assigned] (FLINK-34984) FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-10-08 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-34984: --- Assignee: Zakelly Lan > FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP

[jira] [Updated] (FLINK-36439) Documentation for Disaggregated State Storage and Management

2024-10-08 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-36439: Component/s: Documentation > Documentation for Disaggregated State Storage and Management > -

[jira] [Created] (FLINK-36439) Documentation for Disaggregated State Storage and Management

2024-10-08 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-36439: --- Summary: Documentation for Disaggregated State Storage and Management Key: FLINK-36439 URL: https://issues.apache.org/jira/browse/FLINK-36439 Project: Flink

[jira] [Resolved] (FLINK-19034) Remove deprecated StreamExecutionEnvironment#set/getNumberOfExecutionRetries

2024-10-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo resolved FLINK-19034. Resolution: Done Already removed. > Remove deprecated StreamExecutionEnvironment#set/getNumberOfE

[jira] [Resolved] (FLINK-36433) non-keyed fullWindowPartition#reduce may throw NPE

2024-10-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo resolved FLINK-36433. Fix Version/s: 2.0-preview (was: 2.0.0) Resolution: Fixed master(2.0

[jira] [Updated] (FLINK-3957) Breaking changes for Flink 2.0

2024-10-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-3957: -- Fix Version/s: 2.0.0 (was: 2.0-preview) > Breaking changes for Flink 2.0 > -

[jira] [Commented] (FLINK-3957) Breaking changes for Flink 2.0

2024-10-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887553#comment-17887553 ] Weijie Guo commented on FLINK-3957: --- All sub-tasks target to 2.0-preview are done, chan

[jira] [Comment Edited] (FLINK-36437) Hive connector failed to compile with JDK 11

2024-10-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887543#comment-17887543 ] Weijie Guo edited comment on FLINK-36437 at 10/8/24 10:13 AM:

[jira] [Commented] (FLINK-36437) Hive connector failed to compile with JDK 11

2024-10-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887543#comment-17887543 ] Weijie Guo commented on FLINK-36437: Because Hive doesn't support JDK 11, can we ski

[jira] [Created] (FLINK-36438) Bump assertj from 3.23.1 to 3.26.3

2024-10-08 Thread Siddharth R (Jira)
Siddharth R created FLINK-36438: --- Summary: Bump assertj from 3.23.1 to 3.26.3 Key: FLINK-36438 URL: https://issues.apache.org/jira/browse/FLINK-36438 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-36437) Hive connector failed to compile with JDK 11

2024-10-08 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887523#comment-17887523 ] Leonard Xu commented on FLINK-36437: https://issues.apache.org/jira/browse/HIVE-2241

[jira] [Commented] (FLINK-31197) Unable to write Parquet files containing Arrays with complex types.

2024-10-08 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887499#comment-17887499 ] Robert Metzger commented on FLINK-31197: What's the relationship of this ticket

[jira] [Commented] (FLINK-33748) Remove legacy TableSource/TableSink API in 2.0

2024-10-08 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887507#comment-17887507 ] lincoln lee commented on FLINK-33748: - Split into two-steps: 1st, package moving wa

[jira] [Assigned] (FLINK-36437) Hive connector failed to compile with JDK 11

2024-10-08 Thread Xuannan Su (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuannan Su reassigned FLINK-36437: -- Assignee: Xuannan Su (was: Weijie Guo) > Hive connector failed to compile with JDK 11 >

  1   2   >