Re: [PR] Feature: [api][runtime] Introduce metric mechanism [flink-agents]

2025-07-23 Thread via GitHub
codenohup commented on code in PR #74: URL: https://github.com/apache/flink-agents/pull/74#discussion_r2227276274 ## runtime/src/main/java/org/apache/flink/agents/runtime/metrics/ActionMetricGroup.java: ## @@ -0,0 +1,72 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [D] Asynchronous Execution for Flink Agents [flink-agents]

2025-07-23 Thread via GitHub
GitHub user codenohup edited a discussion: Asynchronous Execution for Flink Agents - [1. Overview and Motivation](#1-overview-and-motivation) - [2. Current Synchronous Execution Flow](#2-current-synchronous-execution-flow) - [3. Asynchronous Execution Design](#3-asynchronous-execution-design)

Re: [D] Asynchronous Execution for Flink Agents [flink-agents]

2025-07-23 Thread via GitHub
GitHub user codenohup edited a discussion: Asynchronous Execution for Flink Agents ## 1. Overview and Motivation Flink Agents is an event-driven agent framework that executes a user-defined sequence of actions in response to each incoming input event. The processing of a single input event i

Re: [PR] [FLINK-32695] [Tests] Migrated SimpleStringGenerator to DataGeneratorSource [flink]

2025-07-23 Thread via GitHub
flinkbot commented on PR #26828: URL: https://github.com/apache/flink/pull/26828#issuecomment-3111844177 ## CI report: * abe314cbe52c7247fba212ef905be8cfb4d1e3d3 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-37783] Auto-disable buffer debloating for tiered shuffle. [flink]

2025-07-23 Thread via GitHub
codenohup commented on PR #26548: URL: https://github.com/apache/flink/pull/26548#issuecomment-3111842499 Hi, @dmvk Thank you for your contribution! I was wondering if it would be possible to backport this PR to the 1.20 branch as well. Currently, it looks a bit inconsistent — the commi

Re: [PR] [FLINK-37783] Auto-disable buffer debloating for tiered shuffle. [flink]

2025-07-23 Thread via GitHub
SteNicholas commented on PR #26548: URL: https://github.com/apache/flink/pull/26548#issuecomment-3111842488 @dmvk, @pnowojski, could this commit cherry pick to 1.20? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [FLINK-32695] Migrated SimpleStringGenerator to DataGeneratorSource [flink]

2025-07-23 Thread via GitHub
Poorvankbhatia commented on PR #26828: URL: https://github.com/apache/flink/pull/26828#issuecomment-3111837423 @afedulov PTAL Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[PR] [FLINK-32695] Migrated SimpleStringGenerator to DataGeneratorSource [flink]

2025-07-23 Thread via GitHub
Poorvankbhatia opened a new pull request, #26828: URL: https://github.com/apache/flink/pull/26828 ## What is the purpose of the change This PR migrates CheckpointedStreamingProgram from the deprecated legacy SourceFunction API to the modern FLIP-27 Source API. ## Brief

Re: [PR] [FLINK-35855][table] Upgrade Calcite version to 1.36.0 [flink]

2025-07-23 Thread via GitHub
liuyongvs commented on PR #26824: URL: https://github.com/apache/flink/pull/26824#issuecomment-3111769411 > it's failing in CI in multiple places > > also please before PR submission check that nobody is working on that especially if it is assigned to someone. I intentionally assigned

Re: [PR] [FLINK-35855][table] Upgrade Calcite version to 1.36.0 [flink]

2025-07-23 Thread via GitHub
liuyongvs closed pull request #26824: [FLINK-35855][table] Upgrade Calcite version to 1.36.0 URL: https://github.com/apache/flink/pull/26824 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[jira] [Updated] (FLINK-38139) Schema changes still caused issues after enabling scan.parse.online.schema.changes.enabled

2025-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-38139: --- Labels: pull-request-available (was: ) > Schema changes still caused issues after enabling

[PR] [FLINK-38139] Fix consecutive online schema change causes job failure. [flink-cdc]

2025-07-23 Thread via GitHub
lvyanquan opened a new pull request, #4064: URL: https://github.com/apache/flink-cdc/pull/4064 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[jira] [Assigned] (FLINK-38139) Schema changes still caused issues after enabling scan.parse.online.schema.changes.enabled

2025-07-23 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanquan Lv reassigned FLINK-38139: -- Assignee: Yanquan Lv > Schema changes still caused issues after enabling > scan.parse.online

[jira] [Commented] (FLINK-38139) Schema changes still caused issues after enabling scan.parse.online.schema.changes.enabled

2025-07-23 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009425#comment-18009425 ] Yanquan Lv commented on FLINK-38139: I have checked the code related to scan.parse.o

[jira] [Updated] (FLINK-38139) Schema changes still caused issues after enabling scan.parse.online.schema.changes.enabled

2025-07-23 Thread Yanquan Lv (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanquan Lv updated FLINK-38139: --- Description: I am currently using version 3.4.0 of FlinkCDC. I have a synchronization job with MySQL

[jira] [Created] (FLINK-38139) Schema changes still caused issues after enabling scan.parse.online.schema.changes.enabled

2025-07-23 Thread Yanquan Lv (Jira)
Yanquan Lv created FLINK-38139: -- Summary: Schema changes still caused issues after enabling scan.parse.online.schema.changes.enabled Key: FLINK-38139 URL: https://issues.apache.org/jira/browse/FLINK-38139

Re: [PR] [FLINK-35855][table] Upgrade Calcite to 1.36.0 [flink]

2025-07-23 Thread via GitHub
snuyanzin commented on code in PR #26827: URL: https://github.com/apache/flink/pull/26827#discussion_r2227077106 ## flink-table/flink-table-planner/pom.xml: ## @@ -87,6 +87,24 @@ under the License. 3.6.1 ${flink.markBundledAsOption

Re: [PR] [FLINK-35855][table] Upgrade Calcite to 1.36.0 [flink]

2025-07-23 Thread via GitHub
snuyanzin commented on code in PR #26827: URL: https://github.com/apache/flink/pull/26827#discussion_r2227074856 ## flink-table/flink-table-planner/src/main/java/org/apache/calcite/sql/util/ReflectiveSqlOperatorTable.java: ## @@ -0,0 +1,160 @@ +/* + * Licensed to the Apache Soft

Re: [PR] [FLINK-35855][table] Upgrade Calcite to 1.36.0 [flink]

2025-07-23 Thread via GitHub
snuyanzin commented on code in PR #26827: URL: https://github.com/apache/flink/pull/26827#discussion_r2227076260 ## flink-table/flink-table-planner/src/test/resources/org/apache/flink/table/planner/plan/batch/sql/PartitionableSinkTest.xml: ## @@ -101,14 +101,14 @@ Sink(table=[de

Re: [PR] [FLINK-35855][table] Upgrade Calcite to 1.36.0 [flink]

2025-07-23 Thread via GitHub
snuyanzin commented on code in PR #26827: URL: https://github.com/apache/flink/pull/26827#discussion_r2227072946 ## flink-table/flink-table-planner/src/main/java/org/apache/calcite/runtime/SqlFunctions.java: ## @@ -0,0 +1,5862 @@ +/* + * Licensed to the Apache Software Foundatio

Re: [PR] [FLINK-35855][table] Upgrade Calcite to 1.36.0 [flink]

2025-07-23 Thread via GitHub
snuyanzin commented on code in PR #26827: URL: https://github.com/apache/flink/pull/26827#discussion_r2227070768 ## flink-table/flink-sql-parser/src/main/java/org/apache/calcite/sql/SqlMapTypeNameSpec.java: ## @@ -0,0 +1,102 @@ +/* + * Licensed to the Apache Software Foundation

Re: [PR] [FLINK-35855][table] Upgrade Calcite to 1.36.0 [flink]

2025-07-23 Thread via GitHub
snuyanzin commented on code in PR #26827: URL: https://github.com/apache/flink/pull/26827#discussion_r2227070192 ## flink-table/flink-sql-parser/src/main/codegen/templates/Parser.jj: ## @@ -7512,6 +7572,8 @@ SqlIdentifier ReservedFunctionName() : | | | +

Re: [PR] [FLINK-35855][table] Upgrade Calcite to 1.36.0 [flink]

2025-07-23 Thread via GitHub
snuyanzin commented on code in PR #26827: URL: https://github.com/apache/flink/pull/26827#discussion_r2227069978 ## flink-table/flink-sql-parser/src/main/codegen/templates/Parser.jj: ## @@ -6867,6 +6901,32 @@ SqlCall JsonArrayAggFunctionCall() : } } + /** + * Parses the

Re: [PR] [hotfix] Fix weekly builds [flink-connector-opensearch]

2025-07-23 Thread via GitHub
snuyanzin merged PR #51: URL: https://github.com/apache/flink-connector-opensearch/pull/51 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubs

Re: [PR] [hotfix] Fix weekly builds [flink-connector-opensearch]

2025-07-23 Thread via GitHub
snuyanzin commented on code in PR #51: URL: https://github.com/apache/flink-connector-opensearch/pull/51#discussion_r2227040248 ## pom.xml: ## @@ -383,6 +380,28 @@ under the License. + + opensearch1 +

Re: [PR] [FLINK-35855][table] Upgrade Calcite version to 1.36.0 [flink]

2025-07-23 Thread via GitHub
snuyanzin commented on PR #26824: URL: https://github.com/apache/flink/pull/26824#issuecomment-3111547698 it's failing in CI in multiple places also please before PR submission check that nobody is working on that especially if it is assigned to someone. I intentionally assigned it

Re: [PR] [hotfix] Fix weekly builds [flink-connector-opensearch]

2025-07-23 Thread via GitHub
reta commented on code in PR #51: URL: https://github.com/apache/flink-connector-opensearch/pull/51#discussion_r2226935186 ## pom.xml: ## @@ -383,6 +380,28 @@ under the License. + + opensearch1 + +

Re: [PR] [hotfix] Fix weekly builds [flink-connector-opensearch]

2025-07-23 Thread via GitHub
snuyanzin commented on code in PR #51: URL: https://github.com/apache/flink-connector-opensearch/pull/51#discussion_r2226920687 ## pom.xml: ## @@ -383,6 +380,28 @@ under the License. + + opensearch1 +

Re: [PR] [FLINK-35855][table] Upgrade Calcite to 1.36.0 [flink]

2025-07-23 Thread via GitHub
flinkbot commented on PR #26827: URL: https://github.com/apache/flink/pull/26827#issuecomment-3110546164 ## CI report: * 6dfb4ccecaf600598a8b436af7fd55fe8db767e1 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-35855][table] Upgrade Calcite to 1.36.0 [flink]

2025-07-23 Thread via GitHub
snuyanzin opened a new pull request, #26827: URL: https://github.com/apache/flink/pull/26827 The PR bumps Calcite to 1.36.0 ## Brief change log ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependen

Re: [PR] [FLINK-38109] [flink-runtime] Fix BlobClient address when bindhost is set [flink]

2025-07-23 Thread via GitHub
rosakng commented on PR #26811: URL: https://github.com/apache/flink/pull/26811#issuecomment-3110074069 > While the existing tests have been updated to use `getBlobServer().getAddress()`, there's no test that specifically reproduces the bug described in [FLINK-38109](https://issues.apache.

Re: [PR] [FLINK-38109] [flink-runtime] Fix BlobClient address when bindhost is set [flink]

2025-07-23 Thread via GitHub
rosakng commented on code in PR #26811: URL: https://github.com/apache/flink/pull/26811#discussion_r2226603772 ## flink-runtime/src/test/java/org/apache/flink/runtime/blob/NoOpTaskExecutorBlobService.java: ## @@ -37,6 +38,11 @@ public int getPort() { return 0; }

Re: [PR] [FLINK-38109] [flink-runtime] Fix BlobClient address when bindhost is set [flink]

2025-07-23 Thread via GitHub
rosakng commented on code in PR #26811: URL: https://github.com/apache/flink/pull/26811#discussion_r2226598798 ## flink-runtime/src/main/java/org/apache/flink/runtime/blob/BlobService.java: ## @@ -43,4 +44,6 @@ public interface BlobService extends Closeable { * @return the

Re: [PR] [FLINK-38109] [flink-runtime] Fix BlobClient address when bindhost is set [flink]

2025-07-23 Thread via GitHub
rosakng commented on code in PR #26811: URL: https://github.com/apache/flink/pull/26811#discussion_r2226598798 ## flink-runtime/src/main/java/org/apache/flink/runtime/blob/BlobService.java: ## @@ -43,4 +44,6 @@ public interface BlobService extends Closeable { * @return the

Re: [PR] [FLINK-38138] Fix OOB error in ColumnarArrayData [flink]

2025-07-23 Thread via GitHub
flinkbot commented on PR #26826: URL: https://github.com/apache/flink/pull/26826#issuecomment-3109833406 ## CI report: * 493c9562cffc887da8ddb6e50d298b46d43166d0 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-38138) Array OOB error when trying to get a binary from a non-zero offset from a vector

2025-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-38138: --- Labels: pull-request-available (was: ) > Array OOB error when trying to get a binary from a

[PR] [FLINK-38138] Fix OOB error in ColumnarArrayData [flink]

2025-07-23 Thread via GitHub
voonhous opened a new pull request, #26826: URL: https://github.com/apache/flink/pull/26826 ## What is the purpose of the change We have noticed that an OOB error is being thrown when trying to invoke getBinary when the following conditions are met: 1. There are multiple elemen

[jira] [Created] (FLINK-38138) Array OOB error when trying to get a binary from a non-zero offset from a vector

2025-07-23 Thread Voon Hou (Jira)
Voon Hou created FLINK-38138: Summary: Array OOB error when trying to get a binary from a non-zero offset from a vector Key: FLINK-38138 URL: https://issues.apache.org/jira/browse/FLINK-38138 Project: Fli

[jira] [Resolved] (FLINK-38035) Security Vulnerability in PyFlink Logging Mechanism (PythonEnvUtils.java)

2025-07-23 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-38035. Fix Version/s: 2.2.0 Resolution: Fixed Resolved in master for 2.2: https://github.

Re: [PR] [FLINK-38035][Python][PythonEnvUtils] Redact sensitive env vars in PythonEnvUtils logging [flink]

2025-07-23 Thread via GitHub
rmetzger merged PR #26803: URL: https://github.com/apache/flink/pull/26803 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] [FLINK-38136][table] Add restore tests for PTFs [flink]

2025-07-23 Thread via GitHub
flinkbot commented on PR #26825: URL: https://github.com/apache/flink/pull/26825#issuecomment-3109225249 ## CI report: * 3ee10b8369dc51bbe424284545e42e2fa4300369 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-38136) Add restore tests for PTFs

2025-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-38136: --- Labels: pull-request-available (was: ) > Add restore tests for PTFs > -

[PR] [FLINK-38136][table] Add restore tests for PTFs [flink]

2025-07-23 Thread via GitHub
raminqaf opened a new pull request, #26825: URL: https://github.com/apache/flink/pull/26825 ## What is the purpose of the change This pull request adds comprehensive restore tests for Process Table Functions (PTFs) to ensure state recovery works correctly across different PTF scenari

[jira] [Commented] (FLINK-37483) Native kubernetes clusters losing checkpoint state on FAILED

2025-07-23 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009309#comment-18009309 ] Matthias Pohl commented on FLINK-37483: --- Ah ok, it took me a bit to get this right

[jira] [Commented] (FLINK-38135) Non-existent method for RAW type hashing

2025-07-23 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009307#comment-18009307 ] lincoln lee commented on FLINK-38135: - [~dylanhz] assigned to you > Non-existent me

[jira] [Assigned] (FLINK-38135) Non-existent method for RAW type hashing

2025-07-23 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee reassigned FLINK-38135: --- Assignee: dylanhz > Non-existent method for RAW type hashing >

Re: [PR] [Python] Support for Event containing Row field can be json serializable [flink-agents]

2025-07-23 Thread via GitHub
Kavishankarks commented on PR #63: URL: https://github.com/apache/flink-agents/pull/63#issuecomment-3109034921 @wenjin272 shall I make the suggested changes? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[jira] [Commented] (FLINK-38137) RocksDB State Backend Null Serialization Causes NPE and Asymmetric (De)Serialization Logic

2025-07-23 Thread Ramin Gharib (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009255#comment-18009255 ] Ramin Gharib commented on FLINK-38137: -- [~nishita0905] This gets more complicated i

[jira] [Updated] (FLINK-38137) RocksDB State Backend Null Serialization Causes NPE and Asymmetric (De)Serialization Logic

2025-07-23 Thread Ramin Gharib (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramin Gharib updated FLINK-38137: - Description: The RocksDB state backend has a critical flaw in its handling of null values, whic

[jira] [Comment Edited] (FLINK-38137) RocksDB State Backend Null Serialization Causes NPE and Asymmetric (De)Serialization Logic

2025-07-23 Thread Nishita Pattanayak (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009251#comment-18009251 ] Nishita Pattanayak edited comment on FLINK-38137 at 7/23/25 1:00 PM: -

[jira] [Commented] (FLINK-38137) RocksDB State Backend Null Serialization Causes NPE and Asymmetric (De)Serialization Logic

2025-07-23 Thread Nishita Pattanayak (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009251#comment-18009251 ] Nishita Pattanayak commented on FLINK-38137: [~raminqaf] This seems to be a

Re: [PR] [FLINK-37583] Upgrade to Kafka 4.0.0 client. [flink-connector-kafka]

2025-07-23 Thread via GitHub
tomncooper commented on PR #161: URL: https://github.com/apache/flink-connector-kafka/pull/161#issuecomment-3108092071 Ok, I have no idea why but rebasing on main has lead to [green tests](https://github.com/tomncooper/flink-connector-kafka/actions/runs/16470498973) on my fork. I a

[PR] Create Accepted [flink-cdc]

2025-07-23 Thread via GitHub
LESSSOUL3 opened a new pull request, #4063: URL: https://github.com/apache/flink-cdc/pull/4063 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] Create Accepted [flink-cdc]

2025-07-23 Thread via GitHub
LESSSOUL3 closed pull request #4063: Create Accepted URL: https://github.com/apache/flink-cdc/pull/4063 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (FLINK-38137) RocksDB State Backend Null Serialization Causes NPE and Asymmetric (De)Serialization Logic

2025-07-23 Thread Ramin Gharib (Jira)
Ramin Gharib created FLINK-38137: Summary: RocksDB State Backend Null Serialization Causes NPE and Asymmetric (De)Serialization Logic Key: FLINK-38137 URL: https://issues.apache.org/jira/browse/FLINK-38137

[jira] [Closed] (FLINK-38114) Allow offloading of task restore to avoid pekko.framesize exceeded errors on task deploy

2025-07-23 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan closed FLINK-38114. - Assignee: Aleksandr Iushmanov Resolution: Fixed Merged into master as 6b0426c7c08e

Re: [PR] [FLINK-38114][runtime] Allow asynchronous offloading of TaskRestore [flink]

2025-07-23 Thread via GitHub
rkhachatryan merged PR #26821: URL: https://github.com/apache/flink/pull/26821 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

[jira] [Created] (FLINK-38136) Add restore tests for PTFs

2025-07-23 Thread Ramin Gharib (Jira)
Ramin Gharib created FLINK-38136: Summary: Add restore tests for PTFs Key: FLINK-38136 URL: https://issues.apache.org/jira/browse/FLINK-38136 Project: Flink Issue Type: Sub-task R

Re: [I] [Feature][api] Introduce Prompt, Tool and ChatModel [flink-agents]

2025-07-23 Thread via GitHub
xintongsong commented on issue #56: URL: https://github.com/apache/flink-agents/issues/56#issuecomment-3107411569 No problem. For agility, we may not have thoroughly discussed over the design before implementation. But as a new project, we have no compatibility concerns until we claim the p

Re: [PR] Feature: [api][runtime] Introduce metric mechanism [flink-agents]

2025-07-23 Thread via GitHub
xintongsong commented on code in PR #74: URL: https://github.com/apache/flink-agents/pull/74#discussion_r2225092506 ## runtime/src/main/java/org/apache/flink/agents/runtime/metrics/ActionMetricGroup.java: ## @@ -0,0 +1,72 @@ +/* + * Licensed to the Apache Software Foundation (AS

Re: [PR] [FLINK-37583] Upgrade to Kafka 4.0.0 client. [flink-connector-kafka]

2025-07-23 Thread via GitHub
tomncooper commented on PR #161: URL: https://github.com/apache/flink-connector-kafka/pull/161#issuecomment-3106993926 Ok I am stumped? Locally I run (with maven 3.8.6 and java 17): ```shell mvn clean deploy -U -B --no-transfer-progress -Dflink.version=2.0.0 \ -DaltDeploymentRe

Re: [PR] [FLINK-37294][state] Support state migration between disabling and enabling ttl in HeapKeyedStateBackend [flink]

2025-07-23 Thread via GitHub
Zakelly commented on PR #26651: URL: https://github.com/apache/flink/pull/26651#issuecomment-3106934840 Thanks for the update! I'll take a look this week. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [I] [Feature][api] Introduce Prompt, Tool and ChatModel [flink-agents]

2025-07-23 Thread via GitHub
AmenAdem commented on issue #56: URL: https://github.com/apache/flink-agents/issues/56#issuecomment-3106914894 Hi @xintongsong and @wenjin272 , Thank you both for the warm welcome and for bringing me into this collaboration! @wenjin272 , I ll dive into design doc and review your Python

Re: [PR] [FLINK-37583] Upgrade to Kafka 4.0.0 client. [flink-connector-kafka]

2025-07-23 Thread via GitHub
fapaul commented on PR #161: URL: https://github.com/apache/flink-connector-kafka/pull/161#issuecomment-3106870900 > @fapaul This PR already updated the docs to say Kafka 2.1.0 or later. Do you think it needs more in depth description? I am happy to add that, but I will need to create a JI

Re: [PR] [FLINK-37583] Upgrade to Kafka 4.0.0 client. [flink-connector-kafka]

2025-07-23 Thread via GitHub
tomncooper commented on PR #161: URL: https://github.com/apache/flink-connector-kafka/pull/161#issuecomment-3106759024 @fapaul This PR already updated the docs to say Kafka 2.1.0 or later. Do you think it needs more in depth description? I am happy to add that but will need to create a JIR

Re: [PR] [FLINK-35855][table] Upgrade Calcite version to 1.36.0 [flink]

2025-07-23 Thread via GitHub
flinkbot commented on PR #26824: URL: https://github.com/apache/flink/pull/26824#issuecomment-3106717637 ## CI report: * 20d6d66369525190db6cdb23918762cd591d7feb UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35855) Upgrade Calcite version to 1.36.0

2025-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35855: --- Labels: pull-request-available (was: ) > Upgrade Calcite version to 1.36.0 > --

[jira] [Updated] (FLINK-38114) Allow offloading of task restore to avoid pekko.framesize exceeded errors on task deploy

2025-07-23 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan updated FLINK-38114: -- Affects Version/s: 2.0.0 > Allow offloading of task restore to avoid pekko.framesize e

[jira] [Updated] (FLINK-38114) Allow offloading of task restore to avoid pekko.framesize exceeded errors on task deploy

2025-07-23 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan updated FLINK-38114: -- Fix Version/s: 2.2 > Allow offloading of task restore to avoid pekko.framesize exceede

[PR] [FLINK-35855][table] Upgrade Calcite version to 1.36.0 [flink]

2025-07-23 Thread via GitHub
liuyongvs opened a new pull request, #26824: URL: https://github.com/apache/flink/pull/26824 ## What is the purpose of the change *Upgrade Calcite to 1.36.0* ## Brief change log ## Verifying this change *existing tests* ## Does this pull request pote

[jira] [Commented] (FLINK-36746) Found deadlock in SerializedThrowable

2025-07-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009188#comment-18009188 ] Yun Tang commented on FLINK-36746: -- [~xiongraorao] do you still have time to update the

Re: [D] Time Plan for the first MVP version of Flink Agents [flink-agents]

2025-07-23 Thread via GitHub
GitHub user xintongsong edited a discussion: Time Plan for the first MVP version of Flink Agents We are targeting a MVP version of Flink Agents (0.1.0) in around end of September. That is 16 weeks from now, and here is a rough time plan. # Phase 1: Week 1-3 (Jun 12 - Jul 2) - [x] Preparation

[I] [Feature] [api] Introduce Prompt, Tool and ChatModel in java [flink-agents]

2025-07-23 Thread via GitHub
wenjin272 opened a new issue, #77: URL: https://github.com/apache/flink-agents/issues/77 ### Search before asking - [x] I searched in the [issues](https://github.com/apache/flink-agents/issues) and found nothing similar. ### Description Introduce Prompt, Tool and ChatMo

[I] [Feature] [api] Introduce Prompt, Tool and ChatModel in Python [flink-agents]

2025-07-23 Thread via GitHub
wenjin272 opened a new issue, #76: URL: https://github.com/apache/flink-agents/issues/76 ### Search before asking - [x] I searched in the [issues](https://github.com/apache/flink-agents/issues) and found nothing similar. ### Description Introduce Prompt, Tool and ChatMo

Re: [I] [Feature][api] Introduce Prompt, Tool and ChatModel [flink-agents]

2025-07-23 Thread via GitHub
wenjin272 commented on issue #56: URL: https://github.com/apache/flink-agents/issues/56#issuecomment-3106612939 Hi @AmenAdem , Thanks for your interest. I have posted the design doc #75. And as @xintongsong said, I have implemented some code on the python part, and will create pr these d

Re: [PR] [FLINK-38111] [oceanbase]:Migrate OceanBase CDC Connector from LogProxy to Binlog Service. [flink-cdc]

2025-07-23 Thread via GitHub
yuanoOo commented on code in PR #4061: URL: https://github.com/apache/flink-cdc/pull/4061#discussion_r2224820535 ## docs/content/docs/connectors/flink-sources/oceanbase-cdc.md: ## @@ -433,434 +498,429 @@ Available Metadata The following format metadata can be exposed as read-on

Re: [PR] [FLINK-38111] [oceanbase]:Migrate OceanBase CDC Connector from LogProxy to Binlog Service. [flink-cdc]

2025-07-23 Thread via GitHub
yuanoOo commented on code in PR #4061: URL: https://github.com/apache/flink-cdc/pull/4061#discussion_r2224819428 ## docs/content/docs/connectors/flink-sources/oceanbase-cdc.md: ## @@ -433,434 +498,429 @@ Available Metadata The following format metadata can be exposed as read-on

Re: [PR] [FLINK-38111] [oceanbase]:Migrate OceanBase CDC Connector from LogProxy to Binlog Service. [flink-cdc]

2025-07-23 Thread via GitHub
yuanoOo commented on code in PR #4061: URL: https://github.com/apache/flink-cdc/pull/4061#discussion_r2224818943 ## docs/content/docs/connectors/flink-sources/oceanbase-cdc.md: ## @@ -433,434 +498,429 @@ Available Metadata The following format metadata can be exposed as read-on

Re: [PR] [FLINK-38135][table] Fix call to non-existent method for RAW type hashing [flink]

2025-07-23 Thread via GitHub
flinkbot commented on PR #26823: URL: https://github.com/apache/flink/pull/26823#issuecomment-3106513203 ## CI report: * 0303d15def3a0971e9ce94c149c1fcfd313a8b75 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-38135) Non-existent method for RAW type hashing

2025-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-38135: --- Labels: pull-request-available (was: ) > Non-existent method for RAW type hashing > ---

[PR] [FLINK-38135][table] Fix call to non-existent method for RAW type hashing [flink]

2025-07-23 Thread via GitHub
dylanhz opened a new pull request, #26823: URL: https://github.com/apache/flink/pull/26823 ## What is the purpose of the change Fix call to non-existent method for RAW type hashing. ## Brief change log Use `BinaryRawValueData#toObject`. ## Verifying this change

Re: [I] [Feature][api] Support ReAct Agent [flink-agents]

2025-07-23 Thread via GitHub
xintongsong commented on issue #57: URL: https://github.com/apache/flink-agents/issues/57#issuecomment-3106488718 @kitalkuyo-gita The proposed feature design neither align with the overall design nor applicable to the current project code base. Please avoid throwing such random AI-genera

Re: [PR] [FLINK-37914][table] Add built-in OBJECT_UPDATE function [flink]

2025-07-23 Thread via GitHub
raminqaf commented on code in PR #26806: URL: https://github.com/apache/flink/pull/26806#discussion_r2224775639 ## flink-python/pyflink/table/expression.py: ## @@ -2193,6 +2193,55 @@ def json_unquote(self) -> 'Expression': """ return _unary_op("jsonUnquote")(se

[jira] [Commented] (FLINK-36746) Found deadlock in SerializedThrowable

2025-07-23 Thread RocMarshal (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009172#comment-18009172 ] RocMarshal commented on FLINK-36746: Hey, [~yunta] [~xiongraorao] , any new developm

Re: [I] [Feature][api] Introduce Prompt, Tool and ChatModel [flink-agents]

2025-07-23 Thread via GitHub
xintongsong commented on issue #56: URL: https://github.com/apache/flink-agents/issues/56#issuecomment-3106383740 Hi @AmenAdem , Thanks for your interest. @wenjin272 has already been working on a design doc (which should be posted very soon) and some code implementations. But AFAIk his w

Re: [PR] [FLINK-37583] Upgrade to Kafka 4.0.0 client. [flink-connector-kafka]

2025-07-23 Thread via GitHub
fapaul commented on PR #161: URL: https://github.com/apache/flink-connector-kafka/pull/161#issuecomment-3106304181 Thanks for the thorough explanation. In summary, in addition to dropping support for 0.x versions (has been done in the past already), we also now drop support for everything,

[jira] [Commented] (FLINK-37483) Native kubernetes clusters losing checkpoint state on FAILED

2025-07-23 Thread Max Feng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009158#comment-18009158 ] Max Feng commented on FLINK-37483: -- Hm, it looks like we have a log that was removed 2

Re: [D] Community Sync [flink-agents]

2025-07-23 Thread via GitHub
GitHub user xintongsong edited a discussion: Community Sync There's a community sync for discussing developing progress, technical designs and community issues about Flink Agents. Everyone is welcome to join. * Schedule: 3am Wed UTC * Google Calendar: https://calendar.google.com/calendar/even

[jira] [Commented] (FLINK-38135) Non-existent method for RAW type hashing

2025-07-23 Thread dylanhz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009155#comment-18009155 ] dylanhz commented on FLINK-38135: - Hi [~lincoln.86xy], I'd like to work on this issue. C

[jira] [Created] (FLINK-38135) Non-existent method for RAW type hashing

2025-07-23 Thread dylanhz (Jira)
dylanhz created FLINK-38135: --- Summary: Non-existent method for RAW type hashing Key: FLINK-38135 URL: https://issues.apache.org/jira/browse/FLINK-38135 Project: Flink Issue Type: Bug Comp

[jira] [Commented] (FLINK-38134) Cannot recognize DropColumnEvent in method SchemaMergingUtils.getSchemaDifference.

2025-07-23 Thread yangyu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009153#comment-18009153 ] yangyu commented on FLINK-38134: we solve it as: {code:java} public static List getSchem

[jira] [Updated] (FLINK-38134) Cannot recognize DropColumnEvent in method SchemaMergingUtils.getSchemaDifference.

2025-07-23 Thread yangyu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yangyu updated FLINK-38134: --- Description: Only AddColumnEvent and AlterColumnTypeEvent can be re > Cannot recognize DropColumnEvent in me

[jira] [Updated] (FLINK-38134) Cannot recognize DropColumnEvent in method SchemaMergingUtils.getSchemaDifference.

2025-07-23 Thread yangyu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yangyu updated FLINK-38134: --- Description: Only AddColumnEvent and AlterColumnTypeEvent can be recognized now. (was: Only AddColumnEvent

[jira] [Created] (FLINK-38134) Cannot recognize DropColumnEvent in method SchemaMergingUtils.getSchemaDifference.

2025-07-23 Thread yangyu (Jira)
yangyu created FLINK-38134: -- Summary: Cannot recognize DropColumnEvent in method SchemaMergingUtils.getSchemaDifference. Key: FLINK-38134 URL: https://issues.apache.org/jira/browse/FLINK-38134 Project: Flink

[jira] [Commented] (FLINK-37483) Native kubernetes clusters losing checkpoint state on FAILED

2025-07-23 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009152#comment-18009152 ] Matthias Pohl commented on FLINK-37483: --- Thanks for bringing this up [~jeremymu] a

[jira] [Commented] (FLINK-38133) Unable to find checkpoint info during Flink jm pod restart on k8s,running mode is nativekubenetes,jobmanager created by deployment

2025-07-23 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009150#comment-18009150 ] Matthias Pohl commented on FLINK-38133: --- Linking the two because the described beh