[jira] [Closed] (FLINK-34481) Migrate SetOpRewriteUtil

2024-02-29 Thread Jacky Lau (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacky Lau closed FLINK-34481. - Release Note: merged f523b9d6191ecb584e36aa2aeffcd0659ce231f7 Resolution: Fixed > Migrate SetOpRew

[jira] [Commented] (FLINK-34481) Migrate SetOpRewriteUtil

2024-02-29 Thread Jacky Lau (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822434#comment-17822434 ] Jacky Lau commented on FLINK-34481: --- Merged f523b9d6191ecb584e36aa2aeffcd0659ce231f7

Re: [PR] [hotfix][runtime] Remove unneeded requestTaskManagerFileUploadByName [flink]

2024-02-29 Thread via GitHub
1996fanrui merged PR #24386: URL: https://github.com/apache/flink/pull/24386 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.ap

Re: [PR] [hotfix][runtime] Remove unneeded requestTaskManagerFileUploadByName [flink]

2024-02-29 Thread via GitHub
1996fanrui commented on PR #24386: URL: https://github.com/apache/flink/pull/24386#issuecomment-1972683847 Thanks @yuchen-ecnu for the review, merging~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[jira] [Commented] (FLINK-34380) Strange RowKind and records about intermediate output when using minibatch join

2024-02-29 Thread Shuai Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822433#comment-17822433 ] Shuai Xu commented on FLINK-34380: -- Let me take a look. > Strange RowKind and records

Re: [PR] [FLINK-34481][table] Migrate SetOpRewriteUtil to java [flink]

2024-02-29 Thread via GitHub
JingGe merged PR #24358: URL: https://github.com/apache/flink/pull/24358 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

Re: [PR] [FLINK-34522][core] Changing the Time to Duration for StateTtlConfig.Builder.cleanupInRocksdbCompactFilter [flink]

2024-02-29 Thread via GitHub
1996fanrui commented on PR #24387: URL: https://github.com/apache/flink/pull/24387#issuecomment-1972677393 Many thanks @HuangXingBo for the debug. I'm on vacation and don't take my Mac, so my colleague @RocMarshal helps fix this for 1.19 first due to 1.19 will be released soon.

Re: [PR] [FLINK-xxxxx][api] Introduce DataStream, Partitioning and ProcessFunction [flink]

2024-02-29 Thread via GitHub
flinkbot commented on PR #24422: URL: https://github.com/apache/flink/pull/24422#issuecomment-1972653582 ## CI report: * cb4615792281b375a45da41795e9f1a0cd70ae2d UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-34487) Integrate tools/azure-pipelines/build-python-wheels.yml into GHA nightly workflow

2024-02-29 Thread Muhammet Orazov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822420#comment-17822420 ] Muhammet Orazov commented on FLINK-34487: - Hey [~mapohl], I'd like to work on th

[PR] [FLINK-xxxxx][api] Introduce DataStream, Partitioning and ProcessFunction [flink]

2024-02-29 Thread via GitHub
reswqa opened a new pull request, #24422: URL: https://github.com/apache/flink/pull/24422 ## What is the purpose of the change *This is the first PR for DataStream V2, and aim to implement FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction *

Re: [PR] [FLINK-34535] Support JobPlanInfo for the explain result [flink]

2024-02-29 Thread via GitHub
huyuanfeng2018 commented on PR #24411: URL: https://github.com/apache/flink/pull/24411#issuecomment-1972635698 > Hi @huyuanfeng2018 thanks for the PR. I have a few comments: > > * Please add `JSON_JOB_PLAN ` to the `python` API (e.g., to the `basic_operations.py`) and test it there

[jira] [Updated] (FLINK-34180) Accept Flink CDC project as part of Apache Flink

2024-02-29 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-34180: --- Description: As discussed in  Flink dev  mailing list[1][2], we have accepted the Flink CDC project

[jira] [Commented] (FLINK-34529) Projection cannot be pushed down through rank operator.

2024-02-29 Thread yisha zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822415#comment-17822415 ] yisha zhou commented on FLINK-34529: hi [~lincoln.86xy] , thanks for your advice. A

[jira] [Updated] (FLINK-34548) FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

2024-02-29 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-34548: --- Labels: (was: Umbrella) > FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and >

[jira] [Updated] (FLINK-34548) FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

2024-02-29 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-34548: --- Description: This is the ticket for FLIP-409: DataStream V2 Building Blocks: DataStream, Partitionin

[jira] [Commented] (FLINK-34380) Strange RowKind and records about intermediate output when using minibatch join

2024-02-29 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822401#comment-17822401 ] xuyang commented on FLINK-34380: Hi,  [~xu_shuai_] . Can you help check it again? > Str

[jira] [Commented] (FLINK-34535) Support JobPlanInfo for the explain result

2024-02-29 Thread yuanfenghu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822399#comment-17822399 ] yuanfenghu commented on FLINK-34535: [~lincoln.86xy]  Thank you for your comment, >

Re: [PR] [FLINK-29114][connector][filesystem] Fix issue of file overwriting caused by multiple writes to the same sink table and shared staging directory [flink]

2024-02-29 Thread via GitHub
LadyForest commented on code in PR #24390: URL: https://github.com/apache/flink/pull/24390#discussion_r1508526295 ## flink-connectors/flink-connector-files/src/main/java/org/apache/flink/connector/file/table/utils/PathUtils.java: ## @@ -0,0 +1,51 @@ +/* + * Licensed to the Apach

[jira] [Comment Edited] (FLINK-34535) Support JobPlanInfo for the explain result

2024-02-29 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822390#comment-17822390 ] lincoln lee edited comment on FLINK-34535 at 3/1/24 5:43 AM: -

[jira] [Commented] (FLINK-34535) Support JobPlanInfo for the explain result

2024-02-29 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822390#comment-17822390 ] lincoln lee commented on FLINK-34535: - [~heigebupahei] The current `explain` syntax

Re: [PR] [FLINK-34556][table] Migrate EnumerableToLogicalTableScan to java. [flink]

2024-02-29 Thread via GitHub
flinkbot commented on PR #24421: URL: https://github.com/apache/flink/pull/24421#issuecomment-1972492174 ## CI report: * c060447bb29118c3127c63eb09290a8c02c43e85 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-34556) Migrate EnumerableToLogicalTableScan

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-34556: --- Labels: pull-request-available (was: ) > Migrate EnumerableToLogicalTableScan > ---

[PR] [FLINK-34556][table] Migrate EnumerableToLogicalTableScan to java. [flink]

2024-02-29 Thread via GitHub
liuyongvs opened a new pull request, #24421: URL: https://github.com/apache/flink/pull/24421 ## What is the purpose of the change The PR migrates EnumerableToLogicalTableScan to java it doesn't touch EnumerableToLogicalTableScanTest to be sure that java version continues passing it

[jira] [Created] (FLINK-34556) Migrate EnumerableToLogicalTableScan

2024-02-29 Thread Jacky Lau (Jira)
Jacky Lau created FLINK-34556: - Summary: Migrate EnumerableToLogicalTableScan Key: FLINK-34556 URL: https://issues.apache.org/jira/browse/FLINK-34556 Project: Flink Issue Type: Sub-task

Re: [PR] [FLINK-34483][docs] Improve the documentation of 'state.checkpoints.dir' and 'state.checkpoint-storage' [flink]

2024-02-29 Thread via GitHub
fredia commented on code in PR #24401: URL: https://github.com/apache/flink/pull/24401#discussion_r1508457644 ## flink-core/src/main/java/org/apache/flink/configuration/CheckpointingOptions.java: ## @@ -76,6 +76,39 @@ public class CheckpointingOptions { * CheckpointStorage

Re: [PR] [FLINK-34522][core] Changing the Time to Duration for StateTtlConfig.Builder.cleanupInRocksdbCompactFilter [flink]

2024-02-29 Thread via GitHub
HuangXingBo commented on code in PR #24417: URL: https://github.com/apache/flink/pull/24417#discussion_r1508454782 ## flink-python/pyflink/datastream/state.py: ## @@ -809,7 +809,7 @@ def cleanup_incrementally(self, def cleanup_in_rocksdb_compact_filter(

[jira] [Commented] (FLINK-34529) Projection cannot be pushed down through rank operator.

2024-02-29 Thread yisha zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822363#comment-17822363 ] yisha zhou commented on FLINK-34529: [~libenchao]  Thanks for assigning the ticket t

[jira] [Commented] (FLINK-34529) Projection cannot be pushed down through rank operator.

2024-02-29 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822362#comment-17822362 ] lincoln lee commented on FLINK-34529: - [~nilerzhou] Thanks for reporting this! As yo

[jira] [Updated] (FLINK-34555) Migrate JoinConditionTypeCoerceRule

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-34555: --- Labels: pull-request-available (was: ) > Migrate JoinConditionTypeCoerceRule >

Re: [PR] [FLINK-34555][table] Migrate JoinConditionTypeCoerceRule to java. [flink]

2024-02-29 Thread via GitHub
flinkbot commented on PR #24420: URL: https://github.com/apache/flink/pull/24420#issuecomment-1972439916 ## CI report: * 0183b6bb862ceaf1ef3ff96896ac5d673ba59493 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] Join condition type coerce rule [flink]

2024-02-29 Thread via GitHub
liuyongvs opened a new pull request, #24420: URL: https://github.com/apache/flink/pull/24420 ## What is the purpose of the change The PR migrates JoinConditionTypeCoerceRule to java it doesn't touch JoinConditionTypeCoerceRuleTest to be sure that java version continues passing it

[jira] [Created] (FLINK-34555) Migrate JoinConditionTypeCoerceRule

2024-02-29 Thread Jacky Lau (Jira)
Jacky Lau created FLINK-34555: - Summary: Migrate JoinConditionTypeCoerceRule Key: FLINK-34555 URL: https://issues.apache.org/jira/browse/FLINK-34555 Project: Flink Issue Type: Sub-task

Re: [PR] [BP-1.18][FLINK-34517][table]fix environment configs ignored when calling procedure operation [flink]

2024-02-29 Thread via GitHub
flinkbot commented on PR #24419: URL: https://github.com/apache/flink/pull/24419#issuecomment-1972391441 ## CI report: * b514f6bb29bd04049073b0762eacbce63d85e5ba UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-34517][table]fix environment configs ignored when calling procedure operation [flink]

2024-02-29 Thread via GitHub
JustinLeesin commented on PR #24397: URL: https://github.com/apache/flink/pull/24397#issuecomment-1972389996 > @JustinLeesin Thanks for update. LGTM. I'll merge to master after 1.19 branch cut @luoyuxia OK, Thank you for taking the time to review my code. -- This is an automated me

[jira] [Commented] (FLINK-16627) Support only generate non-null values when serializing into JSON

2024-02-29 Thread Benchao Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822358#comment-17822358 ] Benchao Li commented on FLINK-16627: [~nilerzhou] Thank you for the interest of cont

[jira] [Assigned] (FLINK-16627) Support only generate non-null values when serializing into JSON

2024-02-29 Thread Benchao Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benchao Li reassigned FLINK-16627: -- Assignee: yisha zhou > Support only generate non-null values when serializing into JSON > ---

[jira] [Commented] (FLINK-34536) Support reading long value as Timestamp column in JSON format

2024-02-29 Thread Benchao Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822357#comment-17822357 ] Benchao Li commented on FLINK-34536: It sounds like a useful feature from the user p

Re: [PR] [FLINK-34517][table]fix environment configs ignored when calling procedure operation [flink]

2024-02-29 Thread via GitHub
JustinLeesin commented on PR #24397: URL: https://github.com/apache/flink/pull/24397#issuecomment-1972385924 > @JustinLeesin Could you please cherry pick it to release-1.18. I'll merge to 1.18 firstly. @luoyuxia Done , [24414](https://github.com/apache/flink/pull/24419) -- This is

[PR] [BP-1.18][FLINK-34517][table]fix environment configs ignored when calling procedure operation [flink]

2024-02-29 Thread via GitHub
JustinLeesin opened a new pull request, #24419: URL: https://github.com/apache/flink/pull/24419 1.18 backport for parent PR [24397](https://github.com/apache/flink/pull/24397) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Closed] (FLINK-34521) Using the Duration instead of the deprecated Time classes

2024-02-29 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan closed FLINK-34521. --- Resolution: Duplicate > Using the Duration instead of the deprecated Time classes >

[jira] [Commented] (FLINK-34521) Using the Duration instead of the deprecated Time classes

2024-02-29 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822350#comment-17822350 ] Rui Fan commented on FLINK-34521: - Thanks for the reminder, i close this jira. > Using

Re: [PR] [FLINK-32076][checkpoint] Introduce file pool to reuse files [flink]

2024-02-29 Thread via GitHub
flinkbot commented on PR #24418: URL: https://github.com/apache/flink/pull/24418#issuecomment-1972349443 ## CI report: * 61e97462d4566a1ae8f17ceb32e42f68f92631a6 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-32076) Add file pool for concurrent file reusing

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32076: --- Labels: pull-request-available (was: ) > Add file pool for concurrent file reusing > --

[PR] [FLINK-32076][checkpoint] Introduce file pool to reuse files [flink]

2024-02-29 Thread via GitHub
masteryhx opened a new pull request, #24418: URL: https://github.com/apache/flink/pull/24418 ## What is the purpose of the change Add file pool for concurrent file reusing ## Brief change log - Introduce PhysicalFilePool and use it in FileMergingSnapshotMana

[jira] [Commented] (FLINK-33989) Insert Statement With Filter Operation Generates Extra Tombstone using Upsert Kafka Connector

2024-02-29 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822337#comment-17822337 ] xuyang commented on FLINK-33989: Agree with [~libenchao] . This is a behavior by design.

Re: [PR] [FLINK-34522][core] Changing the Time to Duration for StateTtlConfig.Builder.cleanupInRocksdbCompactFilter [flink]

2024-02-29 Thread via GitHub
flinkbot commented on PR #24417: URL: https://github.com/apache/flink/pull/24417#issuecomment-1972320798 ## CI report: * c116a9c297479ebddb59864bda83ec8dfd43bb4b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-34522][core] Changing the Time to Duration for StateTtlConfig.Builder.cleanupInRocksdbCompactFilter [flink]

2024-02-29 Thread via GitHub
RocMarshal opened a new pull request, #24417: URL: https://github.com/apache/flink/pull/24417 - What is the purpose of the change [FLINK-32570](https://issues.apache.org/jira/browse/FLINK-32570) deprecated the Time class and refactor all Public or PublicEvolving apis to use the Ja

[jira] [Updated] (FLINK-34550) attempted task still report metric of currentEmitEventTimeLag

2024-02-29 Thread siwei.gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] siwei.gao updated FLINK-34550: -- Attachment: image-2024-03-01-09-51-08-909.png > attempted task still report metric of currentEmitEvent

[jira] [Updated] (FLINK-34550) attempted task still report metric of currentEmitEventTimeLag

2024-02-29 Thread siwei.gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] siwei.gao updated FLINK-34550: -- Description: Attempted task still report metric of currentEmitEventTimeLag when use kafka-connector.A

[jira] [Updated] (FLINK-34550) attempted task still report metric of currentEmitEventTimeLag

2024-02-29 Thread siwei.gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] siwei.gao updated FLINK-34550: -- Description: Attempted task still report metric of currentEmitEventTimeLag when use kafka-connector.A

[jira] [Commented] (FLINK-34553) Time travel support by Flink catalogs

2024-02-29 Thread Feng Jin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822332#comment-17822332 ] Feng Jin commented on FLINK-34553: -- >From what I currently know,only Paimon supports Fl

Re: [PR] [FLINK-34517][table]fix environment configs ignored when calling procedure operation [flink]

2024-02-29 Thread via GitHub
luoyuxia commented on PR #24397: URL: https://github.com/apache/flink/pull/24397#issuecomment-1972271813 @JustinLeesin Could you please cherry pick it to release-1.18. I'll merge to 1.18 firstly. -- This is an automated message from the Apache Git Service. To respond to the message, pleas

Re: [PR] [FLINK-34542][docs] improved example quickstart build.gradle [flink]

2024-02-29 Thread via GitHub
flinkbot commented on PR #24416: URL: https://github.com/apache/flink/pull/24416#issuecomment-1972195868 ## CI report: * 0d64603764567494fefd05b5847a60795af949fd UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-34542) Improve Gradle Quick Start build.gradle with Better Gradle API Alternatives

2024-02-29 Thread Lennon Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lennon Yu updated FLINK-34542: -- Description: This is a ticket of misc. improvements on the build.gradle script provided at {{Applicat

[jira] [Updated] (FLINK-34542) Improve Gradle Quick Start build.gradle with Better Gradle API Alternatives

2024-02-29 Thread Lennon Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lennon Yu updated FLINK-34542: -- Description: This is a ticket of misc. improvements on the build.gradle script provided at {{Applicat

[jira] [Updated] (FLINK-34542) Improve Gradle Quick Start build.gradle with Better Gradle API Alternatives

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-34542: --- Labels: pull-request-available (was: ) > Improve Gradle Quick Start build.gradle with Bette

[PR] [FLINK-34542][docs] improved example quickstart build.gradle [flink]

2024-02-29 Thread via GitHub
LemonU opened a new pull request, #24416: URL: https://github.com/apache/flink/pull/24416 ## What is the purpose of the change To improve the `build.gradle` build script provided in the Flink documentation under section `Application Development >> Project Configuration >> Ove

Re: [PR] [FLINK-34535] Support JobPlanInfo for the explain result [flink]

2024-02-29 Thread via GitHub
jeyhunkarimov commented on code in PR #24411: URL: https://github.com/apache/flink/pull/24411#discussion_r1508294826 ## flink-table/flink-table-planner/src/test/scala/org/apache/flink/table/planner/utils/TableTestBase.scala: ## @@ -1824,6 +1826,11 @@ object TableTestUtil {

[jira] [Updated] (FLINK-34491) Move from experimental support to production support for Java 17

2024-02-29 Thread Dhruv Patel (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dhruv Patel updated FLINK-34491: Description: This task is to move away from experimental support for Java 17 to production suppor

[jira] [Commented] (FLINK-29370) Protobuf in flink-sql-protobuf is not shaded

2024-02-29 Thread Jeyhun Karimov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822311#comment-17822311 ] Jeyhun Karimov commented on FLINK-29370: Hi [~tanjialiang] you might need to con

[jira] [Updated] (FLINK-34554) Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2024-02-29 Thread Hilmi Al Fatih (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hilmi Al Fatih updated FLINK-34554: --- Description: Flink version: 1.17.1 Kafka Broker version: 2.7.1 * 4 GB heap memory for each

[jira] [Updated] (FLINK-34554) Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2024-02-29 Thread Hilmi Al Fatih (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hilmi Al Fatih updated FLINK-34554: --- Description: Flink version: 1.17.1 Kafka Broker version: 2.7.1 * 4 GB heap memory for each

[jira] [Updated] (FLINK-34554) Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2024-02-29 Thread Hilmi Al Fatih (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hilmi Al Fatih updated FLINK-34554: --- Priority: Blocker (was: Minor) > Using EXACTLY_ONCE with KafkaSink cause broker's OOM due t

[jira] [Updated] (FLINK-34554) Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2024-02-29 Thread Hilmi Al Fatih (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hilmi Al Fatih updated FLINK-34554: --- Issue Type: Improvement (was: New Feature) > Using EXACTLY_ONCE with KafkaSink cause broker

[jira] [Created] (FLINK-34554) Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2024-02-29 Thread Hilmi Al Fatih (Jira)
Hilmi Al Fatih created FLINK-34554: -- Summary: Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint Key: FLINK-34554 URL: https://issues.apache.org/jira/browse/F

[jira] [Created] (FLINK-34553) Time travel support by Flink catalogs

2024-02-29 Thread Mehmet Aktas (Jira)
Mehmet Aktas created FLINK-34553: Summary: Time travel support by Flink catalogs Key: FLINK-34553 URL: https://issues.apache.org/jira/browse/FLINK-34553 Project: Flink Issue Type: Technical D

Re: [PR] [FLINK-34517][table]fix environment configs ignored when calling procedure operation [flink]

2024-02-29 Thread via GitHub
JustinLeesin commented on PR #24397: URL: https://github.com/apache/flink/pull/24397#issuecomment-1971516132 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] [FLINK-34517][table]fix environment configs ignored when calling procedure operation [flink]

2024-02-29 Thread via GitHub
JustinLeesin commented on PR #24397: URL: https://github.com/apache/flink/pull/24397#issuecomment-1971488431 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] [FLINK-34517][table]fix environment configs ignored when calling procedure operation [flink]

2024-02-29 Thread via GitHub
JustinLeesin commented on code in PR #24397: URL: https://github.com/apache/flink/pull/24397#discussion_r1507837138 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/runtime/stream/sql/ProcedureITCase.java: ## @@ -210,6 +214,31 @@ void testNamedArgu

[jira] [Commented] (FLINK-34552) Support message deduplication for input data sources

2024-02-29 Thread Sergey Anokhovskiy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822189#comment-17822189 ] Sergey Anokhovskiy commented on FLINK-34552: Thank you for the comment [~mar

Re: [PR] [FLINK-34522][core] Changing the Time to Duration for StateTtlConfig.Builder.cleanupInRocksdbCompactFilter [flink]

2024-02-29 Thread via GitHub
HuangXingBo commented on PR #24387: URL: https://github.com/apache/flink/pull/24387#issuecomment-1971427877 @1996fanrui The test failed is actually related to the implementation of `Duration`. Now, `Duration` is a wrapper for the java class in the JVM created by `gateway`. If `Duration` is

[jira] [Comment Edited] (FLINK-34552) Support message deduplication for input data sources

2024-02-29 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822172#comment-17822172 ] Martijn Visser edited comment on FLINK-34552 at 2/29/24 3:13 PM: -

[jira] [Commented] (FLINK-34552) Support message deduplication for input data sources

2024-02-29 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822172#comment-17822172 ] Martijn Visser commented on FLINK-34552: A couple of points from my point of vie

Re: [PR] [FLINK-34419][docker] Add tests for JDK 17 & 21 [flink-docker]

2024-02-29 Thread via GitHub
morazow commented on code in PR #182: URL: https://github.com/apache/flink-docker/pull/182#discussion_r1507732247 ## .github/workflows/ci.yml: ## @@ -17,14 +17,22 @@ name: "CI" on: [push, pull_request] +env: + TAR_URL: "https://s3.amazonaws.com/flink-nightly/flink-1.20-SN

[jira] [Commented] (FLINK-29370) Protobuf in flink-sql-protobuf is not shaded

2024-02-29 Thread tanjialiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822169#comment-17822169 ] tanjialiang commented on FLINK-29370: - [~jark] [~libenchao] [~maosuhan] I found that

[jira] [Comment Edited] (FLINK-34552) Support message deduplication for input data sources

2024-02-29 Thread Ashish Khatkar (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822161#comment-17822161 ] Ashish Khatkar edited comment on FLINK-34552 at 2/29/24 2:50 PM: -

Re: [PR] [FLINK-34543][datastream]Support Full Partition Processing On Non-keyed DataStream [flink]

2024-02-29 Thread via GitHub
WencongLiu commented on code in PR #24398: URL: https://github.com/apache/flink/pull/24398#discussion_r1507354167 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/sort/AbstractSortPartitionOperator.java: ## @@ -0,0 +1,229 @@ +/* + * Licensed to the

[jira] [Comment Edited] (FLINK-34552) Support message deduplication for input data sources

2024-02-29 Thread Ashish Khatkar (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822161#comment-17822161 ] Ashish Khatkar edited comment on FLINK-34552 at 2/29/24 2:49 PM: -

Re: [PR] [FLINK-34543][datastream]Support Full Partition Processing On Non-keyed DataStream [flink]

2024-02-29 Thread via GitHub
WencongLiu commented on code in PR #24398: URL: https://github.com/apache/flink/pull/24398#discussion_r1507354390 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/KeyedStream.java: ## @@ -1071,6 +1077,110 @@ protected SingleOutputStreamOperator ag

[jira] [Commented] (FLINK-34552) Support message deduplication for input data sources

2024-02-29 Thread Ashish Khatkar (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822161#comment-17822161 ] Ashish Khatkar commented on FLINK-34552: Adding an example for this consider tw

[jira] [Updated] (FLINK-34552) Support message deduplication for input data sources

2024-02-29 Thread Sergey Anokhovskiy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Anokhovskiy updated FLINK-34552: --- Description: My main proposal is to have duplicate message suppression logic as a pa

[jira] [Created] (FLINK-34551) Align retry mechanisms of FutureUtils

2024-02-29 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-34551: - Summary: Align retry mechanisms of FutureUtils Key: FLINK-34551 URL: https://issues.apache.org/jira/browse/FLINK-34551 Project: Flink Issue Type: Technical

[jira] [Created] (FLINK-34552) Support message deduplication for input data sources

2024-02-29 Thread Sergey Anokhovskiy (Jira)
Sergey Anokhovskiy created FLINK-34552: -- Summary: Support message deduplication for input data sources Key: FLINK-34552 URL: https://issues.apache.org/jira/browse/FLINK-34552 Project: Flink

Re: [PR] [FLINK-34419][docker] Add tests for JDK 17 & 21 [flink-docker]

2024-02-29 Thread via GitHub
morazow commented on code in PR #182: URL: https://github.com/apache/flink-docker/pull/182#discussion_r1507649411 ## .github/workflows/ci.yml: ## @@ -17,14 +17,22 @@ name: "CI" on: [push, pull_request] +env: + TAR_URL: "https://s3.amazonaws.com/flink-nightly/flink-1.20-SN

Re: [PR] [FLINK-34419][docker] Add tests for JDK 17 & 21 [flink-docker]

2024-02-29 Thread via GitHub
morazow commented on code in PR #182: URL: https://github.com/apache/flink-docker/pull/182#discussion_r1507649411 ## .github/workflows/ci.yml: ## @@ -17,14 +17,22 @@ name: "CI" on: [push, pull_request] +env: + TAR_URL: "https://s3.amazonaws.com/flink-nightly/flink-1.20-SN

Re: [PR] [FLINK-34419][docker] Add tests for JDK 17 & 21 [flink-docker]

2024-02-29 Thread via GitHub
morazow commented on code in PR #182: URL: https://github.com/apache/flink-docker/pull/182#discussion_r1507649411 ## .github/workflows/ci.yml: ## @@ -17,14 +17,22 @@ name: "CI" on: [push, pull_request] +env: + TAR_URL: "https://s3.amazonaws.com/flink-nightly/flink-1.20-SN

Re: [PR] [FLINK-34419][docker] Add tests for JDK 17 & 21 [flink-docker]

2024-02-29 Thread via GitHub
XComp commented on code in PR #182: URL: https://github.com/apache/flink-docker/pull/182#discussion_r1507624836 ## .github/workflows/ci.yml: ## @@ -17,14 +17,22 @@ name: "CI" on: [push, pull_request] +env: + TAR_URL: "https://s3.amazonaws.com/flink-nightly/flink-1.20-SNAP

Re: [PR] [FLINK-34419][docker] Add tests for JDK 17 & 21 [flink-docker]

2024-02-29 Thread via GitHub
XComp commented on code in PR #182: URL: https://github.com/apache/flink-docker/pull/182#discussion_r1507624836 ## .github/workflows/ci.yml: ## @@ -17,14 +17,22 @@ name: "CI" on: [push, pull_request] +env: + TAR_URL: "https://s3.amazonaws.com/flink-nightly/flink-1.20-SNAP

[jira] [Created] (FLINK-34550) attempted task still report metric of currentEmitEventTimeLag

2024-02-29 Thread siwei.gao (Jira)
siwei.gao created FLINK-34550: - Summary: attempted task still report metric of currentEmitEventTimeLag Key: FLINK-34550 URL: https://issues.apache.org/jira/browse/FLINK-34550 Project: Flink Issu

Re: [PR] [FLINK-33436] Documentation for the built-in Profiler [flink]

2024-02-29 Thread via GitHub
yuchen-ecnu commented on PR #24403: URL: https://github.com/apache/flink/pull/24403#issuecomment-1971160199 Hi @rmetzger, thanks for the quick and detailed comments! While async-profiler supports most platforms, not all. So that's a good suggestion to add the "Requirements" section, and I'v

Re: [PR] [FLINK-34419][docker] Add tests for JDK 17 & 21 [flink-docker]

2024-02-29 Thread via GitHub
morazow commented on code in PR #182: URL: https://github.com/apache/flink-docker/pull/182#discussion_r1507558823 ## .github/workflows/ci.yml: ## @@ -17,14 +17,22 @@ name: "CI" on: [push, pull_request] +env: + TAR_URL: "https://s3.amazonaws.com/flink-nightly/flink-1.20-SN

[jira] [Comment Edited] (FLINK-34529) Projection cannot be pushed down through rank operator.

2024-02-29 Thread Benchao Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822118#comment-17822118 ] Benchao Li edited comment on FLINK-34529 at 2/29/24 1:08 PM: -

[jira] [Commented] (FLINK-34529) Projection cannot be pushed down through rank operator.

2024-02-29 Thread Benchao Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822118#comment-17822118 ] Benchao Li commented on FLINK-34529: [~xuyangzhong][~nilerzhou] Thank you for the ex

[jira] [Commented] (FLINK-34529) Projection cannot be pushed down through rank operator.

2024-02-29 Thread Benchao Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822119#comment-17822119 ] Benchao Li commented on FLINK-34529: [~nilerzhou] Assigned to you~ > Projection can

[jira] [Assigned] (FLINK-34529) Projection cannot be pushed down through rank operator.

2024-02-29 Thread Benchao Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benchao Li reassigned FLINK-34529: -- Assignee: yisha zhou > Projection cannot be pushed down through rank operator. >

Re: [PR] [FLINK-34546] Emit span with failure labels on failure. [flink]

2024-02-29 Thread via GitHub
pnowojski commented on code in PR #24414: URL: https://github.com/apache/flink/pull/24414#discussion_r1507543874 ## flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/failover/ExecutionFailureHandler.java: ## @@ -141,6 +155,51 @@ private CompletableFuture> labe

Re: [PR] [FLINK-34546] Emit span with failure labels on failure. [flink]

2024-02-29 Thread via GitHub
StefanRRichter commented on code in PR #24414: URL: https://github.com/apache/flink/pull/24414#discussion_r1507540785 ## flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/failover/ExecutionFailureHandler.java: ## @@ -141,6 +155,51 @@ private CompletableFuture>

Re: [PR] [FLINK-34546] Emit span with failure labels on failure. [flink]

2024-02-29 Thread via GitHub
pnowojski commented on code in PR #24414: URL: https://github.com/apache/flink/pull/24414#discussion_r1507538335 ## flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/failover/ExecutionFailureHandler.java: ## @@ -141,6 +155,51 @@ private CompletableFuture> labe

Re: [PR] [FLINK-34546] Emit span with failure labels on failure. [flink]

2024-02-29 Thread via GitHub
StefanRRichter commented on code in PR #24414: URL: https://github.com/apache/flink/pull/24414#discussion_r1507536006 ## flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/failover/ExecutionFailureHandler.java: ## @@ -141,6 +150,48 @@ private CompletableFuture>

Re: [PR] [FLINK-34546] Emit span with failure labels on failure. [flink]

2024-02-29 Thread via GitHub
pnowojski commented on code in PR #24414: URL: https://github.com/apache/flink/pull/24414#discussion_r1507534949 ## flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/failover/ExecutionFailureHandler.java: ## @@ -141,6 +150,48 @@ private CompletableFuture> labe

  1   2   >