[jira] [Assigned] (FLINK-34192) Update flink-connector-kafka to be compatible with updated SinkV2 interfaces

2024-02-08 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser reassigned FLINK-34192: -- Assignee: Jiabao Sun > Update flink-connector-kafka to be compatible with updated Sin

[jira] [Closed] (FLINK-34244) Upgrade Confluent Platform to latest compatible version

2024-02-08 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser closed FLINK-34244. -- Resolution: Fixed Fixed in apache/flink-connector-kafka main: cfb275b478ff97e9105c5ffaf20224f

Re: [PR] [FLINK-34244] Update Confluent Platform to 7.4.4 [flink-connector-kafka]

2024-02-08 Thread via GitHub
MartijnVisser merged PR #81: URL: https://github.com/apache/flink-connector-kafka/pull/81 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubsc

[jira] [Commented] (FLINK-33365) Missing filter condition in execution plan containing lookup join with mysql jdbc connector

2024-02-08 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815943#comment-17815943 ] Martijn Visser commented on FLINK-33365: [~rahulchundeth] See the Dev mailing li

[jira] [Commented] (FLINK-33365) Missing filter condition in execution plan containing lookup join with mysql jdbc connector

2024-02-08 Thread Rahul Raj (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815934#comment-17815934 ] Rahul Raj commented on FLINK-33365: --- Hi Team, when we can expect next version of flink

Re: [PR] [FLINK-34386][state] Add RocksDB bloom filter metrics [flink]

2024-02-08 Thread via GitHub
hejufang commented on PR #24274: URL: https://github.com/apache/flink/pull/24274#issuecomment-1935352424 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-26088][Connectors/ElasticSearch] Add Elasticsearch 8.0 support [flink-connector-elasticsearch]

2024-02-08 Thread via GitHub
mtfelisb commented on code in PR #53: URL: https://github.com/apache/flink-connector-elasticsearch/pull/53#discussion_r1483760795 ## flink-connector-elasticsearch8/src/test/java/org/apache/flink/connector/elasticsearch/sink/Elasticsearch8AsyncWriterITCase.java: ## @@ -0,0 +1,27

Re: [PR] [FLINK-26088][Connectors/ElasticSearch] Add Elasticsearch 8.0 support [flink-connector-elasticsearch]

2024-02-08 Thread via GitHub
mtfelisb commented on PR #53: URL: https://github.com/apache/flink-connector-elasticsearch/pull/53#issuecomment-1935170882 > > This pull request is working on every Flink version but `1.19-SNAPSHOT` > > I'm suspecting that's because of https://issues.apache.org/jira/browse/FLINK-2585

[jira] [Assigned] (FLINK-34413) Drop support for HBase v1

2024-02-08 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser reassigned FLINK-34413: -- Assignee: Ferenc Csaky > Drop support for HBase v1 > - > >

[jira] [Updated] (FLINK-34344) Wrong JobID in CheckpointStatsTracker

2024-02-08 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan updated FLINK-34344: -- Fix Version/s: 1.18.2 > Wrong JobID in CheckpointStatsTracker > --

[jira] [Updated] (FLINK-34344) Wrong JobID in CheckpointStatsTracker

2024-02-08 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan updated FLINK-34344: -- Fix Version/s: 1.20.0 > Wrong JobID in CheckpointStatsTracker > --

[jira] [Updated] (FLINK-34344) Wrong JobID in CheckpointStatsTracker

2024-02-08 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan updated FLINK-34344: -- Affects Version/s: 1.18.1 1.20.0 > Wrong JobID in CheckpointSta

Re: [PR] [FLINK-34344] Pass JobID to CheckpointStatsTracker [flink]

2024-02-08 Thread via GitHub
rkhachatryan merged PR #24254: URL: https://github.com/apache/flink/pull/24254 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

Re: [PR] [FLINK-34344] Pass JobID to CheckpointStatsTracker [flink]

2024-02-08 Thread via GitHub
rkhachatryan commented on PR #24254: URL: https://github.com/apache/flink/pull/24254#issuecomment-1934827477 Thanks for the review! Merging -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [FLINK-34344] Pass JobID to CheckpointStatsTracker [flink]

2024-02-08 Thread via GitHub
rkhachatryan commented on code in PR #24254: URL: https://github.com/apache/flink/pull/24254#discussion_r1483515377 ## flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/CheckpointStatsTracker.java: ## @@ -112,8 +112,9 @@ public class CheckpointStatsTracker {

Re: [PR] [FLINK-34417] Log Job ID via MDC [flink]

2024-02-08 Thread via GitHub
flinkbot commented on PR #24292: URL: https://github.com/apache/flink/pull/24292#issuecomment-1934796687 ## CI report: * 605d23d07cc51916ac746b9760a400dd363c0044 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-34417) Add JobID to logging MDC

2024-02-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-34417: --- Labels: pull-request-available (was: ) > Add JobID to logging MDC > ---

[PR] [FLINK-34417] Log Job ID via MDC [flink]

2024-02-08 Thread via GitHub
rkhachatryan opened a new pull request, #24292: URL: https://github.com/apache/flink/pull/24292 ## What is the purpose of the change Add Flink JobID to logging MDC to make analysing the logs easier. ## Verifying this change - added `JobIdLoggingMainThreadExecu

[jira] [Created] (FLINK-34417) Add JobID to logging MDC

2024-02-08 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-34417: - Summary: Add JobID to logging MDC Key: FLINK-34417 URL: https://issues.apache.org/jira/browse/FLINK-34417 Project: Flink Issue Type: Improvement

Re: [PR] [FLINK-34268] Add a test to verify if restore test exists for ExecNode [flink]

2024-02-08 Thread via GitHub
bvarghese1 commented on code in PR #24219: URL: https://github.com/apache/flink/pull/24219#discussion_r1483474513 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/RestoreTestCompleteness.java: ## @@ -0,0 +1,130 @@ +/* + *

[jira] [Closed] (FLINK-34393) Release Testing Instructions: Verify FLINK-20767 Add nested field support for SupportsFilterPushDown

2024-02-08 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Ge closed FLINK-34393. --- Resolution: Fixed > Release Testing Instructions: Verify FLINK-20767 Add nested field support for > Support

[jira] [Commented] (FLINK-34393) Release Testing Instructions: Verify FLINK-20767 Add nested field support for SupportsFilterPushDown

2024-02-08 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815791#comment-17815791 ] Jing Ge commented on FLINK-34393: - Thanks for the clarification. > Release Testing Inst

[jira] [Commented] (FLINK-34393) Release Testing Instructions: Verify FLINK-20767 Add nested field support for SupportsFilterPushDown

2024-02-08 Thread Venkata krishnan Sowrirajan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815786#comment-17815786 ] Venkata krishnan Sowrirajan commented on FLINK-34393: - Looks like I

[jira] [Comment Edited] (FLINK-34393) Release Testing Instructions: Verify FLINK-20767 Add nested field support for SupportsFilterPushDown

2024-02-08 Thread Venkata krishnan Sowrirajan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815785#comment-17815785 ] Venkata krishnan Sowrirajan edited comment on FLINK-34393 at 2/8/24 6:42 PM: -

[jira] [Commented] (FLINK-34393) Release Testing Instructions: Verify FLINK-20767 Add nested field support for SupportsFilterPushDown

2024-02-08 Thread Venkata krishnan Sowrirajan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815785#comment-17815785 ] Venkata krishnan Sowrirajan commented on FLINK-34393: - It won't be r

Re: [PR] [FLINK-34409][ci] Enables (most) tests that were disabled for the AdaptiveScheduler due to missing features [flink]

2024-02-08 Thread via GitHub
XComp commented on PR #24285: URL: https://github.com/apache/flink/pull/24285#issuecomment-1934710721 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (FLINK-34289) Release Testing Instructions: Verify FLINK-33695 Introduce TraceReporter and use it to create checkpointing and recovery traces

2024-02-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815766#comment-17815766 ] Piotr Nowojski commented on FLINK-34289: That definitely would prevent my confus

[jira] [Commented] (FLINK-34404) GroupWindowAggregateProcTimeRestoreTest#testRestore times out

2024-02-08 Thread Alan Sheinberg (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815765#comment-17815765 ] Alan Sheinberg commented on FLINK-34404: I did recently add a test, so if for so

[jira] [Resolved] (FLINK-34200) AutoRescalingITCase#testCheckpointRescalingInKeyedState fails

2024-02-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl resolved FLINK-34200. --- Resolution: Fixed master: [1b95b191922829fd8e7a76e5c9d8de68bb57ae7d|https://github.com/apac

Re: [PR] [FLINK-34200][test] Fix the bug that AutoRescalingITCase.testCheckpointRescalingInKeyedState fails occasionally [flink]

2024-02-08 Thread via GitHub
XComp merged PR #24286: URL: https://github.com/apache/flink/pull/24286 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.

Re: [PR] [FLINK-34386][state] Add RocksDB bloom filter metrics [flink]

2024-02-08 Thread via GitHub
hejufang commented on PR #24274: URL: https://github.com/apache/flink/pull/24274#issuecomment-1934485237 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (FLINK-34411) "Wordcount on Docker test (custom fs plugin)" timed out with some strange issue while setting the test up

2024-02-08 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815746#comment-17815746 ] Ferenc Csaky commented on FLINK-34411: -- The current [dev-1.19|https://github.com/ap

[jira] [Commented] (FLINK-34413) Drop support for HBase v1

2024-02-08 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815744#comment-17815744 ] Ferenc Csaky commented on FLINK-34413: -- Thanks for creating this ticket, feel free

[jira] [Updated] (FLINK-34285) [Umbrella] Test Flink Release 1.19

2024-02-08 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee updated FLINK-34285: Description: This is an umbrella ticket for the Flink 1.19 testing efforts. There're two kinds of

[jira] [Updated] (FLINK-34285) [Umbrella] Test Flink Release 1.19

2024-02-08 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee updated FLINK-34285: Description: This is an umbrella ticket for the Flink 1.19 testing efforts. RM opened a release

Re: [PR] [FLINK-34409][ci] Enables (most) tests that were disabled for the AdaptiveScheduler due to missing features [flink]

2024-02-08 Thread via GitHub
XComp commented on code in PR #24285: URL: https://github.com/apache/flink/pull/24285#discussion_r1483225410 ## flink-tests/src/test/java/org/apache/flink/test/checkpointing/UnalignedCheckpointITCase.java: ## @@ -105,7 +103,6 @@ * */ @RunWith(Parameterized.class) -@Categor

Re: [PR] [FLINK-34401][docs-zh] Translate "Flame Graphs" page into Chinese [flink]

2024-02-08 Thread via GitHub
JingGe commented on code in PR #24279: URL: https://github.com/apache/flink/pull/24279#discussion_r1483214554 ## docs/content.zh/docs/ops/debugging/flame_graphs.md: ## @@ -27,36 +27,37 @@ under the License. # Flame Graphs -[Flame Graphs](http://www.brendangregg.com/flamegra

[jira] [Commented] (FLINK-34416) "Local recovery and sticky scheduling end-to-end test" still doesn't work with AdaptiveScheduler

2024-02-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815738#comment-17815738 ] Matthias Pohl commented on FLINK-34416: --- We should investigate whether that could

[jira] [Created] (FLINK-34416) "Local recovery and sticky scheduling end-to-end test" still doesn't work with AdaptiveScheduler

2024-02-08 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-34416: - Summary: "Local recovery and sticky scheduling end-to-end test" still doesn't work with AdaptiveScheduler Key: FLINK-34416 URL: https://issues.apache.org/jira/browse/FLINK-34416

[jira] [Updated] (FLINK-34285) [Umbrella] Test Flink Release 1.19

2024-02-08 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee updated FLINK-34285: Attachment: screenshot-3.png > [Umbrella] Test Flink Release 1.19 > --

[jira] [Updated] (FLINK-34415) Move away from Kafka-Zookeeper based tests in favor of Kafka-KRaft

2024-02-08 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-34415: --- Description: The current Flink Kafka connector still uses Zookeeper for Kafka-based testing.

[jira] [Commented] (FLINK-34289) Release Testing Instructions: Verify FLINK-33695 Introduce TraceReporter and use it to create checkpointing and recovery traces

2024-02-08 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815735#comment-17815735 ] lincoln lee commented on FLINK-34289: - [~pnowojski] Really appreciate for your valua

[jira] [Commented] (FLINK-34391) Release Testing Instructions: Verify FLINK-15959 Add min number of slots configuration to limit total number of slots

2024-02-08 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815731#comment-17815731 ] Jing Ge commented on FLINK-34391: - pinged [~xiangyu0xf] in the Slack, waiting for the fe

[jira] [Commented] (FLINK-34395) Release Testing Instructions: Verify FLINK-32514 Support using larger checkpointing interval when source is processing backlog

2024-02-08 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815730#comment-17815730 ] Jing Ge commented on FLINK-34395: - pinged [~yunfengzhou] in the Slack, waiting for the f

[jira] [Commented] (FLINK-34393) Release Testing Instructions: Verify FLINK-20767 Add nested field support for SupportsFilterPushDown

2024-02-08 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815728#comment-17815728 ] Jing Ge commented on FLINK-34393: - pinged [~vsowrirajan]  in the Slack, waiting for the

[jira] [Commented] (FLINK-34367) Release Testing Instructions: Verify FLINK-34027 AsyncScalarFunction for asynchronous scalar function support

2024-02-08 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815727#comment-17815727 ] Jing Ge commented on FLINK-34367: - Hi [~asheinberg] would you like to create a release t

Re: [PR] [FLINK-34244] Update Confluent Platform to 7.4.4 [flink-connector-kafka]

2024-02-08 Thread via GitHub
MartijnVisser commented on code in PR #81: URL: https://github.com/apache/flink-connector-kafka/pull/81#discussion_r1483192402 ## flink-connector-kafka/src/test/java/org/apache/flink/connector/kafka/testutils/DockerImageVersions.java: ## @@ -24,7 +24,9 @@ */ public class Doc

[jira] [Created] (FLINK-34415) Move away from Kafka-Zookeeper based tests in favor of Kafka-KRaft

2024-02-08 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34415: -- Summary: Move away from Kafka-Zookeeper based tests in favor of Kafka-KRaft Key: FLINK-34415 URL: https://issues.apache.org/jira/browse/FLINK-34415 Project: Flink

[jira] [Updated] (FLINK-34399) Release Testing: Verify FLINK-33644 Make QueryOperations SQL serializable

2024-02-08 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Ge updated FLINK-34399: Labels: release-testing (was: ) > Release Testing: Verify FLINK-33644 Make QueryOperations SQL serializab

Re: [PR] [FLINK-34244] Update Confluent Platform to 7.4.4 [flink-connector-kafka]

2024-02-08 Thread via GitHub
MartijnVisser commented on code in PR #81: URL: https://github.com/apache/flink-connector-kafka/pull/81#discussion_r1483185495 ## flink-connector-kafka/src/test/java/org/apache/flink/connector/kafka/testutils/DockerImageVersions.java: ## @@ -24,7 +24,9 @@ */ public class Doc

[jira] [Updated] (FLINK-34289) Release Testing Instructions: Verify FLINK-33695 Introduce TraceReporter and use it to create checkpointing and recovery traces

2024-02-08 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee updated FLINK-34289: Attachment: screenshot-2.png > Release Testing Instructions: Verify FLINK-33695 Introduce TraceRep

Re: [PR] [FLINK-34244] Update Confluent Platform to 7.4.4 [flink-connector-kafka]

2024-02-08 Thread via GitHub
snuyanzin commented on code in PR #81: URL: https://github.com/apache/flink-connector-kafka/pull/81#discussion_r1483182849 ## flink-connector-kafka/src/test/java/org/apache/flink/connector/kafka/testutils/DockerImageVersions.java: ## @@ -24,7 +24,9 @@ */ public class DockerI

[jira] [Commented] (FLINK-34305) Release Testing Instructions: Verify FLINK-33261 Support Setting Parallelism for Table/SQL Sources

2024-02-08 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815724#comment-17815724 ] Jing Ge commented on FLINK-34305: - Hi [~sudewei.sdw] I have assigned this ticket to you

[jira] [Assigned] (FLINK-34305) Release Testing Instructions: Verify FLINK-33261 Support Setting Parallelism for Table/SQL Sources

2024-02-08 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Ge reassigned FLINK-34305: --- Assignee: SuDewei (was: Zhanghao Chen) > Release Testing Instructions: Verify FLINK-33261 Support

[jira] [Updated] (FLINK-34244) Upgrade Confluent Platform to latest compatible version

2024-02-08 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-34244: --- Fix Version/s: kafka-3.1.1 > Upgrade Confluent Platform to latest compatible version > -

Re: [PR] [FLINK-34244] Upgrade Confluent Platform Avro Schema Registry [flink]

2024-02-08 Thread via GitHub
MartijnVisser merged PR #24202: URL: https://github.com/apache/flink/pull/24202 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Commented] (FLINK-34252) WatermarkAssignerOperator should not emit WatermarkStatus.IDLE under continuous data flow

2024-02-08 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815719#comment-17815719 ] Martijn Visser commented on FLINK-34252: [~fanrui] I'm curious on your thoughts

Re: [PR] [FLINK-34192] Update to be compatible with updated SinkV2 interfaces [flink-connector-kafka]

2024-02-08 Thread via GitHub
Jiabao-Sun commented on code in PR #84: URL: https://github.com/apache/flink-connector-kafka/pull/84#discussion_r1483154745 ## flink-connector-kafka/src/test/java/org/apache/flink/connector/kafka/testutils/YamlFileMetadataService.java: ## @@ -23,20 +23,19 @@ import org.apache.

Re: [PR] [FLINK-34192] Update to be compatible with updated SinkV2 interfaces [flink-connector-kafka]

2024-02-08 Thread via GitHub
MartijnVisser commented on code in PR #84: URL: https://github.com/apache/flink-connector-kafka/pull/84#discussion_r1483132533 ## flink-connector-kafka/src/test/java/org/apache/flink/connector/kafka/testutils/YamlFileMetadataService.java: ## @@ -23,20 +23,19 @@ import org.apac

[jira] [Created] (FLINK-34414) EXACTLY_ONCE guarantee doesn't work properly for Flink/Pulsar connector

2024-02-08 Thread Jira
Rafał Trójczak created FLINK-34414: -- Summary: EXACTLY_ONCE guarantee doesn't work properly for Flink/Pulsar connector Key: FLINK-34414 URL: https://issues.apache.org/jira/browse/FLINK-34414 Project:

[jira] [Closed] (FLINK-24239) Event time temporal join should support values from array, map, row, etc. as join key

2024-02-08 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dawid Wysakowicz closed FLINK-24239. Resolution: Implemented Implemented in 01cdc703ee6fa56bdfdf799d016c0e882e9e5d99 > Event t

Re: [PR] [FLINK-24239] Event time temporal join should support values from array, map, row, etc. as join key [flink]

2024-02-08 Thread via GitHub
dawidwys merged PR #24253: URL: https://github.com/apache/flink/pull/24253 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] [FLINK-24239] Event time temporal join should support values from array, map, row, etc. as join key [flink]

2024-02-08 Thread via GitHub
snuyanzin commented on PR #24253: URL: https://github.com/apache/flink/pull/24253#issuecomment-1934213444 yes, also played locally , seems working, thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[jira] [Commented] (FLINK-34403) VeryBigPbProtoToRowTest#testSimple cannot pass due to OOM

2024-02-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815685#comment-17815685 ] Piotr Nowojski commented on FLINK-34403: https://dev.azure.com/apache-flink/apac

[jira] [Updated] (FLINK-34403) VeryBigPbProtoToRowTest#testSimple cannot pass due to OOM

2024-02-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34403: --- Priority: Critical (was: Major) > VeryBigPbProtoToRowTest#testSimple cannot pass due to OOM

Re: [PR] [FLINK-34386][state] Add RocksDB bloom filter metrics [flink]

2024-02-08 Thread via GitHub
pnowojski commented on PR #24274: URL: https://github.com/apache/flink/pull/24274#issuecomment-1934175386 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-34152] Tune heap memory of autoscaled jobs [flink-kubernetes-operator]

2024-02-08 Thread via GitHub
mxm commented on code in PR #762: URL: https://github.com/apache/flink-kubernetes-operator/pull/762#discussion_r1483002425 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/ScalingMetricEvaluator.java: ## @@ -314,13 +315,19 @@ protected static Map evaluateGlobalMetr

Re: [PR] [FLINK-34267][CI] Update miniconda install script to fix build on MacOS [flink-connector-shared-utils]

2024-02-08 Thread via GitHub
pvary commented on PR #34: URL: https://github.com/apache/flink-connector-shared-utils/pull/34#issuecomment-1934091836 > @pvary do you remember why we added the old conda version here? IIRC the issue was to run the python tests on Mac with the new Python versions -- This is an aut

Re: [PR] [FLINK-34192] Update to be compatible with updated SinkV2 interfaces [flink-connector-kafka]

2024-02-08 Thread via GitHub
pvary commented on PR #84: URL: https://github.com/apache/flink-connector-kafka/pull/84#issuecomment-1934089389 The SinkV2 related changes are ok (There is some extra casts which are needed) -- This is an automated message from the Apache Git Service. To respond to the message, please lo

Re: [PR] [FLINK-26088][Connectors/ElasticSearch] Add Elasticsearch 8.0 support [flink-connector-elasticsearch]

2024-02-08 Thread via GitHub
Jiabao-Sun commented on code in PR #53: URL: https://github.com/apache/flink-connector-elasticsearch/pull/53#discussion_r1482924435 ## flink-connector-elasticsearch8/src/test/java/org/apache/flink/connector/elasticsearch/sink/Elasticsearch8AsyncWriterITCase.java: ## @@ -0,0 +1,

Re: [PR] [FLINK-26088][Connectors/ElasticSearch] Add Elasticsearch 8.0 support [flink-connector-elasticsearch]

2024-02-08 Thread via GitHub
Jiabao-Sun commented on PR #53: URL: https://github.com/apache/flink-connector-elasticsearch/pull/53#issuecomment-1934031525 > Hi, @MartijnVisser. I have a question regarding compatibility. This pull request is working on every Flink version but `1.19-SNAPSHOT`. I've checked [this issue](

[jira] [Commented] (FLINK-34404) GroupWindowAggregateProcTimeRestoreTest#testRestore times out

2024-02-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815660#comment-17815660 ] Matthias Pohl commented on FLINK-34404: --- I attached the debug logs for the failed

[jira] [Updated] (FLINK-34404) GroupWindowAggregateProcTimeRestoreTest#testRestore times out

2024-02-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-34404: -- Attachment: FLINK-34404.failure.log > GroupWindowAggregateProcTimeRestoreTest#testRestore time

[jira] [Updated] (FLINK-34404) GroupWindowAggregateProcTimeRestoreTest#testRestore times out

2024-02-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-34404: -- Attachment: (was: FLINK-34404.log) > GroupWindowAggregateProcTimeRestoreTest#testRestore t

[jira] [Updated] (FLINK-34404) GroupWindowAggregateProcTimeRestoreTest#testRestore times out

2024-02-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-34404: -- Attachment: FLINK-34404.success.log > GroupWindowAggregateProcTimeRestoreTest#testRestore time

[jira] [Updated] (FLINK-34404) GroupWindowAggregateProcTimeRestoreTest#testRestore times out

2024-02-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-34404: -- Attachment: FLINK-34404.log > GroupWindowAggregateProcTimeRestoreTest#testRestore times out >

[jira] [Commented] (FLINK-34273) git fetch fails

2024-02-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815654#comment-17815654 ] Matthias Pohl commented on FLINK-34273: --- https://dev.azure.com/apache-flink/apache

Re: [PR] [FLINK-34152] Tune heap memory of autoscaled jobs [flink-kubernetes-operator]

2024-02-08 Thread via GitHub
gyfora commented on code in PR #762: URL: https://github.com/apache/flink-kubernetes-operator/pull/762#discussion_r1482812605 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/ScalingMetricEvaluator.java: ## @@ -314,13 +315,19 @@ protected static Map evaluateGlobalM

Re: [PR] [FLINK-34152] Tune heap memory of autoscaled jobs [flink-kubernetes-operator]

2024-02-08 Thread via GitHub
gyfora commented on code in PR #762: URL: https://github.com/apache/flink-kubernetes-operator/pull/762#discussion_r1482812605 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/ScalingMetricEvaluator.java: ## @@ -314,13 +315,19 @@ protected static Map evaluateGlobalM

Re: [PR] [FLINK-34152] Tune heap memory of autoscaled jobs [flink-kubernetes-operator]

2024-02-08 Thread via GitHub
mxm commented on code in PR #762: URL: https://github.com/apache/flink-kubernetes-operator/pull/762#discussion_r1482810083 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/utils/MemoryTuningUtils.java: ## @@ -0,0 +1,238 @@ +/* + * Licensed to the Apache Software Fo

Re: [PR] [FLINK-34152] Tune heap memory of autoscaled jobs [flink-kubernetes-operator]

2024-02-08 Thread via GitHub
mxm commented on code in PR #762: URL: https://github.com/apache/flink-kubernetes-operator/pull/762#discussion_r1482809329 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/utils/MemoryTuningUtils.java: ## @@ -0,0 +1,238 @@ +/* + * Licensed to the Apache Software Fo

Re: [PR] [FLINK-34152] Tune heap memory of autoscaled jobs [flink-kubernetes-operator]

2024-02-08 Thread via GitHub
mxm commented on code in PR #762: URL: https://github.com/apache/flink-kubernetes-operator/pull/762#discussion_r1482802937 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/config/AutoScalerOptions.java: ## @@ -250,6 +251,31 @@ private static ConfigOptions.OptionBui

[jira] [Comment Edited] (FLINK-33960) Adaptive Scheduler doesn't respect the lowerBound for tasks

2024-02-08 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815475#comment-17815475 ] Rui Fan edited comment on FLINK-33960 at 2/8/24 10:57 AM: -- Merg

Re: [PR] [FLINK-33960][Scheduler] Fix the bug that Adaptive Scheduler doesn't respect the lowerBound when one flink job has more than 1 tasks [flink]

2024-02-08 Thread via GitHub
1996fanrui merged PR #24287: URL: https://github.com/apache/flink/pull/24287 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.ap

Re: [PR] [FLINK-33960][Scheduler] Fix the bug that Adaptive Scheduler doesn't respect the lowerBound when one flink job has more than 1 tasks [flink]

2024-02-08 Thread via GitHub
1996fanrui commented on PR #24288: URL: https://github.com/apache/flink/pull/24288#issuecomment-1933823128 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] [FLINK-34200][test] Fix the bug that AutoRescalingITCase.testCheckpointRescalingInKeyedState fails occasionally [flink]

2024-02-08 Thread via GitHub
XComp commented on PR #24286: URL: https://github.com/apache/flink/pull/24286#issuecomment-1933821366 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [FLINK-34200][test] Fix the bug that AutoRescalingITCase.testCheckpointRescalingInKeyedState fails occasionally [flink]

2024-02-08 Thread via GitHub
XComp commented on PR #24286: URL: https://github.com/apache/flink/pull/24286#issuecomment-1933821158 The [CI failure](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=57393) is due to another issue which is documented in FLINK-34411 -- This

Re: [PR] [FLINK-34152] Tune heap memory of autoscaled jobs [flink-kubernetes-operator]

2024-02-08 Thread via GitHub
gyfora commented on code in PR #762: URL: https://github.com/apache/flink-kubernetes-operator/pull/762#discussion_r1482771329 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/utils/MemoryTuningUtils.java: ## @@ -0,0 +1,238 @@ +/* + * Licensed to the Apache Software

[jira] [Commented] (FLINK-34411) "Wordcount on Docker test (custom fs plugin)" timed out with some strange issue while setting the test up

2024-02-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815626#comment-17815626 ] Matthias Pohl commented on FLINK-34411: --- https://dev.azure.com/apache-flink/apache

[jira] [Updated] (FLINK-33960) Adaptive Scheduler doesn't respect the lowerBound for tasks

2024-02-08 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33960: Fix Version/s: 1.19.0 1.18.2 1.20.0 > Adaptive Scheduler doesn't res

Re: [PR] [FLINK-24239] Event time temporal join should support values from array, map, row, etc. as join key [flink]

2024-02-08 Thread via GitHub
dawidwys commented on code in PR #24253: URL: https://github.com/apache/flink/pull/24253#discussion_r1482693914 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/stream/TemporalJoinTestPrograms.java: ## @@ -84,6 +130,36 @@ public cla

Re: [PR] [FLINK-24239] Event time temporal join should support values from array, map, row, etc. as join key [flink]

2024-02-08 Thread via GitHub
dawidwys commented on PR #24253: URL: https://github.com/apache/flink/pull/24253#issuecomment-1933701764 @snuyanzin There is a test for using an entry from a map: ``` INSERT INTO MySink SELECT amount * r.rate FROM OrdersNestedId AS o JOIN RatesHistory FOR SYSTEM_TIME AS OF

[jira] [Created] (FLINK-34413) Drop support for HBase v1

2024-02-08 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34413: -- Summary: Drop support for HBase v1 Key: FLINK-34413 URL: https://issues.apache.org/jira/browse/FLINK-34413 Project: Flink Issue Type: Technical Debt

[jira] [Assigned] (FLINK-34381) `RelDataType#getFullTypeString` should be used to print in `RelTreeWriterImpl` if `withRowType` is true instead of `Object#toString`

2024-02-08 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan reassigned FLINK-34381: - Assignee: xuyang > `RelDataType#getFullTypeString` should be used to print in > `RelTreeWriter

Re: [PR] [FLINK-24239] Event time temporal join should support values from array, map, row, etc. as join key [flink]

2024-02-08 Thread via GitHub
snuyanzin commented on PR #24253: URL: https://github.com/apache/flink/pull/24253#issuecomment-1933613412 Out of curiocity: I didn't find tests for nested arrays/maps/row... Are they out of scope? I mean e.g. this ```sql CREATE TABLE A ( a MAP>, ts TI

[jira] [Commented] (FLINK-34403) VeryBigPbProtoToRowTest#testSimple cannot pass due to OOM

2024-02-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815577#comment-17815577 ] Matthias Pohl commented on FLINK-34403: --- https://dev.azure.com/apache-flink/apache

[jira] [Commented] (FLINK-34202) python tests take suspiciously long in some of the cases

2024-02-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815576#comment-17815576 ] Matthias Pohl commented on FLINK-34202: --- 1.17: https://dev.azure.com/apache-flink

[jira] [Created] (FLINK-34412) ResultPartitionDeploymentDescriptorTest fails due to fatal error (239 exit code)

2024-02-08 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-34412: - Summary: ResultPartitionDeploymentDescriptorTest fails due to fatal error (239 exit code) Key: FLINK-34412 URL: https://issues.apache.org/jira/browse/FLINK-34412 Pr

[jira] [Updated] (FLINK-22765) ExceptionUtilsITCase.testIsMetaspaceOutOfMemoryError is unstable

2024-02-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-22765: -- Affects Version/s: 1.20.0 > ExceptionUtilsITCase.testIsMetaspaceOutOfMemoryError is unstable >

[jira] [Commented] (FLINK-22765) ExceptionUtilsITCase.testIsMetaspaceOutOfMemoryError is unstable

2024-02-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815573#comment-17815573 ] Matthias Pohl commented on FLINK-22765: --- https://dev.azure.com/apache-flink/apache

  1   2   >