[jira] [Commented] (FLINK-33338) Bump FRocksDB version

2023-10-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778646#comment-17778646 ] Piotr Nowojski commented on FLINK-8: The problem is that some of the required by us changes,

[jira] [Updated] (FLINK-33338) Bump FRocksDB version

2023-10-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-8: --- Summary: Bump FRocksDB version (was: Bump FRocksDB version to 7.x) > Bump FRocksDB version

[jira] [Updated] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-10-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-7: --- Description: Remaining open PRs: https://github.com/facebook/rocksdb/pull/11646

[jira] [Updated] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-10-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-7: --- Description: Remaining open PRs: https://github.com/facebook/rocksdb/pull/11646

[jira] [Updated] (FLINK-33338) Bump FRocksDB version to 7.x

2023-10-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-8: --- Summary: Bump FRocksDB version to 7.x (was: Bump RocksDB version to 7.x) > Bump FRocksDB

[jira] [Updated] (FLINK-33338) Bump RocksDB version to 7.x

2023-10-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-8: --- Summary: Bump RocksDB version to 7.x (was: Bump up RocksDB version to 7.x) > Bump RocksDB

[jira] [Created] (FLINK-33338) Bump up RocksDB version to 7.x

2023-10-23 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-8: -- Summary: Bump up RocksDB version to 7.x Key: FLINK-8 URL: https://issues.apache.org/jira/browse/FLINK-8 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-10-23 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-7: -- Summary: Expose IngestDB and ClipDB in the official RocksDB API Key: FLINK-7 URL: https://issues.apache.org/jira/browse/FLINK-7 Project: Flink

[jira] [Commented] (FLINK-33324) Add flink managed timeout mechanism for backend restore operation

2023-10-20 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1641#comment-1641 ] Piotr Nowojski commented on FLINK-33324: Could you share a code for the change, how complicated

[jira] [Commented] (FLINK-23411) Expose Flink checkpoint details metrics

2023-10-19 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1364#comment-1364 ] Piotr Nowojski commented on FLINK-23411: Just FYI. I'm creating at the moment a PoC of using

[jira] [Commented] (FLINK-33178) Highly parallel apps suffer from bottleneck in NativePRNG

2023-10-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17774858#comment-17774858 ] Piotr Nowojski commented on FLINK-33178: I have a feeling this ticket is a duplicate of

[jira] [Commented] (FLINK-33052) codespeed and benchmark server is down

2023-09-20 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17767153#comment-17767153 ] Piotr Nowojski commented on FLINK-33052: I think there is no big difference one way or the

[jira] [Comment Edited] (FLINK-33071) Log checkpoint statistics

2023-09-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17765533#comment-17765533 ] Piotr Nowojski edited comment on FLINK-33071 at 9/15/23 11:37 AM: --

[jira] [Updated] (FLINK-33071) Log checkpoint statistics

2023-09-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-33071: --- Fix Version/s: 1.18.1 > Log checkpoint statistics > -- > >

[jira] [Closed] (FLINK-33071) Log checkpoint statistics

2023-09-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-33071. -- Fix Version/s: 1.19.0 Resolution: Fixed merged commit ece5fad into apache:master >

[jira] [Closed] (FLINK-28758) FlinkKafkaConsumer fails to stop with savepoint

2023-09-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-28758. -- Resolution: Fixed merged commit 27a5465 into main merged commit 20c854c into v3.0 >

[jira] [Assigned] (FLINK-28758) FlinkKafkaConsumer fails to stop with savepoint

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-28758: -- Assignee: Piotr Nowojski (was: Mark Cho) > FlinkKafkaConsumer fails to stop with

[jira] [Commented] (FLINK-28758) FlinkKafkaConsumer fails to stop with savepoint

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764673#comment-17764673 ] Piotr Nowojski commented on FLINK-28758: I will try to take care of that > FlinkKafkaConsumer

[jira] [Comment Edited] (FLINK-33052) codespeed server is down

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764581#comment-17764581 ] Piotr Nowojski edited comment on FLINK-33052 at 9/13/23 10:28 AM: -- We

[jira] [Updated] (FLINK-33052) codespeed server is down

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-33052: --- Priority: Blocker (was: Critical) > codespeed server is down > >

[jira] [Commented] (FLINK-33052) codespeed server is down

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764581#comment-17764581 ] Piotr Nowojski commented on FLINK-33052: We have been always treating benchmarking issues the

[jira] [Commented] (FLINK-33052) codespeed server is down

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764564#comment-17764564 ] Piotr Nowojski commented on FLINK-33052: Thanks for investigating this issue [~jingge]. Let me

[jira] [Updated] (FLINK-33052) codespeed server is down

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-33052: --- Component/s: Benchmarks > codespeed server is down > > >

[jira] [Updated] (FLINK-33052) codespeed server is down

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-33052: --- Affects Version/s: 1.18.0 > codespeed server is down > > >

[jira] [Updated] (FLINK-33052) codespeed server is down

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-33052: --- Priority: Blocker (was: Major) > codespeed server is down > > >

[jira] [Closed] (FLINK-31387) StreamTaskCancellationTest.testCancelTaskShouldPreventAdditionalProcessingTimeTimersFromBeingFired failed with an assertion

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-31387. -- >

[jira] [Commented] (FLINK-23411) Expose Flink checkpoint details metrics

2023-09-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764113#comment-17764113 ] Piotr Nowojski commented on FLINK-23411: {quote} maybe we could still register some task level

[jira] [Comment Edited] (FLINK-23411) Expose Flink checkpoint details metrics

2023-09-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17763789#comment-17763789 ] Piotr Nowojski edited comment on FLINK-23411 at 9/11/23 3:51 PM: - Hey,

[jira] [Commented] (FLINK-23411) Expose Flink checkpoint details metrics

2023-09-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17763789#comment-17763789 ] Piotr Nowojski commented on FLINK-23411: Hey, I've just upon this ticket as we are also looking

[jira] [Created] (FLINK-33071) Log checkpoint statistics

2023-09-11 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-33071: -- Summary: Log checkpoint statistics Key: FLINK-33071 URL: https://issues.apache.org/jira/browse/FLINK-33071 Project: Flink Issue Type: New Feature

[jira] [Updated] (FLINK-13698) Rework threading model of CheckpointCoordinator

2023-08-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-13698: --- Priority: Not a Priority (was: Minor) > Rework threading model of CheckpointCoordinator >

[jira] [Comment Edited] (FLINK-18405) Add watermark support for unaligned checkpoints

2023-08-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752327#comment-17752327 ] Piotr Nowojski edited comment on FLINK-18405 at 8/9/23 8:47 AM: Actually

[jira] [Commented] (FLINK-18405) Add watermark support for unaligned checkpoints

2023-08-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752327#comment-17752327 ] Piotr Nowojski commented on FLINK-18405: Actually I don't see a problem with SQL OVER. Both

[jira] (FLINK-18405) Add watermark support for unaligned checkpoints

2023-08-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18405 ] Piotr Nowojski deleted comment on FLINK-18405: was (Author: pnowojski): To rephrase the problem using the concrete SQL OVER example. SQL Over ({{RowTimeRowsBoundedPrecedingFunction}})

[jira] [Comment Edited] (FLINK-18405) Add watermark support for unaligned checkpoints

2023-08-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752324#comment-17752324 ] Piotr Nowojski edited comment on FLINK-18405 at 8/9/23 8:37 AM: To

[jira] [Commented] (FLINK-18405) Add watermark support for unaligned checkpoints

2023-08-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752324#comment-17752324 ] Piotr Nowojski commented on FLINK-18405: To rephrase the problem using the concrete SQL OVER

[jira] [Commented] (FLINK-32548) Make watermark alignment ready for production use

2023-07-27 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17748194#comment-17748194 ] Piotr Nowojski commented on FLINK-32548: Good catch, I would bump this to {{PublicEvolving}}. >

[jira] [Comment Edited] (FLINK-32548) Make watermark alignment ready for production use

2023-07-27 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17747847#comment-17747847 ] Piotr Nowojski edited comment on FLINK-32548 at 7/27/23 8:38 AM: - I

[jira] [Commented] (FLINK-32548) Make watermark alignment ready for production use

2023-07-27 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17747847#comment-17747847 ] Piotr Nowojski commented on FLINK-32548: I agree with [~fanrui], given recent efforts from his

[jira] [Commented] (FLINK-25322) Support no-claim mode in changelog state backend

2023-07-27 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17747840#comment-17747840 ] Piotr Nowojski commented on FLINK-25322: Thanks for pointing this out [~masteryhx]. {quote} But

[jira] [Commented] (FLINK-19249) Detect broken connections in case TCP Timeout takes too long.

2023-07-19 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744645#comment-17744645 ] Piotr Nowojski commented on FLINK-19249: Hi [~Jiangang], no sorry there was no progress on that

[jira] [Closed] (FLINK-24402) Add a metric for back-pressure from the ChangelogStateBackend

2023-07-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-24402. -- Fix Version/s: 1.18.0 Resolution: Fixed merged commit bcdbc51 into apache:master >

[jira] [Assigned] (FLINK-24402) Add a metric for back-pressure from the ChangelogStateBackend

2023-07-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-24402: -- Assignee: Yanfei Lei > Add a metric for back-pressure from the ChangelogStateBackend

[jira] [Updated] (FLINK-32420) Watermark aggregation performance is poor when watermark alignment is enabled and parallelism is high

2023-07-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-32420: --- Release Note: This performance improvement would be good to mention in the release blog

[jira] [Commented] (FLINK-32420) Watermark aggregation performance is poor when watermark alignment is enabled and parallelism is high

2023-07-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17742846#comment-17742846 ] Piotr Nowojski commented on FLINK-32420: Yeah... no need for further comments :) Thanks

[jira] [Updated] (FLINK-32420) Watermark aggregation performance is poor when watermark alignment is enabled and parallelism is high

2023-07-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-32420: --- Attachment: Screenshot 2023-07-13 at 17.19.11.png Screenshot 2023-07-13 at

[jira] [Commented] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-07-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740998#comment-17740998 ] Piotr Nowojski commented on FLINK-31238: [~mayuehappy] thanks for your work on this! Really nice

[jira] [Commented] (FLINK-25322) Support no-claim mode in changelog state backend

2023-07-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740173#comment-17740173 ] Piotr Nowojski commented on FLINK-25322: Fair enough. In that case I would suggest to write a

[jira] [Commented] (FLINK-32437) Determine and set correct maxParallelism for operator chains

2023-07-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739693#comment-17739693 ] Piotr Nowojski commented on FLINK-32437: Shouldn't we also set different number of keyGroups per

[jira] [Commented] (FLINK-25322) Support no-claim mode in changelog state backend

2023-06-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738073#comment-17738073 ] Piotr Nowojski commented on FLINK-25322: Hi [~Feifan Wang] thanks for picking up this topic.

[jira] [Assigned] (FLINK-25322) Support no-claim mode in changelog state backend

2023-06-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-25322: -- Assignee: Feifan Wang (was: Yuan Mei) > Support no-claim mode in changelog state

[jira] [Comment Edited] (FLINK-31655) Adaptive Channel selection for partitioner

2023-06-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738053#comment-17738053 ] Piotr Nowojski edited comment on FLINK-31655 at 6/28/23 11:24 AM: -- I

[jira] [Commented] (FLINK-31655) Adaptive Channel selection for partitioner

2023-06-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738053#comment-17738053 ] Piotr Nowojski commented on FLINK-31655: I also like the idea with {{maxTraverseSize}} option. I

[jira] [Closed] (FLINK-32316) Duplicated announceCombinedWatermark task maybe scheduled if jobmanager failover

2023-06-27 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-32316. -- Fix Version/s: 1.18.0 1.16.3 1.17.2 Resolution:

[jira] [Closed] (FLINK-24881) When the Source is back pressured, the checkpoint interval may not take effect

2023-06-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-24881. -- Resolution: Not A Bug Hi, sorry for a late response, I have just stumbled across this ticket.

[jira] [Commented] (FLINK-21796) SQLClientKafkaITCase.testKafka fails to download Kafka

2023-06-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731505#comment-17731505 ] Piotr Nowojski commented on FLINK-21796: [~chesnay] [~dwysakowicz], as this has been fixed long

[jira] [Comment Edited] (FLINK-32303) Incorrect error message in KafkaSource

2023-06-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731021#comment-17731021 ] Piotr Nowojski edited comment on FLINK-32303 at 6/9/23 4:48 PM: I think

[jira] [Commented] (FLINK-32303) Incorrect error message in KafkaSource

2023-06-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731021#comment-17731021 ] Piotr Nowojski commented on FLINK-32303: I think this bug has been introduced by FLINK-25132 and

[jira] [Comment Edited] (FLINK-32303) Incorrect error message in KafkaSource

2023-06-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731021#comment-17731021 ] Piotr Nowojski edited comment on FLINK-32303 at 6/9/23 4:47 PM: I think

[jira] [Comment Edited] (FLINK-32303) Incorrect error message in KafkaSource

2023-06-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731021#comment-17731021 ] Piotr Nowojski edited comment on FLINK-32303 at 6/9/23 4:47 PM: I think

[jira] [Created] (FLINK-32303) Incorrect error message in KafkaSource

2023-06-09 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-32303: -- Summary: Incorrect error message in KafkaSource Key: FLINK-32303 URL: https://issues.apache.org/jira/browse/FLINK-32303 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-28853) FLIP-217 Support watermark alignment of source splits

2023-05-30 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727532#comment-17727532 ] Piotr Nowojski commented on FLINK-28853: Thanks for pointing this out [~asardaes]. Closed. >

[jira] [Closed] (FLINK-31519) The watermark alignment docs is outdated after FLIP-217 finished

2023-05-30 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-31519. -- Assignee: Mason Chen Resolution: Fixed Fixed via FLINK-28853 merged commit 678370b

[jira] [Commented] (FLINK-28386) Trigger an immediate checkpoint after all sources finished

2023-05-22 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724809#comment-17724809 ] Piotr Nowojski commented on FLINK-28386: Hi [~Jiang Xin], thanks! I guess it depends what you

[jira] [Assigned] (FLINK-28386) Trigger an immediate checkpoint after all sources finished

2023-05-22 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-28386: -- Assignee: Jiang Xin > Trigger an immediate checkpoint after all sources finished >

[jira] [Commented] (FLINK-31970) "Key group 0 is not in KeyGroupRange" when using CheckpointedFunction

2023-05-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17723386#comment-17723386 ] Piotr Nowojski commented on FLINK-31970: Yes, {{CheckpointedFunction}} can be used with a keyed

[jira] [Updated] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-16 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-31963: --- Fix Version/s: 1.16.2 1.18.0 1.17.1 >

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-16 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17723126#comment-17723126 ] Piotr Nowojski commented on FLINK-31963: To clarify impact of this bug. This is a rare issue

[jira] [Assigned] (FLINK-24696) Translate how to configure unaligned checkpoints into Chinese

2023-05-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-24696: -- Assignee: lijie > Translate how to configure unaligned checkpoints into Chinese >

[jira] [Commented] (FLINK-24696) Translate how to configure unaligned checkpoints into Chinese

2023-05-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722802#comment-17722802 ] Piotr Nowojski commented on FLINK-24696: Sure! Thanks :) > Translate how to configure unaligned

[jira] [Updated] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-31963: --- Affects Version/s: 1.15.4 1.16.1 1.18.0 >

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721777#comment-17721777 ] Piotr Nowojski commented on FLINK-31963: We have managed to reproduce and find the bug. Thank

[jira] [Assigned] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-31963: -- Assignee: Stefan Richter > java.lang.ArrayIndexOutOfBoundsException when scaling

[jira] [Closed] (FLINK-18808) Task-level numRecordsOut metric may be underestimated

2023-05-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-18808. -- Fix Version/s: 1.18.0 Resolution: Fixed Merged to master as 24685395ccf^^..24685395ccf

[jira] [Commented] (FLINK-31959) Correct the unaligned checkpoint type at checkpoint level

2023-05-10 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721233#comment-17721233 ] Piotr Nowojski commented on FLINK-31959: merged as 35254cbdc9a^,35254cbdc9a to master > Correct

[jira] [Updated] (FLINK-31959) Correct the unaligned checkpoint type at checkpoint level

2023-05-10 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-31959: --- Fix Version/s: 1.16.2 1.18.0 1.17.1 > Correct the

[jira] [Comment Edited] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720610#comment-17720610 ] Piotr Nowojski edited comment on FLINK-31963 at 5/9/23 3:23 PM: So far I

[jira] [Comment Edited] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720610#comment-17720610 ] Piotr Nowojski edited comment on FLINK-31963 at 5/8/23 5:03 PM:

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720610#comment-17720610 ] Piotr Nowojski commented on FLINK-31963: Additionally to what [~srichter] asked. [~tanee.kim],

[jira] [Updated] (FLINK-18753) Support local recovery for Unaligned checkpoints

2023-05-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-18753: --- Fix Version/s: (was: 1.18.0) > Support local recovery for Unaligned checkpoints >

[jira] [Commented] (FLINK-24657) Add metric of the total real size of input/output buffers queue

2023-05-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719732#comment-17719732 ] Piotr Nowojski commented on FLINK-24657: We had some discussion around that in the PR [~Weijie

[jira] [Comment Edited] (FLINK-31970) "Key group 0 is not in KeyGroupRange" when using CheckpointedFunction

2023-05-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719336#comment-17719336 ] Piotr Nowojski edited comment on FLINK-31970 at 5/4/23 1:53 PM:

[jira] [Commented] (FLINK-31970) "Key group 0 is not in KeyGroupRange" when using CheckpointedFunction

2023-05-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719336#comment-17719336 ] Piotr Nowojski commented on FLINK-31970: [~YordanPavlov] I was not able to reproduce your error,

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17718610#comment-17718610 ] Piotr Nowojski commented on FLINK-31963: Thanks for the answers [~tanee.kim] {quote} It happens

[jira] [Comment Edited] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scale down via autoscaler

2023-04-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717586#comment-17717586 ] Piotr Nowojski edited comment on FLINK-31963 at 4/28/23 9:51 AM: - Yes, I

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scale down via autoscaler

2023-04-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717586#comment-17717586 ] Piotr Nowojski commented on FLINK-31963: Yes, I agree it looks like a problem with unaligned

[jira] [Updated] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scale down via autoscaler

2023-04-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-31963: --- Component/s: (was: Kubernetes Operator) > java.lang.ArrayIndexOutOfBoundsException when

[jira] [Closed] (FLINK-26910) flink-benchmarks build fails on Apple M1 silicon

2023-04-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-26910. -- Fix Version/s: 1.18.0 Assignee: Martijn Visser Resolution: Fixed Merged to

[jira] [Closed] (FLINK-31925) Sync benchmark dependency versions with the version used in Flink

2023-04-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-31925. -- Resolution: Fixed Merged to flink-benchmarks master as 87c425f > Sync benchmark dependency

[jira] [Assigned] (FLINK-19010) Add a system metric to show the checkpoint restore time

2023-04-25 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-19010: -- Assignee: Yanfei Lei > Add a system metric to show the checkpoint restore time >

[jira] [Commented] (FLINK-19010) Add a system metric to show the checkpoint restore time

2023-04-24 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17715700#comment-17715700 ] Piotr Nowojski commented on FLINK-19010: [~zncheng], are you planning to add only a job level

[jira] [Commented] (FLINK-28386) Trigger an immediate checkpoint after all sources finished

2023-04-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714956#comment-17714956 ] Piotr Nowojski commented on FLINK-28386: [~zlzhang0122] Checkpoint could be used just to make

[jira] [Closed] (FLINK-31846) Support cancel final checkpoint when all tasks are finished

2023-04-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-31846. -- Resolution: Duplicate I will close this ticket, as I think it just duplicates FLINK-28386,

[jira] [Comment Edited] (FLINK-31846) Support cancel final checkpoint when all tasks are finished

2023-04-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714946#comment-17714946 ] Piotr Nowojski edited comment on FLINK-31846 at 4/21/23 11:33 AM: --

[jira] [Comment Edited] (FLINK-31846) Support cancel final checkpoint when all tasks are finished

2023-04-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714946#comment-17714946 ] Piotr Nowojski edited comment on FLINK-31846 at 4/21/23 11:32 AM: --

[jira] [Comment Edited] (FLINK-31846) Support cancel final checkpoint when all tasks are finished

2023-04-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714946#comment-17714946 ] Piotr Nowojski edited comment on FLINK-31846 at 4/21/23 11:08 AM: --

[jira] [Commented] (FLINK-31846) Support cancel final checkpoint when all tasks are finished

2023-04-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714946#comment-17714946 ] Piotr Nowojski commented on FLINK-31846: {quote} f the final checkpoint cannot be cancelled, can

[jira] [Comment Edited] (FLINK-31846) Support cancel final checkpoint when all tasks are finished

2023-04-20 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714562#comment-17714562 ] Piotr Nowojski edited comment on FLINK-31846 at 4/20/23 11:47 AM: -- Hey,

[jira] [Commented] (FLINK-31846) Support cancel final checkpoint when all tasks are finished

2023-04-20 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714562#comment-17714562 ] Piotr Nowojski commented on FLINK-31846: Hey, [~hongfanxo], your feature request would be very

[jira] [Closed] (FLINK-31745) Performance regression on serializerHeavyString since April 3rd

2023-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-31745. -- Resolution: Not A Problem It just restored performance back to the level from ~12th Jan

<    1   2   3   4   5   6   7   8   9   10   >