[jira] [Commented] (FLINK-26354) "-restoreMode" should be "--restoreMode" and should have a shorthand

2022-02-24 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17497541#comment-17497541 ] Piotr Nowojski commented on FLINK-26354: I don't have very strong preferences so feel free to

[jira] [Comment Edited] (FLINK-26306) Triggered checkpoints can be delayed by discarding shared state

2022-02-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496834#comment-17496834 ] Piotr Nowojski edited comment on FLINK-26306 at 2/23/22, 3:16 PM: --

[jira] [Commented] (FLINK-26306) Triggered checkpoints can be delayed by discarding shared state

2022-02-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496834#comment-17496834 ] Piotr Nowojski commented on FLINK-26306: {quote} We can avoid hardcoding these numbers and put

[jira] [Updated] (FLINK-26306) Triggered checkpoints can be delayed by discarding shared state

2022-02-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26306: --- Fix Version/s: 1.16.0 (was: 1.15.0) > Triggered checkpoints can be

[jira] [Comment Edited] (FLINK-26306) Triggered checkpoints can be delayed by discarding shared state

2022-02-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496736#comment-17496736 ] Piotr Nowojski edited comment on FLINK-26306 at 2/23/22, 12:55 PM: ---

[jira] [Commented] (FLINK-26306) Triggered checkpoints can be delayed by discarding shared state

2022-02-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496736#comment-17496736 ] Piotr Nowojski commented on FLINK-26306: Thanks for the explanation, I get it now. > 1. Batch

[jira] [Commented] (FLINK-26306) Triggered checkpoints can be delayed by discarding shared state

2022-02-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496567#comment-17496567 ] Piotr Nowojski commented on FLINK-26306: I've changed type of this issue to an improvement. >

[jira] [Updated] (FLINK-26306) Triggered checkpoints can be delayed by discarding shared state

2022-02-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26306: --- Issue Type: Improvement (was: Bug) > Triggered checkpoints can be delayed by discarding

[jira] [Commented] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

2022-02-22 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495982#comment-17495982 ] Piotr Nowojski commented on FLINK-26049: Ok, thanks for sharing the stack trace. Indeed we can

[jira] [Updated] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

2022-02-22 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26049: --- Issue Type: Bug (was: Improvement) > The tolerable-failed-checkpoints logic is invalid

[jira] [Commented] (FLINK-21871) Support watermark for Hive and Filesystem streaming source

2022-02-22 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495976#comment-17495976 ] Piotr Nowojski commented on FLINK-21871: Are you planning to actively develop this in the near

[jira] [Commented] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

2022-02-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495566#comment-17495566 ] Piotr Nowojski commented on FLINK-26049: Could you [~fanrui] post an example stack trace of an

[jira] [Commented] (FLINK-21871) Support watermark for Hive and Filesystem streaming source

2022-02-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495545#comment-17495545 ] Piotr Nowojski commented on FLINK-21871: Hey [~jark]. I have only now noticed this ticket. Can

[jira] [Closed] (FLINK-26080) PartitionRequest client use Netty's IdleStateHandler to monitor channel's status

2022-02-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-26080. -- Resolution: Duplicate Thanks for the confirmation [~cailiuyang]. I will close this one as a

[jira] [Updated] (FLINK-23870) Test the ability for ignoring in-flight data on recovery

2022-02-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-23870: --- Priority: Critical (was: Blocker) > Test the ability for ignoring in-flight data on

[jira] [Closed] (FLINK-23870) Test the ability for ignoring in-flight data on recovery

2022-02-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-23870. -- Fix Version/s: (was: 1.15.0) Resolution: Abandoned > Test the ability for ignoring

[jira] [Commented] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

2022-02-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495420#comment-17495420 ] Piotr Nowojski commented on FLINK-26049: Hi [~fanrui], I would suggest maybe to slow down here a

[jira] [Updated] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

2022-02-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26049: --- Issue Type: Improvement (was: Bug) > The tolerable-failed-checkpoints logic is invalid

[jira] [Commented] (FLINK-26018) Unnecessary late events when using the new KafkaSource

2022-02-18 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494672#comment-17494672 ] Piotr Nowojski commented on FLINK-26018: Yes [~danderson], you are right. Thanks for spotting

[jira] [Closed] (FLINK-26169) There is a typo in the annotation for the WatermarkAlignmentParams class

2022-02-18 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-26169. -- Resolution: Fixed Fixed as part of already merged issue FLINK-25983 > There is a typo in the

[jira] [Updated] (FLINK-26169) There is a typo in the annotation for the WatermarkAlignmentParams class

2022-02-18 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26169: --- Priority: Minor (was: Major) > There is a typo in the annotation for the

[jira] [Commented] (FLINK-26169) There is a typo in the annotation for the WatermarkAlignmentParams class

2022-02-18 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494665#comment-17494665 ] Piotr Nowojski commented on FLINK-26169: Thanks for spotting the typo! > There is a typo in the

[jira] [Assigned] (FLINK-26169) There is a typo in the annotation for the WatermarkAlignmentParams class

2022-02-18 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-26169: -- Assignee: Echo Lee > There is a typo in the annotation for the

[jira] [Commented] (FLINK-26018) Unnecessary late events when using the new KafkaSource

2022-02-18 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494539#comment-17494539 ] Piotr Nowojski commented on FLINK-26018: I believe solution to this problem and FLINK-21781

[jira] [Commented] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

2022-02-18 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494536#comment-17494536 ] Piotr Nowojski commented on FLINK-21364: Hi [~stevenz3wu] and [~thw]. Sorry for a late response

[jira] [Commented] (FLINK-26213) Translate "Deduplication" page into Chinese

2022-02-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493860#comment-17493860 ] Piotr Nowojski commented on FLINK-26213: Sure, thanks! > Translate "Deduplication" page into

[jira] [Assigned] (FLINK-26213) Translate "Deduplication" page into Chinese

2022-02-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-26213: -- Assignee: Edmond Wang > Translate "Deduplication" page into Chinese >

[jira] [Updated] (FLINK-25819) NetworkBufferPoolTest.testIsAvailableOrNotAfterRequestAndRecycleMultiSegments fails on AZP

2022-02-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25819: --- Issue Type: Bug (was: New Feature) >

[jira] [Commented] (FLINK-26080) PartitionRequest client use Netty's IdleStateHandler to monitor channel's status

2022-02-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493825#comment-17493825 ] Piotr Nowojski commented on FLINK-26080: Hey [~cailiuyang]. Isn't this a duplicate of

[jira] [Updated] (FLINK-25989) EventTimeWindowCheckpointingITCase failed with exit code 137

2022-02-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25989: --- Component/s: API / DataStream (was: Runtime / Checkpointing) >

[jira] [Assigned] (FLINK-25958) OOME Checkpoints & Savepoints were shown as COMPLETE in Flink UI

2022-02-16 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-25958: -- Assignee: Anton Kalashnikov > OOME Checkpoints & Savepoints were shown as COMPLETE

[jira] [Updated] (FLINK-26147) Incremental savepoints directory in CLAIM mode is not being deleted

2022-02-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26147: --- Summary: Incremental savepoints directory in CLAIM mode is not being deleted (was:

[jira] [Updated] (FLINK-26147) Deleting incremental savepoints directory in CLAIM mode

2022-02-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26147: --- Parent: (was: FLINK-25276) Issue Type: Improvement (was: Sub-task) > Deleting

[jira] [Updated] (FLINK-25414) Provide metrics to measure how long task has been blocked

2022-02-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25414: --- Description: https://lists.apache.org/thread/f6ffk9912fg5j1rfkxbzrh0qmp4w6qry Currently

[jira] [Created] (FLINK-26147) Deleting incremental savepoints directory in CLAIM mode

2022-02-15 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-26147: -- Summary: Deleting incremental savepoints directory in CLAIM mode Key: FLINK-26147 URL: https://issues.apache.org/jira/browse/FLINK-26147 Project: Flink

[jira] [Created] (FLINK-26146) Add test coverage for native format flink upgrades (minor versions)

2022-02-15 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-26146: -- Summary: Add test coverage for native format flink upgrades (minor versions) Key: FLINK-26146 URL: https://issues.apache.org/jira/browse/FLINK-26146 Project:

[jira] [Assigned] (FLINK-26146) Add test coverage for native format flink upgrades (minor versions)

2022-02-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-26146: -- Assignee: Sebastian Mattheis > Add test coverage for native format flink upgrades

[jira] [Closed] (FLINK-26002) Add test coverage for native format job upgrades

2022-02-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-26002. -- Resolution: Fixed merged commit 1cf276b into apache:master > Add test coverage for native

[jira] [Updated] (FLINK-26002) Add test coverage for native format job upgrades

2022-02-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26002: --- Parent: FLINK-25276 Issue Type: Sub-task (was: Improvement) > Add test coverage

[jira] [Updated] (FLINK-26134) Document checkpoint/savepoint guarantees

2022-02-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26134: --- Parent: FLINK-25276 Issue Type: Sub-task (was: Improvement) > Document

[jira] [Closed] (FLINK-24441) Block SourceReader when watermarks are out of alignment

2022-02-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-24441. -- Resolution: Fixed Merged to master as 40dc2b48f0e > Block SourceReader when watermarks are

[jira] [Commented] (FLINK-26079) Disallow combination of Changelog backend with CLAIM restore mode when recovering from non-changelog checkpoint

2022-02-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490957#comment-17490957 ] Piotr Nowojski commented on FLINK-26079: So let's do that. Given the MVP status of the changelog

[jira] [Commented] (FLINK-26079) Disallow combination of Changelog backend with CLAIM restore mode when recovering from non-changelog checkpoint

2022-02-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490923#comment-17490923 ] Piotr Nowojski commented on FLINK-26079: {quote} I see the following alternatives: 1. Fix the

[jira] [Reopened] (FLINK-25664) Notify will be not triggered for PipelinedSubpartition if more than one buffer is added during isBlocked == true

2022-02-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reopened FLINK-25664: > Notify will be not triggered for PipelinedSubpartition if more than one > buffer is added

[jira] [Closed] (FLINK-25664) Notify will be not triggered for PipelinedSubpartition if more than one buffer is added during isBlocked == true

2022-02-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-25664. -- Resolution: Not A Problem > Notify will be not triggered for PipelinedSubpartition if more

[jira] [Commented] (FLINK-25664) Notify will be not triggered for PipelinedSubpartition if more than one buffer is added during isBlocked == true

2022-02-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490916#comment-17490916 ] Piotr Nowojski commented on FLINK-25664: No problem, cheers :) And sorry for late initial

[jira] [Updated] (FLINK-25664) Notify will be not triggered for PipelinedSubpartition if more than one buffer is added during isBlocked == true

2022-02-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25664: --- Priority: Critical (was: Major) > Notify will be not triggered for PipelinedSubpartition

[jira] [Commented] (FLINK-25664) Notify will be not triggered for PipelinedSubpartition if more than one buffer is added during isBlocked == true

2022-02-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490746#comment-17490746 ] Piotr Nowojski commented on FLINK-25664: Hi [~cailiuyang]. What problem is this behaviour

[jira] [Commented] (FLINK-26079) Disallow combination of Changelog backend with CLAIM restore mode when recovering from non-changelog checkpoint

2022-02-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490729#comment-17490729 ] Piotr Nowojski commented on FLINK-26079: {quote} The 1st option is resilient to failures because

[jira] [Commented] (FLINK-18356) Exit code 137 returned from process

2022-02-10 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490714#comment-17490714 ] Piotr Nowojski commented on FLINK-18356: Another two examples of "We stopped hearing from agent

[jira] [Commented] (FLINK-26036) LocalRecoveryITCase.testRecoverLocallyFromProcessCrashWithWorkingDirectory timeout on azure

2022-02-10 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490470#comment-17490470 ] Piotr Nowojski commented on FLINK-26036:

[jira] [Closed] (FLINK-24440) Announce and combine latest watermarks across SourceReaders

2022-02-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-24440. -- Resolution: Fixed merged commit 10d6d4f into apache:master > Announce and combine latest

[jira] [Created] (FLINK-26064) KinesisFirehoseSinkITCase IllegalStateException: Trying to access closed classloader

2022-02-09 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-26064: -- Summary: KinesisFirehoseSinkITCase IllegalStateException: Trying to access closed classloader Key: FLINK-26064 URL: https://issues.apache.org/jira/browse/FLINK-26064

[jira] [Commented] (FLINK-24439) Introduce CoordinatorStore

2022-02-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489421#comment-17489421 ] Piotr Nowojski commented on FLINK-24439: The intended usage is basically the parent

[jira] [Updated] (FLINK-25566) Fail to cancel task if disk is bad for java.lang.NoClassDefFoundError

2022-02-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25566: --- Component/s: Runtime / Coordination (was: Runtime / Task) > Fail to

[jira] [Commented] (FLINK-25566) Fail to cancel task if disk is bad for java.lang.NoClassDefFoundError

2022-02-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489353#comment-17489353 ] Piotr Nowojski commented on FLINK-25566: I see your point and I tend to agree, that Flink

[jira] [Commented] (FLINK-25872) Restoring from incremental non-changelog checkpoint with changelog state-backend enabled in CLAIM mode discards state in use

2022-02-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488851#comment-17488851 ] Piotr Nowojski commented on FLINK-25872: I'm bumping this to release blocker, as this bug would

[jira] [Updated] (FLINK-25872) Restoring from incremental non-changelog checkpoint with changelog state-backend enabled in CLAIM mode discards state in use

2022-02-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25872: --- Fix Version/s: 1.15.0 > Restoring from incremental non-changelog checkpoint with changelog

[jira] [Updated] (FLINK-25872) Restoring from incremental non-changelog checkpoint with changelog state-backend enabled in CLAIM mode discards state in use

2022-02-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25872: --- Priority: Blocker (was: Major) > Restoring from incremental non-changelog checkpoint with

[jira] [Updated] (FLINK-23240) ResumeCheckpointManuallyITCase.testExternalizedFSCheckpointsWithLocalRecoveryZookeeper fails on azure

2022-02-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-23240: --- Component/s: (was: Runtime / Checkpointing) >

[jira] [Updated] (FLINK-25982) Support idleness with watermark alignment

2022-02-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25982: --- Description: In the PoC idleness is ignored. What it means is that even if all splits are

[jira] [Updated] (FLINK-25982) Support idleness with watermark alignment

2022-02-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25982: --- Description: In the PoC idleness is ignored. What it means that even if all splits are

[jira] [Closed] (FLINK-24439) Introduce CoordinatorStore

2022-02-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-24439. -- Resolution: Fixed merged commit 271c593 into apache:master > Introduce CoordinatorStore >

[jira] [Commented] (FLINK-25566) Fail to cancel task if disk is bad for java.lang.NoClassDefFoundError

2022-02-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488133#comment-17488133 ] Piotr Nowojski commented on FLINK-25566: Hey [~Jiangang]. I'm not sure what would you like us to

[jira] [Created] (FLINK-25982) Support idleness with watermark alignment

2022-02-07 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-25982: -- Summary: Support idleness with watermark alignment Key: FLINK-25982 URL: https://issues.apache.org/jira/browse/FLINK-25982 Project: Flink Issue Type:

[jira] [Assigned] (FLINK-25914) Performance regression in checkpointSingleInput.UNALIGNED on 31.01.2022

2022-02-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-25914: -- Assignee: Roman Khachatryan (was: Piotr Nowojski) > Performance regression in

[jira] [Updated] (FLINK-25902) NullPointerException in RescalingITCase.testSavepointRescalingOutKeyedState

2022-02-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25902: --- Component/s: Runtime / State Backends (was: Runtime / Checkpointing) >

[jira] [Updated] (FLINK-25833) FlinkUserCodeClassLoader is not registered as parallel capable

2022-02-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25833: --- Component/s: API / Core (was: Runtime / Task) >

[jira] [Updated] (FLINK-25832) When the TaskManager is closed, its associated slot is not set to the released state.

2022-02-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25832: --- Component/s: Runtime / Coordination (was: Runtime / Task) > When the

[jira] [Closed] (FLINK-25827) Potential memory leaks in SourceOperator

2022-02-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-25827. -- Resolution: Fixed merged to master as d95dc864959~4..d95dc864959 merged to release-1.14 as

[jira] [Commented] (FLINK-24483) Document what is Public API and what compatibility guarantees Flink is providing

2022-02-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487035#comment-17487035 ] Piotr Nowojski commented on FLINK-24483: Yes. I would still argue so. That's one of the things

[jira] [Commented] (FLINK-25958) OOME Checkpoints & Savepoints were shown as COMPLETE in Flink UI

2022-02-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17486941#comment-17486941 ] Piotr Nowojski commented on FLINK-25958: It looks like the problem is caused by pre-mature

[jira] [Updated] (FLINK-25958) OOME Checkpoints & Savepoints were shown as COMPLETE in Flink UI

2022-02-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25958: --- Affects Version/s: 1.14.3 1.12.7 1.15.0 >

[jira] [Updated] (FLINK-25914) Performance regression in checkpointSingleInput.UNALIGNED on 31.01.2022

2022-02-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25914: --- Description:

[jira] [Commented] (FLINK-25914) Performance regression in checkpointSingleInput.UNALIGNED on 31.01.2022

2022-02-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17485757#comment-17485757 ] Piotr Nowojski commented on FLINK-25914: I've run bisect and have confirmed that the regression

[jira] [Updated] (FLINK-25426) UnalignedCheckpointRescaleITCase.shouldRescaleUnalignedCheckpoint fails on AZP because it cannot allocate enough network buffers

2022-02-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25426: --- Priority: Critical (was: Blocker) >

[jira] [Created] (FLINK-25914) Performance regression in checkpointSingleInput.UNALIGNED on 31.01.2022

2022-02-01 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-25914: -- Summary: Performance regression in checkpointSingleInput.UNALIGNED on 31.01.2022 Key: FLINK-25914 URL: https://issues.apache.org/jira/browse/FLINK-25914 Project:

[jira] [Updated] (FLINK-25704) Performance regression on 18.01.2022 in batch network benchmarks

2022-02-01 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25704: --- Issue Type: Bug (was: Improvement) > Performance regression on 18.01.2022 in batch network

[jira] [Created] (FLINK-25912) HashMapStateBackend performance regression on 31.01.2022

2022-02-01 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-25912: -- Summary: HashMapStateBackend performance regression on 31.01.2022 Key: FLINK-25912 URL: https://issues.apache.org/jira/browse/FLINK-25912 Project: Flink

[jira] [Commented] (FLINK-25847) KubernetesHighAvailabilityRecoverFromSavepointITCase. testRecoverFromSavepoint failed on azure

2022-02-01 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17485187#comment-17485187 ] Piotr Nowojski commented on FLINK-25847: [~trohrmann], could this deadlock by an explanation for

[jira] [Comment Edited] (FLINK-25847) KubernetesHighAvailabilityRecoverFromSavepointITCase. testRecoverFromSavepoint failed on azure

2022-02-01 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17485187#comment-17485187 ] Piotr Nowojski edited comment on FLINK-25847 at 2/1/22, 11:27 AM: --

[jira] [Closed] (FLINK-25154) FLIP-193: Snapshots ownership

2022-02-01 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-25154. -- Resolution: Fixed > FLIP-193: Snapshots ownership > - > >

[jira] [Updated] (FLINK-25195) Use duplicating API for shared artefacts in RocksDB snapshots

2022-02-01 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25195: --- Fix Version/s: 1.16.0 (was: 1.15.0) > Use duplicating API for shared

[jira] [Updated] (FLINK-25195) Use duplicating API for shared artefacts in RocksDB snapshots

2022-02-01 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25195: --- Parent Issue: FLINK-25887 (was: FLINK-25154) > Use duplicating API for shared artefacts in

[jira] [Commented] (FLINK-25704) Performance regression on 18.01.2022 in batch network benchmarks

2022-02-01 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17485174#comment-17485174 ] Piotr Nowojski commented on FLINK-25704: Changes to the settings merged to flink-benchmark

[jira] [Closed] (FLINK-25728) Potential memory leaks in StreamMultipleInputProcessor

2022-01-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-25728. -- Fix Version/s: 1.15.0 1.13.6 1.14.4 Resolution:

[jira] [Assigned] (FLINK-25728) Potential memory leaks in StreamMultipleInputProcessor

2022-01-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-25728: -- Assignee: pc wang > Potential memory leaks in StreamMultipleInputProcessor >

[jira] [Updated] (FLINK-25896) Buffer debloating issues with high parallelism

2022-01-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25896: --- Description: As described in FLINK-25646, currently buffer debloating has performance

[jira] [Created] (FLINK-25896) Buffer debloating issues with high parallelism

2022-01-31 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-25896: -- Summary: Buffer debloating issues with high parallelism Key: FLINK-25896 URL: https://issues.apache.org/jira/browse/FLINK-25896 Project: Flink Issue

[jira] [Updated] (FLINK-25276) FLIP-203: Support native and incremental savepoints

2022-01-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25276: --- Summary: FLIP-203: Support native and incremental savepoints (was: FLIP-182: Support

[jira] [Assigned] (FLINK-25827) Potential memory leaks in SourceOperator

2022-01-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-25827: -- Assignee: Piotr Nowojski > Potential memory leaks in SourceOperator >

[jira] [Commented] (FLINK-25728) Potential memory leaks in StreamMultipleInputProcessor

2022-01-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17483792#comment-17483792 ] Piotr Nowojski commented on FLINK-25728: After an offline discussion with [~chesnay], we agreed

[jira] [Created] (FLINK-25869) Create a stress test cron build

2022-01-28 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-25869: -- Summary: Create a stress test cron build Key: FLINK-25869 URL: https://issues.apache.org/jira/browse/FLINK-25869 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-25827) Potential memory leaks in SourceOperator

2022-01-26 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25827: --- Parent: (was: FLINK-25728) Issue Type: Bug (was: Sub-task) > Potential memory

[jira] [Created] (FLINK-25827) Potential memory leaks in SourceOperator

2022-01-26 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-25827: -- Summary: Potential memory leaks in SourceOperator Key: FLINK-25827 URL: https://issues.apache.org/jira/browse/FLINK-25827 Project: Flink Issue Type:

[jira] [Closed] (FLINK-25590) Logging warning of insufficient memory for all configured buffers

2022-01-26 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-25590. -- Fix Version/s: 1.15.0 Assignee: Piotr Nowojski Resolution: Fixed Merged to

[jira] [Commented] (FLINK-25704) Performance regression on 18.01.2022 in batch network benchmarks

2022-01-26 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482328#comment-17482328 ] Piotr Nowojski commented on FLINK-25704: Thanks for the investigation [~kevin.cyj] {quote} Make

[jira] [Commented] (FLINK-25728) Potential memory leaks in StreamMultipleInputProcessor

2022-01-25 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481954#comment-17481954 ] Piotr Nowojski commented on FLINK-25728: Thanks for the confirmation. Good catch! (let's move

[jira] [Commented] (FLINK-25728) Potential memory leaks in StreamMultipleInputProcessor

2022-01-25 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481909#comment-17481909 ] Piotr Nowojski commented on FLINK-25728: Thanks for reporting and analysing the issue [~wpc009].

[jira] [Updated] (FLINK-25728) Potential memory leaks in StreamMultipleInputProcessor

2022-01-25 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25728: --- Priority: Critical (was: Blocker) > Potential memory leaks in StreamMultipleInputProcessor

<    3   4   5   6   7   8   9   10   11   12   >