[jira] [Commented] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

2022-05-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534876#comment-17534876 ] Piotr Nowojski commented on FLINK-27251: I've looked at the code and I have a couple of high

[jira] [Commented] (FLINK-27251) Solve the problem that upstream Task cannot be switched to Unaligned Checkpoint

2022-05-10 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534325#comment-17534325 ] Piotr Nowojski commented on FLINK-27251: Thanks for rising the issue [~fanrui]. Yes, this is a

[jira] [Updated] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

2022-05-10 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27251: --- Summary: Timeout aligned to unaligned checkpoint barrier in the output buffers of an

[jira] [Updated] (FLINK-27530) FLIP-227: Support overdraft buffer

2022-05-06 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27530: --- Summary: FLIP-227: Support overdraft buffer (was: Support overdraft buffer) > FLIP-227:

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

2022-05-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531595#comment-17531595 ] Piotr Nowojski commented on FLINK-26803: Would removing 15K out of 50K files solve the issue for

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

2022-05-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531097#comment-17531097 ] Piotr Nowojski commented on FLINK-26803: If it's just a single file per {{OperatorChain}}, why

[jira] [Comment Edited] (FLINK-25872) Restoring from non-changelog checkpoint with changelog state-backend enabled in CLAIM mode discards state in use

2022-05-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530927#comment-17530927 ] Piotr Nowojski edited comment on FLINK-25872 at 5/2/22 7:47 PM:

[jira] [Commented] (FLINK-25872) Restoring from non-changelog checkpoint with changelog state-backend enabled in CLAIM mode discards state in use

2022-05-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530927#comment-17530927 ] Piotr Nowojski commented on FLINK-25872: I would second [~dwysakowicz] concerns if we really

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

2022-05-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530907#comment-17530907 ] Piotr Nowojski commented on FLINK-26803: {quote} one file for each operator in the chain {quote}

[jira] [Comment Edited] (FLINK-6755) Allow triggering Checkpoints through command line client

2022-04-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458438#comment-17458438 ] Piotr Nowojski edited comment on FLINK-6755 at 4/15/22 12:52 PM: - The

[jira] [Comment Edited] (FLINK-6755) Allow triggering Checkpoints through command line client

2022-04-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458438#comment-17458438 ] Piotr Nowojski edited comment on FLINK-6755 at 4/15/22 12:51 PM: - The

[jira] [Comment Edited] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522815#comment-17522815 ] Piotr Nowojski edited comment on FLINK-27101 at 4/15/22 12:48 PM: --

[jira] [Comment Edited] (FLINK-6755) Allow triggering Checkpoints through command line client

2022-04-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458438#comment-17458438 ] Piotr Nowojski edited comment on FLINK-6755 at 4/15/22 12:48 PM: - The

[jira] [Comment Edited] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522815#comment-17522815 ] Piotr Nowojski edited comment on FLINK-27101 at 4/15/22 12:47 PM: --

[jira] [Commented] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522815#comment-17522815 ] Piotr Nowojski commented on FLINK-27101: Checkpoint would be still owned by the Flink itself.

[jira] [Commented] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522243#comment-17522243 ] Piotr Nowojski commented on FLINK-27101: I've chatted offline with [~yunta] a bit about this. I

[jira] [Updated] (FLINK-6755) Allow triggering Checkpoints through command line client

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-6755: -- Priority: Not a Priority (was: Minor) > Allow triggering Checkpoints through command line

[jira] [Reopened] (FLINK-6755) Allow triggering Checkpoints through command line client

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reopened FLINK-6755: --- > Allow triggering Checkpoints through command line client >

[jira] [Updated] (FLINK-24191) Adjusting number of buffers besides buffer size

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-24191: --- Fix Version/s: (was: 1.16.0) > Adjusting number of buffers besides buffer size >

[jira] [Updated] (FLINK-15922) Show "Warn - received late message for checkpoint" only when checkpoint actually expired

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-15922: --- Priority: Not a Priority (was: Minor) > Show "Warn - received late message for checkpoint"

[jira] [Updated] (FLINK-13856) Reduce the delete file api when the checkpoint is completed

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-13856: --- Fix Version/s: (was: 1.16.0) > Reduce the delete file api when the checkpoint is

[jira] [Updated] (FLINK-15922) Show "Warn - received late message for checkpoint" only when checkpoint actually expired

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-15922: --- Fix Version/s: (was: 1.16.0) > Show "Warn - received late message for checkpoint" only

[jira] [Updated] (FLINK-14918) Add performance e2e test module and scripts

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-14918: --- Fix Version/s: (was: 1.16.0) > Add performance e2e test module and scripts >

[jira] [Updated] (FLINK-21317) Downstream keyed state not work after FlinkKafkaShuffle

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-21317: --- Fix Version/s: (was: 1.16.0) > Downstream keyed state not work after FlinkKafkaShuffle

[jira] [Commented] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521662#comment-17521662 ] Piotr Nowojski commented on FLINK-27101: But do you have in mind introducing something like

[jira] [Updated] (FLINK-27214) Build Failed on state backend benchmark

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27214: --- Fix Version/s: 1.16.0 > Build Failed on state backend benchmark >

[jira] [Updated] (FLINK-27214) Build Failed on state backend benchmark

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27214: --- Priority: Blocker (was: Major) > Build Failed on state backend benchmark >

[jira] [Updated] (FLINK-20217) More fine-grained timer processing

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-20217: --- Description: Timers are currently processed in one big block under the checkpoint lock

[jira] [Updated] (FLINK-20217) More fine-grained timer processing

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-20217: --- Component/s: Runtime / Task > More fine-grained timer processing >

[jira] [Updated] (FLINK-25688) Resolve performance degradation with high parallelism when using buffer debloating

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25688: --- Description: As documented in FLINK-25646, currently buffer debloating in Flink, at least

[jira] [Commented] (FLINK-24578) Unexpected erratic load shape for channel skew load profile and ~10% performance loss with enabled debloating

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521540#comment-17521540 ] Piotr Nowojski commented on FLINK-24578: As a next step in this ticket it might be a good idea

[jira] [Comment Edited] (FLINK-24578) Unexpected erratic load shape for channel skew load profile and ~10% performance loss with enabled debloating

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521539#comment-17521539 ] Piotr Nowojski edited comment on FLINK-24578 at 4/13/22 8:28 AM: - I've

[jira] [Updated] (FLINK-24578) Unexpected erratic load shape for channel skew load profile and ~10% performance loss with enabled debloating

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-24578: --- Summary: Unexpected erratic load shape for channel skew load profile and ~10% performance

[jira] [Commented] (FLINK-24578) Unexpected erratic load shape for channel skew load profile

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521539#comment-17521539 ] Piotr Nowojski commented on FLINK-24578: I've spent a couple of days thinking about this

[jira] [Created] (FLINK-27209) Half the Xmx and double the forkCount for unit tests

2022-04-12 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-27209: -- Summary: Half the Xmx and double the forkCount for unit tests Key: FLINK-27209 URL: https://issues.apache.org/jira/browse/FLINK-27209 Project: Flink

[jira] [Commented] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521141#comment-17521141 ] Piotr Nowojski commented on FLINK-27101: What do you have in mind to be pluggable [~yunta]? Just

[jira] [Comment Edited] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521141#comment-17521141 ] Piotr Nowojski edited comment on FLINK-27101 at 4/12/22 1:18 PM: - What

[jira] [Assigned] (FLINK-26052) Update chinese documentation regarding FLIP-203

2022-04-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-26052: -- Assignee: (was: Shen Zhu) > Update chinese documentation regarding FLIP-203 >

[jira] [Created] (FLINK-27202) NullPointerException on stop-with-savepoint with AsyncWaitOperator followed by FlinkKafkaProducer

2022-04-12 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-27202: -- Summary: NullPointerException on stop-with-savepoint with AsyncWaitOperator followed by FlinkKafkaProducer Key: FLINK-27202 URL:

[jira] [Commented] (FLINK-27133) Performance regression in serializerHeavyString

2022-04-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520525#comment-17520525 ] Piotr Nowojski commented on FLINK-27133: Thanks for investigating this [~mapohl]. I also tend to

[jira] [Closed] (FLINK-26864) Performance regression on 25.03.2022

2022-04-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-26864. -- Fix Version/s: 1.16.0 Resolution: Fixed merged commit fecd0fb into apache:master >

[jira] [Updated] (FLINK-14917) Add end to end performance testing framework

2022-04-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-14917: --- Priority: Not a Priority (was: Minor) > Add end to end performance testing framework >

[jira] [Assigned] (FLINK-15550) testCancelTaskExceptionAfterTaskMarkedFailed failed on azure

2022-04-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-15550: -- Assignee: (was: Anton Kalashnikov) >

[jira] [Updated] (FLINK-27133) Performance regression in serializerHeavyString

2022-04-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27133: --- Description:

[jira] [Updated] (FLINK-27133) Performance regression in serializerHeavyString

2022-04-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27133: --- Description:

[jira] [Updated] (FLINK-27133) Performance regression in serializerHeavyString

2022-04-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27133: --- Fix Version/s: 1.15.0 1.16.0 > Performance regression in

[jira] [Created] (FLINK-27133) Performance regression in serializerHeavyString

2022-04-08 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-27133: -- Summary: Performance regression in serializerHeavyString Key: FLINK-27133 URL: https://issues.apache.org/jira/browse/FLINK-27133 Project: Flink Issue

[jira] (FLINK-25852) Annotate SourceFunction and SinkFunction as deprecated

2022-04-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25852 ] Piotr Nowojski deleted comment on FLINK-25852: was (Author: pnowojski): [~daisyt], has this issue been fixed? If not I think we should keep this ticket open or close as "won't do" for

[jira] [Commented] (FLINK-25852) Annotate SourceFunction and SinkFunction as deprecated

2022-04-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17518876#comment-17518876 ] Piotr Nowojski commented on FLINK-25852: [~daisyt], has this issue been fixed? If not I think we

[jira] [Commented] (FLINK-24149) Make checkpoint self-contained and relocatable

2022-04-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17518823#comment-17518823 ] Piotr Nowojski commented on FLINK-24149: Thanks and no problem! > Make checkpoint

[jira] [Commented] (FLINK-18450) FLIP-182: Support watermark alignment

2022-04-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17518770#comment-17518770 ] Piotr Nowojski commented on FLINK-18450: To a very limited extent yes, but for the sake of

[jira] [Created] (FLINK-27117) FLIP-217: Support watermark alignment of source splits

2022-04-07 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-27117: -- Summary: FLIP-217: Support watermark alignment of source splits Key: FLINK-27117 URL: https://issues.apache.org/jira/browse/FLINK-27117 Project: Flink

[jira] [Closed] (FLINK-18450) FLIP-182: Support watermark alignment

2022-04-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-18450. -- Resolution: Fixed > FLIP-182: Support watermark alignment >

[jira] [Closed] (FLINK-25276) FLIP-203: Support native and incremental savepoints

2022-04-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-25276. -- Resolution: Fixed > FLIP-203: Support native and incremental savepoints >

[jira] [Commented] (FLINK-26052) Update chinese documentation regarding FLIP-203

2022-04-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17518765#comment-17518765 ] Piotr Nowojski commented on FLINK-26052: Hey [~shenzhu0127], are you still planning to work on

[jira] [Closed] (FLINK-26835) WordCountSubclassPOJOITCase failed on azure

2022-04-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-26835. -- Fix Version/s: 1.15.0 1.16.0 Resolution: Fixed Merged to master as

[jira] [Updated] (FLINK-26992) Passing directly between threads PojoSerializer may cause ConcurrentModificationException

2022-04-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26992: --- Summary: Passing directly between threads PojoSerializer may cause

[jira] [Commented] (FLINK-26835) WordCountSubclassPOJOITCase failed on azure

2022-03-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515356#comment-17515356 ] Piotr Nowojski commented on FLINK-26835: [~yunta]/[~ym]. While investigating this issue, we have

[jira] [Commented] (FLINK-25815) PulsarSourceITCase.testTaskManagerFailure failed on azure due to timeout

2022-03-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515175#comment-17515175 ] Piotr Nowojski commented on FLINK-25815: I've seen the same issue as reported by Matthias here:

[jira] [Updated] (FLINK-26018) Unnecessary late events when using the new KafkaSource

2022-03-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26018: --- Release Note: (was: Fixed on master: b9593715f35640154615df0098ac7459f37911c3

[jira] [Commented] (FLINK-26683) Commit side effects if stop-with-savepoint failed while finishing

2022-03-30 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17514869#comment-17514869 ] Piotr Nowojski commented on FLINK-26683: {quote} For example, as previous discussion, flink can

[jira] [Closed] (FLINK-26134) Document checkpoint/savepoint guarantees

2022-03-30 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-26134. -- Fix Version/s: 1.15.0 1.16.0 Resolution: Fixed Merged to master as

[jira] [Closed] (FLINK-23386) Running 'Resuming Savepoint (rocks, scale down, rocks timers) end-to-end test failed with TimeoutException when stopping with savepoint

2022-03-29 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-23386. -- Resolution: Cannot Reproduce > Running 'Resuming Savepoint (rocks, scale down, rocks timers)

[jira] [Closed] (FLINK-26130) Document why and when user would like to increase network buffer size

2022-03-29 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-26130. -- Fix Version/s: 1.15.0 1.16.0 1.14.5 Resolution:

[jira] [Commented] (FLINK-26721) PulsarSourceITCase.testSavepoint failed on azure pipeline

2022-03-29 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513915#comment-17513915 ] Piotr Nowojski commented on FLINK-26721:

[jira] [Closed] (FLINK-24177) Add epoll exception check

2022-03-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-24177. -- Resolution: Abandoned > Add epoll exception check > - > >

[jira] [Updated] (FLINK-26882) Unaligned checkpoint with 0s timeout would fail RescaleCheckpointManuallyITCase

2022-03-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26882: --- Priority: Blocker (was: Critical) > Unaligned checkpoint with 0s timeout would fail >

[jira] [Commented] (FLINK-26683) Terminate the job anyway if savepoint finished when stop-with-savepoint

2022-03-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513358#comment-17513358 ] Piotr Nowojski commented on FLINK-26683: I think in both cases we can restart/restore only to

[jira] [Commented] (FLINK-26790) Description image about Unaligned Checkpointing maybe incorrect.

2022-03-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513247#comment-17513247 ] Piotr Nowojski commented on FLINK-26790: I think [~assassinj]'s confusion is about the picture.

[jira] [Closed] (FLINK-22008) writing metadata is not an atomic operation, we should add a commit logic

2022-03-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-22008. -- Resolution: Duplicate > writing metadata is not an atomic operation, we should add a commit

[jira] [Assigned] (FLINK-26864) Performance regression on 25.03.2022

2022-03-25 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-26864: -- Assignee: Sebastian Mattheis (was: Piotr Nowojski) > Performance regression on

[jira] [Assigned] (FLINK-26864) Performance regression on 25.03.2022

2022-03-25 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-26864: -- Assignee: Piotr Nowojski > Performance regression on 25.03.2022 >

[jira] [Commented] (FLINK-26864) Performance regression on 25.03.2022

2022-03-25 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512287#comment-17512287 ] Piotr Nowojski commented on FLINK-26864: Suspected range: 010f622555..ff3336266e After first

[jira] [Created] (FLINK-26864) Performance regression on 25.03.2022

2022-03-25 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-26864: -- Summary: Performance regression on 25.03.2022 Key: FLINK-26864 URL: https://issues.apache.org/jira/browse/FLINK-26864 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-26683) Terminate the job anyway if savepoint finished when stop-with-savepoint

2022-03-22 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510537#comment-17510537 ] Piotr Nowojski commented on FLINK-26683: {quote} We suggest to change it so that when a failure

[jira] [Updated] (FLINK-26783) Restore from a stop-with-savepoint if failed during committing

2022-03-22 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26783: --- Fix Version/s: 1.15.0 > Restore from a stop-with-savepoint if failed during committing >

[jira] [Updated] (FLINK-22887) Backlog based optimizations for RebalancePartitioner and RescalePartitioner (load rebalance)

2022-03-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-22887: --- Summary: Backlog based optimizations for RebalancePartitioner and RescalePartitioner (load

[jira] [Assigned] (FLINK-26279) Provide mailbox delay metric

2022-03-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-26279: -- Assignee: Sebastian Mattheis > Provide mailbox delay metric >

[jira] [Closed] (FLINK-26279) Provide mailbox delay metric

2022-03-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-26279. -- Fix Version/s: 1.16.0 Resolution: Fixed merged commit 32c2ca7 into apache:master >

[jira] [Closed] (FLINK-26682) Migrate regression check script to python and to main repository

2022-03-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-26682. -- Fix Version/s: 1.16.0 Assignee: Piotr Nowojski Resolution: Fixed merged

[jira] [Assigned] (FLINK-24804) Upgrade oshi-core from v3.4.0 to v.5.8.3

2022-03-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-24804: -- Assignee: Sebastian Mattheis > Upgrade oshi-core from v3.4.0 to v.5.8.3 >

[jira] [Assigned] (FLINK-25505) Fix NetworkBufferPoolTest, SystemResourcesCounterTest on Apple M1

2022-03-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-25505: -- Assignee: Sebastian Mattheis > Fix NetworkBufferPoolTest, SystemResourcesCounterTest

[jira] [Updated] (FLINK-25505) Fix NetworkBufferPoolTest, SystemResourcesCounterTest on Apple M1

2022-03-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25505: --- Affects Version/s: 1.16.0 > Fix NetworkBufferPoolTest, SystemResourcesCounterTest on Apple

[jira] [Created] (FLINK-26682) Migrate regression check script to python and to main repository

2022-03-16 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-26682: -- Summary: Migrate regression check script to python and to main repository Key: FLINK-26682 URL: https://issues.apache.org/jira/browse/FLINK-26682 Project: Flink

[jira] [Comment Edited] (FLINK-26650) Avoid to print stack trace for checkpoint trigger failure if not all tasks are started

2022-03-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506939#comment-17506939 ] Piotr Nowojski edited comment on FLINK-26650 at 3/15/22, 2:36 PM: --

[jira] [Commented] (FLINK-26650) Avoid to print stack trace for checkpoint trigger failure if not all tasks are started

2022-03-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506939#comment-17506939 ] Piotr Nowojski commented on FLINK-26650: Checkpoint trigger failures is a super set of "not all

[jira] [Commented] (FLINK-26568) BlockingShuffleITCase.testDeletePartitionFileOfBoundedBlockingShuffle timing out on Azure

2022-03-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506102#comment-17506102 ] Piotr Nowojski commented on FLINK-26568: [~tanyuxin] [~kevin.cyj], could your team take a look

[jira] [Commented] (FLINK-16956) Git fetch failed with exit code 128

2022-03-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504920#comment-17504920 ] Piotr Nowojski commented on FLINK-16956: Ok, thanks for the explanation. > Git fetch failed

[jira] [Comment Edited] (FLINK-16956) Git fetch failed with exit code 128

2022-03-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504903#comment-17504903 ] Piotr Nowojski edited comment on FLINK-16956 at 3/11/22, 12:40 PM: ---

[jira] [Commented] (FLINK-16956) Git fetch failed with exit code 128

2022-03-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504903#comment-17504903 ] Piotr Nowojski commented on FLINK-16956: [~chesnay] Couldn't we implement either a retry

[jira] [Closed] (FLINK-20912) Increase Log and Metric: Time consumed by Checkpoint Restore

2022-03-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-20912. -- Resolution: Abandoned Closing as abandoned. Please feel free to re-open if the issue is still

[jira] [Commented] (FLINK-26018) Unnecessary late events when using the new KafkaSource

2022-03-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502163#comment-17502163 ] Piotr Nowojski commented on FLINK-26018: After an offline discussion we agreed for my team to

[jira] [Assigned] (FLINK-26018) Unnecessary late events when using the new KafkaSource

2022-03-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-26018: -- Assignee: (was: Qingsheng Ren) > Unnecessary late events when using the new

[jira] [Closed] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

2022-03-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-26049. -- Resolution: Fixed Thanks for reporting, describing and fixing the issue [~fanrui] :) > The

[jira] [Updated] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

2022-03-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26049: --- Fix Version/s: 1.14.4 > The tolerable-failed-checkpoints logic is invalid when checkpoint

[jira] [Comment Edited] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

2022-03-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500892#comment-17500892 ] Piotr Nowojski edited comment on FLINK-26049 at 3/4/22, 9:20 AM: - merged

[jira] [Commented] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

2022-03-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500892#comment-17500892 ] Piotr Nowojski commented on FLINK-26049: merged commit ffe353a into apache:master > The

[jira] [Commented] (FLINK-25869) Create a stress test cron build

2022-03-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500017#comment-17500017 ] Piotr Nowojski commented on FLINK-25869: After further offline discussions we reached a

[jira] [Updated] (FLINK-25869) Create a stress test cron build

2022-03-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25869: --- Fix Version/s: (was: 1.15.0) > Create a stress test cron build >

[jira] [Updated] (FLINK-25869) Create a stress test cron build

2022-03-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25869: --- Priority: Not a Priority (was: Critical) > Create a stress test cron build >

<    2   3   4   5   6   7   8   9   10   11   >