[jira] [Commented] (FLINK-35899) Accumulated TumblingProcessingTimeWindows in the state for a few days

2024-07-26 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17868956#comment-17868956 ] Piotr Nowojski commented on FLINK-35899: {quote} how flink decides what timers must be fired

[jira] [Commented] (FLINK-35899) Accumulated TumblingProcessingTimeWindows in the state for a few days

2024-07-26 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17868932#comment-17868932 ] Piotr Nowojski commented on FLINK-35899: Partially. FLIP-443/FLINK-20217 would help with this

[jira] [Comment Edited] (FLINK-35886) Incorrect watermark idleness timeout accounting when subtask is backpressured/blocked

2024-07-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17868098#comment-17868098 ] Piotr Nowojski edited comment on FLINK-35886 at 7/23/24 3:45 PM: - I

[jira] [Commented] (FLINK-35886) Incorrect watermark idleness timeout accounting when subtask is backpressured/blocked

2024-07-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17868098#comment-17868098 ] Piotr Nowojski commented on FLINK-35886: I think this problem requires a public API change, so I

[jira] [Assigned] (FLINK-35886) Incorrect watermark idleness timeout accounting when subtask is backpressured/blocked

2024-07-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-35886: -- Assignee: Piotr Nowojski > Incorrect watermark idleness timeout accounting when

[jira] [Created] (FLINK-35886) Incorrect watermark idleness timeout accounting when subtask is backpressured/blocked

2024-07-23 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35886: -- Summary: Incorrect watermark idleness timeout accounting when subtask is backpressured/blocked Key: FLINK-35886 URL: https://issues.apache.org/jira/browse/FLINK-35886

[jira] [Commented] (FLINK-35860) S5CmdOnMinioITCase failed due to IllegalAccessError in JDK17/21

2024-07-19 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17867284#comment-17867284 ] Piotr Nowojski commented on FLINK-35860: Thanks for closing the ticket [~Weijie Guo]. >

[jira] [Assigned] (FLINK-35860) S5CmdOnMinioITCase failed due to IllegalAccessError in JDK17/21

2024-07-18 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-35860: -- Assignee: Piotr Nowojski > S5CmdOnMinioITCase failed due to IllegalAccessError in

[jira] [Closed] (FLINK-35767) Provide native file copy support for S3 using s5cmd

2024-07-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-35767. -- Fix Version/s: 2.0.0 1.20.0 Resolution: Fixed Merged to master as

[jira] [Closed] (FLINK-35768) Use native file copy in RocksDBStateDownloader

2024-07-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-35768. -- Fix Version/s: 2.0.0 1.20.0 Resolution: Fixed Merged to master as

[jira] [Closed] (FLINK-35821) ResumeCheckpointManuallyITCase failed with File X does not exist or the user running Flink C has insufficient permissions to access it

2024-07-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-35821. -- Resolution: Duplicate > ResumeCheckpointManuallyITCase failed with File X does not exist or

[jira] [Commented] (FLINK-35821) ResumeCheckpointManuallyITCase failed with File X does not exist or the user running Flink C has insufficient permissions to access it

2024-07-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17865353#comment-17865353 ] Piotr Nowojski commented on FLINK-35821: Thanks for the update. After rebasing azure is green so

[jira] [Comment Edited] (FLINK-35754) SqlGatewayE2ECase.testMaterializedTableInFullMode failed due to Internal Server Error

2024-07-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17865115#comment-17865115 ] Piotr Nowojski edited comment on FLINK-35754 at 7/11/24 3:08 PM: -

[jira] [Commented] (FLINK-35754) SqlGatewayE2ECase.testMaterializedTableInFullMode failed due to Internal Server Error

2024-07-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17865115#comment-17865115 ] Piotr Nowojski commented on FLINK-35754: [~hackergin], can you elaborate what's the problem? Is

[jira] [Updated] (FLINK-35821) ResumeCheckpointManuallyITCase failed with File X does not exist or the user running Flink C has insufficient permissions to access it

2024-07-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35821: --- Description:

[jira] [Updated] (FLINK-35821) ResumeCheckpointManuallyITCase failed with File X does not exist or the user running Flink C has insufficient permissions to access it

2024-07-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35821: --- Description:

[jira] [Created] (FLINK-35821) ResumeCheckpointManuallyITCase failed with File X does not exist or the user running Flink C has insufficient permissions to access it

2024-07-11 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35821: -- Summary: ResumeCheckpointManuallyITCase failed with File X does not exist or the user running Flink C has insufficient permissions to access it Key: FLINK-35821 URL:

[jira] [Created] (FLINK-35773) Document s5cmd

2024-07-05 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35773: -- Summary: Document s5cmd Key: FLINK-35773 URL: https://issues.apache.org/jira/browse/FLINK-35773 Project: Flink Issue Type: Sub-task

[jira] [Assigned] (FLINK-35768) Use native file copy in RocksDBStateDownloader

2024-07-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-35768: -- Assignee: Piotr Nowojski > Use native file copy in RocksDBStateDownloader >

[jira] [Created] (FLINK-35772) Deprecate/remove DuplicatingFileSystem

2024-07-05 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35772: -- Summary: Deprecate/remove DuplicatingFileSystem Key: FLINK-35772 URL: https://issues.apache.org/jira/browse/FLINK-35772 Project: Flink Issue Type:

[jira] [Created] (FLINK-35770) Interrupt s5cmd call on cancellation

2024-07-05 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35770: -- Summary: Interrupt s5cmd call on cancellation Key: FLINK-35770 URL: https://issues.apache.org/jira/browse/FLINK-35770 Project: Flink Issue Type:

[jira] [Assigned] (FLINK-35767) Provide native file copy support for S3 using s5cmd

2024-07-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-35767: -- Assignee: Piotr Nowojski > Provide native file copy support for S3 using s5cmd >

[jira] [Assigned] (FLINK-35739) FLIP-444: Native file copy support

2024-07-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-35739: -- Assignee: Piotr Nowojski > FLIP-444: Native file copy support >

[jira] [Created] (FLINK-35771) Limit s5cmd resource usage

2024-07-05 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35771: -- Summary: Limit s5cmd resource usage Key: FLINK-35771 URL: https://issues.apache.org/jira/browse/FLINK-35771 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35767) Provide native file copy support for S3 using s5cmd

2024-07-05 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35767: -- Summary: Provide native file copy support for S3 using s5cmd Key: FLINK-35767 URL: https://issues.apache.org/jira/browse/FLINK-35767 Project: Flink

[jira] [Created] (FLINK-35768) Use native file copy in RocksDBStateDownloader

2024-07-05 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35768: -- Summary: Use native file copy in RocksDBStateDownloader Key: FLINK-35768 URL: https://issues.apache.org/jira/browse/FLINK-35768 Project: Flink Issue

[jira] [Updated] (FLINK-35739) FLIP-444: Native file copy support

2024-07-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35739: --- Component/s: Runtime / State Backends > FLIP-444: Native file copy support >

[jira] [Created] (FLINK-35739) FLIP-444: Native file copy support

2024-07-02 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35739: -- Summary: FLIP-444: Native file copy support Key: FLINK-35739 URL: https://issues.apache.org/jira/browse/FLINK-35739 Project: Flink Issue Type: New

[jira] [Closed] (FLINK-35614) Release Testing Instructions: Verify FLIP-443: Interruptible timers firing

2024-07-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-35614. -- Resolution: Won't Fix I think there is no need to test this feature: * it is already covered

[jira] [Comment Edited] (FLINK-25646) Document buffer debloating issues with high parallelism

2024-06-24 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17859595#comment-17859595 ] Piotr Nowojski edited comment on FLINK-25646 at 6/24/24 7:39 AM: - Yes,

[jira] [Commented] (FLINK-25646) Document buffer debloating issues with high parallelism

2024-06-24 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17859595#comment-17859595 ] Piotr Nowojski commented on FLINK-25646: Yes, that would be the best. Neither me nor

[jira] [Commented] (FLINK-25646) Document buffer debloating issues with high parallelism

2024-06-19 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17856273#comment-17856273 ] Piotr Nowojski commented on FLINK-25646: Hi [~hejufang001]. No, there have been no progress on

[jira] [Commented] (FLINK-35629) Performance regression in stringRead and stringWrite

2024-06-19 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17856172#comment-17856172 ] Piotr Nowojski commented on FLINK-35629: It's strange, why JMH upgrade is causing this? Isn't

[jira] [Closed] (FLINK-34252) WatermarkAssignerOperator should not emit WatermarkStatus.IDLE under continuous data flow

2024-06-18 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-34252. -- Fix Version/s: 1.19.2 Resolution: Fixed merged to release-1.18 as b60318ba1a7^ and

[jira] [Commented] (FLINK-34252) WatermarkAssignerOperator should not emit WatermarkStatus.IDLE under continuous data flow

2024-06-18 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17855830#comment-17855830 ] Piotr Nowojski commented on FLINK-34252: Merged to master as d93e92c665a and d93e92c665a^ >

[jira] [Assigned] (FLINK-34252) WatermarkAssignerOperator should not emit WatermarkStatus.IDLE under continuous data flow

2024-06-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-34252: -- Assignee: Piotr Nowojski (was: David Christle) > WatermarkAssignerOperator should

[jira] [Closed] (FLINK-20217) More fine-grained timer processing

2024-06-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-20217. -- Release Note: Firing timers can now be interrupted to speed up checkpointing. Timers that

[jira] (FLINK-20217) More fine-grained timer processing

2024-06-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20217 ] Piotr Nowojski deleted comment on FLINK-20217: was (Author: pnowojski): Firing timers can now be interrupted to speed up checkpointing. Timers that were interrupted by a checkpoint,

[jira] [Reopened] (FLINK-20217) More fine-grained timer processing

2024-06-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reopened FLINK-20217: > More fine-grained timer processing > -- > >

[jira] [Closed] (FLINK-20217) More fine-grained timer processing

2024-06-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-20217. -- Fix Version/s: 1.20.0 Resolution: Fixed Firing timers can now be interrupted to speed

[jira] [Closed] (FLINK-35528) Skip execution of interruptible mails when yielding

2024-06-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-35528. -- Fix Version/s: 1.20.0 Resolution: Fixed merged commit 77cd1cd into apache:master now

[jira] [Commented] (FLINK-20217) More fine-grained timer processing

2024-06-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854413#comment-17854413 ] Piotr Nowojski commented on FLINK-20217: Merged to master as 503593ab2d4..986d06d2cd7 > More

[jira] [Created] (FLINK-35528) Skip execution of interruptible mails when yielding

2024-06-05 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35528: -- Summary: Skip execution of interruptible mails when yielding Key: FLINK-35528 URL: https://issues.apache.org/jira/browse/FLINK-35528 Project: Flink

[jira] [Updated] (FLINK-35518) CI Bot doesn't run on PRs - status UNKNOWN

2024-06-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35518: --- Summary: CI Bot doesn't run on PRs - status UNKNOWN (was: CI Bot doesn't run on PRs) > CI

[jira] [Created] (FLINK-35518) CI Bot doesn't run on PRs

2024-06-04 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35518: -- Summary: CI Bot doesn't run on PRs Key: FLINK-35518 URL: https://issues.apache.org/jira/browse/FLINK-35518 Project: Flink Issue Type: Bug

[jira] [Comment Edited] (FLINK-30719) flink-runtime-web failed due to a corrupted nodejs dependency

2024-05-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850965#comment-17850965 ] Piotr Nowojski edited comment on FLINK-30719 at 5/31/24 8:11 AM: -

[jira] [Commented] (FLINK-30719) flink-runtime-web failed due to a corrupted nodejs dependency

2024-05-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850965#comment-17850965 ] Piotr Nowojski commented on FLINK-30719: {noformat} 14:47:52.892 [ERROR] Failed to execute goal

[jira] [Closed] (FLINK-32142) Apple Silicon Support: Unable to Build Flink Project due to "Bad CPU Type" Error

2024-05-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-32142. -- Resolution: Fixed merged commit d075c9f into apache:master > Apple Silicon Support: Unable

[jira] (FLINK-28260) flink-runtime-web fails to execute "npm ci" on Apple Silicon (arm64) without rosetta

2024-05-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28260 ] Piotr Nowojski deleted comment on FLINK-28260: was (Author: pnowojski): merged commit d075c9f into apache:master > flink-runtime-web fails to execute "npm ci" on Apple Silicon (arm64)

[jira] [Commented] (FLINK-28260) flink-runtime-web fails to execute "npm ci" on Apple Silicon (arm64) without rosetta

2024-05-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850963#comment-17850963 ] Piotr Nowojski commented on FLINK-28260: merged commit d075c9f into apache:master >

[jira] [Closed] (FLINK-35351) Restore from unaligned checkpoints with a custom partitioner fails.

2024-05-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-35351. -- Fix Version/s: 1.18.2 1.20.0 1.19.1 Resolution:

[jira] [Updated] (FLINK-35420) WordCountMapredITCase fails to compile in IntelliJ

2024-05-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35420: --- Fix Version/s: 1.20.0 > WordCountMapredITCase fails to compile in IntelliJ >

[jira] [Assigned] (FLINK-35420) WordCountMapredITCase fails to compile in IntelliJ

2024-05-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-35420: -- Assignee: Piotr Nowojski > WordCountMapredITCase fails to compile in IntelliJ >

[jira] [Closed] (FLINK-35420) WordCountMapredITCase fails to compile in IntelliJ

2024-05-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-35420. -- Resolution: Fixed 9ccfb65 into apache:master now > WordCountMapredITCase fails to compile

[jira] [Created] (FLINK-35420) WordCountMapredITCase fails to compile in IntelliJ

2024-05-22 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35420: -- Summary: WordCountMapredITCase fails to compile in IntelliJ Key: FLINK-35420 URL: https://issues.apache.org/jira/browse/FLINK-35420 Project: Flink Issue

[jira] [Closed] (FLINK-32828) Partition aware watermark not handled correctly shortly after job start up from checkpoint or savepoint

2024-05-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-32828. -- Fix Version/s: 2.0.0 1.18.2 1.20.0

[jira] [Commented] (FLINK-35351) Restore from unaligned checkpoints with a custom partitioner fails.

2024-05-16 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846869#comment-17846869 ] Piotr Nowojski commented on FLINK-35351: Thanks, after reading the PR indeed I understand this

[jira] [Updated] (FLINK-32828) Partition aware watermark not handled correctly shortly after job start up from checkpoint or savepoint

2024-05-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-32828: --- Summary: Partition aware watermark not handled correctly shortly after job start up from

[jira] [Comment Edited] (FLINK-32828) Kafka partition aware watermark not handled correctly shortly after job start up from checkpoint or savepoint

2024-05-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846694#comment-17846694 ] Piotr Nowojski edited comment on FLINK-32828 at 5/15/24 4:27 PM: - We

[jira] [Commented] (FLINK-32828) Kafka partition aware watermark not handled correctly shortly after job start up from checkpoint or savepoint

2024-05-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846694#comment-17846694 ] Piotr Nowojski commented on FLINK-32828: We have just stumbled upon the same issue and I can

[jira] [Updated] (FLINK-32828) Kafka partition aware watermark not handled correctly shortly after job start up from checkpoint or savepoint

2024-05-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-32828: --- Priority: Critical (was: Major) > Kafka partition aware watermark not handled correctly

[jira] [Updated] (FLINK-32828) Kafka partition aware watermark not handled correctly shortly after job start up from checkpoint or savepoint

2024-05-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-32828: --- Affects Version/s: 1.18.1 1.19.0 > Kafka partition aware watermark

[jira] [Assigned] (FLINK-32828) Kafka partition aware watermark not handled correctly shortly after job start up from checkpoint or savepoint

2024-05-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-32828: -- Assignee: Piotr Nowojski > Kafka partition aware watermark not handled correctly

[jira] [Commented] (FLINK-33109) Watermark alignment not applied after recovery from checkpoint

2024-05-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846597#comment-17846597 ] Piotr Nowojski commented on FLINK-33109: Hi! {quote} I guess this bug has been fixed in 1.17.2

[jira] [Comment Edited] (FLINK-35351) Restore from unaligned checkpoints with a custom partitioner fails.

2024-05-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846231#comment-17846231 ] Piotr Nowojski edited comment on FLINK-35351 at 5/14/24 9:11 AM: - Hi

[jira] [Commented] (FLINK-35351) Restore from unaligned checkpoints with a custom partitioner fails.

2024-05-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846231#comment-17846231 ] Piotr Nowojski commented on FLINK-35351: Hi [~lda-dima], thanks for reporting this issue and

[jira] [Assigned] (FLINK-35351) Restore from unaligned checkpoints with a custom partitioner fails.

2024-05-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-35351: -- Assignee: Dmitriy Linevich > Restore from unaligned checkpoints with a custom

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

2024-04-24 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840327#comment-17840327 ] Piotr Nowojski commented on FLINK-33856: Hey [~hejufang001]! Sorry for the usual open source

[jira] [Updated] (FLINK-33856) Add sub-task spans to TraceReporter for checkpointing

2024-04-24 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-33856: --- Summary: Add sub-task spans to TraceReporter for checkpointing (was: Add metrics to

[jira] [Closed] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

2024-04-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-34913. -- Fix Version/s: 1.20.0 (was: 2.0.0) Resolution: Fixed >

[jira] [Assigned] (FLINK-20217) More fine-grained timer processing

2024-04-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-20217: -- Assignee: Piotr Nowojski > More fine-grained timer processing >

[jira] [Commented] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

2024-04-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836113#comment-17836113 ] Piotr Nowojski commented on FLINK-34704: Sounds good to me (y) Indeed we could later provide

[jira] [Comment Edited] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

2024-04-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836083#comment-17836083 ] Piotr Nowojski edited comment on FLINK-34704 at 4/11/24 9:57 AM: - Yes,

[jira] [Commented] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

2024-04-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836083#comment-17836083 ] Piotr Nowojski commented on FLINK-34704: {quote} the checkpoint still happen when some user code

[jira] [Commented] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

2024-04-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836037#comment-17836037 ] Piotr Nowojski commented on FLINK-34704: {code:java} So it is designed to be safe to checkpoint

[jira] [Comment Edited] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

2024-04-10 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835796#comment-17835796 ] Piotr Nowojski edited comment on FLINK-34704 at 4/10/24 3:46 PM: - Adding

[jira] [Commented] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

2024-04-10 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835796#comment-17835796 ] Piotr Nowojski commented on FLINK-34704: Adding new {{yield}} method wouldn't help, as we can

[jira] [Closed] (FLINK-35065) Add numFiredTimers and numFiredTimersPerSecond metrics

2024-04-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-35065. -- Resolution: Fixed Merged to master as 98bd2659f5b > Add numFiredTimers and

[jira] [Created] (FLINK-35065) Add numFiredTimers and numFiredTimersPerSecond metrics

2024-04-09 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35065: -- Summary: Add numFiredTimers and numFiredTimersPerSecond metrics Key: FLINK-35065 URL: https://issues.apache.org/jira/browse/FLINK-35065 Project: Flink

[jira] [Updated] (FLINK-35051) Weird priorities when processing unaligned checkpoints

2024-04-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35051: --- Affects Version/s: 1.16.3 > Weird priorities when processing unaligned checkpoints >

[jira] [Updated] (FLINK-35051) Weird priorities when processing unaligned checkpoints

2024-04-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35051: --- Description: While looking through the code I noticed that `StreamTask` is processing

[jira] [Updated] (FLINK-35051) Weird priorities when processing unaligned checkpoints

2024-04-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35051: --- Description: While looking through the code I noticed that `StreamTask` is processing

[jira] [Created] (FLINK-35051) Weird priorities when processing unaligned checkpoints

2024-04-08 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35051: -- Summary: Weird priorities when processing unaligned checkpoints Key: FLINK-35051 URL: https://issues.apache.org/jira/browse/FLINK-35051 Project: Flink

[jira] [Commented] (FLINK-32957) Add current timer trigger lag to metrics

2024-04-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833184#comment-17833184 ] Piotr Nowojski commented on FLINK-32957: {{mailboxLatencyMs}} shows basically the same thing

[jira] [Comment Edited] (FLINK-26515) RetryingExecutorTest. testDiscardOnTimeout failed on azure

2024-03-26 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830957#comment-17830957 ] Piotr Nowojski edited comment on FLINK-26515 at 3/26/24 2:31 PM: -

[jira] [Updated] (FLINK-26515) RetryingExecutorTest. testDiscardOnTimeout failed on azure

2024-03-26 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26515: --- Priority: Blocker (was: Critical) > RetryingExecutorTest. testDiscardOnTimeout failed on

[jira] [Commented] (FLINK-26515) RetryingExecutorTest. testDiscardOnTimeout failed on azure

2024-03-26 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830957#comment-17830957 ] Piotr Nowojski commented on FLINK-26515: occurance of the same issue in a private build >

[jira] [Updated] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

2024-03-25 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34913: --- Fix Version/s: 2.0.0 (was: 1.19.1) > ConcurrentModificationException

[jira] [Commented] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

2024-03-25 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830419#comment-17830419 ] Piotr Nowojski commented on FLINK-34913: merged commit 1a5ca7f into apache:master >

[jira] [Comment Edited] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

2024-03-25 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830419#comment-17830419 ] Piotr Nowojski edited comment on FLINK-34913 at 3/25/24 10:01 AM: --

[jira] [Updated] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

2024-03-22 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34913: --- Description: The following failures can occur during job's recovery when using clip &

[jira] [Assigned] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

2024-03-22 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-34913: -- Assignee: Piotr Nowojski > ConcurrentModificationException >

[jira] [Updated] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

2024-03-22 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34913: --- Description: The following failures can occur during job's recovery when using clip &

[jira] [Created] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

2024-03-22 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-34913: -- Summary: ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric Key: FLINK-34913 URL: https://issues.apache.org/jira/browse/FLINK-34913

[jira] [Updated] (FLINK-34696) GSRecoverableWriterCommitter is generating excessive data blobs

2024-03-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34696: --- Issue Type: Improvement (was: Bug) > GSRecoverableWriterCommitter is generating excessive

[jira] [Closed] (FLINK-33816) SourceStreamTaskTest.testTriggeringStopWithSavepointWithDrain failed due async checkpoint triggering not being completed

2024-03-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-33816. -- Fix Version/s: 2.0.0 Assignee: jiabao.sun Resolution: Fixed merged commit

[jira] [Comment Edited] (FLINK-33816) SourceStreamTaskTest.testTriggeringStopWithSavepointWithDrain failed due async checkpoint triggering not being completed

2024-03-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827503#comment-17827503 ] Piotr Nowojski edited comment on FLINK-33816 at 3/15/24 1:33 PM: - Thanks

[jira] [Commented] (FLINK-26990) BatchArrowPythonGroupWindowAggregateFunctionOperatorTest.testFinishBundleTriggeredByTime failed

2024-03-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826779#comment-17826779 ] Piotr Nowojski commented on FLINK-26990: I've just encountered the same issue in some internal

[jira] [Updated] (FLINK-26990) BatchArrowPythonGroupWindowAggregateFunctionOperatorTest.testFinishBundleTriggeredByTime failed

2024-03-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26990: --- Priority: Major (was: Minor) >

[jira] [Updated] (FLINK-26990) BatchArrowPythonGroupWindowAggregateFunctionOperatorTest.testFinishBundleTriggeredByTime failed

2024-03-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26990: --- Affects Version/s: 1.18.1 >

  1   2   3   4   5   6   7   8   9   10   >