[jira] [Assigned] (FLINK-25872) Restoring from non-changelog checkpoint with changelog state-backend enabled in CLAIM mode discards state in use

2022-04-12 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-25872: Assignee: Yanfei Lei > Restoring from non-changelog checkpoint with changelog state-backend enabl

[jira] [Resolved] (FLINK-26757) change the default value of state.backend.rocksdb.restore-overlap-fraction-threshold

2022-04-11 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26757. -- Resolution: Fixed merged in master: 4034d3cd6d13e88e2e5ca101510bf333e94a53fa > change the default val

[jira] [Updated] (FLINK-26757) change the default value of state.backend.rocksdb.restore-overlap-fraction-threshold

2022-04-11 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26757: - Fix Version/s: 1.16.0 > change the default value of > state.backend.rocksdb.restore-overlap-fraction-th

[jira] [Resolved] (FLINK-23399) Add a performance benchmark for statebackend rescaling

2022-04-11 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-23399. -- Resolution: Fixed Merged in flink-benchmarks repo: 57cc8064db4a9f934f77a5fa5038712cb01e5183 > Add a p

[jira] [Commented] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-11 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520387#comment-17520387 ] Yun Tang commented on FLINK-27101: -- I think the root cause to ask for this feature is b

[jira] [Resolved] (FLINK-26852) RocksDBMapState#clear not forwarding exceptions

2022-04-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26852. -- Fix Version/s: 1.16.0 Resolution: Fixed merged in master: 241e819d82bf84535b355e3822894d6b685db

[jira] [Assigned] (FLINK-16078) Translate "Tuning Checkpoints and Large State" page into Chinese

2022-04-05 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-16078: Assignee: Zhuang Liu > Translate "Tuning Checkpoints and Large State" page into Chinese > --

[jira] [Commented] (FLINK-16078) Translate "Tuning Checkpoints and Large State" page into Chinese

2022-04-05 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517865#comment-17517865 ] Yun Tang commented on FLINK-16078: -- [~liu zhuang], already assigned this ticket to you,

[jira] [Resolved] (FLINK-14998) Remove FileUtils#deletePathIfEmpty

2022-04-03 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-14998. -- Resolution: Fixed merged in master: 5f21d15a0937c1ab438a863b59aa9ac113efeeca > Remove FileUtils#delet

[jira] [Resolved] (FLINK-26998) Remove log-related configuration from predefined options in RocksDB state backend

2022-04-03 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26998. -- Resolution: Fixed merged in master: 428bb6584ff867e5b121185fac604f71ad0afbdd release-1.15: 8f502b808ee

[jira] [Resolved] (FLINK-26738) Default value of StateDescriptor is valid when enable state ttl config

2022-04-02 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26738. -- Fix Version/s: 1.15.0 1.16.0 1.14.5 Resolution: Fixed mer

[jira] [Commented] (FLINK-26515) RetryingExecutorTest.testTimeout failed on azure

2022-04-01 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17516237#comment-17516237 ] Yun Tang commented on FLINK-26515: -- Another instance https://dev.azure.com/fredia/flin

[jira] [Assigned] (FLINK-26998) Remove log-related configuration from predefined options in RocksDB state backend

2022-04-01 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-26998: Assignee: Zakelly Lan > Remove log-related configuration from predefined options in RocksDB state

[jira] [Updated] (FLINK-26998) Remove log-related configuration from predefined options in RocksDB state backend

2022-04-01 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26998: - Fix Version/s: 1.16.0 > Remove log-related configuration from predefined options in RocksDB state > bac

[jira] [Commented] (FLINK-23399) Add a performance benchmark for statebackend rescaling

2022-04-01 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17515858#comment-17515858 ] Yun Tang commented on FLINK-23399: -- The benchmark code in flink repo merged in master:

[jira] [Updated] (FLINK-26985) With legacy restore mode, incremantal checkpoints would be deleted by mistake

2022-04-01 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26985: - Description: Before flink-1.15, the restored checkpoint would be regsiterd and not discard on subsume,

[jira] [Commented] (FLINK-26985) With legacy restore mode, incremantal checkpoints would be deleted by mistake

2022-04-01 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17515852#comment-17515852 ] Yun Tang commented on FLINK-26985: -- I think this error is caused by the refactoring int

[jira] [Created] (FLINK-26985) With legacy restore mode, incremantal checkpoints would be deleted by mistake

2022-04-01 Thread Yun Tang (Jira)
Yun Tang created FLINK-26985: Summary: With legacy restore mode, incremantal checkpoints would be deleted by mistake Key: FLINK-26985 URL: https://issues.apache.org/jira/browse/FLINK-26985 Project: Flink

[jira] [Commented] (FLINK-14998) Remove FileUtils#deletePathIfEmpty

2022-03-31 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17515679#comment-17515679 ] Yun Tang commented on FLINK-14998: -- [~jay li], you can refer to https://flink.apache.o

[jira] [Updated] (FLINK-26575) Improve the info message when restoring keyed state backend

2022-03-30 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26575: - Fix Version/s: 1.15.0 1.16.0 1.14.5 > Improve the info message whe

[jira] [Updated] (FLINK-14998) Remove FileUtils#deletePathIfEmpty

2022-03-30 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-14998: - Fix Version/s: 1.16.0 (was: 1.15.0) > Remove FileUtils#deletePathIfEmpty > --

[jira] [Assigned] (FLINK-14998) Remove FileUtils#deletePathIfEmpty

2022-03-30 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-14998: Assignee: jay li > Remove FileUtils#deletePathIfEmpty > -- > >

[jira] [Commented] (FLINK-14998) Remove FileUtils#deletePathIfEmpty

2022-03-30 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17515043#comment-17515043 ] Yun Tang commented on FLINK-14998: -- [~jay li] sure, I will assign this ticket to you.

[jira] [Commented] (FLINK-26882) Unaligned checkpoint with 0s timeout would fail RescaleCheckpointManuallyITCase

2022-03-30 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17515042#comment-17515042 ] Yun Tang commented on FLINK-26882: -- [~nsemmler], the broken instance https://dev.azure

[jira] [Closed] (FLINK-26575) Improve the info message when restoring keyed state backend

2022-03-30 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-26575. Resolution: Fixed merged in master: d8f6279c14236de832566b1ff97053e79e1e1414 release-1.15: df3ab6c72f991e9

[jira] [Resolved] (FLINK-26882) Unaligned checkpoint with 0s timeout would fail RescaleCheckpointManuallyITCase

2022-03-30 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26882. -- Resolution: Fixed > Unaligned checkpoint with 0s timeout would fail > RescaleCheckpointManuallyITCase

[jira] [Commented] (FLINK-26882) Unaligned checkpoint with 0s timeout would fail RescaleCheckpointManuallyITCase

2022-03-30 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17514563#comment-17514563 ] Yun Tang commented on FLINK-26882: -- Merged in master: 317ba3318a8398087defb1e335e3a89f9

[jira] [Updated] (FLINK-26882) Unaligned checkpoint with 0s timeout would fail RescaleCheckpointManuallyITCase

2022-03-30 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26882: - Description: Once we make {{execution.checkpointing.unaligned: true}} and {{execution.checkpointing.ali

[jira] [Commented] (FLINK-26882) Unaligned checkpoint with 0s timeout would fail RescaleCheckpointManuallyITCase

2022-03-30 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17514562#comment-17514562 ] Yun Tang commented on FLINK-26882: -- Since my local CI https://dev.azure.com/myasuka/fl

[jira] [Commented] (FLINK-26882) Unaligned checkpoint with 0s timeout would fail RescaleCheckpointManuallyITCase

2022-03-29 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17514452#comment-17514452 ] Yun Tang commented on FLINK-26882: -- First of all, thanks very much for [~akalashnikov]'

[jira] [Commented] (FLINK-26789) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState failed

2022-03-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513274#comment-17513274 ] Yun Tang commented on FLINK-26789: -- [~roman] Yes, it's my fault to re-paste this link a

[jira] [Updated] (FLINK-26882) Unaligned checkpoint with 0s timeout would fail RescaleCheckpointManuallyITCase

2022-03-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26882: - Priority: Critical (was: Major) > Unaligned checkpoint with 0s timeout would fail > RescaleCheckpointM

[jira] [Closed] (FLINK-26789) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState failed

2022-03-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-26789. Resolution: Fixed > RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState failed > -

[jira] [Commented] (FLINK-26789) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState failed

2022-03-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513249#comment-17513249 ] Yun Tang commented on FLINK-26789: -- I have created another ticket https://issues.apache

[jira] [Created] (FLINK-26882) Unaligned checkpoint with 0s timeout would fail RescaleCheckpointManuallyITCase

2022-03-28 Thread Yun Tang (Jira)
Yun Tang created FLINK-26882: Summary: Unaligned checkpoint with 0s timeout would fail RescaleCheckpointManuallyITCase Key: FLINK-26882 URL: https://issues.apache.org/jira/browse/FLINK-26882 Project: Flin

[jira] [Assigned] (FLINK-26852) RocksDBMapState#clear not forwarding exceptions

2022-03-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-26852: Assignee: Hangxiang Yu > RocksDBMapState#clear not forwarding exceptions > --

[jira] [Commented] (FLINK-26852) RocksDBMapState#clear not forwarding exceptions

2022-03-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513195#comment-17513195 ] Yun Tang commented on FLINK-26852: -- I think this is a really bug, asked [~masteryhx] to

[jira] [Commented] (FLINK-26800) write small data file using share write buffer manager

2022-03-27 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513176#comment-17513176 ] Yun Tang commented on FLINK-26800: -- [~liuyufei], RocksDBJava does not publish too many

[jira] [Commented] (FLINK-26789) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState failed

2022-03-27 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513120#comment-17513120 ] Yun Tang commented on FLINK-26789: -- [~roman], I checked the logs in https://dev.azure.

[jira] [Resolved] (FLINK-26789) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState failed

2022-03-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26789. -- Resolution: Fixed merged in master: c1bd957be3fe45df80602eab78f2980361df22cf > RescaleCheckpointManua

[jira] [Resolved] (FLINK-26700) Update chinese documentation regarding restore modes

2022-03-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26700. -- Resolution: Fixed merged in master: f7ef0412d414ce7df8cff70edbae961ff6eae3f4, 8c34d2503a2606e119c6ac2

[jira] [Updated] (FLINK-26700) Update chinese documentation regarding restore modes

2022-03-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26700: - Fix Version/s: 1.15.0 1.16.0 > Update chinese documentation regarding restore modes >

[jira] [Commented] (FLINK-26738) Default value of StateDescriptor is valid when enable state ttl config

2022-03-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511743#comment-17511743 ] Yun Tang commented on FLINK-26738: -- [~lam167], already assigned to you and downgrade th

[jira] [Updated] (FLINK-26738) Default value of StateDescriptor is valid when enable state ttl config

2022-03-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26738: - Priority: Major (was: Critical) > Default value of StateDescriptor is valid when enable state ttl confi

[jira] [Assigned] (FLINK-26738) Default value of StateDescriptor is valid when enable state ttl config

2022-03-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-26738: Assignee: Jianhui Dong > Default value of StateDescriptor is valid when enable state ttl config >

[jira] [Commented] (FLINK-26738) Default value of StateDescriptor is valid when enable state ttl config

2022-03-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511691#comment-17511691 ] Yun Tang commented on FLINK-26738: -- [~lam167] I agree, would you like to take this tick

[jira] [Commented] (FLINK-26738) Default value of StateDescriptor is valid when enable state ttl config

2022-03-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511603#comment-17511603 ] Yun Tang commented on FLINK-26738: -- [~lam167], the reason why Flink community mark the

[jira] [Commented] (FLINK-26789) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState failed

2022-03-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511161#comment-17511161 ] Yun Tang commented on FLINK-26789: -- I tried to reproduce this problem with changelog, u

[jira] [Updated] (FLINK-26789) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState failed

2022-03-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26789: - Fix Version/s: 1.16.0 (was: 1.15.0) > RescaleCheckpointManuallyITCase.testCheckpo

[jira] [Updated] (FLINK-26789) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState failed

2022-03-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26789: - Affects Version/s: 1.16.0 (was: 1.15.0) > RescaleCheckpointManuallyITCase.tes

[jira] [Assigned] (FLINK-26789) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState failed

2022-03-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-26789: Assignee: Yanfei Lei > RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState failed

[jira] [Commented] (FLINK-26789) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState failed

2022-03-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511106#comment-17511106 ] Yun Tang commented on FLINK-26789: -- [~mapohl] Thanks for your reminder, I will take a l

[jira] [Commented] (FLINK-26738) Default value of StateDescriptor is valid when enable state ttl config

2022-03-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511101#comment-17511101 ] Yun Tang commented on FLINK-26738: -- [~lam167], first of all, the returned {{sum}} is a

[jira] [Updated] (FLINK-24785) Relocate RocksDB's log under flink log directory by default

2022-03-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-24785: - Release Note: The internal log of RocksDB would stay under flink's log directory by default. > Relocate

[jira] [Assigned] (FLINK-26673) ChangelogPeriodicMaterializationITCase.testNonMaterialization failed on master with IllegalStateException

2022-03-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-26673: Assignee: Hangxiang Yu > ChangelogPeriodicMaterializationITCase.testNonMaterialization failed on

[jira] [Resolved] (FLINK-5151) Add discussion about object mutations to heap-based state backend docs.

2022-03-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-5151. - Fix Version/s: 1.16.0 1.14.5 Resolution: Fixed merged in master: 4175fefd557d30

[jira] [Commented] (FLINK-26757) change the default value of state.backend.rocksdb.restore-overlap-fraction-threshold

2022-03-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17509619#comment-17509619 ] Yun Tang commented on FLINK-26757: -- [~Yanfei Lei] thanks for creating this ticket, alre

[jira] [Assigned] (FLINK-26757) change the default value of state.backend.rocksdb.restore-overlap-fraction-threshold

2022-03-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-26757: Assignee: Yanfei Lei > change the default value of > state.backend.rocksdb.restore-overlap-fract

[jira] [Commented] (FLINK-26700) Update chinese documentation regarding restore modes

2022-03-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17509586#comment-17509586 ] Yun Tang commented on FLINK-26700: -- [~Feifan Wang], I could help you to do this. > Upd

[jira] [Commented] (FLINK-26738) Default value of StateDescriptor is valid when enable state ttl config

2022-03-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17509584#comment-17509584 ] Yun Tang commented on FLINK-26738: -- [~lam167], what kind of NPE will you meet? Once th

[jira] [Resolved] (FLINK-21321) Change RocksDB incremental checkpoint re-scaling to use deleteRange

2022-03-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-21321. -- Resolution: Fixed merged in master: b6822f293e24263752419e49f8b7910f4e0464a8 and 1bf45b25791cc3fad8b7

[jira] [Resolved] (FLINK-26560) Make the threshold of the overlap fraction of incremental restoring configurable

2022-03-18 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26560. -- Resolution: Fixed Merged in master: 38fe9c0b34ebec376aa4c13d88859dc021346b04 > Make the threshold of

[jira] [Commented] (FLINK-26698) FileSystemJobResultStore#constructDirtyPath might lost the scheme

2022-03-17 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508041#comment-17508041 ] Yun Tang commented on FLINK-26698: -- +1, for path like "dfs://schema/path/to", #getPath(

[jira] [Updated] (FLINK-24783) Improve monitoring experience and usability of state backend

2022-03-16 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-24783: - Fix Version/s: 1.16.0 > Improve monitoring experience and usability of state backend >

[jira] [Commented] (FLINK-26650) Avoid to print stack trace for checkpoint trigger failure if not all tasks are started

2022-03-15 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507326#comment-17507326 ] Yun Tang commented on FLINK-26650: -- merged in release-1.14: b2ff6543e6c2a6b6c6710281915

[jira] [Updated] (FLINK-26650) Avoid to print stack trace for checkpoint trigger failure if not all tasks are started

2022-03-15 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26650: - Fix Version/s: 1.14.5 > Avoid to print stack trace for checkpoint trigger failure if not all tasks > ar

[jira] [Resolved] (FLINK-26650) Avoid to print stack trace for checkpoint trigger failure if not all tasks are started

2022-03-15 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26650. -- Resolution: Fixed merged in master: 27108785b67f6d028428d00ebd2279d622acbc83 release-1.15: 0562fc3df74

[jira] [Comment Edited] (FLINK-26650) Avoid to print stack trace for checkpoint trigger failure if not all tasks are started

2022-03-15 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506806#comment-17506806 ] Yun Tang edited comment on FLINK-26650 at 3/15/22, 12:28 PM: -

[jira] [Comment Edited] (FLINK-26650) Avoid to print stack trace for checkpoint trigger failure if not all tasks are started

2022-03-15 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506806#comment-17506806 ] Yun Tang edited comment on FLINK-26650 at 3/15/22, 12:23 PM: -

[jira] [Updated] (FLINK-26650) Avoid to print stack trace for checkpoint trigger failure if not all tasks are started

2022-03-15 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26650: - Fix Version/s: 1.16.0 > Avoid to print stack trace for checkpoint trigger failure if not all tasks > ar

[jira] [Commented] (FLINK-26650) Avoid to print stack trace for checkpoint trigger failure if not all tasks are started

2022-03-15 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506806#comment-17506806 ] Yun Tang commented on FLINK-26650: -- cc [~pnowojski] > Avoid to print stack trace for c

[jira] [Created] (FLINK-26650) Avoid to print stack trace for checkpoint trigger failure if not all tasks are started

2022-03-15 Thread Yun Tang (Jira)
Yun Tang created FLINK-26650: Summary: Avoid to print stack trace for checkpoint trigger failure if not all tasks are started Key: FLINK-26650 URL: https://issues.apache.org/jira/browse/FLINK-26650 Projec

[jira] [Updated] (FLINK-25528) support state processor api to create native savepoint

2022-03-15 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-25528: - Summary: support state processor api to create native savepoint (was: support state processor api to cr

[jira] [Resolved] (FLINK-25528) support state processor api to create checkpoint

2022-03-15 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-25528. -- Resolution: Fixed Merged in master: a0d31c5e0914d8e759917a72ca7b667d3db2f1d2 > support state processo

[jira] [Resolved] (FLINK-26550) Correct the information of checkpoint failure

2022-03-10 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26550. -- Resolution: Fixed resolved in master: 254c918b3e681f3e7014b558413f5c8db9c8e67f in release-1.14: 00fed2

[jira] [Created] (FLINK-26575) Improve the info message when restoring keyed state backend

2022-03-10 Thread Yun Tang (Jira)
Yun Tang created FLINK-26575: Summary: Improve the info message when restoring keyed state backend Key: FLINK-26575 URL: https://issues.apache.org/jira/browse/FLINK-26575 Project: Flink Issue Ty

[jira] [Updated] (FLINK-26560) Make the threshold of the overlap fraction of incremental restoring configurable

2022-03-09 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26560: - Fix Version/s: 1.16.0 > Make the threshold of the overlap fraction of incremental restoring > configura

[jira] [Updated] (FLINK-26560) Make the threshold of the overlap fraction of incremental restoring configurable

2022-03-09 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26560: - Priority: Major (was: Minor) > Make the threshold of the overlap fraction of incremental restoring > c

[jira] [Commented] (FLINK-26560) Make the threshold of the overlap fraction of incremental restoring configurable

2022-03-09 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503971#comment-17503971 ] Yun Tang commented on FLINK-26560: -- Upgrade the priority to "Major". Once FLINK-23399

[jira] [Assigned] (FLINK-26560) Make the threshold of the overlap fraction of incremental restoring configurable

2022-03-09 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-26560: Assignee: Yanfei Lei > Make the threshold of the overlap fraction of incremental restoring > con

[jira] [Commented] (FLINK-26394) CheckpointCoordinator.isTriggering can not be reset if a checkpoint expires while the checkpointCoordinator task is queuing in the SourceCoordinator executor.

2022-03-09 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503579#comment-17503579 ] Yun Tang commented on FLINK-26394: -- Though the PR still has broken tests, I think this

[jira] [Created] (FLINK-26550) Correct the information of checkpoint failure

2022-03-09 Thread Yun Tang (Jira)
Yun Tang created FLINK-26550: Summary: Correct the information of checkpoint failure Key: FLINK-26550 URL: https://issues.apache.org/jira/browse/FLINK-26550 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-23399) Add a performance benchmark for statebackend rescaling

2022-03-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-23399: - Fix Version/s: 1.16.0 > Add a performance benchmark for statebackend rescaling > ---

[jira] [Commented] (FLINK-26490) Adjust the MaxParallelism or remove the MaxParallelism check when unnecessary.

2022-03-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503328#comment-17503328 ] Yun Tang commented on FLINK-26490: -- [~liufangqi] Since the check is so fundamental for

[jira] [Commented] (FLINK-26490) Adjust the MaxParallelism or remove the MaxParallelism check when unnecessary.

2022-03-07 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17502156#comment-17502156 ] Yun Tang commented on FLINK-26490: -- I am still thinking of whther there are places left

[jira] [Commented] (FLINK-26490) Adjust the MaxParallelism or remove the MaxParallelism check when unnecessary.

2022-03-06 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17502069#comment-17502069 ] Yun Tang commented on FLINK-26490: -- I think it might be possible, how will you modify i

[jira] [Resolved] (FLINK-26464) Introduce new metrics to represent full checkpoint size

2022-03-06 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26464. -- Resolution: Fixed Merged in master: b2f4c0ea259027ed3f6a04595202cf2589e2495a > Introduce new metrics

[jira] [Commented] (FLINK-26406) Significant differences of Fault Tolerance between English and Chinese version

2022-03-05 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501764#comment-17501764 ] Yun Tang commented on FLINK-26406: -- I see, these parts belong to the learn-flink module

[jira] [Assigned] (FLINK-26406) Significant differences of Fault Tolerance between English and Chinese version

2022-03-05 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-26406: Assignee: tonny > Significant differences of Fault Tolerance between English and Chinese version

[jira] [Created] (FLINK-26464) Introduce new metrics to represent full checkpoint size

2022-03-03 Thread Yun Tang (Jira)
Yun Tang created FLINK-26464: Summary: Introduce new metrics to represent full checkpoint size Key: FLINK-26464 URL: https://issues.apache.org/jira/browse/FLINK-26464 Project: Flink Issue Type: B

[jira] [Commented] (FLINK-26179) Support periodic savepointing in the operator

2022-03-02 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500532#comment-17500532 ] Yun Tang commented on FLINK-26179: -- I don't think Flink community should support automa

[jira] [Commented] (FLINK-26406) Significant differences of Fault Tolerance between English and Chinese version

2022-02-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17499361#comment-17499361 ] Yun Tang commented on FLINK-26406: -- The deprecated state backends do not mean they cann

[jira] [Updated] (FLINK-26406) Significant differences of Fault Tolerance between English and Chinese version

2022-02-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26406: - Priority: Major (was: Blocker) > Significant differences of Fault Tolerance between English and Chinese

[jira] [Commented] (FLINK-26394) CheckpointCoordinator.isTriggering can not be reset if a checkpoint expires while the checkpointCoordinator task is queuing in the SourceCoordinator executor.

2022-02-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17499358#comment-17499358 ] Yun Tang commented on FLINK-26394: -- [~pltbkd], do you have any test case to reproduce t

[jira] [Updated] (FLINK-25528) support state processor api to create checkpoint

2022-02-27 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-25528: - Summary: support state processor api to create checkpoint (was: state processor api do not support incr

[jira] [Commented] (FLINK-26354) "-restoreMode" should be "--restoreMode" and should have a shorthand

2022-02-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17497878#comment-17497878 ] Yun Tang commented on FLINK-26354: -- Since the latest version of commons-cli is 1.5.0, w

[jira] [Created] (FLINK-26338) Add documentation of savepoint type on Command-Line part

2022-02-23 Thread Yun Tang (Jira)
Yun Tang created FLINK-26338: Summary: Add documentation of savepoint type on Command-Line part Key: FLINK-26338 URL: https://issues.apache.org/jira/browse/FLINK-26338 Project: Flink Issue Type:

[jira] [Commented] (FLINK-26306) Triggered checkpoints can be delayed by discarding shared state

2022-02-22 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17496504#comment-17496504 ] Yun Tang commented on FLINK-26306: -- [~roman] After materialization, I think the new che

[jira] [Commented] (FLINK-25528) state processor api do not support increment checkpoint

2022-02-21 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17495465#comment-17495465 ] Yun Tang commented on FLINK-25528: -- [~liufangqi] I have already assigned this ticket to

[jira] [Assigned] (FLINK-25528) state processor api do not support increment checkpoint

2022-02-21 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-25528: Assignee: 刘方奇 > state processor api do not support increment checkpoint > ---

<    1   2   3   4   5   6   7   8   9   10   >