[jira] [Comment Edited] (FLINK-25672) FileSource enumerator remembers paths of all already processed files which can result in large state

[ https://issues.apache.org/jira/browse/FLINK-25672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17679874#comment-17679874 ] Cliff Resnick edited comment on FLINK-25672 at 1/23/23 4:13 PM: --

[jira] [Commented] (FLINK-25672) FileSource enumerator remembers paths of all already processed files which can result in large state

[ https://issues.apache.org/jira/browse/FLINK-25672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17679874#comment-17679874 ] Cliff Resnick commented on FLINK-25672: --- I imagine it may require a breaking chang

[jira] [Commented] (FLINK-25672) FileSource enumerator remembers paths of all already processed files which can result in large state

[ https://issues.apache.org/jira/browse/FLINK-25672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17679868#comment-17679868 ] Cliff Resnick commented on FLINK-25672: --- This issue has turned into a real problem

[jira] [Comment Edited] (FLINK-11947) Support MapState value schema evolution for RocksDB

[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856993#comment-16856993 ] Cliff Resnick edited comment on FLINK-11947 at 6/5/19 7:49 PM: ---

[jira] [Commented] (FLINK-11947) Support MapState value schema evolution for RocksDB

[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856993#comment-16856993 ] Cliff Resnick commented on FLINK-11947: --- [~klion26] confirmed working! Sorry it to

[jira] [Commented] (FLINK-11947) Support MapState value schema evolution for RocksDB

[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854459#comment-16854459 ] Cliff Resnick commented on FLINK-11947: --- I was not able to get to it on Friday, bu

[jira] [Commented] (FLINK-11947) Support MapState value schema evolution for RocksDB

[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851810#comment-16851810 ] Cliff Resnick commented on FLINK-11947: --- [~klion26] great! I'll try it today. > S

[jira] [Commented] (FLINK-11947) Support MapState value schema evolution for RocksDB

[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850743#comment-16850743 ] Cliff Resnick commented on FLINK-11947: --- Thanks [~klion26]. I look forward to test

[jira] [Commented] (FLINK-11947) Support MapState key / value schema evolution for RocksDB

[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847669#comment-16847669 ] Cliff Resnick commented on FLINK-11947: --- Does the deescalation from Blocker mean t

[jira] [Comment Edited] (FLINK-12334) change to MockStreamTask breaks OneInputStreamOperatorTestHarness

[ https://issues.apache.org/jira/browse/FLINK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831932#comment-16831932 ] Cliff Resnick edited comment on FLINK-12334 at 5/2/19 8:28 PM: ---

[jira] [Comment Edited] (FLINK-12334) change to MockStreamTask breaks OneInputStreamOperatorTestHarness

[ https://issues.apache.org/jira/browse/FLINK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831932#comment-16831932 ] Cliff Resnick edited comment on FLINK-12334 at 5/2/19 8:27 PM: ---

[jira] [Comment Edited] (FLINK-12334) change to MockStreamTask breaks OneInputStreamOperatorTestHarness

[ https://issues.apache.org/jira/browse/FLINK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831932#comment-16831932 ] Cliff Resnick edited comment on FLINK-12334 at 5/2/19 8:27 PM: ---

[jira] [Comment Edited] (FLINK-12334) change to MockStreamTask breaks OneInputStreamOperatorTestHarness

[ https://issues.apache.org/jira/browse/FLINK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831932#comment-16831932 ] Cliff Resnick edited comment on FLINK-12334 at 5/2/19 8:26 PM: ---

[jira] [Commented] (FLINK-12334) change to MockStreamTask breaks OneInputStreamOperatorTestHarness

[ https://issues.apache.org/jira/browse/FLINK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831932#comment-16831932 ] Cliff Resnick commented on FLINK-12334: --- Hi [~fan_li_ya] We have a custom StreamO

[jira] [Created] (FLINK-12334) change to MockStreamTask breaks OneInputStreamOperatorTestHarness

Cliff Resnick created FLINK-12334: - Summary: change to MockStreamTask breaks OneInputStreamOperatorTestHarness Key: FLINK-12334 URL: https://issues.apache.org/jira/browse/FLINK-12334 Project: Flink

[jira] [Commented] (FLINK-11947) Support MapState key / value schema evolution for RocksDB

[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795072#comment-16795072 ] Cliff Resnick commented on FLINK-11947: --- Thanks for the explanation, that makes se

[jira] [Commented] (FLINK-10671) rest monitoring api Savepoint status call fails if akka.ask.timeout < checkpoint duration

[ https://issues.apache.org/jira/browse/FLINK-10671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675184#comment-16675184 ] Cliff Resnick commented on FLINK-10671: --- [~gjy] yes, I think when I created the is

[jira] [Created] (FLINK-10671) rest monitoring api Savepoint status call fails if akka.ask.timeout < checkpoint duration

Cliff Resnick created FLINK-10671: - Summary: rest monitoring api Savepoint status call fails if akka.ask.timeout < checkpoint duration Key: FLINK-10671 URL: https://issues.apache.org/jira/browse/FLINK-10671

[jira] [Created] (FLINK-9339) Accumulators are not UI accessible running in FLIP-6 mode

Cliff Resnick created FLINK-9339: Summary: Accumulators are not UI accessible running in FLIP-6 mode Key: FLINK-9339 URL: https://issues.apache.org/jira/browse/FLINK-9339 Project: Flink Issue

[jira] [Updated] (FLINK-8616) Missing null check in OperatorChain.CopyingChainingOutput#pushToOperator masks ClassCastException

[ https://issues.apache.org/jira/browse/FLINK-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cliff Resnick updated FLINK-8616: - Summary: Missing null check in OperatorChain.CopyingChainingOutput#pushToOperator masks ClassCastE

[jira] [Updated] (FLINK-8616) Missing null check in OperatorChain.copyingChainOutput#pushToOperator masks ClassCastException

[ https://issues.apache.org/jira/browse/FLINK-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cliff Resnick updated FLINK-8616: - Summary: Missing null check in OperatorChain.copyingChainOutput#pushToOperator masks ClassCastExce

[jira] [Created] (FLINK-8616) Missing null check in OperatorChain#pushToOperator masks ClassCastException

Cliff Resnick created FLINK-8616: Summary: Missing null check in OperatorChain#pushToOperator masks ClassCastException Key: FLINK-8616 URL: https://issues.apache.org/jira/browse/FLINK-8616 Project: Fl

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064079#comment-16064079 ] Cliff Resnick commented on FLINK-6964: -- [~srichter] Looks good from this end, all tes

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063768#comment-16063768 ] Cliff Resnick commented on FLINK-6964: -- [~srichter] So far, looks good! I need to lea

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061270#comment-16061270 ] Cliff Resnick commented on FLINK-6964: -- looks likes it's still trying to register a P

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061257#comment-16061257 ] Cliff Resnick commented on FLINK-6964: -- I ran with your newer precondition. It actual

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061216#comment-16061216 ] Cliff Resnick commented on FLINK-6964: -- ok, will try that. meanwhile here is a run (a

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061178#comment-16061178 ] Cliff Resnick commented on FLINK-6964: -- ok I'll wait on your push > Fix recovery for

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061163#comment-16061163 ] Cliff Resnick commented on FLINK-6964: -- Ha! I just started running. ok, will merge an

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061092#comment-16061092 ] Cliff Resnick commented on FLINK-6964: -- I'll merge and rerun. This is what I have for

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061088#comment-16061088 ] Cliff Resnick commented on FLINK-6964: -- [~srichter] By hanging I mean that the checkp

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060027#comment-16060027 ] Cliff Resnick commented on FLINK-6964: -- [~srichter] I tried your fix. After resuming

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058158#comment-16058158 ] Cliff Resnick commented on FLINK-6633: -- Thanks [~srichter], I'll give this a try tomo

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056537#comment-16056537 ] Cliff Resnick commented on FLINK-6633: -- Stefan, if you need me to unpack things furth

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056527#comment-16056527 ] Cliff Resnick commented on FLINK-6633: -- Ok, new gist is here: https://gist.github.com

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056342#comment-16056342 ] Cliff Resnick commented on FLINK-6633: -- full log here: https://gist.github.com/cresny

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056334#comment-16056334 ] Cliff Resnick commented on FLINK-6633: -- {noformat} 2017-06-20 18:44:39.376 [ip-10-15

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056332#comment-16056332 ] Cliff Resnick commented on FLINK-6633: -- The issue that [~gyfora] mentioned still exis

[jira] [Created] (FLINK-5646) REST api documentation missing details on jar upload

Cliff Resnick created FLINK-5646: Summary: REST api documentation missing details on jar upload Key: FLINK-5646 URL: https://issues.apache.org/jira/browse/FLINK-5646 Project: Flink Issue Type

[jira] [Commented] (FLINK-4228) RocksDB semi-async snapshot to S3AFileSystem fails

[ https://issues.apache.org/jira/browse/FLINK-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773084#comment-15773084 ] Cliff Resnick commented on FLINK-4228: -- My last pull request is good to go so I guess

[jira] [Commented] (FLINK-4228) RocksDB semi-async snapshot to S3AFileSystem fails

[ https://issues.apache.org/jira/browse/FLINK-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15772906#comment-15772906 ] Cliff Resnick commented on FLINK-4228: -- The issue now is exclusive to running on YARN

[jira] [Created] (FLINK-5083) Race condition in Rolling/Bucketing Sink pending files cleanup

Cliff Resnick created FLINK-5083: Summary: Race condition in Rolling/Bucketing Sink pending files cleanup Key: FLINK-5083 URL: https://issues.apache.org/jira/browse/FLINK-5083 Project: Flink

[jira] [Commented] (FLINK-4228) RocksDB semi-async snapshot to S3AFileSystem fails

[ https://issues.apache.org/jira/browse/FLINK-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390493#comment-15390493 ] Cliff Resnick commented on FLINK-4228: -- I added a pull request for this. I included t