[jira] [Comment Edited] (FLINK-25672) FileSource enumerator remembers paths of all already processed files which can result in large state

2023-01-23 Thread Cliff Resnick (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679874#comment-17679874 ] Cliff Resnick edited comment on FLINK-25672 at 1/23/23 4:13 PM: I

[jira] [Commented] (FLINK-25672) FileSource enumerator remembers paths of all already processed files which can result in large state

2023-01-23 Thread Cliff Resnick (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679874#comment-17679874 ] Cliff Resnick commented on FLINK-25672: --- I imagine it may require a breaking change from what I

[jira] [Commented] (FLINK-25672) FileSource enumerator remembers paths of all already processed files which can result in large state

2023-01-23 Thread Cliff Resnick (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679868#comment-17679868 ] Cliff Resnick commented on FLINK-25672: --- This issue has turned into a real problem for us with our

[jira] [Comment Edited] (FLINK-11947) Support MapState value schema evolution for RocksDB

2019-06-05 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856993#comment-16856993 ] Cliff Resnick edited comment on FLINK-11947 at 6/5/19 7:49 PM: --- [~klion26]

[jira] [Commented] (FLINK-11947) Support MapState value schema evolution for RocksDB

2019-06-05 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856993#comment-16856993 ] Cliff Resnick commented on FLINK-11947: --- [~klion26] confirmed working! Sorry it took me so lone,

[jira] [Commented] (FLINK-11947) Support MapState value schema evolution for RocksDB

2019-06-03 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854459#comment-16854459 ] Cliff Resnick commented on FLINK-11947: --- I was not able to get to it on Friday, but will give it

[jira] [Commented] (FLINK-11947) Support MapState value schema evolution for RocksDB

2019-05-30 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851810#comment-16851810 ] Cliff Resnick commented on FLINK-11947: --- [~klion26] great! I'll try it today. > Support MapState

[jira] [Commented] (FLINK-11947) Support MapState value schema evolution for RocksDB

2019-05-29 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16850743#comment-16850743 ] Cliff Resnick commented on FLINK-11947: --- Thanks [~klion26]. I look forward to testing your fix! 

[jira] [Commented] (FLINK-11947) Support MapState key / value schema evolution for RocksDB

2019-05-24 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847669#comment-16847669 ] Cliff Resnick commented on FLINK-11947: --- Does the deescalation from Blocker mean that this will

[jira] [Comment Edited] (FLINK-12334) change to MockStreamTask breaks OneInputStreamOperatorTestHarness

2019-05-02 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831932#comment-16831932 ] Cliff Resnick edited comment on FLINK-12334 at 5/2/19 8:28 PM: --- Hi

[jira] [Comment Edited] (FLINK-12334) change to MockStreamTask breaks OneInputStreamOperatorTestHarness

2019-05-02 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831932#comment-16831932 ] Cliff Resnick edited comment on FLINK-12334 at 5/2/19 8:27 PM: --- Hi

[jira] [Comment Edited] (FLINK-12334) change to MockStreamTask breaks OneInputStreamOperatorTestHarness

2019-05-02 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831932#comment-16831932 ] Cliff Resnick edited comment on FLINK-12334 at 5/2/19 8:27 PM: --- Hi

[jira] [Comment Edited] (FLINK-12334) change to MockStreamTask breaks OneInputStreamOperatorTestHarness

2019-05-02 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831932#comment-16831932 ] Cliff Resnick edited comment on FLINK-12334 at 5/2/19 8:26 PM: --- Hi

[jira] [Commented] (FLINK-12334) change to MockStreamTask breaks OneInputStreamOperatorTestHarness

2019-05-02 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831932#comment-16831932 ] Cliff Resnick commented on FLINK-12334: --- Hi [~fan_li_ya] We have a custom StreamOperator with an

[jira] [Created] (FLINK-12334) change to MockStreamTask breaks OneInputStreamOperatorTestHarness

2019-04-25 Thread Cliff Resnick (JIRA)
Cliff Resnick created FLINK-12334: - Summary: change to MockStreamTask breaks OneInputStreamOperatorTestHarness Key: FLINK-12334 URL: https://issues.apache.org/jira/browse/FLINK-12334 Project: Flink

[jira] [Commented] (FLINK-11947) Support MapState key / value schema evolution for RocksDB

2019-03-18 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795072#comment-16795072 ] Cliff Resnick commented on FLINK-11947: --- Thanks for the explanation, that makes sense. However,

[jira] [Commented] (FLINK-10671) rest monitoring api Savepoint status call fails if akka.ask.timeout < checkpoint duration

2018-11-05 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675184#comment-16675184 ] Cliff Resnick commented on FLINK-10671: --- [~gjy] yes, I think when I created the issue I couldn't

[jira] [Created] (FLINK-10671) rest monitoring api Savepoint status call fails if akka.ask.timeout < checkpoint duration

2018-10-24 Thread Cliff Resnick (JIRA)
Cliff Resnick created FLINK-10671: - Summary: rest monitoring api Savepoint status call fails if akka.ask.timeout < checkpoint duration Key: FLINK-10671 URL: https://issues.apache.org/jira/browse/FLINK-10671

[jira] [Created] (FLINK-9339) Accumulators are not UI accessible running in FLIP-6 mode

2018-05-11 Thread Cliff Resnick (JIRA)
Cliff Resnick created FLINK-9339: Summary: Accumulators are not UI accessible running in FLIP-6 mode Key: FLINK-9339 URL: https://issues.apache.org/jira/browse/FLINK-9339 Project: Flink

[jira] [Updated] (FLINK-8616) Missing null check in OperatorChain.CopyingChainingOutput#pushToOperator masks ClassCastException

2018-02-08 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cliff Resnick updated FLINK-8616: - Summary: Missing null check in OperatorChain.CopyingChainingOutput#pushToOperator masks

[jira] [Updated] (FLINK-8616) Missing null check in OperatorChain.copyingChainOutput#pushToOperator masks ClassCastException

2018-02-08 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cliff Resnick updated FLINK-8616: - Summary: Missing null check in OperatorChain.copyingChainOutput#pushToOperator masks

[jira] [Created] (FLINK-8616) Missing null check in OperatorChain#pushToOperator masks ClassCastException

2018-02-08 Thread Cliff Resnick (JIRA)
Cliff Resnick created FLINK-8616: Summary: Missing null check in OperatorChain#pushToOperator masks ClassCastException Key: FLINK-8616 URL: https://issues.apache.org/jira/browse/FLINK-8616 Project:

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

2017-06-26 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064079#comment-16064079 ] Cliff Resnick commented on FLINK-6964: -- [~srichter] Looks good from this end, all tests passed.

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

2017-06-26 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063768#comment-16063768 ] Cliff Resnick commented on FLINK-6964: -- [~srichter] So far, looks good! I need to leave early today

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

2017-06-23 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061270#comment-16061270 ] Cliff Resnick commented on FLINK-6964: -- looks likes it's still trying to register a Placeholder? >

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

2017-06-23 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061257#comment-16061257 ] Cliff Resnick commented on FLINK-6964: -- I ran with your newer precondition. It actually succeeded

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

2017-06-23 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061216#comment-16061216 ] Cliff Resnick commented on FLINK-6964: -- ok, will try that. meanwhile here is a run (and hang) from

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

2017-06-23 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061178#comment-16061178 ] Cliff Resnick commented on FLINK-6964: -- ok I'll wait on your push > Fix recovery for incremental

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

2017-06-23 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061163#comment-16061163 ] Cliff Resnick commented on FLINK-6964: -- Ha! I just started running. ok, will merge and rebuild The

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

2017-06-23 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061092#comment-16061092 ] Cliff Resnick commented on FLINK-6964: -- I'll merge and rerun. This is what I have for log scope.

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

2017-06-23 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061088#comment-16061088 ] Cliff Resnick commented on FLINK-6964: -- [~srichter] By hanging I mean that the checkpoint, though

[jira] [Commented] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

2017-06-22 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060027#comment-16060027 ] Cliff Resnick commented on FLINK-6964: -- [~srichter] I tried your fix. After resuming from a

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

2017-06-21 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058158#comment-16058158 ] Cliff Resnick commented on FLINK-6633: -- Thanks [~srichter], I'll give this a try tomorrow morning

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

2017-06-20 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056537#comment-16056537 ] Cliff Resnick commented on FLINK-6633: -- Stefan, if you need me to unpack things further please feel

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

2017-06-20 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056527#comment-16056527 ] Cliff Resnick commented on FLINK-6633: -- Ok, new gist is here:

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

2017-06-20 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056342#comment-16056342 ] Cliff Resnick commented on FLINK-6633: -- full log here:

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

2017-06-20 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056334#comment-16056334 ] Cliff Resnick commented on FLINK-6633: -- {noformat} 2017-06-20 18:44:39.376 [ip-10-150-96-228] INFO

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

2017-06-20 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056332#comment-16056332 ] Cliff Resnick commented on FLINK-6633: -- The issue that [~gyfora] mentioned still exists in current

[jira] [Created] (FLINK-5646) REST api documentation missing details on jar upload

2017-01-25 Thread Cliff Resnick (JIRA)
Cliff Resnick created FLINK-5646: Summary: REST api documentation missing details on jar upload Key: FLINK-5646 URL: https://issues.apache.org/jira/browse/FLINK-5646 Project: Flink Issue

[jira] [Commented] (FLINK-4228) RocksDB semi-async snapshot to S3AFileSystem fails

2016-12-23 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15773084#comment-15773084 ] Cliff Resnick commented on FLINK-4228: -- My last pull request is good to go so I guess it's up to you

[jira] [Commented] (FLINK-4228) RocksDB semi-async snapshot to S3AFileSystem fails

2016-12-23 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772906#comment-15772906 ] Cliff Resnick commented on FLINK-4228: -- The issue now is exclusive to running on YARN with s3a:// as

[jira] [Commented] (FLINK-4228) RocksDB semi-async snapshot to S3AFileSystem fails

2016-07-22 Thread Cliff Resnick (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390493#comment-15390493 ] Cliff Resnick commented on FLINK-4228: -- I added a pull request for this. I included the fink-yarn