[jira] [Commented] (FLINK-25200) Implement duplicating for s3 filesystem

2022-01-24 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481058#comment-17481058 ] Piotr Nowojski commented on FLINK-25200: Ok, so I guess we are on the same page. I don't see a

[jira] [Commented] (FLINK-25200) Implement duplicating for s3 filesystem

2022-01-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481048#comment-17481048 ] Yun Tang commented on FLINK-25200: -- [~pnowojski] Actually, I mean we should implement Aliyun OSS

[jira] [Commented] (FLINK-25200) Implement duplicating for s3 filesystem

2022-01-24 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480952#comment-17480952 ] Piotr Nowojski commented on FLINK-25200: [~yunta], maybe there is some confusion on our side.

[jira] [Commented] (FLINK-25200) Implement duplicating for s3 filesystem

2022-01-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480904#comment-17480904 ] Yun Tang commented on FLINK-25200: -- [~pnowojski] From my knowledge, S3 will involve copy on server side

[jira] [Commented] (FLINK-25200) Implement duplicating for s3 filesystem

2022-01-20 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479437#comment-17479437 ] Piotr Nowojski commented on FLINK-25200: [~yunta], I'm not sure how much more information would

[jira] [Commented] (FLINK-25200) Implement duplicating for s3 filesystem

2022-01-19 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479139#comment-17479139 ] Yun Tang commented on FLINK-25200: -- [~akalashnikov] I think we should run tests to mock the condition

[jira] [Commented] (FLINK-25200) Implement duplicating for s3 filesystem

2022-01-19 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478686#comment-17478686 ] Dawid Wysakowicz commented on FLINK-25200: -- > Do you ensure that the test logic is reading

[jira] [Commented] (FLINK-25200) Implement duplicating for s3 filesystem

2022-01-19 Thread Anton Kalashnikov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478685#comment-17478685 ] Anton Kalashnikov commented on FLINK-25200: --- ??Do you ensure that the test logic is reading

[jira] [Commented] (FLINK-25200) Implement duplicating for s3 filesystem

2022-01-19 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478674#comment-17478674 ] Yun Tang commented on FLINK-25200: -- For general RocksDB incremental checkpoint, we should also test

[jira] [Commented] (FLINK-25200) Implement duplicating for s3 filesystem

2022-01-19 Thread Anton Kalashnikov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478648#comment-17478648 ] Anton Kalashnikov commented on FLINK-25200: --- I have done some tests for comparing `upload