[GitHub] [spark] HeartSaVioR commented on pull request #37474: [SPARK-40039][SS] Introducing a streaming checkpoint file manager based on Hadoop's Abortable interface

2022-08-27 Thread GitBox
HeartSaVioR commented on PR #37474: URL: https://github.com/apache/spark/pull/37474#issuecomment-1229143104 Looks like all code changes in hadoop-cloud except IntegrationTestSuite should be moved to hadoop-3 and it would work afterwards. Thanks @HyukjinKwon for handling the issue. -- Thi

[GitHub] [spark] HeartSaVioR commented on pull request #37474: [SPARK-40039][SS] Introducing a streaming checkpoint file manager based on Hadoop's Abortable interface

2022-08-24 Thread GitBox
HeartSaVioR commented on PR #37474: URL: https://github.com/apache/spark/pull/37474#issuecomment-1226802090 Looks like Steve's comment has addressed. Thanks! Merging to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [spark] HeartSaVioR commented on pull request #37474: [SPARK-40039][SS] Introducing a streaming checkpoint file manager based on Hadoop's Abortable interface

2022-08-18 Thread GitBox
HeartSaVioR commented on PR #37474: URL: https://github.com/apache/spark/pull/37474#issuecomment-1220155962 @attilapiros Could you please perform some performance benchmark and put the observation in PR description, as I mentioned in previous comments? Thanks in advance. -- This is an au