[GitHub] [spark] mridulm commented on pull request #40843: [SPARK-43179][SHUFFLE] Allowing apps to control whether their metadata gets saved in the db by the External Shuffle Service

mridulm commented on PR #40843: URL: https://github.com/apache/spark/pull/40843#issuecomment-1518125522 Thanks for fixing this @otterc ! Thanks for the reviews @tgravescs, @zhouyejoe :-) -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] mridulm commented on pull request #40843: [SPARK-43179][SHUFFLE] Allowing apps to control whether their metadata gets saved in the db by the External Shuffle Service

mridulm commented on PR #40843: URL: https://github.com/apache/spark/pull/40843#issuecomment-1515895607 Exactly that usecase @tgravescs. We have usecases where applications require heightened security, and are fine with the recomputation cost due to lost shuffle data. -- This is an

[GitHub] [spark] mridulm commented on pull request #40843: [SPARK-43179][SHUFFLE] Allowing apps to control whether their metadata gets saved in the db by the External Shuffle Service

mridulm commented on PR #40843: URL: https://github.com/apache/spark/pull/40843#issuecomment-1514901193 +CC @attilapiros -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.