HeartSaVioR commented on pull request #31355: URL: https://github.com/apache/spark/pull/31355#issuecomment-794441176
I don't have a real use case as I commented earlier on review comment, but you could imagine the case where external storage has limited bandwidth on concurrent writes. Quite earlier (5+ years ago) I had a case and had to deal with manual repartition. Actually, specifying upper bound / lower bound looks more suitable for that case (so it triggers repartition only when the write operation's partitions exceed/under certain boundary), but that looks to be beyond the PR. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
