HeartSaVioR commented on pull request #31355: URL: https://github.com/apache/spark/pull/31355#issuecomment-799000237
Kindly reminder @rdblue - looks like the static number of partitions for non specific distribution is the only thing we need to sort out, and it's not a one of initial goals of the PR. Unless we are very clear this has to be addressed altogether, I'd say this is beyond the PR. Do you agree, or you have someone in real world cases and confirm static number of partitions work great for such cases? (Even hypothetically thinking on such cases, upper/lower bound makes more sense to me, which is different story.) ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org