rdblue commented on pull request #31355:
URL: https://github.com/apache/spark/pull/31355#issuecomment-779365676
Before moving on, I think we need to decide whether this controls
parallelism all the time, or just when certain distributions are used. I think
it should be all the time for con
rdblue commented on pull request #31355:
URL: https://github.com/apache/spark/pull/31355#issuecomment-768668219
Overall, I have no problem adding this. My one reservation is that I would
hope that most sources don't explicitly control parallelism and I think adding
only this would cause im
