viirya commented on a change in pull request #30735: URL: https://github.com/apache/spark/pull/30735#discussion_r541705354
########## File path: docs/running-on-kubernetes.md ########## @@ -1083,14 +1083,6 @@ See the [configuration page](configuration.html) for information on Spark config </td> <td>2.4.0</td> </tr> -<tr> - <td><code>spark.kubernetes.pyspark.pythonVersion</code></td> - <td><code>"3"</code></td> - <td> - This sets the major Python version of the docker image used to run the driver and executor containers. Can be 3. - </td> - <td>2.4.0</td> -</tr> Review comment: The disappearance of the `pythonVersion` might make end users a bit hard to follow quickly. Seems no migration guide is there for kubernetes. Should we mention the removing and the support of PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON env variables in this doc? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org