HyukjinKwon commented on code in PR #44294:
URL: https://github.com/apache/spark/pull/44294#discussion_r1437927991
##########
core/src/main/scala/org/apache/spark/internal/config/Python.scala:
##########
@@ -69,4 +69,12 @@ private[spark] object Python {
.version("3.2.0")
.booleanConf
.createWithDefault(false)
+
+ val PYTHON_DATAFRAME_CHUNK_READ_ENABLED =
+ ConfigBuilder("spark.python.dataFrameChunkRead.enabled")
+ .doc("When true, driver and executes launch local cached arrow batch
servers for serving " +
Review Comment:
```suggestion
.doc("When true, driver and executers launch local cached Arrow batch
servers for serving " +
```
##########
core/src/main/scala/org/apache/spark/internal/config/Python.scala:
##########
@@ -69,4 +69,12 @@ private[spark] object Python {
.version("3.2.0")
.booleanConf
.createWithDefault(false)
+
+ val PYTHON_DATAFRAME_CHUNK_READ_ENABLED =
+ ConfigBuilder("spark.python.dataFrameChunkRead.enabled")
+ .doc("When true, driver and executes launch local cached arrow batch
servers for serving " +
+ "pyspark DataFrame chunk read requests.")
Review Comment:
```suggestion
"PySpark DataFrame chunk read requests.")
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
