[GitHub] [spark] HyukjinKwon commented on a change in pull request #34631: [SPARK-37277][PYTHON][SQL] Support DayTimeIntervalType in pandas UDF and Arrow optimization

2021-11-17 Thread GitBox
HyukjinKwon commented on a change in pull request #34631: URL: https://github.com/apache/spark/pull/34631#discussion_r751945528 ## File path: python/pyspark/sql/pandas/conversion.py ## @@ -225,7 +227,10 @@ def toPandas(self) -> "PandasDataFrameLike": else:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34631: [SPARK-37277][PYTHON][SQL] Support DayTimeIntervalType in pandas UDF and Arrow optimization

2021-11-17 Thread GitBox
HyukjinKwon commented on a change in pull request #34631: URL: https://github.com/apache/spark/pull/34631#discussion_r751947212 ## File path: python/pyspark/sql/pandas/conversion.py ## @@ -225,7 +227,10 @@ def toPandas(self) -> "PandasDataFrameLike": else:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34631: [SPARK-37277][PYTHON][SQL] Support DayTimeIntervalType in pandas UDF and Arrow optimization

2021-11-17 Thread GitBox
HyukjinKwon commented on a change in pull request #34631: URL: https://github.com/apache/spark/pull/34631#discussion_r751947485 ## File path: python/pyspark/sql/pandas/conversion.py ## @@ -225,7 +227,10 @@ def toPandas(self) -> "PandasDataFrameLike": else:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34631: [SPARK-37277][PYTHON][SQL] Support DayTimeIntervalType in pandas UDF and Arrow optimization

2021-11-17 Thread GitBox
HyukjinKwon commented on a change in pull request #34631: URL: https://github.com/apache/spark/pull/34631#discussion_r751948058 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/vectorized/ArrowColumnVector.java ## @@ -19,19 +19,14 @@ import org.apache.arrow.vec

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34631: [SPARK-37277][PYTHON][SQL] Support DayTimeIntervalType in pandas UDF and Arrow optimization

2021-11-17 Thread GitBox
HyukjinKwon commented on a change in pull request #34631: URL: https://github.com/apache/spark/pull/34631#discussion_r751948058 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/vectorized/ArrowColumnVector.java ## @@ -19,19 +19,14 @@ import org.apache.arrow.vec