Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20567#discussion_r167685604
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1941,12 +1941,24 @@ def toPandas(self):
timezone = None
if
Github user BryanCutler commented on a diff in the pull request:
https://github.com/apache/spark/pull/20567#discussion_r167644725
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1941,12 +1941,24 @@ def toPandas(self):
timezone = None
if
Github user BryanCutler commented on a diff in the pull request:
https://github.com/apache/spark/pull/20567#discussion_r167635216
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1941,12 +1941,24 @@ def toPandas(self):
timezone = None
if
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20567#discussion_r167469258
--- Diff: python/pyspark/sql/tests.py ---
@@ -48,12 +49,12 @@
else:
import unittest
+from pyspark.util import _exception_message
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20567#discussion_r167423077
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1941,12 +1941,24 @@ def toPandas(self):
timezone = None
if
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/20567#discussion_r167415761
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1941,12 +1941,24 @@ def toPandas(self):
timezone = None
if
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20567#discussion_r167394432
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1941,12 +1941,24 @@ def toPandas(self):
timezone = None
if
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20567#discussion_r167394424
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1955,38 +1967,34 @@ def toPandas(self):
return
GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/20567
[SPARK-23380][PYTHON] Make toPandas fall back to Arrow optimization
disabled when schema is not supported in Arrow optimization
## What changes were proposed in this pull request?