[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987418#comment-16987418
]
Hyukjin Kwon commented on SPARK-30063:
--
Closing this assuming the issue was resolved.
> Failure
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987417#comment-16987417
]
Hyukjin Kwon commented on SPARK-30063:
--
{quote}
Set the PYTHONHASHSEED environment variable such
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987230#comment-16987230
]
Tim Kellogg commented on SPARK-30063:
-
Improvement suggestions
* Set the PYTHONHASHSEED environment
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987154#comment-16987154
]
Bryan Cutler commented on SPARK-30063:
--
I haven't looked at your bug report in detail but you are
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986817#comment-16986817
]
Ruben Berenguel commented on SPARK-30063:
-
Wow, this looks bad for now (since grouped_aggs are
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986438#comment-16986438
]
Tim Kellogg commented on SPARK-30063:
-
Additional notes on UDFs returning
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986373#comment-16986373
]
Tim Kellogg commented on SPARK-30063:
-
This appears to be 100% related to pyarrow version. I
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986304#comment-16986304
]
Tim Kellogg commented on SPARK-30063:
-
I attached variety-of-schemas.ipynb. It seems reproducing
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986253#comment-16986253
]
Tim Kellogg commented on SPARK-30063:
-
I added the expanded query plan, hopefully that can holdover
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986242#comment-16986242
]
Tim Kellogg commented on SPARK-30063:
-
[~RBerenguel] I agree that the schema seems to be passed
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986236#comment-16986236
]
Tim Kellogg commented on SPARK-30063:
-
pyarrow==0.15.1
pandas==0.24.2
I've tried several other
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985755#comment-16985755
]
Hyukjin Kwon commented on SPARK-30063:
--
Also can you describe the PyArrow and pandas versions you
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985192#comment-16985192
]
Ruben Berenguel commented on SPARK-30063:
-
Hi [~tkellogg] I’d like to have a look, do you have
13 matches
Mail list logo
