[
https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432470#comment-15432470
]
holdenk commented on SPARK-12072:
-
My guess is probably not a directly related issue - your OOM from
[
https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432459#comment-15432459
]
Ben Teeuwen commented on SPARK-12072:
-
[~holdenk] we haven't been able to test the patch above (yet).
[
https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247017#comment-15247017
]
holdenk commented on SPARK-12072:
-
Any results yet?
> python dataframe ._jdf.schema().json() breaks on
[
https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235845#comment-15235845
]
holdenk commented on SPARK-12072:
-
Just figured I'd follow up post Strata and see if you all had any
[
https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203912#comment-15203912
]
Rares Mirica commented on SPARK-12072:
--
Thank you for looking into this, testing asap
> python
[
https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203902#comment-15203902
]
holdenk commented on SPARK-12072:
-
[~mrares] I've got a draft PR that I think should fix your issue - if
[
https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203657#comment-15203657
]
Apache Spark commented on SPARK-12072:
--
User 'holdenk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200758#comment-15200758
]
holdenk commented on SPARK-12072:
-
So coming back to this after chatting with [~mrares] I've got
[
https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051705#comment-15051705
]
holdenk commented on SPARK-12072:
-
Ok cool, let me take a look and see if there is another way to fix
[
https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035823#comment-15035823
]
Rares Mirica commented on SPARK-12072:
--
My set is in the millions of parameters. I believe you are
[
https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034564#comment-15034564
]
holdenk commented on SPARK-12072:
-
Around what # of attrs are you seeing failures at? Do you think we
11 matches
Mail list logo