[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

2016-08-23 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432470#comment-15432470 ] holdenk commented on SPARK-12072: - My guess is probably not a directly related issue - your OOM from

[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

2016-08-23 Thread Ben Teeuwen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432459#comment-15432459 ] Ben Teeuwen commented on SPARK-12072: - [~holdenk] we haven't been able to test the patch above (yet).

[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

2016-04-18 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247017#comment-15247017 ] holdenk commented on SPARK-12072: - Any results yet? > python dataframe ._jdf.schema().json() breaks on

[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

2016-04-11 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235845#comment-15235845 ] holdenk commented on SPARK-12072: - Just figured I'd follow up post Strata and see if you all had any

[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

2016-03-21 Thread Rares Mirica (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203912#comment-15203912 ] Rares Mirica commented on SPARK-12072: -- Thank you for looking into this, testing asap > python

[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

2016-03-21 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203902#comment-15203902 ] holdenk commented on SPARK-12072: - [~mrares] I've got a draft PR that I think should fix your issue - if

[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

2016-03-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203657#comment-15203657 ] Apache Spark commented on SPARK-12072: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

2016-03-18 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200758#comment-15200758 ] holdenk commented on SPARK-12072: - So coming back to this after chatting with [~mrares] I've got

[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

2015-12-10 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051705#comment-15051705 ] holdenk commented on SPARK-12072: - Ok cool, let me take a look and see if there is another way to fix

[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

2015-12-02 Thread Rares Mirica (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035823#comment-15035823 ] Rares Mirica commented on SPARK-12072: -- My set is in the millions of parameters. I believe you are

[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

2015-12-01 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034564#comment-15034564 ] holdenk commented on SPARK-12072: - Around what # of attrs are you seeing failures at? Do you think we