[jira] [Commented] (SPARK-37185) DataFrame.take() only uses one worker

[ https://issues.apache.org/jira/browse/SPARK-37185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17437585#comment-17437585 ] mathieu longtin commented on SPARK-37185: - It seems to try to optimize for a simple query, but

[jira] [Commented] (SPARK-37185) DataFrame.take() only uses one worker

[ https://issues.apache.org/jira/browse/SPARK-37185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17437009#comment-17437009 ] mathieu longtin commented on SPARK-37185: - Additional note: if there's a "group by" in the

[jira] [Created] (SPARK-37185) DataFrame.take() only uses one worker

mathieu longtin created SPARK-37185: --- Summary: DataFrame.take() only uses one worker Key: SPARK-37185 URL: https://issues.apache.org/jira/browse/SPARK-37185 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-24753) bad backslah parsing in SQL statements

[ https://issues.apache.org/jira/browse/SPARK-24753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539023#comment-16539023 ] mathieu longtin edited comment on SPARK-24753 at 7/10/18 5:59 PM: --

[jira] [Commented] (SPARK-24753) bad backslah parsing in SQL statements

[ https://issues.apache.org/jira/browse/SPARK-24753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539023#comment-16539023 ] mathieu longtin commented on SPARK-24753: - Thanks for the response. Yes, it does work with

[jira] [Created] (SPARK-24753) bad backslah parsing in SQL statements

mathieu longtin created SPARK-24753: --- Summary: bad backslah parsing in SQL statements Key: SPARK-24753 URL: https://issues.apache.org/jira/browse/SPARK-24753 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15531) spark-class tries to use too much memory when running Launcher

[ https://issues.apache.org/jira/browse/SPARK-15531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300986#comment-15300986 ] mathieu longtin commented on SPARK-15531: - Correct, on a 128G server, just running {{java}} with

[jira] [Commented] (SPARK-15531) spark-class tries to use too much memory when running Launcher

[ https://issues.apache.org/jira/browse/SPARK-15531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300666#comment-15300666 ] mathieu longtin commented on SPARK-15531: - The VM that spark-class launches afterwards has an

[jira] [Created] (SPARK-15531) spark-class tries to use too much memory when running Launcher

mathieu longtin created SPARK-15531: --- Summary: spark-class tries to use too much memory when running Launcher Key: SPARK-15531 URL: https://issues.apache.org/jira/browse/SPARK-15531 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-13266) Python DataFrameReader converts None to "None" instead of null

[ https://issues.apache.org/jira/browse/SPARK-13266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mathieu longtin updated SPARK-13266: Comment: was deleted (was: https://github.com/apache/spark/pull/11305) > Python

[jira] [Commented] (SPARK-13266) Python DataFrameReader converts None to "None" instead of null

[ https://issues.apache.org/jira/browse/SPARK-13266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157260#comment-15157260 ] mathieu longtin commented on SPARK-13266: - https://github.com/apache/spark/pull/11305 > Python

[jira] [Reopened] (SPARK-13290) wholeTextFile and binaryFiles are really slow

[ https://issues.apache.org/jira/browse/SPARK-13290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mathieu longtin reopened SPARK-13290: - Slow relative to reading the exact same file on a local disk on the same machine. Python

[jira] [Created] (SPARK-13290) wholeTextFile and binaryFiles are really slow

mathieu longtin created SPARK-13290: --- Summary: wholeTextFile and binaryFiles are really slow Key: SPARK-13290 URL: https://issues.apache.org/jira/browse/SPARK-13290 Project: Spark Issue

[jira] [Created] (SPARK-13266) Python DataFrameReader converts None to "None" instead of null

mathieu longtin created SPARK-13266: --- Summary: Python DataFrameReader converts None to "None" instead of null Key: SPARK-13266 URL: https://issues.apache.org/jira/browse/SPARK-13266 Project: Spark