[jira] [Commented] (SPARK-22152) Add Dataset flatten function

[ https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184296#comment-16184296 ] Drew Robb commented on SPARK-22152: --- There is also a ticket for adding it to RDD:

[jira] [Commented] (SPARK-22152) Add Dataset flatten function

[ https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183585#comment-16183585 ] Drew Robb commented on SPARK-22152: --- I personally use `Option` very frequently in datasets, and it is

[jira] [Created] (SPARK-22152) Add Dataset flatten function

Drew Robb created SPARK-22152: - Summary: Add Dataset flatten function Key: SPARK-22152 URL: https://issues.apache.org/jira/browse/SPARK-22152 Project: Spark Issue Type: Wish

[jira] [Commented] (SPARK-8288) ScalaReflection should also try apply methods defined in companion objects when inferring schema from a Product type

[ https://issues.apache.org/jira/browse/SPARK-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181716#comment-16181716 ] Drew Robb commented on SPARK-8288: -- I do not yet have a fully working fix. I think that the best approach

[jira] [Commented] (SPARK-21133) HighlyCompressedMapStatus#writeExternal throws NPE

[ https://issues.apache.org/jira/browse/SPARK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162519#comment-16162519 ] Drew Robb commented on SPARK-21133: --- My mistake, you are absolutely correct. I had some locally cached

[jira] [Commented] (SPARK-21133) HighlyCompressedMapStatus#writeExternal throws NPE

[ https://issues.apache.org/jira/browse/SPARK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162469#comment-16162469 ] Drew Robb commented on SPARK-21133: --- Thanks for the fix on this, but I don't think the fix version is

[jira] [Commented] (SPARK-8288) ScalaReflection should also try apply methods defined in companion objects when inferring schema from a Product type

[ https://issues.apache.org/jira/browse/SPARK-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16115036#comment-16115036 ] Drew Robb commented on SPARK-8288: -- An additional fix beyond my PR would be needed to handle reading this

[jira] [Commented] (SPARK-8288) ScalaReflection should also try apply methods defined in companion objects when inferring schema from a Product type

[ https://issues.apache.org/jira/browse/SPARK-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107798#comment-16107798 ] Drew Robb commented on SPARK-8288: -- I opened a PR for this issue, not sure why the bot didn't pick it up?

[jira] [Commented] (SPARK-12664) Expose raw prediction scores in MultilayerPerceptronClassificationModel

[ https://issues.apache.org/jira/browse/SPARK-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928928#comment-15928928 ] Drew Robb commented on SPARK-12664: --- This feature is also very important to me. I'm considering working

[jira] [Issue Comment Deleted] (SPARK-16599) java.util.NoSuchElementException: None.get at at org.apache.spark.storage.BlockInfoManager.releaseAllLocksForTask(BlockInfoManager.scala:343)

[ https://issues.apache.org/jira/browse/SPARK-16599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Drew Robb updated SPARK-16599: -- Comment: was deleted (was: I encountered an identical exception when using a singleton spark session.

[jira] [Commented] (SPARK-16599) java.util.NoSuchElementException: None.get at at org.apache.spark.storage.BlockInfoManager.releaseAllLocksForTask(BlockInfoManager.scala:343)

[ https://issues.apache.org/jira/browse/SPARK-16599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832569#comment-15832569 ] Drew Robb commented on SPARK-16599: --- I encountered an identical exception when using a singleton spark

[jira] [Updated] (SPARK-17986) SQLTransformer leaks temporary tables

[ https://issues.apache.org/jira/browse/SPARK-17986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Drew Robb updated SPARK-17986: -- Description: The SQLTransformer creates a temporary table when called, and does not delete this

[jira] [Created] (SPARK-17986) SQLTransformer leaks temporary tables

Drew Robb created SPARK-17986: - Summary: SQLTransformer leaks temporary tables Key: SPARK-17986 URL: https://issues.apache.org/jira/browse/SPARK-17986 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-17928) No driver.memoryOverhead setting for mesos cluster mode

Drew Robb created SPARK-17928: - Summary: No driver.memoryOverhead setting for mesos cluster mode Key: SPARK-17928 URL: https://issues.apache.org/jira/browse/SPARK-17928 Project: Spark Issue