[jira] [Resolved] (SPARK-11117) PhysicalRDD.outputsUnsafeRows should return true when the underlying data source produces UnsafeRows

[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-7. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9305

[jira] [Resolved] (SPARK-11345) Make HadoopFsRelation always outputs UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-11345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11345. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9305

[jira] [Comment Edited] (SPARK-10158) ALS should print better errors when given Long IDs

[ https://issues.apache.org/jira/browse/SPARK-10158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983644#comment-14983644 ] Bryan Cutler edited comment on SPARK-10158 at 10/31/15 7:05 AM: I think

[jira] [Assigned] (SPARK-11436) we should rebind right encoder when join 2 datasets

[ https://issues.apache.org/jira/browse/SPARK-11436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11436: Assignee: Apache Spark > we should rebind right encoder when join 2 datasets >

[jira] [Commented] (SPARK-11436) we should rebind right encoder when join 2 datasets

[ https://issues.apache.org/jira/browse/SPARK-11436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983965#comment-14983965 ] Apache Spark commented on SPARK-11436: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11436) we should rebind right encoder when join 2 datasets

[ https://issues.apache.org/jira/browse/SPARK-11436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11436: Assignee: (was: Apache Spark) > we should rebind right encoder when join 2 datasets >

[jira] [Comment Edited] (SPARK-11431) Allow exploding arrays of structs in DataFrames

[ https://issues.apache.org/jira/browse/SPARK-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983980#comment-14983980 ] Tycho Grouwstra edited comment on SPARK-11431 at 10/31/15 12:51 PM:

[jira] [Comment Edited] (SPARK-11431) Allow exploding arrays of structs in DataFrames

[ https://issues.apache.org/jira/browse/SPARK-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983980#comment-14983980 ] Tycho Grouwstra edited comment on SPARK-11431 at 10/31/15 12:51 PM:

[jira] [Assigned] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10500: Assignee: Apache Spark > sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

[jira] [Created] (SPARK-11436) we should rebind right encoder when join 2 datasets

Wenchen Fan created SPARK-11436: --- Summary: we should rebind right encoder when join 2 datasets Key: SPARK-11436 URL: https://issues.apache.org/jira/browse/SPARK-11436 Project: Spark Issue

[jira] [Resolved] (SPARK-11226) Empty line in json file should be skipped

[ https://issues.apache.org/jira/browse/SPARK-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11226. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9211

[jira] [Updated] (SPARK-11226) Empty line in json file should be skipped

[ https://issues.apache.org/jira/browse/SPARK-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11226: -- Assignee: Jeff Zhang > Empty line in json file should be skipped >

[jira] [Commented] (SPARK-11431) Allow exploding arrays of structs in DataFrames

[ https://issues.apache.org/jira/browse/SPARK-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983945#comment-14983945 ] Michael Armbrust commented on SPARK-11431: -- Have you look at the explode that works on a column?

[jira] [Assigned] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10500: Assignee: (was: Apache Spark) > sparkr.zip cannot be created if $SPARK_HOME/R/lib is

[jira] [Commented] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983925#comment-14983925 ] Apache Spark commented on SPARK-10500: -- User 'sun-rui' has created a pull request for this issue:

[jira] [Commented] (SPARK-11431) Allow exploding arrays of structs in DataFrames

[ https://issues.apache.org/jira/browse/SPARK-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983980#comment-14983980 ] Tycho Grouwstra commented on SPARK-11431: - Hah, I actually missed that, so my bad, thanks! What

[jira] [Comment Edited] (SPARK-11431) Allow exploding arrays of structs in DataFrames

[ https://issues.apache.org/jira/browse/SPARK-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983980#comment-14983980 ] Tycho Grouwstra edited comment on SPARK-11431 at 10/31/15 12:53 PM:

[jira] [Updated] (SPARK-11431) Allow exploding arrays of structs in DataFrames

[ https://issues.apache.org/jira/browse/SPARK-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tycho Grouwstra updated SPARK-11431: Description: I am creating DataFrames from some [JSON

[jira] [Comment Edited] (SPARK-11431) Allow exploding arrays of structs in DataFrames

[ https://issues.apache.org/jira/browse/SPARK-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983980#comment-14983980 ] Tycho Grouwstra edited comment on SPARK-11431 at 10/31/15 12:54 PM:

[jira] [Created] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

Jason White created SPARK-11437: --- Summary: createDataFrame shouldn't .take() when provided schema Key: SPARK-11437 URL: https://issues.apache.org/jira/browse/SPARK-11437 Project: Spark Issue

[jira] [Commented] (SPARK-6373) Add SSL/TLS for the Netty based BlockTransferService

[ https://issues.apache.org/jira/browse/SPARK-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984140#comment-14984140 ] Jeffrey Turpin commented on SPARK-6373: --- [~jlewandowski], are you willing to do a review of my

[jira] [Assigned] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11437: Assignee: (was: Apache Spark) > createDataFrame shouldn't .take() when provided

[jira] [Commented] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984166#comment-14984166 ] Apache Spark commented on SPARK-11437: -- User 'JasonMWhite' has created a pull request for this

[jira] [Assigned] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11437: Assignee: Apache Spark > createDataFrame shouldn't .take() when provided schema >

[jira] [Updated] (SPARK-10978) Allow PrunedFilterScan to eliminate predicates from further evaluation

[ https://issues.apache.org/jira/browse/SPARK-10978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10978: - Priority: Critical (was: Minor) > Allow PrunedFilterScan to eliminate predicates from further

[jira] [Updated] (SPARK-11024) Optimize NULL in by folding it to Literal(null)

[ https://issues.apache.org/jira/browse/SPARK-11024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11024: - Assignee: Dilip Biswal > Optimize NULL in by folding it to Literal(null) >

[jira] [Resolved] (SPARK-11024) Optimize NULL in by folding it to Literal(null)

[ https://issues.apache.org/jira/browse/SPARK-11024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11024. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9348

[jira] [Commented] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984009#comment-14984009 ] Jason White commented on SPARK-11437: - [~marmbrus] We briefly discussed this at SparkSummitEU this

[jira] [Resolved] (SPARK-11431) Allow exploding arrays of structs in DataFrames

[ https://issues.apache.org/jira/browse/SPARK-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tycho Grouwstra resolved SPARK-11431. - Resolution: Implemented > Allow exploding arrays of structs in DataFrames >

[jira] [Created] (SPARK-11439) Optiomization of creating sparse feature without dense one

Kai Sasaki created SPARK-11439: -- Summary: Optiomization of creating sparse feature without dense one Key: SPARK-11439 URL: https://issues.apache.org/jira/browse/SPARK-11439 Project: Spark Issue

[jira] [Updated] (SPARK-11439) Optiomization of creating sparse feature without dense one

[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated SPARK-11439: --- Description: Currently, sparse feature generated in {{LinearDataGenerator}} needs to create dense

[jira] [Resolved] (SPARK-11427) DataFrame's intersect method does not work, returns 1

[ https://issues.apache.org/jira/browse/SPARK-11427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ram Kandasamy resolved SPARK-11427. --- Resolution: Duplicate > DataFrame's intersect method does not work, returns 1 >

[jira] [Commented] (SPARK-11427) DataFrame's intersect method does not work, returns 1

[ https://issues.apache.org/jira/browse/SPARK-11427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984195#comment-14984195 ] Ram Kandasamy commented on SPARK-11427: --- So it looks like this issue has been resolved in spark

[jira] [Commented] (SPARK-6373) Add SSL/TLS for the Netty based BlockTransferService

[ https://issues.apache.org/jira/browse/SPARK-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984219#comment-14984219 ] Jeffrey Turpin commented on SPARK-6373: --- Any comments/feedback would be appreciated...

[jira] [Created] (SPARK-11438) Allow users to define nondeterministic UDFs

Yin Huai created SPARK-11438: Summary: Allow users to define nondeterministic UDFs Key: SPARK-11438 URL: https://issues.apache.org/jira/browse/SPARK-11438 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-11438) Allow users to define nondeterministic UDFs

[ https://issues.apache.org/jira/browse/SPARK-11438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984223#comment-14984223 ] Apache Spark commented on SPARK-11438: -- User 'yhuai' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11438) Allow users to define nondeterministic UDFs

[ https://issues.apache.org/jira/browse/SPARK-11438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11438: Assignee: Yin Huai (was: Apache Spark) > Allow users to define nondeterministic UDFs >

[jira] [Assigned] (SPARK-11438) Allow users to define nondeterministic UDFs

[ https://issues.apache.org/jira/browse/SPARK-11438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-11438: Assignee: Yin Huai > Allow users to define nondeterministic UDFs >

[jira] [Assigned] (SPARK-11438) Allow users to define nondeterministic UDFs

[ https://issues.apache.org/jira/browse/SPARK-11438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11438: Assignee: Apache Spark (was: Yin Huai) > Allow users to define nondeterministic UDFs >

[jira] [Resolved] (SPARK-11265) YarnClient can't get tokens to talk to Hive 1.2.1 in a secure cluster

[ https://issues.apache.org/jira/browse/SPARK-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11265. Resolution: Fixed Assignee: Steve Loughran Fix Version/s: 1.6.0 >