[jira] [Commented] (SPARK-13352) BlockFetch does not scale well on large block

2016-04-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245209#comment-15245209 ] Davies Liu commented on SPARK-13352: corrected, thanks > BlockFetch does not scale w

[jira] [Comment Edited] (SPARK-13352) BlockFetch does not scale well on large block

2016-04-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15234559#comment-15234559 ] Davies Liu edited comment on SPARK-13352 at 4/18/16 6:40 AM: -

[jira] [Commented] (SPARK-14696) Needs implicit encoders for boxed primitive types

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245204#comment-15245204 ] Apache Spark commented on SPARK-14696: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-14696) Needs implicit encoders for boxed primitive types

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14696: Assignee: Reynold Xin (was: Apache Spark) > Needs implicit encoders for boxed primitive t

[jira] [Assigned] (SPARK-14696) Needs implicit encoders for boxed primitive types

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14696: Assignee: Apache Spark (was: Reynold Xin) > Needs implicit encoders for boxed primitive t

[jira] [Created] (SPARK-14696) Needs implicit encoders for boxed primitive types

2016-04-17 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14696: --- Summary: Needs implicit encoders for boxed primitive types Key: SPARK-14696 URL: https://issues.apache.org/jira/browse/SPARK-14696 Project: Spark Issue Type: I

[jira] [Commented] (SPARK-14453) Consider removing SPARK_JAVA_OPTS env variable

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245169#comment-15245169 ] Apache Spark commented on SPARK-14453: -- User 'jerryshao' has created a pull request

[jira] [Assigned] (SPARK-14453) Consider removing SPARK_JAVA_OPTS env variable

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14453: Assignee: Apache Spark > Consider removing SPARK_JAVA_OPTS env variable >

[jira] [Assigned] (SPARK-14453) Consider removing SPARK_JAVA_OPTS env variable

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14453: Assignee: (was: Apache Spark) > Consider removing SPARK_JAVA_OPTS env variable > -

[jira] [Commented] (SPARK-12810) PySpark CrossValidatorModel should support avgMetrics

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245152#comment-15245152 ] Apache Spark commented on SPARK-12810: -- User 'vectorijk' has created a pull request

[jira] [Assigned] (SPARK-12810) PySpark CrossValidatorModel should support avgMetrics

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12810: Assignee: (was: Apache Spark) > PySpark CrossValidatorModel should support avgMetrics

[jira] [Assigned] (SPARK-12810) PySpark CrossValidatorModel should support avgMetrics

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12810: Assignee: Apache Spark > PySpark CrossValidatorModel should support avgMetrics > -

[jira] [Commented] (SPARK-13662) [SQL][Hive] Have SHOW TABLES return additional fields from Hive MetaStore

2016-04-17 Thread Evan Chan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245129#comment-15245129 ] Evan Chan commented on SPARK-13662: --- Vijay, That would be awesome! Please go ahead.

[jira] [Commented] (SPARK-13904) Add support for pluggable cluster manager

2016-04-17 Thread Hemant Bhanawat (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245118#comment-15245118 ] Hemant Bhanawat commented on SPARK-13904: - [~kiszk] I am looking into this. > A

[jira] [Commented] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245109#comment-15245109 ] Apache Spark commented on SPARK-14647: -- User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14647: Assignee: Andrew Or (was: Apache Spark) > Group SQLContext/HiveContext state into Persist

[jira] [Assigned] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14647: Assignee: Apache Spark (was: Andrew Or) > Group SQLContext/HiveContext state into Persist

[jira] [Commented] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245100#comment-15245100 ] Yin Huai commented on SPARK-14647: -- Seems that test still timed out after we reverted th

[jira] [Updated] (SPARK-14695) Error occurs when using OFF_HEAP persistent level

2016-04-17 Thread Liang Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Lee updated SPARK-14695: -- Description: When running a PageRank job through the default examples, e.g., the class 'org.apache.s

[jira] [Comment Edited] (SPARK-14409) Investigate adding a RankingEvaluator to ML

2016-04-17 Thread Yong Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245084#comment-15245084 ] Yong Tang edited comment on SPARK-14409 at 4/18/16 3:12 AM: T

[jira] [Commented] (SPARK-14409) Investigate adding a RankingEvaluator to ML

2016-04-17 Thread Yong Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245084#comment-15245084 ] Yong Tang commented on SPARK-14409: --- Thanks [~mlnick] for the references. I will take a

[jira] [Commented] (SPARK-14695) Error occurs when using OFF_HEAP persistent level

2016-04-17 Thread Liang Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245083#comment-15245083 ] Liang Lee commented on SPARK-14695: --- The cluster enviroment is like this: Totally 3 ser

[jira] [Commented] (SPARK-14628) Remove all the Options in TaskMetrics

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245079#comment-15245079 ] Apache Spark commented on SPARK-14628: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-14409) Investigate adding a RankingEvaluator to ML

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245077#comment-15245077 ] Apache Spark commented on SPARK-14409: -- User 'yongtang' has created a pull request f

[jira] [Assigned] (SPARK-14409) Investigate adding a RankingEvaluator to ML

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14409: Assignee: (was: Apache Spark) > Investigate adding a RankingEvaluator to ML >

[jira] [Assigned] (SPARK-14409) Investigate adding a RankingEvaluator to ML

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14409: Assignee: Apache Spark > Investigate adding a RankingEvaluator to ML > ---

[jira] [Created] (SPARK-14695) Error occurs when using OFF_HEAP persistent level

2016-04-17 Thread Liang Lee (JIRA)
Liang Lee created SPARK-14695: - Summary: Error occurs when using OFF_HEAP persistent level Key: SPARK-14695 URL: https://issues.apache.org/jira/browse/SPARK-14695 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-14694) Thrift Server + Hive Metastore + Kerberos doesn't work

2016-04-17 Thread zhangguancheng (JIRA)
zhangguancheng created SPARK-14694: -- Summary: Thrift Server + Hive Metastore + Kerberos doesn't work Key: SPARK-14694 URL: https://issues.apache.org/jira/browse/SPARK-14694 Project: Spark Is

[jira] [Updated] (SPARK-14693) Spark Streaming Context Hangs on Start

2016-04-17 Thread Evan Oman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Oman updated SPARK-14693: -- Description: All, I am trying to use Kinesis with Spark Streaming on Spark 1.6.0 via Databricks and m

[jira] [Updated] (SPARK-14693) Spark Streaming Context Hangs on Start

2016-04-17 Thread Evan Oman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Oman updated SPARK-14693: -- Description: All, I am trying to use Kinesis with Spark Streaming on Spark 1.6.0 via Databricks and m

[jira] [Updated] (SPARK-14693) Spark Streaming Context Hangs on Start

2016-04-17 Thread Evan Oman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Oman updated SPARK-14693: -- Description: All, I am trying to use Kinesis with Spark Streaming on Spark 1.6.0 via Databricks and m

[jira] [Assigned] (SPARK-14127) [Table related commands] Describe table

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14127: Assignee: Apache Spark > [Table related commands] Describe table > ---

[jira] [Updated] (SPARK-14693) Spark Streaming Context Hangs on Start

2016-04-17 Thread Evan Oman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Oman updated SPARK-14693: -- Description: All, I am trying to use Kinesis with Spark Streaming on Spark 1.6.0 via Databricks and m

[jira] [Assigned] (SPARK-14127) [Table related commands] Describe table

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14127: Assignee: (was: Apache Spark) > [Table related commands] Describe table >

[jira] [Commented] (SPARK-14127) [Table related commands] Describe table

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245069#comment-15245069 ] Apache Spark commented on SPARK-14127: -- User 'dilipbiswal' has created a pull reques

[jira] [Created] (SPARK-14693) Spark Streaming Context Hangs on Start

2016-04-17 Thread Evan Oman (JIRA)
Evan Oman created SPARK-14693: - Summary: Spark Streaming Context Hangs on Start Key: SPARK-14693 URL: https://issues.apache.org/jira/browse/SPARK-14693 Project: Spark Issue Type: Bug Co

[jira] [Commented] (SPARK-14453) Consider removing SPARK_JAVA_OPTS env variable

2016-04-17 Thread Krishnan Narayan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245065#comment-15245065 ] Krishnan Narayan commented on SPARK-14453: -- +1 > Consider removing SPARK_JAVA_

[jira] [Commented] (SPARK-14453) Consider removing SPARK_JAVA_OPTS env variable

2016-04-17 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245048#comment-15245048 ] Saisai Shao commented on SPARK-14453: - Yes, this should be a part of SPARK-12344. Sin

[jira] [Created] (SPARK-14692) Error While Setting the path for R front end

2016-04-17 Thread Niranjan Molkeri` (JIRA)
Niranjan Molkeri` created SPARK-14692: - Summary: Error While Setting the path for R front end Key: SPARK-14692 URL: https://issues.apache.org/jira/browse/SPARK-14692 Project: Spark Issue

[jira] [Commented] (SPARK-13662) [SQL][Hive] Have SHOW TABLES return additional fields from Hive MetaStore

2016-04-17 Thread Vijay Parmar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245029#comment-15245029 ] Vijay Parmar commented on SPARK-13662: -- Hi Evan, I would like to look into the issu

[jira] [Assigned] (SPARK-14691) Simplify and Unify Error Generation for Unsupported Alter Table DDL

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14691: Assignee: (was: Apache Spark) > Simplify and Unify Error Generation for Unsupported Al

[jira] [Assigned] (SPARK-14691) Simplify and Unify Error Generation for Unsupported Alter Table DDL

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14691: Assignee: Apache Spark > Simplify and Unify Error Generation for Unsupported Alter Table D

[jira] [Commented] (SPARK-14691) Simplify and Unify Error Generation for Unsupported Alter Table DDL

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245028#comment-15245028 ] Apache Spark commented on SPARK-14691: -- User 'gatorsmile' has created a pull request

[jira] [Created] (SPARK-14691) Simplify and Unify Error Generation for Unsupported Alter Table DDL

2016-04-17 Thread Xiao Li (JIRA)
Xiao Li created SPARK-14691: --- Summary: Simplify and Unify Error Generation for Unsupported Alter Table DDL Key: SPARK-14691 URL: https://issues.apache.org/jira/browse/SPARK-14691 Project: Spark Is

[jira] [Commented] (SPARK-14325) some strange name conflicts in `group_by`

2016-04-17 Thread Vijay Parmar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245024#comment-15245024 ] Vijay Parmar commented on SPARK-14325: -- Hi Dmitriy, It has been a very short time I

[jira] [Commented] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245009#comment-15245009 ] Andrew Or commented on SPARK-14647: --- I've reverted it for now. > Group SQLContext/Hive

[jira] [Commented] (SPARK-14586) SparkSQL doesn't parse decimal like Hive

2016-04-17 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244986#comment-15244986 ] Stephane Maarek commented on SPARK-14586: - Hi [~tsuresh], thanks for your reply.

[jira] [Commented] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244984#comment-15244984 ] Apache Spark commented on SPARK-14642: -- User 'sbcd90' has created a pull request for

[jira] [Assigned] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14642: Assignee: Apache Spark > import org.apache.spark.sql.expressions._ breaks udf under functi

[jira] [Assigned] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14642: Assignee: (was: Apache Spark) > import org.apache.spark.sql.expressions._ breaks udf u

[jira] [Resolved] (SPARK-14632) randomSplit method fails on dataframes with maps in schema

2016-04-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14632. - Resolution: Fixed Assignee: Subhobrata Dey Fix Version/s: 2.0.0 > randomSplit met

[jira] [Commented] (SPARK-12922) Implement gapply() on DataFrame in SparkR

2016-04-17 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244918#comment-15244918 ] Narine Kokhlikyan commented on SPARK-12922: --- Hi [~sunrui], I’ve made some prog

[jira] [Commented] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions

2016-04-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244899#comment-15244899 ] Yin Huai commented on SPARK-14642: -- [~sbcd90] Yea sure. I am not very sure about the rig

[jira] [Commented] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions

2016-04-17 Thread Subhobrata Dey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244896#comment-15244896 ] Subhobrata Dey commented on SPARK-14642: Hello [~yhuai], I see that the issue get

[jira] [Commented] (SPARK-13904) Add support for pluggable cluster manager

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244882#comment-15244882 ] Apache Spark commented on SPARK-13904: -- User 'tedyu' has created a pull request for

[jira] [Commented] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244880#comment-15244880 ] Yin Huai commented on SPARK-14647: -- Let me check the code and see if there is any suspic

[jira] [Commented] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244879#comment-15244879 ] Yin Huai commented on SPARK-14647: -- Looking at the log, it seems that it took a long tim

[jira] [Commented] (SPARK-14686) Implement a non-inheritable localProperty facility

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244807#comment-15244807 ] Apache Spark commented on SPARK-14686: -- User 'marcintustin' has created a pull reque

[jira] [Assigned] (SPARK-14686) Implement a non-inheritable localProperty facility

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14686: Assignee: (was: Apache Spark) > Implement a non-inheritable localProperty facility > -

[jira] [Assigned] (SPARK-14686) Implement a non-inheritable localProperty facility

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14686: Assignee: Apache Spark > Implement a non-inheritable localProperty facility >

[jira] [Commented] (SPARK-13904) Add support for pluggable cluster manager

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244805#comment-15244805 ] Kazuaki Ishizaki commented on SPARK-13904: -- To merge this PR may have begun caus

[jira] [Issue Comment Deleted] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-14690: - Comment: was deleted (was: Add a link to the original JIRA) > [SQL] SPARK-8020 fails in

[jira] [Closed] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki closed SPARK-14690. Add a link to the original JIRA > [SQL] SPARK-8020 fails in Jenkins for master > -

[jira] [Commented] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244798#comment-15244798 ] Kazuaki Ishizaki commented on SPARK-14690: -- I see. I will reopen the original JI

[jira] [Resolved] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki resolved SPARK-14690. -- Resolution: Duplicate > [SQL] SPARK-8020 fails in Jenkins for master >

[jira] [Commented] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

2016-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244784#comment-15244784 ] Sean Owen commented on SPARK-14690: --- Same, please reopen the JIRA whose resolution you

[jira] [Reopened] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-14647: --- Pardon, does look like this may have begun causing test failures: https://amplab.cs.berkeley.edu/jenkins

[jira] [Resolved] (SPARK-14689) [SQL] SPARK-9757 fails in Jenkins for master

2016-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14689. --- Resolution: Duplicate I think it doesn't help to make a new JIRA for this, as it splits the thread of

[jira] [Updated] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-14690: - Summary: [SQL] SPARK-8020 fails in Jenkins for master (was: [SQL] SPARK-9757 fails in Je

[jira] [Created] (SPARK-14690) [SQL] SPARK-9757 fails in Jenkins for master

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-14690: Summary: [SQL] SPARK-9757 fails in Jenkins for master Key: SPARK-14690 URL: https://issues.apache.org/jira/browse/SPARK-14690 Project: Spark Issue Ty

[jira] [Created] (SPARK-14689) [SQL] SPARK-9757 fails in Jenkins for master

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-14689: Summary: [SQL] SPARK-9757 fails in Jenkins for master Key: SPARK-14689 URL: https://issues.apache.org/jira/browse/SPARK-14689 Project: Spark Issue Ty

[jira] [Commented] (SPARK-14688) pyspark textFileStream gzipped

2016-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244770#comment-15244770 ] Sean Owen commented on SPARK-14688: --- Please provide some detail? AFAIK it's just delega

[jira] [Created] (SPARK-14688) pyspark textFileStream gzipped

2016-04-17 Thread seth (JIRA)
seth created SPARK-14688: Summary: pyspark textFileStream gzipped Key: SPARK-14688 URL: https://issues.apache.org/jira/browse/SPARK-14688 Project: Spark Issue Type: Improvement Components:

[jira] [Assigned] (SPARK-14685) Properly document heritability of localProperties

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14685: Assignee: Apache Spark > Properly document heritability of localProperties > -

[jira] [Commented] (SPARK-14685) Properly document heritability of localProperties

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244692#comment-15244692 ] Apache Spark commented on SPARK-14685: -- User 'marcintustin' has created a pull reque

[jira] [Assigned] (SPARK-14685) Properly document heritability of localProperties

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14685: Assignee: (was: Apache Spark) > Properly document heritability of localProperties > --

[jira] [Commented] (SPARK-14343) Dataframe operations on a partitioned dataset (using partition discovery) return invalid results

2016-04-17 Thread Jurriaan Pruis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244669#comment-15244669 ] Jurriaan Pruis commented on SPARK-14343: On the spark 2.0.0 nightly build it does

[jira] [Updated] (SPARK-14343) Dataframe operations on a partitioned dataset (using partition discovery) return invalid results

2016-04-17 Thread Jurriaan Pruis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jurriaan Pruis updated SPARK-14343: --- Affects Version/s: 2.0.0 > Dataframe operations on a partitioned dataset (using partition dis

[jira] [Commented] (SPARK-13753) Column nullable is derived incorrectly

2016-04-17 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244640#comment-15244640 ] Takeshi Yamamuro commented on SPARK-13753: -- Could you also put the explain resul

[jira] [Commented] (SPARK-14635) Documentation and Examples for TF-IDF only refer to HashingTF

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244575#comment-15244575 ] Apache Spark commented on SPARK-14635: -- User 'hhbyyh' has created a pull request for

[jira] [Assigned] (SPARK-14635) Documentation and Examples for TF-IDF only refer to HashingTF

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14635: Assignee: Apache Spark > Documentation and Examples for TF-IDF only refer to HashingTF > -

[jira] [Assigned] (SPARK-14635) Documentation and Examples for TF-IDF only refer to HashingTF

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14635: Assignee: (was: Apache Spark) > Documentation and Examples for TF-IDF only refer to Ha

[jira] [Commented] (SPARK-14681) Provide label/impurity stats for spark.ml decision tree nodes

2016-04-17 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244574#comment-15244574 ] zhengruifeng commented on SPARK-14681: -- Will this stats be inclued in trainingSummar

[jira] [Assigned] (SPARK-14283) Avoid sort in randomSplit when possible

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14283: Assignee: Apache Spark > Avoid sort in randomSplit when possible > ---

[jira] [Commented] (SPARK-14283) Avoid sort in randomSplit when possible

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244571#comment-15244571 ] Apache Spark commented on SPARK-14283: -- User 'zhengruifeng' has created a pull reque

[jira] [Assigned] (SPARK-14283) Avoid sort in randomSplit when possible

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14283: Assignee: (was: Apache Spark) > Avoid sort in randomSplit when possible >

[jira] [Commented] (SPARK-14283) Avoid sort in randomSplit when possible

2016-04-17 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244568#comment-15244568 ] zhengruifeng commented on SPARK-14283: -- [~josephkb] I can work on this. There should

[jira] [Commented] (SPARK-13363) Aggregator not working with DataFrame

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244566#comment-15244566 ] Apache Spark commented on SPARK-13363: -- User 'cloud-fan' has created a pull request