[jira] [Commented] (SPARK-14453) Consider removing SPARK_JAVA_OPTS env variable

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245169#comment-15245169 ] Apache Spark commented on SPARK-14453: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14453) Consider removing SPARK_JAVA_OPTS env variable

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14453: Assignee: Apache Spark > Consider removing SPARK_JAVA_OPTS env variable >

[jira] [Assigned] (SPARK-14453) Consider removing SPARK_JAVA_OPTS env variable

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14453: Assignee: (was: Apache Spark) > Consider removing SPARK_JAVA_OPTS env variable >

[jira] [Commented] (SPARK-12810) PySpark CrossValidatorModel should support avgMetrics

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245152#comment-15245152 ] Apache Spark commented on SPARK-12810: -- User 'vectorijk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12810) PySpark CrossValidatorModel should support avgMetrics

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12810: Assignee: (was: Apache Spark) > PySpark CrossValidatorModel should support avgMetrics

[jira] [Commented] (SPARK-13662) [SQL][Hive] Have SHOW TABLES return additional fields from Hive MetaStore

2016-04-17 Thread Evan Chan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245129#comment-15245129 ] Evan Chan commented on SPARK-13662: --- Vijay, That would be awesome! Please go ahead. >

[jira] [Commented] (SPARK-13904) Add support for pluggable cluster manager

2016-04-17 Thread Hemant Bhanawat (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245118#comment-15245118 ] Hemant Bhanawat commented on SPARK-13904: - [~kiszk] I am looking into this. > Add support for

[jira] [Commented] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245109#comment-15245109 ] Apache Spark commented on SPARK-14647: -- User 'yhuai' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14647: Assignee: Andrew Or (was: Apache Spark) > Group SQLContext/HiveContext state into

[jira] [Assigned] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14647: Assignee: Apache Spark (was: Andrew Or) > Group SQLContext/HiveContext state into

[jira] [Commented] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245100#comment-15245100 ] Yin Huai commented on SPARK-14647: -- Seems that test still timed out after we reverted the commit

[jira] [Updated] (SPARK-14695) Error occurs when using OFF_HEAP persistent level

2016-04-17 Thread Liang Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Lee updated SPARK-14695: -- Description: When running a PageRank job through the default examples, e.g., the class

[jira] [Comment Edited] (SPARK-14409) Investigate adding a RankingEvaluator to ML

2016-04-17 Thread Yong Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245084#comment-15245084 ] Yong Tang edited comment on SPARK-14409 at 4/18/16 3:12 AM: Thanks [~mlnick]

[jira] [Commented] (SPARK-14409) Investigate adding a RankingEvaluator to ML

2016-04-17 Thread Yong Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245084#comment-15245084 ] Yong Tang commented on SPARK-14409: --- Thanks [~mlnick] for the references. I will take a look at those

[jira] [Commented] (SPARK-14695) Error occurs when using OFF_HEAP persistent level

2016-04-17 Thread Liang Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245083#comment-15245083 ] Liang Lee commented on SPARK-14695: --- The cluster enviroment is like this: Totally 3 servers. One acts

[jira] [Commented] (SPARK-14628) Remove all the Options in TaskMetrics

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245079#comment-15245079 ] Apache Spark commented on SPARK-14628: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-14409) Investigate adding a RankingEvaluator to ML

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245077#comment-15245077 ] Apache Spark commented on SPARK-14409: -- User 'yongtang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14409) Investigate adding a RankingEvaluator to ML

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14409: Assignee: (was: Apache Spark) > Investigate adding a RankingEvaluator to ML >

[jira] [Assigned] (SPARK-14409) Investigate adding a RankingEvaluator to ML

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14409: Assignee: Apache Spark > Investigate adding a RankingEvaluator to ML >

[jira] [Created] (SPARK-14695) Error occurs when using OFF_HEAP persistent level

2016-04-17 Thread Liang Lee (JIRA)
Liang Lee created SPARK-14695: - Summary: Error occurs when using OFF_HEAP persistent level Key: SPARK-14695 URL: https://issues.apache.org/jira/browse/SPARK-14695 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-14694) Thrift Server + Hive Metastore + Kerberos doesn't work

2016-04-17 Thread zhangguancheng (JIRA)
zhangguancheng created SPARK-14694: -- Summary: Thrift Server + Hive Metastore + Kerberos doesn't work Key: SPARK-14694 URL: https://issues.apache.org/jira/browse/SPARK-14694 Project: Spark

[jira] [Updated] (SPARK-14693) Spark Streaming Context Hangs on Start

2016-04-17 Thread Evan Oman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Oman updated SPARK-14693: -- Description: All, I am trying to use Kinesis with Spark Streaming on Spark 1.6.0 via Databricks and

[jira] [Updated] (SPARK-14693) Spark Streaming Context Hangs on Start

2016-04-17 Thread Evan Oman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Oman updated SPARK-14693: -- Description: All, I am trying to use Kinesis with Spark Streaming on Spark 1.6.0 via Databricks and

[jira] [Updated] (SPARK-14693) Spark Streaming Context Hangs on Start

2016-04-17 Thread Evan Oman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Oman updated SPARK-14693: -- Description: All, I am trying to use Kinesis with Spark Streaming on Spark 1.6.0 via Databricks and

[jira] [Updated] (SPARK-14693) Spark Streaming Context Hangs on Start

2016-04-17 Thread Evan Oman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Oman updated SPARK-14693: -- Description: All, I am trying to use Kinesis with Spark Streaming on Spark 1.6.0 via Databricks and

[jira] [Assigned] (SPARK-14127) [Table related commands] Describe table

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14127: Assignee: Apache Spark > [Table related commands] Describe table >

[jira] [Assigned] (SPARK-14127) [Table related commands] Describe table

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14127: Assignee: (was: Apache Spark) > [Table related commands] Describe table >

[jira] [Commented] (SPARK-14127) [Table related commands] Describe table

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245069#comment-15245069 ] Apache Spark commented on SPARK-14127: -- User 'dilipbiswal' has created a pull request for this

[jira] [Created] (SPARK-14693) Spark Streaming Context Hangs on Start

2016-04-17 Thread Evan Oman (JIRA)
Evan Oman created SPARK-14693: - Summary: Spark Streaming Context Hangs on Start Key: SPARK-14693 URL: https://issues.apache.org/jira/browse/SPARK-14693 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14453) Consider removing SPARK_JAVA_OPTS env variable

2016-04-17 Thread Krishnan Narayan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245065#comment-15245065 ] Krishnan Narayan commented on SPARK-14453: -- +1 > Consider removing SPARK_JAVA_OPTS env

[jira] [Commented] (SPARK-14453) Consider removing SPARK_JAVA_OPTS env variable

2016-04-17 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245048#comment-15245048 ] Saisai Shao commented on SPARK-14453: - Yes, this should be a part of SPARK-12344. Since SPARK-12344

[jira] [Created] (SPARK-14692) Error While Setting the path for R front end

2016-04-17 Thread Niranjan Molkeri` (JIRA)
Niranjan Molkeri` created SPARK-14692: - Summary: Error While Setting the path for R front end Key: SPARK-14692 URL: https://issues.apache.org/jira/browse/SPARK-14692 Project: Spark Issue

[jira] [Commented] (SPARK-13662) [SQL][Hive] Have SHOW TABLES return additional fields from Hive MetaStore

2016-04-17 Thread Vijay Parmar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245029#comment-15245029 ] Vijay Parmar commented on SPARK-13662: -- Hi Evan, I would like to look into the issue. Let me know

[jira] [Assigned] (SPARK-14691) Simplify and Unify Error Generation for Unsupported Alter Table DDL

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14691: Assignee: (was: Apache Spark) > Simplify and Unify Error Generation for Unsupported

[jira] [Assigned] (SPARK-14691) Simplify and Unify Error Generation for Unsupported Alter Table DDL

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14691: Assignee: Apache Spark > Simplify and Unify Error Generation for Unsupported Alter Table

[jira] [Commented] (SPARK-14691) Simplify and Unify Error Generation for Unsupported Alter Table DDL

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245028#comment-15245028 ] Apache Spark commented on SPARK-14691: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Created] (SPARK-14691) Simplify and Unify Error Generation for Unsupported Alter Table DDL

2016-04-17 Thread Xiao Li (JIRA)
Xiao Li created SPARK-14691: --- Summary: Simplify and Unify Error Generation for Unsupported Alter Table DDL Key: SPARK-14691 URL: https://issues.apache.org/jira/browse/SPARK-14691 Project: Spark

[jira] [Commented] (SPARK-14325) some strange name conflicts in `group_by`

2016-04-17 Thread Vijay Parmar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245024#comment-15245024 ] Vijay Parmar commented on SPARK-14325: -- Hi Dmitriy, It has been a very short time I joined the

[jira] [Commented] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245009#comment-15245009 ] Andrew Or commented on SPARK-14647: --- I've reverted it for now. > Group SQLContext/HiveContext state

[jira] [Commented] (SPARK-14586) SparkSQL doesn't parse decimal like Hive

2016-04-17 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244986#comment-15244986 ] Stephane Maarek commented on SPARK-14586: - Hi [~tsuresh], thanks for your reply. It makes sense!

[jira] [Commented] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244984#comment-15244984 ] Apache Spark commented on SPARK-14642: -- User 'sbcd90' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14642: Assignee: Apache Spark > import org.apache.spark.sql.expressions._ breaks udf under

[jira] [Assigned] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14642: Assignee: (was: Apache Spark) > import org.apache.spark.sql.expressions._ breaks udf

[jira] [Resolved] (SPARK-14632) randomSplit method fails on dataframes with maps in schema

2016-04-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14632. - Resolution: Fixed Assignee: Subhobrata Dey Fix Version/s: 2.0.0 > randomSplit

[jira] [Commented] (SPARK-12922) Implement gapply() on DataFrame in SparkR

2016-04-17 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244918#comment-15244918 ] Narine Kokhlikyan commented on SPARK-12922: --- Hi [~sunrui], I’ve made some progress in putting

[jira] [Commented] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions

2016-04-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244899#comment-15244899 ] Yin Huai commented on SPARK-14642: -- [~sbcd90] Yea sure. I am not very sure about the right solution.

[jira] [Commented] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions

2016-04-17 Thread Subhobrata Dey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244896#comment-15244896 ] Subhobrata Dey commented on SPARK-14642: Hello [~yhuai], I see that the issue gets resolved when

[jira] [Commented] (SPARK-13904) Add support for pluggable cluster manager

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244882#comment-15244882 ] Apache Spark commented on SPARK-13904: -- User 'tedyu' has created a pull request for this issue:

[jira] [Commented] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244880#comment-15244880 ] Yin Huai commented on SPARK-14647: -- Let me check the code and see if there is any suspicious place. >

[jira] [Commented] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244879#comment-15244879 ] Yin Huai commented on SPARK-14647: -- Looking at the log, it seems that it took a long time to resolve

[jira] [Commented] (SPARK-14686) Implement a non-inheritable localProperty facility

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244807#comment-15244807 ] Apache Spark commented on SPARK-14686: -- User 'marcintustin' has created a pull request for this

[jira] [Assigned] (SPARK-14686) Implement a non-inheritable localProperty facility

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14686: Assignee: (was: Apache Spark) > Implement a non-inheritable localProperty facility >

[jira] [Assigned] (SPARK-14686) Implement a non-inheritable localProperty facility

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14686: Assignee: Apache Spark > Implement a non-inheritable localProperty facility >

[jira] [Commented] (SPARK-13904) Add support for pluggable cluster manager

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244805#comment-15244805 ] Kazuaki Ishizaki commented on SPARK-13904: -- To merge this PR may have begun causing test

[jira] [Issue Comment Deleted] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-14690: - Comment: was deleted (was: Add a link to the original JIRA) > [SQL] SPARK-8020 fails in

[jira] [Closed] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki closed SPARK-14690. Add a link to the original JIRA > [SQL] SPARK-8020 fails in Jenkins for master >

[jira] [Commented] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244798#comment-15244798 ] Kazuaki Ishizaki commented on SPARK-14690: -- I see. I will reopen the original JIRA soon. >

[jira] [Resolved] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki resolved SPARK-14690. -- Resolution: Duplicate > [SQL] SPARK-8020 fails in Jenkins for master >

[jira] [Commented] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

2016-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244784#comment-15244784 ] Sean Owen commented on SPARK-14690: --- Same, please reopen the JIRA whose resolution you believe caused

[jira] [Reopened] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

2016-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-14647: --- Pardon, does look like this may have begun causing test failures:

[jira] [Resolved] (SPARK-14689) [SQL] SPARK-9757 fails in Jenkins for master

2016-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14689. --- Resolution: Duplicate I think it doesn't help to make a new JIRA for this, as it splits the thread

[jira] [Updated] (SPARK-14690) [SQL] SPARK-8020 fails in Jenkins for master

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-14690: - Summary: [SQL] SPARK-8020 fails in Jenkins for master (was: [SQL] SPARK-9757 fails in

[jira] [Created] (SPARK-14690) [SQL] SPARK-9757 fails in Jenkins for master

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-14690: Summary: [SQL] SPARK-9757 fails in Jenkins for master Key: SPARK-14690 URL: https://issues.apache.org/jira/browse/SPARK-14690 Project: Spark Issue

[jira] [Created] (SPARK-14689) [SQL] SPARK-9757 fails in Jenkins for master

2016-04-17 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-14689: Summary: [SQL] SPARK-9757 fails in Jenkins for master Key: SPARK-14689 URL: https://issues.apache.org/jira/browse/SPARK-14689 Project: Spark Issue

[jira] [Commented] (SPARK-14688) pyspark textFileStream gzipped

2016-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244770#comment-15244770 ] Sean Owen commented on SPARK-14688: --- Please provide some detail? AFAIK it's just delegating to the same

[jira] [Created] (SPARK-14688) pyspark textFileStream gzipped

2016-04-17 Thread seth (JIRA)
seth created SPARK-14688: Summary: pyspark textFileStream gzipped Key: SPARK-14688 URL: https://issues.apache.org/jira/browse/SPARK-14688 Project: Spark Issue Type: Improvement Components:

[jira] [Assigned] (SPARK-14685) Properly document heritability of localProperties

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14685: Assignee: Apache Spark > Properly document heritability of localProperties >

[jira] [Commented] (SPARK-14685) Properly document heritability of localProperties

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244692#comment-15244692 ] Apache Spark commented on SPARK-14685: -- User 'marcintustin' has created a pull request for this

[jira] [Assigned] (SPARK-14685) Properly document heritability of localProperties

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14685: Assignee: (was: Apache Spark) > Properly document heritability of localProperties >

[jira] [Commented] (SPARK-14343) Dataframe operations on a partitioned dataset (using partition discovery) return invalid results

2016-04-17 Thread Jurriaan Pruis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244669#comment-15244669 ] Jurriaan Pruis commented on SPARK-14343: On the spark 2.0.0 nightly build it doesn't work at all:

[jira] [Updated] (SPARK-14343) Dataframe operations on a partitioned dataset (using partition discovery) return invalid results

2016-04-17 Thread Jurriaan Pruis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jurriaan Pruis updated SPARK-14343: --- Affects Version/s: 2.0.0 > Dataframe operations on a partitioned dataset (using partition

[jira] [Commented] (SPARK-13753) Column nullable is derived incorrectly

2016-04-17 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244640#comment-15244640 ] Takeshi Yamamuro commented on SPARK-13753: -- Could you also put the explain result of your query?

[jira] [Commented] (SPARK-14635) Documentation and Examples for TF-IDF only refer to HashingTF

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244575#comment-15244575 ] Apache Spark commented on SPARK-14635: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14635) Documentation and Examples for TF-IDF only refer to HashingTF

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14635: Assignee: Apache Spark > Documentation and Examples for TF-IDF only refer to HashingTF >

[jira] [Assigned] (SPARK-14635) Documentation and Examples for TF-IDF only refer to HashingTF

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14635: Assignee: (was: Apache Spark) > Documentation and Examples for TF-IDF only refer to

[jira] [Commented] (SPARK-14681) Provide label/impurity stats for spark.ml decision tree nodes

2016-04-17 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244574#comment-15244574 ] zhengruifeng commented on SPARK-14681: -- Will this stats be inclued in trainingSummary or

[jira] [Assigned] (SPARK-14283) Avoid sort in randomSplit when possible

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14283: Assignee: Apache Spark > Avoid sort in randomSplit when possible >

[jira] [Commented] (SPARK-14283) Avoid sort in randomSplit when possible

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244571#comment-15244571 ] Apache Spark commented on SPARK-14283: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-14283) Avoid sort in randomSplit when possible

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14283: Assignee: (was: Apache Spark) > Avoid sort in randomSplit when possible >

[jira] [Commented] (SPARK-14283) Avoid sort in randomSplit when possible

2016-04-17 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244568#comment-15244568 ] zhengruifeng commented on SPARK-14283: -- [~josephkb] I can work on this. There should be a version of

[jira] [Commented] (SPARK-13363) Aggregator not working with DataFrame

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244566#comment-15244566 ] Apache Spark commented on SPARK-13363: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-14687) Call path.getFileSystem(conf) instead of call FileSystem.get(conf)

2016-04-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244560#comment-15244560 ] Reynold Xin commented on SPARK-14687: - Can you explain the problems? > Call

[jira] [Commented] (SPARK-14687) Call path.getFileSystem(conf) instead of call FileSystem.get(conf)

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244557#comment-15244557 ] Apache Spark commented on SPARK-14687: -- User 'lw-lin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14687) Call path.getFileSystem(conf) instead of call FileSystem.get(conf)

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14687: Assignee: Apache Spark > Call path.getFileSystem(conf) instead of call

[jira] [Assigned] (SPARK-14687) Call path.getFileSystem(conf) instead of call FileSystem.get(conf)

2016-04-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14687: Assignee: (was: Apache Spark) > Call path.getFileSystem(conf) instead of call

[jira] [Created] (SPARK-14687) Call path.getFileSystem(conf) instead of call FileSystem.get(conf)

2016-04-17 Thread Liwei Lin (JIRA)
Liwei Lin created SPARK-14687: - Summary: Call path.getFileSystem(conf) instead of call FileSystem.get(conf) Key: SPARK-14687 URL: https://issues.apache.org/jira/browse/SPARK-14687 Project: Spark

[jira] [Comment Edited] (SPARK-14682) Provide evaluateEachIteration method or equivalent for spark.ml GBTs

2016-04-17 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244555#comment-15244555 ] zhengruifeng edited comment on SPARK-14682 at 4/17/16 6:30 AM: --- [~josephkb]

[jira] [Commented] (SPARK-14682) Provide evaluateEachIteration method or equivalent for spark.ml GBTs

2016-04-17 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244555#comment-15244555 ] zhengruifeng commented on SPARK-14682: -- [~josephkb] It is ml.tree.impl.GradientBoostedTrees not