[jira] [Commented] (SPARK-6428) Add to style checker public method must have explicit type defined

2015-03-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374825#comment-14374825 ] Apache Spark commented on SPARK-6428: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-6452) CheckAnalysis should throw when analyzed plan contains unresolved node(s)

2015-03-22 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-6452: - Summary: CheckAnalysis should throw when analyzed plan contains unresolved node(s) Key: SPARK-6452 URL: https://issues.apache.org/jira/browse/SPARK-6452 Project: Spark

[jira] [Commented] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374838#comment-14374838 ] Cheng Lian commented on SPARK-6444: --- Another valid fix for this issue is simply

[jira] [Commented] (SPARK-6454) Fix several broken links in PySpark docs

2015-03-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374919#comment-14374919 ] Apache Spark commented on SPARK-6454: - User 'kamilsmuga' has created a pull request

[jira] [Commented] (SPARK-5320) Joins on simple table created using select gives error

2015-03-22 Thread Yuri Saito (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374832#comment-14374832 ] Yuri Saito commented on SPARK-5320: --- Thank you very much Michael Armbrust. Could you

[jira] [Created] (SPARK-6454) Fix several broken links in PySpark docs

2015-03-22 Thread Sean Owen (JIRA)
Sean Owen created SPARK-6454: Summary: Fix several broken links in PySpark docs Key: SPARK-6454 URL: https://issues.apache.org/jira/browse/SPARK-6454 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6444) Sum expression should remain unresolved if the data type isn't a numeric type

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374831#comment-14374831 ] Cheng Lian commented on SPARK-6444: --- This issue also exposes another issue in the

[jira] [Updated] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6444: -- Description: SQL functions should remain unresolved if their arguments don't satisfy their argument

[jira] [Updated] (SPARK-6454) Fix several broken links in PySpark docs

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6454: - Assignee: Kamil Smuga (was: Sean Owen) Fix several broken links in PySpark docs

[jira] [Assigned] (SPARK-6454) Fix several broken links in PySpark docs

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-6454: Assignee: Sean Owen Fix several broken links in PySpark docs

[jira] [Commented] (SPARK-6452) CheckAnalysis should throw when the Aggregate node contains missing input attribute(s)

2015-03-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374945#comment-14374945 ] Apache Spark commented on SPARK-6452: - User 'liancheng' has created a pull request for

[jira] [Updated] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6444: -- Description: SQL functions should remain unresolved if their arguments don't satisfy their argument

[jira] [Updated] (SPARK-6452) CheckAnalysis should throw when the plan contains node(s) with missing input attribute(s)

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6452: -- Summary: CheckAnalysis should throw when the plan contains node(s) with missing input attribute(s)

[jira] [Updated] (SPARK-6452) CheckAnalysis should throw when the plan contains node(s) missing input attribute(s)

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6452: -- Description: Please refer to SPARK-6444 for reproduction steps. The top {{Aggregate}} node in the

[jira] [Updated] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6444: -- Description: SQL functions should remain unresolved if their arguments don't satisfy their argument

[jira] [Commented] (SPARK-3266) JavaDoubleRDD doesn't contain max()

2015-03-22 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374859#comment-14374859 ] Jacek Lewandowski commented on SPARK-3266: -- [~joshrosen] it would be awesome to

[jira] [Commented] (SPARK-6455) Correct some mistakes and typos

2015-03-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374929#comment-14374929 ] Apache Spark commented on SPARK-6455: - User 'yuhc' has created a pull request for this

[jira] [Updated] (SPARK-6455) Correct some mistakes and typos

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6455: - Priority: Trivial (was: Minor) Affects Version/s: (was: 1.4.0)

[jira] [Commented] (SPARK-6449) Driver OOM results in reported application result SUCCESS

2015-03-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374827#comment-14374827 ] Reynold Xin commented on SPARK-6449: Ryan - do you want to submit a pull request for

[jira] [Commented] (SPARK-6448) History server doesn't log exception when failing to replay log file

2015-03-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374887#comment-14374887 ] Apache Spark commented on SPARK-6448: - User 'ryan-williams' has created a pull request

[jira] [Resolved] (SPARK-6448) History server doesn't log exception when failing to replay log file

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6448. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5122

[jira] [Updated] (SPARK-6448) History server doesn't log exception when failing to replay log file

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6448: - Priority: Trivial (was: Major) Assignee: Ryan Williams History server doesn't log exception when

[jira] [Updated] (SPARK-6406) Launcher backward compatibility issues

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6406: - Priority: Minor (was: Blocker) Issue Type: Improvement (was: Bug) Per PR discussion I think we

[jira] [Commented] (SPARK-6453) Some Mesos*Suite have a different package with their classes

2015-03-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374855#comment-14374855 ] Apache Spark commented on SPARK-6453: - User 'jongyoul' has created a pull request for

[jira] [Updated] (SPARK-6453) Some Mesos*Suite have a different package with their classes

2015-03-22 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-6453: Component/s: Mesos Some Mesos*Suite have a different package with their classes

[jira] [Updated] (SPARK-6453) Some Mesos*Suite have a different package with their classes

2015-03-22 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-6453: Fix Version/s: 1.4.0 1.3.1 Some Mesos*Suite have a different package with their

[jira] [Updated] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6444: -- Assignee: (was: Cheng Lian) SQL functions (either built-in or UDF) should check for data types of

[jira] [Updated] (SPARK-6452) CheckAnalysis should throw when the Aggregate node contains missing input attribute(s)

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6452: -- Summary: CheckAnalysis should throw when the Aggregate node contains missing input attribute(s) (was:

[jira] [Updated] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6444: -- Summary: SQL functions (either built-in or UDF) should check for data types of their arguments (was:

[jira] [Commented] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374872#comment-14374872 ] Apache Spark commented on SPARK-6444: - User 'liancheng' has created a pull request for

[jira] [Updated] (SPARK-6452) CheckAnalysis should throw when the plan contains node(s) missing input attribute(s)

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6452: -- Summary: CheckAnalysis should throw when the plan contains node(s) missing input attribute(s) (was:

[jira] [Updated] (SPARK-6132) Context cleaner race condition across SparkContexts

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6132: - Labels: (was: backport-needed) Context cleaner race condition across SparkContexts

[jira] [Resolved] (SPARK-6132) Context cleaner race condition across SparkContexts

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6132. -- Resolution: Fixed Fix Version/s: 1.2.2 1.1.2 Context cleaner race condition

[jira] [Created] (SPARK-6455) Correct some mistakes and typos

2015-03-22 Thread Hangchen Yu (JIRA)
Hangchen Yu created SPARK-6455: -- Summary: Correct some mistakes and typos Key: SPARK-6455 URL: https://issues.apache.org/jira/browse/SPARK-6455 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-6453) Some Mesos*Suite have a different package with their classes

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6453: - Assignee: Jongyoul Lee Issue Type: Improvement (was: Bug) Some Mesos*Suite have a different

[jira] [Resolved] (SPARK-6454) Fix several broken links in PySpark docs

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6454. -- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Resolved] (SPARK-6455) Correct some mistakes and typos

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6455. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5128

[jira] [Resolved] (SPARK-6453) Some Mesos*Suite have a different package with their classes

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6453. -- Resolution: Fixed Fix Version/s: (was: 1.3.1) Issue resolved by pull request 5126

[jira] [Updated] (SPARK-6457) Error when calling Pyspark RandomForestModel.load

2015-03-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6457: - Description: Reported by [https://github.com/catmonkeylee]: Summary: PySpark

[jira] [Resolved] (SPARK-6335) REPL :reset command also removes refs to SparkContext and SQLContext

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6335. -- Resolution: Won't Fix Yes, I think it's a decent suggestion but agree with Patrick that the least

[jira] [Commented] (SPARK-6457) Error when calling Pyspark RandomForestModel.load

2015-03-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375072#comment-14375072 ] Joseph K. Bradley commented on SPARK-6457: -- I tried to reproduce this error

[jira] [Created] (SPARK-6456) Spark Sql throwing exception on large partitioned data

2015-03-22 Thread pankaj (JIRA)
pankaj created SPARK-6456: - Summary: Spark Sql throwing exception on large partitioned data Key: SPARK-6456 URL: https://issues.apache.org/jira/browse/SPARK-6456 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-6457) Error when calling Pyspark RandomForestModel.load

2015-03-22 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-6457: Summary: Error when calling Pyspark RandomForestModel.load Key: SPARK-6457 URL: https://issues.apache.org/jira/browse/SPARK-6457 Project: Spark

[jira] [Commented] (SPARK-6457) Error when calling Pyspark RandomForestModel.load

2015-03-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375079#comment-14375079 ] Joseph K. Bradley commented on SPARK-6457: -- To catmonkeylee: Can you try

[jira] [Created] (SPARK-6458) Bad error message for invalid data sources

2015-03-22 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-6458: --- Summary: Bad error message for invalid data sources Key: SPARK-6458 URL: https://issues.apache.org/jira/browse/SPARK-6458 Project: Spark Issue Type:

[jira] [Commented] (SPARK-6231) Join on two tables (generated from same one) is broken

2015-03-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375130#comment-14375130 ] Michael Armbrust commented on SPARK-6231: - After a bunch of investigation I'm

[jira] [Updated] (SPARK-6231) Join on two tables (generated from same one) is broken

2015-03-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6231: Target Version/s: 1.4.0 (was: 1.3.1) Join on two tables (generated from same one) is

[jira] [Commented] (SPARK-5368) Spark should support NAT (via akka improvements)

2015-03-22 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375157#comment-14375157 ] Matthew Farrellee commented on SPARK-5368: -- [~srowen] i was able to workaround my

[jira] [Commented] (SPARK-5368) Spark should support NAT (via akka improvements)

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375166#comment-14375166 ] Sean Owen commented on SPARK-5368: -- Sure [~jayunit100] or [~farrellee] would like to

[jira] [Updated] (SPARK-6337) Spark 1.3 doc fixes

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6337: - Assignee: Vinod KC Spark 1.3 doc fixes --- Key: SPARK-6337

[jira] [Updated] (SPARK-6376) Subqueries are thrown away too early in dataframes

2015-03-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6376: Summary: Subqueries are thrown away too early in dataframes (was: Relation are thrown away

[jira] [Commented] (SPARK-4941) Yarn cluster mode does not upload all needed jars to driver node (Spark 1.2.0)

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375162#comment-14375162 ] Sean Owen commented on SPARK-4941: -- I tried a simplified version of this with

[jira] [Commented] (SPARK-4941) Yarn cluster mode does not upload all needed jars to driver node (Spark 1.2.0)

2015-03-22 Thread Gurpreet Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375165#comment-14375165 ] Gurpreet Singh commented on SPARK-4941: --- Thanks Sean !!! Will check again on my end

[jira] [Updated] (SPARK-6456) Spark Sql throwing exception on large partitioned data

2015-03-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6456: Description: Observation: Spark connects with hive Metastore. i am able to run simple

[jira] [Commented] (SPARK-6456) Spark Sql throwing exception on large partitioned data

2015-03-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375119#comment-14375119 ] Michael Armbrust commented on SPARK-6456: - Do you have the logs from the

[jira] [Commented] (SPARK-5113) Audit and document use of hostnames and IP addresses in Spark

2015-03-22 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375158#comment-14375158 ] Matthew Farrellee commented on SPARK-5113: -- [~pwendell] would

[jira] [Updated] (SPARK-5033) Spark 1.1.0/1.1.1/1.2.0 can't run well in HDP on Windows

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5033: - Component/s: Windows Spark 1.1.0/1.1.1/1.2.0 can't run well in HDP on Windows

[jira] [Updated] (SPARK-5034) Spark on Yarn within HDInsight on Windows

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5034: - Component/s: Windows Spark on Yarn within HDInsight on Windows

[jira] [Created] (SPARK-6459) Warn when Column API is constructing trivially true equality

2015-03-22 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-6459: --- Summary: Warn when Column API is constructing trivially true equality Key: SPARK-6459 URL: https://issues.apache.org/jira/browse/SPARK-6459 Project: Spark

[jira] [Commented] (SPARK-6450) Self joining query failure

2015-03-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375129#comment-14375129 ] Michael Armbrust commented on SPARK-6450: - [~lian cheng] I think we are failing to

[jira] [Resolved] (SPARK-6122) Upgrade Tachyon dependency to 0.6.0

2015-03-22 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-6122. --- Resolution: Fixed Upgrade Tachyon dependency to 0.6.0 ---

[jira] [Resolved] (SPARK-6337) Spark 1.3 doc fixes

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6337. -- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Commented] (SPARK-5368) Spark should support NAT (via akka improvements)

2015-03-22 Thread jay vyas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375163#comment-14375163 ] jay vyas commented on SPARK-5368: - Okay, to close *optionally* with the close someone

[jira] [Commented] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

2015-03-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375164#comment-14375164 ] Sean Owen commented on SPARK-6435: -- I tried a simplified version of this with

[jira] [Comment Edited] (SPARK-5368) Spark should support NAT (via akka improvements)

2015-03-22 Thread jay vyas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375163#comment-14375163 ] jay vyas edited comment on SPARK-5368 at 3/22/15 8:58 PM: -- Okay,

[jira] [Updated] (SPARK-6367) Use the proper data type for those expressions that are hijacking existing data types.

2015-03-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6367: Target Version/s: 1.4.0 (was: 1.3.1) Use the proper data type for those expressions that

[jira] [Updated] (SPARK-6231) Join on two tables (generated from same one) is broken

2015-03-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6231: Priority: Critical (was: Blocker) Join on two tables (generated from same one) is broken

[jira] [Updated] (SPARK-6368) Build a specialized serializer for Exchange operator.

2015-03-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6368: Target Version/s: 1.4.0 (was: 1.3.1) Build a specialized serializer for Exchange

[jira] [Resolved] (SPARK-6408) JDBCRDD fails on where clause with string literal

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6408. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Created] (SPARK-6453) Some Mesos*Suite have a different package with their classes

2015-03-22 Thread Jongyoul Lee (JIRA)
Jongyoul Lee created SPARK-6453: --- Summary: Some Mesos*Suite have a different package with their classes Key: SPARK-6453 URL: https://issues.apache.org/jira/browse/SPARK-6453 Project: Spark

[jira] [Commented] (SPARK-6444) SQL functions (either built-in or UDF) should check for data types of their arguments

2015-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374878#comment-14374878 ] Cheng Lian commented on SPARK-6444: --- This PR contains the quick fix I mentioned above. I

[jira] [Updated] (SPARK-6449) Driver OOM results in reported application result SUCCESS

2015-03-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6449: --- Component/s: (was: Spark Core) YARN Driver OOM results in reported

[jira] [Updated] (SPARK-6456) Spark Sql throwing exception on large partitioned data

2015-03-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6456: --- Component/s: (was: Spark Core) Spark Sql throwing exception on large partitioned data

[jira] [Resolved] (SPARK-2858) Default log4j configuration no longer seems to work

2015-03-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2858. Resolution: Invalid This is really old and I don't think it still an issue. I'm just

[jira] [Commented] (SPARK-5863) Improve performance of convertToScala codepath.

2015-03-22 Thread Cristian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375243#comment-14375243 ] Cristian commented on SPARK-5863: - I'm a bit confused. The original jira refers to a very

[jira] [Commented] (SPARK-6373) Add SSL/TLS for the Netty based BlockTransferService

2015-03-22 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375186#comment-14375186 ] Aaron Davidson commented on SPARK-6373: --- Thanks for taking a look at this. The API

[jira] [Commented] (SPARK-5863) Improve performance of convertToScala codepath.

2015-03-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375229#comment-14375229 ] Patrick Wendell commented on SPARK-5863: This seems worth potentially fixing in

[jira] [Updated] (SPARK-5863) Improve performance of convertToScala codepath.

2015-03-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5863: --- Target Version/s: 1.3.1, 1.4.0 (was: 1.4.0) Improve performance of convertToScala codepath.

[jira] [Updated] (SPARK-4227) Document external shuffle service

2015-03-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4227: --- Priority: Critical (was: Major) Document external shuffle service

[jira] [Updated] (SPARK-4227) Document external shuffle service

2015-03-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4227: --- Target Version/s: 1.3.1, 1.4.0 (was: 1.3.0, 1.4.0) Document external shuffle service

[jira] [Commented] (SPARK-6449) Driver OOM results in reported application result SUCCESS

2015-03-22 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375244#comment-14375244 ] Ryan Williams commented on SPARK-6449: -- Hey [~rxin] yea I have some code that I

[jira] [Comment Edited] (SPARK-5682) Add encrypted shuffle in spark

2015-03-22 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370631#comment-14370631 ] liyunzhang_intel edited comment on SPARK-5682 at 3/23/15 1:31 AM:

[jira] [Updated] (SPARK-6409) It is not necessary that avoid old inteface of hive because this will make some UDAF can not work.

2015-03-22 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-6409: -- Summary: It is not necessary that avoid old inteface of hive because this will make some UDAF can not

[jira] [Updated] (SPARK-6409) It is not necessary that avoid old inteface of hive that will make some UDAF can not work.

2015-03-22 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-6409: -- Summary: It is not necessary that avoid old inteface of hive that will make some UDAF can not work.

[jira] [Updated] (SPARK-6409) It is not necessary that avoid old inteface of hive, because this will make some UDAF can not work.

2015-03-22 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-6409: -- Summary: It is not necessary that avoid old inteface of hive, because this will make some UDAF can not

[jira] [Commented] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-03-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375273#comment-14375273 ] Apache Spark commented on SPARK-6049: - User 'DoingDone9' has created a pull request

[jira] [Commented] (SPARK-6409) It is not necessary that avoid old inteface of hive, because this will make some UDAF can not work.

2015-03-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375274#comment-14375274 ] Apache Spark commented on SPARK-6409: - User 'DoingDone9' has created a pull request

[jira] [Commented] (SPARK-6430) Cannot resolve column correctlly when using left semi join

2015-03-22 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375283#comment-14375283 ] zzc commented on SPARK-6430: Thanks, [~marmbrus] Cannot resolve column correctlly when using

[jira] [Commented] (SPARK-5004) PySpark does not handle SOCKS proxy

2015-03-22 Thread Eric O. LEBIGOT (EOL) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375286#comment-14375286 ] Eric O. LEBIGOT (EOL) commented on SPARK-5004: -- Yeah, a patch would be great.

[jira] [Updated] (SPARK-5004) PySpark does not handle SOCKS proxy

2015-03-22 Thread Eric O. LEBIGOT (EOL) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric O. LEBIGOT (EOL) updated SPARK-5004: - Affects Version/s: 1.3.0 PySpark does not handle SOCKS proxy

[jira] [Commented] (SPARK-6457) Error when calling Pyspark RandomForestModel.load

2015-03-22 Thread lee.xiaobo.2006 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375295#comment-14375295 ] lee.xiaobo.2006 commented on SPARK-6457: Thanks Joseph K. Bradley, I change the

[jira] [Commented] (SPARK-6457) Error when calling Pyspark RandomForestModel.load

2015-03-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375298#comment-14375298 ] Joseph K. Bradley commented on SPARK-6457: -- [~lee.xiaobo] Thanks! I'm glad you

[jira] [Resolved] (SPARK-6457) Error when calling Pyspark RandomForestModel.load

2015-03-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-6457. -- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Fixed by

[jira] [Commented] (SPARK-5004) PySpark does not handle SOCKS proxy

2015-03-22 Thread Eric O. LEBIGOT (EOL) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375312#comment-14375312 ] Eric O. LEBIGOT (EOL) commented on SPARK-5004: -- I did some more

[jira] [Comment Edited] (SPARK-5004) PySpark does not handle SOCKS proxy

2015-03-22 Thread Eric O. LEBIGOT (EOL) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375312#comment-14375312 ] Eric O. LEBIGOT (EOL) edited comment on SPARK-5004 at 3/23/15 2:52 AM:

[jira] [Comment Edited] (SPARK-5004) PySpark does not handle SOCKS proxy

2015-03-22 Thread Eric O. LEBIGOT (EOL) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375312#comment-14375312 ] Eric O. LEBIGOT (EOL) edited comment on SPARK-5004 at 3/23/15 2:53 AM:

[jira] [Updated] (SPARK-6450) Self joining query failure

2015-03-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6450: Priority: Blocker (was: Critical) Self joining query failure --

[jira] [Updated] (SPARK-5863) Improve performance of convertToScala codepath.

2015-03-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5863: --- Target Version/s: 1.4.0 (was: 1.3.1, 1.4.0) Improve performance of convertToScala codepath.

[jira] [Updated] (SPARK-6012) Deadlock when asking for partitions from CoalescedRDD on top of a TakeOrdered operator

2015-03-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6012: --- Target Version/s: 1.4.0 (was: 1.3.1, 1.4.0) Deadlock when asking for partitions from

[jira] [Updated] (SPARK-6012) Deadlock when asking for partitions from CoalescedRDD on top of a TakeOrdered operator

2015-03-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6012: --- Target Version/s: 1.3.1, 1.4.0 (was: 1.4.0) Deadlock when asking for partitions from

  1   2   >