[jira] [Commented] (SPARK-11819) nice error message for missing encoder

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011158#comment-15011158 ] Apache Spark commented on SPARK-11819: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-11818) REPL ExecutorClassLoader cannot see any resources from parent class loader

2015-11-18 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011168#comment-15011168 ] Jungtaek Lim commented on SPARK-11818: -- Yes, assembly jar has HBase libs, and unzipped assembly jar

[jira] [Comment Edited] (SPARK-11818) REPL ExecutorClassLoader cannot see any resources from parent class loader

2015-11-18 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011202#comment-15011202 ] Jungtaek Lim edited comment on SPARK-11818 at 11/18/15 3:30 PM: One thing

[jira] [Commented] (SPARK-11818) REPL ExecutorClassLoader cannot see any resources from parent class loader

2015-11-18 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011202#comment-15011202 ] Jungtaek Lim commented on SPARK-11818: -- One thing to note is, if I remove "spark.repl.class.uri"

[jira] [Commented] (SPARK-11818) REPL ExecutorClassLoader cannot see any resources from parent class loader

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011216#comment-15011216 ] Apache Spark commented on SPARK-11818: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-11818) REPL ExecutorClassLoader cannot see any resources from parent class loader

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11818: Assignee: (was: Apache Spark) > REPL ExecutorClassLoader cannot see any resources

[jira] [Commented] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-11-18 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011210#comment-15011210 ] Stavros Kontopoulos commented on SPARK-11638: - Ok i tried to veirfy that but no result: On

[jira] [Commented] (SPARK-11818) ExecutorClassLoader cannot see any resources from parent class loader

2015-11-18 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011223#comment-15011223 ] Jungtaek Lim commented on SPARK-11818: -- Removed "REPL" from title since it could confuse us to

[jira] [Updated] (SPARK-11773) Implement collection functions in SparkR

2015-11-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11773: -- Assignee: Sun Rui > Implement collection functions in SparkR >

[jira] [Resolved] (SPARK-11773) Implement collection functions in SparkR

2015-11-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11773. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11195) Exception thrown on executor throws ClassNotFoundException on driver

2015-11-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11195: - Assignee: Hurshal Patel > Exception thrown on executor throws ClassNotFoundException on driver >

[jira] [Resolved] (SPARK-11195) Exception thrown on executor throws ClassNotFoundException on driver

2015-11-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11195. -- Resolution: Fixed Fix Version/s: 1.6.0 1.5.3 Issue resolved by pull request

[jira] [Assigned] (SPARK-11819) nice error message for missing encoder

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11819: Assignee: Apache Spark > nice error message for missing encoder >

[jira] [Updated] (SPARK-11818) ExecutorClassLoader cannot see any resources from parent class loader

2015-11-18 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-11818: - Summary: ExecutorClassLoader cannot see any resources from parent class loader (was: REPL

[jira] [Comment Edited] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-11-18 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011210#comment-15011210 ] Stavros Kontopoulos edited comment on SPARK-11638 at 11/18/15 3:44 PM:

[jira] [Resolved] (SPARK-11804) Exception raise when using Jdbc predicates option in PySpark

2015-11-18 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11804. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9791

[jira] [Resolved] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11281. --- Resolution: Fixed Assignee: Maciej Szymkiewicz Resolved by

[jira] [Commented] (SPARK-11189) History server is not able to parse some application report

2015-11-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011150#comment-15011150 ] Jean-Baptiste Onofré commented on SPARK-11189: -- OK, I know what's the problem: when the

[jira] [Commented] (SPARK-11820) PySpark LiR & LoR should support weightCol

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011172#comment-15011172 ] Apache Spark commented on SPARK-11820: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-11818) REPL ExecutorClassLoader cannot see any resources from parent class loader

2015-11-18 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011168#comment-15011168 ] Jungtaek Lim edited comment on SPARK-11818 at 11/18/15 3:18 PM: Yes,

[jira] [Assigned] (SPARK-11820) PySpark LiR & LoR should support weightCol

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11820: Assignee: Apache Spark > PySpark LiR & LoR should support weightCol >

[jira] [Commented] (SPARK-11792) SizeEstimator cannot provide a good size estimation of UnsafeHashedRelations

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011233#comment-15011233 ] Apache Spark commented on SPARK-11792: -- User 'yhuai' has created a pull request for this issue:

[jira] [Commented] (SPARK-11189) History server is not able to parse some application report

2015-11-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011142#comment-15011142 ] Jean-Baptiste Onofré commented on SPARK-11189: -- Let me try on 1.6.0-SNAPSHOT. I keep you

[jira] [Comment Edited] (SPARK-11818) REPL ExecutorClassLoader cannot see any resources from parent class loader

2015-11-18 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011168#comment-15011168 ] Jungtaek Lim edited comment on SPARK-11818 at 11/18/15 3:19 PM: Yes,

[jira] [Commented] (SPARK-11189) History server is not able to parse some application report

2015-11-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011171#comment-15011171 ] Jean-Baptiste Onofré commented on SPARK-11189: -- I confirm, it has been fixed by: {code}

[jira] [Commented] (SPARK-11782) Master Web UI should link to correct Application UI in cluster mode

2015-11-18 Thread Matthias Niehoff (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011192#comment-15011192 ] Matthias Niehoff commented on SPARK-11782: -- What I did: - started master on node 1 - started a

[jira] [Assigned] (SPARK-11820) PySpark LiR & LoR should support weightCol

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11820: Assignee: (was: Apache Spark) > PySpark LiR & LoR should support weightCol >

[jira] [Assigned] (SPARK-11818) REPL ExecutorClassLoader cannot see any resources from parent class loader

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11818: Assignee: Apache Spark > REPL ExecutorClassLoader cannot see any resources from parent

[jira] [Updated] (SPARK-11818) REPL ExecutorClassLoader cannot see any resources from parent class loader

2015-11-18 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-11818: - Affects Version/s: 1.4.1 > REPL ExecutorClassLoader cannot see any resources from parent class

[jira] [Assigned] (SPARK-11819) nice error message for missing encoder

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11819: Assignee: (was: Apache Spark) > nice error message for missing encoder >

[jira] [Resolved] (SPARK-11189) History server is not able to parse some application report

2015-11-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved SPARK-11189. -- Resolution: Cannot Reproduce > History server is not able to parse some

[jira] [Comment Edited] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-11-18 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011210#comment-15011210 ] Stavros Kontopoulos edited comment on SPARK-11638 at 11/18/15 3:39 PM:

[jira] [Commented] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

2015-11-18 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011339#comment-15011339 ] Iulian Dragos commented on SPARK-11327: --- [~abraithwaite] it's a valid question, but it's

[jira] [Updated] (SPARK-11818) REPL ExecutorClassLoader cannot see any resources from parent class loader

2015-11-18 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-11818: - Component/s: (was: Spark Core) Spark Shell > REPL ExecutorClassLoader

[jira] [Created] (SPARK-11819) nice error message for missing encoder

2015-11-18 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-11819: --- Summary: nice error message for missing encoder Key: SPARK-11819 URL: https://issues.apache.org/jira/browse/SPARK-11819 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-11820) PySpark LiR & LoR should support weightCol

2015-11-18 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11820: --- Summary: PySpark LiR & LoR should support weightCol Key: SPARK-11820 URL: https://issues.apache.org/jira/browse/SPARK-11820 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11189) History server is not able to parse some application report

2015-11-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011163#comment-15011163 ] Jean-Baptiste Onofré commented on SPARK-11189: -- I'm not able to reproduce it, so it looks OK

[jira] [Commented] (SPARK-11803) Dataset self join returns incorrect result

2015-11-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011193#comment-15011193 ] Xiao Li commented on SPARK-11803: - No problem. Actually, I have a couple of test cases. You can try it.

[jira] [Commented] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-11-18 Thread Radoslaw Gruchalski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011330#comment-15011330 ] Radoslaw Gruchalski commented on SPARK-11638: - Stavros, These are the immediate I can see:

[jira] [Updated] (SPARK-11804) Exception raise when using Jdbc predicates option in PySpark

2015-11-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11804: -- Assignee: Jeff Zhang > Exception raise when using Jdbc predicates option in PySpark >

[jira] [Resolved] (SPARK-11803) Dataset self join returns incorrect result

2015-11-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11803. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9806

[jira] [Updated] (SPARK-11803) Dataset self join returns incorrect result

2015-11-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11803: - Assignee: Wenchen Fan > Dataset self join returns incorrect result >

[jira] [Created] (SPARK-11822) Add docs for new Netty RPC configuration

2015-11-18 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-11822: Summary: Add docs for new Netty RPC configuration Key: SPARK-11822 URL: https://issues.apache.org/jira/browse/SPARK-11822 Project: Spark Issue Type:

[jira] [Updated] (SPARK-11821) Spark-Hive doesn't work with Kerberos in local mode

2015-11-18 Thread Wojciech Indyk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wojciech Indyk updated SPARK-11821: --- Description: There is an error between Spark-hive and Hive on a Hadoop cluster. I have found

[jira] [Updated] (SPARK-11725) Let UDF to handle null value

2015-11-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11725: - Assignee: Wenchen Fan > Let UDF to handle null value > > >

[jira] [Updated] (SPARK-11815) PySpark DecisionTreeClassifier & DecisionTreeRegressor should support setSeed

2015-11-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11815: -- Component/s: PySpark MLlib > PySpark DecisionTreeClassifier & DecisionTreeRegressor

[jira] [Updated] (SPARK-11817) insert of timestamp with factional seconds inserts a NULL

2015-11-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11817: -- Component/s: SQL > insert of timestamp with factional seconds inserts a NULL >

[jira] [Updated] (SPARK-11720) Handle edge cases when count = 0 or 1 for Stats function

2015-11-18 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-11720: -- Summary: Handle edge cases when count = 0 or 1 for Stats function (was: Return Double.NaN instead of

[jira] [Updated] (SPARK-11720) Handle edge cases when count = 0 or 1 for Stats function

2015-11-18 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-11720: -- Description: update the behavior of stats function when count =0 or 1 to make it in consistent across

[jira] [Commented] (SPARK-6790) Model export/import for spark.ml: LinearRegression

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011620#comment-15011620 ] Apache Spark commented on SPARK-6790: - User 'jkbradley' has created a pull request for this issue:

[jira] [Updated] (SPARK-11655) SparkLauncherBackendSuite leaks child processes

2015-11-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-11655: --- Attachment: stack.log > SparkLauncherBackendSuite leaks child processes >

[jira] [Resolved] (SPARK-11795) org.apache.spark.sql.AnalysisException: Can't extract value from a#12

2015-11-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11795. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9792

[jira] [Updated] (SPARK-11795) org.apache.spark.sql.AnalysisException: Can't extract value from a#12

2015-11-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11795: - Assignee: Wenchen Fan > org.apache.spark.sql.AnalysisException: Can't extract value from

[jira] [Resolved] (SPARK-11772) DataFrame.show() fails with non-ASCII strings

2015-11-18 Thread Greg Baker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Baker resolved SPARK-11772. Resolution: Not A Problem Problem is in printing in Python, not in .show() > DataFrame.show()

[jira] [Commented] (SPARK-11655) SparkLauncherBackendSuite leaks child processes

2015-11-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011671#comment-15011671 ] Marcelo Vanzin commented on SPARK-11655: That test doesn't use the launcher code, so it's most

[jira] [Commented] (SPARK-11655) SparkLauncherBackendSuite leaks child processes

2015-11-18 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011687#comment-15011687 ] shane knapp commented on SPARK-11655: - ah ok, good to know. i'll kill that process now, if it's

[jira] [Commented] (SPARK-11655) SparkLauncherBackendSuite leaks child processes

2015-11-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011700#comment-15011700 ] Marcelo Vanzin commented on SPARK-11655: yeah, it's fine. Also probably good to file a separate

[jira] [Resolved] (SPARK-11655) SparkLauncherBackendSuite leaks child processes

2015-11-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11655. Resolution: Fixed > SparkLauncherBackendSuite leaks child processes >

[jira] [Created] (SPARK-11821) Spark-Hive doesn't work with Kerberos in local mode

2015-11-18 Thread Wojciech Indyk (JIRA)
Wojciech Indyk created SPARK-11821: -- Summary: Spark-Hive doesn't work with Kerberos in local mode Key: SPARK-11821 URL: https://issues.apache.org/jira/browse/SPARK-11821 Project: Spark

[jira] [Updated] (SPARK-11725) Let UDF to handle null value

2015-11-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11725: - Labels: releasenotes (was: ) > Let UDF to handle null value >

[jira] [Resolved] (SPARK-11725) Let UDF to handle null value

2015-11-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11725. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9770

[jira] [Reopened] (SPARK-11655) SparkLauncherBackendSuite leaks child processes

2015-11-18 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp reopened SPARK-11655: - this is still happening, but nowhere nearly as much as before. the spark 1.6 SBT hadoop 2.0 build

[jira] [Commented] (SPARK-3877) The exit code of spark-submit is still 0 when an yarn application fails

2015-11-18 Thread sam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011690#comment-15011690 ] sam commented on SPARK-3877: Is this really fixed?? I'm getting this on 1.5.0 using EMR. [~tgraves]

[jira] [Commented] (SPARK-11655) SparkLauncherBackendSuite leaks child processes

2015-11-18 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011703#comment-15011703 ] shane knapp commented on SPARK-11655: - sounds good to me. you can re-close this bug and i'll open a

[jira] [Updated] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2015-11-18 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-11823: Attachment: stack.log > HiveThriftBinaryServerSuite tests timing out, leaves hanging processes >

[jira] [Updated] (SPARK-11812) pyspark reduceByKeyAndWindow does not handle unspecified invFunc (invFunc=None)

2015-11-18 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-11812: -- Shepherd: Shixiong(Ryan) Zhu > pyspark reduceByKeyAndWindow does not handle unspecified

[jira] [Created] (SPARK-11826) Subtract BlockMatrix

2015-11-18 Thread Ehsan Mohyedin Kermani (JIRA)
Ehsan Mohyedin Kermani created SPARK-11826: -- Summary: Subtract BlockMatrix Key: SPARK-11826 URL: https://issues.apache.org/jira/browse/SPARK-11826 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11288) Specify the return type for UDF in Scala

2015-11-18 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011855#comment-15011855 ] Jakob Odersky commented on SPARK-11288: --- Tell me if I'm missing the point, but you can also pass

[jira] [Commented] (SPARK-8352) Affixed table of contents, similar to Bootstrap 3 docs

2015-11-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011713#comment-15011713 ] Josh Rosen commented on SPARK-8352: --- If we move to Bootstrap 3, that should be done as its own separate

[jira] [Created] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2015-11-18 Thread shane knapp (JIRA)
shane knapp created SPARK-11823: --- Summary: HiveThriftBinaryServerSuite tests timing out, leaves hanging processes Key: SPARK-11823 URL: https://issues.apache.org/jira/browse/SPARK-11823 Project: Spark

[jira] [Created] (SPARK-11824) WebUI does not render descriptions with 'bad' HTML, throws console error

2015-11-18 Thread Andy Robb (JIRA)
Andy Robb created SPARK-11824: - Summary: WebUI does not render descriptions with 'bad' HTML, throws console error Key: SPARK-11824 URL: https://issues.apache.org/jira/browse/SPARK-11824 Project: Spark

[jira] [Created] (SPARK-11825) TransportContext's IdleStateHandler should be the first handler in the pipeline

2015-11-18 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-11825: -- Summary: TransportContext's IdleStateHandler should be the first handler in the pipeline Key: SPARK-11825 URL: https://issues.apache.org/jira/browse/SPARK-11825

[jira] [Commented] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2015-11-18 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011832#comment-15011832 ] shane knapp commented on SPARK-11823: - this appears to be happening right now on

[jira] [Commented] (SPARK-11826) Subtract BlockMatrix

2015-11-18 Thread Ehsan Mohyedin Kermani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011857#comment-15011857 ] Ehsan Mohyedin Kermani commented on SPARK-11826: I am going to send a PR now. > Subtract

[jira] [Resolved] (SPARK-4557) Spark Streaming' foreachRDD method should accept a VoidFunction<...>, not a Function<..., Void>

2015-11-18 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-4557. -- Resolution: Fixed Assignee: Bryan Cutler Fix Version/s: 1.6.0 > Spark

[jira] [Updated] (SPARK-4557) Spark Streaming' foreachRDD method should accept a VoidFunction<...>, not a Function<..., Void>

2015-11-18 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-4557: - Target Version/s: (was: 2.0.0) > Spark Streaming' foreachRDD method should accept a

[jira] [Commented] (SPARK-11275) [SQL] Incorrect results when using rollup/cube

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011732#comment-15011732 ] Apache Spark commented on SPARK-11275: -- User 'aray' has created a pull request for this issue:

[jira] [Commented] (SPARK-6727) Model export/import for spark.ml: HashingTF

2015-11-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011759#comment-15011759 ] Joseph K. Bradley commented on SPARK-6727: -- This would be nice---except that I don't think it

[jira] [Commented] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2015-11-18 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011764#comment-15011764 ] shane knapp commented on SPARK-11823: - [~joshrosen] > HiveThriftBinaryServerSuite tests timing out,

[jira] [Resolved] (SPARK-11739) Dead SQLContext may not be cleared

2015-11-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11739. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9706

[jira] [Resolved] (SPARK-11825) TransportContext's IdleStateHandler should be the first handler in the pipeline

2015-11-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11825. Resolution: Not A Problem >From [~zsxwing]: {quote} It's a false alarm.

[jira] [Updated] (SPARK-11826) Subtract BlockMatrix

2015-11-18 Thread Ehsan Mohyedin Kermani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ehsan Mohyedin Kermani updated SPARK-11826: --- Priority: Major (was: Minor) > Subtract BlockMatrix >

[jira] [Commented] (SPARK-11826) Subtract BlockMatrix

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011872#comment-15011872 ] Apache Spark commented on SPARK-11826: -- User 'ehsanmok' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11826) Subtract BlockMatrix

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11826: Assignee: Apache Spark > Subtract BlockMatrix > > >

[jira] [Updated] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2015-11-18 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-11823: Attachment:

[jira] [Assigned] (SPARK-11826) Subtract BlockMatrix

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11826: Assignee: (was: Apache Spark) > Subtract BlockMatrix > > >

[jira] [Resolved] (SPARK-11809) Switch the default Mesos mode to coarse-grained mode

2015-11-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11809. - Resolution: Fixed Fix Version/s: 1.6.0 > Switch the default Mesos mode to coarse-grained

[jira] [Resolved] (SPARK-10745) Separate configs between shuffle and RPC

2015-11-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10745. Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0 > Separate

[jira] [Created] (SPARK-11827) Support java.math.BigInteger in Type-Inference utilities for POJOs

2015-11-18 Thread Abhilash Srimat Tirumala Pallerlamudi (JIRA)
Abhilash Srimat Tirumala Pallerlamudi created SPARK-11827: - Summary: Support java.math.BigInteger in Type-Inference utilities for POJOs Key: SPARK-11827 URL:

[jira] [Updated] (SPARK-2331) SparkContext.emptyRDD should return RDD[T] not EmptyRDD[T]

2015-11-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2331: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-11806 > SparkContext.emptyRDD should return

[jira] [Updated] (SPARK-10580) Remove Bagel

2015-11-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10580: Issue Type: Sub-task (was: Task) Parent: SPARK-11806 > Remove Bagel > > >

[jira] [Updated] (SPARK-4819) Remove Guava's "Optional" from public API

2015-11-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-4819: --- Issue Type: Sub-task (was: Task) Parent: SPARK-11806 > Remove Guava's "Optional" from public

[jira] [Resolved] (SPARK-11652) Remote code execution with InvokerTransformer

2015-11-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11652. --- Resolution: Fixed Fix Version/s: 1.4.2 1.6.0 1.5.3

[jira] [Reopened] (SPARK-11777) HiveContext.saveAsTable does not update the metastore on overwrite

2015-11-18 Thread Stanislav Hadjiiski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stanislav Hadjiiski reopened SPARK-11777: - I would like to refer you to the cloudera documentation:

[jira] [Comment Edited] (SPARK-11777) HiveContext.saveAsTable does not update the metastore on overwrite

2015-11-18 Thread Stanislav Hadjiiski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010819#comment-15010819 ] Stanislav Hadjiiski edited comment on SPARK-11777 at 11/18/15 11:40 AM:

[jira] [Issue Comment Deleted] (SPARK-11777) HiveContext.saveAsTable does not update the metastore on overwrite

2015-11-18 Thread Stanislav Hadjiiski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stanislav Hadjiiski updated SPARK-11777: Comment: was deleted (was: I would like to refer you to the cloudera

[jira] [Updated] (SPARK-11799) Make it explicit in executor logs that uncaught exceptions are thrown during executor shutdown

2015-11-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11799: -- Target Version/s: (was: 1.5.1) [~vsr] you can't target a released version > Make it explicit in

[jira] [Commented] (SPARK-11803) Dataset self join returns incorrect result

2015-11-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010837#comment-15010837 ] Wenchen Fan commented on SPARK-11803: - [~smilegator] sorry I haven't noticed that you are already

[jira] [Commented] (SPARK-11777) HiveContext.saveAsTable does not update the metastore on overwrite

2015-11-18 Thread Stanislav Hadjiiski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010907#comment-15010907 ] Stanislav Hadjiiski commented on SPARK-11777: - Spark updates the HDFS (which is directly used

[jira] [Commented] (SPARK-11815) PySpark DecisionTreeClassifier & DecisionTreeRegressor should support setSeed

2015-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010952#comment-15010952 ] Apache Spark commented on SPARK-11815: -- User 'yanboliang' has created a pull request for this issue:

  1   2   3   4   5   >