[jira] [Commented] (SPARK-1087) Separate file for traceback and callsite related functions

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14133094#comment-14133094 ] Apache Spark commented on SPARK-1087: - User 'staple' has created a pull request for th

[jira] [Resolved] (SPARK-3463) Show metrics about spilling in Python

2014-09-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3463. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2336 [https://github.com/

[jira] [Updated] (SPARK-3438) Support for accessing secured HDFS in Standalone Mode

2014-09-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3438: --- Description: Access to secured HDFS is currently supported in YARN using YARN's built in secu

[jira] [Updated] (SPARK-3501) Hive SimpleUDF will create duplicated type cast which cause exception in constant folding

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3501: Assignee: Cheng Hao > Hive SimpleUDF will create duplicated type cast which cause exception

[jira] [Resolved] (SPARK-3515) ParquetMetastoreSuite fails when executed together with other suites under Maven

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3515. - Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Cheng Lian > ParquetMetas

[jira] [Updated] (SPARK-3501) Hive SimpleUDF will create duplicated type cast which cause exception in constant folding

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3501: Target Version/s: 1.2.0 > Hive SimpleUDF will create duplicated type cast which cause except

[jira] [Updated] (SPARK-3485) should check parameter type when find constructors

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3485: Target Version/s: 1.2.0 > should check parameter type when find constructors > -

[jira] [Resolved] (SPARK-3030) reuse python worker

2014-09-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3030. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2259 [https://github.com/

[jira] [Resolved] (SPARK-3294) Avoid boxing/unboxing when handling in-memory columnar storage

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3294. - Resolution: Fixed Fix Version/s: 1.2.0 > Avoid boxing/unboxing when handling in-mem

[jira] [Commented] (SPARK-3519) PySpark RDDs are missing the distinct(n) method

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132963#comment-14132963 ] Apache Spark commented on SPARK-3519: - User 'mattf' has created a pull request for thi

[jira] [Resolved] (SPARK-3481) HiveComparisonTest throws exception of "org.apache.hadoop.hive.ql.metadata.HiveException: Database does not exist: default"

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3481. - Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Cheng Hao > HiveCompariso

[jira] [Commented] (SPARK-3414) Case insensitivity breaks when unresolved relation contains attributes with uppercase letters in their names

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132893#comment-14132893 ] Apache Spark commented on SPARK-3414: - User 'marmbrus' has created a pull request for

[jira] [Reopened] (SPARK-3414) Case insensitivity breaks when unresolved relation contains attributes with uppercase letters in their names

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-3414: - Assignee: Michael Armbrust (was: Cheng Lian) > Case insensitivity breaks when unresolve

[jira] [Commented] (SPARK-2594) Add CACHE TABLE AS SELECT ...

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132876#comment-14132876 ] Apache Spark commented on SPARK-2594: - User 'ravipesala' has created a pull request fo

[jira] [Resolved] (SPARK-2562) Add Date datatype support to Spark SQL

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2562. - Resolution: Duplicate > Add Date datatype support to Spark SQL > -

[jira] [Updated] (SPARK-3407) Add Date type support

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3407: Assignee: Adrian Wang > Add Date type support > - > > Ke

[jira] [Updated] (SPARK-3407) Add Date type support

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3407: Target Version/s: 1.2.0 > Add Date type support > - > >

[jira] [Commented] (SPARK-3519) PySpark RDDs are missing the distinct(n) method

2014-09-13 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132833#comment-14132833 ] Nicholas Chammas commented on SPARK-3519: - [~joshrosen] & [~davies]: Here is a tic

[jira] [Created] (SPARK-3519) PySpark RDDs are missing the distinct(n) method

2014-09-13 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-3519: --- Summary: PySpark RDDs are missing the distinct(n) method Key: SPARK-3519 URL: https://issues.apache.org/jira/browse/SPARK-3519 Project: Spark Issue Typ

[jira] [Commented] (SPARK-2593) Add ability to pass an existing Akka ActorSystem into Spark

2014-09-13 Thread Helena Edelson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132797#comment-14132797 ] Helena Edelson commented on SPARK-2593: --- Here is a good example of just one of the i

[jira] [Updated] (SPARK-2593) Add ability to pass an existing Akka ActorSystem into Spark

2014-09-13 Thread Helena Edelson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Helena Edelson updated SPARK-2593: -- Description: As a developer I want to pass an existing ActorSystem into StreamingContext in loa

[jira] [Commented] (SPARK-3518) Remove useless statement in JsonProtocol

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132608#comment-14132608 ] Apache Spark commented on SPARK-3518: - User 'sarutak' has created a pull request for t

[jira] [Created] (SPARK-3518) Remove useless statement in JsonProtocol

2014-09-13 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-3518: - Summary: Remove useless statement in JsonProtocol Key: SPARK-3518 URL: https://issues.apache.org/jira/browse/SPARK-3518 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-2926) Add MR-style (merge-sort) SortShuffleReader for sort-based shuffle

2014-09-13 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132598#comment-14132598 ] Saisai Shao edited comment on SPARK-2926 at 9/13/14 8:09 AM: -

[jira] [Commented] (SPARK-2926) Add MR-style (merge-sort) SortShuffleReader for sort-based shuffle

2014-09-13 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132598#comment-14132598 ] Saisai Shao commented on SPARK-2926: Ok, I will take a try and let you know then it is

[jira] [Commented] (SPARK-2098) All Spark processes should support spark-defaults.conf, config file

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132593#comment-14132593 ] Apache Spark commented on SPARK-2098: - User 'witgo' has created a pull request for thi

[jira] [Commented] (SPARK-3491) Use pickle to serialize the data in MLlib Python

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132590#comment-14132590 ] Apache Spark commented on SPARK-3491: - User 'davies' has created a pull request for th