[jira] [Resolved] (SPARK-3455) **HotFix** Unit test failed due to can not resolve the attribute references

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3455. - Resolution: Fixed **HotFix** Unit test failed due to can not resolve the attribute

[jira] [Updated] (SPARK-2883) Spark Support for ORCFile format

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2883: Priority: Blocker (was: Major) Spark Support for ORCFile format

[jira] [Updated] (SPARK-2883) Spark Support for ORCFile format

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2883: Target Version/s: 1.2.0 Spark Support for ORCFile format

[jira] [Commented] (SPARK-3481) HiveComparisonTest throws exception of org.apache.hadoop.hive.ql.metadata.HiveException: Database does not exist: default

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132567#comment-14132567 ] Apache Spark commented on SPARK-3481: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-3491) Use pickle to serialize the data in MLlib Python

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132590#comment-14132590 ] Apache Spark commented on SPARK-3491: - User 'davies' has created a pull request for

[jira] [Commented] (SPARK-2098) All Spark processes should support spark-defaults.conf, config file

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132593#comment-14132593 ] Apache Spark commented on SPARK-2098: - User 'witgo' has created a pull request for

[jira] [Commented] (SPARK-2926) Add MR-style (merge-sort) SortShuffleReader for sort-based shuffle

2014-09-13 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132598#comment-14132598 ] Saisai Shao commented on SPARK-2926: Ok, I will take a try and let you know then it is

[jira] [Comment Edited] (SPARK-2926) Add MR-style (merge-sort) SortShuffleReader for sort-based shuffle

2014-09-13 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132598#comment-14132598 ] Saisai Shao edited comment on SPARK-2926 at 9/13/14 8:09 AM: -

[jira] [Created] (SPARK-3518) Remove useless statement in JsonProtocol

2014-09-13 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-3518: - Summary: Remove useless statement in JsonProtocol Key: SPARK-3518 URL: https://issues.apache.org/jira/browse/SPARK-3518 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3518) Remove useless statement in JsonProtocol

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132608#comment-14132608 ] Apache Spark commented on SPARK-3518: - User 'sarutak' has created a pull request for

[jira] [Updated] (SPARK-2593) Add ability to pass an existing Akka ActorSystem into Spark

2014-09-13 Thread Helena Edelson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Helena Edelson updated SPARK-2593: -- Description: As a developer I want to pass an existing ActorSystem into StreamingContext in

[jira] [Commented] (SPARK-2593) Add ability to pass an existing Akka ActorSystem into Spark

2014-09-13 Thread Helena Edelson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132797#comment-14132797 ] Helena Edelson commented on SPARK-2593: --- Here is a good example of just one of the

[jira] [Created] (SPARK-3519) PySpark RDDs are missing the distinct(n) method

2014-09-13 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-3519: --- Summary: PySpark RDDs are missing the distinct(n) method Key: SPARK-3519 URL: https://issues.apache.org/jira/browse/SPARK-3519 Project: Spark Issue

[jira] [Commented] (SPARK-3519) PySpark RDDs are missing the distinct(n) method

2014-09-13 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132833#comment-14132833 ] Nicholas Chammas commented on SPARK-3519: - [~joshrosen] [~davies]: Here is a

[jira] [Updated] (SPARK-3407) Add Date type support

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3407: Target Version/s: 1.2.0 Add Date type support -

[jira] [Updated] (SPARK-3407) Add Date type support

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3407: Assignee: Adrian Wang Add Date type support - Key:

[jira] [Resolved] (SPARK-2562) Add Date datatype support to Spark SQL

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2562. - Resolution: Duplicate Add Date datatype support to Spark SQL

[jira] [Commented] (SPARK-2594) Add CACHE TABLE name AS SELECT ...

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132876#comment-14132876 ] Apache Spark commented on SPARK-2594: - User 'ravipesala' has created a pull request

[jira] [Reopened] (SPARK-3414) Case insensitivity breaks when unresolved relation contains attributes with uppercase letters in their names

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-3414: - Assignee: Michael Armbrust (was: Cheng Lian) Case insensitivity breaks when

[jira] [Commented] (SPARK-3414) Case insensitivity breaks when unresolved relation contains attributes with uppercase letters in their names

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132893#comment-14132893 ] Apache Spark commented on SPARK-3414: - User 'marmbrus' has created a pull request for

[jira] [Resolved] (SPARK-3481) HiveComparisonTest throws exception of org.apache.hadoop.hive.ql.metadata.HiveException: Database does not exist: default

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3481. - Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Cheng Hao

[jira] [Commented] (SPARK-3519) PySpark RDDs are missing the distinct(n) method

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132963#comment-14132963 ] Apache Spark commented on SPARK-3519: - User 'mattf' has created a pull request for

[jira] [Resolved] (SPARK-3294) Avoid boxing/unboxing when handling in-memory columnar storage

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3294. - Resolution: Fixed Fix Version/s: 1.2.0 Avoid boxing/unboxing when handling

[jira] [Resolved] (SPARK-3030) reuse python worker

2014-09-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3030. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2259

[jira] [Updated] (SPARK-3485) should check parameter type when find constructors

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3485: Target Version/s: 1.2.0 should check parameter type when find constructors

[jira] [Resolved] (SPARK-3515) ParquetMetastoreSuite fails when executed together with other suites under Maven

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3515. - Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Cheng Lian

[jira] [Updated] (SPARK-3501) Hive SimpleUDF will create duplicated type cast which cause exception in constant folding

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3501: Target Version/s: 1.2.0 Hive SimpleUDF will create duplicated type cast which cause

[jira] [Updated] (SPARK-3501) Hive SimpleUDF will create duplicated type cast which cause exception in constant folding

2014-09-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3501: Assignee: Cheng Hao Hive SimpleUDF will create duplicated type cast which cause exception

[jira] [Updated] (SPARK-3438) Support for accessing secured HDFS in Standalone Mode

2014-09-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3438: --- Description: Access to secured HDFS is currently supported in YARN using YARN's built in

[jira] [Resolved] (SPARK-3463) Show metrics about spilling in Python

2014-09-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3463. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2336

[jira] [Commented] (SPARK-1087) Separate file for traceback and callsite related functions

2014-09-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14133094#comment-14133094 ] Apache Spark commented on SPARK-1087: - User 'staple' has created a pull request for