[jira] [Comment Edited] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

2015-02-05 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308394#comment-14308394 ] Nicholas Chammas edited comment on SPARK-5637 at 2/6/15 1:19 AM:

[jira] [Commented] (SPARK-5607) NullPointerException in objenesis

2015-02-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308423#comment-14308423 ] Patrick Wendell commented on SPARK-5607: This may have actually caused more of an

[jira] [Created] (SPARK-5640) org.apache.spark.sql.catalyst.ScalaReflection is not thread safe

2015-02-05 Thread Tobias Schlatter (JIRA)
Tobias Schlatter created SPARK-5640: --- Summary: org.apache.spark.sql.catalyst.ScalaReflection is not thread safe Key: SPARK-5640 URL: https://issues.apache.org/jira/browse/SPARK-5640 Project: Spark

[jira] [Created] (SPARK-5641) Allow spark_ec2.py to copy arbitrary files to cluster via deploy.generic

2015-02-05 Thread Florian Verhein (JIRA)
Florian Verhein created SPARK-5641: -- Summary: Allow spark_ec2.py to copy arbitrary files to cluster via deploy.generic Key: SPARK-5641 URL: https://issues.apache.org/jira/browse/SPARK-5641 Project:

[jira] [Resolved] (SPARK-5638) Add a config flag to disable eager analysis of DataFrames

2015-02-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5638. Resolution: Fixed Fix Version/s: 1.3.0 Add a config flag to disable eager analysis of

[jira] [Updated] (SPARK-5557) Servlet API classes now missing after jetty shading

2015-02-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5557: --- Summary: Servlet API classes now missing after jetty shading (was: spark-shell failed to

[jira] [Updated] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

2015-02-05 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5637: Component/s: EC2 Expose spark_ec2 as as StarCluster Plugin

[jira] [Commented] (SPARK-5557) Servlet API classes now missing after jetty shading

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308378#comment-14308378 ] Apache Spark commented on SPARK-5557: - User 'pwendell' has created a pull request for

[jira] [Comment Edited] (SPARK-5557) Servlet API classes now missing after jetty shading

2015-02-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308391#comment-14308391 ] Patrick Wendell edited comment on SPARK-5557 at 2/6/15 1:07 AM:

[jira] [Commented] (SPARK-5557) Servlet API classes now missing after jetty shading

2015-02-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308391#comment-14308391 ] Patrick Wendell commented on SPARK-5557: I'm sorry that this affected so many

[jira] [Commented] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

2015-02-05 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308394#comment-14308394 ] Nicholas Chammas commented on SPARK-5637: - [~agrothberg] - Can you expand on how

[jira] [Commented] (SPARK-5598) Model import/export for ALS

2015-02-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308433#comment-14308433 ] Xiangrui Meng commented on SPARK-5598: -- [~srowen] Do you expect the produced PMML

[jira] [Commented] (SPARK-5619) Support 'show roles' in HiveContext

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14307106#comment-14307106 ] Apache Spark commented on SPARK-5619: - User 'watermen' has created a pull request for

[jira] [Commented] (SPARK-5613) YarnClientSchedulerBackend fails to get application report when yarn restarts

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306903#comment-14306903 ] Apache Spark commented on SPARK-5613: - User 'kasjain' has created a pull request for

[jira] [Commented] (SPARK-5617) test failure of SQLQuerySuite

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14307084#comment-14307084 ] Apache Spark commented on SPARK-5617: - User 'scwf' has created a pull request for this

[jira] [Updated] (SPARK-5619) Support 'show roles' in HiveContext

2015-02-05 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-5619: - Fix Version/s: 1.3.0 Support 'show roles' in HiveContext ---

[jira] [Updated] (SPARK-5619) Support 'show roles' in HiveContext

2015-02-05 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-5619: - Fix Version/s: (was: 1.3.0) Support 'show roles' in HiveContext ---

[jira] [Commented] (SPARK-5618) Optimise utility code.

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14307101#comment-14307101 ] Apache Spark commented on SPARK-5618: - User 'fukuo33' has created a pull request for

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

2015-02-05 Thread Dale Richardson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306899#comment-14306899 ] Dale Richardson commented on SPARK-5388: Heh Andrew, definitely starting to look a

[jira] [Commented] (SPARK-5614) Predicate pushdown through Generate

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14307073#comment-14307073 ] Apache Spark commented on SPARK-5614: - User 'ianluyan' has created a pull request for

[jira] [Updated] (SPARK-5619) Support 'show roles' in HiveContext

2015-02-05 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-5619: - Affects Version/s: 1.2.0 Support 'show roles' in HiveContext ---

[jira] [Resolved] (SPARK-5557) Servlet API classes now missing after jetty shading

2015-02-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5557. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Patrick Wendell Servlet

[jira] [Commented] (SPARK-3185) SPARK launch on Hadoop 2 in EC2 throws Tachyon exception when Formatting JOURNAL_FOLDER

2015-02-05 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308471#comment-14308471 ] DeepakVohra commented on SPARK-3185: The Spark is built with Hadoop 2.0

[jira] [Commented] (SPARK-5631) Server IPC version 7 cannot communicate with client version 4

2015-02-05 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308475#comment-14308475 ] DeepakVohra commented on SPARK-5631: The Spark is built with Hadoop 2.0

[jira] [Commented] (SPARK-5626) Spurious test failures due to NullPointerException in EasyMock test code

2015-02-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308482#comment-14308482 ] Patrick Wendell commented on SPARK-5626: [~joshrosen] I may have caused this by

[jira] [Reopened] (SPARK-5607) NullPointerException in objenesis

2015-02-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-5607: NullPointerException in objenesis - Key:

[jira] [Commented] (SPARK-5607) NullPointerException in objenesis

2015-02-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308493#comment-14308493 ] Patrick Wendell commented on SPARK-5607: I've reverted my patch since it may have

[jira] [Commented] (SPARK-5628) Add option to return spark-ec2 version

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308500#comment-14308500 ] Apache Spark commented on SPARK-5628: - User 'nchammas' has created a pull request for

[jira] [Created] (SPARK-5642) Apply column pruning on unused aggregation fields

2015-02-05 Thread Adrian Wang (JIRA)
Adrian Wang created SPARK-5642: -- Summary: Apply column pruning on unused aggregation fields Key: SPARK-5642 URL: https://issues.apache.org/jira/browse/SPARK-5642 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5642) Apply column pruning on unused aggregation fields

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308526#comment-14308526 ] Apache Spark commented on SPARK-5642: - User 'adrian-wang' has created a pull request

[jira] [Resolved] (SPARK-4687) SparkContext#addFile doesn't keep file folder information

2015-02-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4687. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.0 Issue resolved by pull request

[jira] [Reopened] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-02-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-4105: --- I'm re-opening this issue because I've seen another recent occurrence of this error in Spark 1.2.0+.

[jira] [Created] (SPARK-5625) Spark binaries do not incude Spark Core

2015-02-05 Thread DeepakVohra (JIRA)
DeepakVohra created SPARK-5625: -- Summary: Spark binaries do not incude Spark Core Key: SPARK-5625 URL: https://issues.apache.org/jira/browse/SPARK-5625 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4687) SparkContext#addFile doesn't keep file folder information

2015-02-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4687: -- Assignee: Sandy Ryza SparkContext#addFile doesn't keep file folder information

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

2015-02-05 Thread Philippe Girolami (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14307719#comment-14307719 ] Philippe Girolami commented on SPARK-1867: -- [~srowen] I'm unfortunately reporting

[jira] [Created] (SPARK-5626) Spurious test failures due to NullPointerException in EasyMock test code

2015-02-05 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-5626: - Summary: Spurious test failures due to NullPointerException in EasyMock test code Key: SPARK-5626 URL: https://issues.apache.org/jira/browse/SPARK-5626 Project: Spark

[jira] [Commented] (SPARK-5610) Generate Java docs without package private classes and methods

2015-02-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14307888#comment-14307888 ] Xiangrui Meng commented on SPARK-5610: -- Thanks for the reminder! I will try it with

[jira] [Resolved] (SPARK-5474) curl should support URL redirection in build/mvn

2015-02-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5474. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Guoqiang Li curl should

[jira] [Commented] (SPARK-5403) Ignore UserKnownHostsFile in SSH calls

2015-02-05 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14307904#comment-14307904 ] Nicholas Chammas commented on SPARK-5403: - I believe this issue duplicates an

[jira] [Created] (SPARK-5627) Enhance spark-ec2 for some programmatic use cases

2015-02-05 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-5627: --- Summary: Enhance spark-ec2 for some programmatic use cases Key: SPARK-5627 URL: https://issues.apache.org/jira/browse/SPARK-5627 Project: Spark Issue

[jira] [Created] (SPARK-5628) Add option to return spark-ec2 version

2015-02-05 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-5628: --- Summary: Add option to return spark-ec2 version Key: SPARK-5628 URL: https://issues.apache.org/jira/browse/SPARK-5628 Project: Spark Issue Type:

[jira] [Created] (SPARK-5629) Add spark-ec2 option to return info about cluster for programmatic consumption

2015-02-05 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-5629: --- Summary: Add spark-ec2 option to return info about cluster for programmatic consumption Key: SPARK-5629 URL: https://issues.apache.org/jira/browse/SPARK-5629

<    1   2