[jira] [Updated] (SPARK-6425) Add parallel Q-learning algorithm to MLLib

2015-03-26 Thread zhangyouhua (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangyouhua updated SPARK-6425: --- Description: [~mengxr] Q-learning is a model-free reinforcement learning technique. Specifically,

[jira] [Resolved] (SPARK-6549) Spark console logger logs to stderr by default

2015-03-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6549. Resolution: Won't Fix I think this is a wont fix due to compatibility issues. If I'm wrong

[jira] [Created] (SPARK-6558) Utils.getCurrentUserName returns the full principal name instead of login name

2015-03-26 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-6558: Summary: Utils.getCurrentUserName returns the full principal name instead of login name Key: SPARK-6558 URL: https://issues.apache.org/jira/browse/SPARK-6558

[jira] [Assigned] (SPARK-5750) Document that ordering of elements in shuffled partitions is not deterministic across runs

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5750: --- Assignee: Apache Spark Document that ordering of elements in shuffled partitions is not

[jira] [Assigned] (SPARK-5836) Highlight in Spark documentation that by default Spark does not delete its temporary files

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5836: --- Assignee: (was: Apache Spark) Highlight in Spark documentation that by default Spark

[jira] [Assigned] (SPARK-4655) Split Stage into ShuffleMapStage and ResultStage subclasses

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4655: --- Assignee: Apache Spark (was: Ilya Ganelin) Split Stage into ShuffleMapStage and

[jira] [Assigned] (SPARK-3441) Explain in docs that repartitionAndSortWithinPartitions enacts Hadoop style shuffle

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3441: --- Assignee: Apache Spark (was: Sandy Ryza) Explain in docs that

[jira] [Assigned] (SPARK-3441) Explain in docs that repartitionAndSortWithinPartitions enacts Hadoop style shuffle

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3441: --- Assignee: Sandy Ryza (was: Apache Spark) Explain in docs that

[jira] [Assigned] (SPARK-3533) Add saveAsTextFileByKey() method to RDDs

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3533: --- Assignee: Apache Spark Add saveAsTextFileByKey() method to RDDs

[jira] [Assigned] (SPARK-3533) Add saveAsTextFileByKey() method to RDDs

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3533: --- Assignee: (was: Apache Spark) Add saveAsTextFileByKey() method to RDDs

[jira] [Comment Edited] (SPARK-6539) SparkContext throws NullPointerException

2015-03-26 Thread davep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382292#comment-14382292 ] davep edited comment on SPARK-6539 at 3/26/15 5:38 PM: --- Looks like

[jira] [Assigned] (SPARK-5836) Highlight in Spark documentation that by default Spark does not delete its temporary files

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5836: --- Assignee: Apache Spark Highlight in Spark documentation that by default Spark does not

[jira] [Assigned] (SPARK-5750) Document that ordering of elements in shuffled partitions is not deterministic across runs

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5750: --- Assignee: (was: Apache Spark) Document that ordering of elements in shuffled partitions

[jira] [Commented] (SPARK-6264) Python API for FPGrowth

2015-03-26 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382136#comment-14382136 ] Yanbo Liang commented on SPARK-6264: [~josephkb] Could you assign this to me ?

[jira] [Commented] (SPARK-4587) Model export/import

2015-03-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382284#comment-14382284 ] Joseph K. Bradley commented on SPARK-4587: -- Can you not check out that repo?

[jira] [Commented] (SPARK-6548) Adding stddev to DataFrame functions

2015-03-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382281#comment-14382281 ] Reynold Xin commented on SPARK-6548: Thanks [~dreamquster]. Adding stddev to

[jira] [Updated] (SPARK-6264) Python API for FPGrowth

2015-03-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6264: - Assignee: Yanbo Liang Python API for FPGrowth ---

[jira] [Assigned] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2691: --- Assignee: Timothy Chen (was: Apache Spark) Allow Spark on Mesos to be launched with Docker

[jira] [Resolved] (SPARK-6532) LDAModel.scala fails scalastyle on Windows

2015-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6532. -- Resolution: Fixed Fix Version/s: (was: 1.3.1) Just re-resolving since there was a separate

[jira] [Assigned] (SPARK-4655) Split Stage into ShuffleMapStage and ResultStage subclasses

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4655: --- Assignee: Ilya Ganelin (was: Apache Spark) Split Stage into ShuffleMapStage and

[jira] [Commented] (SPARK-6504) Cannot read Parquet files generated from different versions at once

2015-03-26 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382199#comment-14382199 ] Michael Armbrust commented on SPARK-6504: - Yes, hopefully next week. Cannot

[jira] [Commented] (SPARK-6539) SparkContext throws NullPointerException

2015-03-26 Thread davep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382292#comment-14382292 ] davep commented on SPARK-6539: -- Looks like it's more related to memory usage with Java 8 Saw

[jira] [Issue Comment Deleted] (SPARK-6481) Set In Progress when a PR is opened for an issue

2015-03-26 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-6481: Comment: was deleted (was: Oh, never mind then. :-}) Set In Progress when a PR is opened

[jira] [Assigned] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2691: --- Assignee: Apache Spark (was: Timothy Chen) Allow Spark on Mesos to be launched with Docker

[jira] [Reopened] (SPARK-6532) LDAModel.scala fails scalastyle on Windows

2015-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-6532: -- Assignee: Sean Owen LDAModel.scala fails scalastyle on Windows

[jira] [Commented] (SPARK-6538) Add missing nullable Metastore fields when merging a Parquet schema

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382257#comment-14382257 ] Apache Spark commented on SPARK-6538: - User 'budde' has created a pull request for

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

2015-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382340#comment-14382340 ] Sean Owen commented on SPARK-6481: -- So, I'm seeing about 50 new Assignee emails a day

[jira] [Assigned] (SPARK-6284) Support framework authentication and role in Mesos framework

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6284: --- Assignee: Apache Spark Support framework authentication and role in Mesos framework

[jira] [Assigned] (SPARK-6284) Support framework authentication and role in Mesos framework

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6284: --- Assignee: (was: Apache Spark) Support framework authentication and role in Mesos

[jira] [Assigned] (SPARK-6433) hive tests to import spark-sql test JAR for QueryTest access

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6433: --- Assignee: Apache Spark hive tests to import spark-sql test JAR for QueryTest access

[jira] [Created] (SPARK-6557) Only set bold text on PR github test output for problems

2015-03-26 Thread Brennon York (JIRA)
Brennon York created SPARK-6557: --- Summary: Only set bold text on PR github test output for problems Key: SPARK-6557 URL: https://issues.apache.org/jira/browse/SPARK-6557 Project: Spark Issue

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

2015-03-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382472#comment-14382472 ] Josh Rosen commented on SPARK-6481: --- For SPARK-3441, this issue was updated because the

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

2015-03-26 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382476#comment-14382476 ] Nicholas Chammas commented on SPARK-6481: - SPARK-3441 looks fine to me. It was

[jira] [Updated] (SPARK-6539) SparkContext throws NullPointerException

2015-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6539: - Priority: Minor (was: Major) It's weird that the JVM is consuming so much virtual memory there. I am not

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

2015-03-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382370#comment-14382370 ] Josh Rosen commented on SPARK-6481: --- It looks like it should be possible to disable

[jira] [Assigned] (SPARK-6113) Stabilize DecisionTree and ensembles APIs

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6113: --- Assignee: Apache Spark (was: Joseph K. Bradley) Stabilize DecisionTree and ensembles APIs

[jira] [Resolved] (SPARK-6117) describe function for summary statistics

2015-03-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6117. Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 describe function for

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

2015-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382468#comment-14382468 ] Sean Owen commented on SPARK-6481: -- The thing is, for some reason it's making changes on

[jira] [Commented] (SPARK-6413) For data source tables, we should provide better output for described formatted.

2015-03-26 Thread Christian Perez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382473#comment-14382473 ] Christian Perez commented on SPARK-6413: Since I'm the source of this issue, I can

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

2015-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382489#comment-14382489 ] Sean Owen commented on SPARK-6481: -- Got it. So we may see a lot of this activity as

[jira] [Assigned] (SPARK-6433) hive tests to import spark-sql test JAR for QueryTest access

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6433: --- Assignee: (was: Apache Spark) hive tests to import spark-sql test JAR for QueryTest

[jira] [Assigned] (SPARK-6414) Spark driver failed with NPE on job cancelation

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6414: --- Assignee: (was: Apache Spark) Spark driver failed with NPE on job cancelation

[jira] [Assigned] (SPARK-6414) Spark driver failed with NPE on job cancelation

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6414: --- Assignee: Apache Spark Spark driver failed with NPE on job cancelation

[jira] [Commented] (SPARK-6532) LDAModel.scala fails scalastyle on Windows

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381897#comment-14381897 ] Apache Spark commented on SPARK-6532: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-6548) Adding stddev to DataFrame functions

2015-03-26 Thread sdfox (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381901#comment-14381901 ] sdfox commented on SPARK-6548: -- I will take it. Adding stddev to DataFrame functions

[jira] [Assigned] (SPARK-2475) Check whether #cores #receivers in local mode

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2475: --- Assignee: (was: Apache Spark) Check whether #cores #receivers in local mode

[jira] [Assigned] (SPARK-2475) Check whether #cores #receivers in local mode

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2475: --- Assignee: Apache Spark Check whether #cores #receivers in local mode

[jira] [Commented] (SPARK-2475) Check whether #cores #receivers in local mode

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381906#comment-14381906 ] Apache Spark commented on SPARK-2475: - User 'ArcherShao' has created a pull request

[jira] [Assigned] (SPARK-5253) LinearRegression with L1/L2 (elastic net) using OWLQN in new ML package

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5253: --- Assignee: Apache Spark LinearRegression with L1/L2 (elastic net) using OWLQN in new ML

[jira] [Updated] (SPARK-5253) LinearRegression with L1/L2 (elastic net) using OWLQN in new ML package

2015-03-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5253: - Assignee: DB Tsai LinearRegression with L1/L2 (elastic net) using OWLQN in new ML

[jira] [Resolved] (SPARK-6554) Cannot use partition columns in where clause when Parquet filter push-down is enabled

2015-03-26 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6554. - Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Cannot use

[jira] [Updated] (SPARK-1476) 2GB limit in spark for blocks

2015-03-26 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-1476: --- Assignee: (was: Mridul Muralidharan) 2GB limit in spark for blocks

[jira] [Updated] (SPARK-2532) Fix issues with consolidated shuffle

2015-03-26 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-2532: --- Assignee: (was: Mridul Muralidharan) Fix issues with consolidated shuffle

[jira] [Commented] (SPARK-6550) Add PreAnalyzer to keep logical plan consistent across DataFrame

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382746#comment-14382746 ] Apache Spark commented on SPARK-6550: - User 'marmbrus' has created a pull request for

[jira] [Assigned] (SPARK-5253) LinearRegression with L1/L2 (elastic net) using OWLQN in new ML package

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5253: --- Assignee: (was: Apache Spark) LinearRegression with L1/L2 (elastic net) using OWLQN in

[jira] [Assigned] (SPARK-6345) Model update propagation during prediction in Streaming Regression

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6345: --- Assignee: Apache Spark (was: Jeremy Freeman) Model update propagation during prediction in

[jira] [Assigned] (SPARK-6345) Model update propagation during prediction in Streaming Regression

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6345: --- Assignee: Jeremy Freeman (was: Apache Spark) Model update propagation during prediction in

[jira] [Commented] (SPARK-4897) Python 3 support

2015-03-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382722#comment-14382722 ] Josh Rosen commented on SPARK-4897: --- There's now an open pull request for this, which is

[jira] [Commented] (SPARK-4503) The history server is not compatible with HDFS HA

2015-03-26 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382358#comment-14382358 ] Marcelo Vanzin commented on SPARK-4503: --- I just had to debug a similar problem in a

[jira] [Assigned] (SPARK-6113) Stabilize DecisionTree and ensembles APIs

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6113: --- Assignee: Joseph K. Bradley (was: Apache Spark) Stabilize DecisionTree and ensembles APIs

[jira] [Assigned] (SPARK-6405) Spark Kryo buffer should be forced to be max. 2GB

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6405: --- Assignee: Apache Spark Spark Kryo buffer should be forced to be max. 2GB

[jira] [Assigned] (SPARK-6405) Spark Kryo buffer should be forced to be max. 2GB

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6405: --- Assignee: (was: Apache Spark) Spark Kryo buffer should be forced to be max. 2GB

[jira] [Commented] (SPARK-6405) Spark Kryo buffer should be forced to be max. 2GB

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382912#comment-14382912 ] Apache Spark commented on SPARK-6405: - User 'mccheah' has created a pull request for

[jira] [Assigned] (SPARK-6510) Add Graph#minus method to act as Set#difference

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6510: --- Assignee: (was: Apache Spark) Add Graph#minus method to act as Set#difference

[jira] [Assigned] (SPARK-6510) Add Graph#minus method to act as Set#difference

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6510: --- Assignee: Apache Spark Add Graph#minus method to act as Set#difference

[jira] [Commented] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

2015-03-26 Thread Masayoshi TSUZUKI (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383143#comment-14383143 ] Masayoshi TSUZUKI commented on SPARK-6435: -- {code} if [%2]==[] ( {code} I think

[jira] [Assigned] (SPARK-1706) Allow multiple executors per worker in Standalone mode

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1706: --- Assignee: Nan Zhu (was: Apache Spark) Allow multiple executors per worker in Standalone

[jira] [Assigned] (SPARK-1706) Allow multiple executors per worker in Standalone mode

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1706: --- Assignee: Apache Spark (was: Nan Zhu) Allow multiple executors per worker in Standalone

[jira] [Assigned] (SPARK-6379) Support a functon to call user-defined functions registered in SQLContext

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6379: --- Assignee: Apache Spark Support a functon to call user-defined functions registered in

[jira] [Assigned] (SPARK-6379) Support a functon to call user-defined functions registered in SQLContext

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6379: --- Assignee: (was: Apache Spark) Support a functon to call user-defined functions

[jira] [Created] (SPARK-6547) Missing import Files in InsertIntoHiveTableSuite.scala

2015-03-26 Thread Zhichao Zhang (JIRA)
Zhichao Zhang created SPARK-6547: - Summary: Missing import Files in InsertIntoHiveTableSuite.scala Key: SPARK-6547 URL: https://issues.apache.org/jira/browse/SPARK-6547 Project: Spark Issue

[jira] [Updated] (SPARK-6547) Missing import Files in InsertIntoHiveTableSuite.scala

2015-03-26 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-6547: -- Description: missing import Files, build error as follows: {quote} [error]

[jira] [Updated] (SPARK-6547) Missing import Files in InsertIntoHiveTableSuite.scala

2015-03-26 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-6547: -- Description: missing import Files, build error as follows: {quote} [error]

[jira] [Assigned] (SPARK-6547) Missing import Files in InsertIntoHiveTableSuite.scala

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6547: --- Assignee: Apache Spark Missing import Files in InsertIntoHiveTableSuite.scala

[jira] [Assigned] (SPARK-6547) Missing import Files in InsertIntoHiveTableSuite.scala

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6547: --- Assignee: (was: Apache Spark) Missing import Files in InsertIntoHiveTableSuite.scala

[jira] [Commented] (SPARK-6547) Missing import Files in InsertIntoHiveTableSuite.scala

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381473#comment-14381473 ] Apache Spark commented on SPARK-6547: - User 'zzcclp' has created a pull request for

[jira] [Resolved] (SPARK-6536) Add IN to python Column

2015-03-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6536. Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Target

[jira] [Closed] (SPARK-6547) Missing import Files in InsertIntoHiveTableSuite.scala

2015-03-26 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang closed SPARK-6547. - Resolution: Duplicate It is duplicate

[jira] [Assigned] (SPARK-6117) describe function for summary statistics

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6117: --- Assignee: Apache Spark describe function for summary statistics

[jira] [Assigned] (SPARK-6117) describe function for summary statistics

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6117: --- Assignee: (was: Apache Spark) describe function for summary statistics

[jira] [Commented] (SPARK-6117) describe function for summary statistics

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381527#comment-14381527 ] Apache Spark commented on SPARK-6117: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-6521) executors in the same node read local shuffle file

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6521: --- Assignee: Apache Spark executors in the same node read local shuffle file

[jira] [Updated] (SPARK-6548) Adding stddev to DataFrame functions

2015-03-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6548: --- Labels: DataFrame starter (was: starter) Adding stddev to DataFrame functions

[jira] [Created] (SPARK-6548) Adding stddev to DataFrame functions

2015-03-26 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-6548: -- Summary: Adding stddev to DataFrame functions Key: SPARK-6548 URL: https://issues.apache.org/jira/browse/SPARK-6548 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-6548) Adding stddev to DataFrame functions

2015-03-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6548: --- Fix Version/s: 1.4.0 Adding stddev to DataFrame functions

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

2015-03-26 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381934#comment-14381934 ] Nicholas Chammas commented on SPARK-6481: - Im willing to update this if there is a

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

2015-03-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381944#comment-14381944 ] Josh Rosen commented on SPARK-6481: --- Actually, I haven't triggered the mass update quite

[jira] [Commented] (SPARK-6504) Cannot read Parquet files generated from different versions at once

2015-03-26 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382020#comment-14382020 ] Michael Armbrust commented on SPARK-6504: - Have you tried this with Spark 1.3?

[jira] [Updated] (SPARK-6550) Add PreAnalyzer to keep logical plan consistent across DataFrame

2015-03-26 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6550: Target Version/s: 1.3.1 Add PreAnalyzer to keep logical plan consistent across DataFrame

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

2015-03-26 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381939#comment-14381939 ] Nicholas Chammas commented on SPARK-6481: - Also, there was a one time mass update

[jira] [Commented] (SPARK-6504) Cannot read Parquet files generated from different versions at once

2015-03-26 Thread Marius Soutier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382073#comment-14382073 ] Marius Soutier commented on SPARK-6504: --- Not easily, but 1.3.1 is supposed to be

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

2015-03-26 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381975#comment-14381975 ] Nicholas Chammas commented on SPARK-6481: - Oh, never mind then. :-} Set In

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

2015-03-26 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381976#comment-14381976 ] Nicholas Chammas commented on SPARK-6481: - Oh, never mind then. :-} Set In

[jira] [Resolved] (SPARK-6480) histogram() bucket function is wrong in some simple edge cases

2015-03-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6480. -- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 1.2.2

[jira] [Updated] (SPARK-6538) Add missing nullable Metastore fields when merging a Parquet schema

2015-03-26 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6538: Target Version/s: 1.3.1, 1.4.0 Fix Version/s: (was: 1.3.1) Add missing nullable

[jira] [Commented] (SPARK-6504) Cannot read Parquet files generated from different versions at once

2015-03-26 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382032#comment-14382032 ] Michael Armbrust commented on SPARK-6504: - Ah, I see. Would you be able to try

[jira] [Commented] (SPARK-6504) Cannot read Parquet files generated from different versions at once

2015-03-26 Thread Marius Soutier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382027#comment-14382027 ] Marius Soutier commented on SPARK-6504: --- No, as far as I understand, Spark 1.3

[jira] [Commented] (SPARK-6264) Python API for FPGrowth

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382096#comment-14382096 ] Apache Spark commented on SPARK-6264: - User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-6264) Python API for FPGrowth

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6264: --- Assignee: (was: Apache Spark) Python API for FPGrowth ---

[jira] [Assigned] (SPARK-6264) Python API for FPGrowth

2015-03-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6264: --- Assignee: Apache Spark Python API for FPGrowth ---

<    1   2   3   >