[jira] [Created] (SPARK-10846) Stray META-INF in directory spark-shell is launched from causes problems

2015-09-27 Thread Ryan Williams (JIRA)
Ryan Williams created SPARK-10846: - Summary: Stray META-INF in directory spark-shell is launched from causes problems Key: SPARK-10846 URL: https://issues.apache.org/jira/browse/SPARK-10846 Project:

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-27 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909764#comment-14909764 ] Ondřej Smola commented on SPARK-8734: - Problem is limitation of java Properties format - common

[jira] [Resolved] (SPARK-10741) Hive Query Having/OrderBy against Parquet table is not working

2015-09-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-10741. -- Resolution: Fixed Fix Version/s: 1.6.0 1.5.2 This issue has been resolved by

[jira] [Comment Edited] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-27 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909764#comment-14909764 ] Ondřej Smola edited comment on SPARK-8734 at 9/27/15 2:55 PM: -- Problem is

[jira] [Commented] (SPARK-10722) Uncaught exception: RDDBlockId not found in driver-heartbeater

2015-09-27 Thread Michael Malak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909883#comment-14909883 ] Michael Malak commented on SPARK-10722: --- I have seen this in a small Hello World type program

[jira] [Resolved] (SPARK-10720) Add a java wrapper to create dataframe from a local list of Java Beans.

2015-09-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10720. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8879

[jira] [Updated] (SPARK-10720) Add a java wrapper to create dataframe from a local list of Java Beans.

2015-09-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10720: -- Assignee: holdenk > Add a java wrapper to create dataframe from a local list of Java Beans. >

[jira] [Created] (SPARK-10848) Applied JSON Schema Works for json RDD but not when loading json file

2015-09-27 Thread Miklos Christine (JIRA)
Miklos Christine created SPARK-10848: Summary: Applied JSON Schema Works for json RDD but not when loading json file Key: SPARK-10848 URL: https://issues.apache.org/jira/browse/SPARK-10848

[jira] [Commented] (SPARK-10644) Applications wait even if free executors are available

2015-09-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909873#comment-14909873 ] Sean Owen commented on SPARK-10644: --- Yes, but how much memory do the workers allocate to executors? >

[jira] [Commented] (SPARK-10846) Stray META-INF in directory spark-shell is launched from causes problems

2015-09-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909872#comment-14909872 ] Sean Owen commented on SPARK-10846: --- It's a standard Java mechanism, yes. It would have to be on the

[jira] [Created] (SPARK-10847) Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure

2015-09-27 Thread Shea Parkes (JIRA)
Shea Parkes created SPARK-10847: --- Summary: Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure Key: SPARK-10847 URL: https://issues.apache.org/jira/browse/SPARK-10847 Project:

[jira] [Updated] (SPARK-10850) WholeTextFileRDD only affect the first line in each partition

2015-09-27 Thread Fengdong Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu updated SPARK-10850: Component/s: Spark Core > WholeTextFileRDD only affect the first line in each partition >

[jira] [Assigned] (SPARK-10688) Python API for AFTSurvivalRegression

2015-09-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10688: Assignee: Apache Spark > Python API for AFTSurvivalRegression >

[jira] [Commented] (SPARK-10688) Python API for AFTSurvivalRegression

2015-09-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909738#comment-14909738 ] Apache Spark commented on SPARK-10688: -- User 'vectorijk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10688) Python API for AFTSurvivalRegression

2015-09-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10688: Assignee: (was: Apache Spark) > Python API for AFTSurvivalRegression >

[jira] [Commented] (SPARK-10778) Implement toString for AssociationRules.Rule

2015-09-27 Thread shimizu yoshihiro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909941#comment-14909941 ] shimizu yoshihiro commented on SPARK-10778: --- Thanks! > Implement toString for

[jira] [Created] (SPARK-10849) Allow user to specify database column type for data frame fields when writing data to jdbc data sources.

2015-09-27 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-10849: Summary: Allow user to specify database column type for data frame fields when writing data to jdbc data sources. Key: SPARK-10849 URL:

[jira] [Commented] (SPARK-7160) Support converting DataFrames to typed RDDs.

2015-09-27 Thread Ray Ortigas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909971#comment-14909971 ] Ray Ortigas commented on SPARK-7160: Hi [~marmbrus], I just updated the PR again based on your

[jira] [Created] (SPARK-10850) wholeTextFileRDD only affect the first line in each partition

2015-09-27 Thread Fengdong Yu (JIRA)
Fengdong Yu created SPARK-10850: --- Summary: wholeTextFileRDD only affect the first line in each partition Key: SPARK-10850 URL: https://issues.apache.org/jira/browse/SPARK-10850 Project: Spark

[jira] [Updated] (SPARK-10850) WholeTextFileRDD only affect the first line in each partition

2015-09-27 Thread Fengdong Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu updated SPARK-10850: Summary: WholeTextFileRDD only affect the first line in each partition (was: wholeTextFileRDD

[jira] [Updated] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2015-09-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-4066: -- Description: Here is the thread Koert started:

[jira] [Commented] (SPARK-10849) Allow user to specify database column type for data frame fields when writing data to jdbc data sources.

2015-09-27 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909972#comment-14909972 ] Suresh Thalamati commented on SPARK-10849: -- I am working on creating pull request for this

[jira] [Comment Edited] (SPARK-10796) The Stage taskSets may are all removed while stage still have pending partitions after having lost some executors

2015-09-27 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909990#comment-14909990 ] SuYan edited comment on SPARK-10796 at 9/28/15 2:59 AM: Running Stage 0, running

[jira] [Commented] (SPARK-10796) The Stage taskSets may are all removed while stage still have pending partitions after having lost some executors

2015-09-27 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909990#comment-14909990 ] SuYan commented on SPARK-10796: --- Running Stage 0, running TaskSet0.0, Finshed task0.0 in ExecA, running

[jira] [Updated] (SPARK-10829) Scan DataSource with predicate expression combine partition key and attributes doesn't work

2015-09-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10829: - Priority: Critical (was: Blocker) > Scan DataSource with predicate expression combine partition key and

[jira] [Updated] (SPARK-10829) Scan DataSource with predicate expression combine partition key and attributes doesn't work

2015-09-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10829: - Target Version/s: 1.5.2, 1.6.0 > Scan DataSource with predicate expression combine partition key and >

[jira] [Comment Edited] (SPARK-10796) The Stage taskSets may are all removed while stage still have pending partitions after having lost some executors

2015-09-27 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909990#comment-14909990 ] SuYan edited comment on SPARK-10796 at 9/28/15 3:00 AM: Running Stage 0.0,

[jira] [Assigned] (SPARK-10796) The Stage taskSets may are all removed while stage still have pending partitions after having lost some executors

2015-09-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10796: Assignee: (was: Apache Spark) > The Stage taskSets may are all removed while stage

[jira] [Assigned] (SPARK-10796) The Stage taskSets may are all removed while stage still have pending partitions after having lost some executors

2015-09-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10796: Assignee: Apache Spark > The Stage taskSets may are all removed while stage still have

[jira] [Commented] (SPARK-10796) The Stage taskSets may are all removed while stage still have pending partitions after having lost some executors

2015-09-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909996#comment-14909996 ] Apache Spark commented on SPARK-10796: -- User 'suyanNone' has created a pull request for this issue:

[jira] [Commented] (SPARK-10644) Applications wait even if free executors are available

2015-09-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909726#comment-14909726 ] Sean Owen commented on SPARK-10644: --- What is your memory config -- just to double-check? as you say,

[jira] [Commented] (SPARK-10644) Applications wait even if free executors are available

2015-09-27 Thread Balagopal Nair (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909758#comment-14909758 ] Balagopal Nair commented on SPARK-10644: That's true.. My memory config is 512m per executor

[jira] [Resolved] (SPARK-10778) Implement toString for AssociationRules.Rule

2015-09-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10778. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8904

[jira] [Updated] (SPARK-10597) MultivariateOnlineSummarizer for weighted instances

2015-09-27 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-10597: Assignee: DB Tsai > MultivariateOnlineSummarizer for weighted instances >