[jira] [Updated] (SPARK-10796) The Stage taskSets may are all removed while stage still have pending partitions after having lost some executors

2016-05-10 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SuYan updated SPARK-10796: -- Description: We meet that problem in Spark 1.3.0, and I also check the latest Spark code, and I think that

[jira] [Updated] (SPARK-14261) Memory leak in Spark Thrift Server

2016-05-10 Thread Xiaochun Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochun Liang updated SPARK-14261: --- Attachment: 8892_MemorySnapshot.PNG 8892_6g_stop_longrunquery_objects.PNG

[jira] [Commented] (SPARK-14261) Memory leak in Spark Thrift Server

2016-05-10 Thread Xiaochun Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277789#comment-15277789 ] Xiaochun Liang commented on SPARK-14261: I tried the fix on Spark-1.6.1, apply the fix in

[jira] [Commented] (SPARK-15100) Audit: ml.feature

2016-05-10 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277767#comment-15277767 ] yuhao yang commented on SPARK-15100: Improvements or new features in spark.ml.feature: ||feature

[jira] [Updated] (SPARK-14939) Add FoldablePropagation optimizer

2016-05-10 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-14939: -- Description: This issues aims to add new FoldablePropagation optimizer that propagates

[jira] [Created] (SPARK-15247) sqlCtx.read.parquet yields at least n_executors * n_cores tasks

2016-05-10 Thread Johnny W. (JIRA)
Johnny W. created SPARK-15247: - Summary: sqlCtx.read.parquet yields at least n_executors * n_cores tasks Key: SPARK-15247 URL: https://issues.apache.org/jira/browse/SPARK-15247 Project: Spark

[jira] [Commented] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277716#comment-15277716 ] Hyukjin Kwon commented on SPARK-15245: -- (BTW, as you might already know, the reason why I thought

[jira] [Comment Edited] (SPARK-14261) Memory leak in Spark Thrift Server

2016-05-10 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15275238#comment-15275238 ] Weizhong edited comment on SPARK-14261 at 5/10/16 6:52 AM: --- I also face this

[jira] [Commented] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277700#comment-15277700 ] Hyukjin Kwon commented on SPARK-15245: -- Thank you so much. Let me close my PR. > stream API throws

[jira] [Commented] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277697#comment-15277697 ] Sean Owen commented on SPARK-15245: --- The message seems correct. I agree it could possibly be checked

[jira] [Commented] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277696#comment-15277696 ] Hyukjin Kwon commented on SPARK-15245: -- Oh, the main reason is, I thought {{'basePath' must be a

[jira] [Resolved] (SPARK-15239) spark document conflict about mesos cluster

2016-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15239. --- Resolution: Not A Problem If you take a look at the docs in the repo you can see this has been

[jira] [Resolved] (SPARK-15228) pyspark.RDD.toLocalIterator Documentation

2016-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15228. --- Resolution: Not A Problem > pyspark.RDD.toLocalIterator Documentation >

[jira] [Updated] (SPARK-14623) add label binarizer

2016-05-10 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiayin updated SPARK-14623: - Description: It relates to https://issues.apache.org/jira/browse/SPARK-7445 Map the labels to 0/1. For

[jira] [Commented] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277690#comment-15277690 ] Sean Owen commented on SPARK-15245: --- Hm, what's the issue here? it says the arg was not a directory,

[jira] [Comment Edited] (SPARK-15228) pyspark.RDD.toLocalIterator Documentation

2016-05-10 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277688#comment-15277688 ] Sandeep Singh edited comment on SPARK-15228 at 5/10/16 6:21 AM: Seems to

[jira] [Commented] (SPARK-15228) pyspark.RDD.toLocalIterator Documentation

2016-05-10 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277688#comment-15277688 ] Sandeep Singh commented on SPARK-15228: --- Seems to be fixed in the current master. Before

[jira] [Commented] (SPARK-14162) java.lang.IllegalStateException: Did not find registered driver with class oracle.jdbc.OracleDriver

2016-05-10 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277682#comment-15277682 ] Sun Rui commented on SPARK-14162: - We met the same error. The cause is that in one worker node, mysql

[jira] [Commented] (SPARK-15228) pyspark.RDD.toLocalIterator Documentation

2016-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277681#comment-15277681 ] Sean Owen commented on SPARK-15228: --- Still not clear what that means. Can you make a pull request? >

[jira] [Assigned] (SPARK-15246) Fix code style and improve volatile for SPARK-4452

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15246: Assignee: (was: Apache Spark) > Fix code style and improve volatile for SPARK-4452 >

[jira] [Updated] (SPARK-15246) Fix code style and improve volatile for SPARK-4452

2016-05-10 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-15246: - Summary: Fix code style and improve volatile for SPARK-4452 (was: Fix code style and improve

[jira] [Commented] (SPARK-15246) Fix code style and improve volatile for SPARK-4452

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277672#comment-15277672 ] Apache Spark commented on SPARK-15246: -- User 'lianhuiwang' has created a pull request for this

[jira] [Assigned] (SPARK-15246) Fix code style and improve volatile for SPARK-4452

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15246: Assignee: Apache Spark > Fix code style and improve volatile for SPARK-4452 >

[jira] [Created] (SPARK-15246) Fix code style and improve volatile for Spillable

2016-05-10 Thread Lianhui Wang (JIRA)
Lianhui Wang created SPARK-15246: Summary: Fix code style and improve volatile for Spillable Key: SPARK-15246 URL: https://issues.apache.org/jira/browse/SPARK-15246 Project: Spark Issue

<    1   2   3