[jira] [Created] (SPARK-10387) Code generation for decision tree

2015-09-01 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-10387: - Summary: Code generation for decision tree Key: SPARK-10387 URL: https://issues.apache.org/jira/browse/SPARK-10387 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-7132) Add fit with validation set to spark.ml GBT

2015-09-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724889#comment-14724889 ] Yanbo Liang commented on SPARK-7132: I will work on this issue. [~josephkb] I propose

[jira] [Comment Edited] (SPARK-7132) Add fit with validation set to spark.ml GBT

2015-09-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724889#comment-14724889 ] Yanbo Liang edited comment on SPARK-7132 at 9/1/15 7:02 AM: I

[jira] [Comment Edited] (SPARK-7132) Add fit with validation set to spark.ml GBT

2015-09-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724889#comment-14724889 ] Yanbo Liang edited comment on SPARK-7132 at 9/1/15 7:03 AM: I

[jira] [Created] (SPARK-10388) Public dataset loader interface

2015-09-01 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-10388: - Summary: Public dataset loader interface Key: SPARK-10388 URL: https://issues.apache.org/jira/browse/SPARK-10388 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-10324) MLlib 1.6 Roadmap

2015-09-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10324: -- Description: Following SPARK-8445, we created this master list for MLlib features we plan to h

[jira] [Updated] (SPARK-10324) MLlib 1.6 Roadmap

2015-09-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10324: -- Description: Following SPARK-8445, we created this master list for MLlib features we plan to h

[jira] [Updated] (SPARK-10324) MLlib 1.6 Roadmap

2015-09-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10324: -- Description: Following SPARK-8445, we created this master list for MLlib features we plan to h

[jira] [Updated] (SPARK-10324) MLlib 1.6 Roadmap

2015-09-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10324: -- Priority: Blocker (was: Critical) > MLlib 1.6 Roadmap > - > >

[jira] [Updated] (SPARK-10324) MLlib 1.6 Roadmap

2015-09-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10324: -- Description: Following SPARK-8445, we created this master list for MLlib features we plan to h

[jira] [Commented] (SPARK-10324) MLlib 1.6 Roadmap

2015-09-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724899#comment-14724899 ] Xiangrui Meng commented on SPARK-10324: --- Changed priority to blocker to make this l

[jira] [Created] (SPARK-10389) support order by non-attribute grouping expression on Aggregate

2015-09-01 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-10389: --- Summary: support order by non-attribute grouping expression on Aggregate Key: SPARK-10389 URL: https://issues.apache.org/jira/browse/SPARK-10389 Project: Spark

[jira] [Updated] (SPARK-10389) support order by non-attribute grouping expression on Aggregate

2015-09-01 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-10389: Description: For example, we should support "SELECT MAX(value) FROM src GROUP BY key + 1 ORDER BY k

[jira] [Commented] (SPARK-10389) support order by non-attribute grouping expression on Aggregate

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724905#comment-14724905 ] Apache Spark commented on SPARK-10389: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-10389) support order by non-attribute grouping expression on Aggregate

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10389: Assignee: (was: Apache Spark) > support order by non-attribute grouping expression on

[jira] [Assigned] (SPARK-10389) support order by non-attribute grouping expression on Aggregate

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10389: Assignee: Apache Spark > support order by non-attribute grouping expression on Aggregate >

[jira] [Created] (SPARK-10390) Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J

2015-09-01 Thread JIRA
Zoltán Zvara created SPARK-10390: Summary: Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J Key: SPARK-10390 URL: https://issues.apache.org/jira/browse/SPARK-10390

[jira] [Created] (SPARK-10391) Spark 1.4.1 released news under news/spark-1-3-1-released.html

2015-09-01 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-10391: --- Summary: Spark 1.4.1 released news under news/spark-1-3-1-released.html Key: SPARK-10391 URL: https://issues.apache.org/jira/browse/SPARK-10391 Project: Spark

[jira] [Commented] (SPARK-10261) Add @Since annotation to ml.evaluation

2015-09-01 Thread Tijo Thomas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724975#comment-14724975 ] Tijo Thomas commented on SPARK-10261: - I am working on this issue. > Add @Since ann

[jira] [Created] (SPARK-10392) Pyspark - Wrong DateType support

2015-09-01 Thread JIRA
Maciej Bryński created SPARK-10392: -- Summary: Pyspark - Wrong DateType support Key: SPARK-10392 URL: https://issues.apache.org/jira/browse/SPARK-10392 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-7770) Should GBT validationTol be relative tolerance?

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7770: --- Assignee: (was: Apache Spark) > Should GBT validationTol be relative tolerance? > ---

[jira] [Commented] (SPARK-7770) Should GBT validationTol be relative tolerance?

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725013#comment-14725013 ] Apache Spark commented on SPARK-7770: - User 'yanboliang' has created a pull request fo

[jira] [Assigned] (SPARK-7770) Should GBT validationTol be relative tolerance?

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7770: --- Assignee: Apache Spark > Should GBT validationTol be relative tolerance? > --

[jira] [Resolved] (SPARK-10301) For struct type, if parquet's global schema has less fields than a file's schema, data reading will fail

2015-09-01 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-10301. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8509 [https://github.c

[jira] [Updated] (SPARK-10392) Pyspark - Wrong DateType support

2015-09-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-10392: --- Affects Version/s: 1.4.1 > Pyspark - Wrong DateType support > ---

[jira] [Assigned] (SPARK-10370) After a stages map outputs are registered, all running attempts should be marked as zombies

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10370: Assignee: (was: Apache Spark) > After a stages map outputs are registered, all running

[jira] [Commented] (SPARK-10370) After a stages map outputs are registered, all running attempts should be marked as zombies

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725043#comment-14725043 ] Apache Spark commented on SPARK-10370: -- User 'suyanNone' has created a pull request

[jira] [Assigned] (SPARK-10370) After a stages map outputs are registered, all running attempts should be marked as zombies

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10370: Assignee: Apache Spark > After a stages map outputs are registered, all running attempts s

[jira] [Commented] (SPARK-10246) Join in PySpark using a list of column names

2015-09-01 Thread Alexey Grishchenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725045#comment-14725045 ] Alexey Grishchenko commented on SPARK-10246: Cannot reproduce, all the option

[jira] [Updated] (SPARK-10390) Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J

2015-09-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltán Zvara updated SPARK-10390: - Description: While running PySpark through iPython. {code} Py4JJavaError: An error occurred whil

[jira] [Updated] (SPARK-10390) Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J

2015-09-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltán Zvara updated SPARK-10390: - Description: While running PySpark through iPython. {code} Py4JJavaError: An error occurred whil

[jira] [Updated] (SPARK-10392) Pyspark - Wrong DateType support

2015-09-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-10392: --- Description: I have following problem. I created table. {code} CREATE TABLE `spark_test` (

[jira] [Updated] (SPARK-10392) Pyspark - Wrong DateType support

2015-09-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-10392: --- Description: I have following problem. I created table. {code} CREATE TABLE `spark_test` (

[jira] [Commented] (SPARK-7544) pyspark.sql.types.Row should implement __getitem__

2015-09-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725066#comment-14725066 ] Maciej Bryński commented on SPARK-7544: --- Will this PR be added to spark ? > pyspark

[jira] [Updated] (SPARK-10390) Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J

2015-09-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltán Zvara updated SPARK-10390: - Description: While running PySpark through iPython. {code} Py4JJavaError: An error occurred whil

[jira] [Resolved] (SPARK-10391) Spark 1.4.1 released news under news/spark-1-3-1-released.html

2015-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10391. --- Resolution: Fixed Assignee: Sean Owen Fix Version/s: 1.5.0 Fixed and pushed a revisio

[jira] [Created] (SPARK-10393) use ML pipeline in LDA example

2015-09-01 Thread yuhao yang (JIRA)
yuhao yang created SPARK-10393: -- Summary: use ML pipeline in LDA example Key: SPARK-10393 URL: https://issues.apache.org/jira/browse/SPARK-10393 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-10390) Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J

2015-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725073#comment-14725073 ] Sean Owen commented on SPARK-10390: --- This means you've pulled in a later version of Gua

[jira] [Updated] (SPARK-10314) [CORE]RDD persist to OFF_HEAP tachyon got block rdd_x_x not found exception when parallelism is big than data split size

2015-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10314: -- Fix Version/s: (was: 1.6.0) [~wangxiaoyu] Don't set Fix version; it's not resolved. > [CORE]RDD pe

[jira] [Commented] (SPARK-10393) use ML pipeline in LDA example

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725078#comment-14725078 ] Apache Spark commented on SPARK-10393: -- User 'hhbyyh' has created a pull request for

[jira] [Assigned] (SPARK-10393) use ML pipeline in LDA example

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10393: Assignee: (was: Apache Spark) > use ML pipeline in LDA example > -

[jira] [Assigned] (SPARK-10393) use ML pipeline in LDA example

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10393: Assignee: Apache Spark > use ML pipeline in LDA example > -- >

[jira] [Resolved] (SPARK-9089) Failing to run simple job on Spark Standalone Cluster

2015-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9089. -- Resolution: Cannot Reproduce > Failing to run simple job on Spark Standalone Cluster > -

[jira] [Updated] (SPARK-10392) Pyspark - Wrong DateType support

2015-09-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-10392: --- Description: I have following problem. I created table. {code} CREATE TABLE `spark_test` (

[jira] [Commented] (SPARK-9878) ReduceByKey + FullOuterJoin return 0 element if using an empty RDD

2015-09-01 Thread Alexey Grishchenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725117#comment-14725117 ] Alexey Grishchenko commented on SPARK-9878: --- Not reproduced on master: {code} sc

[jira] [Resolved] (SPARK-9878) ReduceByKey + FullOuterJoin return 0 element if using an empty RDD

2015-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9878. -- Resolution: Cannot Reproduce Agree, I also can't reproduce this. > ReduceByKey + FullOuterJoin return

[jira] [Updated] (SPARK-8730) Deser primitive class with Java serialization

2015-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8730: - Assignee: Eugen Cepoi > Deser primitive class with Java serialization > --

[jira] [Updated] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

2015-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10374: -- Component/s: Build > Spark-core 1.5.0-RC2 can create version conflicts with apps depending on > protob

[jira] [Created] (SPARK-10394) Make GBTParams use shared "stepSize"

2015-09-01 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-10394: --- Summary: Make GBTParams use shared "stepSize" Key: SPARK-10394 URL: https://issues.apache.org/jira/browse/SPARK-10394 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-10394) Make GBTParams use shared "stepSize"

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725133#comment-14725133 ] Apache Spark commented on SPARK-10394: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-10394) Make GBTParams use shared "stepSize"

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10394: Assignee: (was: Apache Spark) > Make GBTParams use shared "stepSize" > ---

[jira] [Assigned] (SPARK-10394) Make GBTParams use shared "stepSize"

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10394: Assignee: Apache Spark > Make GBTParams use shared "stepSize" > --

[jira] [Commented] (SPARK-9622) DecisionTreeRegressor: provide variance of prediction

2015-09-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725137#comment-14725137 ] Yanbo Liang commented on SPARK-9622: I agree to return a Double column of variances at

[jira] [Created] (SPARK-10395) Simplify CatalystReadSupport

2015-09-01 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-10395: -- Summary: Simplify CatalystReadSupport Key: SPARK-10395 URL: https://issues.apache.org/jira/browse/SPARK-10395 Project: Spark Issue Type: Improvement Co

[jira] [Commented] (SPARK-10395) Simplify CatalystReadSupport

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725175#comment-14725175 ] Apache Spark commented on SPARK-10395: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-10395) Simplify CatalystReadSupport

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10395: Assignee: Cheng Lian (was: Apache Spark) > Simplify CatalystReadSupport > ---

[jira] [Assigned] (SPARK-10395) Simplify CatalystReadSupport

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10395: Assignee: Apache Spark (was: Cheng Lian) > Simplify CatalystReadSupport > ---

[jira] [Commented] (SPARK-10390) Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J

2015-09-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725189#comment-14725189 ] Zoltán Zvara commented on SPARK-10390: -- I did not packed Guava with my app, this is

[jira] [Comment Edited] (SPARK-10390) Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J

2015-09-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725189#comment-14725189 ] Zoltán Zvara edited comment on SPARK-10390 at 9/1/15 11:03 AM:

[jira] [Commented] (SPARK-10390) Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J

2015-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725199#comment-14725199 ] Sean Owen commented on SPARK-10390: --- It definitely means you have a later version of Gu

[jira] [Commented] (SPARK-10199) Avoid using reflections for parquet model save

2015-09-01 Thread Vinod KC (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725211#comment-14725211 ] Vinod KC commented on SPARK-10199: -- [~mengxr] I've measured the overhead of reflexion in

[jira] [Created] (SPARK-10396) spark-sql ctrl+c does not exit

2015-09-01 Thread linbao111 (JIRA)
linbao111 created SPARK-10396: - Summary: spark-sql ctrl+c does not exit Key: SPARK-10396 URL: https://issues.apache.org/jira/browse/SPARK-10396 Project: Spark Issue Type: Bug Components

[jira] [Resolved] (SPARK-10396) spark-sql ctrl+c does not exit

2015-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10396. --- Resolution: Duplicate It's helpful if you can please search JIRA first. It easy to find several issu

[jira] [Commented] (SPARK-5226) Add DBSCAN Clustering Algorithm to MLlib

2015-09-01 Thread Rajeev Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725284#comment-14725284 ] Rajeev Reddy commented on SPARK-5226: - Hello Aliaksei Litouka, I have looked into your

[jira] [Updated] (SPARK-10392) Pyspark - Wrong DateType support on JDBC connection

2015-09-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-10392: --- Summary: Pyspark - Wrong DateType support on JDBC connection (was: Pyspark - Wrong DateType

[jira] [Commented] (SPARK-10261) Add @Since annotation to ml.evaluation

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725300#comment-14725300 ] Apache Spark commented on SPARK-10261: -- User 'tijoparacka' has created a pull reques

[jira] [Assigned] (SPARK-10261) Add @Since annotation to ml.evaluation

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10261: Assignee: (was: Apache Spark) > Add @Since annotation to ml.evaluation > -

[jira] [Assigned] (SPARK-10261) Add @Since annotation to ml.evaluation

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10261: Assignee: Apache Spark > Add @Since annotation to ml.evaluation >

[jira] [Commented] (SPARK-10162) PySpark filters with datetimes mess up when datetimes have timezones.

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725329#comment-14725329 ] Apache Spark commented on SPARK-10162: -- User '0x0FFF' has created a pull request for

[jira] [Created] (SPARK-10397) Make Python's SparkContext self-descriptive on "print sc"

2015-09-01 Thread Sergey Tryuber (JIRA)
Sergey Tryuber created SPARK-10397: -- Summary: Make Python's SparkContext self-descriptive on "print sc" Key: SPARK-10397 URL: https://issues.apache.org/jira/browse/SPARK-10397 Project: Spark

[jira] [Commented] (SPARK-10262) Add @Since annotation to ml.attribute

2015-09-01 Thread Tijo Thomas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725388#comment-14725388 ] Tijo Thomas commented on SPARK-10262: - I am working on this. > Add @Since annotation

[jira] [Commented] (SPARK-10392) Pyspark - Wrong DateType support on JDBC connection

2015-09-01 Thread Alexey Grishchenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725390#comment-14725390 ] Alexey Grishchenko commented on SPARK-10392: This is a corner case for DateTy

[jira] [Assigned] (SPARK-10392) Pyspark - Wrong DateType support on JDBC connection

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10392: Assignee: Apache Spark > Pyspark - Wrong DateType support on JDBC connection > ---

[jira] [Commented] (SPARK-10392) Pyspark - Wrong DateType support on JDBC connection

2015-09-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725404#comment-14725404 ] Maciej Bryński commented on SPARK-10392: {code} class DateType(AtomicType): "

[jira] [Assigned] (SPARK-10392) Pyspark - Wrong DateType support on JDBC connection

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10392: Assignee: (was: Apache Spark) > Pyspark - Wrong DateType support on JDBC connection >

[jira] [Comment Edited] (SPARK-10392) Pyspark - Wrong DateType support on JDBC connection

2015-09-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725404#comment-14725404 ] Maciej Bryński edited comment on SPARK-10392 at 9/1/15 1:38 PM: ---

[jira] [Commented] (SPARK-10392) Pyspark - Wrong DateType support on JDBC connection

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725403#comment-14725403 ] Apache Spark commented on SPARK-10392: -- User '0x0FFF' has created a pull request for

[jira] [Issue Comment Deleted] (SPARK-10392) Pyspark - Wrong DateType support on JDBC connection

2015-09-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-10392: --- Comment: was deleted (was: {code} class DateType(AtomicType): """Date (datetime.date) dat

[jira] [Created] (SPARK-10398) Migrate Spark download page to use new lua mirroring scripts

2015-09-01 Thread Luciano Resende (JIRA)
Luciano Resende created SPARK-10398: --- Summary: Migrate Spark download page to use new lua mirroring scripts Key: SPARK-10398 URL: https://issues.apache.org/jira/browse/SPARK-10398 Project: Spark

[jira] [Updated] (SPARK-10398) Migrate Spark download page to use new lua mirroring scripts

2015-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10398: -- Assignee: Sean Owen Priority: Minor (was: Major) Issue Type: Task (was: Bug) No problem,

[jira] [Resolved] (SPARK-10398) Migrate Spark download page to use new lua mirroring scripts

2015-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10398. --- Resolution: Fixed Fix Version/s: 1.5.0 > Migrate Spark download page to use new lua mirroring

[jira] [Comment Edited] (SPARK-10199) Avoid using reflections for parquet model save

2015-09-01 Thread Vinod KC (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725211#comment-14725211 ] Vinod KC edited comment on SPARK-10199 at 9/1/15 2:15 PM: -- [~men

[jira] [Created] (SPARK-10399) Off Heap Memory Access for non-JVM libraries (C++)

2015-09-01 Thread Paul Weiss (JIRA)
Paul Weiss created SPARK-10399: -- Summary: Off Heap Memory Access for non-JVM libraries (C++) Key: SPARK-10399 URL: https://issues.apache.org/jira/browse/SPARK-10399 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-10375) Setting the driver memory with SparkConf().set("spark.driver.memory","1g") does not work

2015-09-01 Thread Alex Rovner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725473#comment-14725473 ] Alex Rovner commented on SPARK-10375: - May I suggest throwing an exception when certa

[jira] [Updated] (SPARK-10375) Setting the driver memory with SparkConf().set("spark.driver.memory","1g") does not work

2015-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10375: -- Issue Type: Improvement (was: Bug) > Setting the driver memory with SparkConf().set("spark.driver.memo

[jira] [Commented] (SPARK-10314) [CORE]RDD persist to OFF_HEAP tachyon got block rdd_x_x not found exception when parallelism is big than data split size

2015-09-01 Thread Xiaoyu Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725530#comment-14725530 ] Xiaoyu Wang commented on SPARK-10314: - Yes,Any questions with the pull request? Do yo

[jira] [Commented] (SPARK-2666) when task is FetchFailed cancel running tasks of failedStage

2015-09-01 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725552#comment-14725552 ] Imran Rashid commented on SPARK-2666: - I'm copying [~kayousterhout]'s comment from the

[jira] [Updated] (SPARK-10370) After a stages map outputs are registered, all running attempts should be marked as zombies

2015-09-01 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-10370: - Description: Follow up to SPARK-5259. During stage retry, its possible for a stage to "complete

[jira] [Reopened] (SPARK-10398) Migrate Spark download page to use new lua mirroring scripts

2015-09-01 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende reopened SPARK-10398: - There are few other places where the closer.cgi is referenced. > Migrate Spark download page

[jira] [Updated] (SPARK-10398) Migrate Spark download page to use new lua mirroring scripts

2015-09-01 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende updated SPARK-10398: Attachment: SPARK-10398 This patch handles other download links referenced on the Spark doc

[jira] [Commented] (SPARK-9988) Create local (external) sort operator

2015-09-01 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725589#comment-14725589 ] Shixiong Zhu commented on SPARK-9988: - {{ExternalSorter}} is coupled with {{SparkEnv}}

[jira] [Commented] (SPARK-10398) Migrate Spark download page to use new lua mirroring scripts

2015-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725592#comment-14725592 ] Sean Owen commented on SPARK-10398: --- Good catch, there's another use in the project doc

[jira] [Created] (SPARK-10400) Rename or deprecate SQL option "spark.sql.parquet.followParquetFormatSpec"

2015-09-01 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-10400: -- Summary: Rename or deprecate SQL option "spark.sql.parquet.followParquetFormatSpec" Key: SPARK-10400 URL: https://issues.apache.org/jira/browse/SPARK-10400 Project: Spark

[jira] [Commented] (SPARK-2666) when task is FetchFailed cancel running tasks of failedStage

2015-09-01 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725615#comment-14725615 ] Imran Rashid commented on SPARK-2666: - I realized I didn't very clearly spell out one

[jira] [Commented] (SPARK-10398) Migrate Spark download page to use new lua mirroring scripts

2015-09-01 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725619#comment-14725619 ] Luciano Resende commented on SPARK-10398: - I can submit a PR for the docs as well

[jira] [Commented] (SPARK-10398) Migrate Spark download page to use new lua mirroring scripts

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725622#comment-14725622 ] Apache Spark commented on SPARK-10398: -- User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-10398) Migrate Spark download page to use new lua mirroring scripts

2015-09-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725632#comment-14725632 ] Apache Spark commented on SPARK-10398: -- User 'lresende' has created a pull request f

[jira] [Updated] (SPARK-10398) Migrate Spark download page to use new lua mirroring scripts

2015-09-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10398: -- Assignee: Luciano Resende (was: Sean Owen) > Migrate Spark download page to use new lua mirroring scri

[jira] [Commented] (SPARK-9008) Stop and remove driver from supervised mode in spark-master interface

2015-09-01 Thread Alberto Miorin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725637#comment-14725637 ] Alberto Miorin commented on SPARK-9008: --- I have the same problem, but with spark mes

[jira] [Created] (SPARK-10401) spark-submit --unsupervise

2015-09-01 Thread Alberto Miorin (JIRA)
Alberto Miorin created SPARK-10401: -- Summary: spark-submit --unsupervise Key: SPARK-10401 URL: https://issues.apache.org/jira/browse/SPARK-10401 Project: Spark Issue Type: New Feature

  1   2   3   >