[jira] [Assigned] (SPARK-9801) Spark streaming deletes the temp file and backup files without checking if they exist or not

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9801: --- Assignee: Apache Spark > Spark streaming deletes the temp file and backup files without check

[jira] [Commented] (SPARK-9801) Spark streaming deletes the temp file and backup files without checking if they exist or not

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680844#comment-14680844 ] Apache Spark commented on SPARK-9801: - User 'viadea' has created a pull request for th

[jira] [Assigned] (SPARK-9801) Spark streaming deletes the temp file and backup files without checking if they exist or not

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9801: --- Assignee: (was: Apache Spark) > Spark streaming deletes the temp file and backup files wi

[jira] [Assigned] (SPARK-8965) Add ml-guide Python Example: Estimator, Transformer, and Param

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8965: --- Assignee: (was: Apache Spark) > Add ml-guide Python Example: Estimator, Transformer, and

[jira] [Commented] (SPARK-8965) Add ml-guide Python Example: Estimator, Transformer, and Param

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680838#comment-14680838 ] Apache Spark commented on SPARK-8965: - User 'Rosstin' has created a pull request for t

[jira] [Assigned] (SPARK-8965) Add ml-guide Python Example: Estimator, Transformer, and Param

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8965: --- Assignee: Apache Spark > Add ml-guide Python Example: Estimator, Transformer, and Param > ---

[jira] [Created] (SPARK-9802) spark configuration page should mention spark.executor.cores yarn property

2015-08-10 Thread nirav patel (JIRA)
nirav patel created SPARK-9802: -- Summary: spark configuration page should mention spark.executor.cores yarn property Key: SPARK-9802 URL: https://issues.apache.org/jira/browse/SPARK-9802 Project: Spark

[jira] [Created] (SPARK-9801) Spark streaming deletes the temp file and backup files without checking if they exist or not

2015-08-10 Thread Hao Zhu (JIRA)
Hao Zhu created SPARK-9801: -- Summary: Spark streaming deletes the temp file and backup files without checking if they exist or not Key: SPARK-9801 URL: https://issues.apache.org/jira/browse/SPARK-9801 Projec

[jira] [Updated] (SPARK-9801) Spark streaming deletes the temp file and backup files without checking if they exist or not

2015-08-10 Thread Hao Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Zhu updated SPARK-9801: --- Description: For spark streaming, when checkpoint is happening, it is getting below error message from spark

[jira] [Comment Edited] (SPARK-9658) ML 1.5 QA: API: Binary incompatible changes

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659182#comment-14659182 ] Joseph K. Bradley edited comment on SPARK-9658 at 8/10/15 9:42 PM: -

[jira] [Assigned] (SPARK-9572) Add StreamingContext.getActiveOrCreate() to python API

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9572: --- Assignee: Tathagata Das (was: Apache Spark) > Add StreamingContext.getActiveOrCreate() to py

[jira] [Commented] (SPARK-9572) Add StreamingContext.getActiveOrCreate() to python API

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680790#comment-14680790 ] Apache Spark commented on SPARK-9572: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-9572) Add StreamingContext.getActiveOrCreate() to python API

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9572: --- Assignee: Apache Spark (was: Tathagata Das) > Add StreamingContext.getActiveOrCreate() to py

[jira] [Assigned] (SPARK-9789) Reinstate LogisticRegression threshold Param

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9789: --- Assignee: Apache Spark (was: Joseph K. Bradley) > Reinstate LogisticRegression threshold Par

[jira] [Assigned] (SPARK-9789) Reinstate LogisticRegression threshold Param

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9789: --- Assignee: Joseph K. Bradley (was: Apache Spark) > Reinstate LogisticRegression threshold Par

[jira] [Commented] (SPARK-9789) Reinstate LogisticRegression threshold Param

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680789#comment-14680789 ] Apache Spark commented on SPARK-9789: - User 'jkbradley' has created a pull request for

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-10 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680779#comment-14680779 ] Feynman Liang commented on SPARK-9660: -- SPARK-9800 > ML 1.5 QA: API: New Scala APIs,

[jira] [Created] (SPARK-9800) GradientDescent$.runMiniBatchSGD

2015-08-10 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9800: Summary: GradientDescent$.runMiniBatchSGD Key: SPARK-9800 URL: https://issues.apache.org/jira/browse/SPARK-9800 Project: Spark Issue Type: Documentation

[jira] [Created] (SPARK-9799) SVMModel documentation improvements

2015-08-10 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9799: Summary: SVMModel documentation improvements Key: SPARK-9799 URL: https://issues.apache.org/jira/browse/SPARK-9799 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-10 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680770#comment-14680770 ] Feynman Liang commented on SPARK-9660: -- SPARK-9799 > ML 1.5 QA: API: New Scala APIs,

[jira] [Created] (SPARK-9798) CrossValidatorModel Documentation Improvements

2015-08-10 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9798: Summary: CrossValidatorModel Documentation Improvements Key: SPARK-9798 URL: https://issues.apache.org/jira/browse/SPARK-9798 Project: Spark Issue Type: Docu

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-10 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680767#comment-14680767 ] Feynman Liang commented on SPARK-9660: -- SPARK-9798 > ML 1.5 QA: API: New Scala APIs,

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-10 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680761#comment-14680761 ] Feynman Liang commented on SPARK-9660: -- SPARK-9796 > ML 1.5 QA: API: New Scala APIs,

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-10 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680762#comment-14680762 ] Feynman Liang commented on SPARK-9660: -- SPARK-9796 > ML 1.5 QA: API: New Scala APIs,

[jira] [Created] (SPARK-9797) Document StreamingLinearRegressionWithSGD default parameter values

2015-08-10 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9797: Summary: Document StreamingLinearRegressionWithSGD default parameter values Key: SPARK-9797 URL: https://issues.apache.org/jira/browse/SPARK-9797 Project: Spark

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-10 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680760#comment-14680760 ] Feynman Liang commented on SPARK-9660: -- SPARK-9797 > ML 1.5 QA: API: New Scala APIs,

[jira] [Created] (SPARK-9796) LogisticRegressionModel Docs Completeness

2015-08-10 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9796: Summary: LogisticRegressionModel Docs Completeness Key: SPARK-9796 URL: https://issues.apache.org/jira/browse/SPARK-9796 Project: Spark Issue Type: Documenta

[jira] [Resolved] (SPARK-9759) Improve performance of Decimal.times() and casting from integral

2015-08-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9759. Resolution: Fixed Assignee: Davies Liu Fix Version/s: 1.5.0 > Improve performance of

[jira] [Resolved] (SPARK-9620) generated UnsafeProjection does not support many columns or large exressions

2015-08-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9620. Resolution: Fixed Assignee: Davies Liu Fix Version/s: 1.5.0 > generated UnsafeProjec

[jira] [Resolved] (SPARK-9763) Minimize exposure of internal SQL classes

2015-08-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9763. Resolution: Fixed Fix Version/s: 1.5.0 > Minimize exposure of internal SQL classes >

[jira] [Assigned] (SPARK-9795) Dynamic allocation: avoid double counting when killing same executor

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9795: --- Assignee: Andrew Or (was: Apache Spark) > Dynamic allocation: avoid double counting when kil

[jira] [Updated] (SPARK-9795) Dynamic allocation: avoid double counting when killing same executor twice

2015-08-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9795: - Summary: Dynamic allocation: avoid double counting when killing same executor twice (was: Dynamic allocat

[jira] [Assigned] (SPARK-9795) Dynamic allocation: avoid double counting when killing same executor

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9795: --- Assignee: Apache Spark (was: Andrew Or) > Dynamic allocation: avoid double counting when kil

[jira] [Commented] (SPARK-9795) Dynamic allocation: avoid double counting when killing same executor

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680738#comment-14680738 ] Apache Spark commented on SPARK-9795: - User 'andrewor14' has created a pull request fo

[jira] [Commented] (SPARK-9788) LDA docConcentration, gammaShape 1.5 binary incompatibility fixes

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680733#comment-14680733 ] Apache Spark commented on SPARK-9788: - User 'feynmanliang' has created a pull request

[jira] [Created] (SPARK-9795) Dynamic allocation: avoid double counting when killing same executor

2015-08-10 Thread Andrew Or (JIRA)
Andrew Or created SPARK-9795: Summary: Dynamic allocation: avoid double counting when killing same executor Key: SPARK-9795 URL: https://issues.apache.org/jira/browse/SPARK-9795 Project: Spark I

[jira] [Updated] (SPARK-9633) SBT download locations outdated; need an update

2015-08-10 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-9633: -- Fix Version/s: 1.2.3 1.1.2 1.0.3 > SBT download locations outdated

[jira] [Commented] (SPARK-9794) ISO DateTime parser is too strict

2015-08-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680695#comment-14680695 ] Sean Owen commented on SPARK-9794: -- Note that Jackson happens to have an {{ISO8601DateFor

[jira] [Commented] (SPARK-9633) SBT download locations outdated; need an update

2015-08-10 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680696#comment-14680696 ] Davies Liu commented on SPARK-9633: --- cherry-pick this into 1.2, 1.1 and 1.0 branch > SB

[jira] [Commented] (SPARK-9794) ISO DateTime parser is too strict

2015-08-10 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680688#comment-14680688 ] Josh Rosen commented on SPARK-9794: --- The same code exists in 1.4.0 and 1.4.1: https://g

[jira] [Updated] (SPARK-9794) ISO DateTime parser is too strict

2015-08-10 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9794: -- Affects Version/s: 1.2.2 1.3.1 1.4.1 > ISO DateTime parser

[jira] [Resolved] (SPARK-9784) Exchange.isUnsafe should check whether codegen and unsafe are enabled

2015-08-10 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9784. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8073 [https://github.com/

[jira] [Created] (SPARK-9794) ISO DateTime parser is too strict

2015-08-10 Thread Alex Angelini (JIRA)
Alex Angelini created SPARK-9794: Summary: ISO DateTime parser is too strict Key: SPARK-9794 URL: https://issues.apache.org/jira/browse/SPARK-9794 Project: Spark Issue Type: Bug Com

[jira] [Updated] (SPARK-9784) Exchange.isUnsafe should check whether codegen and unsafe are enabled

2015-08-10 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9784: -- Priority: Blocker (was: Major) > Exchange.isUnsafe should check whether codegen and unsafe are enabled

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680668#comment-14680668 ] Joseph K. Bradley commented on SPARK-9660: -- I'll update the logreg docs in my PR

[jira] [Commented] (SPARK-9788) LDA docConcentration, gammaShape 1.5 binary incompatibility fixes

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680666#comment-14680666 ] Joseph K. Bradley commented on SPARK-9788: -- Yeah, I guess we should revert getAlp

[jira] [Commented] (SPARK-9788) LDA docConcentration, gammaShape 1.5 binary incompatibility fixes

2015-08-10 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680653#comment-14680653 ] Feynman Liang commented on SPARK-9788: -- We will still have incompatibilities with the

[jira] [Commented] (SPARK-9789) Reinstate LogisticRegression threshold Param

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680627#comment-14680627 ] Joseph K. Bradley commented on SPARK-9789: -- I'll work on this now. > Reinstate L

[jira] [Assigned] (SPARK-9789) Reinstate LogisticRegression threshold Param

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-9789: Assignee: Joseph K. Bradley > Reinstate LogisticRegression threshold Param > --

[jira] [Updated] (SPARK-9766) check and add missing docs for PySpark ML

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9766: - Target Version/s: 1.5.0 > check and add missing docs for PySpark ML >

[jira] [Updated] (SPARK-9766) check and add missing docs for PySpark ML

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9766: - Assignee: Yanbo Liang > check and add missing docs for PySpark ML > --

[jira] [Updated] (SPARK-9766) check and add missing docs for PySpark ML

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9766: - Summary: check and add missing docs for PySpark ML (was: check and add miss docs for PySp

[jira] [Commented] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680616#comment-14680616 ] Joseph K. Bradley commented on SPARK-9663: -- [~yanboliang] Thanks for creating tho

[jira] [Updated] (SPARK-9788) LDA docConcentration, gammaShape 1.5 binary incompatibility fixes

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9788: - Shepherd: Joseph K. Bradley > LDA docConcentration, gammaShape 1.5 binary incompatibility

[jira] [Updated] (SPARK-9788) LDA docConcentration, gammaShape 1.5 binary incompatibility fixes

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9788: - Assignee: Feynman Liang > LDA docConcentration, gammaShape 1.5 binary incompatibility fixe

[jira] [Updated] (SPARK-9750) SparseMatrix should override equals

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9750: - Summary: SparseMatrix should override equals (was: DenseMatrix, SparseMatrix should overr

[jira] [Updated] (SPARK-9750) SparseMatrix should override equals

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9750: - Description: [SparseMatrix|https://github.com/apache/spark/blob/9897cc5e3d6c70f7e45e887e2c

[jira] [Created] (SPARK-9793) PySpark DenseVector, SparseVector should override __eq__

2015-08-10 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-9793: Summary: PySpark DenseVector, SparseVector should override __eq__ Key: SPARK-9793 URL: https://issues.apache.org/jira/browse/SPARK-9793 Project: Spark

[jira] [Updated] (SPARK-9750) DenseMatrix, SparseMatrix should override equals

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9750: - Priority: Critical (was: Blocker) > DenseMatrix, SparseMatrix should override equals > --

[jira] [Created] (SPARK-9792) PySpark DenseMatrix, SparseMatrix should override __eq__

2015-08-10 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-9792: Summary: PySpark DenseMatrix, SparseMatrix should override __eq__ Key: SPARK-9792 URL: https://issues.apache.org/jira/browse/SPARK-9792 Project: Spark

[jira] [Updated] (SPARK-9750) DenseMatrix, SparseMatrix should override equals

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9750: - Description: [SparseMatrix|https://github.com/apache/spark/blob/9897cc5e3d6c70f7e45e887e2c

[jira] [Updated] (SPARK-9750) DenseMatrix, SparseMatrix should override equals

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9750: - Summary: DenseMatrix, SparseMatrix should override equals (was: SparseMatrix should overr

[jira] [Created] (SPARK-9791) Review API for developer and experimental tags

2015-08-10 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-9791: Summary: Review API for developer and experimental tags Key: SPARK-9791 URL: https://issues.apache.org/jira/browse/SPARK-9791 Project: Spark Issue Type: Sub-

[jira] [Commented] (SPARK-9788) LDA docConcentration, gammaShape 1.5 binary incompatibility fixes

2015-08-10 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680568#comment-14680568 ] Feynman Liang commented on SPARK-9788: -- Assign to me > LDA docConcentration, gammaSh

[jira] [Commented] (SPARK-9790) [YARN] Expose in WebUI if NodeManager is the reason why executors were killed.

2015-08-10 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680570#comment-14680570 ] Mark Grover commented on SPARK-9790: I am working on this, will file a Work-In-Progres

[jira] [Updated] (SPARK-9750) SparseMatrix should override equals

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9750: - Shepherd: Joseph K. Bradley > SparseMatrix should override equals > --

[jira] [Commented] (SPARK-9750) SparseMatrix should override equals

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680566#comment-14680566 ] Joseph K. Bradley commented on SPARK-9750: -- This JIRA should probably be expanded

[jira] [Updated] (SPARK-9750) SparseMatrix should override equals

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9750: - Assignee: Feynman Liang > SparseMatrix should override equals > --

[jira] [Commented] (SPARK-9785) HashPartitioning compatibility should consider expression ordering

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680550#comment-14680550 ] Apache Spark commented on SPARK-9785: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-9785) HashPartitioning compatibility should consider expression ordering

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9785: --- Assignee: Josh Rosen (was: Apache Spark) > HashPartitioning compatibility should consider ex

[jira] [Assigned] (SPARK-9785) HashPartitioning compatibility should consider expression ordering

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9785: --- Assignee: Apache Spark (was: Josh Rosen) > HashPartitioning compatibility should consider ex

[jira] [Created] (SPARK-9790) [YARN] Expose in WebUI if NodeManager is the reason why executors were killed.

2015-08-10 Thread Mark Grover (JIRA)
Mark Grover created SPARK-9790: -- Summary: [YARN] Expose in WebUI if NodeManager is the reason why executors were killed. Key: SPARK-9790 URL: https://issues.apache.org/jira/browse/SPARK-9790 Project: Spa

[jira] [Updated] (SPARK-9785) HashPartitioning compatibility should consider expression ordering

2015-08-10 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9785: -- Summary: HashPartitioning compatibility should consider expression ordering (was: HashPartitioning comp

[jira] [Comment Edited] (SPARK-9658) ML 1.5 QA: API: Binary incompatible changes

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659182#comment-14659182 ] Joseph K. Bradley edited comment on SPARK-9658 at 8/10/15 6:49 PM: -

[jira] [Created] (SPARK-9789) Reinstate LogisticRegression threshold Param

2015-08-10 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-9789: Summary: Reinstate LogisticRegression threshold Param Key: SPARK-9789 URL: https://issues.apache.org/jira/browse/SPARK-9789 Project: Spark Issue Type

[jira] [Created] (SPARK-9788) LDA docConcentration, gammaShape 1.5 binary incompatibility fixes

2015-08-10 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-9788: Summary: LDA docConcentration, gammaShape 1.5 binary incompatibility fixes Key: SPARK-9788 URL: https://issues.apache.org/jira/browse/SPARK-9788 Project: Spar

[jira] [Updated] (SPARK-9787) Test for memory leaks using the streaming tests in spark-perf

2015-08-10 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9787: - Assignee: Shixiong Zhu > Test for memory leaks using the streaming tests in spark-perf > -

[jira] [Created] (SPARK-9786) Test backpressure

2015-08-10 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-9786: Summary: Test backpressure Key: SPARK-9786 URL: https://issues.apache.org/jira/browse/SPARK-9786 Project: Spark Issue Type: Sub-task Components: St

[jira] [Created] (SPARK-9787) Test for memory leaks using the streaming tests in spark-perf

2015-08-10 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-9787: Summary: Test for memory leaks using the streaming tests in spark-perf Key: SPARK-9787 URL: https://issues.apache.org/jira/browse/SPARK-9787 Project: Spark

[jira] [Updated] (SPARK-9785) HashPartitioning compatibility should be sensitive to expression ordering

2015-08-10 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9785: -- Summary: HashPartitioning compatibility should be sensitive to expression ordering (was: HashPartitioni

[jira] [Created] (SPARK-9785) HashPartitioning guarantees / compatibleWith violate those methods' contracts

2015-08-10 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9785: - Summary: HashPartitioning guarantees / compatibleWith violate those methods' contracts Key: SPARK-9785 URL: https://issues.apache.org/jira/browse/SPARK-9785 Project: Spark

[jira] [Updated] (SPARK-9340) CatalystSchemaConverter and CatalystRowConverter don't handle unannotated repeated fields correctly

2015-08-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9340: -- Sprint: Spark 1.5 doc/QA sprint Target Version/s: 1.5.0 > CatalystSchemaConverter and Cata

[jira] [Commented] (SPARK-9340) CatalystSchemaConverter and CatalystRowConverter don't handle unannotated repeated fields correctly

2015-08-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680523#comment-14680523 ] Cheng Lian commented on SPARK-9340: --- Great, would you mind to leave a LGTM on the GitHub

[jira] [Updated] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9720: - Assignee: Bertrand Dechoux > spark.ml Identifiable types should have UID in toString metho

[jira] [Updated] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9720: - Description: It would be nice to include the UID (instance name) in toString methods. Tha

[jira] [Commented] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680520#comment-14680520 ] Joseph K. Bradley commented on SPARK-9720: -- Oh sorry! I shouldn't have said "pri

[jira] [Comment Edited] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659207#comment-14659207 ] Joseph K. Bradley edited comment on SPARK-9663 at 8/10/15 6:32 PM: -

[jira] [Commented] (SPARK-9622) DecisionTreeRegressor: provide variance of prediction

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680510#comment-14680510 ] Joseph K. Bradley commented on SPARK-9622: -- OK, before you do though, it'd be wor

[jira] [Updated] (SPARK-9711) Unable to run spark after restarting cluster with spark-ec2

2015-08-10 Thread Guangyang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guangyang Li updated SPARK-9711: Description: With Spark 1.4.1 and YARN client mode, my application works at the first time the clus

[jira] [Commented] (SPARK-9340) CatalystSchemaConverter and CatalystRowConverter don't handle unannotated repeated fields correctly

2015-08-10 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680492#comment-14680492 ] Damian Guy commented on SPARK-9340: --- Code looks good and it works as expected. Tests pas

[jira] [Commented] (SPARK-7778) Add standard deviation aggregate expression

2015-08-10 Thread Rakesh Chalasani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680491#comment-14680491 ] Rakesh Chalasani commented on SPARK-7778: - Hi SsuTing: The aggregate expression i

[jira] [Assigned] (SPARK-9784) Exchange.isUnsafe should check whether codegen and unsafe are enabled

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9784: --- Assignee: Apache Spark (was: Josh Rosen) > Exchange.isUnsafe should check whether codegen an

[jira] [Assigned] (SPARK-9784) Exchange.isUnsafe should check whether codegen and unsafe are enabled

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9784: --- Assignee: Josh Rosen (was: Apache Spark) > Exchange.isUnsafe should check whether codegen an

[jira] [Commented] (SPARK-9784) Exchange.isUnsafe should check whether codegen and unsafe are enabled

2015-08-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680482#comment-14680482 ] Apache Spark commented on SPARK-9784: - User 'JoshRosen' has created a pull request for

[jira] [Resolved] (SPARK-7536) Audit MLlib Python API for 1.4

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7536. -- Resolution: Done Thanks [~yanboliang] for putting this (very successful) list together a

[jira] [Created] (SPARK-9784) Exchange.isUnsafe should check whether codegen and unsafe are enabled

2015-08-10 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9784: - Summary: Exchange.isUnsafe should check whether codegen and unsafe are enabled Key: SPARK-9784 URL: https://issues.apache.org/jira/browse/SPARK-9784 Project: Spark

[jira] [Resolved] (SPARK-9755) Add method documentation to MultivariateOnlineSummarizer

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9755. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8045 [https

[jira] [Commented] (SPARK-9783) Use SqlNewHadoopRDD in JSONRelation to eliminate extra refresh() call

2015-08-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680457#comment-14680457 ] Cheng Lian commented on SPARK-9783: --- cc [~yhuai] > Use SqlNewHadoopRDD in JSONRelation

[jira] [Updated] (SPARK-9755) Add method documentation to MultivariateOnlineSummarizer

2015-08-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9755: - Shepherd: Joseph K. Bradley Assignee: Feynman Liang > Add method documentation to Mult

[jira] [Updated] (SPARK-9783) Use SqlNewHadoopRDD in JSONRelation to eliminate extra refresh() call

2015-08-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9783: -- Sprint: Spark 1.5 doc/QA sprint Environment: (was: PR #8035 made a quick fix for SPARK-9743

<    1   2   3   >