[jira] [Resolved] (SPARK-13962) spark.ml Evaluators should support other numeric types for label

2016-04-25 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-13962. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12500 [https:/

[jira] [Assigned] (SPARK-14913) Simplify configuration API

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14913: Assignee: Apache Spark (was: Reynold Xin) > Simplify configuration API >

[jira] [Commented] (SPARK-14913) Simplify configuration API

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257650#comment-15257650 ] Apache Spark commented on SPARK-14913: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-14913) Simplify configuration API

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14913: Assignee: Reynold Xin (was: Apache Spark) > Simplify configuration API >

[jira] [Created] (SPARK-14913) Simplify configuration API

2016-04-25 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14913: --- Summary: Simplify configuration API Key: SPARK-14913 URL: https://issues.apache.org/jira/browse/SPARK-14913 Project: Spark Issue Type: Sub-task Compo

[jira] [Assigned] (SPARK-14912) Propagate data source options to Hadoop configurations

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14912: Assignee: Reynold Xin (was: Apache Spark) > Propagate data source options to Hadoop confi

[jira] [Assigned] (SPARK-14912) Propagate data source options to Hadoop configurations

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14912: Assignee: Apache Spark (was: Reynold Xin) > Propagate data source options to Hadoop confi

[jira] [Commented] (SPARK-14912) Propagate data source options to Hadoop configurations

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257589#comment-15257589 ] Apache Spark commented on SPARK-14912: -- User 'rxin' has created a pull request for t

[jira] [Created] (SPARK-14912) Propagate data source options to Hadoop configurations

2016-04-25 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14912: --- Summary: Propagate data source options to Hadoop configurations Key: SPARK-14912 URL: https://issues.apache.org/jira/browse/SPARK-14912 Project: Spark Issue Ty

[jira] [Commented] (SPARK-14313) AFTSurvivalRegression model persistence in SparkR

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257563#comment-15257563 ] Apache Spark commented on SPARK-14313: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-14313) AFTSurvivalRegression model persistence in SparkR

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14313: Assignee: Yanbo Liang (was: Apache Spark) > AFTSurvivalRegression model persistence in Sp

[jira] [Assigned] (SPARK-14313) AFTSurvivalRegression model persistence in SparkR

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14313: Assignee: Apache Spark (was: Yanbo Liang) > AFTSurvivalRegression model persistence in Sp

[jira] [Updated] (SPARK-14874) Remove the obsolete Batch representation

2016-04-25 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-14874: -- Description: The Batch class, which had been used to indicate progress in a stream, was abandoned by S

[jira] [Closed] (SPARK-14806) Alias original Hive options in Spark SQL conf

2016-04-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-14806. --- Resolution: Won't Fix > Alias original Hive options in Spark SQL conf > -

[jira] [Assigned] (SPARK-14315) GLMs model persistence in SparkR

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14315: Assignee: (was: Apache Spark) > GLMs model persistence in SparkR > ---

[jira] [Commented] (SPARK-14315) GLMs model persistence in SparkR

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257532#comment-15257532 ] Apache Spark commented on SPARK-14315: -- User 'GayathriMurali' has created a pull req

[jira] [Assigned] (SPARK-14315) GLMs model persistence in SparkR

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14315: Assignee: Apache Spark > GLMs model persistence in SparkR > --

[jira] [Resolved] (SPARK-14861) Replace internal usages of SQLContext with SparkSession

2016-04-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14861. - Resolution: Fixed Fix Version/s: 2.0.0 > Replace internal usages of SQLContext with SparkS

[jira] [Commented] (SPARK-14904) Add back HiveContext in compatibility package

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257521#comment-15257521 ] Apache Spark commented on SPARK-14904: -- User 'rxin' has created a pull request for t

[jira] [Resolved] (SPARK-14904) Add back HiveContext in compatibility package

2016-04-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14904. - Resolution: Fixed Fix Version/s: 2.0.0 > Add back HiveContext in compatibility package > -

[jira] [Commented] (SPARK-14911) Fix a potential data race in TaskMemoryManager

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257497#comment-15257497 ] Apache Spark commented on SPARK-14911: -- User 'lw-lin' has created a pull request for

[jira] [Assigned] (SPARK-14911) Fix a potential data race in TaskMemoryManager

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14911: Assignee: (was: Apache Spark) > Fix a potential data race in TaskMemoryManager > -

[jira] [Assigned] (SPARK-14911) Fix a potential data race in TaskMemoryManager

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14911: Assignee: Apache Spark > Fix a potential data race in TaskMemoryManager >

[jira] [Commented] (SPARK-13902) Make DAGScheduler.getAncestorShuffleDependencies() return in topological order to ensure building ancestor stages first.

2016-04-25 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257496#comment-15257496 ] Takuya Ueshin commented on SPARK-13902: --- Yes, exactly. > Make DAGScheduler.getAnce

[jira] [Created] (SPARK-14911) Fix a potential data race in TaskMemoryManager

2016-04-25 Thread Liwei Lin (JIRA)
Liwei Lin created SPARK-14911: - Summary: Fix a potential data race in TaskMemoryManager Key: SPARK-14911 URL: https://issues.apache.org/jira/browse/SPARK-14911 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-13902) Make DAGScheduler.getAncestorShuffleDependencies() return in topological order to ensure building ancestor stages first.

2016-04-25 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-13902: -- Description: {{DAGScheduler}} sometimes generate incorrect stage graph. Some stages are generat

[jira] [Commented] (SPARK-13902) Make DAGScheduler.getAncestorShuffleDependencies() return in topological order to ensure building ancestor stages first.

2016-04-25 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257481#comment-15257481 ] Takuya Ueshin commented on SPARK-13902: --- I'm sorry, I made a mistake. I should have

[jira] [Assigned] (SPARK-14314) K-means model persistence in SparkR

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14314: Assignee: (was: Apache Spark) > K-means model persistence in SparkR >

[jira] [Commented] (SPARK-14314) K-means model persistence in SparkR

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257475#comment-15257475 ] Apache Spark commented on SPARK-14314: -- User 'GayathriMurali' has created a pull req

[jira] [Assigned] (SPARK-14314) K-means model persistence in SparkR

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14314: Assignee: Apache Spark > K-means model persistence in SparkR > ---

[jira] [Commented] (SPARK-14910) Native DDL Command Support for Describe Function in Non-identifier Format

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257427#comment-15257427 ] Apache Spark commented on SPARK-14910: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-14910) Native DDL Command Support for Describe Function in Non-identifier Format

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14910: Assignee: (was: Apache Spark) > Native DDL Command Support for Describe Function in No

[jira] [Assigned] (SPARK-14910) Native DDL Command Support for Describe Function in Non-identifier Format

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14910: Assignee: Apache Spark > Native DDL Command Support for Describe Function in Non-identifie

[jira] [Updated] (SPARK-14910) Native DDL Command Support for Describe Function in Non-identifier Format

2016-04-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14910: Issue Type: Sub-task (was: Improvement) Parent: SPARK-14118 > Native DDL Command Support for Descr

[jira] [Created] (SPARK-14910) Native DDL Command Support for Describe Function in Non-identifier Format

2016-04-25 Thread Xiao Li (JIRA)
Xiao Li created SPARK-14910: --- Summary: Native DDL Command Support for Describe Function in Non-identifier Format Key: SPARK-14910 URL: https://issues.apache.org/jira/browse/SPARK-14910 Project: Spark

[jira] [Updated] (SPARK-14909) Spark UI submitted time is wrong

2016-04-25 Thread Christophe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christophe updated SPARK-14909: --- Attachment: time-spark3.png time-spark2.png time-spark1.png

[jira] [Commented] (SPARK-14908) Provide support HDFS-located resources for "spark.executor.extraClasspath" on YARN

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257390#comment-15257390 ] Apache Spark commented on SPARK-14908: -- User 'mikhaildubkov' has created a pull requ

[jira] [Assigned] (SPARK-14908) Provide support HDFS-located resources for "spark.executor.extraClasspath" on YARN

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14908: Assignee: Apache Spark > Provide support HDFS-located resources for "spark.executor.extra

[jira] [Assigned] (SPARK-14908) Provide support HDFS-located resources for "spark.executor.extraClasspath" on YARN

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14908: Assignee: (was: Apache Spark) > Provide support HDFS-located resources for "spark.exe

[jira] [Created] (SPARK-14909) Spark UI submitted time is wrong

2016-04-25 Thread Christophe (JIRA)
Christophe created SPARK-14909: -- Summary: Spark UI submitted time is wrong Key: SPARK-14909 URL: https://issues.apache.org/jira/browse/SPARK-14909 Project: Spark Issue Type: Bug Affects Vers

[jira] [Issue Comment Deleted] (SPARK-14772) Python ML Params.copy treats uid, paramMaps differently than Scala

2016-04-25 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiayin updated SPARK-14772: - Comment: was deleted (was: I can submit a code to fix this issue and I'm testing it.) > Python ML Params

[jira] [Resolved] (SPARK-14902) Expose user-facing RuntimeConfig in SparkSession

2016-04-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14902. - Resolution: Fixed Fix Version/s: 2.0.0 > Expose user-facing RuntimeConfig in SparkSession

[jira] [Updated] (SPARK-6339) Support creating temporary tables with DDL

2016-04-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6339: Target Version/s: 2.0.0 > Support creating temporary tables with DDL > -

[jira] [Created] (SPARK-14908) Provide support HDFS-located resources for "spark.executor.extraClasspath" on YARN

2016-04-25 Thread Dubkov Mikhail (JIRA)
Dubkov Mikhail created SPARK-14908: -- Summary: Provide support HDFS-located resources for "spark.executor.extraClasspath" on YARN Key: SPARK-14908 URL: https://issues.apache.org/jira/browse/SPARK-14908

[jira] [Assigned] (SPARK-14907) Use repartition in GLMRegressionModel.save

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14907: Assignee: (was: Apache Spark) > Use repartition in GLMRegressionModel.save > -

[jira] [Commented] (SPARK-14907) Use repartition in GLMRegressionModel.save

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257324#comment-15257324 ] Apache Spark commented on SPARK-14907: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Updated] (SPARK-14613) Add @Since into the matrix and vector classes in spark-mllib-local

2016-04-25 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-14613: Assignee: Pravin Gadakh > Add @Since into the matrix and vector classes in spark-mllib-local >

[jira] [Assigned] (SPARK-14907) Use repartition in GLMRegressionModel.save

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14907: Assignee: Apache Spark > Use repartition in GLMRegressionModel.save >

[jira] [Updated] (SPARK-14906) Move VectorUDT and MatrixUDT in PySpark to new ML package

2016-04-25 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-14906: Issue Type: Sub-task (was: Improvement) Parent: SPARK-13944 > Move VectorUDT and M

[jira] [Updated] (SPARK-14906) Move VectorUDT and MatrixUDT in PySpark to new ML package

2016-04-25 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-14906: Description: As we move VectorUDT and MatrixUDT in Scala to new ml package, the PySpark cod

[jira] [Created] (SPARK-14907) Use repartition in GLMRegressionModel.save

2016-04-25 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-14907: - Summary: Use repartition in GLMRegressionModel.save Key: SPARK-14907 URL: https://issues.apache.org/jira/browse/SPARK-14907 Project: Spark Issue Type: Impr

[jira] [Created] (SPARK-14906) Move VectorUDT and MatrixUDT in PySpark to new ML package

2016-04-25 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-14906: --- Summary: Move VectorUDT and MatrixUDT in PySpark to new ML package Key: SPARK-14906 URL: https://issues.apache.org/jira/browse/SPARK-14906 Project: Spark

[jira] [Commented] (SPARK-14249) Change MLReader.read to be a property for PySpark

2016-04-25 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257311#comment-15257311 ] Miao Wang commented on SPARK-14249: --- [~josephkb]Thanks! It is good to learn something n

[jira] [Commented] (SPARK-14894) Python GaussianMixture summary

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257307#comment-15257307 ] Apache Spark commented on SPARK-14894: -- User 'GayathriMurali' has created a pull req

[jira] [Commented] (SPARK-14880) Parallel Gradient Descent with less map-reduce shuffle overhead

2016-04-25 Thread Ahmed Mahran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257297#comment-15257297 ] Ahmed Mahran commented on SPARK-14880: -- I think Zinkevich's requires the loss to be

[jira] [Created] (SPARK-14905) create conda environments w/locked package versions

2016-04-25 Thread shane knapp (JIRA)
shane knapp created SPARK-14905: --- Summary: create conda environments w/locked package versions Key: SPARK-14905 URL: https://issues.apache.org/jira/browse/SPARK-14905 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14870) NPE in generate aggregate

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257244#comment-15257244 ] Apache Spark commented on SPARK-14870: -- User 'sameeragarwal' has created a pull requ

[jira] [Resolved] (SPARK-14888) UnresolvedFunction should use FunctionIdentifier rather than just a string for function name

2016-04-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14888. - Resolution: Fixed Fix Version/s: 2.0.0 > UnresolvedFunction should use FunctionIdentifier

[jira] [Commented] (SPARK-14511) Publish our forked genjavadoc for 2.12.0-M4 or stop using a forked version

2016-04-25 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257217#comment-15257217 ] Jakob Odersky commented on SPARK-14511: --- Update: an issue was discovered during rel

[jira] [Commented] (SPARK-14555) Python API for methods introduced for Structured Streaming

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257211#comment-15257211 ] Apache Spark commented on SPARK-14555: -- User 'brkyvz' has created a pull request for

[jira] [Commented] (SPARK-8855) Python API for Association Rules

2016-04-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257205#comment-15257205 ] Joseph K. Bradley commented on SPARK-8855: -- This may be significantly easier to a

[jira] [Assigned] (SPARK-14904) Add back HiveContext in compatibility package

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14904: Assignee: Andrew Or (was: Apache Spark) > Add back HiveContext in compatibility package >

[jira] [Commented] (SPARK-14904) Add back HiveContext in compatibility package

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257191#comment-15257191 ] Apache Spark commented on SPARK-14904: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-14904) Add back HiveContext in compatibility package

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14904: Assignee: Apache Spark (was: Andrew Or) > Add back HiveContext in compatibility package >

[jira] [Commented] (SPARK-14903) Revert: Change MLWritable.write to be a property

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257182#comment-15257182 ] Apache Spark commented on SPARK-14903: -- User 'jkbradley' has created a pull request

[jira] [Assigned] (SPARK-14903) Revert: Change MLWritable.write to be a property

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14903: Assignee: Joseph K. Bradley (was: Apache Spark) > Revert: Change MLWritable.write to be a

[jira] [Assigned] (SPARK-14903) Revert: Change MLWritable.write to be a property

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14903: Assignee: Apache Spark (was: Joseph K. Bradley) > Revert: Change MLWritable.write to be a

[jira] [Commented] (SPARK-14071) Change MLWritable.write to be a property

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257183#comment-15257183 ] Apache Spark commented on SPARK-14071: -- User 'jkbradley' has created a pull request

[jira] [Created] (SPARK-14904) Add back HiveContext in compatibility package

2016-04-25 Thread Andrew Or (JIRA)
Andrew Or created SPARK-14904: - Summary: Add back HiveContext in compatibility package Key: SPARK-14904 URL: https://issues.apache.org/jira/browse/SPARK-14904 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-14828) Start SparkSession in REPL instead of SQLContext

2016-04-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14828: Issue Type: Sub-task (was: Bug) Parent: SPARK-13485 > Start SparkSession in REPL instead o

[jira] [Resolved] (SPARK-14828) Start SparkSession in REPL instead of SQLContext

2016-04-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14828. - Resolution: Fixed Fix Version/s: 2.0.0 > Start SparkSession in REPL instead of SQLContext

[jira] [Assigned] (SPARK-14894) Python GaussianMixture summary

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14894: Assignee: Apache Spark > Python GaussianMixture summary > -- >

[jira] [Commented] (SPARK-14894) Python GaussianMixture summary

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257161#comment-15257161 ] Apache Spark commented on SPARK-14894: -- User 'GayathriMurali' has created a pull req

[jira] [Assigned] (SPARK-14894) Python GaussianMixture summary

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14894: Assignee: (was: Apache Spark) > Python GaussianMixture summary > -

[jira] [Created] (SPARK-14903) Revert: Change MLWritable.write to be a property

2016-04-25 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-14903: - Summary: Revert: Change MLWritable.write to be a property Key: SPARK-14903 URL: https://issues.apache.org/jira/browse/SPARK-14903 Project: Spark Is

[jira] [Updated] (SPARK-14903) Revert: Change MLWritable.write to be a property

2016-04-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14903: -- Description: Per discussion in [SPARK-14249], there is not a good way to support .read

[jira] [Closed] (SPARK-14249) Change MLReader.read to be a property for PySpark

2016-04-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-14249. - Resolution: Won't Fix > Change MLReader.read to be a property for PySpark > -

[jira] [Commented] (SPARK-14249) Change MLReader.read to be a property for PySpark

2016-04-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257146#comment-15257146 ] Joseph K. Bradley commented on SPARK-14249: --- I don't see a good way to do this.

[jira] [Assigned] (SPARK-14902) Expose user-facing RuntimeConfig in SparkSession

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14902: Assignee: Andrew Or (was: Apache Spark) > Expose user-facing RuntimeConfig in SparkSessio

[jira] [Assigned] (SPARK-14902) Expose user-facing RuntimeConfig in SparkSession

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14902: Assignee: Apache Spark (was: Andrew Or) > Expose user-facing RuntimeConfig in SparkSessio

[jira] [Commented] (SPARK-14902) Expose user-facing RuntimeConfig in SparkSession

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257100#comment-15257100 ] Apache Spark commented on SPARK-14902: -- User 'andrewor14' has created a pull request

[jira] [Created] (SPARK-14902) Expose user-facing RuntimeConfig in SparkSession

2016-04-25 Thread Andrew Or (JIRA)
Andrew Or created SPARK-14902: - Summary: Expose user-facing RuntimeConfig in SparkSession Key: SPARK-14902 URL: https://issues.apache.org/jira/browse/SPARK-14902 Project: Spark Issue Type: Sub-ta

[jira] [Updated] (SPARK-14313) AFTSurvivalRegression model persistence in SparkR

2016-04-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-14313: -- Assignee: Yanbo Liang > AFTSurvivalRegression model persistence in SparkR > ---

[jira] [Updated] (SPARK-14313) AFTSurvivalRegression model persistence in SparkR

2016-04-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-14313: -- Target Version/s: 2.0.0 > AFTSurvivalRegression model persistence in SparkR > -

[jira] [Resolved] (SPARK-14312) NaiveBayes model persistence in SparkR

2016-04-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-14312. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12573 [https://g

[jira] [Commented] (SPARK-14900) spark.ml classification metrics should include accuracy

2016-04-25 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257034#comment-15257034 ] Miao Wang commented on SPARK-14900: --- If no one takes this one, I will work on it. Than

[jira] [Commented] (SPARK-14894) Python GaussianMixture summary

2016-04-25 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257021#comment-15257021 ] Miao Wang commented on SPARK-14894: --- If you have it ready now, please send the pull req

[jira] [Assigned] (SPARK-14853) Support LeftSemi/LeftAnti in SortMergeJoin

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14853: Assignee: Apache Spark (was: Davies Liu) > Support LeftSemi/LeftAnti in SortMergeJoin > -

[jira] [Commented] (SPARK-14853) Support LeftSemi/LeftAnti in SortMergeJoin

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257009#comment-15257009 ] Apache Spark commented on SPARK-14853: -- User 'davies' has created a pull request for

[jira] [Commented] (SPARK-14894) Python GaussianMixture summary

2016-04-25 Thread Gayathri Murali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257006#comment-15257006 ] Gayathri Murali commented on SPARK-14894: - [~wangmiao1981] I have PR ready for th

[jira] [Assigned] (SPARK-14853) Support LeftSemi/LeftAnti in SortMergeJoin

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14853: Assignee: Davies Liu (was: Apache Spark) > Support LeftSemi/LeftAnti in SortMergeJoin > -

[jira] [Commented] (SPARK-14467) Add async io in FileScanRDD

2016-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257005#comment-15257005 ] Apache Spark commented on SPARK-14467: -- User 'sameeragarwal' has created a pull requ

[jira] [Commented] (SPARK-14891) ALS in ML never validates input schema

2016-04-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257004#comment-15257004 ] Joseph K. Bradley commented on SPARK-14891: --- For most use cases, Int should be

[jira] [Commented] (SPARK-14880) Parallel Gradient Descent with less map-reduce shuffle overhead

2016-04-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256996#comment-15256996 ] Joseph K. Bradley commented on SPARK-14880: --- Thanks for this suggestion. To ge

[jira] [Resolved] (SPARK-13739) Predicate Push Down Through Window Operator

2016-04-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-13739. --- Resolution: Fixed Assignee: Xiao Li Target Version/s: 2.0.0 > P

[jira] [Closed] (SPARK-14880) Parallel Gradient Descent with less map-reduce shuffle overhead

2016-04-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-14880. - Resolution: Won't Fix > Parallel Gradient Descent with less map-reduce shuffle overhead >

[jira] [Updated] (SPARK-14844) KMeansModel in spark.ml should allow to change featureCol and predictionCol

2016-04-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14844: -- Priority: Trivial (was: Major) > KMeansModel in spark.ml should allow to change featur

[jira] [Commented] (SPARK-14831) Make ML APIs in SparkR consistent

2016-04-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256983#comment-15256983 ] Joseph K. Bradley commented on SPARK-14831: --- 2. {{spark.glm}}, etc. SGTM. For

[jira] [Resolved] (SPARK-14721) Remove the HiveContext class

2016-04-25 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14721. --- Resolution: Fixed Fix Version/s: 2.0.0 > Remove the HiveContext class > --

[jira] [Created] (SPARK-14901) java exception when showing join

2016-04-25 Thread Brent Elmer (JIRA)
Brent Elmer created SPARK-14901: --- Summary: java exception when showing join Key: SPARK-14901 URL: https://issues.apache.org/jira/browse/SPARK-14901 Project: Spark Issue Type: Bug Comp

  1   2   3   >