[jira] [Commented] (SPARK-18813) MLlib 2.2 Roadmap

[ https://issues.apache.org/jira/browse/SPARK-18813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15739306#comment-15739306 ] yuhao yang commented on SPARK-18813: Thanks for the response. Those are great metrics

[jira] [Assigned] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18810: Assignee: Apache Spark (was: Felix Cheung) > SparkR install.spark does not work for RCs,

[jira] [Commented] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15739257#comment-15739257 ] Apache Spark commented on SPARK-18810: -- User 'felixcheung' has created a pull reques

[jira] [Assigned] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18810: Assignee: Felix Cheung (was: Apache Spark) > SparkR install.spark does not work for RCs,

[jira] [Commented] (SPARK-18799) Spark SQL expose interface for plug-gable parser extension

[ https://issues.apache.org/jira/browse/SPARK-18799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15739210#comment-15739210 ] Hyukjin Kwon commented on SPARK-18799: -- Could we resolve this as a duplicate if it d

[jira] [Updated] (SPARK-18815) NPE when collecting column stats for string/binary column having only null values

[ https://issues.apache.org/jira/browse/SPARK-18815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18815: Issue Type: Sub-task (was: Bug) Parent: SPARK-16026 > NPE when collecting column stats for

[jira] [Resolved] (SPARK-18815) NPE when collecting column stats for string/binary column having only null values

[ https://issues.apache.org/jira/browse/SPARK-18815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18815. - Resolution: Fixed Assignee: Zhenhua Wang Fix Version/s: 2.2.0 2

[jira] [Commented] (SPARK-18332) SparkR 2.1 QA: Programming guide, migration guide, vignettes updates

[ https://issues.apache.org/jira/browse/SPARK-18332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15739095#comment-15739095 ] Joseph K. Bradley commented on SPARK-18332: --- [~felixcheung], [~yanboliang] I no

[jira] [Commented] (SPARK-18813) MLlib 2.2 Roadmap

[ https://issues.apache.org/jira/browse/SPARK-18813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15739090#comment-15739090 ] Joseph K. Bradley commented on SPARK-18813: --- How do these look? MLlib, sorted

[jira] [Resolved] (SPARK-4587) Model export/import

[ https://issues.apache.org/jira/browse/SPARK-4587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-4587. -- Resolution: Fixed Fix Version/s: 2.0.0 I'm going to mark this complete. This was

[jira] [Closed] (SPARK-6722) Model import/export for StreamingKMeansModel

[ https://issues.apache.org/jira/browse/SPARK-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-6722. Resolution: Won't Fix I'm going to close this. While it would be nice to have, it may take

[jira] [Resolved] (SPARK-5991) Python API for ML model import/export

[ https://issues.apache.org/jira/browse/SPARK-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-5991. -- Resolution: Fixed Fix Version/s: 2.0.0 I'm going to mark this complete. We finis

[jira] [Commented] (SPARK-18813) MLlib 2.2 Roadmap

[ https://issues.apache.org/jira/browse/SPARK-18813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15739071#comment-15739071 ] Joseph K. Bradley commented on SPARK-18813: --- I definitely agree that it's becom

[jira] [Assigned] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-18810: Assignee: Felix Cheung > SparkR install.spark does not work for RCs, snapshots > -

[jira] [Updated] (SPARK-18819) Failure to read single-row Parquet files

[ https://issues.apache.org/jira/browse/SPARK-18819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Kamprath updated SPARK-18819: - Description: When I create a data frame in PySpark with a small row count (less than numb

[jira] [Updated] (SPARK-18819) Failure to read single-row Parquet files

[ https://issues.apache.org/jira/browse/SPARK-18819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Kamprath updated SPARK-18819: - Description: When I create a data frame in PySpark with a small row count (less than numb

[jira] [Created] (SPARK-18819) Failure to read single-row Parquet files

Michael Kamprath created SPARK-18819: Summary: Failure to read single-row Parquet files Key: SPARK-18819 URL: https://issues.apache.org/jira/browse/SPARK-18819 Project: Spark Issue Type:

[jira] [Created] (SPARK-18818) Window...orderBy() should accept an 'ascending' parameter just like DataFrame.orderBy()

Nicholas Chammas created SPARK-18818: Summary: Window...orderBy() should accept an 'ascending' parameter just like DataFrame.orderBy() Key: SPARK-18818 URL: https://issues.apache.org/jira/browse/SPARK-18818

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15738558#comment-15738558 ] Apache Spark commented on SPARK-18817: -- User 'bdwyer2' has created a pull request fo

[jira] [Assigned] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18817: Assignee: (was: Apache Spark) > Ensure nothing is written outside R's tempdir() by def

[jira] [Assigned] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18817: Assignee: Apache Spark > Ensure nothing is written outside R's tempdir() by default >

[jira] [Created] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

Brendan Dwyer created SPARK-18817: - Summary: Ensure nothing is written outside R's tempdir() by default Key: SPARK-18817 URL: https://issues.apache.org/jira/browse/SPARK-18817 Project: Spark

[jira] [Commented] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15738477#comment-15738477 ] Saikat Kanjilal commented on SPARK-9487: Then I would suggest keeping it open and

[jira] [Commented] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15738424#comment-15738424 ] Sean Owen commented on SPARK-9487: -- Well, this JIRA is implicitly about making a test or

[jira] [Commented] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15738419#comment-15738419 ] Saikat Kanjilal commented on SPARK-9487: I'm ok closing it actually but it does ou

[jira] [Updated] (SPARK-18803) Fix path-related and JarEntry-related test failures and skip some tests failed on Windows due to path length limitation

[ https://issues.apache.org/jira/browse/SPARK-18803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18803: -- Assignee: Hyukjin Kwon > Fix path-related and JarEntry-related test failures and skip some tests > fai

[jira] [Resolved] (SPARK-18803) Fix path-related and JarEntry-related test failures and skip some tests failed on Windows due to path length limitation

[ https://issues.apache.org/jira/browse/SPARK-18803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18803. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16234 [https://github.co

[jira] [Commented] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15738389#comment-15738389 ] Sean Owen commented on SPARK-18806: --- Are you saying it's not a problem? > driverwrappe

[jira] [Commented] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15738383#comment-15738383 ] Sean Owen commented on SPARK-9487: -- Yes, that probably means the test changes aren't quit

[jira] [Commented] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15738309#comment-15738309 ] Saikat Kanjilal commented on SPARK-9487: [~srowen] I think the above plan is great

[jira] [Assigned] (SPARK-18766) Push Down Filter Through BatchEvalPython

[ https://issues.apache.org/jira/browse/SPARK-18766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-18766: --- Assignee: Xiao Li > Push Down Filter Through BatchEvalPython > -

[jira] [Resolved] (SPARK-18766) Push Down Filter Through BatchEvalPython

[ https://issues.apache.org/jira/browse/SPARK-18766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-18766. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16193 [https://github.com/ap

[jira] [Updated] (SPARK-18606) [HISTORYSERVER]It will check html elems while searching HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18606: -- Assignee: Tao Wang Issue Type: Improvement (was: Bug) > [HISTORYSERVER]It will check html elems

[jira] [Resolved] (SPARK-18606) [HISTORYSERVER]It will check html elems while searching HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18606. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16031 [https://github.co

[jira] [Assigned] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18814: Assignee: Herman van Hovell (was: Apache Spark) > CheckAnalysis rejects TPCDS query 32 >

[jira] [Commented] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15738058#comment-15738058 ] Apache Spark commented on SPARK-18814: -- User 'nsyca' has created a pull request for

[jira] [Assigned] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18814: Assignee: Apache Spark (was: Herman van Hovell) > CheckAnalysis rejects TPCDS query 32 >

[jira] [Assigned] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-18814: - Assignee: Herman van Hovell > CheckAnalysis rejects TPCDS query 32 > ---

[jira] [Updated] (SPARK-17460) Dataset.joinWith broadcasts gigabyte sized table, causes OOM Exception

[ https://issues.apache.org/jira/browse/SPARK-17460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17460: Assignee: Huaxin Gao > Dataset.joinWith broadcasts gigabyte sized table, causes OOM Exception > ---

[jira] [Resolved] (SPARK-17460) Dataset.joinWith broadcasts gigabyte sized table, causes OOM Exception

[ https://issues.apache.org/jira/browse/SPARK-17460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17460. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 16175 [https://githu

[jira] [Commented] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15737865#comment-15737865 ] Nattavut Sutyanyong commented on SPARK-18814: - I have a potential fix; it wor

[jira] [Commented] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15737710#comment-15737710 ] Nattavut Sutyanyong commented on SPARK-18814: - [~cloud_fan] FYI, part of the

[jira] [Commented] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15737686#comment-15737686 ] Nattavut Sutyanyong commented on SPARK-18814: - I can reproduce with a simple

[jira] [Commented] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15737640#comment-15737640 ] Nattavut Sutyanyong commented on SPARK-18814: - To get the extra `#111` of `c