[jira] [Assigned] (SPARK-7660) Snappy-java buffer-sharing bug leads to data corruption / test failures

2015-05-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-7660: - Assignee: Josh Rosen > Snappy-java buffer-sharing bug leads to data corruption / test failures >

[jira] [Assigned] (SPARK-7660) Snappy-java buffer-sharing bug leads to data corruption / test failures

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7660: --- Assignee: Apache Spark > Snappy-java buffer-sharing bug leads to data corruption / test failu

[jira] [Commented] (SPARK-7660) Snappy-java buffer-sharing bug leads to data corruption / test failures

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14545031#comment-14545031 ] Apache Spark commented on SPARK-7660: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-7660) Snappy-java buffer-sharing bug leads to data corruption / test failures

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7660: --- Assignee: (was: Apache Spark) > Snappy-java buffer-sharing bug leads to data corruption /

[jira] [Commented] (SPARK-2344) Add Fuzzy C-Means algorithm to MLlib

2015-05-14 Thread Alex (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14545027#comment-14545027 ] Alex commented on SPARK-2344: - Hi, How are you? I have couple of questions: 1) When are you

[jira] [Created] (SPARK-7661) Support for dynamic allocation of executors in Kinesis Spark Streaming

2015-05-14 Thread Murtaza Kanchwala (JIRA)
Murtaza Kanchwala created SPARK-7661: Summary: Support for dynamic allocation of executors in Kinesis Spark Streaming Key: SPARK-7661 URL: https://issues.apache.org/jira/browse/SPARK-7661 Project:

[jira] [Commented] (SPARK-7654) DataFrameReader and DataFrameWriter for input/output API

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14545017#comment-14545017 ] Apache Spark commented on SPARK-7654: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-7654) DataFrameReader and DataFrameWriter for input/output API

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7654: --- Assignee: Reynold Xin (was: Apache Spark) > DataFrameReader and DataFrameWriter for input/ou

[jira] [Assigned] (SPARK-7654) DataFrameReader and DataFrameWriter for input/output API

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7654: --- Assignee: Apache Spark (was: Reynold Xin) > DataFrameReader and DataFrameWriter for input/ou

[jira] [Updated] (SPARK-7654) DataFrameReader and DataFrameWriter for input/output API

2015-05-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7654: --- Description: We have a proliferation of save options now. It'd make more sense to have a builder patt

[jira] [Updated] (SPARK-7654) DataFrameReader and DataFrameWriter for input/output API

2015-05-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7654: --- Summary: DataFrameReader and DataFrameWriter for input/output API (was: Create builder pattern for Da

[jira] [Commented] (SPARK-7660) Snappy-java buffer-sharing bug leads to data corruption / test failures

2015-05-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14545014#comment-14545014 ] Josh Rosen commented on SPARK-7660: --- If we're wary of upgrading to a new Snappy version

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-05-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14545006#comment-14545006 ] Josh Rosen commented on SPARK-4105: --- I've opened SPARK-7660 to track progress on the fix

[jira] [Commented] (SPARK-7660) Snappy-java buffer-sharing bug leads to data corruption / test failures

2015-05-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14545005#comment-14545005 ] Josh Rosen commented on SPARK-7660: --- I pushed https://github.com/apache/spark/commit/7d

[jira] [Updated] (SPARK-7660) Snappy-java buffer-sharing bug leads to data corruption / test failures

2015-05-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7660: -- Description: snappy-java contains a bug that can lead to situations where separate SnappyOutputStream i

[jira] [Commented] (SPARK-7660) Snappy-java buffer-sharing bug leads to data corruption / test failures

2015-05-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544987#comment-14544987 ] Josh Rosen commented on SPARK-7660: --- Note that this affects more than just Spark 1.4.0;

[jira] [Created] (SPARK-7660) Snappy-java buffer-sharing bug leads to data corruption / test failures

2015-05-14 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-7660: - Summary: Snappy-java buffer-sharing bug leads to data corruption / test failures Key: SPARK-7660 URL: https://issues.apache.org/jira/browse/SPARK-7660 Project: Spark

[jira] [Commented] (SPARK-7269) Incorrect aggregation analysis

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544979#comment-14544979 ] Apache Spark commented on SPARK-7269: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-7624) Task scheduler delay is increasing time over time in spark local mode

2015-05-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544978#comment-14544978 ] Davies Liu commented on SPARK-7624: --- In the context of Spark Streaming, there could be s

[jira] [Assigned] (SPARK-7624) Task scheduler delay is increasing time over time in spark local mode

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7624: --- Assignee: Davies Liu (was: Apache Spark) > Task scheduler delay is increasing time over time

[jira] [Commented] (SPARK-7624) Task scheduler delay is increasing time over time in spark local mode

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544962#comment-14544962 ] Apache Spark commented on SPARK-7624: - User 'davies' has created a pull request for th

[jira] [Assigned] (SPARK-7624) Task scheduler delay is increasing time over time in spark local mode

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7624: --- Assignee: Apache Spark (was: Davies Liu) > Task scheduler delay is increasing time over time

[jira] [Commented] (SPARK-7080) Binary processing based aggregate operator

2015-05-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544953#comment-14544953 ] Josh Rosen commented on SPARK-7080: --- [~marmbrus], what do you think about adding a testi

[jira] [Issue Comment Deleted] (SPARK-7077) Binary processing hash table for aggregation

2015-05-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7077: -- Comment: was deleted (was: [~marmbrus], what do you think about adding a testing suite for this operato

[jira] [Commented] (SPARK-7077) Binary processing hash table for aggregation

2015-05-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544952#comment-14544952 ] Josh Rosen commented on SPARK-7077: --- [~marmbrus], what do you think about adding a testi

[jira] [Commented] (SPARK-7624) Task scheduler delay is increasing time over time in spark local mode

2015-05-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544950#comment-14544950 ] Davies Liu commented on SPARK-7624: --- This is introduced by https://github.com/apache/spa

[jira] [Updated] (SPARK-7226) Support math functions in R DataFrame

2015-05-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7226: - Assignee: Qian Huang > Support math functions in R DataFrame > ---

[jira] [Commented] (SPARK-7651) PySpark GMM predict, predictSoft should fail on bad input

2015-05-14 Thread Meethu Mathew (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544930#comment-14544930 ] Meethu Mathew commented on SPARK-7651: -- Ok thank you > PySpark GMM predict, predictS

[jira] [Commented] (SPARK-7651) PySpark GMM predict, predictSoft should fail on bad input

2015-05-14 Thread Meethu Mathew (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544929#comment-14544929 ] Meethu Mathew commented on SPARK-7651: -- Ok thank you > PySpark GMM predict, predictS

[jira] [Commented] (SPARK-7651) PySpark GMM predict, predictSoft should fail on bad input

2015-05-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544927#comment-14544927 ] Joseph K. Bradley commented on SPARK-7651: -- Please base your PR on master. I can

[jira] [Assigned] (SPARK-7624) Task scheduler delay is increasing time over time in spark local mode

2015-05-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-7624: - Assignee: Davies Liu > Task scheduler delay is increasing time over time in spark local mode > --

[jira] [Updated] (SPARK-3147) Implement A/B testing

2015-05-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-3147: - Target Version/s: 1.5.0 (was: 1.4.0) > Implement A/B testing > - > >

[jira] [Commented] (SPARK-7651) PySpark GMM predict, predictSoft should fail on bad input

2015-05-14 Thread Meethu Mathew (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544924#comment-14544924 ] Meethu Mathew commented on SPARK-7651: -- Could you please tell me where I should make

[jira] [Commented] (SPARK-3147) Implement A/B testing

2015-05-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544925#comment-14544925 ] Joseph K. Bradley commented on SPARK-3147: -- Thanks for pointing this out. [~flia

[jira] [Commented] (SPARK-7651) PySpark GMM predict, predictSoft should fail on bad input

2015-05-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544923#comment-14544923 ] Joseph K. Bradley commented on SPARK-7651: -- Great, thank you! > PySpark GMM pred

[jira] [Commented] (SPARK-7472) DAG visualization: handle skipped stages differently

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544912#comment-14544912 ] Apache Spark commented on SPARK-7472: - User 'andrewor14' has created a pull request fo

[jira] [Assigned] (SPARK-7472) DAG visualization: handle skipped stages differently

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7472: --- Assignee: Apache Spark (was: Andrew Or) > DAG visualization: handle skipped stages different

[jira] [Assigned] (SPARK-7472) DAG visualization: handle skipped stages differently

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7472: --- Assignee: Andrew Or (was: Apache Spark) > DAG visualization: handle skipped stages different

[jira] [Commented] (SPARK-7627) DAG visualization: cached RDDs not shown on job page

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544911#comment-14544911 ] Apache Spark commented on SPARK-7627: - User 'andrewor14' has created a pull request fo

[jira] [Commented] (SPARK-7651) PySpark GMM predict, predictSoft should fail on bad input

2015-05-14 Thread Meethu Mathew (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544910#comment-14544910 ] Meethu Mathew commented on SPARK-7651: -- [~josephkb] Yea, I wil fix it asap. > PySpar

[jira] [Closed] (SPARK-7627) DAG visualization: cached RDDs not shown on job page

2015-05-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7627. Resolution: Fixed Fix Version/s: 1.4.0 > DAG visualization: cached RDDs not shown on job page > -

[jira] [Updated] (SPARK-7628) DAG visualization: position graphs with semantic awareness

2015-05-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7628: - Issue Type: Sub-task (was: Bug) Parent: SPARK-7463 > DAG visualization: position graphs with sema

[jira] [Reopened] (SPARK-7627) DAG visualization: cached RDDs not shown on job page

2015-05-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-7627: -- > DAG visualization: cached RDDs not shown on job page > ---

[jira] [Updated] (SPARK-7627) DAG visualization: cached RDDs not shown on job page

2015-05-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7627: - Issue Type: Sub-task (was: Bug) Parent: SPARK-7463 > DAG visualization: cached RDDs not shown on

[jira] [Closed] (SPARK-7500) DAG visualization: cluster name bleeds beyond the cluster

2015-05-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7500. Resolution: Fixed Fix Version/s: 1.4.0 > DAG visualization: cluster name bleeds beyond the cluster >

[jira] [Assigned] (SPARK-7226) Support math functions in R DataFrame

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7226: --- Assignee: Apache Spark > Support math functions in R DataFrame >

[jira] [Commented] (SPARK-7226) Support math functions in R DataFrame

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544880#comment-14544880 ] Apache Spark commented on SPARK-7226: - User 'hqzizania' has created a pull request for

[jira] [Assigned] (SPARK-7226) Support math functions in R DataFrame

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7226: --- Assignee: (was: Apache Spark) > Support math functions in R DataFrame > -

[jira] [Resolved] (SPARK-7098) Inconsistent Timestamp behavior when used in WHERE clause

2015-05-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7098. Resolution: Fixed Fix Version/s: 1.4.0 > Inconsistent Timestamp behavior when used in WHERE c

[jira] [Assigned] (SPARK-7659) Sort by attributes that are not present in the SELECT clause when there is windowfunction analysis error

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7659: --- Assignee: (was: Apache Spark) > Sort by attributes that are not present in the SELECT cla

[jira] [Commented] (SPARK-7659) Sort by attributes that are not present in the SELECT clause when there is windowfunction analysis error

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544862#comment-14544862 ] Apache Spark commented on SPARK-7659: - User 'scwf' has created a pull request for this

[jira] [Assigned] (SPARK-7659) Sort by attributes that are not present in the SELECT clause when there is windowfunction analysis error

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7659: --- Assignee: Apache Spark > Sort by attributes that are not present in the SELECT clause when th

[jira] [Created] (SPARK-7659) Sort by attributes that are not present in the SELECT clause when there is windowfunction analysis error

2015-05-14 Thread Fei Wang (JIRA)
Fei Wang created SPARK-7659: --- Summary: Sort by attributes that are not present in the SELECT clause when there is windowfunction analysis error Key: SPARK-7659 URL: https://issues.apache.org/jira/browse/SPARK-7659

[jira] [Updated] (SPARK-7624) Task scheduler delay is increasing time over time in spark local mode

2015-05-14 Thread Jack Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jack Hu updated SPARK-7624: --- Description: I am running a simple spark streaming program with spark 1.3.1 in local mode, it receives json s

[jira] [Updated] (SPARK-7624) Task scheduler delay is increasing time over time in spark local mode

2015-05-14 Thread Jack Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jack Hu updated SPARK-7624: --- Description: I am running a simple spark streaming program with spark 1.3.1 in local mode, it receives json s

[jira] [Assigned] (SPARK-7658) Update the mouse behaviors for the timeline graphs

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7658: --- Assignee: (was: Apache Spark) > Update the mouse behaviors for the timeline graphs >

[jira] [Commented] (SPARK-7658) Update the mouse behaviors for the timeline graphs

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544832#comment-14544832 ] Apache Spark commented on SPARK-7658: - User 'zsxwing' has created a pull request for t

[jira] [Assigned] (SPARK-7658) Update the mouse behaviors for the timeline graphs

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7658: --- Assignee: Apache Spark > Update the mouse behaviors for the timeline graphs > ---

[jira] [Created] (SPARK-7658) Update the mouse behaviors for the timeline graphs

2015-05-14 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-7658: --- Summary: Update the mouse behaviors for the timeline graphs Key: SPARK-7658 URL: https://issues.apache.org/jira/browse/SPARK-7658 Project: Spark Issue Type: Im

[jira] [Resolved] (SPARK-7548) Add explode expression

2015-05-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7548. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6107 [https:/

[jira] [Assigned] (SPARK-6906) Refactor Connection to Hive Metastore

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6906: --- Assignee: Michael Armbrust (was: Apache Spark) > Refactor Connection to Hive Metastore > ---

[jira] [Commented] (SPARK-6906) Refactor Connection to Hive Metastore

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544813#comment-14544813 ] Apache Spark commented on SPARK-6906: - User 'marmbrus' has created a pull request for

[jira] [Assigned] (SPARK-6906) Refactor Connection to Hive Metastore

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6906: --- Assignee: Apache Spark (was: Michael Armbrust) > Refactor Connection to Hive Metastore > ---

[jira] [Assigned] (SPARK-7657) [YARN] Show driver link in Spark UI

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7657: --- Assignee: Apache Spark > [YARN] Show driver link in Spark UI > --

[jira] [Assigned] (SPARK-7657) [YARN] Show driver link in Spark UI

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7657: --- Assignee: (was: Apache Spark) > [YARN] Show driver link in Spark UI > ---

[jira] [Commented] (SPARK-7657) [YARN] Show driver link in Spark UI

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544805#comment-14544805 ] Apache Spark commented on SPARK-7657: - User 'harishreedharan' has created a pull reque

[jira] [Created] (SPARK-7657) [YARN] Show driver link in Spark UI

2015-05-14 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created SPARK-7657: --- Summary: [YARN] Show driver link in Spark UI Key: SPARK-7657 URL: https://issues.apache.org/jira/browse/SPARK-7657 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-4669) Allow users to set arbitrary akka configurations via property file

2015-05-14 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang closed SPARK-4669. --- Resolution: Won't Fix Per Prashant's comments in https://github.com/apache/spark/pull/3551, I closed this. >

[jira] [Assigned] (SPARK-6743) Join with empty projection on one side produces invalid results

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6743: --- Assignee: (was: Apache Spark) > Join with empty projection on one side produces invalid r

[jira] [Assigned] (SPARK-6743) Join with empty projection on one side produces invalid results

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6743: --- Assignee: Apache Spark > Join with empty projection on one side produces invalid results > --

[jira] [Commented] (SPARK-6743) Join with empty projection on one side produces invalid results

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544782#comment-14544782 ] Apache Spark commented on SPARK-6743: - User 'marmbrus' has created a pull request for

[jira] [Commented] (SPARK-6743) Join with empty projection on one side produces invalid results

2015-05-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544783#comment-14544783 ] Michael Armbrust commented on SPARK-6743: - Thanks for narrowing this down. I've o

[jira] [Assigned] (SPARK-7656) use CatalystConf in FunctionRegistry

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7656: --- Assignee: Apache Spark > use CatalystConf in FunctionRegistry > -

[jira] [Commented] (SPARK-7656) use CatalystConf in FunctionRegistry

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544772#comment-14544772 ] Apache Spark commented on SPARK-7656: - User 'scwf' has created a pull request for this

[jira] [Assigned] (SPARK-7656) use CatalystConf in FunctionRegistry

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7656: --- Assignee: (was: Apache Spark) > use CatalystConf in FunctionRegistry > --

[jira] [Created] (SPARK-7656) use CatalystConf in FunctionRegistry

2015-05-14 Thread Fei Wang (JIRA)
Fei Wang created SPARK-7656: --- Summary: use CatalystConf in FunctionRegistry Key: SPARK-7656 URL: https://issues.apache.org/jira/browse/SPARK-7656 Project: Spark Issue Type: Improvement Co

[jira] [Created] (SPARK-7655) Akka timeout exception

2015-05-14 Thread Yin Huai (JIRA)
Yin Huai created SPARK-7655: --- Summary: Akka timeout exception Key: SPARK-7655 URL: https://issues.apache.org/jira/browse/SPARK-7655 Project: Spark Issue Type: Bug Components: Spark Core

[jira] [Resolved] (SPARK-7619) autodoc_docstring_signature doesn't work for some classes/methods under spark.ml

2015-05-14 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7619. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6161 [https://githu

[jira] [Created] (SPARK-7654) Create builder pattern for DataFrame.save

2015-05-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7654: -- Summary: Create builder pattern for DataFrame.save Key: SPARK-7654 URL: https://issues.apache.org/jira/browse/SPARK-7654 Project: Spark Issue Type: Sub-task

[jira] [Issue Comment Deleted] (SPARK-7648) Additional methods in ALS JavaModel wrappers

2015-05-14 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7648: - Comment: was deleted (was: User 'mengxr' has created a pull request for this issue: https://github

[jira] [Assigned] (SPARK-7647) Additional methods in GLM JavaModel wrappers

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7647: --- Assignee: Apache Spark > Additional methods in GLM JavaModel wrappers > -

[jira] [Closed] (SPARK-7647) Additional methods in GLM JavaModel wrappers

2015-05-14 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-7647. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Xiangrui Meng https://github.com/ap

[jira] [Commented] (SPARK-7647) Additional methods in GLM JavaModel wrappers

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544715#comment-14544715 ] Apache Spark commented on SPARK-7647: - User 'mengxr' has created a pull request for th

[jira] [Assigned] (SPARK-7647) Additional methods in GLM JavaModel wrappers

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7647: --- Assignee: (was: Apache Spark) > Additional methods in GLM JavaModel wrappers > --

[jira] [Created] (SPARK-7653) ML Pipeline and meta-algs should take random seed param

2015-05-14 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7653: Summary: ML Pipeline and meta-algs should take random seed param Key: SPARK-7653 URL: https://issues.apache.org/jira/browse/SPARK-7653 Project: Spark

[jira] [Commented] (SPARK-3147) Implement A/B testing

2015-05-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544673#comment-14544673 ] Tathagata Das commented on SPARK-3147: -- Is this going to make it to 1.4.0? If not cou

[jira] [Commented] (SPARK-7612) Use BLAS in naive Bayes training

2015-05-14 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544661#comment-14544661 ] Xiangrui Meng commented on SPARK-7612: -- FYI, saw ~4x speedup with this change in perf

[jira] [Created] (SPARK-7652) Performance regression in naive Bayes prediction

2015-05-14 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7652: Summary: Performance regression in naive Bayes prediction Key: SPARK-7652 URL: https://issues.apache.org/jira/browse/SPARK-7652 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-6289) PySpark doesn't maintain SQL date Types

2015-05-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544652#comment-14544652 ] Davies Liu commented on SPARK-6289: --- [~mnazario] datetime is a subclass of date, so a da

[jira] [Updated] (SPARK-6289) PySpark doesn't maintain SQL date Types

2015-05-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-6289: -- Description: For the DateType, Spark SQL requires a datetime.date in Python. However, if you collect a

[jira] [Closed] (SPARK-7643) Number of executors and partitions are displayed wrongly in storage tab

2015-05-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7643. Resolution: Fixed Fix Version/s: 1.4.0 > Number of executors and partitions are displayed wrongly in

[jira] [Closed] (SPARK-7645) Show milliseconds in the UI if the batch interval < 1 second

2015-05-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7645. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Shixiong Zhu > Show milliseconds in the UI

[jira] [Closed] (SPARK-7649) Use window.localStorage to store the status rather than the url

2015-05-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7649. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Shixiong Zhu > Use window.localStorage to s

[jira] [Closed] (SPARK-7598) Add aliveWorkers metrics in Master

2015-05-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7598. Resolution: Fixed Fix Version/s: 1.4.0 Target Version/s: 1.4.0 > Add aliveWorkers metrics i

[jira] [Updated] (SPARK-6917) Broken data returned to PySpark dataframe if any large numbers used in Scala land

2015-05-14 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6917: - Assignee: Davies Liu > Broken data returned to PySpark dataframe if any large numbers used in Scal

[jira] [Updated] (SPARK-7651) PySpark GMM predict, predictSoft should fail on bad input

2015-05-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7651: - Priority: Minor (was: Major) > PySpark GMM predict, predictSoft should fail on bad input

[jira] [Commented] (SPARK-7651) PySpark GMM predict, predictSoft should fail on bad input

2015-05-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544599#comment-14544599 ] Joseph K. Bradley commented on SPARK-7651: -- Ping [~MeethuMathew]: Could you pleas

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2015-05-14 Thread Kannan Rajah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544563#comment-14544563 ] Kannan Rajah commented on SPARK-1529: - Just wanted to check if folks got a chance to r

[jira] [Created] (SPARK-7651) PySpark GMM predict, predictSoft should fail on bad input

2015-05-14 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7651: Summary: PySpark GMM predict, predictSoft should fail on bad input Key: SPARK-7651 URL: https://issues.apache.org/jira/browse/SPARK-7651 Project: Spark

[jira] [Commented] (SPARK-7619) autodoc_docstring_signature doesn't work for some classes/methods under spark.ml

2015-05-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544540#comment-14544540 ] Apache Spark commented on SPARK-7619: - User 'mengxr' has created a pull request for th

  1   2   3   >