[jira] [Updated] (SPARK-7747) Document spark.sql.planner.externalSort option

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7747: - Assignee: Luca Martinetti Document spark.sql.planner.externalSort option

[jira] [Updated] (SPARK-7743) Upgrade Parquet to 1.7

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7743: - Assignee: Thomas Omans Upgrade Parquet to 1.7 -- Key: SPARK-7743

[jira] [Updated] (SPARK-7980) Support SQLContext.range(end)

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7980: - Assignee: Animesh Baranawal Support SQLContext.range(end) -

[jira] [Updated] (SPARK-8098) Show correct length of bytes on log page

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8098: - Assignee: Carson Wang Show correct length of bytes on log page

[jira] [Updated] (SPARK-8085) Pass in user-specified schema in read.df

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8085: - Assignee: Shivaram Venkataraman Pass in user-specified schema in read.df

[jira] [Commented] (SPARK-6284) Support framework authentication and role in Mesos framework

2015-06-06 Thread Kapil Malik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575628#comment-14575628 ] Kapil Malik commented on SPARK-6284: ^ +1. It's a must have for our usecase as well

[jira] [Commented] (SPARK-8069) Add support for cutoff to RandomForestClassifier

2015-06-06 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575627#comment-14575627 ] holdenk commented on SPARK-8069: Cool, I'll give that some though this weekend :) Add

[jira] [Commented] (SPARK-6707) Mesos Scheduler should allow the user to specify constraints based on slave attributes

2015-06-06 Thread Kapil Malik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575629#comment-14575629 ] Kapil Malik commented on SPARK-6707: [~ankurcha] so this change will accept

[jira] [Updated] (SPARK-8079) NPE when HadoopFsRelation.prepareForWriteJob throws exception

2015-06-06 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8079: -- Target Version/s: 1.4.1, 1.5.0 (was: 1.4.0, 1.4.1) NPE when HadoopFsRelation.prepareForWriteJob

[jira] [Updated] (SPARK-6973) The total stages on the allJobsPage is wrong

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6973: - Assignee: meiyoula The total stages on the allJobsPage is wrong

[jira] [Resolved] (SPARK-6973) The total stages on the allJobsPage is wrong

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6973. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 5550

[jira] [Updated] (SPARK-8080) Custom Receiver.store with Iterator type do not give correct count at Spark UI

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8080: - Component/s: Web UI Priority: Minor (was: Major) Fix Version/s: (was: 1.4.0)

[jira] [Updated] (SPARK-8079) NPE when HadoopFsRelation.prepareForWriteJob throws exception

2015-06-06 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8079: -- Labels: backport-needed (was: ) NPE when HadoopFsRelation.prepareForWriteJob throws exception

[jira] [Commented] (SPARK-8071) Run PySpark dataframe.rollup/cube test failed

2015-06-06 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575619#comment-14575619 ] Weizhong commented on SPARK-8071: - Hello [~chenghao], it failed on the PySpark unit

[jira] [Updated] (SPARK-8104) move the auto alias logic into Analyzer

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8104: - Component/s: SQL move the auto alias logic into Analyzer ---

[jira] [Resolved] (SPARK-8076) spark sql udtf error

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8076. -- Resolution: Invalid (Components please)

[jira] [Updated] (SPARK-8070) Improve createDataFrame in Python

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8070: - Component/s: PySpark Improve createDataFrame in Python -

[jira] [Updated] (SPARK-8048) Explicit partitionning of an RDD with 0 partition will yield empty outer join

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8048: - Component/s: Spark Core Explicit partitionning of an RDD with 0 partition will yield empty outer join

[jira] [Updated] (SPARK-8100) Make able to refer lost executor log

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8100: - Component/s: Web UI (Components please)

[jira] [Assigned] (SPARK-8138) Error message for discovered conflicting partition columns is not intuitive

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8138: --- Assignee: Apache Spark (was: Cheng Lian) Error message for discovered conflicting

[jira] [Commented] (SPARK-8138) Error message for discovered conflicting partition columns is not intuitive

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575609#comment-14575609 ] Apache Spark commented on SPARK-8138: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-8138) Error message for discovered conflicting partition columns is not intuitive

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8138: --- Assignee: Cheng Lian (was: Apache Spark) Error message for discovered conflicting

[jira] [Comment Edited] (SPARK-8079) NPE when HadoopFsRelation.prepareForWriteJob throws exception

2015-06-06 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575635#comment-14575635 ] Cheng Lian edited comment on SPARK-8079 at 6/6/15 8:51 AM: ---

[jira] [Updated] (SPARK-7889) Jobs progress of apps on complete page of HistoryServer shows uncompleted

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7889: - Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) I think the intent is to make job

[jira] [Commented] (SPARK-8079) NPE when HadoopFsRelation.prepareForWriteJob throws exception

2015-06-06 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575635#comment-14575635 ] Cheng Lian commented on SPARK-8079: --- Bascially, in {{InsertIntoHadoopFsRelation}} we

[jira] [Updated] (SPARK-8124) Created more examples on SparkR DataFrames

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8124: - Component/s: SparkR Examples Description: (Components please)

[jira] [Updated] (SPARK-8136) AM link download test can be flaky

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8136: - Component/s: YARN Tests AM link download test can be flaky

[jira] [Updated] (SPARK-8101) Upgrade netty to avoid memory leak accord to netty #3837 issues

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8101: - Component/s: Spark Core Upgrade netty to avoid memory leak accord to netty #3837 issues

[jira] [Created] (SPARK-8138) Error message for discovered conflicting partition columns is not intuitive

2015-06-06 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-8138: - Summary: Error message for discovered conflicting partition columns is not intuitive Key: SPARK-8138 URL: https://issues.apache.org/jira/browse/SPARK-8138 Project: Spark

[jira] [Resolved] (SPARK-8079) NPE when HadoopFsRelation.prepareForWriteJob throws exception

2015-06-06 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-8079. --- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue resolved by pull request

[jira] [Assigned] (SPARK-8140) Minor internal improvements in Streaming MLlib Algorithms

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8140: --- Assignee: Apache Spark Minor internal improvements in Streaming MLlib Algorithms

[jira] [Assigned] (SPARK-8140) Minor internal improvements in Streaming MLlib Algorithms

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8140: --- Assignee: (was: Apache Spark) Minor internal improvements in Streaming MLlib Algorithms

[jira] [Commented] (SPARK-8140) Minor internal improvements in Streaming MLlib Algorithms

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575719#comment-14575719 ] Apache Spark commented on SPARK-8140: - User 'MechCoder' has created a pull request for

[jira] [Created] (SPARK-8140) Minor internal improvements in Streaming MLlib Algorithms

2015-06-06 Thread Manoj Kumar (JIRA)
Manoj Kumar created SPARK-8140: -- Summary: Minor internal improvements in Streaming MLlib Algorithms Key: SPARK-8140 URL: https://issues.apache.org/jira/browse/SPARK-8140 Project: Spark Issue

[jira] [Created] (SPARK-8139) Documents data sources and Parquet output committer related options

2015-06-06 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-8139: - Summary: Documents data sources and Parquet output committer related options Key: SPARK-8139 URL: https://issues.apache.org/jira/browse/SPARK-8139 Project: Spark

[jira] [Updated] (SPARK-8079) NPE when HadoopFsRelation.prepareForWriteJob throws exception

2015-06-06 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8079: -- Labels: (was: backport-needed) NPE when HadoopFsRelation.prepareForWriteJob throws exception

[jira] [Commented] (SPARK-2205) Unnecessary exchange operators in a join on multiple tables with the same join key.

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575683#comment-14575683 ] Apache Spark commented on SPARK-2205: - User 'jeanlyn' has created a pull request for

[jira] [Assigned] (SPARK-2205) Unnecessary exchange operators in a join on multiple tables with the same join key.

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2205: --- Assignee: Yin Huai (was: Apache Spark) Unnecessary exchange operators in a join on

[jira] [Assigned] (SPARK-2205) Unnecessary exchange operators in a join on multiple tables with the same join key.

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2205: --- Assignee: Apache Spark (was: Yin Huai) Unnecessary exchange operators in a join on

[jira] [Commented] (SPARK-7871) Improve the outputPartitioning for HashOuterJoin(full outer join)

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575684#comment-14575684 ] Apache Spark commented on SPARK-7871: - User 'jeanlyn' has created a pull request for

[jira] [Commented] (SPARK-8139) Documents data sources and Parquet output committer related options

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575686#comment-14575686 ] Apache Spark commented on SPARK-8139: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-8139) Documents data sources and Parquet output committer related options

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8139: --- Assignee: Cheng Lian (was: Apache Spark) Documents data sources and Parquet output

[jira] [Assigned] (SPARK-8139) Documents data sources and Parquet output committer related options

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8139: --- Assignee: Apache Spark (was: Cheng Lian) Documents data sources and Parquet output

[jira] [Updated] (SPARK-8140) Minor internal improvements in Streaming MLlib Algorithms

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8140: - Priority: Trivial (was: Minor) I think the PR changes one aspect of the code and (once the new bug is

[jira] [Commented] (SPARK-7893) Complex Operators between Graphs

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575786#comment-14575786 ] Apache Spark commented on SPARK-7893: - User 'shijinkui' has created a pull request for

[jira] [Updated] (SPARK-8140) Remove empty model check in StreamingLinearAlgorithm

2015-06-06 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-8140: --- Summary: Remove empty model check in StreamingLinearAlgorithm (was: Minor internal improvements in

[jira] [Commented] (SPARK-8140) Remove empty model check in StreamingLinearAlgorithm

2015-06-06 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575802#comment-14575802 ] Manoj Kumar commented on SPARK-8140: Okay, I've changed the description of the JIRA.

[jira] [Updated] (SPARK-8142) Spark Job Fails with ResultTask Class Cast Exception

2015-06-06 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-8142: --- Summary: Spark Job Fails with ResultTask Class Cast Exception (was: Spark Job Fails with ResultTask

[jira] [Created] (SPARK-8142) Spark Job Fails with ResultTask Class Exception

2015-06-06 Thread Dev Lakhani (JIRA)
Dev Lakhani created SPARK-8142: -- Summary: Spark Job Fails with ResultTask Class Exception Key: SPARK-8142 URL: https://issues.apache.org/jira/browse/SPARK-8142 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8056) Design an easier way to construct schema for both Scala and Python

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575794#comment-14575794 ] Apache Spark commented on SPARK-8056: - User 'ilganeli' has created a pull request for

[jira] [Created] (SPARK-8141) Precompute datatypes for partition columns and reuse it

2015-06-06 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-8141: -- Summary: Precompute datatypes for partition columns and reuse it Key: SPARK-8141 URL: https://issues.apache.org/jira/browse/SPARK-8141 Project: Spark

[jira] [Commented] (SPARK-8122) ParquetRelation.enableLogForwarding() may fail to configure loggers

2015-06-06 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575790#comment-14575790 ] Cheng Lian commented on SPARK-8122: --- That makes sense to me now, thanks for the

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

2015-06-06 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575788#comment-14575788 ] Ryan Williams commented on SPARK-5784: -- Hi [~varvind], the verdict here was that this

[jira] [Assigned] (SPARK-8141) Precompute datatypes for partition columns and reuse it

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8141: --- Assignee: Apache Spark Precompute datatypes for partition columns and reuse it

[jira] [Commented] (SPARK-8141) Precompute datatypes for partition columns and reuse it

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575823#comment-14575823 ] Apache Spark commented on SPARK-8141: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-8141) Precompute datatypes for partition columns and reuse it

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8141: --- Assignee: (was: Apache Spark) Precompute datatypes for partition columns and reuse it

[jira] [Created] (SPARK-8143) Spark application history cannot be found even for finished jobs

2015-06-06 Thread Dev Lakhani (JIRA)
Dev Lakhani created SPARK-8143: -- Summary: Spark application history cannot be found even for finished jobs Key: SPARK-8143 URL: https://issues.apache.org/jira/browse/SPARK-8143 Project: Spark

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

2015-06-06 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575958#comment-14575958 ] Dev Lakhani commented on SPARK-8142: I'm using pre-compiled binaries for spark 1.3.1

[jira] [Updated] (SPARK-8129) Securely pass auth secrets to executors in standalone cluster mode

2015-06-06 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kan Zhang updated SPARK-8129: - Description: Currently, when authentication is turned on, the standalone cluster manager passes auth

[jira] [Assigned] (SPARK-8145) Trigger a double click on the span to show full job description

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8145: --- Assignee: (was: Apache Spark) Trigger a double click on the span to show full job

[jira] [Assigned] (SPARK-8145) Trigger a double click on the span to show full job description

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8145: --- Assignee: Apache Spark Trigger a double click on the span to show full job description

[jira] [Resolved] (SPARK-7639) Add Python API for Statistics.kernelDensity

2015-06-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7639. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6387

[jira] [Commented] (SPARK-7013) Add unit test for spark.ml StandardScaler

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575971#comment-14575971 ] Apache Spark commented on SPARK-7013: - User 'RoyGao' has created a pull request for

[jira] [Assigned] (SPARK-7013) Add unit test for spark.ml StandardScaler

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7013: --- Assignee: (was: Apache Spark) Add unit test for spark.ml StandardScaler

[jira] [Assigned] (SPARK-7013) Add unit test for spark.ml StandardScaler

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7013: --- Assignee: Apache Spark Add unit test for spark.ml StandardScaler

[jira] [Commented] (SPARK-8143) Spark application history cannot be found even for finished jobs

2015-06-06 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575959#comment-14575959 ] Dev Lakhani commented on SPARK-8143: Ok will wait for the official 1.4 release and

[jira] [Commented] (SPARK-8128) Dataframe Fails to Recognize Column in Schema

2015-06-06 Thread Brad Willard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576027#comment-14576027 ] Brad Willard commented on SPARK-8128: - Initially I had through this was a bug related

[jira] [Created] (SPARK-8145) Trigger a double click on the span to show full job description

2015-06-06 Thread q79969786 (JIRA)
q79969786 created SPARK-8145: Summary: Trigger a double click on the span to show full job description Key: SPARK-8145 URL: https://issues.apache.org/jira/browse/SPARK-8145 Project: Spark Issue

[jira] [Updated] (SPARK-7639) Add Python API for Statistics.kernelDensity

2015-06-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7639: - Assignee: Manoj Kumar Add Python API for Statistics.kernelDensity

[jira] [Updated] (SPARK-8145) Trigger a double click on the span to show full job description

2015-06-06 Thread q79969786 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] q79969786 updated SPARK-8145: - External issue URL: (was: https://github.com/apache/spark/pull/6646) Trigger a double click on the

[jira] [Commented] (SPARK-8144) PySpark SQL readwriter options() does not work

2015-06-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576081#comment-14576081 ] Davies Liu commented on SPARK-8144: --- We could do something, but it will be tricky,

[jira] [Closed] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-06-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7169. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Marcelo Vanzin Target

[jira] [Assigned] (SPARK-8146) DataFrame Python API: Alias replace in DataFrameNaFunctions

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8146: --- Assignee: Reynold Xin (was: Apache Spark) DataFrame Python API: Alias replace in

[jira] [Commented] (SPARK-8146) DataFrame Python API: Alias replace in DataFrameNaFunctions

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576112#comment-14576112 ] Apache Spark commented on SPARK-8146: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-8146) DataFrame Python API: Alias replace in DataFrameNaFunctions

2015-06-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8146: --- Assignee: Apache Spark (was: Reynold Xin) DataFrame Python API: Alias replace in

[jira] [Commented] (SPARK-6707) Mesos Scheduler should allow the user to specify constraints based on slave attributes

2015-06-06 Thread Ankur Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576101#comment-14576101 ] Ankur Chauhan commented on SPARK-6707: -- Hi Kapil, The patch is pretty much ready to

[jira] [Commented] (SPARK-2551) Cleanup FilteringParquetRowInputFormat

2015-06-06 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576109#comment-14576109 ] Cheng Lian commented on SPARK-2551: --- Yeah, thanks for reminding. Actually [~saucam] has

[jira] [Created] (SPARK-8146) DataFrame Python API: Alias replace in DataFrameNaFunctions

2015-06-06 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8146: -- Summary: DataFrame Python API: Alias replace in DataFrameNaFunctions Key: SPARK-8146 URL: https://issues.apache.org/jira/browse/SPARK-8146 Project: Spark Issue

[jira] [Updated] (SPARK-8142) Spark Job Fails with ResultTask Class Cast Exception

2015-06-06 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-8142: --- Description: When running a Spark Job, I get no failures in the application code whatsoever but a

[jira] [Created] (SPARK-8144) PySpark SQL readwriter options() does not work

2015-06-06 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-8144: Summary: PySpark SQL readwriter options() does not work Key: SPARK-8144 URL: https://issues.apache.org/jira/browse/SPARK-8144 Project: Spark Issue

[jira] [Commented] (SPARK-8071) Run PySpark dataframe.rollup/cube test failed

2015-06-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575877#comment-14575877 ] Davies Liu commented on SPARK-8071: --- I think It may be related to JDK 8 (we didn't test

[jira] [Commented] (SPARK-8143) Spark application history cannot be found even for finished jobs

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575876#comment-14575876 ] Sean Owen commented on SPARK-8143: -- [~devl.development] please have a look around JIRA

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

2015-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575874#comment-14575874 ] Sean Owen commented on SPARK-8142: -- Yeah, this sounds like a classpath or Spark version

[jira] [Commented] (SPARK-8144) PySpark SQL readwriter options() does not work

2015-06-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575894#comment-14575894 ] Joseph K. Bradley commented on SPARK-8144: -- Oops, I was mis-using it. But I

[jira] [Updated] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

2015-06-06 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-8142: --- Summary: Spark Job Fails with ResultTask ClassCastException (was: Spark Job Fails with ResultTask

[jira] [Updated] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

2015-06-06 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani updated SPARK-8142: --- Description: When running a Spark Job, I get no failures in the application code whatsoever but a

[jira] [Commented] (SPARK-8144) PySpark SQL readwriter options() does not work

2015-06-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575875#comment-14575875 ] Davies Liu commented on SPARK-8144: --- [~josephkb] It's not a typo, it's correct. Could