[jira] [Commented] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-05-20 Thread Kaveen Raajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553733#comment-14553733 ] Kaveen Raajan commented on SPARK-5389: -- I had the same problem. I found the root caus

[jira] [Resolved] (SPARK-7753) Improve kernel density API

2015-05-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7753. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6279 [https://githu

[jira] [Updated] (SPARK-7784) Check 1.3-> 1.4 SQL API compliance using java-compliance-checker

2015-05-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7784: - Attachment: compat_report.html There are lots of false positives since package private classes/met

[jira] [Created] (SPARK-7784) Check 1.3-> 1.4 SQL API compliance using java-compliance-checker

2015-05-20 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7784: Summary: Check 1.3-> 1.4 SQL API compliance using java-compliance-checker Key: SPARK-7784 URL: https://issues.apache.org/jira/browse/SPARK-7784 Project: Spark

[jira] [Commented] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-05-20 Thread Xia Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553703#comment-14553703 ] Xia Hu commented on SPARK-6197: --- Ok, get it. Thank you very much~~ > handle json parse exce

[jira] [Commented] (SPARK-7320) Add rollup and cube support to DataFrame Java/Scala DSL

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553696#comment-14553696 ] Apache Spark commented on SPARK-7320: - User 'chenghao-intel' has created a pull reques

[jira] [Resolved] (SPARK-7606) Document all PySpark SQL/DataFrame public methods with @since tag

2015-05-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7606. Resolution: Fixed Fix Version/s: 1.4.0 > Document all PySpark SQL/DataFrame public methods wi

[jira] [Resolved] (SPARK-7389) Tachyon integration improvement

2015-05-20 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7389. Resolution: Fixed Fix Version/s: 1.5.0 > Tachyon integration improvement > --

[jira] [Updated] (SPARK-7389) Tachyon integration improvement

2015-05-20 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7389: --- Assignee: shimingfei > Tachyon integration improvement > --- > >

[jira] [Updated] (SPARK-7782) A small problem on history server webpage

2015-05-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7782: -- Component/s: Web UI Priority: Minor (was: Major) Labels: starter (was: ) > A small pro

[jira] [Resolved] (SPARK-7746) SetFetchSize for JDBCRDD's prepareStatement

2015-05-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7746. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Liang-Chi Hsieh > SetFetchSize for

[jira] [Assigned] (SPARK-7783) Add rollup and cube support to DataFrame Python DSL

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7783: --- Assignee: Apache Spark (was: Davies Liu) > Add rollup and cube support to DataFrame Python D

[jira] [Assigned] (SPARK-7783) Add rollup and cube support to DataFrame Python DSL

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7783: --- Assignee: Davies Liu (was: Apache Spark) > Add rollup and cube support to DataFrame Python D

[jira] [Commented] (SPARK-7783) Add rollup and cube support to DataFrame Python DSL

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553635#comment-14553635 ] Apache Spark commented on SPARK-7783: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-7754) Use PartialFunction literals instead of objects in Catalyst

2015-05-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553617#comment-14553617 ] Reynold Xin commented on SPARK-7754: Note that there is at least one downside to this

[jira] [Updated] (SPARK-7320) Add rollup and cube support to DataFrame Java/Scala DSL

2015-05-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7320: --- Summary: Add rollup and cube support to DataFrame Java/Scala DSL (was: Add rollup and cube support to

[jira] [Assigned] (SPARK-7783) Add rollup and cube support to DataFrame Python DSL

2015-05-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-7783: - Assignee: Davies Liu (was: Cheng Hao) > Add rollup and cube support to DataFrame Python DSL > --

[jira] [Commented] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-05-20 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553600#comment-14553600 ] Zhang, Liye commented on SPARK-6197: Hi [~Xia Hu], This Patch only solve the problem f

[jira] [Commented] (SPARK-7781) GradientBoostedTrees.trainRegressor is missing maxBins parameter in pyspark

2015-05-20 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553596#comment-14553596 ] holdenk commented on SPARK-7781: I can take this :) > GradientBoostedTrees.trainRegressor

[jira] [Created] (SPARK-7783) Add rollup and cube support to DataFrame Python DSL

2015-05-20 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7783: -- Summary: Add rollup and cube support to DataFrame Python DSL Key: SPARK-7783 URL: https://issues.apache.org/jira/browse/SPARK-7783 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-7782) A small problem on history server webpage

2015-05-20 Thread Xia Hu (JIRA)
Xia Hu created SPARK-7782: - Summary: A small problem on history server webpage Key: SPARK-7782 URL: https://issues.apache.org/jira/browse/SPARK-7782 Project: Spark Issue Type: Bug Affects Version

[jira] [Updated] (SPARK-4134) Tone down scary executor lost messages when killing on purpose

2015-05-20 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4134: - Target Version/s: 1.5.0 > Tone down scary executor lost messages when killing on purpose > ---

[jira] [Commented] (SPARK-4134) Tone down scary executor lost messages when killing on purpose

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553583#comment-14553583 ] Apache Spark commented on SPARK-4134: - User 'andrewor14' has created a pull request fo

[jira] [Assigned] (SPARK-4134) Tone down scary executor lost messages when killing on purpose

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4134: --- Assignee: Andrew Or (was: Apache Spark) > Tone down scary executor lost messages when killin

[jira] [Assigned] (SPARK-4134) Tone down scary executor lost messages when killing on purpose

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4134: --- Assignee: Apache Spark (was: Andrew Or) > Tone down scary executor lost messages when killin

[jira] [Created] (SPARK-7781) GradientBoostedTrees.trainRegressor is missing maxBins parameter in pyspark

2015-05-20 Thread Don Drake (JIRA)
Don Drake created SPARK-7781: Summary: GradientBoostedTrees.trainRegressor is missing maxBins parameter in pyspark Key: SPARK-7781 URL: https://issues.apache.org/jira/browse/SPARK-7781 Project: Spark

[jira] [Resolved] (SPARK-7774) Add sqlContext to MLlibTestSparkContext

2015-05-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7774. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6303 [https://githu

[jira] [Assigned] (SPARK-7778) Add standard deviation aggregate expression

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7778: --- Assignee: (was: Apache Spark) > Add standard deviation aggregate expression > --

[jira] [Commented] (SPARK-7778) Add standard deviation aggregate expression

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553563#comment-14553563 ] Apache Spark commented on SPARK-7778: - User 'rakeshchalasani' has created a pull reque

[jira] [Assigned] (SPARK-7778) Add standard deviation aggregate expression

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7778: --- Assignee: Apache Spark > Add standard deviation aggregate expression > -

[jira] [Commented] (SPARK-7439) Should delete temporary local directories

2015-05-20 Thread Taeyun Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553556#comment-14553556 ] Taeyun Kim commented on SPARK-7439: --- It's not enough to clean up the dirs. Dirs themselv

[jira] [Reopened] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-05-20 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-6197: -- > handle json parse exception for eventlog file not finished writing >

[jira] [Updated] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-05-20 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6197: - Labels: backport-needed (was: ) > handle json parse exception for eventlog file not finished writing > -

[jira] [Updated] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-05-20 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6197: - Fix Version/s: (was: 1.3.2) > handle json parse exception for eventlog file not finished writing > --

[jira] [Commented] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-05-20 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553550#comment-14553550 ] Andrew Or commented on SPARK-6197: -- It would appear that it's because it was later revert

[jira] [Resolved] (SPARK-7320) Add rollup and cube support to DataFrame DSL

2015-05-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7320. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6304 [https://github.com/apac

[jira] [Resolved] (SPARK-7777) Fix a flaky test: org.apache.spark.streaming.BasicOperationsSuite.rdd cleanup - input blocks and persisted RDDs

2015-05-20 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-. -- Resolution: Fixed Fix Version/s: 1.4.0 > Fix a flaky test: org.apache.spark.streaming.Bas

[jira] [Commented] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-05-20 Thread Xia Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553548#comment-14553548 ] Xia Hu commented on SPARK-6197: --- this patch seems useless to me. My version is 1.3.1 and env

[jira] [Updated] (SPARK-7777) Fix a flaky test: org.apache.spark.streaming.BasicOperationsSuite.rdd cleanup - input blocks and persisted RDDs

2015-05-20 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-: - Assignee: Shixiong Zhu > Fix a flaky test: org.apache.spark.streaming.BasicOperationsSuite.rdd cle

[jira] [Commented] (SPARK-7555) User guide update for ElasticNet

2015-05-20 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553542#comment-14553542 ] DB Tsai commented on SPARK-7555: [~coderxiang] told me he will chime in and help out the d

[jira] [Created] (SPARK-7780) The intercept in LogisticRegressionWithLBFGS should not be regularized

2015-05-20 Thread DB Tsai (JIRA)
DB Tsai created SPARK-7780: -- Summary: The intercept in LogisticRegressionWithLBFGS should not be regularized Key: SPARK-7780 URL: https://issues.apache.org/jira/browse/SPARK-7780 Project: Spark Iss

[jira] [Updated] (SPARK-7750) Rename "json" endpoints to "api" endpoints

2015-05-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-7750: Assignee: Hari Shreedharan > Rename "json" endpoints to "api" endpoints > --

[jira] [Resolved] (SPARK-7750) Rename "json" endpoints to "api" endpoints

2015-05-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-7750. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6273 [https://github.

[jira] [Assigned] (SPARK-7779) Dynamic allocation: confusing message when canceling requests

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7779: --- Assignee: Andrew Or (was: Apache Spark) > Dynamic allocation: confusing message when canceli

[jira] [Commented] (SPARK-7779) Dynamic allocation: confusing message when canceling requests

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553510#comment-14553510 ] Apache Spark commented on SPARK-7779: - User 'andrewor14' has created a pull request fo

[jira] [Assigned] (SPARK-7779) Dynamic allocation: confusing message when canceling requests

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7779: --- Assignee: Apache Spark (was: Andrew Or) > Dynamic allocation: confusing message when canceli

[jira] [Created] (SPARK-7779) Dynamic allocation: confusing message when canceling requests

2015-05-20 Thread Andrew Or (JIRA)
Andrew Or created SPARK-7779: Summary: Dynamic allocation: confusing message when canceling requests Key: SPARK-7779 URL: https://issues.apache.org/jira/browse/SPARK-7779 Project: Spark Issue Ty

[jira] [Created] (SPARK-7778) Add standard deviation aggregate expression

2015-05-20 Thread Rakesh Chalasani (JIRA)
Rakesh Chalasani created SPARK-7778: --- Summary: Add standard deviation aggregate expression Key: SPARK-7778 URL: https://issues.apache.org/jira/browse/SPARK-7778 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-7219) HashingTF should output ML attributes

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7219: --- Assignee: Xiangrui Meng (was: Apache Spark) > HashingTF should output ML attributes > --

[jira] [Commented] (SPARK-7219) HashingTF should output ML attributes

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553491#comment-14553491 ] Apache Spark commented on SPARK-7219: - User 'mengxr' has created a pull request for th

[jira] [Assigned] (SPARK-7219) HashingTF should output ML attributes

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7219: --- Assignee: Apache Spark (was: Xiangrui Meng) > HashingTF should output ML attributes > --

[jira] [Assigned] (SPARK-7776) Add shutdown hook to stop StreamingContext

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7776: --- Assignee: Tathagata Das (was: Apache Spark) > Add shutdown hook to stop StreamingContext > -

[jira] [Commented] (SPARK-7776) Add shutdown hook to stop StreamingContext

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553461#comment-14553461 ] Apache Spark commented on SPARK-7776: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-7776) Add shutdown hook to stop StreamingContext

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7776: --- Assignee: Apache Spark (was: Tathagata Das) > Add shutdown hook to stop StreamingContext > -

[jira] [Updated] (SPARK-7776) Add shutdown hook to stop StreamingContext

2015-05-20 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7776: - Description: Shutdown hook to stop SparkContext was added recently. This results in ugly errors w

[jira] [Updated] (SPARK-7776) Add shutdown hook to stop StreamingContext

2015-05-20 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7776: - Description: Shutdown hook to stop SparkContext was added recently. This results in ugly errors w

[jira] [Comment Edited] (SPARK-7611) Support HashJoin if the join condition uses eqNullSafe/<=>

2015-05-20 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553448#comment-14553448 ] Matt Cheah edited comment on SPARK-7611 at 5/21/15 12:54 AM: -

[jira] [Resolved] (SPARK-7719) Java 6 code in UnsafeShuffleWriterSuite

2015-05-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7719. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6298 [https://github.com/

[jira] [Commented] (SPARK-7611) Support HashJoin if the join condition uses eqNullSafe/<=>

2015-05-20 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553448#comment-14553448 ] Matt Cheah commented on SPARK-7611: --- For context, was there a specific decision to avoid

[jira] [Assigned] (SPARK-7775) YARN AM tried to sleep negative milliseconds

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7775: --- Assignee: Andrew Or (was: Apache Spark) > YARN AM tried to sleep negative milliseconds > ---

[jira] [Commented] (SPARK-7775) YARN AM tried to sleep negative milliseconds

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553438#comment-14553438 ] Apache Spark commented on SPARK-7775: - User 'andrewor14' has created a pull request fo

[jira] [Assigned] (SPARK-7775) YARN AM tried to sleep negative milliseconds

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7775: --- Assignee: Apache Spark (was: Andrew Or) > YARN AM tried to sleep negative milliseconds > ---

[jira] [Commented] (SPARK-7777) Fix a flaky test: org.apache.spark.streaming.BasicOperationsSuite.rdd cleanup - input blocks and persisted RDDs

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553437#comment-14553437 ] Apache Spark commented on SPARK-: - User 'zsxwing' has created a pull request for t

[jira] [Assigned] (SPARK-7777) Fix a flaky test: org.apache.spark.streaming.BasicOperationsSuite.rdd cleanup - input blocks and persisted RDDs

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-: --- Assignee: Apache Spark > Fix a flaky test: org.apache.spark.streaming.BasicOperationsSuite.rd

[jira] [Assigned] (SPARK-7777) Fix a flaky test: org.apache.spark.streaming.BasicOperationsSuite.rdd cleanup - input blocks and persisted RDDs

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-: --- Assignee: (was: Apache Spark) > Fix a flaky test: org.apache.spark.streaming.BasicOperati

[jira] [Commented] (SPARK-7320) Add rollup and cube support to DataFrame DSL

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553431#comment-14553431 ] Apache Spark commented on SPARK-7320: - User 'chenghao-intel' has created a pull reques

[jira] [Created] (SPARK-7777) Fix a flaky test: org.apache.spark.streaming.BasicOperationsSuite.rdd cleanup - input blocks and persisted RDDs

2015-05-20 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-: --- Summary: Fix a flaky test: org.apache.spark.streaming.BasicOperationsSuite.rdd cleanup - input blocks and persisted RDDs Key: SPARK- URL: https://issues.apache.org/jira/browse/

[jira] [Commented] (SPARK-7775) YARN AM tried to sleep negative milliseconds

2015-05-20 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553430#comment-14553430 ] Andrew Or commented on SPARK-7775: -- Just realized the bug was not merged into 1.4, so I'm

[jira] [Updated] (SPARK-7775) YARN AM tried to sleep negative milliseconds

2015-05-20 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7775: - Description: {code} SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J

[jira] [Updated] (SPARK-7775) YARN AM tried to sleep negative milliseconds

2015-05-20 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7775: - Target Version/s: 1.5.0 (was: 1.4.0) > YARN AM tried to sleep negative milliseconds > ---

[jira] [Updated] (SPARK-7775) YARN AM tried to sleep negative milliseconds

2015-05-20 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7775: - Priority: Critical (was: Blocker) > YARN AM tried to sleep negative milliseconds > --

[jira] [Updated] (SPARK-7775) YARN AM tried to sleep negative milliseconds

2015-05-20 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7775: - Affects Version/s: (was: 1.4.0) 1.5.0 > YARN AM tried to sleep negative millise

[jira] [Resolved] (SPARK-7762) Set default value for outputCol based on UID

2015-05-20 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7762. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6289 [https

[jira] [Updated] (SPARK-7775) YARN AM tried to sleep negative milliseconds

2015-05-20 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7775: - Description: {code} SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J

[jira] [Created] (SPARK-7776) Add shutdown hook to stop StreamingContext

2015-05-20 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-7776: Summary: Add shutdown hook to stop StreamingContext Key: SPARK-7776 URL: https://issues.apache.org/jira/browse/SPARK-7776 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-7775) YARN AM tried to sleep negative milliseconds

2015-05-20 Thread Andrew Or (JIRA)
Andrew Or created SPARK-7775: Summary: YARN AM tried to sleep negative milliseconds Key: SPARK-7775 URL: https://issues.apache.org/jira/browse/SPARK-7775 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-7606) Document all PySpark SQL/DataFrame public methods with @since tag

2015-05-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-7606: - Assignee: Davies Liu > Document all PySpark SQL/DataFrame public methods with @since tag > --

[jira] [Assigned] (SPARK-7774) Add sqlContext to MLlibTestSparkContext

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7774: --- Assignee: Apache Spark (was: Xiangrui Meng) > Add sqlContext to MLlibTestSparkContext >

[jira] [Assigned] (SPARK-7774) Add sqlContext to MLlibTestSparkContext

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7774: --- Assignee: Xiangrui Meng (was: Apache Spark) > Add sqlContext to MLlibTestSparkContext >

[jira] [Commented] (SPARK-7774) Add sqlContext to MLlibTestSparkContext

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553379#comment-14553379 ] Apache Spark commented on SPARK-7774: - User 'mengxr' has created a pull request for th

[jira] [Created] (SPARK-7774) Add sqlContext to MLlibTestSparkContext

2015-05-20 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7774: Summary: Add sqlContext to MLlibTestSparkContext Key: SPARK-7774 URL: https://issues.apache.org/jira/browse/SPARK-7774 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-7773) Document `spark.dynamicAllocation.initialExecutors`

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553374#comment-14553374 ] Apache Spark commented on SPARK-7773: - User 'andrewor14' has created a pull request fo

[jira] [Assigned] (SPARK-7773) Document `spark.dynamicAllocation.initialExecutors`

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7773: --- Assignee: Apache Spark (was: Andrew Or) > Document `spark.dynamicAllocation.initialExecutors

[jira] [Assigned] (SPARK-7773) Document `spark.dynamicAllocation.initialExecutors`

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7773: --- Assignee: Andrew Or (was: Apache Spark) > Document `spark.dynamicAllocation.initialExecutors

[jira] [Created] (SPARK-7773) Document `spark.dynamicAllocation.initialExecutors`

2015-05-20 Thread Andrew Or (JIRA)
Andrew Or created SPARK-7773: Summary: Document `spark.dynamicAllocation.initialExecutors` Key: SPARK-7773 URL: https://issues.apache.org/jira/browse/SPARK-7773 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-7251) Perform sequential scan when iterating over entries in BytesToBytesMap

2015-05-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7251. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6159 [https://github.com/

[jira] [Resolved] (SPARK-7698) Implement buffer pooling / re-use in ExecutorMemoryManager when using HeapAllocator

2015-05-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7698. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6227 [https://github.com/

[jira] [Assigned] (SPARK-7771) Dynamic allocation: lower timeouts further

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7771: --- Assignee: Apache Spark (was: Andrew Or) > Dynamic allocation: lower timeouts further > -

[jira] [Assigned] (SPARK-7771) Dynamic allocation: lower timeouts further

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7771: --- Assignee: Andrew Or (was: Apache Spark) > Dynamic allocation: lower timeouts further > -

[jira] [Commented] (SPARK-7771) Dynamic allocation: lower timeouts further

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553329#comment-14553329 ] Apache Spark commented on SPARK-7771: - User 'andrewor14' has created a pull request fo

[jira] [Assigned] (SPARK-7127) Broadcast spark.ml tree ensemble models for predict

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7127: --- Assignee: Apache Spark > Broadcast spark.ml tree ensemble models for predict > --

[jira] [Resolved] (SPARK-7767) Fail fast if the DStream checkpoint is not serializable

2015-05-20 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7767. -- Resolution: Fixed Fix Version/s: 1.4.0 > Fail fast if the DStream checkpoint is not seria

[jira] [Commented] (SPARK-7127) Broadcast spark.ml tree ensemble models for predict

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553321#comment-14553321 ] Apache Spark commented on SPARK-7127: - User 'BryanCutler' has created a pull request f

[jira] [Assigned] (SPARK-7127) Broadcast spark.ml tree ensemble models for predict

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7127: --- Assignee: (was: Apache Spark) > Broadcast spark.ml tree ensemble models for predict > ---

[jira] [Commented] (SPARK-7565) Broken maps in jsonRDD

2015-05-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553280#comment-14553280 ] Apache Spark commented on SPARK-7565: - User 'davies' has created a pull request for th

[jira] [Created] (SPARK-7772) User guide for spark.ml trees and ensembles

2015-05-20 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7772: Summary: User guide for spark.ml trees and ensembles Key: SPARK-7772 URL: https://issues.apache.org/jira/browse/SPARK-7772 Project: Spark Issue Type:

[jira] [Created] (SPARK-7771) Dynamic allocation: lower timeouts further

2015-05-20 Thread Andrew Or (JIRA)
Andrew Or created SPARK-7771: Summary: Dynamic allocation: lower timeouts further Key: SPARK-7771 URL: https://issues.apache.org/jira/browse/SPARK-7771 Project: Spark Issue Type: Bug Co

[jira] [Resolved] (SPARK-7741) ContextCleaner not used by many DStream operations

2015-05-20 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7741. -- Resolution: Fixed Fix Version/s: 1.4.0 > ContextCleaner not used by many DStream operatio

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFoundException with Kryo, Guava 14

2015-05-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553258#comment-14553258 ] ASF GitHub Bot commented on SPARK-6069: --- Github user pferrel closed the pull request

[jira] [Updated] (SPARK-7511) PySpark ML seed Param should be varied per class

2015-05-20 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7511: - Assignee: Holden Karau > PySpark ML seed Param should be varied per class > --

  1   2   3   >