[jira] [Resolved] (SPARK-3936) Incorrect result in GraphX BytecodeUtils with closures + class/object methods

2014-11-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3936. Resolution: Fixed Fix Version/s: 1.2.0 > Incorrect result in GraphX BytecodeUtils with closur

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-11 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207774#comment-14207774 ] Aaron Davidson commented on SPARK-2468: --- [~zzcclp] Ah, man, that's not good. Just to

[jira] [Commented] (SPARK-4341) Spark need to set num-executors automatically

2014-11-11 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207770#comment-14207770 ] Hong Shen commented on SPARK-4341: -- 1. Add a configuration spark.executor.auto.set to ena

[jira] [Commented] (SPARK-4326) unidoc is broken on master

2014-11-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207767#comment-14207767 ] Xiangrui Meng commented on SPARK-4326: -- I was wondering why it worked on 1.2, and the

[jira] [Updated] (SPARK-4359) Empty classifier in "avro-mapred" is misinterpreted in SBT

2014-11-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4359: - Description: In the parent pom, "avro.mapred.classifier" is set to "hadoop2" for Yarn but not otherwise s

[jira] [Updated] (SPARK-4359) Empty classifier in "avro-mapred" is misinterpreted in SBT

2014-11-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4359: - Description: In the parent pom, "avro.mapred.classifier" is set to "hadoop2" for Yarn but not otherwise s

[jira] [Created] (SPARK-4359) Empty classifier in "avro-mapred" is misinterpreted in SBT

2014-11-11 Thread Andrew Or (JIRA)
Andrew Or created SPARK-4359: Summary: Empty classifier in "avro-mapred" is misinterpreted in SBT Key: SPARK-4359 URL: https://issues.apache.org/jira/browse/SPARK-4359 Project: Spark Issue Type:

[jira] [Updated] (SPARK-4359) Empty classifier in "avro-mapred" is misinterpreted in SBT

2014-11-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4359: - Affects Version/s: 1.2.0 > Empty classifier in "avro-mapred" is misinterpreted in SBT > --

[jira] [Updated] (SPARK-4359) Empty classifier in "avro-mapred" is misinterpreted in SBT

2014-11-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4359: - Affects Version/s: 1.1.0 > Empty classifier in "avro-mapred" is misinterpreted in SBT > --

[jira] [Resolved] (SPARK-4347) GradientBoostingSuite takes more than 1 minute to finish

2014-11-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4347. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3214 [https://githu

[jira] [Commented] (SPARK-4358) Parsing NumericLit with more specified types

2014-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207736#comment-14207736 ] Apache Spark commented on SPARK-4358: - User 'viirya' has created a pull request for th

[jira] [Created] (SPARK-4358) Parsing NumericLit with more specified types

2014-11-11 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-4358: -- Summary: Parsing NumericLit with more specified types Key: SPARK-4358 URL: https://issues.apache.org/jira/browse/SPARK-4358 Project: Spark Issue Type: Im

[jira] [Updated] (SPARK-4348) pyspark.mllib.random conflicts with random module

2014-11-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4348: - Assignee: Davies Liu > pyspark.mllib.random conflicts with random module > ---

[jira] [Commented] (SPARK-4355) OnlineSummarizer doesn't merge mean correctly

2014-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207731#comment-14207731 ] Apache Spark commented on SPARK-4355: - User 'mengxr' has created a pull request for th

[jira] [Commented] (SPARK-720) Statically guarantee serialization will succeed

2014-11-11 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207732#comment-14207732 ] Andrew Ash commented on SPARK-720: -- A big design goal of Spark is that you don't have to h

[jira] [Updated] (SPARK-4357) Modify release publishing to work with Scala 2.11

2014-11-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4357: --- Component/s: Project Infra > Modify release publishing to work with Scala 2.11 > -

[jira] [Created] (SPARK-4357) Modify release publishing to work with Scala 2.11

2014-11-11 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-4357: -- Summary: Modify release publishing to work with Scala 2.11 Key: SPARK-4357 URL: https://issues.apache.org/jira/browse/SPARK-4357 Project: Spark Issue Typ

[jira] [Comment Edited] (SPARK-689) Task will crash when setting SPARK_WORKER_CORES> 128

2014-11-11 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207721#comment-14207721 ] Andrew Ash edited comment on SPARK-689 at 11/12/14 5:52 AM: I a

[jira] [Closed] (SPARK-689) Task will crash when setting SPARK_WORKER_CORES> 128

2014-11-11 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash closed SPARK-689. Resolution: Cannot Reproduce > Task will crash when setting SPARK_WORKER_CORES> 128 > ---

[jira] [Commented] (SPARK-689) Task will crash when setting SPARK_WORKER_CORES> 128

2014-11-11 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207721#comment-14207721 ] Andrew Ash commented on SPARK-689: -- I attempted a repro on a one-node cluster (my laptop)

[jira] [Updated] (SPARK-4356) Test Scala 2.11 on Jenkins

2014-11-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4356: --- Priority: Critical (was: Major) > Test Scala 2.11 on Jenkins > -- > >

[jira] [Updated] (SPARK-4356) Test Scala 2.11 on Jenkins

2014-11-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4356: --- Summary: Test Scala 2.11 on Jenkins (was: Test Scala 2.11 in maven) > Test Scala 2.11 on Jenk

[jira] [Updated] (SPARK-4356) Test Scala 2.11 on Jenkins

2014-11-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4356: --- Issue Type: Improvement (was: Bug) > Test Scala 2.11 on Jenkins > --

[jira] [Updated] (SPARK-4356) Test Scala 2.11 in maven

2014-11-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4356: --- Component/s: Project Infra > Test Scala 2.11 in maven > > >

[jira] [Created] (SPARK-4356) Test Scala 2.11 in maven

2014-11-11 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-4356: -- Summary: Test Scala 2.11 in maven Key: SPARK-4356 URL: https://issues.apache.org/jira/browse/SPARK-4356 Project: Spark Issue Type: Bug Report

[jira] [Resolved] (SPARK-1812) Support cross-building with Scala 2.11

2014-11-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1812. Resolution: Fixed Fix Version/s: 1.2.0 The initial version of this patch has been mer

[jira] [Commented] (SPARK-3445) Deprecate and later remove YARN alpha support

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207691#comment-14207691 ] Sean Owen commented on SPARK-3445: -- I know it's a different question, but, what is holdin

[jira] [Created] (SPARK-4355) OnlineSummarizer doesn't merge mean correctly

2014-11-11 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-4355: Summary: OnlineSummarizer doesn't merge mean correctly Key: SPARK-4355 URL: https://issues.apache.org/jira/browse/SPARK-4355 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3066) Support recommendAll in matrix factorization model

2014-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207685#comment-14207685 ] Apache Spark commented on SPARK-3066: - User 'debasish83' has created a pull request fo

[jira] [Commented] (SPARK-4351) Record cacheable RDD reads and display RDD miss rates

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207684#comment-14207684 ] Sean Owen commented on SPARK-4351: -- This sounds a lot like SPARK-3548, which also has a P

[jira] [Resolved] (SPARK-3662) Importing pandas breaks included pi.py example

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3662. -- Resolution: Duplicate I suggest considering this a duplicate of the later issue as it has a proposed re

[jira] [Updated] (SPARK-4354) 14/11/12 09:39:00 WARN TaskSetManager: Lost task 5.0 in stage 0.0 (TID 5, HYD-RNDNW-VFRCO-RCORE2): java.lang.NoClassDefFoundError: Could not initialize class org.xerial.s

2014-11-11 Thread Shyam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shyam updated SPARK-4354: - Attachment: client-exception.txt The process of execution and mentioned exception can be found in the text file a

[jira] [Created] (SPARK-4354) 14/11/12 09:39:00 WARN TaskSetManager: Lost task 5.0 in stage 0.0 (TID 5, HYD-RNDNW-VFRCO-RCORE2): java.lang.NoClassDefFoundError: Could not initialize class org.xerial.s

2014-11-11 Thread Shyam (JIRA)
Shyam created SPARK-4354: Summary: 14/11/12 09:39:00 WARN TaskSetManager: Lost task 5.0 in stage 0.0 (TID 5, HYD-RNDNW-VFRCO-RCORE2): java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy Key: SPARK-4354

[jira] [Commented] (SPARK-4038) Outlier Detection Algorithm for MLlib

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207655#comment-14207655 ] Sean Owen commented on SPARK-4038: -- That's an ancient JIRA. I think that in general, MLli

[jira] [Closed] (SPARK-4350) aggregate doesn't make copies of zeroValue in local mode

2014-11-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-4350. Resolution: Not a Problem Found the real problem somewhere else. > aggregate doesn't make copies of

[jira] [Updated] (SPARK-4353) Delete the val that never used in Catalog

2014-11-11 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4353: -- Description: "dbName" in Catalog never used, like that { val (dbName, tblName) = processDatabaseAndT

[jira] [Updated] (SPARK-4353) Delete the val that never used in Catalog

2014-11-11 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4353: -- Description: "dbName" in Catalog never used, like that { val (dbName, tblName) = processDatabaseAndT

[jira] [Commented] (SPARK-4353) Delete the val that never used in Catalog

2014-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207581#comment-14207581 ] Apache Spark commented on SPARK-4353: - User 'DoingDone9' has created a pull request fo

[jira] [Updated] (SPARK-4353) Delete the val that never used in Catalog

2014-11-11 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4353: -- Summary: Delete the val that never used in Catalog (was: Delete the val that never used) > Delete the

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

2014-11-11 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207568#comment-14207568 ] Ryan Williams commented on SPARK-3630: -- I'm seeing many Snappy {{FAILED_TO_UNCOMPRESS

[jira] [Commented] (SPARK-4351) Record cacheable RDD reads and display RDD miss rates

2014-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207566#comment-14207566 ] Apache Spark commented on SPARK-4351: - User 'woggle' has created a pull request for th

[jira] [Updated] (SPARK-4353) Delete the val that never used

2014-11-11 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4353: -- Component/s: SQL > Delete the val that never used > -- > > K

[jira] [Updated] (SPARK-4353) Delete the val that never used

2014-11-11 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4353: -- Description: "dbName" in Catalog never used, like that "val (dbName, tblName) = processDatabaseAndTableN

[jira] [Updated] (SPARK-4353) Delete the val that never used

2014-11-11 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4353: -- Issue Type: Improvement (was: Wish) > Delete the val that never used > -- >

[jira] [Created] (SPARK-4353) Delete the val that never used

2014-11-11 Thread DoingDone9 (JIRA)
DoingDone9 created SPARK-4353: - Summary: Delete the val that never used Key: SPARK-4353 URL: https://issues.apache.org/jira/browse/SPARK-4353 Project: Spark Issue Type: Wish Reporter:

[jira] [Commented] (SPARK-4038) Outlier Detection Algorithm for MLlib

2014-11-11 Thread Ashutosh Trivedi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207550#comment-14207550 ] Ashutosh Trivedi commented on SPARK-4038: - similar issue was opened at Mahout htt

[jira] [Commented] (SPARK-4348) pyspark.mllib.random conflicts with random module

2014-11-11 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207529#comment-14207529 ] Davies Liu commented on SPARK-4348: --- After some experiments, I found it's more harder th

[jira] [Commented] (SPARK-4348) pyspark.mllib.random conflicts with random module

2014-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207511#comment-14207511 ] Apache Spark commented on SPARK-4348: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

2014-11-11 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207463#comment-14207463 ] Yu Ishikawa commented on SPARK-2429: [~rnowling] Sorry for commenting again. Could you

[jira] [Created] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2014-11-11 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-4352: - Summary: Incorporate locality preferences in dynamic allocation requests Key: SPARK-4352 URL: https://issues.apache.org/jira/browse/SPARK-4352 Project: Spark Issu

[jira] [Commented] (SPARK-4338) Remove yarn-alpha support

2014-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207450#comment-14207450 ] Apache Spark commented on SPARK-4338: - User 'sryza' has created a pull request for thi

[jira] [Commented] (SPARK-4347) GradientBoostingSuite takes more than 1 minute to finish

2014-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207435#comment-14207435 ] Apache Spark commented on SPARK-4347: - User 'manishamde' has created a pull request fo

[jira] [Created] (SPARK-4351) Record cacheable RDD reads and display RDD miss rates

2014-11-11 Thread Charles Reiss (JIRA)
Charles Reiss created SPARK-4351: Summary: Record cacheable RDD reads and display RDD miss rates Key: SPARK-4351 URL: https://issues.apache.org/jira/browse/SPARK-4351 Project: Spark Issue Typ

[jira] [Updated] (SPARK-4322) Analysis incorrectly rejects accessing grouping fields

2014-11-11 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4322: Assignee: Cheng Lian > Analysis incorrectly rejects accessing grouping fields >

[jira] [Updated] (SPARK-4258) NPE with new Parquet Filters

2014-11-11 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4258: Assignee: Cheng Lian > NPE with new Parquet Filters > > >

[jira] [Commented] (SPARK-4349) Spark driver hangs on sc.parallelize() if exception is thrown during serialization

2014-11-11 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207392#comment-14207392 ] Matt Cheah commented on SPARK-4349: --- Investigation showed that the DAGScheduler may not

[jira] [Resolved] (SPARK-4157) Task input statistics incomplete when a task reads from multiple locations

2014-11-11 Thread Charles Reiss (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Reiss resolved SPARK-4157. -- Resolution: Duplicate > Task input statistics incomplete when a task reads from multiple locatio

[jira] [Commented] (SPARK-3066) Support recommendAll in matrix factorization model

2014-11-11 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207298#comment-14207298 ] Debasish Das commented on SPARK-3066: - [~mengxr] I am testing recommendAllUsers and re

[jira] [Commented] (SPARK-4228) Save a ScheamRDD in JSON format

2014-11-11 Thread Dan McClary (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207261#comment-14207261 ] Dan McClary commented on SPARK-4228: Pull request here: https://github.com/apache/spar

[jira] [Commented] (SPARK-4228) Save a ScheamRDD in JSON format

2014-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207262#comment-14207262 ] Apache Spark commented on SPARK-4228: - User 'dwmclary' has created a pull request for

[jira] [Closed] (SPARK-2269) Clean up and add unit tests for resourceOffers in MesosSchedulerBackend

2014-11-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2269. Resolution: Fixed Fix Version/s: 1.2.0 Target Version/s: 1.2.0 > Clean up and add unit test

[jira] [Created] (SPARK-4350) aggregate doesn't make copies of zeroValue in local mode

2014-11-11 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-4350: Summary: aggregate doesn't make copies of zeroValue in local mode Key: SPARK-4350 URL: https://issues.apache.org/jira/browse/SPARK-4350 Project: Spark Issue

[jira] [Commented] (SPARK-4092) Input metrics don't work for coalesce()'d RDD's

2014-11-11 Thread Kostas Sakellis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207190#comment-14207190 ] Kostas Sakellis commented on SPARK-4092: [~aash], yes this should solve a superset

[jira] [Commented] (SPARK-4348) pyspark.mllib.random conflicts with random module

2014-11-11 Thread Doris Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207199#comment-14207199 ] Doris Xin commented on SPARK-4348: -- I fully support this. It took a lot of hacking just t

[jira] [Commented] (SPARK-4349) Spark driver hangs on sc.parallelize() if exception is thrown during serialization

2014-11-11 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207185#comment-14207185 ] Matt Cheah commented on SPARK-4349: --- I'm investigating this now. Someone can assign to m

[jira] [Created] (SPARK-4349) Spark driver hangs on sc.parallelize() if exception is thrown during serialization

2014-11-11 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-4349: - Summary: Spark driver hangs on sc.parallelize() if exception is thrown during serialization Key: SPARK-4349 URL: https://issues.apache.org/jira/browse/SPARK-4349 Project: S

[jira] [Commented] (SPARK-4326) unidoc is broken on master

2014-11-11 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207177#comment-14207177 ] Nicholas Chammas commented on SPARK-4326: - Side question: Should we be (or are we

[jira] [Commented] (SPARK-4345) Spark SQL Hive throws exception when drop a none-exist table

2014-11-11 Thread Alex Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207171#comment-14207171 ] Alex Liu commented on SPARK-4345: - Swallow NoSuchObjectException exception when drop a non

[jira] [Created] (SPARK-4348) pyspark.mllib.random conflicts with random module

2014-11-11 Thread Davies Liu (JIRA)
Davies Liu created SPARK-4348: - Summary: pyspark.mllib.random conflicts with random module Key: SPARK-4348 URL: https://issues.apache.org/jira/browse/SPARK-4348 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4326) unidoc is broken on master

2014-11-11 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207156#comment-14207156 ] Marcelo Vanzin commented on SPARK-4326: --- Funny that it doesn't happen on 1.2 since t

[jira] [Commented] (SPARK-1739) Close PR's after period of inactivity

2014-11-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207112#comment-14207112 ] Josh Rosen commented on SPARK-1739: --- My proposal would be to have SparkQA post a comment

[jira] [Commented] (SPARK-4205) Timestamp and Date objects with comparison operators

2014-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207037#comment-14207037 ] Apache Spark commented on SPARK-4205: - User 'culler' has created a pull request for th

[jira] [Commented] (SPARK-2205) Unnecessary exchange operators in a join on multiple tables with the same join key.

2014-11-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207031#comment-14207031 ] Yin Huai commented on SPARK-2205: - Just a note to myself. It will be good to also look at

[jira] [Updated] (SPARK-4347) GradientBoostingSuite takes more than 1 minute to finish

2014-11-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4347: - Assignee: Manish Amde > GradientBoostingSuite takes more than 1 minute to finish > ---

[jira] [Commented] (SPARK-3682) Add helpful warnings to the UI

2014-11-11 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206891#comment-14206891 ] Kay Ousterhout commented on SPARK-3682: --- Some of the metrics you mentioned fall unde

[jira] [Updated] (SPARK-4169) [Core] Locale dependent code

2014-11-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4169: - Assignee: Niklas Wilcke > [Core] Locale dependent code > > >

[jira] [Created] (SPARK-4347) GradientBoostingSuite takes more than 1 minute to finish

2014-11-11 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-4347: Summary: GradientBoostingSuite takes more than 1 minute to finish Key: SPARK-4347 URL: https://issues.apache.org/jira/browse/SPARK-4347 Project: Spark Issue

[jira] [Resolved] (SPARK-4282) Stopping flag in YarnClientSchedulerBackend should be volatile

2014-11-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-4282. -- Resolution: Fixed Fix Version/s: 1.3.0 1.2.0 Assignee: Kousuke

[jira] [Created] (SPARK-4346) YarnClientSchedulerBack.asyncMonitorApplication should be common with Client.monitorApplication

2014-11-11 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-4346: Summary: YarnClientSchedulerBack.asyncMonitorApplication should be common with Client.monitorApplication Key: SPARK-4346 URL: https://issues.apache.org/jira/browse/SPARK-4346

[jira] [Resolved] (SPARK-4305) yarn-alpha profile won't build due to network/yarn module

2014-11-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-4305. -- Resolution: Fixed Fix Version/s: 1.3.0 1.2.0 Assignee: Sean Ow

[jira] [Created] (SPARK-4345) Spark SQL Hive throws exception when drop a none-exist table

2014-11-11 Thread Alex Liu (JIRA)
Alex Liu created SPARK-4345: --- Summary: Spark SQL Hive throws exception when drop a none-exist table Key: SPARK-4345 URL: https://issues.apache.org/jira/browse/SPARK-4345 Project: Spark Issue Type:

[jira] [Commented] (SPARK-4344) spark.yarn.user.classpath.first is undocumented

2014-11-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206722#comment-14206722 ] Apache Spark commented on SPARK-4344: - User 'arahuja' has created a pull request for t

[jira] [Created] (SPARK-4344) spark.yarn.user.classpath.first is undocumented

2014-11-11 Thread Arun Ahuja (JIRA)
Arun Ahuja created SPARK-4344: - Summary: spark.yarn.user.classpath.first is undocumented Key: SPARK-4344 URL: https://issues.apache.org/jira/browse/SPARK-4344 Project: Spark Issue Type: Documenta

[jira] [Resolved] (SPARK-1830) Deploy failover, Make Persistence engine and LeaderAgent Pluggable.

2014-11-11 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-1830. --- Resolution: Fixed Fix Version/s: (was: 1.2.0) (was: 1.0.1)

[jira] [Reopened] (SPARK-3624) "Failed to find Spark assembly in /usr/share/spark/lib" for RELEASED debian packages

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-3624: -- I jumped the gun; per Mark's comments this still deserves some resolution. > "Failed to find Spark assembly

[jira] [Commented] (SPARK-1216) Add a OneHotEncoder for handling categorical features

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206526#comment-14206526 ] Sean Owen commented on SPARK-1216: -- [~sandyr] This is basically https://issues.apache.org

[jira] [Commented] (SPARK-4034) get java.lang.NoClassDefFoundError: com/google/common/util/concurrent/ThreadFactoryBuilder in idea

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206505#comment-14206505 ] Sean Owen commented on SPARK-4034: -- I use IDEA and I have never encountered this. From th

[jira] [Commented] (SPARK-4343) Mima considers protected API methods for exclusion from binary checks.

2014-11-11 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206472#comment-14206472 ] Prashant Sharma commented on SPARK-4343: I am not sure if its a desired behaviour.

[jira] [Created] (SPARK-4343) Mima considers protected API methods for exclusion from binary checks.

2014-11-11 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-4343: -- Summary: Mima considers protected API methods for exclusion from binary checks. Key: SPARK-4343 URL: https://issues.apache.org/jira/browse/SPARK-4343 Project: Sp

[jira] [Resolved] (SPARK-1463) cleanup unnecessary dependency jars in the spark assembly jars

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1463. -- Resolution: Fixed Fix Version/s: (was: 1.0.0) Fixed at some point, it seems. No longer in the

[jira] [Resolved] (SPARK-1317) sbt doesn't work for building Spark programs

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1317. -- Resolution: Not a Problem > sbt doesn't work for building Spark programs > -

[jira] [Resolved] (SPARK-3624) "Failed to find Spark assembly in /usr/share/spark/lib" for RELEASED debian packages

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3624. -- Resolution: Won't Fix PR discussion seems to have several votes for "WontFix" > "Failed to find Spark a

[jira] [Resolved] (SPARK-3228) When DStream save RDD to hdfs , don't create directory and empty file if there are no data received from source in the batch duration .

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3228. -- Resolution: Won't Fix Given PR discussion, sounds like a WontFix > When DStream save RDD to hdfs , don'

[jira] [Resolved] (SPARK-2121) Not fully cached when there is enough memory in ALS

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2121. -- Resolution: Not a Problem > Not fully cached when there is enough memory in ALS > --

[jira] [Resolved] (SPARK-2982) Glitch of spark streaming

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2982. -- Resolution: Invalid Target Version/s: (was: 1.0.2) > Glitch of spark streaming > ---

[jira] [Commented] (SPARK-2819) Difficult to turn on intercept with linear models

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206415#comment-14206415 ] Sean Owen commented on SPARK-2819: -- Is this still in play ? the convenience methods can't

[jira] [Resolved] (SPARK-2733) Update make-distribution.sh to download Tachyon 0.5.0

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2733. -- Resolution: Duplicate Also roughly a duplicate of SPARK-2702, like its parent, and also resolved. > Upd

[jira] [Resolved] (SPARK-2732) Update build script to Tachyon 0.5.0

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2732. -- Resolution: Duplicate Dupe of SPARK-2702, and resolved anyway. > Update build script to Tachyon 0.5.0 >

[jira] [Resolved] (SPARK-2720) spark-examples should depend on HBase modules for HBase 0.96+

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2720. -- Resolution: Duplicate Basically subsumed by SPARK-1297, which was resolved. > spark-examples should dep

[jira] [Resolved] (SPARK-2725) Add instructions about how to build with Hive to building-with-maven.md

2014-11-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2725. -- Resolution: Fixed The current {{building-spark.md}} has Hive-related build instructions. This was fixed

  1   2   >