[jira] [Resolved] (SPARK-2104) RangePartitioner should use user specified serializer to serialize range bounds

2014-06-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2104. Resolution: Fixed Fix Version/s: 1.1.0 RangePartitioner should use user specified

[jira] [Resolved] (SPARK-897) Preemptively serialize closures to help users identify non-serializable errors early on

2014-06-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-897. --- Resolution: Fixed Fix Version/s: (was: 1.0.0) 1.1.0 Preemptively

[jira] [Resolved] (SPARK-2077) Log serializer in use on application startup

2014-06-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2077. Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Andrew Ash Log serializer in use

[jira] [Created] (SPARK-2324) SparkContext should not exit directly when spark.local.dir is a list of multiple paths and one of them has error

2014-06-30 Thread YanTang Zhai (JIRA)
YanTang Zhai created SPARK-2324: --- Summary: SparkContext should not exit directly when spark.local.dir is a list of multiple paths and one of them has error Key: SPARK-2324 URL:

[jira] [Created] (SPARK-2325) Utils.getLocalDir had better check the directory and choose a good one instead of choosing the first one directly

2014-06-30 Thread YanTang Zhai (JIRA)
YanTang Zhai created SPARK-2325: --- Summary: Utils.getLocalDir had better check the directory and choose a good one instead of choosing the first one directly Key: SPARK-2325 URL:

[jira] [Commented] (SPARK-2327) Fix nullabilities of Join/Generate/Aggregate.

2014-06-30 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047495#comment-14047495 ] Takuya Ueshin commented on SPARK-2327: -- PRed:

[jira] [Created] (SPARK-2328) Add execution of `SHOW TABLES` before `TestHive.reset()`.

2014-06-30 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-2328: Summary: Add execution of `SHOW TABLES` before `TestHive.reset()`. Key: SPARK-2328 URL: https://issues.apache.org/jira/browse/SPARK-2328 Project: Spark

[jira] [Commented] (SPARK-2328) Add execution of `SHOW TABLES` before `TestHive.reset()`.

2014-06-30 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047546#comment-14047546 ] Takuya Ueshin commented on SPARK-2328: -- PRed:

[jira] [Created] (SPARK-2329) Add multi-label evaluation metrics

2014-06-30 Thread Alexander Ulanov (JIRA)
Alexander Ulanov created SPARK-2329: --- Summary: Add multi-label evaluation metrics Key: SPARK-2329 URL: https://issues.apache.org/jira/browse/SPARK-2329 Project: Spark Issue Type: New

[jira] [Created] (SPARK-2330) Spark shell has weird scala semantics

2014-06-30 Thread Andrea Ferretti (JIRA)
Andrea Ferretti created SPARK-2330: -- Summary: Spark shell has weird scala semantics Key: SPARK-2330 URL: https://issues.apache.org/jira/browse/SPARK-2330 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2330) Spark shell has weird scala semantics

2014-06-30 Thread Andrea Ferretti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrea Ferretti updated SPARK-2330: --- Description: Normal scala expressions are interpreted in a strange way in the spark shell.

[jira] [Commented] (SPARK-2330) Spark shell has weird scala semantics

2014-06-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047689#comment-14047689 ] Sean Owen commented on SPARK-2330: -- I can't reproduce this in HEAD right now. Try that?

[jira] [Commented] (SPARK-2003) SparkContext(SparkConf) doesn't work in pyspark

2014-06-30 Thread Diana Carroll (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047710#comment-14047710 ] Diana Carroll commented on SPARK-2003: -- I do not agree this is a doc bug. This is

[jira] [Created] (SPARK-2331) SparkContext.emptyRDD has wrong return type

2014-06-30 Thread Ian Hummel (JIRA)
Ian Hummel created SPARK-2331: - Summary: SparkContext.emptyRDD has wrong return type Key: SPARK-2331 URL: https://issues.apache.org/jira/browse/SPARK-2331 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-2331) SparkContext.emptyRDD has wrong return type

2014-06-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048041#comment-14048041 ] Sean Owen edited comment on SPARK-2331 at 6/30/14 7:48 PM: --- My 2

[jira] [Commented] (SPARK-2331) SparkContext.emptyRDD has wrong return type

2014-06-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048041#comment-14048041 ] Sean Owen commented on SPARK-2331: -- My 2 cents. You mean the type is EmptyRDD[Nothing]

[jira] [Created] (SPARK-2332) add exclusion for old servlet-api on hadoop-client in core

2014-06-30 Thread Pete MacKinnon (JIRA)
Pete MacKinnon created SPARK-2332: - Summary: add exclusion for old servlet-api on hadoop-client in core Key: SPARK-2332 URL: https://issues.apache.org/jira/browse/SPARK-2332 Project: Spark

[jira] [Commented] (SPARK-2245) VertexRDD can not be materialized for checkpointing

2014-06-30 Thread Baoxu Shi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048073#comment-14048073 ] Baoxu Shi commented on SPARK-2245: -- I edited my original comment to add the updates, but

[jira] [Commented] (SPARK-2167) spark-submit should return exit code based on failure/success

2014-06-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048175#comment-14048175 ] Marcelo Vanzin commented on SPARK-2167: --- Given that spark-submit doesn't really have

[jira] [Resolved] (SPARK-2318) When exiting on a signal, print the signal name first

2014-06-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2318. Resolution: Fixed Fix Version/s: 1.1.0 When exiting on a signal, print the signal name

[jira] [Resolved] (SPARK-2293) Replace RDD.zip usage by map with predict inside.

2014-06-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2293. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1250

[jira] [Commented] (SPARK-2138) The KMeans algorithm in the MLlib can lead to the Serialized Task size become bigger and bigger

2014-06-30 Thread Piotr Szul (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048429#comment-14048429 ] Piotr Szul commented on SPARK-2138: --- I tested my code with 1.0.1 and I can confirm that

[jira] [Commented] (SPARK-2168) History Server renered page not suitable for load balancing

2014-06-30 Thread Lukasz Jastrzebski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048485#comment-14048485 ] Lukasz Jastrzebski commented on SPARK-2168: --- PR opened History Server renered

[jira] [Commented] (SPARK-2138) The KMeans algorithm in the MLlib can lead to the Serialized Task size become bigger and bigger

2014-06-30 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048488#comment-14048488 ] DjvuLee commented on SPARK-2138: @[~piotrszul] Thanks for your test, I will also test this