[jira] [Resolved] (SPARK-2252) mathjax doesn't work in HTTPS (math formulas not rendered)

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2252. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 mathjax doesn't work in

[jira] [Commented] (SPARK-2249) how to convert rows of schemaRdd into HashMaps

2014-06-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041766#comment-14041766 ] Sean Owen commented on SPARK-2249: -- This is where issues are reported, rather than where

[jira] [Commented] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

2014-06-24 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041789#comment-14041789 ] Prashant Sharma commented on SPARK-1199: One work around is to use `:paste`

[jira] [Commented] (SPARK-2125) Add sorting flag to ShuffleManager, and implement it in HashShuffleManager

2014-06-24 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041809#comment-14041809 ] Saisai Shao commented on SPARK-2125: Hi Matei, I have some basic implementations about

[jira] [Updated] (SPARK-2253) Disable partial aggregation automatically when reduction factor is low

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2253: --- Description: Once we see enough number of rows in partial aggregation and don't observe any

[jira] [Comment Edited] (SPARK-2125) Add sorting flag to ShuffleManager, and implement it in HashShuffleManager

2014-06-24 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041809#comment-14041809 ] Saisai Shao edited comment on SPARK-2125 at 6/24/14 7:26 AM: -

[jira] [Created] (SPARK-2255) create a self destructing iterator that release key value pairs from in-memory hash maps

2014-06-24 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-2255: -- Summary: create a self destructing iterator that release key value pairs from in-memory hash maps Key: SPARK-2255 URL: https://issues.apache.org/jira/browse/SPARK-2255

[jira] [Created] (SPARK-2254) ScalaRefection should mark primitive types as non-nullable.

2014-06-24 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-2254: Summary: ScalaRefection should mark primitive types as non-nullable. Key: SPARK-2254 URL: https://issues.apache.org/jira/browse/SPARK-2254 Project: Spark

[jira] [Updated] (SPARK-2255) create a self destructing iterator that releases records from hash maps

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2255: --- Summary: create a self destructing iterator that releases records from hash maps (was: create a

[jira] [Created] (SPARK-2256) pyspark: RDD.take doesn't work ... sometimes ...

2014-06-24 Thread JIRA
Ángel Álvarez created SPARK-2256: Summary: pyspark: RDD.take doesn't work ... sometimes ... Key: SPARK-2256 URL: https://issues.apache.org/jira/browse/SPARK-2256 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2248) spark.default.parallelism does not apply in local mode

2014-06-24 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041838#comment-14041838 ] Guoqiang Li commented on SPARK-2248: PR: https://github.com/apache/spark/pull/1194

[jira] [Updated] (SPARK-2125) Add sorting flag to ShuffleManager, and implement it in HashShuffleManager

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2125: --- Assignee: Saisai Shao Add sorting flag to ShuffleManager, and implement it in HashShuffleManager

[jira] [Commented] (SPARK-2254) ScalaRefection should mark primitive types as non-nullable.

2014-06-24 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041837#comment-14041837 ] Takuya Ueshin commented on SPARK-2254: -- PRed:

[jira] [Closed] (SPARK-2249) how to convert rows of schemaRdd into HashMaps

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-2249. -- Resolution: Not a Problem how to convert rows of schemaRdd into HashMaps

[jira] [Updated] (SPARK-2244) pyspark - RDD action hangs (after previously succeeding)

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2244: --- Description: {code} $ ./dist/bin/pyspark Python 2.7.5 (default, Feb 19 2014, 13:47:28) [GCC 4.8.2

[jira] [Commented] (SPARK-2247) data frames based on RDD

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041841#comment-14041841 ] Reynold Xin commented on SPARK-2247: This would be a great feature to build out on

[jira] [Updated] (SPARK-2247) data frames based on RDD

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2247: --- Target Version/s: (was: 1.0.0) data frames based on RDD -

[jira] [Updated] (SPARK-2242) Running sc.parallelize(..).count() hangs pyspark

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2242: --- Assignee: Andrew Or Running sc.parallelize(..).count() hangs pyspark

[jira] [Commented] (SPARK-2243) Using several Spark Contexts

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041844#comment-14041844 ] Reynold Xin commented on SPARK-2243: I don't think we currently support multiple

[jira] [Updated] (SPARK-2244) pyspark - RDD action hangs (after previously succeeding)

2014-06-24 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Farrellee updated SPARK-2244: - Environment: system: fedora 20 w/ maven 3.1.1 and openjdk 1.7.0_55 1.8.0_05 code: sha

[jira] [Created] (SPARK-2257) The algorithm of ALS in mlib lacks a parameter

2014-06-24 Thread zhengbing li (JIRA)
zhengbing li created SPARK-2257: --- Summary: The algorithm of ALS in mlib lacks a parameter Key: SPARK-2257 URL: https://issues.apache.org/jira/browse/SPARK-2257 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2257) The algorithm of ALS in mlib lacks a parameter

2014-06-24 Thread zhengbing li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengbing li updated SPARK-2257: Description: When I test ALS algorithm using netflix data, I find I cannot get the acurate

[jira] [Commented] (SPARK-2257) The algorithm of ALS in mlib lacks a parameter

2014-06-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042025#comment-14042025 ] Sean Owen commented on SPARK-2257: -- I don't think this is a bug, in the sense that it is

[jira] [Closed] (SPARK-2257) The algorithm of ALS in mlib lacks a parameter

2014-06-24 Thread zhengbing li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengbing li closed SPARK-2257. --- Resolution: Fixed Fix Version/s: 1.0.1 The algorithm of ALS in mlib lacks a parameter

[jira] [Created] (SPARK-2258) Worker UI displays zombie executors

2014-06-24 Thread Andrew Or (JIRA)
Andrew Or created SPARK-2258: Summary: Worker UI displays zombie executors Key: SPARK-2258 URL: https://issues.apache.org/jira/browse/SPARK-2258 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2258) Worker UI displays zombie executors

2014-06-24 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2258: - Attachment: Screen Shot 2014-06-24 at 9.23.18 AM.png Worker UI displays zombie executors

[jira] [Commented] (SPARK-1556) jets3t dep doesn't update properly with newer Hadoop versions

2014-06-24 Thread David Rosenstrauch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042332#comment-14042332 ] David Rosenstrauch commented on SPARK-1556: --- Thanks again for the tip. I didn't

[jira] [Created] (SPARK-2259) Spark submit documentation for --deploy-mode is highly misleading

2014-06-24 Thread Andrew Or (JIRA)
Andrew Or created SPARK-2259: Summary: Spark submit documentation for --deploy-mode is highly misleading Key: SPARK-2259 URL: https://issues.apache.org/jira/browse/SPARK-2259 Project: Spark

[jira] [Updated] (SPARK-2204) Scheduler for Mesos in fine-grained mode launches tasks on wrong executors

2014-06-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2204: --- Target Version/s: 1.0.1, 1.1.0 Scheduler for Mesos in fine-grained mode launches tasks on

[jira] [Created] (SPARK-2260) Spark submit standalone-cluster mode is broken

2014-06-24 Thread Andrew Or (JIRA)
Andrew Or created SPARK-2260: Summary: Spark submit standalone-cluster mode is broken Key: SPARK-2260 URL: https://issues.apache.org/jira/browse/SPARK-2260 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1937) Tasks can be submitted before executors are registered

2014-06-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-1937: - Assignee: Rui Li Tasks can be submitted before executors are registered

[jira] [Resolved] (SPARK-1937) Tasks can be submitted before executors are registered

2014-06-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-1937. -- Resolution: Fixed Fix Version/s: 1.1.0 Target Version/s: 1.1.0 Tasks can be

[jira] [Updated] (SPARK-1911) Warn users that jars should be built with Java 6 for YARN

2014-06-24 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1911: - Summary: Warn users that jars should be built with Java 6 for YARN (was: Warn users that jars should be

[jira] [Reopened] (SPARK-1911) Warn users that jars should be built with Java 6 for YARN

2014-06-24 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-1911: -- Looks like we still haven't fixed this. At the very least we should explicitly add this warning in the

[jira] [Updated] (SPARK-1911) Warn users if their jars are not built with Java 6

2014-06-24 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1911: - Fix Version/s: (was: 1.0.0) 1.1.0 Warn users if their jars are not built with

[jira] [Updated] (SPARK-1911) Warn users if their jars are not built with Java 6

2014-06-24 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1911: - Affects Version/s: 1.1.0 Warn users if their jars are not built with Java 6

[jira] [Updated] (SPARK-1911) Warn users if their jars are not built with Java 6

2014-06-24 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1911: - Description: Currently we warn users only in make-distribution.sh, but most users build the jars

[jira] [Updated] (SPARK-1911) Warn users if their assembly jars are not built with Java 6

2014-06-24 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1911: - Summary: Warn users if their assembly jars are not built with Java 6 (was: Warn users if their jars are

[jira] [Updated] (SPARK-1911) Warn users if their assembly jars are not built with Java 6

2014-06-24 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1911: - Description: The root cause of the problem is detailed in:

[jira] [Commented] (SPARK-1891) Add admin acls to the Web UI

2014-06-24 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042516#comment-14042516 ] Thomas Graves commented on SPARK-1891: -- https://github.com/apache/spark/pull/1196

[jira] [Updated] (SPARK-1911) Warn users if their jars are not built with Java 6

2014-06-24 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1911: - Summary: Warn users if their jars are not built with Java 6 (was: Warn users that jars should be built

[jira] [Updated] (SPARK-1911) Warn users if their assembly jars are not built with Java 6

2014-06-24 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1911: - Description: The root cause of the problem is detailed in:

[jira] [Commented] (SPARK-2244) pyspark - RDD action hangs (after previously succeeding)

2014-06-24 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042523#comment-14042523 ] Matthew Farrellee commented on SPARK-2244: -- i have a theory - after a long bisect

[jira] [Commented] (SPARK-2244) pyspark - RDD action hangs (after previously succeeding)

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042529#comment-14042529 ] Reynold Xin commented on SPARK-2244: Is this related?

[jira] [Commented] (SPARK-2244) pyspark - RDD action hangs (after previously succeeding)

2014-06-24 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042536#comment-14042536 ] Matthew Farrellee commented on SPARK-2244: -- yes, but i prefer my solution -

[jira] [Resolved] (SPARK-1718) pyspark doesn't work with assembly jar containing over 65536 files/dirs built on redhat

2014-06-24 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-1718. -- Resolution: Duplicate pyspark doesn't work with assembly jar containing over 65536 files/dirs

[jira] [Created] (SPARK-2261) Spark application event logs are not very NameNode-friendly

2014-06-24 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-2261: - Summary: Spark application event logs are not very NameNode-friendly Key: SPARK-2261 URL: https://issues.apache.org/jira/browse/SPARK-2261 Project: Spark

[jira] [Commented] (SPARK-2262) Extreme Learning Machines (ELM) for MLLib

2014-06-24 Thread Erik Erlandson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042731#comment-14042731 ] Erik Erlandson commented on SPARK-2262: --- I'd like to have this assigned to me

[jira] [Commented] (SPARK-2251) MLLib Naive Bayes Example SparkException: Can only zip RDDs with same number of elements in each partition

2014-06-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042738#comment-14042738 ] Sean Owen commented on SPARK-2251: -- For what it's worth, I can reproduce this. In the

[jira] [Created] (SPARK-2263) Can't insert MapK, V values to Hive tables

2014-06-24 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2263: - Summary: Can't insert MapK, V values to Hive tables Key: SPARK-2263 URL: https://issues.apache.org/jira/browse/SPARK-2263 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-2264) CachedTableSuite SQL Tests are Failing

2014-06-24 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2264: -- Summary: CachedTableSuite SQL Tests are Failing Key: SPARK-2264 URL: https://issues.apache.org/jira/browse/SPARK-2264 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2264) CachedTableSuite SQL Tests are Failing

2014-06-24 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2264: Component/s: SQL CachedTableSuite SQL Tests are Failing

[jira] [Commented] (SPARK-2259) Spark submit documentation for --deploy-mode is highly misleading

2014-06-24 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042811#comment-14042811 ] Andrew Or commented on SPARK-2259: -- https://github.com/apache/spark/pull/1200 Spark

[jira] [Updated] (SPARK-2266) Log page on Worker UI displays Some(app-id)

2014-06-24 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2266: - Attachment: Screen Shot 2014-06-24 at 5.07.54 PM.png Log page on Worker UI displays Some(app-id)

[jira] [Updated] (SPARK-2267) Log the exception when TaskResultGetter fails to fetch/deserialize task result

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2267: --- Summary: Log the exception when TaskResultGetter fails to fetch/deserialize task result (was: Log

[jira] [Updated] (SPARK-2267) Log exception when TaskResultGetter fails to fetch/deserialize task result

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2267: --- Summary: Log exception when TaskResultGetter fails to fetch/deserialize task result (was: Log the

[jira] [Created] (SPARK-2268) Utils.createTempDir() creates race with HDFS at shutdown

2014-06-24 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-2268: - Summary: Utils.createTempDir() creates race with HDFS at shutdown Key: SPARK-2268 URL: https://issues.apache.org/jira/browse/SPARK-2268 Project: Spark

[jira] [Commented] (SPARK-2192) Examples Data Not in Binary Distribution

2014-06-24 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042938#comment-14042938 ] Henry Saputra commented on SPARK-2192: -- I think several tests already have the data

[jira] [Commented] (SPARK-2263) Can't insert MapK, V values to Hive tables

2014-06-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042941#comment-14042941 ] Cheng Lian commented on SPARK-2263: --- PR: https://github.com/apache/spark/pull/1205

[jira] [Comment Edited] (SPARK-2245) VertexRDD can not be materialized for checkpointing

2014-06-24 Thread Baoxu Shi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041448#comment-14041448 ] Baoxu Shi edited comment on SPARK-2245 at 6/25/14 1:43 AM: --- Hi

[jira] [Created] (SPARK-2269) Clean up and add unit tests for resourceOffers in MesosSchedulerBackend

2014-06-24 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2269: -- Summary: Clean up and add unit tests for resourceOffers in MesosSchedulerBackend Key: SPARK-2269 URL: https://issues.apache.org/jira/browse/SPARK-2269 Project:

[jira] [Commented] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

2014-06-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042962#comment-14042962 ] Patrick Wendell commented on SPARK-2156: Fixed in 1.1.0 via:

[jira] [Created] (SPARK-2270) Kryo cannot serialize results returned by asJavaIterable (and thus groupBy/cogroup are broken in Java APIs when Kryo is used)

2014-06-24 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-2270: -- Summary: Kryo cannot serialize results returned by asJavaIterable (and thus groupBy/cogroup are broken in Java APIs when Kryo is used) Key: SPARK-2270 URL:

[jira] [Resolved] (SPARK-2248) spark.default.parallelism does not apply in local mode

2014-06-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2248. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1194

[jira] [Updated] (SPARK-2271) Use Hive's high performance Decimal128 to replace BigDecimal

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2271: --- Description: Hive JIRA: https://issues.apache.org/jira/browse/HIVE-6017 Use Hive's high performance

[jira] [Updated] (SPARK-2271) Use Hive's high performance Decimal128 to replace BigDecimal

2014-06-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2271: --- Assignee: Cheng Lian Use Hive's high performance Decimal128 to replace BigDecimal

[jira] [Created] (SPARK-2272) Feature scaling which standardizes the range of independent variables or features of data.

2014-06-24 Thread DB Tsai (JIRA)
DB Tsai created SPARK-2272: -- Summary: Feature scaling which standardizes the range of independent variables or features of data. Key: SPARK-2272 URL: https://issues.apache.org/jira/browse/SPARK-2272

[jira] [Commented] (SPARK-2251) MLLib Naive Bayes Example SparkException: Can only zip RDDs with same number of elements in each partition

2014-06-24 Thread Jun Xie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14043052#comment-14043052 ] Jun Xie commented on SPARK-2251: Hi, Sean. Thanks very much for your insight. I am new to

[jira] [Commented] (SPARK-2268) Utils.createTempDir() creates race with HDFS at shutdown

2014-06-24 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14043071#comment-14043071 ] Mridul Muralidharan commented on SPARK-2268: Setting priority for shutdown

[jira] [Commented] (SPARK-2265) MIMA excludes aren't generated for external modules

2014-06-24 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14043076#comment-14043076 ] Prashant Sharma commented on SPARK-2265: Those jars are already on its classpath.