[jira] [Resolved] (SPARK-1395) Cannot launch jobs on Yarn cluster with local: scheme in SPARK_JAR

2014-06-23 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-1395. -- Resolution: Fixed Fix Version/s: (was: 1.0.0) 1.1.0 Cannot

[jira] [Commented] (SPARK-1945) Add full Java examples in MLlib docs

2014-06-23 Thread Anant Daksh Asthana (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040796#comment-14040796 ] Anant Daksh Asthana commented on SPARK-1945: Michael, This issue refers to the

[jira] [Resolved] (SPARK-1846) RAT checks should exclude logs/ directory

2014-06-23 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash resolved SPARK-1846. --- Resolution: Fixed Fix Version/s: 1.0.0 RAT checks should exclude logs/ directory

[jira] [Commented] (SPARK-1846) RAT checks should exclude logs/ directory

2014-06-23 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040983#comment-14040983 ] Andrew Ash commented on SPARK-1846: --- Yep this was merged in commit

[jira] [Updated] (SPARK-2228) onStageSubmitted does not properly called so NoSuchElement will be thrown in onStageCompleted

2014-06-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2228: --- Target Version/s: 1.0.1, 1.1.0 onStageSubmitted does not properly called so NoSuchElement

[jira] [Updated] (SPARK-2228) onStageSubmitted does not properly called so NoSuchElement will be thrown in onStageCompleted

2014-06-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2228: --- Affects Version/s: (was: 1.1.0) onStageSubmitted does not properly called so

[jira] [Commented] (SPARK-704) ConnectionManager sometimes cannot detect loss of sending connections

2014-06-23 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041091#comment-14041091 ] Henry Saputra commented on SPARK-704: - Thanks a lot to [~woggle] and [~mridulm80] for

[jira] [Commented] (SPARK-1945) Add full Java examples in MLlib docs

2014-06-23 Thread Michael Yannakopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041127#comment-14041127 ] Michael Yannakopoulos commented on SPARK-1945: -- Nice, thanks for the info...

[jira] [Created] (SPARK-2244) pyspark - RDD action hangs (after previously succeeding)

2014-06-23 Thread Matthew Farrellee (JIRA)
Matthew Farrellee created SPARK-2244: Summary: pyspark - RDD action hangs (after previously succeeding) Key: SPARK-2244 URL: https://issues.apache.org/jira/browse/SPARK-2244 Project: Spark

[jira] [Commented] (SPARK-2244) pyspark - RDD action hangs (after previously succeeding)

2014-06-23 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041138#comment-14041138 ] Matthew Farrellee commented on SPARK-2244: -- fyi - i've not been able to reproduce

[jira] [Commented] (SPARK-2244) pyspark - RDD action hangs (after previously succeeding)

2014-06-23 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041175#comment-14041175 ] Matthew Farrellee commented on SPARK-2244: -- this reproduces both w/ pyspark and

[jira] [Assigned] (SPARK-1890) add modify acls to the web UI for the kill button

2014-06-23 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-1890: Assignee: Thomas Graves add modify acls to the web UI for the kill button

[jira] [Created] (SPARK-2245) VertexRDD can not be materialized for checkpointing

2014-06-23 Thread Baoxu Shi (JIRA)
Baoxu Shi created SPARK-2245: Summary: VertexRDD can not be materialized for checkpointing Key: SPARK-2245 URL: https://issues.apache.org/jira/browse/SPARK-2245 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2245) VertexRDD can not be materialized for checkpointing

2014-06-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041244#comment-14041244 ] Reynold Xin commented on SPARK-2245: [~ankurd] VertexRDD can not be materialized for

[jira] [Resolved] (SPARK-2118) If tools jar is not present, MIMA build should exit with an exception

2014-06-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2118. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1068

[jira] [Resolved] (SPARK-1768) History Server enhancements

2014-06-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1768. Resolution: Fixed Issue resolved by pull request 718

[jira] [Assigned] (SPARK-1891) Add admin acls to the Web UI

2014-06-23 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-1891: Assignee: Thomas Graves Add admin acls to the Web UI

[jira] [Resolved] (SPARK-1669) SQLContext.cacheTable() should be idempotent

2014-06-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1669. - Resolution: Fixed Fix Version/s: 1.1.0 1.0.1

[jira] [Commented] (SPARK-2245) VertexRDD can not be materialized for checkpointing

2014-06-23 Thread Baoxu Shi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041448#comment-14041448 ] Baoxu Shi commented on SPARK-2245: -- Just submit the changes, thanks! VertexRDD can not

[jira] [Created] (SPARK-2246) Add user-data option to EC2 scripts

2014-06-23 Thread Allan Douglas R. de Oliveira (JIRA)
Allan Douglas R. de Oliveira created SPARK-2246: --- Summary: Add user-data option to EC2 scripts Key: SPARK-2246 URL: https://issues.apache.org/jira/browse/SPARK-2246 Project: Spark

[jira] [Commented] (SPARK-2246) Add user-data option to EC2 scripts

2014-06-23 Thread Allan Douglas R. de Oliveira (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041465#comment-14041465 ] Allan Douglas R. de Oliveira commented on SPARK-2246: - PR:

[jira] [Created] (SPARK-2247) data frames based on RDD

2014-06-23 Thread venu k tangirala (JIRA)
venu k tangirala created SPARK-2247: --- Summary: data frames based on RDD Key: SPARK-2247 URL: https://issues.apache.org/jira/browse/SPARK-2247 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-1767) Prefer HDFS-cached replicas when scheduling data-local tasks

2014-06-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041503#comment-14041503 ] Sandy Ryza commented on SPARK-1767: --- It will be in the Hadoop 2.5 release Prefer

[jira] [Commented] (SPARK-2244) pyspark - RDD action hangs (after previously succeeding)

2014-06-23 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041517#comment-14041517 ] Matthew Farrellee commented on SPARK-2244: -- notes - import logging logger =

[jira] [Created] (SPARK-2248) spark.default.parallelism does not apply in local mode

2014-06-23 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-2248: Summary: spark.default.parallelism does not apply in local mode Key: SPARK-2248 URL: https://issues.apache.org/jira/browse/SPARK-2248 Project: Spark Issue

[jira] [Created] (SPARK-2249) how to convert rows of schemaRdd into HashMaps

2014-06-23 Thread jackielihf (JIRA)
jackielihf created SPARK-2249: - Summary: how to convert rows of schemaRdd into HashMaps Key: SPARK-2249 URL: https://issues.apache.org/jira/browse/SPARK-2249 Project: Spark Issue Type: Question

[jira] [Created] (SPARK-2250) show stage RDDs in UI

2014-06-23 Thread Neville Li (JIRA)
Neville Li created SPARK-2250: - Summary: show stage RDDs in UI Key: SPARK-2250 URL: https://issues.apache.org/jira/browse/SPARK-2250 Project: Spark Issue Type: New Feature Components:

[jira] [Created] (SPARK-2251) MLLib Naive Bayes Example SparkException: Can only zip RDDs with same number of elements in each partition

2014-06-23 Thread Jun Xie (JIRA)
Jun Xie created SPARK-2251: -- Summary: MLLib Naive Bayes Example SparkException: Can only zip RDDs with same number of elements in each partition Key: SPARK-2251 URL: https://issues.apache.org/jira/browse/SPARK-2251

[jira] [Updated] (SPARK-2249) how to convert rows of schemaRdd into HashMaps

2014-06-23 Thread jackielihf (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jackielihf updated SPARK-2249: -- Description: spark 1.0.0 how to convert rows of schemaRdd into HashMaps using column names as keys?

[jira] [Resolved] (SPARK-2124) Move aggregation into ShuffleManager implementations

2014-06-23 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-2124. -- Resolution: Fixed Fix Version/s: 1.1.0 Move aggregation into ShuffleManager

[jira] [Created] (SPARK-2252) mathjax doesn't work in HTTPS (math formulas not rendered)

2014-06-23 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-2252: -- Summary: mathjax doesn't work in HTTPS (math formulas not rendered) Key: SPARK-2252 URL: https://issues.apache.org/jira/browse/SPARK-2252 Project: Spark Issue