[jira] [Updated] (SPARK-1242) Add aggregate to python API

2014-04-25 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-1242: - Assignee: Holden Karau Add aggregate to python API ---

[jira] [Created] (SPARK-1626) Update Spark YARN docs to use spark-submit

2014-04-25 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1626: -- Summary: Update Spark YARN docs to use spark-submit Key: SPARK-1626 URL: https://issues.apache.org/jira/browse/SPARK-1626 Project: Spark Issue Type:

[jira] [Updated] (SPARK-1625) Ensure all legacy YARN options are supported with spark-submit

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1625: --- Component/s: YARN Ensure all legacy YARN options are supported with spark-submit

[jira] [Updated] (SPARK-1621) Update Chill to 0.3.6

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1621: --- Issue Type: Dependency upgrade (was: Improvement) Update Chill to 0.3.6

[jira] [Resolved] (SPARK-1582) Job cancellation does not interrupt threads

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1582. Resolution: Fixed Fix Version/s: 1.0.0 Job cancellation does not interrupt threads

[jira] [Resolved] (SPARK-1590) Recommend to use FindBugs

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1590. Resolution: Not a Problem Assignee: Shixiong Zhu [~zsxwing] I'm marking this as not

[jira] [Commented] (SPARK-1590) Recommend to use FindBugs

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980735#comment-13980735 ] Patrick Wendell commented on SPARK-1590: I agree with this course of action.

[jira] [Commented] (SPARK-1604) Couldn't run spark-submit with yarn cluster mode when using deps jar

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980740#comment-13980740 ] Patrick Wendell commented on SPARK-1604: I'm not sure why you're including both

[jira] [Resolved] (SPARK-1607) Remove use of octal literals, deprecated in Scala 2.10 / removed in 2.11

2014-04-25 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-1607. -- Resolution: Fixed Fix Version/s: 1.0.0 Remove use of octal literals, deprecated in

[jira] [Resolved] (SPARK-1611) Incorrect initialization order in AppendOnlyMap

2014-04-25 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-1611. - Resolution: Fixed Fix Version/s: 1.0.0 Incorrect initialization order in AppendOnlyMap

[jira] [Commented] (SPARK-993) Don't reuse Writable objects in SequenceFile by default

2014-04-25 Thread Arun Ramakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980747#comment-13980747 ] Arun Ramakrishnan commented on SPARK-993: - How does one reproduce this issue ? I

[jira] [Comment Edited] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

2014-04-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980756#comment-13980756 ] Piotr Kołaczkowski edited comment on SPARK-1199 at 4/25/14 7:26 AM:

[jira] [Created] (SPARK-1628) Missing hashCode methods in Partitioner subclasses

2014-04-25 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-1628: --- Summary: Missing hashCode methods in Partitioner subclasses Key: SPARK-1628 URL: https://issues.apache.org/jira/browse/SPARK-1628 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-1597) Add a version of reduceByKey that takes the Partitioner as a second argument

2014-04-25 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Singh reassigned SPARK-1597: Assignee: Sandeep Singh Add a version of reduceByKey that takes the Partitioner as a

[jira] [Updated] (SPARK-1604) Couldn't run spark-submit with yarn cluster mode when built with assemble-deps

2014-04-25 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kan Zhang updated SPARK-1604: - Summary: Couldn't run spark-submit with yarn cluster mode when built with assemble-deps (was: Couldn't

[jira] [Updated] (SPARK-1604) Couldn't run spark-submit with yarn cluster mode when built with assemble-deps

2014-04-25 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kan Zhang updated SPARK-1604: - Description: {code}

[jira] [Created] (SPARK-1629) Spark Core missing commons-lang dependence

2014-04-25 Thread witgo (JIRA)
witgo created SPARK-1629: Summary: Spark Core missing commons-lang dependence Key: SPARK-1629 URL: https://issues.apache.org/jira/browse/SPARK-1629 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1629) Spark Core missing commons-lang dependence

2014-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980878#comment-13980878 ] Sean Owen commented on SPARK-1629: -- I don't see any usage of Commons Lang in the whole

[jira] [Comment Edited] (SPARK-1629) Spark Core missing commons-lang dependence

2014-04-25 Thread witgo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980886#comment-13980886 ] witgo edited comment on SPARK-1629 at 4/25/14 11:06 AM: Hi Sean

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

2014-04-25 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980962#comment-13980962 ] Ted Malaska commented on SPARK-1478: Spark-1584 is done and so is PR #300. So final

[jira] [Commented] (SPARK-1467) Make StorageLevel.apply() factory methods experimental

2014-04-25 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981031#comment-13981031 ] Sandeep Singh commented on SPARK-1467: -- https://github.com/apache/spark/pull/551

[jira] [Commented] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

2014-04-25 Thread Andrew Kerr (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981187#comment-13981187 ] Andrew Kerr commented on SPARK-1199: I have something of a workaround: {code} object

[jira] [Comment Edited] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

2014-04-25 Thread Andrew Kerr (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981187#comment-13981187 ] Andrew Kerr edited comment on SPARK-1199 at 4/25/14 4:44 PM: -

[jira] [Created] (SPARK-1630) PythonRDDs don't handle nulls gracefully

2014-04-25 Thread Kalpit Shah (JIRA)
Kalpit Shah created SPARK-1630: -- Summary: PythonRDDs don't handle nulls gracefully Key: SPARK-1630 URL: https://issues.apache.org/jira/browse/SPARK-1630 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

2014-04-25 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981313#comment-13981313 ] Mridul Muralidharan commented on SPARK-1576: There is a misunderstanding here

[jira] [Commented] (SPARK-1586) Fix issues with spark development under windows

2014-04-25 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981321#comment-13981321 ] Mridul Muralidharan commented on SPARK-1586: Immediate issues fixed though

[jira] [Resolved] (SPARK-1587) Fix thread leak in spark

2014-04-25 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-1587. Resolution: Fixed Fixed, https://github.com/apache/spark/pull/504 Fix thread

[jira] [Commented] (SPARK-1626) Update Spark YARN docs to use spark-submit

2014-04-25 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981325#comment-13981325 ] Thomas Graves commented on SPARK-1626: -- this is dup of SPARK-1492 Update Spark YARN

[jira] [Commented] (SPARK-1631) App name set in SparkConf (not in JVM properties) not respected by Yarn backend

2014-04-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981337#comment-13981337 ] Marcelo Vanzin commented on SPARK-1631: --- PR:

[jira] [Resolved] (SPARK-1621) Update Chill to 0.3.6

2014-04-25 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-1621. -- Resolution: Fixed Update Chill to 0.3.6 - Key:

[jira] [Commented] (SPARK-1630) PythonRDDs don't handle nulls gracefully

2014-04-25 Thread Kalpit Shah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981458#comment-13981458 ] Kalpit Shah commented on SPARK-1630: https://github.com/apache/spark/pull/554

[jira] [Commented] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

2014-04-25 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981473#comment-13981473 ] Nishkam Ravi commented on SPARK-1576: - We have been using SPARK_JAVA_OPTS and

[jira] [Reopened] (SPARK-1395) Cannot launch jobs on Yarn cluster with local: scheme in SPARK_JAR

2014-04-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reopened SPARK-1395: --- This is broken again. Cannot launch jobs on Yarn cluster with local: scheme in SPARK_JAR

[jira] [Created] (SPARK-1633) Various examples for Scala and Java custom receiver, etc.

2014-04-25 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-1633: Summary: Various examples for Scala and Java custom receiver, etc. Key: SPARK-1633 URL: https://issues.apache.org/jira/browse/SPARK-1633 Project: Spark

[jira] [Commented] (SPARK-1600) flaky test case in streaming.CheckpointSuite

2014-04-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981552#comment-13981552 ] Tathagata Das commented on SPARK-1600: -- Will try to address this post 1.0 release

[jira] [Commented] (SPARK-1409) Flaky Test: actor input stream test in org.apache.spark.streaming.InputStreamsSuite

2014-04-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981555#comment-13981555 ] Tathagata Das commented on SPARK-1409: -- The test seems to run fine when launched from

[jira] [Closed] (SPARK-1400) Spark Streaming's received data is not cleaned up from BlockManagers when not needed any more

2014-04-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-1400. Resolution: Duplicate Duplicate https://issues.apache.org/jira/browse/SPARK-1592 Spark

[jira] [Updated] (SPARK-1632) Avoid boxing in ExternalAppendOnlyMap compares

2014-04-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-1632: -- Summary: Avoid boxing in ExternalAppendOnlyMap compares (was: Avoid boxing in

[jira] [Updated] (SPARK-1634) Java API docs contain test cases

2014-04-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1634: - Summary: Java API docs contain test cases (was: JavaDoc contains test cases) Java API docs

[jira] [Updated] (SPARK-1634) Java API docs contain test cases

2014-04-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1634: - Description: The generated Java API docs contain all test cases. (was: The generated Java API

[jira] [Created] (SPARK-1635) Java API docs do not show annotation.

2014-04-25 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-1635: Summary: Java API docs do not show annotation. Key: SPARK-1635 URL: https://issues.apache.org/jira/browse/SPARK-1635 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

2014-04-25 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981583#comment-13981583 ] Ted Malaska commented on SPARK-1478: I re cloned the code and ran a test. There is a

[jira] [Closed] (SPARK-703) KafkaWordCount example crashes with java.lang.ArrayIndexOutOfBoundsException in CheckpointRDD.scala

2014-04-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-703. --- Resolution: Not a Problem KafkaWordCount example crashes with

[jira] [Commented] (SPARK-703) KafkaWordCount example crashes with java.lang.ArrayIndexOutOfBoundsException in CheckpointRDD.scala

2014-04-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981581#comment-13981581 ] Tathagata Das commented on SPARK-703: - Yes, that observation is correct. This is

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

2014-04-25 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981601#comment-13981601 ] Ted Malaska commented on SPARK-1478: never mind it is working now. Upgrade

[jira] [Created] (SPARK-1636) Move main methods to examples

2014-04-25 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-1636: Summary: Move main methods to examples Key: SPARK-1636 URL: https://issues.apache.org/jira/browse/SPARK-1636 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-1637) Clean up examples for 1.0

2014-04-25 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-1637: Summary: Clean up examples for 1.0 Key: SPARK-1637 URL: https://issues.apache.org/jira/browse/SPARK-1637 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-1598) Mark main methods experimental

2014-04-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-1598. -- Resolution: Duplicate We will move main methods to examples instead. Mark main methods

[jira] [Created] (SPARK-1638) Executors fail to come up if spark.executor.extraJavaOptions is set

2014-04-25 Thread Kalpit Shah (JIRA)
Kalpit Shah created SPARK-1638: -- Summary: Executors fail to come up if spark.executor.extraJavaOptions is set Key: SPARK-1638 URL: https://issues.apache.org/jira/browse/SPARK-1638 Project: Spark

[jira] [Created] (SPARK-1640) In yarn-client mode, pass preferred node locations to AM

2014-04-25 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-1640: - Summary: In yarn-client mode, pass preferred node locations to AM Key: SPARK-1640 URL: https://issues.apache.org/jira/browse/SPARK-1640 Project: Spark Issue Type:

[jira] [Updated] (SPARK-1641) Spark submit warning tells the user to use spark-submit

2014-04-25 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1641: - Description: $ bin/spark-submit ... Spark assembly has been built with Hive, including Datanucleus jars

[jira] [Closed] (SPARK-711) Spark Streaming 0.7.0: ArrayIndexOutOfBoundsException in KafkaWordCount Example

2014-04-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-711. --- Resolution: Duplicate Duplicate issue: https://issues.apache.org/jira/browse/SPARK-703 Spark

[jira] [Commented] (SPARK-944) Give example of writing to HBase from Spark Streaming

2014-04-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981693#comment-13981693 ] Tathagata Das commented on SPARK-944: - Do you have a working example now, that you

[jira] [Comment Edited] (SPARK-944) Give example of writing to HBase from Spark Streaming

2014-04-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981693#comment-13981693 ] Tathagata Das edited comment on SPARK-944 at 4/25/14 10:10 PM:

[jira] [Updated] (SPARK-1639) Some tidying of Spark on YARN ApplicationMaster and ExecutorLauncher

2014-04-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-1639: -- Summary: Some tidying of Spark on YARN ApplicationMaster and ExecutorLauncher (was: Some tidying of

[jira] [Updated] (SPARK-1637) Clean up examples for 1.0

2014-04-25 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-1637: - Description: - Move all of them into subpackages of org.apache.spark.examples (right now some

[jira] [Updated] (SPARK-1235) DAGScheduler ignores exceptions thrown in handleTaskCompletion

2014-04-25 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-1235: - Affects Version/s: (was: 1.0.0) DAGScheduler ignores exceptions thrown in

[jira] [Resolved] (SPARK-1235) DAGScheduler ignores exceptions thrown in handleTaskCompletion

2014-04-25 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-1235. -- Resolution: Fixed Fix Version/s: 1.0.0 Resolved in

[jira] [Closed] (SPARK-1620) Uncaught exception from Akka scheduler

2014-04-25 Thread Mark Hamstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Hamstra closed SPARK-1620. --- Resolution: Invalid Uncaught exception from Akka scheduler --

[jira] [Resolved] (SPARK-1632) Avoid boxing in ExternalAppendOnlyMap compares

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1632. Resolution: Fixed Fix Version/s: 1.0.0 Avoid boxing in ExternalAppendOnlyMap

[jira] [Commented] (SPARK-1299) making comments of RDD.doCheckpoint consistent with its usage

2014-04-25 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981819#comment-13981819 ] Nan Zhu commented on SPARK-1299: addressed in https://github.com/apache/spark/pull/186

[jira] [Resolved] (SPARK-1299) making comments of RDD.doCheckpoint consistent with its usage

2014-04-25 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu resolved SPARK-1299. Resolution: Fixed Fix Version/s: 1.0.0 making comments of RDD.doCheckpoint consistent with its

[jira] [Resolved] (SPARK-1298) Remove duplicate partition id checking

2014-04-25 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu resolved SPARK-1298. Resolution: Fixed Fix Version/s: 1.0.0 Remove duplicate partition id checking

[jira] [Resolved] (SPARK-1356) [STREAMING] Annotate developer and experimental API's

2014-04-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1356. -- Resolution: Fixed Assignee: Tathagata Das [STREAMING] Annotate developer and

[jira] [Closed] (SPARK-1634) Java API docs contain test cases

2014-04-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-1634. Resolution: Not a Problem Fix Version/s: 1.0.0 Assignee: Xiangrui Meng Re-tried

[jira] [Closed] (SPARK-1558) [streaming] Update receiver information to match it with code

2014-04-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-1558. Resolution: Invalid Irrelevant after underlying code changes. [streaming] Update receiver

[jira] [Assigned] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1606: -- Assignee: Patrick Wendell spark-submit needs `--arg` for every application parameter

[jira] [Commented] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981851#comment-13981851 ] Patrick Wendell commented on SPARK-1606: I submitted a PR here that adds the

[jira] [Comment Edited] (SPARK-1606) spark-submit needs `--arg` for every application parameter

2014-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981851#comment-13981851 ] Patrick Wendell edited comment on SPARK-1606 at 4/26/14 2:26 AM:

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

2014-04-25 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981855#comment-13981855 ] Ted Malaska commented on SPARK-1478: No worries that error was caused by me. Still

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

2014-04-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981856#comment-13981856 ] Tathagata Das commented on SPARK-1478: -- Haha, yeah, lazy vals are super useful in