[jira] [Commented] (SPARK-1603) flaky test case in StreamingContextSuite

2014-05-05 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990209#comment-13990209 ] Nan Zhu commented on SPARK-1603: [~tdas], I checked the code, the fix itself should be

[jira] [Commented] (SPARK-1603) flaky test case in StreamingContextSuite

2014-05-05 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990216#comment-13990216 ] Nan Zhu commented on SPARK-1603: Ah, just made a PR at the same time,

[jira] [Commented] (SPARK-1175) on shutting down a long running job, the cluster does not accept new jobs and gets hung

2014-05-04 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13988940#comment-13988940 ] Nan Zhu commented on SPARK-1175: this should have been fixed in

[jira] [Resolved] (SPARK-1175) on shutting down a long running job, the cluster does not accept new jobs and gets hung

2014-05-04 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu resolved SPARK-1175. Resolution: Fixed Fix Version/s: 1.0.0 on shutting down a long running job, the cluster does not

[jira] [Assigned] (SPARK-1706) Allow multiple executors per worker in Standalone mode

2014-05-04 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu reassigned SPARK-1706: -- Assignee: Nan Zhu Allow multiple executors per worker in Standalone mode

[jira] [Commented] (SPARK-1706) Allow multiple executors per worker in Standalone mode

2014-05-04 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989165#comment-13989165 ] Nan Zhu commented on SPARK-1706: made the PR: https://github.com/apache/spark/pull/636

[jira] [Created] (SPARK-1715) Ensure actor is self-contained in DAGScheduler

2014-05-04 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-1715: -- Summary: Ensure actor is self-contained in DAGScheduler Key: SPARK-1715 URL: https://issues.apache.org/jira/browse/SPARK-1715 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-1686) Master switches thread when ElectedLeader

2014-05-04 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu reassigned SPARK-1686: -- Assignee: Nan Zhu Master switches thread when ElectedLeader

[jira] [Commented] (SPARK-1299) making comments of RDD.doCheckpoint consistent with its usage

2014-04-25 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981819#comment-13981819 ] Nan Zhu commented on SPARK-1299: addressed in https://github.com/apache/spark/pull/186

[jira] [Resolved] (SPARK-1299) making comments of RDD.doCheckpoint consistent with its usage

2014-04-25 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu resolved SPARK-1299. Resolution: Fixed Fix Version/s: 1.0.0 making comments of RDD.doCheckpoint consistent with its

[jira] [Resolved] (SPARK-1298) Remove duplicate partition id checking

2014-04-25 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu resolved SPARK-1298. Resolution: Fixed Fix Version/s: 1.0.0 Remove duplicate partition id checking

[jira] [Updated] (SPARK-1600) flaky test case in streaming.CheckpointSuite

2014-04-24 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu updated SPARK-1600: --- Component/s: Streaming Affects Version/s: 0.9.1 1.0.0

[jira] [Created] (SPARK-1600) flaky test case in streaming.CheckpointSuite

2014-04-23 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-1600: -- Summary: flaky test case in streaming.CheckpointSuite Key: SPARK-1600 URL: https://issues.apache.org/jira/browse/SPARK-1600 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1600) flaky test case in streaming.CheckpointSuite

2014-04-23 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu updated SPARK-1600: --- Description: the case recovery with file input stream.recovery with file input stream sometimes fails

[jira] [Created] (SPARK-1603) flaky test case in StreamingContextSuite

2014-04-23 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-1603: -- Summary: flaky test case in StreamingContextSuite Key: SPARK-1603 URL: https://issues.apache.org/jira/browse/SPARK-1603 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-1556) jets3t dependency is outdated

2014-04-21 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-1556: -- Summary: jets3t dependency is outdated Key: SPARK-1556 URL: https://issues.apache.org/jira/browse/SPARK-1556 Project: Spark Issue Type: Bug Components: Spark

[jira] [Resolved] (SPARK-1523) improve the readability of code in AkkaUtil

2014-04-18 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu resolved SPARK-1523. Resolution: Fixed Fix Version/s: 1.1.0 improve the readability of code in AkkaUtil

[jira] [Updated] (SPARK-1519) support minPartitions parameter of wholeTextFiles() in pyspark

2014-04-16 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu updated SPARK-1519: --- Description: though Scala implementation provides the parameter of minPartitions in wholeTextFiles, PySpark

[jira] [Commented] (SPARK-1483) Rename minSplits to minPartitions in public APIs

2014-04-16 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13971961#comment-13971961 ] Nan Zhu commented on SPARK-1483: made the PR: https://github.com/apache/spark/pull/430

[jira] [Commented] (SPARK-1399) Reason for Stage Failure should be shown in UI

2014-04-15 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13970351#comment-13970351 ] Nan Zhu commented on SPARK-1399: made the PR: https://github.com/apache/spark/pull/421

[jira] [Assigned] (SPARK-1483) Rename minSplits to minPartitions in public APIs

2014-04-15 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu reassigned SPARK-1483: -- Assignee: Nan Zhu Rename minSplits to minPartitions in public APIs

[jira] [Commented] (SPARK-1462) Examples of ML algorithms are using deprecated APIs

2014-04-10 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13965275#comment-13965275 ] Nan Zhu commented on SPARK-1462: mainly Vector, better to be Vector.dense Examples of ML

<    1   2   3