[jira] [Commented] (SPARK-1438) Update RDD.sample() API to make seed parameter optional

2014-04-23 Thread Arun Ramakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977874#comment-13977874 ] Arun Ramakrishnan commented on SPARK-1438: -- NEW PR at

[jira] [Commented] (SPARK-1583) Use java.util.HashMap.remove by mistake in BlockManagerMasterActor.removeBlockManager

2014-04-23 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977895#comment-13977895 ] Shixiong Zhu commented on SPARK-1583: - PR: https://github.com/apache/spark/pull/500

[jira] [Created] (SPARK-1584) Upgrade Flume dependency to 1.4.0

2014-04-23 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-1584: - Summary: Upgrade Flume dependency to 1.4.0 Key: SPARK-1584 URL: https://issues.apache.org/jira/browse/SPARK-1584 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-1480) Choose classloader consistently inside of Spark codebase

2014-04-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977897#comment-13977897 ] Patrick Wendell commented on SPARK-1480:

[jira] [Commented] (SPARK-1584) Upgrade Flume dependency to 1.4.0

2014-04-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977901#comment-13977901 ] Sandy Ryza commented on SPARK-1584: --- This will allow us to take advantage of features

[jira] [Commented] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

2014-04-23 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977906#comment-13977906 ] Nishkam Ravi commented on SPARK-1576: - Hi Sandy, I've initiated a pull request for

[jira] [Commented] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

2014-04-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977918#comment-13977918 ] Sandy Ryza commented on SPARK-1576: --- Thanks, mind posting a link to it on this JIRA?

[jira] [Commented] (SPARK-1584) Upgrade Flume dependency to 1.4.0

2014-04-23 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978212#comment-13978212 ] Ted Malaska commented on SPARK-1584: Hey Sandy, I hope you don't mind. I made a pull

[jira] [Commented] (SPARK-1584) Upgrade Flume dependency to 1.4.0

2014-04-23 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978223#comment-13978223 ] Ted Malaska commented on SPARK-1584: Never mind it does like the build issue I'm

[jira] [Commented] (SPARK-1589) Compare Option[Partitioner] and Partitioner directly

2014-04-23 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978262#comment-13978262 ] Shixiong Zhu commented on SPARK-1589: - PR: https://github.com/apache/spark/pull/508

[jira] [Created] (SPARK-1590) Recommend to use FindBugs

2014-04-23 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-1590: --- Summary: Recommend to use FindBugs Key: SPARK-1590 URL: https://issues.apache.org/jira/browse/SPARK-1590 Project: Spark Issue Type: Question

[jira] [Comment Edited] (SPARK-1590) Recommend to use FindBugs

2014-04-23 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978291#comment-13978291 ] Shixiong Zhu edited comment on SPARK-1590 at 4/23/14 3:18 PM: --

[jira] [Updated] (SPARK-1590) Recommend to use FindBugs

2014-04-23 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-1590: Attachment: findbugs.png FindBugs in IDEA Recommend to use FindBugs -

[jira] [Created] (SPARK-1591) scala.MatchError executing custom UDTF

2014-04-23 Thread Ken Ellinwood (JIRA)
Ken Ellinwood created SPARK-1591: Summary: scala.MatchError executing custom UDTF Key: SPARK-1591 URL: https://issues.apache.org/jira/browse/SPARK-1591 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-1119) Make examples and assembly jar naming consistent between maven/sbt

2014-04-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1119. Resolution: Fixed Assignee: Patrick Wendell Make examples and assembly jar naming

[jira] [Updated] (SPARK-1119) Make examples and assembly jar naming consistent between maven/sbt

2014-04-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1119: --- Description: Right now it's somewhat different. Also it should be consistent with what the

[jira] [Updated] (SPARK-1159) Add Shortest-path computations to graphx.lib

2014-04-23 Thread Andres Perez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andres Perez updated SPARK-1159: Description: Add a landmark-based shortest-path computation to org.apache.spark.graphx.lib, to

[jira] [Commented] (SPARK-1159) Add Shortest-path computations to graphx.lib

2014-04-23 Thread Andres Perez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978513#comment-13978513 ] Andres Perez commented on SPARK-1159: - The pull-request no longer adds any

[jira] [Commented] (SPARK-1188) GraphX triplets not working properly

2014-04-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978592#comment-13978592 ] Reynold Xin commented on SPARK-1188: I added you to contributor list so you should be

[jira] [Commented] (SPARK-1588) SPARK_JAVA_OPTS is not getting propagated

2014-04-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978612#comment-13978612 ] Patrick Wendell commented on SPARK-1588: The approach in spark-submit is to

[jira] [Commented] (SPARK-1588) SPARK_JAVA_OPTS is not getting propagated

2014-04-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978703#comment-13978703 ] Patrick Wendell commented on SPARK-1588: Btw - SPARK_JAVA_OPTS is officially

[jira] [Created] (SPARK-1592) Streaming input blocks were never removed from the BlockManagers

2014-04-23 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-1592: Summary: Streaming input blocks were never removed from the BlockManagers Key: SPARK-1592 URL: https://issues.apache.org/jira/browse/SPARK-1592 Project: Spark

[jira] [Updated] (SPARK-1592) Old streaming input blocks not removed automatically from the BlockManagers

2014-04-23 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1592: - Summary: Old streaming input blocks not removed automatically from the BlockManagers (was:

[jira] [Commented] (SPARK-1588) SPARK_JAVA_OPTS is not getting propagated

2014-04-23 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978827#comment-13978827 ] Mridul Muralidharan commented on SPARK-1588: Apparently, SPARK_YARN_USER_ENV

[jira] [Updated] (SPARK-1588) SPARK_JAVA_OPTS and SPARK_YARN_USER_ENV are not getting propagated

2014-04-23 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-1588: - Summary: SPARK_JAVA_OPTS and SPARK_YARN_USER_ENV are not getting propagated (was:

[jira] [Commented] (SPARK-1588) SPARK_JAVA_OPTS and SPARK_YARN_USER_ENV are not getting propagated

2014-04-23 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978846#comment-13978846 ] Thomas Graves commented on SPARK-1588: -- Mridul put up pr:

[jira] [Comment Edited] (SPARK-1588) SPARK_JAVA_OPTS and SPARK_YARN_USER_ENV are not getting propagated

2014-04-23 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978846#comment-13978846 ] Thomas Graves edited comment on SPARK-1588 at 4/23/14 8:27 PM:

[jira] [Created] (SPARK-1593) Add status command to Spark Daemons(master/worker)

2014-04-23 Thread Pradeep Chanumolu (JIRA)
Pradeep Chanumolu created SPARK-1593: Summary: Add status command to Spark Daemons(master/worker) Key: SPARK-1593 URL: https://issues.apache.org/jira/browse/SPARK-1593 Project: Spark

[jira] [Updated] (SPARK-1593) Add status command to Spark Daemons(master/worker)

2014-04-23 Thread Pradeep Chanumolu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Chanumolu updated SPARK-1593: - Attachment: 0001-Adding-Spark-Daemon-master-worker-status-command.patch Patch for adding

[jira] [Updated] (SPARK-1595) Remove VectorRDDs

2014-04-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1595: - Affects Version/s: 1.0.0 Remove VectorRDDs - Key: SPARK-1595

[jira] [Resolved] (SPARK-1571) UnresolvedException when running JavaSparkSQL example

2014-04-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1571. - Resolution: Fixed UnresolvedException when running JavaSparkSQL example

[jira] [Commented] (SPARK-1571) UnresolvedException when running JavaSparkSQL example

2014-04-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978991#comment-13978991 ] Michael Armbrust commented on SPARK-1571: - I think this is fixed by

[jira] [Created] (SPARK-1599) Allow to use intercept in Ridge and Lasso

2014-04-23 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-1599: Summary: Allow to use intercept in Ridge and Lasso Key: SPARK-1599 URL: https://issues.apache.org/jira/browse/SPARK-1599 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-1600) flaky test case in streaming.CheckpointSuite

2014-04-23 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-1600: -- Summary: flaky test case in streaming.CheckpointSuite Key: SPARK-1600 URL: https://issues.apache.org/jira/browse/SPARK-1600 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1600) flaky test case in streaming.CheckpointSuite

2014-04-23 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu updated SPARK-1600: --- Description: the case recovery with file input stream.recovery with file input stream sometimes fails

[jira] [Commented] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

2014-04-23 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979184#comment-13979184 ] Nishkam Ravi commented on SPARK-1576: - Thomas, --driver-java-options would not work

[jira] [Created] (SPARK-1601) CacheManager#getOrCompute() does not return an InterruptibleIterator

2014-04-23 Thread Aaron Davidson (JIRA)
Aaron Davidson created SPARK-1601: - Summary: CacheManager#getOrCompute() does not return an InterruptibleIterator Key: SPARK-1601 URL: https://issues.apache.org/jira/browse/SPARK-1601 Project: Spark

[jira] [Created] (SPARK-1602) Cancelled jobs can lead to corrupted cached partitions

2014-04-23 Thread Aaron Davidson (JIRA)
Aaron Davidson created SPARK-1602: - Summary: Cancelled jobs can lead to corrupted cached partitions Key: SPARK-1602 URL: https://issues.apache.org/jira/browse/SPARK-1602 Project: Spark Issue

[jira] [Created] (SPARK-1603) flaky test case in StreamingContextSuite

2014-04-23 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-1603: -- Summary: flaky test case in StreamingContextSuite Key: SPARK-1603 URL: https://issues.apache.org/jira/browse/SPARK-1603 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1527) rootDirs in DiskBlockManagerSuite doesn't get full path from rootDir0, rootDir1

2014-04-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-1527: --- Assignee: Niraj Suthar rootDirs in DiskBlockManagerSuite doesn't get full path from rootDir0,