[jira] [Commented] (SPARK-1551) Spark master does not build in sbt

2014-04-21 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13975442#comment-13975442 ] holdenk commented on SPARK-1551: Sorry about that, I had something dirty locally that

[jira] [Created] (SPARK-1552) GraphX performs type comparison incorrectly

2014-04-21 Thread Ankur Dave (JIRA)
Ankur Dave created SPARK-1552: - Summary: GraphX performs type comparison incorrectly Key: SPARK-1552 URL: https://issues.apache.org/jira/browse/SPARK-1552 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1552) GraphX performs type comparison incorrectly

2014-04-21 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-1552: -- Description: In GraphImpl, mapVertices and outerJoinVertices use a more efficient implementation when

[jira] [Commented] (SPARK-1438) Update RDD.sample() API to make seed parameter optional

2014-04-21 Thread Arun Ramakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13975486#comment-13975486 ] Arun Ramakrishnan commented on SPARK-1438: -- pull request at

[jira] [Assigned] (SPARK-1490) Add kerberos support to the HistoryServer

2014-04-21 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-1490: Assignee: Thomas Graves Add kerberos support to the HistoryServer

[jira] [Commented] (SPARK-1472) Go through YARN api used in Spark to make sure we aren't using Private Apis

2014-04-21 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13975609#comment-13975609 ] Thomas Graves commented on SPARK-1472: -- So it looks like its currently impossible to

[jira] [Assigned] (SPARK-1439) Aggregate Scaladocs across projects

2014-04-21 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia reassigned SPARK-1439: Assignee: Matei Zaharia Aggregate Scaladocs across projects

[jira] [Assigned] (SPARK-1440) Generate JavaDoc instead of ScalaDoc for Java API

2014-04-21 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia reassigned SPARK-1440: Assignee: Matei Zaharia Generate JavaDoc instead of ScalaDoc for Java API

[jira] [Created] (SPARK-1554) Update doc overview page to not mention building if you get a pre-built distro

2014-04-21 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-1554: Summary: Update doc overview page to not mention building if you get a pre-built distro Key: SPARK-1554 URL: https://issues.apache.org/jira/browse/SPARK-1554

[jira] [Resolved] (SPARK-1202) Add a cancel button in the UI for stages

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1202. Resolution: Fixed Add a cancel button in the UI for stages

[jira] [Resolved] (SPARK-918) hadoop-client dependency should be explained for Scala in addition to Java in quickstart

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-918. --- Resolution: Won't Fix This was fixed as a result of a separate re-factoring of the docs.

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2014-04-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13975914#comment-13975914 ] Cheng Lian commented on SPARK-1529: --- After some investigation, I came to the conclusion

[jira] [Issue Comment Deleted] (SPARK-1438) Update RDD.sample() API to make seed parameter optional

2014-04-21 Thread Kevin Tham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Tham updated SPARK-1438: -- Comment: was deleted (was: I can work on this (I'd like to try to submit my first Spark contribution

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13975947#comment-13975947 ] Patrick Wendell commented on SPARK-1529: [~liancheng] Hey Cheng, the tricky thing

[jira] [Created] (SPARK-1556) jets3t dependency is outdated

2014-04-21 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-1556: -- Summary: jets3t dependency is outdated Key: SPARK-1556 URL: https://issues.apache.org/jira/browse/SPARK-1556 Project: Spark Issue Type: Bug Components: Spark

[jira] [Commented] (SPARK-1556) jets3t dependency is outdated

2014-04-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13975957#comment-13975957 ] Sean Owen commented on SPARK-1556: -- Actually, why does Spark have a direct dependency on

[jira] [Commented] (SPARK-1556) jets3t dependency is outdated

2014-04-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13975967#comment-13975967 ] Sean Owen commented on SPARK-1556: -- OK, I partly eat my words. jets3t isn't included by

[jira] [Created] (SPARK-1557) Set permissions on event log files/directories

2014-04-21 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-1557: Summary: Set permissions on event log files/directories Key: SPARK-1557 URL: https://issues.apache.org/jira/browse/SPARK-1557 Project: Spark Issue Type:

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976038#comment-13976038 ] Patrick Wendell commented on SPARK-1529: One idea proposed by [~adav] was to

[jira] [Resolved] (SPARK-1399) Reason for Stage Failure should be shown in UI

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1399. Resolution: Fixed Reason for Stage Failure should be shown in UI

[jira] [Updated] (SPARK-1399) Reason for Stage Failure should be shown in UI

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1399: --- Fix Version/s: 1.0.0 Reason for Stage Failure should be shown in UI

[jira] [Resolved] (SPARK-1539) RDDPage.scala contains RddPage

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1539. Resolution: Fixed Fix Version/s: 1.0.0 RDDPage.scala contains RddPage

[jira] [Created] (SPARK-1558) [streaming] Update receiver information to match it with code

2014-04-21 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-1558: Summary: [streaming] Update receiver information to match it with code Key: SPARK-1558 URL: https://issues.apache.org/jira/browse/SPARK-1558 Project: Spark

[jira] [Updated] (SPARK-1505) [streaming] Add 0.9 to 1.0 migration guide for streaming receiver

2014-04-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1505: - Component/s: Streaming [streaming] Add 0.9 to 1.0 migration guide for streaming receiver

[jira] [Updated] (SPARK-1558) [streaming] Update receiver information to match it with code

2014-04-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1558: - Component/s: Documentation [streaming] Update receiver information to match it with code

[jira] [Updated] (SPARK-1504) [streaming] Add deployment subsection to streaming

2014-04-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1504: - Component/s: Streaming [streaming] Add deployment subsection to streaming

[jira] [Assigned] (SPARK-1457) Change APIs for training algorithms to take optimizer as parameter

2014-04-21 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-1457: -- Assignee: DB Tsai Change APIs for training algorithms to take optimizer as parameter

[jira] [Assigned] (SPARK-1516) Yarn Client should not call System.exit, should throw exception instead.

2014-04-21 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-1516: -- Assignee: DB Tsai Yarn Client should not call System.exit, should throw exception instead.

[jira] [Created] (SPARK-1559) Add conf dir to CLASSPATH in compute-classpath.sh dependent on whether SPARK_CONF_DIR is set

2014-04-21 Thread Albert Chu (JIRA)
Albert Chu created SPARK-1559: - Summary: Add conf dir to CLASSPATH in compute-classpath.sh dependent on whether SPARK_CONF_DIR is set Key: SPARK-1559 URL: https://issues.apache.org/jira/browse/SPARK-1559

[jira] [Updated] (SPARK-693) Let deploy scripts set alternate conf, work directories

2014-04-21 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Albert Chu updated SPARK-693: - Attachment: SPARK-693.patch We required this support in our environment. Attached is my patch to

[jira] [Updated] (SPARK-1543) Add ADMM for solving Lasso (and elastic net) problem

2014-04-21 Thread Shuo Xiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Xiang updated SPARK-1543: -- Description: This PR introduces the Alternating Direction Method of Multipliers (ADMM) for solving

[jira] [Created] (SPARK-1561) sbt/sbt assembly generates too many local files

2014-04-21 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-1561: Summary: sbt/sbt assembly generates too many local files Key: SPARK-1561 URL: https://issues.apache.org/jira/browse/SPARK-1561 Project: Spark Issue Type:

[jira] [Created] (SPARK-1562) Exclude internal catalyst classes from scaladoc, or make them package private

2014-04-21 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1562: -- Summary: Exclude internal catalyst classes from scaladoc, or make them package private Key: SPARK-1562 URL: https://issues.apache.org/jira/browse/SPARK-1562

[jira] [Resolved] (SPARK-1440) Generate JavaDoc instead of ScalaDoc for Java API

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1440. Resolution: Fixed Generate JavaDoc instead of ScalaDoc for Java API

[jira] [Resolved] (SPARK-1439) Aggregate Scaladocs across projects

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1439. Resolution: Fixed Aggregate Scaladocs across projects

[jira] [Resolved] (SPARK-1332) Improve Spark Streaming's Network Receiver and InputDStream API for future stability

2014-04-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1332. Resolution: Fixed Fix Version/s: 1.0.0 Improve Spark Streaming's Network Receiver