[jira] [Updated] (SPARK-1698) Improve spark integration

[ https://issues.apache.org/jira/browse/SPARK-1698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-1698: --- Fix Version/s: (was: 1.0.0) 1.1.0 Improve spark integration

[jira] [Commented] (SPARK-1175) on shutting down a long running job, the cluster does not accept new jobs and gets hung

[ https://issues.apache.org/jira/browse/SPARK-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13988940#comment-13988940 ] Nan Zhu commented on SPARK-1175: this should have been fixed in

[jira] [Resolved] (SPARK-1175) on shutting down a long running job, the cluster does not accept new jobs and gets hung

[ https://issues.apache.org/jira/browse/SPARK-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu resolved SPARK-1175. Resolution: Fixed Fix Version/s: 1.0.0 on shutting down a long running job, the cluster does not

[jira] [Assigned] (SPARK-1706) Allow multiple executors per worker in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu reassigned SPARK-1706: -- Assignee: Nan Zhu Allow multiple executors per worker in Standalone mode

[jira] [Assigned] (SPARK-1709) spark-submit should use main class attribute of JAR if no --class is given

[ https://issues.apache.org/jira/browse/SPARK-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Singh reassigned SPARK-1709: Assignee: Sandeep Singh spark-submit should use main class attribute of JAR if no --class

[jira] [Assigned] (SPARK-1710) spark-submit should print better errors than InvocationTargetException

[ https://issues.apache.org/jira/browse/SPARK-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Singh reassigned SPARK-1710: Assignee: Sandeep Singh spark-submit should print better errors than

[jira] [Issue Comment Deleted] (SPARK-1556) jets3t dep doesn't update properly with newer Hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1556: - Comment: was deleted (was: Actually, why does Spark have a direct dependency on jets3t at all? it is

[jira] [Updated] (SPARK-1644) The org.datanucleus:* should not be packaged into spark-assembly-*.jar

[ https://issues.apache.org/jira/browse/SPARK-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-1644: --- Fix Version/s: 1.1.0 The org.datanucleus:* should not be packaged into spark-assembly-*.jar

[jira] [Created] (SPARK-1711) We should not use two build tools at the same time, sbt or maven should be removed.

Guoqiang Li created SPARK-1711: -- Summary: We should not use two build tools at the same time, sbt or maven should be removed. Key: SPARK-1711 URL: https://issues.apache.org/jira/browse/SPARK-1711

[jira] [Updated] (SPARK-1711) We should not use two build tools at the same time, should remove one of them

[ https://issues.apache.org/jira/browse/SPARK-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-1711: --- Summary: We should not use two build tools at the same time, should remove one of them (was: We

[jira] [Resolved] (SPARK-1658) Correctly identify if maven is installed and working

[ https://issues.apache.org/jira/browse/SPARK-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1658. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 580

[jira] [Updated] (SPARK-1712) ParallelCollectionRDD operations hanging forever without any error messages

[ https://issues.apache.org/jira/browse/SPARK-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Kołaczkowski updated SPARK-1712: -- Attachment: executor.jstack.txt repl.jstack.txt

[jira] [Commented] (SPARK-1707) Remove 3 second sleep before starting app on YARN

[ https://issues.apache.org/jira/browse/SPARK-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989091#comment-13989091 ] Sandy Ryza commented on SPARK-1707: --- https://github.com/apache/spark/pull/634 Remove 3

[jira] [Resolved] (SPARK-1703) Warn users if Spark is run on JRE6 but compiled with JDK7

[ https://issues.apache.org/jira/browse/SPARK-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1703. Resolution: Fixed Issue resolved by pull request 627

[jira] [Updated] (SPARK-1712) ParallelCollectionRDD operations hanging forever without any error messages

[ https://issues.apache.org/jira/browse/SPARK-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Kołaczkowski updated SPARK-1712: -- Description: {noformat} scala val collection = (1 to 100).map(i = (foo + i,

[jira] [Updated] (SPARK-1712) ParallelCollectionRDD operations hanging forever without any error messages

[ https://issues.apache.org/jira/browse/SPARK-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Kołaczkowski updated SPARK-1712: -- Description: {noformat} scala val collection = (1 to 100).map(i = (foo + i,

[jira] [Resolved] (SPARK-1520) Assembly Jar with more than 65536 files won't work when compiled on JDK7 and run on JDK6

[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1520. Resolution: Unresolved There is no known resolution for this problem. We've updated the

[jira] [Updated] (SPARK-1703) Warn users if Spark is run on JRE6 but compiled with JDK7

[ https://issues.apache.org/jira/browse/SPARK-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1703: --- Assignee: Patrick Wendell Warn users if Spark is run on JRE6 but compiled with JDK7

[jira] [Commented] (SPARK-1520) Assembly Jar with more than 65536 files won't work when compiled on JDK7 and run on JDK6

[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989098#comment-13989098 ] Sean Owen commented on SPARK-1520: -- [~pwendell] On this note, I wonder if it's also best

[jira] [Created] (SPARK-1713) YarnAllocationHandler starts a thread for every executor it runs

Sandy Ryza created SPARK-1713: - Summary: YarnAllocationHandler starts a thread for every executor it runs Key: SPARK-1713 URL: https://issues.apache.org/jira/browse/SPARK-1713 Project: Spark

[jira] [Commented] (SPARK-1706) Allow multiple executors per worker in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989165#comment-13989165 ] Nan Zhu commented on SPARK-1706: made the PR: https://github.com/apache/spark/pull/636

[jira] [Created] (SPARK-1715) Ensure actor is self-contained in DAGScheduler

Nan Zhu created SPARK-1715: -- Summary: Ensure actor is self-contained in DAGScheduler Key: SPARK-1715 URL: https://issues.apache.org/jira/browse/SPARK-1715 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-1709) spark-submit should use main class attribute of JAR if no --class is given

[ https://issues.apache.org/jira/browse/SPARK-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia reassigned SPARK-1709: Assignee: Matei Zaharia (was: Sandeep Singh) spark-submit should use main class

[jira] [Commented] (SPARK-1709) spark-submit should use main class attribute of JAR if no --class is given

[ https://issues.apache.org/jira/browse/SPARK-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989181#comment-13989181 ] Matei Zaharia commented on SPARK-1709: -- Sorry Sandeep, I actually have a patch done

[jira] [Commented] (SPARK-1709) spark-submit should use main class attribute of JAR if no --class is given

[ https://issues.apache.org/jira/browse/SPARK-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989182#comment-13989182 ] Matei Zaharia commented on SPARK-1709: -- Should've assigned it to myself earlier.

[jira] [Commented] (SPARK-1520) Assembly Jar with more than 65536 files won't work when compiled on JDK7 and run on JDK6

[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989206#comment-13989206 ] Xiangrui Meng commented on SPARK-1520: -- Koert, which JDK6 did you use? This problem

[jira] [Resolved] (SPARK-1693) Dependent on multiple versions of servlet-api jars lead to throw an SecurityException when Spark built for hadoop 2.3.0 , 2.4.0

[ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1693. Resolution: Fixed Issue resolved by pull request 628

[jira] [Commented] (SPARK-1716) EC2 script should exit with non-zero code on UsageError

[ https://issues.apache.org/jira/browse/SPARK-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989226#comment-13989226 ] Allan Douglas R. de Oliveira commented on SPARK-1716: - PR here:

[jira] [Created] (SPARK-1716) EC2 script should exit with non-zero code on UsageError

Allan Douglas R. de Oliveira created SPARK-1716: --- Summary: EC2 script should exit with non-zero code on UsageError Key: SPARK-1716 URL: https://issues.apache.org/jira/browse/SPARK-1716

[jira] [Assigned] (SPARK-1686) Master switches thread when ElectedLeader

[ https://issues.apache.org/jira/browse/SPARK-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu reassigned SPARK-1686: -- Assignee: Nan Zhu Master switches thread when ElectedLeader

[jira] [Commented] (SPARK-1520) Assembly Jar with more than 65536 files won't work when compiled on JDK7 and run on JDK6

[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989240#comment-13989240 ] Koert Kuipers commented on SPARK-1520: -- Xiangrui, I have to stick to sun java.

[jira] [Created] (SPARK-1717) spark-ec2.py sometimes doesn't wait long enough for EC2 to stand up

Madhu Siddalingaiah created SPARK-1717: -- Summary: spark-ec2.py sometimes doesn't wait long enough for EC2 to stand up Key: SPARK-1717 URL: https://issues.apache.org/jira/browse/SPARK-1717

[jira] [Commented] (SPARK-1717) spark-ec2.py sometimes doesn't wait long enough for EC2 to stand up

[ https://issues.apache.org/jira/browse/SPARK-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989253#comment-13989253 ] Madhu Siddalingaiah commented on SPARK-1717: Increased number of tries from 2

[jira] [Updated] (SPARK-1716) EC2 script should exit with non-zero code on UsageError

[ https://issues.apache.org/jira/browse/SPARK-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1716: --- Assignee: Allan Douglas R. de Oliveira EC2 script should exit with non-zero code on

[jira] [Resolved] (SPARK-1716) EC2 script should exit with non-zero code on UsageError

[ https://issues.apache.org/jira/browse/SPARK-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1716. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 638

[jira] [Updated] (SPARK-1682) Add gradient descent w/o sampling and RDA L1 updater

[ https://issues.apache.org/jira/browse/SPARK-1682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Wang updated SPARK-1682: - Description: The GradientDescent optimizer does sampling before a gradient step. When input data is

[jira] [Resolved] (SPARK-1710) spark-submit should print better errors than InvocationTargetException

[ https://issues.apache.org/jira/browse/SPARK-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1710. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 630

[jira] [Commented] (SPARK-1709) spark-submit should use main class attribute of JAR if no --class is given

[ https://issues.apache.org/jira/browse/SPARK-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989263#comment-13989263 ] Sandeep Singh commented on SPARK-1709: -- Sure no problem. I haven't done much work on

[jira] [Resolved] (SPARK-1717) spark-ec2.py sometimes doesn't wait long enough for EC2 to stand up

[ https://issues.apache.org/jira/browse/SPARK-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1717. Resolution: Fixed Issue resolved by pull request 641