[jira] [Commented] (SPARK-10643) Support HDFS application download in client mode spark submit

[ https://issues.apache.org/jira/browse/SPARK-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15176166#comment-15176166 ] Alan Braithwaite commented on SPARK-10643: -- ¯\_(ツ)_/¯ Either way, it doesn't look like it was

[jira] [Commented] (SPARK-10643) Support HDFS application download in client mode spark submit

[ https://issues.apache.org/jira/browse/SPARK-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15159550#comment-15159550 ] Alan Braithwaite commented on SPARK-10643: -- It's not a bug, just a feature request. The code in

[jira] [Comment Edited] (SPARK-12826) Spark Workers do not attempt reconnect or exit on connection failure.

[ https://issues.apache.org/jira/browse/SPARK-12826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113180#comment-15113180 ] Alan Braithwaite edited comment on SPARK-12826 at 2/3/16 5:25 PM: --

[jira] [Created] (SPARK-13005) Don't require spark.shuffle.service.port to be set on job conf

Alan Braithwaite created SPARK-13005: Summary: Don't require spark.shuffle.service.port to be set on job conf Key: SPARK-13005 URL: https://issues.apache.org/jira/browse/SPARK-13005 Project:

[jira] [Created] (SPARK-13006) Use Log4j for Spark Standalone Executor Logging

Alan Braithwaite created SPARK-13006: Summary: Use Log4j for Spark Standalone Executor Logging Key: SPARK-13006 URL: https://issues.apache.org/jira/browse/SPARK-13006 Project: Spark

[jira] [Created] (SPARK-13007) Document where configuration / properties are read and applied

Alan Braithwaite created SPARK-13007: Summary: Document where configuration / properties are read and applied Key: SPARK-13007 URL: https://issues.apache.org/jira/browse/SPARK-13007 Project:

[jira] [Updated] (SPARK-13007) Document where configuration / properties are read and applied

[ https://issues.apache.org/jira/browse/SPARK-13007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-13007: - Description: While spark is well documented for the most part, often times I have

[jira] [Commented] (SPARK-12826) Spark Workers do not attempt reconnect or exit on connection failure.

[ https://issues.apache.org/jira/browse/SPARK-12826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113180#comment-15113180 ] Alan Braithwaite commented on SPARK-12826: -- Update to this: We moved the spark-master out from

[jira] [Updated] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-11327: - Description: I haven't figured out exactly what's going on yet, but there's something in

[jira] [Updated] (SPARK-10643) Support HDFS application download in client mode spark submit

[ https://issues.apache.org/jira/browse/SPARK-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-10643: - Description: When using mesos with docker and marathon, it would be nice to be able to

[jira] [Updated] (SPARK-12826) Spark Workers do not attempt reconnect or exit on connection failure.

[ https://issues.apache.org/jira/browse/SPARK-12826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-12826: - Priority: Critical (was: Major) > Spark Workers do not attempt reconnect or exit on

[jira] [Commented] (SPARK-12826) Spark Workers do not attempt reconnect or exit on connection failure.

[ https://issues.apache.org/jira/browse/SPARK-12826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099079#comment-15099079 ] Alan Braithwaite commented on SPARK-12826: -- Yes, we set it to listen to the any address because

[jira] [Created] (SPARK-12826) Spark Workers do not attempt reconnect or exit on connection failure.

Alan Braithwaite created SPARK-12826: Summary: Spark Workers do not attempt reconnect or exit on connection failure. Key: SPARK-12826 URL: https://issues.apache.org/jira/browse/SPARK-12826

[jira] [Closed] (SPARK-12743) spark.executor.memory is ignored by spark-submit in Standalone Cluster mode

[ https://issues.apache.org/jira/browse/SPARK-12743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite closed SPARK-12743. Resolution: Cannot Reproduce I can't reproduce it either this morning. Gotta love

[jira] [Commented] (SPARK-4389) Set akka.remote.netty.tcp.bind-hostname="0.0.0.0" so driver can be located behind NAT

[ https://issues.apache.org/jira/browse/SPARK-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092481#comment-15092481 ] Alan Braithwaite commented on SPARK-4389: - So is there any hope for running spark behind a

[jira] [Created] (SPARK-12743) spark.executor.memory is ignored by spark-submit in Standalone Cluster mode

Alan Braithwaite created SPARK-12743: Summary: spark.executor.memory is ignored by spark-submit in Standalone Cluster mode Key: SPARK-12743 URL: https://issues.apache.org/jira/browse/SPARK-12743

[jira] [Updated] (SPARK-10643) Support HDFS application download in client mode spark submit

[ https://issues.apache.org/jira/browse/SPARK-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-10643: - Summary: Support HDFS application download in client mode spark submit (was: Support

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023050#comment-15023050 ] Alan Braithwaite commented on SPARK-8734: - Any news on whether or not this will be Accepted, and

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981966#comment-14981966 ] Alan Braithwaite commented on SPARK-3630: - Of course! I can provide more information tomorrow but

[jira] [Comment Edited] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981966#comment-14981966 ] Alan Braithwaite edited comment on SPARK-3630 at 10/30/15 6:08 AM: --- Of

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983151#comment-14983151 ] Alan Braithwaite commented on SPARK-3630: - Whelp, I should have saved the stacktrace when I had it

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979329#comment-14979329 ] Alan Braithwaite commented on SPARK-3630: - What's the status of this? > Identify cause of

[jira] [Comment Edited] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976595#comment-14976595 ] Alan Braithwaite edited comment on SPARK-11327 at 10/27/15 3:56 PM: I

[jira] [Commented] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976595#comment-14976595 ] Alan Braithwaite commented on SPARK-11327: -- I don't think it's in the startup script. We're

[jira] [Commented] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976587#comment-14976587 ] Alan Braithwaite commented on SPARK-11327: -- Ah, sorry about that. Thanks for the pointer. >

[jira] [Commented] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976530#comment-14976530 ] Alan Braithwaite commented on SPARK-11327: -- It's the cluster mode manager for mesos.

[jira] [Updated] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-11327: - Description: I haven't figured out exactly what's going on yet, but there's something in

[jira] [Updated] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-11327: - Description: I haven't figured out exactly what's going on yet, but there's something in

[jira] [Updated] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-11327: - Description: I haven't figured out exactly what's going on yet, but there's something in

[jira] [Created] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

Alan Braithwaite created SPARK-11327: Summary: spark-dispatcher doesn't pass along some spark properties Key: SPARK-11327 URL: https://issues.apache.org/jira/browse/SPARK-11327 Project: Spark

[jira] [Updated] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-11327: - Description: I haven't figured out exactly what's going on yet, but there's something in

[jira] [Commented] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975280#comment-14975280 ] Alan Braithwaite commented on SPARK-11327: -- This may warrant opening a separate issue, but

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935352#comment-14935352 ] Alan Braithwaite commented on SPARK-8734: - I like this method and it's consistent with most other

[jira] [Updated] (SPARK-10647) Mesos HA mode misuses spark.deploy.zookeeper.dir property; configs should be documented

[ https://issues.apache.org/jira/browse/SPARK-10647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-10647: - Description: The property `spark.deploy.zookeeper.dir` doesn't match up with the other

[jira] [Commented] (SPARK-10647) Mesos HA mode misuses spark.deploy.zookeeper.dir property; configs should be documented

[ https://issues.apache.org/jira/browse/SPARK-10647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14933729#comment-14933729 ] Alan Braithwaite commented on SPARK-10647: -- Actually reading that, it makes more sense to me to

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908647#comment-14908647 ] Alan Braithwaite commented on SPARK-8734: - Will this work with multiple instances of the same

[jira] [Updated] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-8734: Attachment: network.diff Actually, I've attached a rudimentary diff for network support.

[jira] [Comment Edited] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907843#comment-14907843 ] Alan Braithwaite edited comment on SPARK-8734 at 9/25/15 9:21 AM: --

[jira] [Commented] (SPARK-10748) Log error instead of crashing Spark Mesos dispatcher when a job is misconfigured

[ https://issues.apache.org/jira/browse/SPARK-10748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903672#comment-14903672 ] Alan Braithwaite commented on SPARK-10748: -- This could be tricky with persistence too. I

[jira] [Updated] (SPARK-10643) Support HDFS urls in spark-submit

[ https://issues.apache.org/jira/browse/SPARK-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-10643: - Description: When using mesos with docker and marathon, it would be nice to be able to

[jira] [Created] (SPARK-10643) Support HDFS urls in spark-submit

Alan Braithwaite created SPARK-10643: Summary: Support HDFS urls in spark-submit Key: SPARK-10643 URL: https://issues.apache.org/jira/browse/SPARK-10643 Project: Spark Issue Type: New

[jira] [Created] (SPARK-10647) Rename property spark.deploy.zookeeper.dir to spark.mesos.deploy.zookeeper.dir

Alan Braithwaite created SPARK-10647: Summary: Rename property spark.deploy.zookeeper.dir to spark.mesos.deploy.zookeeper.dir Key: SPARK-10647 URL: https://issues.apache.org/jira/browse/SPARK-10647

[jira] [Updated] (SPARK-10647) Rename property spark.deploy.zookeeper.dir to spark.mesos.deploy.zookeeper.dir

[ https://issues.apache.org/jira/browse/SPARK-10647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-10647: - Issue Type: Improvement (was: New Feature) > Rename property spark.deploy.zookeeper.dir

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741149#comment-14741149 ] Alan Braithwaite commented on SPARK-8734: - Any updates on this issue? I was checking out