[jira] [Commented] (SPARK-24918) Executor Plugin API

2019-10-28 Thread Brandon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961672#comment-16961672 ] Brandon commented on SPARK-24918: - [~nsheth] placing the plugin class inside a jar and passing as

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-28 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595182#comment-16595182 ] Imran Rashid commented on SPARK-24918: -- Yes, that's right, its to avoid putting a reference to the

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595020#comment-16595020 ] Sean Owen commented on SPARK-24918: --- Wait, why doesn't a static init "run everywhere"? is "everywhere"

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589483#comment-16589483 ] Apache Spark commented on SPARK-24918: -- User 'NiharS' has created a pull request for this issue:

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-22 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589249#comment-16589249 ] Marcelo Vanzin commented on SPARK-24918: Unless he gives you push access to his repo, that's

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-22 Thread Nihar Sheth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589248#comment-16589248 ] Nihar Sheth commented on SPARK-24918: - [~irashid] has asked me to add testing to his PR. I'm not

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16582009#comment-16582009 ] Felix Cheung commented on SPARK-24918: -- I'd tend to agree with opt in - too many mistakes with

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-14 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579851#comment-16579851 ] Thomas Graves commented on SPARK-24918: --- Personally I like the explicit config on better

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-13 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579042#comment-16579042 ] Marcelo Vanzin commented on SPARK-24918: I like the idea in general. On the implementation side,

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-13 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578894#comment-16578894 ] Imran Rashid commented on SPARK-24918: -- With dynamic allocation you don't have a good place to run

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578872#comment-16578872 ] Sean Owen commented on SPARK-24918: --- This is just for per-executor initialization right? What's the

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-13 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578858#comment-16578858 ] Imran Rashid commented on SPARK-24918: -- [~lucacanali] OK I see the case for what you're proposing

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-13 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578853#comment-16578853 ] Imran Rashid commented on SPARK-24918: -- Ah, right, thanks [~vanzin], I knew I had seen this before.

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-13 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578767#comment-16578767 ] Marcelo Vanzin commented on SPARK-24918: For reference: this looks kinda similar to SPARK-650.

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-08 Thread Luca Canali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572850#comment-16572850 ] Luca Canali commented on SPARK-24918: - [~irashid] I agree that the proposal should be something of

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-07 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571793#comment-16571793 ] Imran Rashid commented on SPARK-24918: -- [~lucacanali] you could certainly sample stack traces, but

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-07 Thread Luca Canali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571748#comment-16571748 ] Luca Canali commented on SPARK-24918: - I have a use case where I would like to sample stack traces

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-03 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568471#comment-16568471 ] Imran Rashid commented on SPARK-24918: -- attached an [spip

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16562521#comment-16562521 ] Apache Spark commented on SPARK-24918: -- User 'squito' has created a pull request for this issue:

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-07-26 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558829#comment-16558829 ] Imran Rashid commented on SPARK-24918: -- The only thing I *really* needed was just to be able to

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-07-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558331#comment-16558331 ] Thomas Graves commented on SPARK-24918: --- I think this is a good idea. I thought I had seen a Jira

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-07-26 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556964#comment-16556964 ] Imran Rashid commented on SPARK-24918: -- I have some changes with an initial draft of this, at

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-07-25 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16555939#comment-16555939 ] Imran Rashid commented on SPARK-24918: -- [~jerryshao] [~tgraves] you might be interested in this --