Re: Unsubscribe

2016-11-28 Thread Charles Allen
Can we get a bot that auto-subscribes folks to cat-facts! when they email the user list instead of user-unsubscr...@spark.apache.org ? On Mon, Nov 28, 2016 at 1:28 PM R. Revert wrote: > Unsubscribe > > El 28 nov. 2016 5:22 p. m., escribió: > > Unsubscribe > > ---

Re: Spark 2.0.0-preview ... problem with jackson core version

2016-07-01 Thread Charles Allen
I'm having the same difficulty porting https://github.com/metamx/druid-spark-batch/tree/spark2 over to spark2.x, where I have to go track down who is pulling in bad jackson versions. On Fri, Jul 1, 2016 at 11:59 AM Sean Owen wrote: > Are you just asking why you can't use 2.5.3 in your app? bec

Re: Spark 1.5 on Mesos

2016-03-02 Thread Charles Allen
what you've tried and I can see what's wrong. I think it's > most likely just the configuration of where the Spark home folder is in the > image. > > Tim > > On Wed, Mar 2, 2016 at 2:28 PM, Charles Allen < > charles.al...@metamarkets.com> wro

Re: Spark 1.5 on Mesos

2016-03-02 Thread Charles Allen
Re: Spark on Mesos Warning regarding disk space: https://issues.apache.org/jira/browse/SPARK-12330 That's a spark flaw I encountered on a very regular basis on mesos. That and a few other annoyances are fixed in https://github.com/metamx/spark/tree/v1.5.2-mmx Here's another mild annoyance I'v

Re: Mesos scheduler obeying limit of tasks / executor

2015-12-11 Thread Charles Allen
b.com/apache/spark/pull/4027 > > iulian > ​ > > On Wed, Dec 9, 2015 at 7:23 PM, Charles Allen < > charles.al...@metamarkets.com> wrote: > >> I have a spark app in development which has relatively strict cpu/mem >> ratios that are required. As such, I cannot arb

Mesos scheduler obeying limit of tasks / executor

2015-12-09 Thread Charles Allen
ints, or looking for limits of tasks per executor. How can I limit the tasks per executor (or per memory pool) in the Mesos backend scheduler? Thanks, Charles Allen

Re: ClassLoader resources on executor

2015-12-02 Thread Charles Allen
12:14 PM Charles Allen wrote: > I still have to propagate the file into the directory somehow, and also > that's marked as only for legacy jobs (deprecated?), so no, I have not > experimented with it yet. > > On Wed, Dec 2, 2015 at 12:53 AM Rishi Mishra > wrote:

Re: ClassLoader resources on executor

2015-12-02 Thread Charles Allen
lasspath > resources will be accessible through the executors class loader which > executes your job. > > On Wed, Dec 2, 2015 at 2:15 AM, Charles Allen < > charles.al...@metamarkets.com> wrote: > >> Is there a way to pass configuration file resources to be resolvable >>

ClassLoader resources on executor

2015-12-01 Thread Charles Allen
pache/spark/pull/9118 seems to tackle a similar problem in a hard-coded kind of way. Thank you, Charles Allen