Allowing parallelism in spark local mode

2016-02-12 Thread yael aharon
Hello, I have an application that receives requests over HTTP and uses spark in local mode to process the requests. Each request is running in its own thread. It seems that spark is queueing the jobs, processing them one at a time. When 2 requests arrive simultaneously, the processing time for

Re: Allowing parallelism in spark local mode

2016-02-12 Thread Chris Fregly
.apache.org" <user@spark.apache.org> > Subject: Allowing parallelism in spark local mode > > Hello, > I have an application that receives requests over HTTP and uses spark in > local mode to process the requests. Each request is running in its own > thread. > It seems tha

Re: Allowing parallelism in spark local mode

2016-02-12 Thread Silvio Fiorito
@spark.apache.org<mailto:user@spark.apache.org>" <user@spark.apache.org<mailto:user@spark.apache.org>> Subject: Allowing parallelism in spark local mode Hello, I have an application that receives requests over HTTP and uses spark in local mode to process the requests. E