Re: Run Multiple Spark jobs. Reduce Execution time.

a small hint would be very helpful . On Wed, Feb 14, 2018 at 5:17 PM, akshay naidu wrote: > Hello Siva, > Thanks for your reply. > > Actually i'm trying to generate online reports for my clients. For this I > want the jobs should be executed faster without putting any

Re: Run Multiple Spark jobs. Reduce Execution time.

Hello Siva, Thanks for your reply. Actually i'm trying to generate online reports for my clients. For this I want the jobs should be executed faster without putting any job on QUEUE irrespective of the number of jobs different clients are executing from different locations. currently , a job

Re: Run Multiple Spark jobs. Reduce Execution time.

** yarn-site.xml yarn.scheduler.fair.preemption.cluster-utilization-threshold 0.8 yarn.scheduler.minimum-allocation-mb 3584 yarn.scheduler.maximum-allocation-mb

Re: Run Multiple Spark jobs. Reduce Execution time.

On Tue, Feb 13, 2018 at 4:43 PM, akshay naidu wrote: > Hello, > I'm try to run multiple spark jobs on cluster running in yarn. > Master is 24GB server with 6 Slaves of 12GB > > fairscheduler.xml settings are - > > FAIR > 10 > 2 > > > I am running 8 jobs

Run Multiple Spark jobs. Reduce Execution time.

Hello, I'm try to run multiple spark jobs on cluster running in yarn. Master is 24GB server with 6 Slaves of 12GB fairscheduler.xml settings are - FAIR 10 2 I am running 8 jobs simultaneously , jobs are running parallelly but not all. at a time only 7 of then runs simultaneously