Re: Phase level Scheduling algorithm in heterogeneous cluster

Regarding the implementation - without knowing much about the algorithm - I would guess you would at minimum need to implement a new scheduler - see here

Phase level Scheduling algorithm in heterogeneous cluster

Hi, I'm trying to deploy PRISM algorithm which proposed in IEEE paper title "prism: Fine-Grained Resource-Aware Scheduling for MapReduce", for phase level scheduling work  in homogeneous cluster.I'm stack with first step how to implement this algorithm and configure it, which parts i have to cha

Re: yarn memory settings in heterogeneous cluster

HTH, Thanks for your prompt response. I'll take a look at the per-job memory settings which from your explaining should resolve my issue. -Matt On Fri, Aug 28, 2015 at 12:35 PM, Vinod Kumar Vavilapalli < vino...@hortonworks.com> wrote: > Hi Matt, > > Replies inline. > > > I'm using the Capacity

Re: yarn memory settings in heterogeneous cluster

Hi Matt, Replies inline. > I'm using the Capacity Scheduler and deploy mapred-site.xml and yarn-site.xml > configuration files with various memory settings that are tailored to the > resources for a particular machine. The master node, and the two slave node > classes each get a different conf

yarn memory settings in heterogeneous cluster

f how their per-node memory settings are configured. Couple questions to help drive the discussion. - how should yarn be configured in a heterogeneous cluster? - yarn exposes a minimum and maximum allocation, how do I indicate that additional memory is desirable such that yarn doesn't always

Re: Heterogeneous Cluster

[image: >>> http://images.askcts.com/images/cts_logo_email.png]<http://www.askcts.com/> >>> www.askcts.com >>> amachto...@askcts.com >>> [image: >>> http://images.askcts.com/images/cts_logo_linkedin.png]<http://www.linkedin.com/company/cts-inc>[imag

Re: Heterogeneous Cluster

om/images/cts_logo_twitter.png]<https://twitter.com/askCTS>[image: >> http://images.askcts.com/images/cts_logo_facebook.png]<https://www.facebook.com/askCTS> >> >> >> >> *From:* Ian Jackson [mailto:ian_jack...@trilliumsoftware.com] >> *Sent:* Friday, November 22, 2013 4:05 PM >> *To:* user@hadoop.apache.org >> *Subject:* Heterogeneous Cluster >> >> >> >> Has anyone set up a Heterogeneous cluster, some Windows nodes and Linux >> nodes? >> > > <><><><>

Re: Heterogeneous Cluster

m/company/cts-inc>[image: > http://images.askcts.com/images/cts_logo_twitter.png]<https://twitter.com/askCTS>[image: > http://images.askcts.com/images/cts_logo_facebook.png]<https://www.facebook.com/askCTS> > > > > *From:* Ian Jackson [mailto:ian_jack...@trilliumsoftware.

RE: Heterogeneous Cluster

mages.askcts.com/images/cts_logo_twitter.png]<https://twitter.com/askCTS>[http://images.askcts.com/images/cts_logo_facebook.png]<https://www.facebook.com/askCTS> From: Ian Jackson [mailto:ian_jack...@trilliumsoftware.com] Sent: Friday, November 22, 2013 4:05 PM To: user@hadoop.apache

Heterogeneous Cluster

Has anyone set up a Heterogeneous cluster, some Windows nodes and Linux nodes?