Re: YARN - How is a node for a container determined?

Most of the applications are twill apps and are some what long running, but not perpetual, a few hours to a day. Many of the apps (say about half) have a lot of idle time. These apps come from across the enterprise, Idk why they're idle. There are also a few MR, TEZ, and Spark apps in the mix. If

Re: unsubscribe

Hi Corne! Please send an email to user-unsubscr...@hadoop.apache.org as mentioned on https://hadoop.apache.org/mailing_lists.html Thanks On Sun, Aug 27, 2017 at 10:25 PM, Corne Van Rensburg wrote: > [image: Softsure] > > unsubscribe > > > > *Corne Van RensburgManaging

Re:

Hi Dominique, Please send an email to user-unsubscr...@hadoop.apache.org as mentioned on https://hadoop.apache.org/mailing_lists.html Thanks Ravi 2017-08-26 10:49 GMT-07:00 Dominique Rozenberg : > unsubscribe > > > > > > [image: cid:image001.jpg@01D10A65.E830C520] > >

Re: Recommendation for Resourcemanager GC configuration

Hi Naga, Ravi, We have lots of small applications running on the cluster. We use Java 8 and Hadoop version 2.7.3. Resourcemanager is running on 40GB heap with NewRatio set to 3. We store 100,000 completed apps in memory (max-completed-apps). Tenured space occupies ~28 GB after a full GC. Is

Re: Recommendation for Resourcemanager GC configuration

Hi Vinod, The heap size is 40GB and NewRatio is set to 3. We have max completed applications set to 10. Regards, Puneet From: Vinod Kumar Vavilapalli Date: Wednesday, August 23, 2017 at 5:47 PM To: "Ravuri, Venkata Puneet" Cc:

Re: File copy from local to hdfs error

Hello Istavan, Thanks for the help it worked finally There was firewall issue solving that part made the hdfs work and take entry from local file system. Thanks and Regards Atul Rajan -Sent from my iPhone On 28-Aug-2017, at 11:20 PM, István Fajth wrote: Hi Atul, as

Re: YARN - How is a node for a container determined?

" densely pack containers on fewer nodes" : quite surprising, +1 with Daemon You have Yarn labels that can be used for that. Classical example are the need of specific hardware fir some processing. https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/NodeLabel.html Regards,