[ANNOUNCE] Apache Hadoop 3.2.0 release

Greetings all, It gives me great pleasure to announce that the Apache Hadoop community has voted to release Apache Hadoop 3.2.0. Apache Hadoop 3.2.0 is the first release of Apache Hadoop 3.2 line for the year 2019, which includes 1092 fixes since previous Hadoop 3.1.0 release. Of these fixes:

Re: Getting yarn node labels statistics

Hi Soheil There is one REST endpoint named "/label-mappings". This will provide nodelabel -> nodes mapping. http://rm-http-address:port/ws/v1/cluster/label-mappings Thanks Sunil On Thu, Mar 1, 2018 at 8:33 PM Soheil Pourbafrani wrote: > Is there any command or URL (like JMX) to get nodemanage

Re: Yarn StandBy Resourcemanager WebUi

Hi Soheil YARN web endpoint is designed in such a way that even if you land on standby RM's web endpoint, it will be redirected to active RM. - Sunil On Sun, Jan 21, 2018 at 3:03 AM Soheil Pourbafrani wrote: > I've configured Yarn cluster in high availability mode with standby > resource manage

Re: What does JobPriority mean?

Hi Benson, Prior to 2.8 releases, YARN did not support priorities for its applications. Currently user can specify priority (higher integer value means higher priority) to its applications so that high priority apps could get resources faster from scheduler (priority is applicable within a leaf qu

Re: Question about Resource Manager Rest APIs

Hi Jason, All data fetched from ResourceManager such as list of apps or reports etc are taken at current time (not cached). Do you expect some other data ? - Sunil On Tue, Sep 12, 2017 at 8:09 PM Xu,Jason wrote: > Hi all, > > > > I am trying to get information about the cluster via Resource M

Re: Hadoop 3.0

Yes. Latest changes in alpha-4 could be found here http://hadoop.apache.org/docs/r3.0.0-alpha4/hadoop-project-dist/hadoop-common/release/3.0.0-alpha4/CHANGES.3.0.0-alpha4.html - Sunil On Sun, Jul 9, 2017 at 9:21 PM Hariharan wrote: > Some of the major changes are listed here: > https://blog.clo

Re: How to monitor YARN application memory per container?

Sunil On Thu, Jun 15, 2017 at 6:56 AM Sunil G wrote: > Hi Shmuel > > This feature is available in Hadoop 2.8 + release lines. Or Hadoop 3 > alpha's. > > Thanks > Sunil > > On Wed, Jun 14, 2017 at 6:31 AM Shmuel Blitz > wrote: > >> Hi Sunil, >&

Re: How to monitor YARN application memory per container?

this to see the value I give to ' > spark.executor.memory' makes sense or not. > > I'm looking for memory usage/allocated information *per-container*. > > Shmuel > > On Wed, Jun 14, 2017 at 4:04 PM, Sunil G wrote: > >> Hi Shmuel >> >> In Ha

Re: How to monitor YARN application memory per container?

Hi Shmuel In Hadoop 2.8 release line, you could check "yarn node -status {nodeId}" CLI command or "http:///ws/v1/cluster/nodes/{nodeid}" REST end point to get container's actual resource usage per node. You could also check the same in any of Hadoop 3.0 alpha releases as well. Thanks Sunil On Tu