Re: MapReduce Terasort job is slow on Java 11

Hi Wei-Chiu We are running all the processes on JDK11 and not just the MR job. Thanks, Ashutosh On Wed, Nov 23, 2022 at 4:59 PM Wei-Chiu Chuang wrote: > For the JDK11 case, does everyone on the cluster run on JDK11? or is it the > MR job that is on JDK11? > > We have users running JDK in produ

Re: MapReduce Terasort job is slow on Java 11

For the JDK11 case, does everyone on the cluster run on JDK11? or is it the MR job that is on JDK11? We have users running JDK in production. The NN GC performance was the only thing we were aware of. In the past we noticed because JDK11 uses G1GC by default, large NameNode performance was worse t

Re: MapReduce Terasort job is slow on Java 11

Hi Prabhu Thanks for bringing this to attention. I can see it as part of this JIRA - HADOOP-15338 . It was also pointed out in the past as well about the degradation by @Ayush and @zhenhe. We should continue this discussion. @Ayush, did we get t

MapReduce Terasort job is slow on Java 11

Hi, Any pointers on why the MapReduce Terasort job is slower on Java 11 compared with Java 8. Input data, Configs, Number of Worker Nodes, Node instance type, Hadoop version and Resources are the same in both the runs. Have compared App logs of both good and bad runs and observed Avg Task (both Map