Hi,

If you've got the 1st starvation fixed (with Hadoop 2.8 patch), all these 
configs + enable log4j2 async logging, you should definitely see a performance 
improvement.

Here's the log patches, which need a corresponding LLAP config (& have to be 
disabled in HS2, for the progress bar to work)

https://issues.apache.org/jira/browse/HIVE-13027
+
https://issues.apache.org/jira/browse/HIVE-16061

You might want to share the explain plans + a jstack, if you want me to narrow 
down on the issue.

Pick a simple query like Query55 or 52, to get a sane baseline.

> And For somaxconn, why the somaxconn value of the shuffle port (15551) is 50 
> not 16384? Thanks for your help.

Good catch, I think you might have more backports to match my GA build (which 
spikes ~80% cpu on 16 cores easily)

https://issues.apache.org/jira/browse/HIVE-16737

Cheers,
Gopal


Reply via email to