Hive on Tez local debug

Hi all, How debug execution code in hive on tez? "hive --debug" command only debug the explain level code and does not debug the execution code. Does hot have the similar usage as hos by using command "set spark.master=local;"? Thanks for your help. Regards, Jia Ke

RE: Hive +Tez+LLAP does not have obvious performance improvement than HIVE + Tez

Hi Gopal, > I have upgrade hive version to 3.0 and the somaxconn value of shuffle > port(15551) has been 16384 not 50. Thank you very much. > But I encounter the following problem when run llap, and this is same with > https://issues.apache.org/jira/browse/HIVE-10693 . Whether it is a bug of >

RE: Hive +Tez+LLAP does not have obvious performance improvement than HIVE + Tez

Hi Gopal, After setting the fds, somaxconn and DNS UDP packet loss configuration as you provided, the result have no change. Please help me check whether I set wrong configuration. Thanks very much. >For FDs, we set the related value to 65536 in /etc/security/limits.conf * - nofile

RE: Hive +Tez+LLAP does not have obvious performance improvement than HIVE + Tez

Hi Gopal , >I still do not understand the "only" mode. In the "only" mode, where the query >fragment run, LLAP daemon or tez container? >I change the execution mode from "all" to "only" and disable the >HybridGraceHashJoin. The execution time of q1 from 76s to 456s. Now, in "all" mode , we set

RE: Hive +Tez+LLAP does not have obvious performance improvement than HIVE + Tez

uggestions? Whether the "all" mode can gain the >best performance or not? And how the "auto" and "only" mode work? Regards, Jia Ke -Original Message- From: Gopal Vijayaraghavan [mailto:gop...@apache.org] Sent: Thursday, November 23, 2017 4:03 AM To:

RE: Hive +Tez+LLAP does not have obvious performance improvement than HIVE + Tez

? Now in llap daemon, we set the container > size is 210g and the jvm heap size is 180g and the cache size is 20g and the > executors and io thread is 81(the cpu vcores of yarn is 81). Does these > configuration is suitable? With these configurations, the cpu utilization > of lla

Request write access to the Hive wiki

Hi, I'd like to have write access to the Hive wiki. My Confluence username is jia.a...@intel.commailto:jia.a...@intel.com with Full Name Jia Ke. Please help me deal with it. Thank you! Regards, Jia Ke

Request write access to the Hive wiki

Hi, I'd like to have write access to the Hive wiki. My Confluence username is ke.a@intel.commailto:ke.a@intel.com with Full Name Jia Ke. Please help me deal with it. Thank you! Regards, Jia Ke