Re:How the actual "sample data" are implemented when using tez reduce auto-parallelism

2016-02-26 Thread LLBian
instruction. Any reply would be very very grateful. At 2016-02-27 11:13:48, "LLBian" wrote: > > >Hello, Respected experts: >  >Recently, I am studying  tez reduce auto-parallelism, I read the article  >"Apache Tez: Dynamic Graph Reconfiguration",TEZ-398 and HIVE-

How the actual "sample data" are implemented when using tez reduce auto-parallelism

2016-02-26 Thread LLBian
Hello, Respected experts:   Recently, I am studying  tez reduce auto-parallelism, I read the article  "Apache Tez: Dynamic Graph Reconfiguration",TEZ-398 and HIVE-7158. I found the HIVE-7158 said that "Tez can optionally sample data from a fraction  of the tasks of a vertex and use that informati

TEZ log missing

2016-01-21 Thread LLBian
not understand,should I change yarn log configurations? Any reply will be appreciated. Thankyou & Best Regards. ---LLBian

hive on tez serialization and deserialization( custom Serde initialize() just called one time in hive client, when split in AM)

2016-01-21 Thread LLBian
n somewhere to call this logic again, but I have not found appropriate places. I am eager to get your guidance. I would very much appreciate your help. Any reply will be appreciated. Thankyou & Best Regards. ---LLBian

Re:Re: what is the difference between ³hive.compute.splits.in.am=true²and "hive.compute.splits.in.am=false"

2016-01-18 Thread LLBian
Thank you very very much,Gopal. I got it. And I will study this carefully on the PPTS you shared. Best Regards. --LLBian At 2016-01-19 14:16:27, "Gopal Vijayaraghavan" wrote: > > >>Thank-you so much for your quick response. Yea, the option is use only >>for hiv

Re:Re: what is the difference between ³hive.compute.splits.in.am=true²and "hive.compute.splits.in.am=false"

2016-01-18 Thread LLBian
). Can you please tell me other explainations? Thankyou & Rest Regards ---LLBian At 2016-01-19 11:44:02, "Gopal Vijayaraghavan" wrote: > >>what is the difference between³hive.compute.splits.in.am=true²and >>"hive.compute.splits.in.am=false"? >>whic

what is the difference between “hive.compute.splits.in.am=true”and "hive.compute.splits.in.am=false"

2016-01-18 Thread LLBian
the application scenario? Any reply are very appreciated. --LLBian