Zoltan Haindrich created HIVE-19095:
---------------------------------------

             Summary: Improve analyze statement execution time for partitioned 
tables
                 Key: HIVE-19095
                 URL: https://issues.apache.org/jira/browse/HIVE-19095
             Project: Hive
          Issue Type: Improvement
            Reporter: Zoltan Haindrich


tpcds@1TB:
{{analyze web_returns compile statistics for columns}} 

both compile and stat task execution is slow; 
there were ~2000 calls to get_partitions_ps_with_auth which took 2minutes
stattask seems to be slow because it seems like the metastore updates the stats 
1 by 1 for each partition

{flushCache=1, optimizer=565, open_txns=8, TezCompiler=5248, get_table_req=69, 
get_partitions_ps_with_auth=130333}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to