rbalamohan opened a new pull request #2134:
URL: https://github.com/apache/hive/pull/2134


   HIVE-24943: Initiator: Optimise when tables/partitions are not eligible for 
compaction
   https://issues.apache.org/jira/browse/HIVE-24943
   
   ### What changes were proposed in this pull request?
   
https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/txn/compactor/MetaStoreCompactorThread.java#L73
 
   
   When large number of databases & tables are present, HMS spends good amount 
of time and CPU in gathering table details. 
   
   Initiator should be able to detect such databases and reduce load on HMS for 
such tables & databases. This PR tries to avoid such databases/tables in 
Initiator.
   
   
   ### Why are the changes needed?
   To reduce load on HMS. When large number of DBs & tables are present, HMS 
spends good amount of time & CPU in this codepath.
   
   ### Does this PR introduce _any_ user-facing change?
   Np
   
   ### How was this patch tested?
   small internal cluster


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to