It's a very big treatment "Major Compaction". We use bulk loading and we've put one major at 2 A.M and it rocks !
-- Laurent HATIER - Consultant Big Data & Business Intelligence chez CapGemini fr.linkedin.com/pub/laurent-hatier/25/36b/a86/ <http://fr.linkedin.com/pub/laurent-h/25/36b/a86/> 2015-07-30 10:51 GMT+02:00 奥伯莱恩 <[email protected]>: > major compaction will cleanup deleted data and merge HFiles into one file > . Maybe it's not needed . > At 2015-07-30 07:23:02, "Krishna" <[email protected]> wrote: > >Hi, > > > >I am planning to bulk-load about 10 TB of data to a table pre-split with > >30 regions with max region file size configured to 10 GB. > > > >Is it recommended that I run a major compaction when bulk-loading > finishes? How > >many HFiles does the reducer create? >
