yuting sun created HBASE-29185:
----------------------------------
Summary: How to ensure the atomicity of data files during
compaction
Key: HBASE-29185
URL: https://issues.apache.org/jira/browse/HBASE-29185
Project: HBase
Issue Type: Sub-task
Components: Compaction
Affects Versions: 2.6.0
Reporter: yuting sun
{code:java}
//代码占位符
{code}
protected List<HStoreFile> doCompaction(CompactionRequestImpl cr,
Collection<HStoreFile> filesToCompact, User user, long compactionStartTime,
List<Path> newFiles) throws IOException \{ // Do the steps necessary to
complete the compaction. setStoragePolicyFromFileName(newFiles);
List<HStoreFile> sfs = storeEngine.commitStoreFiles(newFiles, true); if
(this.getCoprocessorHost() != null) { for (HStoreFile sf : sfs) {
getCoprocessorHost().postCompact(this, sf, cr.getTracker(), cr, user); } }
replaceStoreFiles(filesToCompact, sfs, true); long outputBytes =
getTotalSize(sfs); // At this point the store will use new files for all new
scanners. refreshStoreSizeAndTotalBytes(); // update store size. long now =
EnvironmentEdgeManager.currentTime(); if ( region.getRegionServerServices() !=
null && region.getRegionServerServices().getMetrics() != null ) \{
region.getRegionServerServices().getMetrics().updateCompaction(
region.getTableDescriptor().getTableName().getNameAsString(), cr.isMajor(), now
- compactionStartTime, cr.getFiles().size(), newFiles.size(), cr.getSize(),
outputBytes); } logCompactionEndMessage(cr, sfs, now, compactionStartTime);
return sfs; }
{code:java}
//代码占位符{code}
In the commitStoreFiles logic and replaceStoreFiles logic, after the sfs file
is moved to the data directory and before it is loaded by storeFile, if
compaction abort occurs, how should the sfs collection be handled? It seems
that it is retained in the data directory and waits for the next loading.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
