Junegunn Choi created HBASE-29091:
-------------------------------------
Summary: ExportSnapshot: snapshot.export.copy.references.threads
not needed
Key: HBASE-29091
URL: https://issues.apache.org/jira/browse/HBASE-29091
Project: HBase
Issue Type: Task
Components: mapreduce, snapshots
Reporter: Junegunn Choi
HBASE-20579 added a configuration {{snapshot.export.copy.references.threads}}
to parallelize the copy of files in the snapshot directory. However, this is an
overkill and no longer needed since 0.99 because HBASE-7987 replaced many empty
files in a snapshot directory with a single manifest file.
The author of HBASE-20579 was running HBase 0.98 at the time of the proposal.
bq. Of course. But I test it using version 0.98. For a snapshot which has
115328 reference files, it cost 3122 seconds to submit the job without the
patch. And it cost 775 seconds with the patch.
And it looks like it was a version without HBASE-11742 which backported
HBASE-7987 to 0.98 branch.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
