atsaonerk commented on PR #3444:
URL: https://github.com/apache/hive/pull/3444#issuecomment-1239240003
Results of jmh performance benchmark test indicates an improvement in
TableExport operation. If table is dumped in parallel manner instead of serial
, the operation completes much faster giving. Below is the result seen when 500
tablexport operations are done both in serial and parallel manner.
Result
"org.apache.hive.benchmark.ql.exec.TableAndPartitionExportBench.BaseBench.parallel":
N = 5
mean = 640.862 ?(99.9%) 113.354 ms/op
Result
"org.apache.hive.benchmark.ql.exec.TableAndPartitionExportBench.BaseBench.serial":
N = 5
mean = 51697.322 ?(99.9%) 322.747 ms/op
Benchmark
Mode Cnt Score Error Units
TableAndPartitionExportBench.BaseBench.parallel ss 5
640.862 ? 113.354 ms/op
TableAndPartitionExportBench.BaseBench.serial ss 5
51697.322 ? 322.747 ms/op
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
