Hello Alexey Serbin, Kudu Jenkins, Abhishek Chennaka,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/19278
to look at the new patch set (#7).
Change subject: [tools] Add test to generate heavy rowset compaction
......................................................................
[tools] Add test to generate heavy rowset compaction
This patch adds tests to repro KUDU-3406 like scenario
where rowset compaction could end up consuming large
amount of memory used to load accumulated undo deltas.
TestLoadgenCompactRowSetsOpHighMemUsage:
Generates load to invoke CompactRowSetsOp without
enabling memory budgeting flags.
With memory budgeting disabled, memory usage is as follows:
Timing: real 10.446s, "peak_mem_usage":3323898718
Timing: real 9.816s, "peak_mem_usage":4199547144
Timing: real 9.038s, "peak_mem_usage":3779520834
Timing: real 10.610s, "peak_mem_usage":3757873687
TestLoadgenCompactRowSetsOpOptimalMemUsage:
Generates load to ensure CompactRowSetsOp stats computation
kicks in. With memory budgeting flags enabled in such a way
that budgeting criteria is met, CompactRowSetsOp is skipped.
With memory budgeting enabled, memory usage is as follows:
Timing: real 1.032s, "peak_mem_usage":106388163
Timing: real 1.341s, "peak_mem_usage":439757141
Timing: real 1.621s, "peak_mem_usage":420143817
Timing: real 1.187s, "peak_mem_usage":439080084
Timing: real 1.111s, "peak_mem_usage":390513965
Change-Id: Ief4ec03f1bf0f7936f8fb054948f87e71333f824
---
M src/kudu/tools/kudu-tool-test.cc
1 file changed, 233 insertions(+), 2 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/78/19278/7
--
To view, visit http://gerrit.cloudera.org:8080/19278
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ief4ec03f1bf0f7936f8fb054948f87e71333f824
Gerrit-Change-Number: 19278
Gerrit-PatchSet: 7
Gerrit-Owner: Ashwani Raina <ara...@cloudera.com>
Gerrit-Reviewer: Abhishek Chennaka <achenn...@cloudera.com>
Gerrit-Reviewer: Alexey Serbin <ale...@apache.org>
Gerrit-Reviewer: Ashwani Raina <ara...@cloudera.com>
Gerrit-Reviewer: Kudu Jenkins (120)
