Hello Alexey Serbin, Kudu Jenkins, Abhishek Chennaka, I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/19278 to look at the new patch set (#9). Change subject: [tools] Add test to generate heavy rowset compaction ...................................................................... [tools] Add test to generate heavy rowset compaction This patch adds tests to repro KUDU-3406 like scenario where rowset compaction could end up consuming large amount of memory used to load accumulated undo deltas. TestLoadgenCompactRowSetsOpHighMemUsage: Generates load to invoke CompactRowSetsOp without enabling memory budgeting flags. With memory budgeting disabled, memory usage is as follows: Timing: real 10.446s, "peak_mem_usage":3323898718 Timing: real 9.816s, "peak_mem_usage":4199547144 Timing: real 9.038s, "peak_mem_usage":3779520834 Timing: real 10.610s, "peak_mem_usage":3757873687 TestLoadgenCompactRowSetsOpOptimalMemUsage: Generates load to ensure CompactRowSetsOp stats computation kicks in. With memory budgeting flags enabled in such a way that budgeting criteria is met, CompactRowSetsOp is skipped. With memory budgeting enabled, memory usage is as follows: Timing: real 1.032s, "peak_mem_usage":106388163 Timing: real 1.341s, "peak_mem_usage":439757141 Timing: real 1.621s, "peak_mem_usage":420143817 Timing: real 1.187s, "peak_mem_usage":439080084 Timing: real 1.111s, "peak_mem_usage":390513965 Change-Id: Ief4ec03f1bf0f7936f8fb054948f87e71333f824 --- M src/kudu/benchmarks/CMakeLists.txt A src/kudu/benchmarks/compaction-highmem.cc M src/kudu/scripts/benchmarks.sh 3 files changed, 391 insertions(+), 0 deletions(-) git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/78/19278/9 -- To view, visit http://gerrit.cloudera.org:8080/19278 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: Ief4ec03f1bf0f7936f8fb054948f87e71333f824 Gerrit-Change-Number: 19278 Gerrit-PatchSet: 9 Gerrit-Owner: Ashwani Raina <ara...@cloudera.com> Gerrit-Reviewer: Abhishek Chennaka <achenn...@cloudera.com> Gerrit-Reviewer: Alexey Serbin <ale...@apache.org> Gerrit-Reviewer: Ashwani Raina <ara...@cloudera.com> Gerrit-Reviewer: Kudu Jenkins (120)