David Ribeiro Alves has uploaded a new patch set (#5).
Change subject: Ported delta encoding from Impala to KUDU.
......................................................................
Ported delta encoding from Impala to KUDU.
The porting work is quite straightforward since the most of Delta
encoding related codes have been merged into KUDU codebase, like
class BitReader, BitWriter etc. But to improve random access performance,
the original block format is modified to contain more metadata.
Before:
Each block contains
- <min delta>
- <list of bit widths of miniblocks>
- <miniblocks>
After:
Each block contains
- <list of bit widths of miniblocks>
- <list of min deltas of miniblocks>
- <list of first values of miniblocks>
- <miniblocks>
Change-Id: I1446a78f22773c28a7cc877fbe861697e39b2af8
---
M src/kudu/cfile/encoding-test.cc
A src/kudu/cfile/packed_diff_block.h
M src/kudu/cfile/type_encodings.cc
M src/kudu/client/schema.cc
M src/kudu/client/schema.h
M src/kudu/common/common.proto
M src/kudu/util/bit-stream-utils.h
M src/kudu/util/bit-stream-utils.inline.h
8 files changed, 553 insertions(+), 2 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/10/1210/5
--
To view, visit http://gerrit.cloudera.org:8080/1210
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I1446a78f22773c28a7cc877fbe861697e39b2af8
Gerrit-PatchSet: 5
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-Owner: [email protected]
Gerrit-Reviewer: David Ribeiro Alves <[email protected]>
Gerrit-Reviewer: Todd Lipcon <[email protected]>
Gerrit-Reviewer: [email protected]
