Daniel Becker has uploaded this change for review. ( http://gerrit.cloudera.org:8080/12621
Change subject: IMPALA-8253: Draft - Parquet delta encoding and decoding. ...................................................................... IMPALA-8253: Draft - Parquet delta encoding and decoding. Implemented an encoder and decoder for the Parquet delta encoding (see https://github.com/apache/parquet-format/blob/master/Encodings.md). The coders are not integrated with Impala yet, they provide an interface that Impala could use. TODO: Currently the delta coders only support 32-bit integers. For 64 bit integers, we have to extend the functionality of BitWriter and BatchedBitReader. Added new methods to BitWriter and BatchedBitReader handling Uleb and ZigZag integers for 64 bits. Testing: - Added new tests for the encoder and decoder - Tests covering the additions in BitWriter and BatchedBitReader. Change-Id: Ie7378ac1a490a6c89a0a4349aae86cbc0fbc80f8 --- M be/src/benchmarks/CMakeLists.txt A be/src/benchmarks/parquet-delta-benchmark.cc M be/src/exec/parquet/CMakeLists.txt M be/src/exec/parquet/parquet-common.h A be/src/exec/parquet/parquet-delta-coder-test-data.h A be/src/exec/parquet/parquet-delta-coder-test.cc A be/src/exec/parquet/parquet-delta-decoder.h A be/src/exec/parquet/parquet-delta-encoder.h M be/src/util/CMakeLists.txt M be/src/util/bit-packing-test.cc M be/src/util/bit-packing.h M be/src/util/bit-packing.inline.h M be/src/util/bit-stream-utils-test.cc M be/src/util/bit-stream-utils.h M be/src/util/bit-stream-utils.inline.h 15 files changed, 4,238 insertions(+), 56 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/21/12621/6 -- To view, visit http://gerrit.cloudera.org:8080/12621 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: Ie7378ac1a490a6c89a0a4349aae86cbc0fbc80f8 Gerrit-Change-Number: 12621 Gerrit-PatchSet: 6 Gerrit-Owner: Daniel Becker <daniel.bec...@cloudera.com> Gerrit-Reviewer: Csaba Ringhofer <csringho...@cloudera.com> Gerrit-Reviewer: Daniel Becker <daniel.bec...@cloudera.com> Gerrit-Reviewer: Gabor Kaszab <gaborkas...@cloudera.com> Gerrit-Reviewer: Zoltan Borok-Nagy <borokna...@cloudera.com>
