Balazs Hevele has uploaded this change for review. ( http://gerrit.cloudera.org:8080/24059
Change subject: WIP IMPALA-14700: Add support for Parquet LZ4_RAW compression ...................................................................... WIP IMPALA-14700: Add support for Parquet LZ4_RAW compression NOTE: This change requires a Parquet Version higher than the current one (1.12.3), because of the LZ4_RAW Thrift enum value. For that reason, APACHE_PARQUET_VERSION is increased to 1.15.2 in this WIP patch, and is used instead of CDP_PARQUET_VERSION. Parquet deprecated LZ4 compression, and added a new one, LZ4_RAW. This patch adds support for LZ4_RAW. It uses Lz4Compressor (Corresponding to THdfsCompression::LZ4). Testing: Tested manually with an existing Parquet file with LZ4_RAW compression: 1. "CREATE TABLE <table> LIKE PARQUET <file> STORED AS PARQUET" query works properly 2. Impala shows the rows properly with a select query after manually replacing the parquet file in HDFS for the table created in 1, and refreshing the table. Change-Id: I22ee4e5bf9abec37be941c1dca8019a563343d34 --- M be/src/exec/parquet/parquet-common.cc M be/src/exec/parquet/parquet-metadata-utils.cc M be/src/util/codec.cc M be/src/util/codec.h M bin/impala-config.sh M common/thrift/parquet.thrift 6 files changed, 21 insertions(+), 14 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/59/24059/1 -- To view, visit http://gerrit.cloudera.org:8080/24059 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I22ee4e5bf9abec37be941c1dca8019a563343d34 Gerrit-Change-Number: 24059 Gerrit-PatchSet: 1 Gerrit-Owner: Balazs Hevele <[email protected]>
