Joe McDonnell has uploaded this change for review. ( http://gerrit.cloudera.org:8080/17259
Change subject: IMPALA-10629: Fix parquet compression codecs for data load scripts ...................................................................... IMPALA-10629: Fix parquet compression codecs for data load scripts Currently, the dataload scripts don't respect non-standard compression codecs when loading Parquet data. It always loads snappy, even when specifying something else like --table_format=parquet/zstd. This fixes the dataload scripts so that they specify the compression_codec query option correctly and thus use the right codec when loading Parquet. This should make it easier to do performance testing on various Parquet codecs (like ZSTD). Testing: - Ran bin/load-data.py -w tpch --table_format=parquet/zstd and checked the codec in the file with the parquet-reader utility Change-Id: I1a346de3e5c4e38328e5a8ce8162697b7dd6553a --- M testdata/bin/generate-schema-statements.py 1 file changed, 29 insertions(+), 6 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/59/17259/1 -- To view, visit http://gerrit.cloudera.org:8080/17259 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I1a346de3e5c4e38328e5a8ce8162697b7dd6553a Gerrit-Change-Number: 17259 Gerrit-PatchSet: 1 Gerrit-Owner: Joe McDonnell <joemcdonn...@cloudera.com>
