Michael Smith has uploaded this change for review. ( http://gerrit.cloudera.org:8080/19172
Change subject: IMPALA-7098: Re-enable tests under EC ...................................................................... IMPALA-7098: Re-enable tests under EC Re-enables tests under erasure coding, or provides more specific exceptions. Erasure coding uses multiple data blocks to construct a block group. Our tests use RS-3-2-1024k, which includes 3 data blocks in a block group. Each of these blocks is sized according to `dfs.block.size`, so block groups by default hold up to 384MB of data. Impala schedules work to executors based on blocks reported by HDFS, which for EC actually represent block groups. So with default block size, a file in EC has 1/3rd the number of schedulable blocks. That affects many of our tests, which often verify how many nodes a read is scheduled on and use relatively small files (<1GB) which will only have 1 or 2 block groups in EC. Reduce `dfs.block.size` in the minicluster to ~1/3rd the default so our tests have the same number of block groups to schedule. Change-Id: Ib452024993e35d5a8d2854c6b2085115b26e40df --- M bin/impala-config.sh M testdata/cluster/node_templates/common/etc/hadoop/conf/hdfs-site.xml.tmpl M tests/common/skip.py M tests/custom_cluster/test_admission_controller.py M tests/custom_cluster/test_auto_scaling.py M tests/custom_cluster/test_query_retries.py M tests/custom_cluster/test_runtime_profile.py M tests/metadata/test_explain.py M tests/query_test/test_hdfs_caching.py M tests/query_test/test_insert.py M tests/query_test/test_mt_dop.py M tests/query_test/test_nested_types.py M tests/query_test/test_resource_limits.py M tests/query_test/test_scanners.py M tests/util/auto_scaler.py 15 files changed, 34 insertions(+), 49 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/72/19172/1 -- To view, visit http://gerrit.cloudera.org:8080/19172 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: Ib452024993e35d5a8d2854c6b2085115b26e40df Gerrit-Change-Number: 19172 Gerrit-PatchSet: 1 Gerrit-Owner: Michael Smith <michael.sm...@cloudera.com>
