Riza Suminto has uploaded this change for review. ( http://gerrit.cloudera.org:8080/21021
Change subject: IMPALA-12796: Add is_footer_only in TFileSplitGeneratorSpec ...................................................................... IMPALA-12796: Add is_footer_only in TFileSplitGeneratorSpec Several tests in test_scanners.py failed by wrong row counts with S3 target filesystem after IMPALA-12631. S3 filesystem does not have block. Planner will produce TFileSplitGeneratorSpec instead of TScanRangeLocationList, and IMPALA-12631 miss to address necessary changes in TFileSplitGeneratorSpec. This patch address the issue by adding is_footer_only field in TFileSplitGeneratorSpec schedule accordingly in schedule.cc. Testing: - Pass core tests with S3 target filesystem. Change-Id: Iaa6e3c14debe68cf601131c6594774c8c695923e --- M be/src/scheduling/scheduler-test-util.cc M be/src/scheduling/scheduler-test-util.h M be/src/scheduling/scheduler-test.cc M be/src/scheduling/scheduler.cc M common/thrift/PlanNodes.thrift M fe/src/main/java/org/apache/impala/planner/HdfsScanNode.java 6 files changed, 67 insertions(+), 25 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/21/21021/1 -- To view, visit http://gerrit.cloudera.org:8080/21021 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: Iaa6e3c14debe68cf601131c6594774c8c695923e Gerrit-Change-Number: 21021 Gerrit-PatchSet: 1 Gerrit-Owner: Riza Suminto <riza.sumi...@cloudera.com>
