Michael Smith has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/19262 )
Change subject: IMPALA-11736: Copy data between ofs buckets ...................................................................... IMPALA-11736: Copy data between ofs buckets When Impala moves a file - such as for a LOAD DATA statement - it checks whether the source and destination are the same filesystem. If the same, it uses hdfsRename, otherwise it uses hdfsMove to move between filesystems. Ozone's ofs protocol supports referencing multiple buckets by path in the same filesystem, but does not support rename between them. All other filesystems Impala supports include the bucket name (if they use that concept) in the authority. This patch updates the function used to determine whether two paths are in the same filesystem to also check that they're in the same bucket as a requirement for hdfsRename. Testing: ran test suite with Ozone. Change-Id: Ic61f01672fa605fec0377885b13a1621573e424e Reviewed-on: http://gerrit.cloudera.org:8080/19262 Reviewed-by: Joe McDonnell <joemcdonn...@cloudera.com> Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com> --- M be/src/runtime/dml-exec-state.cc M be/src/runtime/exec-env.h M be/src/util/hdfs-util-test.cc M be/src/util/hdfs-util.cc M be/src/util/hdfs-util.h M fe/src/main/java/org/apache/impala/common/FileSystemUtil.java M fe/src/test/java/org/apache/impala/common/FileSystemUtilTest.java M tests/metadata/test_load.py 8 files changed, 199 insertions(+), 59 deletions(-) Approvals: Joe McDonnell: Looks good to me, approved Impala Public Jenkins: Verified -- To view, visit http://gerrit.cloudera.org:8080/19262 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Ic61f01672fa605fec0377885b13a1621573e424e Gerrit-Change-Number: 19262 Gerrit-PatchSet: 7 Gerrit-Owner: Michael Smith <michael.sm...@cloudera.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Joe McDonnell <joemcdonn...@cloudera.com> Gerrit-Reviewer: Michael Smith <michael.sm...@cloudera.com>
