Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/15334 )
Change subject: IMPALA-9400: Initial Ozone support ...................................................................... IMPALA-9400: Initial Ozone support Ozone is a block-based filesystem store and is similar to HDFS in many aspects. This patch adds initial support for reading data stored on Ozone and writing data to Ozone. It adds Ozone to the whitelist of Impala writable filesystems and adds the necessary Ozone client jars to the Impala classpath. Initially, Ozone will be treated as a remote storage service, similar to how Impala treats S3 and ABFS. Ozone will typically be deployed on a separate storage cluster, so all reads will be remote. Since remote HDFS and Ozone are separate storage systems, with distinct performance characteristics, they are treated as separate systems for disk scheduling purposes. Rather than updating to a new CDP GBN with the added Ozone client jars, I just modified the existing GBN to include the new jars in the Maven repo. Testing: * Manually tested that connecting to an external Ozone cluster works and that Impala can create an Ozone-backed table, write to the table, read from the table, and drop the table * Ran core tests with and without USE_CDP_HIVE=true Change-Id: I2544ff61e8767f061253a62a01ce2b7dfc384a99 Reviewed-on: http://gerrit.cloudera.org:8080/15334 Reviewed-by: Sahil Takiar <stak...@cloudera.com> Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com> --- M be/src/exec/hdfs-table-sink.cc M be/src/runtime/io/disk-io-mgr-test.cc M be/src/runtime/io/disk-io-mgr.cc M be/src/runtime/io/disk-io-mgr.h M be/src/util/hdfs-util.cc M be/src/util/hdfs-util.h M bin/impala-config.sh M fe/pom.xml M fe/src/main/java/org/apache/impala/common/FileSystemUtil.java M impala-parent/pom.xml 10 files changed, 75 insertions(+), 5 deletions(-) Approvals: Sahil Takiar: Looks good to me, approved Impala Public Jenkins: Verified -- To view, visit http://gerrit.cloudera.org:8080/15334 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I2544ff61e8767f061253a62a01ce2b7dfc384a99 Gerrit-Change-Number: 15334 Gerrit-PatchSet: 5 Gerrit-Owner: Sahil Takiar <stak...@cloudera.com> Gerrit-Reviewer: Anonymous Coward (572) Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Joe McDonnell <joemcdonn...@cloudera.com> Gerrit-Reviewer: Sahil Takiar <stak...@cloudera.com> Gerrit-Reviewer: Tim Armstrong <tarmstr...@cloudera.com>
