Joe McDonnell has uploaded this change for review. ( http://gerrit.cloudera.org:8080/13872
Change subject: IMPALA-8766: Change cloud dependencies to use hadoop-cloud-storage ...................................................................... IMPALA-8766: Change cloud dependencies to use hadoop-cloud-storage Currently, fe/pom.xml includes direct dependencies on hadoop-aws, hadoop-azure, and hadoop-azure-datalake. Hadoop has a meta-package hadoop-cloud-storage that provides these dependencies with appropriate exclusions. This would not change Impala's build significantly, but it allows different versions or distributions of Hadoop to add necessary runtime jars to the classpath. For example, distributions of Hadoop that use Apache Knox for identity management can add Knox jars to this meta-package. This switches Impala to use the hadoop-cloud-storage package. This does not change the default configuration, but the USE_CDP_HIVE=true configuration gains Apache Knox jars. Due to the structure of the CDP maven repository, it has dependencies on versions of jars that are not in the CDP maven repository. So, USE_CDP_HIVE=true requires the Hortonworks public maven repository. This is added, but it is only enabled with USE_CDP_HIVE=true and only for releases (no SNAPSHOTs). Testing: - Ran core tests - Manually verified classpath changes Change-Id: I08f1c36ecf54ac277d99e2d2843163eada732e50 --- M fe/pom.xml M impala-parent/pom.xml 2 files changed, 18 insertions(+), 14 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/72/13872/1 -- To view, visit http://gerrit.cloudera.org:8080/13872 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I08f1c36ecf54ac277d99e2d2843163eada732e50 Gerrit-Change-Number: 13872 Gerrit-PatchSet: 1 Gerrit-Owner: Joe McDonnell <joemcdonn...@cloudera.com>
