Quanlong Huang has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/19019 )
Change subject: IMPALA-11528: Catalogd should start up with a corrupt Hive function. ...................................................................... IMPALA-11528: Catalogd should start up with a corrupt Hive function. This commit handles the case for a specific kind of corrupt function within the Hive Metastore in the following situation: A valid Hive SQL function gets created in HMS. This UDF is written in Java and must derive from the "UDF" class. After creating this function in Impala, we then replace the underlying jar file with a class that does NOT derive from the "UDF" class. In this scenario, catalogd should reject the function and still start up gracefully. Before this commit, catalogd wasn't coming up. The reason for this was because the Hive function FunctionUtils.getUDFClassType() has a dependency on UDAF and was throwing a LinkageError exception, so we need to include the UDAF class in the shaded jar. Merge conflicts in branch-4.1: - Ignore MapredContext.class in java/shaded-deps/hive-exec/pom.xml - Replace SkipIfFS.hive in test_permanent_udfs.py with individual skip annotations - Update version in java/test-corrupt-hive-udfs/pom.xml Change-Id: I54e7a1df6d018ba6cf5ecf32dc9946edf86e2112 Reviewed-on: http://gerrit.cloudera.org:8080/18927 Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Reviewed-by: Tamas Mate <tma...@apache.org> Reviewed-on: http://gerrit.cloudera.org:8080/19019 --- M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java M java/pom.xml M java/shaded-deps/hive-exec/pom.xml A java/test-corrupt-hive-udfs/pom.xml A java/test-corrupt-hive-udfs/src/main/java/org/apache/impala/CorruptUdf.java A java/test-hive-udfs/src/main/java/org/apache/impala/CorruptUdf.java M testdata/bin/copy-udfs-udas.sh M tests/custom_cluster/test_permanent_udfs.py 8 files changed, 159 insertions(+), 1 deletion(-) Approvals: Impala Public Jenkins: Verified Tamas Mate: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/19019 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: branch-4.1.1 Gerrit-MessageType: merged Gerrit-Change-Id: I54e7a1df6d018ba6cf5ecf32dc9946edf86e2112 Gerrit-Change-Number: 19019 Gerrit-PatchSet: 5 Gerrit-Owner: Quanlong Huang <huangquanl...@gmail.com> Gerrit-Reviewer: Csaba Ringhofer <csringho...@cloudera.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Quanlong Huang <huangquanl...@gmail.com> Gerrit-Reviewer: Steve Carlin <scar...@cloudera.com> Gerrit-Reviewer: Tamas Mate <tma...@apache.org>
