panbingkun commented on PR #44208: URL: https://github.com/apache/spark/pull/44208#issuecomment-1849466292
This is a workaround solution to make `HiveExternalCatalogVersionsSuite` test to pass. - The root cause is that in this test, it relies on `hive-exec-2.3.9.jar` and `slf4j-api-1.7.30.jar`, but in our GA environment, these two files are incomplete, <img width="648" alt="image" src="https://github.com/apache/spark/assets/15246973/fb28e61c-510c-4e4e-b924-4f99cc7fe29e";> and ivy cannot detect this integrity. https://github.com/databricks/spark-redshift/issues/244#issuecomment-347082455 It directly loads the file from the local maven location, causing the failure of `HiveExternalCatalogVersionsSuite`. - Because `HiveExternalCatalogVersionsSuite` test downloads the ·published spark file· for testing, modifying the code will not affect it. Here, we can only delete the corrupted file before executing the UT, so that ivy cannot recognize it, and then ivy will actively download the two completed jars from the remote side, thus bypassing it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
