elukey opened a new pull request #611: BIGTOP-3308: add support for openssl 1.1.0 on Debian URL: https://github.com/apache/bigtop/pull/611 In BIGTOP-2932 a patch was backported from Hadoop upstream to better support openssl 1.1.x. Some time later a new commit was filed to address some corner cases, but it was never backported to BigTop. On Debian 9 openssl 1.1.0 is the default, and BigTop builds against it. When executing the command "hadoop checknative -a" though an error shows up: openssl: false EVP_CIPHER_CTX_cleanup The issue is that EVP_CIPHER_CTX_cleanup was removed from openssl 1.1.0, but OpensslCipher.c kept using it until a proper if guard was added by the patch provided by this pull request. In my case this issue caused Spark 2.4's RPC encryption, based on Openssl native lib, to fail when establishing new connections between workers and AM on Yarn. I rebuilt the hadoop deb package with the patch and tested in the Debian 9 Docker image, the checknative util now returns correctly a positive "true" for openssl. I also tested it with Spark 2.4 on a test Hadoop cluster and it seems working fine.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
