Kengo Seki created BIGTOP-4289:
----------------------------------
Summary: Fix Hadoop build on Fedora 40
Key: BIGTOP-4289
URL: https://issues.apache.org/jira/browse/BIGTOP-4289
Project: Bigtop
Issue Type: Bug
Components: hadoop
Reporter: Kengo Seki
I tried to build Hadoop 3.3.6 on Fedora 40 and came across the following errors.
{code}
$ cat /etc/redhat-release
Fedora release 40 (Forty)
$ gcc --version
gcc (GCC) 14.2.1 20240912 (Red Hat 14.2.1-3)
Copyright (C) 2024 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
$ openssl version
OpenSSL 3.2.2 4 Jun 2024 (Library: OpenSSL 3.2.2 4 Jun 2024)
$ ./gradlew hadoop-clean hadoop-pkg
...
[WARNING]
/home/vagrant/bigtop/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-common-project/hadoop-common/src/main/native/src/test/org/apache/hadoop/io/erasurecode/erasure_code_test.c:
In function ‘main’:
[WARNING]
/home/vagrant/bigtop/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-common-project/hadoop-common/src/main/native/src/test/org/apache/hadoop/io/erasurecode/erasure_code_test.c:116:7:
error: implicit declaration of function ‘dumpDecoder’
[-Wimplicit-function-declaration]
[WARNING] 116 | dumpDecoder(pDecoder);
[WARNING] | ^~~~~~~~~~~
[WARNING] make[2]: *** [CMakeFiles/erasure_code_test.dir/build.make:146:
CMakeFiles/erasure_code_test.dir/main/native/src/test/org/apache/hadoop/io/erasurecode/erasure_code_test.c.o]
Error 1
[WARNING] make[1]: *** [CMakeFiles/Makefile2:89:
CMakeFiles/erasure_code_test.dir/all] Error 2
[WARNING] make[1]: *** Waiting for unfinished jobs....
[WARNING]
/home/vagrant/bigtop/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/crypto/random/OpensslSecureRandom.c:
In function ‘locks_setup’:
[WARNING]
/home/vagrant/bigtop/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/crypto/random/OpensslSecureRandom.c:250:33:
error: implicit declaration of function ‘dlsym_CRYPTO_num_locks’; did you mean
‘dlsym_CRYPTO_malloc’? [-Wimplicit-function-declaration]
[WARNING] 250 | lock_cs = dlsym_CRYPTO_malloc(dlsym_CRYPTO_num_locks() * \
[WARNING] | ^~~~~~~~~~~~~~~~~~~~~~
[WARNING] | dlsym_CRYPTO_malloc
[WARNING]
/home/vagrant/bigtop/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/crypto/random/OpensslSecureRandom.c:257:3:
error: implicit declaration of function ‘dlsym_CRYPTO_set_id_callback’; did
you mean ‘CRYPTO_set_id_callback’? [-Wimplicit-function-declaration]
[WARNING] 257 | dlsym_CRYPTO_set_id_callback((unsigned long
(*)())pthreads_thread_id);
[WARNING] | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
[WARNING] | CRYPTO_set_id_callback
[WARNING]
/home/vagrant/bigtop/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/crypto/random/OpensslSecureRandom.c:258:3:
error: implicit declaration of function ‘dlsym_CRYPTO_set_locking_callback’;
did you mean ‘CRYPTO_set_locking_callback’? [-Wimplicit-function-declaration]
[WARNING] 258 | dlsym_CRYPTO_set_locking_callback((void
(*)())pthreads_locking_callback);
[WARNING] | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[WARNING] | CRYPTO_set_locking_callback
...
{code}
HADOOP-19180 includes the fix for the first dumpDecoder thing, but others don't
seem to be addressed in upstream, at least as of the 3.4.1 release.
[~iwasakims] Could you take a look at it?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
