[jira] [Commented] (HADOOP-17708) Fail to build hadoop-common from source on Fedora
[
https://issues.apache.org/jira/browse/HADOOP-17708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17394836#comment-17394836
]
Brahma Reddy Battula commented on HADOOP-17708:
---
[~bioinfornatics] did you apply patch as suggested by [~iwasakims] and ran
again..? Currently i removed the target version 3.2.2 which released.
> Fail to build hadoop-common from source on Fedora
> -
>
> Key: HADOOP-17708
> URL: https://issues.apache.org/jira/browse/HADOOP-17708
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Jonathan mercier
>Priority: Major
>
> Dear I tried to build hadoop from source with a vanilla fedora 34
> {code:bash}
> dnf group install -y "Development Tools" \
> && dnf install -y java-1.8.0-openjdk-devel fuse-devel snappy-java
> snappy-devel jansson-devel protobuf zlib-devel libzstd-devel \
>maven-1:3.6.3 cmake gcc-c++ ant protobuf-compiler
> protobuf-java slf4j
> export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.292.b10-0.fc34.x86_64/
> export MAVEN_OPTS="-Xms2048M -Xmx4096M"
> export
> PATH="/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.292.b10-0.fc34.x86_64/bin/:$PATH"
> export CC=/usr/bin/gcc
> export CXX=/usr/bin/g++
> curl -LO
> https://apache.mediamirrors.org/hadoop/common/hadoop-3.2.2/hadoop-3.2.2-src.tar.gz
> tar xf hadoop-3.2.2-src.tar.gz && cd hadoop-3.2.2-src
> mvn package -Pdist,native -Drequire.snappy=true -DskipTests -Dtar
> {code}
> But I have this error
> {code:java}
> at org.apache.hadoop.maven.plugin.cmakebuilder.CompileMojo.runMake
> (CompileMojo.java:229)
>
>
> at org.apache.hadoop.maven.plugin.cmakebuilder.CompileMojo.execute
> (CompileMojo.java:98)
>
>
> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo
> (DefaultBuildPluginManager.java:137)
>
>
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute
> (MojoExecutor.java:210)
>
>
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute
> (MojoExecutor.java:156)
>
>
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute
> (MojoExecutor.java:148)
>
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
> (LifecycleModuleBuilder.java:117)
>
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
> (LifecycleModuleBuilder.java:81)
>
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
> (SingleThreadedBuilder.java:56)
>
>
> at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
> (LifecycleStarter.java:128)
>
>
> at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
>
>
>
> at org.apache.maven.D
[jira] [Commented] (HADOOP-17708) Fail to build hadoop-common from source on Fedora
[
https://issues.apache.org/jira/browse/HADOOP-17708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17350720#comment-17350720
]
Masatake Iwasaki commented on HADOOP-17708:
---
[~bioinfornatics] The fix version/s of HADOOP-17569 is 3.2.3, 3.3.1 and 3.4.0.
If you want to build 3.2.2 on Fedora 33 or above, you need to apply [the patch
of #2886|https://github.com/apache/hadoop/pull/2886.patch].
> Fail to build hadoop-common from source on Fedora
> -
>
> Key: HADOOP-17708
> URL: https://issues.apache.org/jira/browse/HADOOP-17708
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Jonathan mercier
>Priority: Major
>
> Dear I tried to build hadoop from source with a vanilla fedora 34
> {code:bash}
> dnf group install -y "Development Tools" \
> && dnf install -y java-1.8.0-openjdk-devel fuse-devel snappy-java
> snappy-devel jansson-devel protobuf zlib-devel libzstd-devel \
>maven-1:3.6.3 cmake gcc-c++ ant protobuf-compiler
> protobuf-java slf4j
> export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.292.b10-0.fc34.x86_64/
> export MAVEN_OPTS="-Xms2048M -Xmx4096M"
> export
> PATH="/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.292.b10-0.fc34.x86_64/bin/:$PATH"
> export CC=/usr/bin/gcc
> export CXX=/usr/bin/g++
> curl -LO
> https://apache.mediamirrors.org/hadoop/common/hadoop-3.2.2/hadoop-3.2.2-src.tar.gz
> tar xf hadoop-3.2.2-src.tar.gz && cd hadoop-3.2.2-src
> mvn package -Pdist,native -Drequire.snappy=true -DskipTests -Dtar
> {code}
> But I have this error
> {code:java}
> at org.apache.hadoop.maven.plugin.cmakebuilder.CompileMojo.runMake
> (CompileMojo.java:229)
>
>
> at org.apache.hadoop.maven.plugin.cmakebuilder.CompileMojo.execute
> (CompileMojo.java:98)
>
>
> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo
> (DefaultBuildPluginManager.java:137)
>
>
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute
> (MojoExecutor.java:210)
>
>
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute
> (MojoExecutor.java:156)
>
>
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute
> (MojoExecutor.java:148)
>
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
> (LifecycleModuleBuilder.java:117)
>
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
> (LifecycleModuleBuilder.java:81)
>
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
> (SingleThreadedBuilder.java:56)
>
>
> at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
> (LifecycleStarter.java:128)
>
>
> at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
>
>
>
[jira] [Commented] (HADOOP-17708) Fail to build hadoop-common from source on Fedora
[
https://issues.apache.org/jira/browse/HADOOP-17708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17349663#comment-17349663
]
Jonathan mercier commented on HADOOP-17708:
---
How to reproduce it:
{code:java}
docker run -it fedora:34 /bin/bash
# Install requirement
dnf group install -y "Development Tools" \
&& dnf install -y java-1.8.0-openjdk-devel fuse-devel snappy-java snappy-devel
jansson-devel protobuf zlib-devel libzstd-devel \
maven-1:3.6.3 cmake gcc-c++ ant protobuf-compiler
protobuf-java slf4j fuse-devel fusesource-pom \
nodejs bats pkg-config autoconf automake libtool
boost-devel doxygen libtirpc-devel \
zlib-devel lz4-devel bzip2-devel openssl-devel
cyrus-sasl-devel libpmem-devel libcxx-devel \
# configure and set java 8
alternatives --install /usr/bin/javajava
/usr/lib/jvm/java-1.8.0/bin/java 180 \
--slave /usr/bin/alt-java alt-java
/usr/lib/jvm/java-1.8.0/bin/alt-java \
--slave /usr/bin/keytool keytool
/usr/lib/jvm/java-1.8.0/bin/keytool \
--slave /usr/bin/jjs jjs
/usr/lib/jvm/java-1.8.0/bin/jjs \
--slave /usr/bin/unpack200 unpack200
/usr/lib/jvm/java-1.8.0/jre/bin/unpack200 \
--slave /usr/bin/appletviewer appletviewer
/usr/lib/jvm/java-1.8.0/bin/appletviewer \
--slave /usr/bin/clhsdbclhsdb
/usr/lib/jvm/java-1.8.0/bin/clhsdb \
--slave /usr/bin/hsdb hsdb
/usr/lib/jvm/java-1.8.0/bin/hsdb \
--slave /usr/bin/idlj idlj
/usr/lib/jvm/java-1.8.0/bin/idlj \
--slave /usr/bin/jar jar
/usr/lib/jvm/java-1.8.0/bin/jar \
--slave /usr/bin/jarsigner jarsigner
/usr/lib/jvm/java-1.8.0/bin/jarsigner \
--slave /usr/bin/java-rmi.cgi java-rmi.cgi
/usr/lib/jvm/java-1.8.0/bin/java-rmi.cgi \
--slave /usr/bin/javac javac
/usr/lib/jvm/java-1.8.0/bin/javac \
--slave /usr/bin/javadoc javadoc
/usr/lib/jvm/java-1.8.0/bin/javadoc \
--slave /usr/bin/javah javah
/usr/lib/jvm/java-1.8.0/bin/javah \
--slave /usr/bin/javap javap
/usr/lib/jvm/java-1.8.0/bin/javap \
--slave /usr/bin/jcmd jcmd
/usr/lib/jvm/java-1.8.0/bin/jcmd \
--slave /usr/bin/jconsole jconsole
/usr/lib/jvm/java-1.8.0/bin/jconsole \
--slave /usr/bin/jdb jdb
/usr/lib/jvm/java-1.8.0/bin/jdb \
--slave /usr/bin/jdeps jdeps
/usr/lib/jvm/java-1.8.0/bin/jdeps \
--slave /usr/bin/jfr jfr
/usr/lib/jvm/java-1.8.0/bin/jfr \
--slave /usr/bin/jhat jhat
/usr/lib/jvm/java-1.8.0/bin/jhat \
--slave /usr/bin/jinfo jinfo
/usr/lib/jvm/java-1.8.0/bin/jinfo \
--slave /usr/bin/jmap jmap
/usr/lib/jvm/java-1.8.0/bin/jmap \
--slave /usr/bin/jps jps
/usr/lib/jvm/java-1.8.0/bin/jps \
--slave /usr/bin/jrunscriptjrunscript
/usr/lib/jvm/java-1.8.0/bin/jrunscript \
--slave /usr/bin/jsadebugd jsadebugd
/usr/lib/jvm/java-1.8.0/bin/jsadebugd \
--slave /usr/bin/jstackjstack
/usr/lib/jvm/java-1.8.0/bin/jstack \
--slave /usr/bin/jstatdjstatd
/usr/lib/jvm/java-1.8.0/bin/jstatd \
--slave /usr/bin/native2ascii native2ascii
/usr/lib/jvm/java-1.8.0/bin/native2ascii \
--slave /usr/bin/orbd orbd
/usr/lib/jvm/java-1.8.0/bin/orbd \
--slave /usr/bin/pack200 pack200
/usr/lib/jvm/java-1.8.0/bin/pack200 \
--slave /usr/bin/policytoolpolicytool
/usr/lib/jvm/java-1.8.0/bin/policytool \
--slave /usr/bin/rmic rmic
/usr/lib/jvm/java-1.8.0/bin/rmic \
--slave /usr/bin/rmid rmid
/usr/lib/jvm/java-1.8.0/bin/rmid \
--slave /usr/bin/rmiregistry rmiregistry
/usr/lib/jvm/java-1.8.0/bin/rmiregistry \
--slave /usr/bin/schemagen schemagen
/usr/lib/jvm/java-1.8.0/bin/schemagen \
--slave /usr/bin/serialver serialver
/usr/lib/jvm/java-1.8.0/bin/serialver \
--slave /usr/bin/servertoolservertool
/usr/lib/jvm/java-1.8.0/bin/servertool \
--slave /usr/bin/tnameserv tnameserv
/usr/lib/jvm/java-1.8.0/bin/tnameserv \
--slave /usr/bin/wsgen wsgen
/usr/lib/jvm/java-1.8.0/bin/wsgen \
[jira] [Commented] (HADOOP-17708) Fail to build hadoop-common from source on Fedora
[
https://issues.apache.org/jira/browse/HADOOP-17708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17347885#comment-17347885
]
Jonathan mercier commented on HADOOP-17708:
---
After turn on full log message with the flags {color:#4c9aff}-e -X{color}
{code:bash}
mvn package -Pdist,native -Drequire.snappy=true -DskipTests -Dtar -e -X
{code}
I can see that the real problem is here:
{code}
Unable to find source-code formatter for language: log. Available languages
are: actionscript, ada, applescript, bash, c, c#, c++, cpp, css, erlang, go,
groovy, haskell, html, java, javascript, js, json, lua, none, nyan, objc, perl,
php, python, r, rainbow, ruby, scala, sh, sql, swift, visualbasic, xml,
yaml[WARNING] [ 12%] Built target test_bulk_crc32
[WARNING] make[1]: Leaving directory
'/hadoop-3.2.2-src/hadoop-common-project/hadoop-common/target/native'
[WARNING]
/hadoop-3.2.2-src/hadoop-common-project/hadoop-common/src/main/native/src/exception.c:
In function ‘terror’:
[WARNING]
/hadoop-3.2.2-src/hadoop-common-project/hadoop-common/src/main/native/src/exception.c:118:34:
error: ‘sys_nerr’ undeclared (first use in this function)
[WARNING] 118 | if ((errnum < 0) || (errnum >= sys_nerr)) {
[WARNING] | ^~~~
[WARNING]
/hadoop-3.2.2-src/hadoop-common-project/hadoop-common/src/main/native/src/exception.c:118:34:
note: each undeclared identifier is reported only once for each function it
appears in
[WARNING]
/hadoop-3.2.2-src/hadoop-common-project/hadoop-common/src/main/native/src/exception.c:121:10:
error: ‘sys_errlist’ undeclared (first use in this function)
[WARNING] 121 | return sys_errlist[errnum];
[WARNING] | ^~~
[WARNING]
/hadoop-3.2.2-src/hadoop-common-project/hadoop-common/src/main/native/src/exception.c:123:1:
warning: control reaches end of non-void function [-Wreturn-type]
[WARNING] 123 | }
[WARNING] | ^
[WARNING] make[2]: *** [CMakeFiles/hadoop_static.dir/build.make:82:
CMakeFiles/hadoop_static.dir/main/native/src/exception.c.o] Error 1
[WARNING] make[1]: *** [CMakeFiles/Makefile2:99:
CMakeFiles/hadoop_static.dir/all] Error 2
