looks like BUILDING.TXT will need changing -currently it declares the dependency as optional
On 6 October 2014 12:19, Colin McCabe <cmcc...@alumni.cmu.edu> wrote: > On Thu, Oct 2, 2014 at 1:15 PM, Ted Yu <yuzhih...@gmail.com> wrote: >> On my Mac and on Linux, I was able to >> find /usr/include/openssl/opensslconf.h >> >> However the file is absent on Jenkins machine(s). >> >> Just want to make sure that the file is needed for native build before >> filing INFRA ticket. > > opensslconf.h is part of the openssl-devel package (at least on my > machine) and if it is missing, I would suspect that openssl is either > not installed or incorrectly installed. > > We need it for the native build to have coverage for the > openssl-related things (like random number generation and encryption). > > Colin > >> >> Cheers >> >> On Thu, Oct 2, 2014 at 9:09 AM, Tsuyoshi OZAWA <ozawa.tsuyo...@gmail.com> >> wrote: >> >>> Hi Ted, >>> >>> On my local, the build of trunk with "mvn package -Pnative,dist" works >>> well. I'm not certain whether this problem is related, but some build >>> fails on YARN(e.g. YARN-2562, YARN-2615, YARN-2640). >>> >>> The version information of OS and libssl-dev on my local environment >>> is as follows: >>> >>> $ uname -a >>> Linux ip-172-31-4-83 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 >>> 19:11:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux >>> >>> $ apt-cache show libssl-dev >>> Package: libssl-dev >>> Priority: optional >>> Section: libdevel >>> Installed-Size: 6162 >>> Maintainer: Ubuntu Developers <ubuntu-devel-disc...@lists.ubuntu.com> >>> Original-Maintainer: Debian OpenSSL Team >>> <pkg-openssl-de...@lists.alioth.debian.org> >>> Architecture: amd64 >>> Source: openssl >>> Version: 1.0.1f-1ubuntu2 >>> Depends: libssl1.0.0 (= 1.0.1f-1ubuntu2), zlib1g-dev >>> Recommends: libssl-doc >>> Filename: pool/main/o/openssl/libssl-dev_1.0.1f-1ubuntu2_amd64.deb >>> Size: 1066212 >>> MD5sum: 321724885048f9a78d0e93887a7eb296 >>> SHA1: e337538bed6e5765a0a85c4ca2af1d0deefd6ce0 >>> SHA256: ed199dc9131923fa3c911202f165402b1310f50dcdfab987f6f5c2669fc698cc >>> >>> Cheers, >>> - Tsuyoshi >>> >>> On Thu, Oct 2, 2014 at 11:43 PM, Ted Yu <yuzhih...@gmail.com> wrote: >>> > Hadoop-Common-trunk build failed due to missing opensslconf.h >>> > >>> > Is this environment issue or due to recent commits ? >>> > >>> > Cheers >>> > >>> > On Thu, Oct 2, 2014 at 7:31 AM, Apache Jenkins Server < >>> > jenk...@builds.apache.org> wrote: >>> > >>> >> See <https://builds.apache.org/job/Hadoop-Common-trunk/1257/> >>> >> >>> >> ------------------------------------------ >>> >> [exec] /usr/bin/cmake -E cmake_progress_report < >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native/CMakeFiles >>> > >>> >> 8 >>> >> [exec] [ 16%] Building C object >>> >> >>> CMakeFiles/hadoop.dir/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c.o >>> >> [exec] /usr/bin/cc -Dhadoop_EXPORTS -m32 -g -Wall -O2 -D_REENTRANT >>> >> -D_GNU_SOURCE -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -fPIC -I< >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native/javah >>> > >>> >> -I< >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/native/src >>> > >>> >> -I< >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src >>> > >>> >> -I< >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/src >>> > >>> >> -I< >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native >>> > >>> >> -I/home/jenkins/tools/java/latest/include >>> >> -I/home/jenkins/tools/java/latest/include/linux -I< >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/util >>> > >>> >> -o >>> >> >>> CMakeFiles/hadoop.dir/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c.o >>> >> -c < >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c >>> >> > >>> >> [exec] In file included from < >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/nat >>> >> > >>> >> [exec] >>> >> ive/src/org/apache/hadoop/crypto/org_apache_hadoop_crypto.h:33:0, >>> >> [exec] from < >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c >>> >> >:19: >>> >> [exec] /usr/incl >>> >> [exec] ude/openssl/aes.h:55:33: fatal error: openssl/opensslconf.h: >>> >> No such file or directory >>> >> [exec] #include <openssl/opensslconf.h> >>> >> [exec] ^ >>> >> [exec] compilation terminated. >>> >> [exec] make[2]: *** >>> >> >>> [CMakeFiles/hadoop.dir/main/native/src/org/apache/hadoop/crypto/OpensslCipher.c.o] >>> >> Error 1 >>> >> [exec] make[1]: *** [CMakeFiles/hadoop.dir/all] Error 2 >>> >> [exec] make: *** [all] Error 2 >>> >> [exec] make[2]: Leaving directory `< >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native >>> >> '> >>> >> [exec] make[1]: Leaving directory `< >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native >>> >> '> >>> >> [INFO] >>> >> ------------------------------------------------------------------------ >>> >> [INFO] Reactor Summary: >>> >> [INFO] >>> >> [INFO] Apache Hadoop Annotations ......................... SUCCESS [ >>> >> 6.890 s] >>> >> [INFO] Apache Hadoop MiniKDC ............................. SUCCESS [ >>> >> 11.827 s] >>> >> [INFO] Apache Hadoop Auth ................................ SUCCESS >>> [04:57 >>> >> min] >>> >> [INFO] Apache Hadoop Auth Examples ....................... SUCCESS [ >>> >> 4.448 s] >>> >> [INFO] Apache Hadoop Common .............................. FAILURE [ >>> >> 21.471 s] >>> >> [INFO] Apache Hadoop NFS ................................. SKIPPED >>> >> [INFO] Apache Hadoop KMS ................................. SKIPPED >>> >> [INFO] Apache Hadoop Common Project ...................... SKIPPED >>> >> [INFO] >>> >> ------------------------------------------------------------------------ >>> >> [INFO] BUILD FAILURE >>> >> [INFO] >>> >> ------------------------------------------------------------------------ >>> >> [INFO] Total time: 05:43 min >>> >> [INFO] Finished at: 2014-10-02T14:30:49+00:00 >>> >> [INFO] Final Memory: 65M/763M >>> >> [INFO] >>> >> ------------------------------------------------------------------------ >>> >> [ERROR] Failed to execute goal >>> >> org.apache.maven.plugins:maven-antrun-plugin:1.7:run (make) on project >>> >> hadoop-common: An Ant BuildException has occured: exec returned: 2 >>> >> [ERROR] around Ant part ...<exec dir="< >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native >>> "> >>> >> executable="make" failonerror="true">... @ 7:160 in < >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/antrun/build-main.xml >>> >> > >>> >> [ERROR] -> [Help 1] >>> >> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to >>> execute >>> >> goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (make) on >>> project >>> >> hadoop-common: An Ant BuildException has occured: exec returned: 2 >>> >> around Ant part ...<exec dir="< >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native >>> "> >>> >> executable="make" failonerror="true">... @ 7:160 in < >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/antrun/build-main.xml >>> >> > >>> >> at >>> >> >>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216) >>> >> at >>> >> >>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) >>> >> at >>> >> >>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) >>> >> at >>> >> >>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108) >>> >> at >>> >> >>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76) >>> >> at >>> >> >>> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) >>> >> at >>> >> >>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116) >>> >> at >>> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361) >>> >> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155) >>> >> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584) >>> >> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213) >>> >> at org.apache.maven.cli.MavenCli.main(MavenCli.java:157) >>> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> >> at >>> >> >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >>> >> at >>> >> >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >>> >> at java.lang.reflect.Method.invoke(Method.java:597) >>> >> at >>> >> >>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) >>> >> at >>> >> >>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) >>> >> at >>> >> >>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) >>> >> at >>> >> >>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) >>> >> Caused by: org.apache.maven.plugin.MojoExecutionException: An Ant >>> >> BuildException has occured: exec returned: 2 >>> >> around Ant part ...<exec dir="< >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/native >>> "> >>> >> executable="make" failonerror="true">... @ 7:160 in < >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/antrun/build-main.xml >>> >> > >>> >> at >>> >> org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:355) >>> >> at >>> >> >>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133) >>> >> at >>> >> >>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) >>> >> ... 19 more >>> >> Caused by: < >>> >> >>> https://builds.apache.org/job/Hadoop-Common-trunk/ws/hadoop-common-project/hadoop-common/target/antrun/build-main.xml >>> >:7: >>> >> exec returned: 2 >>> >> at >>> >> org.apache.tools.ant.taskdefs.ExecTask.runExecute(ExecTask.java:646) >>> >> at >>> >> org.apache.tools.ant.taskdefs.ExecTask.runExec(ExecTask.java:672) >>> >> at >>> >> org.apache.tools.ant.taskdefs.ExecTask.execute(ExecTask.java:498) >>> >> at >>> >> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) >>> >> at sun.reflect.GeneratedMethodAccessor88.invoke(Unknown Source) >>> >> at >>> >> >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >>> >> at java.lang.reflect.Method.invoke(Method.java:597) >>> >> at >>> >> >>> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106) >>> >> at org.apache.tools.ant.Task.perform(Task.java:348) >>> >> at org.apache.tools.ant.Target.execute(Target.java:390) >>> >> at org.apache.tools.ant.Target.performTasks(Target.java:411) >>> >> at >>> >> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399) >>> >> at org.apache.tools.ant.Project.executeTarget(Project.java:1368) >>> >> at >>> >> org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:327) >>> >> ... 21 more >>> >> [ERROR] >>> >> [ERROR] >>> >> [ERROR] For more information about the errors and possible solutions, >>> >> please read the following articles: >>> >> [ERROR] [Help 1] >>> >> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException >>> >> [ERROR] >>> >> [ERROR] After correcting the problems, you can resume the build with the >>> >> command >>> >> [ERROR] mvn <goals> -rf :hadoop-common >>> >> Build step 'Execute shell' marked build as failure >>> >> Archiving artifacts >>> >> Recording test results >>> >> >>> >>> >>> >>> -- >>> - Tsuyoshi >>> -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
