Yup, I tried without ninja, still dosent work On Wed, Jul 26, 2017 at 8:30 PM, Vincent Tran <vtt...@cloudera.com> wrote:
> I ran it without -ninja and with -build_shared_libs option one time and it > got fixed. Is that the same as -so? The -help menu wasn't clear about > whether they are interchangeable or they are two opposite options. > > I just ran it again with -so. It still seems to work. > > On Wed, Jul 26, 2017 at 8:26 PM, Lars Volker <l...@cloudera.com> wrote: > > > Vincent, did you build without ninja but with -so enabled? That still > give > > me the same error. > > > > On Fri, Jul 21, 2017 at 12:01 PM, Vincent Tran <vtt...@cloudera.com> > > wrote: > > > > > This happened to me last evening. I turned off ninja build and did a > full > > > build. Seems to have fixed it. > > > Not sure if it's the exact same root cause here though (if you don't > use > > > ninja). > > > > > > On Fri, Jul 21, 2017 at 2:54 PM, Matthew Jacobs <m...@cloudera.com> > wrote: > > > > > > > Did you ever come to a conclusion on this? > > > > > > > > On Wed, Jul 19, 2017 at 5:14 PM, Bikramjeet Vig > > > > <bikramjeet....@cloudera.com> wrote: > > > > > Didn't work, heres the output of rm CMakeCache.txt && cmake . > > > > > > > > > > > > > > > -- Setup toolchain link flags > > > > > -Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64 > > > > > -L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64 > > > > > -- Build type is DEBUG > > > > > -- ENABLE_CODE_COVERAGE: false > > > > > -- Boost version: 1.57.0 > > > > > -- Found the following Boost libraries: > > > > > -- thread > > > > > -- regex > > > > > -- filesystem > > > > > -- system > > > > > -- date_time > > > > > -- Boost include dir: > > > > > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include > > > > > -- Boost libraries: > > > > > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/ > > > > libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1. > > > > 57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/ > > > > toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/ > > > > bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_ > > > > system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0- > > > > p3/lib/libboost_date_time.a > > > > > -- Found OpenSSL: > > > > > /usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64- > > > > linux-gnu/libcrypto.so > > > > > (found version "1.0.2g") > > > > > -- ----------> Adding thirdparty library openssl_ssl. <---------- > > > > > -- Header files: /usr/include > > > > > -- Added shared library dependency openssl_ssl: > > > > > /usr/lib/x86_64-linux-gnu/libssl.so > > > > > -- ----------> Adding thirdparty library openssl_crypto. > <---------- > > > > > -- Added shared library dependency openssl_crypto: > > > > > /usr/lib/x86_64-linux-gnu/libcrypto.so > > > > > -- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include > > > > > -- ----------> Adding thirdparty library bzip2. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/ > > > > include > > > > > -- Added static library dependency bzip2: > > > > > /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a > > > > > -- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include > > > > > -- ----------> Adding thirdparty library zlib. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/ > > toolchain/zlib-1.2.8/include > > > > > -- Added static library dependency zlib: > > > > > /home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a > > > > > -- ----------> Adding thirdparty library hdfs. <---------- > > > > > -- Header files: > > > > > /home/bikram/dev/Impala/toolchain/cdh_components/ > > > hadoop-2.6.0-cdh5.13.0- > > > > SNAPSHOT/include > > > > > -- Added static library dependency hdfs: > > > > > /home/bikram/dev/Impala/toolchain/cdh_components/ > > > hadoop-2.6.0-cdh5.13.0- > > > > SNAPSHOT/lib/native/libhdfs.a > > > > > -- ----------> Adding thirdparty library glog. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/ > > > include > > > > > -- Added static library dependency glog: > > > > > /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a > > > > > -- ----------> Adding thirdparty library gflags. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/ > toolchain/gflags-2.2.0-p1/ > > > > include > > > > > -- Added static library dependency gflags: > > > > > /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a > > > > > -- ----------> Adding thirdparty library pprof. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/ > > > > include > > > > > -- Added static library dependency pprof: > > > > > /home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a > > > > > -- ----------> Adding thirdparty library gtest. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/ > > toolchain/gtest-1.6.0/include > > > > > -- Added static library dependency gtest: > > > > > /home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a > > > > > -- LLVM llvm-config found at: > > > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config > > > > > -- LLVM clang++ found at: > > > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++ > > > > > -- LLVM opt found at: > > > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt > > > > > -- LLVM_ROOT: /home/bikram/dev/Impala/ > toolchain/llvm-3.8.0-asserts- > > p1 > > > > > -- LLVM llvm-config found at: > > > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts- > > > p1/bin/llvm-config > > > > > -- LLVM include dir: > > > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include > > > > > -- LLVM lib dir: /home/bikram/dev/Impala/ > > toolchain/llvm-3.8.0-asserts- > > > > p1/lib > > > > > -- ----------> Adding thirdparty library cyrus_sasl. <---------- > > > > > -- Header files: /usr/include > > > > > -- Added shared library dependency cyrus_sasl: > > > > > /usr/lib/x86_64-linux-gnu/libsasl2.so > > > > > -- ----------> Adding thirdparty library ldap. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/ > toolchain/openldap-2.4.25/ > > > > include > > > > > -- Added static library dependency ldap: > > > > > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/libldap.a > > > > > -- ----------> Adding thirdparty library lber. <---------- > > > > > -- Added static library dependency lber: > > > > > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/liblber.a > > > > > -- ----------> Adding thirdparty library thrift. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/ > toolchain/thrift-0.9.0-p9/ > > > > include > > > > > -- Added static library dependency thrift: > > > > > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/lib/libthrift.a > > > > > -- Thrift version: Thrift version 0.9.0 > > > > > -- Thrift contrib dir: /home/bikram/dev/Impala/ > > > toolchain/thrift-0.9.0-p9 > > > > > -- Thrift compiler: > > > > > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift > > > > > -- Found FLATBUFFERS: > > > > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include > > > > > -- ----------> Adding thirdparty library flatbuffers. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/ > > toolchain/flatbuffers-1.6.0/ > > > > include > > > > > -- Added static library dependency flatbuffers: > > > > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/ > > > lib/libflatbuffers.a > > > > > -- FlatBuffers compiler: > > > > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc > > > > > -- ----------> Adding thirdparty library snappy. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/ > > > toolchain/snappy-1.1.4/include > > > > > -- Added static library dependency snappy: > > > > > /home/bikram/dev/Impala/toolchain/snappy-1.1.4/lib/libsnappy.a > > > > > -- ----------> Adding thirdparty library lz4. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/ > toolchain/lz4-1.7.5/include > > > > > -- Added static library dependency lz4: > > > > > /home/bikram/dev/Impala/toolchain/lz4-1.7.5/lib/liblz4.a > > > > > -- /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include > > > > > -- ----------> Adding thirdparty library re2. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/ > toolchain/re2-20130115-p1/ > > > > include > > > > > -- Added static library dependency re2: > > > > > /home/bikram/dev/Impala/toolchain/re2-20130115-p1/lib/libre2.a > > > > > -- RapidJson include dir: > > > > > /home/bikram/dev/Impala/toolchain/rapidjson-0.11/include > > > > > -- ----------> Adding thirdparty library avro. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/ > > > include > > > > > -- Added static library dependency avro: > > > > > /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/lib/libavro.a > > > > > -- Found PROTOBUF: > > > > > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/ > libprotobuf.so > > > > > -- ----------> Adding thirdparty library protobuf. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/ > > > > include > > > > > -- Added static library dependency protobuf: > > > > > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.a > > > > > -- ----------> Adding thirdparty library protoc. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/ > > > > include > > > > > -- Added static library dependency protoc: > > > > > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotoc.a > > > > > -- Found LIBEV: /home/bikram/dev/Impala/toolchain/libev-4.20/lib/ > > > > libev.so > > > > > -- ----------> Adding thirdparty library libev. <---------- > > > > > -- Header files: /home/bikram/dev/Impala/ > > toolchain/libev-4.20/include > > > > > -- Added static library dependency libev: > > > > > /home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.a > > > > > -- Found CRCUTIL: > > > > > /home/bikram/dev/Impala/toolchain/crcutil- > > > 440ba7babeff77ffad992df3a10c76 > > > > 7f184e946e-p1/lib/libcrcutil.so > > > > > > > > > > -- ----------> Adding thirdparty library crcutil. <---------- > > > > > -- Header files: > > > > > /home/bikram/dev/Impala/toolchain/crcutil- > > > 440ba7babeff77ffad992df3a10c76 > > > > 7f184e946e-p1/include > > > > > -- Added static library dependency crcutil: > > > > > /home/bikram/dev/Impala/toolchain/crcutil- > > > 440ba7babeff77ffad992df3a10c76 > > > > 7f184e946e-p1/lib/libcrcutil.a > > > > > -- Found JNI: > > > > > /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/libjawt.so;/usr/lib/ > > > > jvm/jdk1.7.0_80/jre/lib/amd64/libjsig.so;/usr/lib/jvm/jdk1. > > > > 7.0_80/jre/lib/amd64/server/libjvm.so > > > > > > > > > > -- ----------> Adding thirdparty library java_jvm. <---------- > > > > > -- Header files: > > > > > /usr/lib/jvm/jdk1.7.0_80/include;/usr/lib/jvm/jdk1.7.0_ > > > > 80/include/linux;/usr/lib/jvm/jdk1.7.0_80/include > > > > > -- Added static library dependency java_jvm: > > > > > /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so > > > > > -- ----------> Adding thirdparty library breakpad. <---------- > > > > > -- Header files: > > > > > /home/bikram/dev/Impala/toolchain/breakpad- > > > > ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/include/breakpad > > > > > -- Added static library dependency breakpad: > > > > > /home/bikram/dev/Impala/toolchain/breakpad- > > > > ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/lib/libbreakpad_client.a > > > > > -- Added shared library dependency rt: /usr/lib/x86_64-linux-gnu/ > > > > librt.so > > > > > -- Added shared library dependency dl: /usr/lib/x86_64-linux-gnu/ > > > > libdl.so > > > > > Using Thrift compiler: > > > > > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift > > > > > Found output dir: /home/bikram/dev/Impala/shell/ > > > > > Using FlatBuffers compiler: > > > > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc > > > > > --java-o/home/bikram/dev/Impala/fe/generated-sources/gen-java-b > > > > > --cpp-o/home/bikram/dev/Impala/be/generated-sources/gen-cpp-b > > > > > -- Could NOT find Doxygen (missing: DOXYGEN_EXECUTABLE) > > > > > -- WARNING: Doxygen not found - Docs will not be created > > > > > -- Looking for sched_getcpu > > > > > -- Looking for sched_getcpu - found > > > > > -- Compiler Flags: -Wall -Wno-sign-compare -Wno-unknown-pragmas > > > -pthread > > > > > -fno-strict-aliasing -std=c++14 -Wno-deprecated -Wno-vla > > > > > -DBOOST_DATE_TIME_POSIX_TIME_STD_CONFIG > -DBOOST_SYSTEM_NO_DEPRECATED > > > -B > > > > > /home/bikram/dev/Impala/toolchain/binutils-2.26.1/bin/ > -fuse-ld=gold > > > -g > > > > > -Wno-unused-local-typedefs -ggdb -gdwarf-2 -Werror -fverbose-asm > > > > > -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS > > > > > -D__STDC_LIMIT_MACROS > > > > > -- Common /home/bikram/dev/Impala/be/build/debug/ > > > > > -- Configuring done > > > > > -- Generating done > > > > > -- Build files have been written to: /home/bikram/dev/Impala > > > > > > > > > > > > > > > On Wed, Jul 19, 2017 at 5:09 PM, Bikramjeet Vig < > > > > bikramjeet....@cloudera.com > > > > >> wrote: > > > > > > > > > >> Thanks, lemme try it real quick and I'll get back to you > > > > >> > > > > >> On Wed, Jul 19, 2017 at 5:04 PM, Henry Robinson <he...@apache.org > > > > > > wrote: > > > > >> > > > > >>> Can you try: > > > > >>> > > > > >>> cd $IMPALA_HOME > > > > >>> rm CMakeCache.txt > > > > >>> cmake . > > > > >>> <make impala, however you usually do it> > > > > >>> > > > > >>> If that doesn't work, can you send me the output of rm > > CMakeCache.txt > > > > && > > > > >>> cmake . from IMPALA_HOME? > > > > >>> > > > > >>> Thanks, > > > > >>> Henry > > > > >>> > > > > >>> On 19 July 2017 at 17:03, Henry Robinson <he...@cloudera.com> > > wrote: > > > > >>> > > > > >>> > Sorry, I read too quickly - you've done that already! Let me > > take a > > > > >>> look. > > > > >>> > > > > > >>> > On 19 July 2017 at 17:01, Henry Robinson <he...@apache.org> > > wrote: > > > > >>> > > > > > >>> >> Yep, you need to remove the downloaded version of gflags and > > > > replace it > > > > >>> >> with a recent toolchain version. See my mail from yesterday > for > > > > >>> >> instructions: https://lists.apache.org/api/source.lua/a154f4 > > > > >>> >> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev. > > > > >>> >> impala.apache.org%3E > > > > >>> >> > > > > >>> >> On 19 July 2017 at 16:56, Bikramjeet Vig < > > > > bikramjeet....@cloudera.com> > > > > >>> >> wrote: > > > > >>> >> > > > > >>> >>> After fetching latest from asf-gerrit (that has the toolchain > > > > commit > > > > >>> >>> related to gflags) and doing a manual toolchain refresh, I am > > > > unable > > > > >>> to > > > > >>> >>> run > > > > >>> >>> impala when I build with "make_debug" or "buildall -so", both > > > > >>> statestore > > > > >>> >>> and catalogd show the following error: > > > > >>> >>> > > > > >>> >>> ERROR: something wrong with flag 'flagfile' in file > > > > >>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui > > > > >>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/ > > > > >>> >>> gflags-2.2.0-p1/src/gflags.cc'. > > > > >>> >>> One possibility: file > > > > >>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui > > > > >>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/ > > > > >>> >>> gflags-2.2.0-p1/src/gflags.cc' > > > > >>> >>> is being linked both statically and dynamically into this > > > > executable. > > > > >>> >>> > > > > >>> >>> I am only able to make it work if I go with static linking by > > > > >>> building it > > > > >>> >>> with "buildall" without the "-so" > > > > >>> >>> > > > > >>> >>> Anyone facing the same issue? > > > > >>> >>> > > > > >>> >> > > > > >>> >> > > > > >>> > > > > > >>> > > > > > >>> > -- > > > > >>> > Henry Robinson > > > > >>> > Software Engineer > > > > >>> > Cloudera > > > > >>> > 415-994-6679 <(415)%20994-6679> > > > > >>> > > > > > >>> > > > > >> > > > > >> > > > > > > > > > > > > > > > > -- > > > Vincent T. Tran > > > Customer Operations Engineer > > > Cloudera, Inc. > > > > > > > > > -- > Vincent T. Tran > Customer Operations Engineer > Cloudera, Inc. >
