Re: Problem running Impala built with dynamic linking

[Bikramjeet Vig]

Yup, I tried without ninja, still dosent work

On Wed, Jul 26, 2017 at 8:30 PM, Vincent Tran  wrote:

> I ran it without -ninja and with -build_shared_libs option one time and it
> got fixed. Is that the same as -so? The -help menu wasn't clear about
> whether they are interchangeable or they are two opposite options.
>
> I just ran it again with -so. It still seems to work.
>
> On Wed, Jul 26, 2017 at 8:26 PM, Lars Volker  wrote:
>
> > Vincent, did you build without ninja but with -so enabled? That still
> give
> > me the same error.
> >
> > On Fri, Jul 21, 2017 at 12:01 PM, Vincent Tran 
> > wrote:
> >
> > > This happened to me last evening. I turned off ninja build and did a
> full
> > > build. Seems to have fixed it.
> > > Not sure if it's the exact same root cause here though (if you don't
> use
> > > ninja).
> > >
> > > On Fri, Jul 21, 2017 at 2:54 PM, Matthew Jacobs 
> wrote:
> > >
> > > > Did you ever come to a conclusion on this?
> > > >
> > > > On Wed, Jul 19, 2017 at 5:14 PM, Bikramjeet Vig
> > > >  wrote:
> > > > > Didn't work, heres the output of rm CMakeCache.txt && cmake .
> > > > >
> > > > >
> > > > > -- Setup toolchain link flags
> > > > > -Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > > > > -L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > > > > -- Build type is DEBUG
> > > > > -- ENABLE_CODE_COVERAGE: false
> > > > > -- Boost version: 1.57.0
> > > > > -- Found the following Boost libraries:
> > > > > --   thread
> > > > > --   regex
> > > > > --   filesystem
> > > > > --   system
> > > > > --   date_time
> > > > > -- Boost include dir:
> > > > > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
> > > > > -- Boost libraries:
> > > > > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/
> > > > libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.
> > > > 57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/
> > > > toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/
> > > > bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_
> > > > system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-
> > > > p3/lib/libboost_date_time.a
> > > > > -- Found OpenSSL:
> > > > > /usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-
> > > > linux-gnu/libcrypto.so
> > > > > (found version "1.0.2g")
> > > > > -- --> Adding thirdparty library openssl_ssl. <--
> > > > > -- Header files: /usr/include
> > > > > -- Added shared library dependency openssl_ssl:
> > > > > /usr/lib/x86_64-linux-gnu/libssl.so
> > > > > -- --> Adding thirdparty library openssl_crypto.
> <--
> > > > > -- Added shared library dependency openssl_crypto:
> > > > > /usr/lib/x86_64-linux-gnu/libcrypto.so
> > > > > -- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> > > > > -- --> Adding thirdparty library bzip2. <--
> > > > > -- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/
> > > > include
> > > > > -- Added static library dependency bzip2:
> > > > > /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
> > > > > -- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > > > > -- --> Adding thirdparty library zlib. <--
> > > > > -- Header files: /home/bikram/dev/Impala/
> > toolchain/zlib-1.2.8/include
> > > > > -- Added static library dependency zlib:
> > > > > /home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
> > > > > -- --> Adding thirdparty library hdfs. <--
> > > > > -- Header files:
> > > > > /home/bikram/dev/Impala/toolchain/cdh_components/
> > > hadoop-2.6.0-cdh5.13.0-
> > > > SNAPSHOT/include
> > > > > -- Added static library dependency hdfs:
> > > > > /home/bikram/dev/Impala/toolchain/cdh_components/
> > > hadoop-2.6.0-cdh5.13.0-
> > > > SNAPSHOT/lib/native/libhdfs.a
> > > > > -- --> Adding thirdparty library glog. <--
> > > > > -- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/
> > > include
> > > > > -- Added static library dependency glog:
> > > > > /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
> > > > > -- --> Adding thirdparty library gflags. <--
> > > > > -- Header files: /home/bikram/dev/Impala/
> toolchain/gflags-2.2.0-p1/
> > > > include
> > > > > -- Added static library dependency gflags:
> > > > > /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
> > > > > -- --> Adding thirdparty library pprof. <--
> > > > > -- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/
> > > > include
> > > > > -- Added static library dependency pprof:
> > > > > /home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
> > > > > -- --> Adding thirdparty library gtest. <--
> > > > > -- Header files: /home/bikram/dev/Impala/
> > toolchain/gtest-1.6.0/include
> > > > > -- Added static library dependency gtest:
> > > > > 

Re: Problem running Impala built with dynamic linking

[Vincent Tran]

I ran it without -ninja and with -build_shared_libs option one time and it
got fixed. Is that the same as -so? The -help menu wasn't clear about
whether they are interchangeable or they are two opposite options.

I just ran it again with -so. It still seems to work.

On Wed, Jul 26, 2017 at 8:26 PM, Lars Volker  wrote:

> Vincent, did you build without ninja but with -so enabled? That still give
> me the same error.
>
> On Fri, Jul 21, 2017 at 12:01 PM, Vincent Tran 
> wrote:
>
> > This happened to me last evening. I turned off ninja build and did a full
> > build. Seems to have fixed it.
> > Not sure if it's the exact same root cause here though (if you don't use
> > ninja).
> >
> > On Fri, Jul 21, 2017 at 2:54 PM, Matthew Jacobs  wrote:
> >
> > > Did you ever come to a conclusion on this?
> > >
> > > On Wed, Jul 19, 2017 at 5:14 PM, Bikramjeet Vig
> > >  wrote:
> > > > Didn't work, heres the output of rm CMakeCache.txt && cmake .
> > > >
> > > >
> > > > -- Setup toolchain link flags
> > > > -Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > > > -L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > > > -- Build type is DEBUG
> > > > -- ENABLE_CODE_COVERAGE: false
> > > > -- Boost version: 1.57.0
> > > > -- Found the following Boost libraries:
> > > > --   thread
> > > > --   regex
> > > > --   filesystem
> > > > --   system
> > > > --   date_time
> > > > -- Boost include dir:
> > > > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
> > > > -- Boost libraries:
> > > > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/
> > > libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.
> > > 57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/
> > > toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/
> > > bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_
> > > system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-
> > > p3/lib/libboost_date_time.a
> > > > -- Found OpenSSL:
> > > > /usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-
> > > linux-gnu/libcrypto.so
> > > > (found version "1.0.2g")
> > > > -- --> Adding thirdparty library openssl_ssl. <--
> > > > -- Header files: /usr/include
> > > > -- Added shared library dependency openssl_ssl:
> > > > /usr/lib/x86_64-linux-gnu/libssl.so
> > > > -- --> Adding thirdparty library openssl_crypto. <--
> > > > -- Added shared library dependency openssl_crypto:
> > > > /usr/lib/x86_64-linux-gnu/libcrypto.so
> > > > -- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> > > > -- --> Adding thirdparty library bzip2. <--
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/
> > > include
> > > > -- Added static library dependency bzip2:
> > > > /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
> > > > -- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > > > -- --> Adding thirdparty library zlib. <--
> > > > -- Header files: /home/bikram/dev/Impala/
> toolchain/zlib-1.2.8/include
> > > > -- Added static library dependency zlib:
> > > > /home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
> > > > -- --> Adding thirdparty library hdfs. <--
> > > > -- Header files:
> > > > /home/bikram/dev/Impala/toolchain/cdh_components/
> > hadoop-2.6.0-cdh5.13.0-
> > > SNAPSHOT/include
> > > > -- Added static library dependency hdfs:
> > > > /home/bikram/dev/Impala/toolchain/cdh_components/
> > hadoop-2.6.0-cdh5.13.0-
> > > SNAPSHOT/lib/native/libhdfs.a
> > > > -- --> Adding thirdparty library glog. <--
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/
> > include
> > > > -- Added static library dependency glog:
> > > > /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
> > > > -- --> Adding thirdparty library gflags. <--
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/
> > > include
> > > > -- Added static library dependency gflags:
> > > > /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
> > > > -- --> Adding thirdparty library pprof. <--
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/
> > > include
> > > > -- Added static library dependency pprof:
> > > > /home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
> > > > -- --> Adding thirdparty library gtest. <--
> > > > -- Header files: /home/bikram/dev/Impala/
> toolchain/gtest-1.6.0/include
> > > > -- Added static library dependency gtest:
> > > > /home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
> > > > -- LLVM llvm-config found at:
> > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
> > > > -- LLVM clang++ found at:
> > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
> > > > -- LLVM opt found at:
> > > > 

Re: Problem running Impala built with dynamic linking

[Lars Volker]

Vincent, did you build without ninja but with -so enabled? That still give
me the same error.

On Fri, Jul 21, 2017 at 12:01 PM, Vincent Tran  wrote:

> This happened to me last evening. I turned off ninja build and did a full
> build. Seems to have fixed it.
> Not sure if it's the exact same root cause here though (if you don't use
> ninja).
>
> On Fri, Jul 21, 2017 at 2:54 PM, Matthew Jacobs  wrote:
>
> > Did you ever come to a conclusion on this?
> >
> > On Wed, Jul 19, 2017 at 5:14 PM, Bikramjeet Vig
> >  wrote:
> > > Didn't work, heres the output of rm CMakeCache.txt && cmake .
> > >
> > >
> > > -- Setup toolchain link flags
> > > -Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > > -L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > > -- Build type is DEBUG
> > > -- ENABLE_CODE_COVERAGE: false
> > > -- Boost version: 1.57.0
> > > -- Found the following Boost libraries:
> > > --   thread
> > > --   regex
> > > --   filesystem
> > > --   system
> > > --   date_time
> > > -- Boost include dir:
> > > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
> > > -- Boost libraries:
> > > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/
> > libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.
> > 57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/
> > toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/
> > bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_
> > system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-
> > p3/lib/libboost_date_time.a
> > > -- Found OpenSSL:
> > > /usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-
> > linux-gnu/libcrypto.so
> > > (found version "1.0.2g")
> > > -- --> Adding thirdparty library openssl_ssl. <--
> > > -- Header files: /usr/include
> > > -- Added shared library dependency openssl_ssl:
> > > /usr/lib/x86_64-linux-gnu/libssl.so
> > > -- --> Adding thirdparty library openssl_crypto. <--
> > > -- Added shared library dependency openssl_crypto:
> > > /usr/lib/x86_64-linux-gnu/libcrypto.so
> > > -- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> > > -- --> Adding thirdparty library bzip2. <--
> > > -- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/
> > include
> > > -- Added static library dependency bzip2:
> > > /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
> > > -- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > > -- --> Adding thirdparty library zlib. <--
> > > -- Header files: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > > -- Added static library dependency zlib:
> > > /home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
> > > -- --> Adding thirdparty library hdfs. <--
> > > -- Header files:
> > > /home/bikram/dev/Impala/toolchain/cdh_components/
> hadoop-2.6.0-cdh5.13.0-
> > SNAPSHOT/include
> > > -- Added static library dependency hdfs:
> > > /home/bikram/dev/Impala/toolchain/cdh_components/
> hadoop-2.6.0-cdh5.13.0-
> > SNAPSHOT/lib/native/libhdfs.a
> > > -- --> Adding thirdparty library glog. <--
> > > -- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/
> include
> > > -- Added static library dependency glog:
> > > /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
> > > -- --> Adding thirdparty library gflags. <--
> > > -- Header files: /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/
> > include
> > > -- Added static library dependency gflags:
> > > /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
> > > -- --> Adding thirdparty library pprof. <--
> > > -- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/
> > include
> > > -- Added static library dependency pprof:
> > > /home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
> > > -- --> Adding thirdparty library gtest. <--
> > > -- Header files: /home/bikram/dev/Impala/toolchain/gtest-1.6.0/include
> > > -- Added static library dependency gtest:
> > > /home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
> > > -- LLVM llvm-config found at:
> > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
> > > -- LLVM clang++ found at:
> > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
> > > -- LLVM opt found at:
> > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt
> > > -- LLVM_ROOT: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1
> > > -- LLVM llvm-config found at:
> > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-
> p1/bin/llvm-config
> > > -- LLVM include dir:
> > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include
> > > -- LLVM lib dir: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-
> > p1/lib
> > > -- --> Adding thirdparty library cyrus_sasl. <--
> > > -- Header files: /usr/include
> > > -- Added shared library 

Re: Problem running Impala built with dynamic linking

[Bikramjeet Vig]

Henry is looking into it. Meanwhile I am working impala statically linked.

On Fri, Jul 21, 2017 at 11:54 AM, Matthew Jacobs  wrote:

> Did you ever come to a conclusion on this?
>
> On Wed, Jul 19, 2017 at 5:14 PM, Bikramjeet Vig
>  wrote:
> > Didn't work, heres the output of rm CMakeCache.txt && cmake .
> >
> >
> > -- Setup toolchain link flags
> > -Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > -L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > -- Build type is DEBUG
> > -- ENABLE_CODE_COVERAGE: false
> > -- Boost version: 1.57.0
> > -- Found the following Boost libraries:
> > --   thread
> > --   regex
> > --   filesystem
> > --   system
> > --   date_time
> > -- Boost include dir:
> > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
> > -- Boost libraries:
> > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/
> libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.
> 57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/
> toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/
> bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_
> system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-
> p3/lib/libboost_date_time.a
> > -- Found OpenSSL:
> > /usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-
> linux-gnu/libcrypto.so
> > (found version "1.0.2g")
> > -- --> Adding thirdparty library openssl_ssl. <--
> > -- Header files: /usr/include
> > -- Added shared library dependency openssl_ssl:
> > /usr/lib/x86_64-linux-gnu/libssl.so
> > -- --> Adding thirdparty library openssl_crypto. <--
> > -- Added shared library dependency openssl_crypto:
> > /usr/lib/x86_64-linux-gnu/libcrypto.so
> > -- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> > -- --> Adding thirdparty library bzip2. <--
> > -- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/
> include
> > -- Added static library dependency bzip2:
> > /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
> > -- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > -- --> Adding thirdparty library zlib. <--
> > -- Header files: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > -- Added static library dependency zlib:
> > /home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
> > -- --> Adding thirdparty library hdfs. <--
> > -- Header files:
> > /home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-
> SNAPSHOT/include
> > -- Added static library dependency hdfs:
> > /home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-
> SNAPSHOT/lib/native/libhdfs.a
> > -- --> Adding thirdparty library glog. <--
> > -- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/include
> > -- Added static library dependency glog:
> > /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
> > -- --> Adding thirdparty library gflags. <--
> > -- Header files: /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/
> include
> > -- Added static library dependency gflags:
> > /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
> > -- --> Adding thirdparty library pprof. <--
> > -- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/
> include
> > -- Added static library dependency pprof:
> > /home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
> > -- --> Adding thirdparty library gtest. <--
> > -- Header files: /home/bikram/dev/Impala/toolchain/gtest-1.6.0/include
> > -- Added static library dependency gtest:
> > /home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
> > -- LLVM llvm-config found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
> > -- LLVM clang++ found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
> > -- LLVM opt found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt
> > -- LLVM_ROOT: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1
> > -- LLVM llvm-config found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/bin/llvm-config
> > -- LLVM include dir:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include
> > -- LLVM lib dir: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-
> p1/lib
> > -- --> Adding thirdparty library cyrus_sasl. <--
> > -- Header files: /usr/include
> > -- Added shared library dependency cyrus_sasl:
> > /usr/lib/x86_64-linux-gnu/libsasl2.so
> > -- --> Adding thirdparty library ldap. <--
> > -- Header files: /home/bikram/dev/Impala/toolchain/openldap-2.4.25/
> include
> > -- Added static library dependency ldap:
> > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/libldap.a
> > -- --> Adding thirdparty library lber. <--
> > -- Added static library dependency lber:
> > 

Re: Problem running Impala built with dynamic linking

[Matthew Jacobs]

Did you ever come to a conclusion on this?

On Wed, Jul 19, 2017 at 5:14 PM, Bikramjeet Vig
 wrote:
> Didn't work, heres the output of rm CMakeCache.txt && cmake .
>
>
> -- Setup toolchain link flags
> -Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> -L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> -- Build type is DEBUG
> -- ENABLE_CODE_COVERAGE: false
> -- Boost version: 1.57.0
> -- Found the following Boost libraries:
> --   thread
> --   regex
> --   filesystem
> --   system
> --   date_time
> -- Boost include dir:
> /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
> -- Boost libraries:
> /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_date_time.a
> -- Found OpenSSL:
> /usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-linux-gnu/libcrypto.so
> (found version "1.0.2g")
> -- --> Adding thirdparty library openssl_ssl. <--
> -- Header files: /usr/include
> -- Added shared library dependency openssl_ssl:
> /usr/lib/x86_64-linux-gnu/libssl.so
> -- --> Adding thirdparty library openssl_crypto. <--
> -- Added shared library dependency openssl_crypto:
> /usr/lib/x86_64-linux-gnu/libcrypto.so
> -- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> -- --> Adding thirdparty library bzip2. <--
> -- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> -- Added static library dependency bzip2:
> /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
> -- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> -- --> Adding thirdparty library zlib. <--
> -- Header files: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> -- Added static library dependency zlib:
> /home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
> -- --> Adding thirdparty library hdfs. <--
> -- Header files:
> /home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-SNAPSHOT/include
> -- Added static library dependency hdfs:
> /home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-SNAPSHOT/lib/native/libhdfs.a
> -- --> Adding thirdparty library glog. <--
> -- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/include
> -- Added static library dependency glog:
> /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
> -- --> Adding thirdparty library gflags. <--
> -- Header files: /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/include
> -- Added static library dependency gflags:
> /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
> -- --> Adding thirdparty library pprof. <--
> -- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/include
> -- Added static library dependency pprof:
> /home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
> -- --> Adding thirdparty library gtest. <--
> -- Header files: /home/bikram/dev/Impala/toolchain/gtest-1.6.0/include
> -- Added static library dependency gtest:
> /home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
> -- LLVM llvm-config found at:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
> -- LLVM clang++ found at:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
> -- LLVM opt found at:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt
> -- LLVM_ROOT: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1
> -- LLVM llvm-config found at:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/bin/llvm-config
> -- LLVM include dir:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include
> -- LLVM lib dir: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/lib
> -- --> Adding thirdparty library cyrus_sasl. <--
> -- Header files: /usr/include
> -- Added shared library dependency cyrus_sasl:
> /usr/lib/x86_64-linux-gnu/libsasl2.so
> -- --> Adding thirdparty library ldap. <--
> -- Header files: /home/bikram/dev/Impala/toolchain/openldap-2.4.25/include
> -- Added static library dependency ldap:
> /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/libldap.a
> -- --> Adding thirdparty library lber. <--
> -- Added static library dependency lber:
> /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/liblber.a
> -- --> Adding thirdparty library thrift. <--
> -- Header files: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/include
> -- Added static library dependency thrift:
> /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/lib/libthrift.a
> -- Thrift version: Thrift version 0.9.0
> -- Thrift contrib dir: 

Re: Problem running Impala built with dynamic linking

[Bikramjeet Vig]

Didn't work, heres the output of rm CMakeCache.txt && cmake .


-- Setup toolchain link flags
-Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
-L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
-- Build type is DEBUG
-- ENABLE_CODE_COVERAGE: false
-- Boost version: 1.57.0
-- Found the following Boost libraries:
--   thread
--   regex
--   filesystem
--   system
--   date_time
-- Boost include dir:
/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
-- Boost libraries:
/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_date_time.a
-- Found OpenSSL:
/usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-linux-gnu/libcrypto.so
(found version "1.0.2g")
-- --> Adding thirdparty library openssl_ssl. <--
-- Header files: /usr/include
-- Added shared library dependency openssl_ssl:
/usr/lib/x86_64-linux-gnu/libssl.so
-- --> Adding thirdparty library openssl_crypto. <--
-- Added shared library dependency openssl_crypto:
/usr/lib/x86_64-linux-gnu/libcrypto.so
-- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
-- --> Adding thirdparty library bzip2. <--
-- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
-- Added static library dependency bzip2:
/home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
-- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
-- --> Adding thirdparty library zlib. <--
-- Header files: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
-- Added static library dependency zlib:
/home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
-- --> Adding thirdparty library hdfs. <--
-- Header files:
/home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-SNAPSHOT/include
-- Added static library dependency hdfs:
/home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-SNAPSHOT/lib/native/libhdfs.a
-- --> Adding thirdparty library glog. <--
-- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/include
-- Added static library dependency glog:
/home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
-- --> Adding thirdparty library gflags. <--
-- Header files: /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/include
-- Added static library dependency gflags:
/home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
-- --> Adding thirdparty library pprof. <--
-- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/include
-- Added static library dependency pprof:
/home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
-- --> Adding thirdparty library gtest. <--
-- Header files: /home/bikram/dev/Impala/toolchain/gtest-1.6.0/include
-- Added static library dependency gtest:
/home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
-- LLVM llvm-config found at:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
-- LLVM clang++ found at:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
-- LLVM opt found at:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt
-- LLVM_ROOT: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1
-- LLVM llvm-config found at:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/bin/llvm-config
-- LLVM include dir:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include
-- LLVM lib dir: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/lib
-- --> Adding thirdparty library cyrus_sasl. <--
-- Header files: /usr/include
-- Added shared library dependency cyrus_sasl:
/usr/lib/x86_64-linux-gnu/libsasl2.so
-- --> Adding thirdparty library ldap. <--
-- Header files: /home/bikram/dev/Impala/toolchain/openldap-2.4.25/include
-- Added static library dependency ldap:
/home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/libldap.a
-- --> Adding thirdparty library lber. <--
-- Added static library dependency lber:
/home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/liblber.a
-- --> Adding thirdparty library thrift. <--
-- Header files: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/include
-- Added static library dependency thrift:
/home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/lib/libthrift.a
-- Thrift version: Thrift version 0.9.0
-- Thrift contrib dir: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9
-- Thrift compiler:
/home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
-- Found FLATBUFFERS:
/home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include
-- --> Adding thirdparty library flatbuffers. <--
-- Header files: 

Re: Problem running Impala built with dynamic linking

[Bikramjeet Vig]

Thanks, lemme try it real quick and I'll get back to you

On Wed, Jul 19, 2017 at 5:04 PM, Henry Robinson  wrote:

> Can you try:
>
> cd $IMPALA_HOME
> rm CMakeCache.txt
> cmake .
> 
>
> If that doesn't work, can you send me the output of rm CMakeCache.txt &&
> cmake . from IMPALA_HOME?
>
> Thanks,
> Henry
>
> On 19 July 2017 at 17:03, Henry Robinson  wrote:
>
> > Sorry, I read too quickly - you've done that already! Let me take a look.
> >
> > On 19 July 2017 at 17:01, Henry Robinson  wrote:
> >
> >> Yep, you need to remove the downloaded version of gflags and replace it
> >> with a recent toolchain version. See my mail from yesterday for
> >> instructions: https://lists.apache.org/api/source.lua/a154f4
> >> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.
> >> impala.apache.org%3E
> >>
> >> On 19 July 2017 at 16:56, Bikramjeet Vig 
> >> wrote:
> >>
> >>> After fetching latest from asf-gerrit (that has the toolchain commit
> >>> related to gflags) and doing a manual toolchain refresh, I am unable to
> >>> run
> >>> impala when I build with "make_debug" or "buildall -so", both
> statestore
> >>> and catalogd show the following error:
> >>>
> >>> ERROR: something wrong with flag 'flagfile' in file
> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> >>> gflags-2.2.0-p1/src/gflags.cc'.
> >>> One possibility: file
> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> >>> gflags-2.2.0-p1/src/gflags.cc'
> >>> is being linked both statically and dynamically into this executable.
> >>>
> >>> I am only able to make it work if I go with static linking by building
> it
> >>> with "buildall" without the "-so"
> >>>
> >>> Anyone facing the same issue?
> >>>
> >>
> >>
> >
> >
> > --
> > Henry Robinson
> > Software Engineer
> > Cloudera
> > 415-994-6679 <(415)%20994-6679>
> >
>

Re: Problem running Impala built with dynamic linking

[Henry Robinson]

Can you try:

cd $IMPALA_HOME
rm CMakeCache.txt
cmake .


If that doesn't work, can you send me the output of rm CMakeCache.txt &&
cmake . from IMPALA_HOME?

Thanks,
Henry

On 19 July 2017 at 17:03, Henry Robinson  wrote:

> Sorry, I read too quickly - you've done that already! Let me take a look.
>
> On 19 July 2017 at 17:01, Henry Robinson  wrote:
>
>> Yep, you need to remove the downloaded version of gflags and replace it
>> with a recent toolchain version. See my mail from yesterday for
>> instructions: https://lists.apache.org/api/source.lua/a154f4
>> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.
>> impala.apache.org%3E
>>
>> On 19 July 2017 at 16:56, Bikramjeet Vig 
>> wrote:
>>
>>> After fetching latest from asf-gerrit (that has the toolchain commit
>>> related to gflags) and doing a manual toolchain refresh, I am unable to
>>> run
>>> impala when I build with "make_debug" or "buildall -so", both statestore
>>> and catalogd show the following error:
>>>
>>> ERROR: something wrong with flag 'flagfile' in file
>>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
>>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
>>> gflags-2.2.0-p1/src/gflags.cc'.
>>> One possibility: file
>>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
>>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
>>> gflags-2.2.0-p1/src/gflags.cc'
>>> is being linked both statically and dynamically into this executable.
>>>
>>> I am only able to make it work if I go with static linking by building it
>>> with "buildall" without the "-so"
>>>
>>> Anyone facing the same issue?
>>>
>>
>>
>
>
> --
> Henry Robinson
> Software Engineer
> Cloudera
> 415-994-6679 <(415)%20994-6679>
>

Re: Problem running Impala built with dynamic linking

[Henry Robinson]

Sorry, I read too quickly - you've done that already! Let me take a look.

On 19 July 2017 at 17:01, Henry Robinson  wrote:

> Yep, you need to remove the downloaded version of gflags and replace it
> with a recent toolchain version. See my mail from yesterday for
> instructions: https://lists.apache.org/api/source.lua/
> a154f43ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%
> 3Cdev.impala.apache.org%3E
>
> On 19 July 2017 at 16:56, Bikramjeet Vig 
> wrote:
>
>> After fetching latest from asf-gerrit (that has the toolchain commit
>> related to gflags) and doing a manual toolchain refresh, I am unable to
>> run
>> impala when I build with "make_debug" or "buildall -so", both statestore
>> and catalogd show the following error:
>>
>> ERROR: something wrong with flag 'flagfile' in file
>> '/data/jenkins/workspace/verify-impala-toolchain-package-
>> build/label/ec2-package-ubuntu-16-04/toolchain/source/
>> gflags/gflags-2.2.0-p1/src/gflags.cc'.
>> One possibility: file
>> '/data/jenkins/workspace/verify-impala-toolchain-package-
>> build/label/ec2-package-ubuntu-16-04/toolchain/source/
>> gflags/gflags-2.2.0-p1/src/gflags.cc'
>> is being linked both statically and dynamically into this executable.
>>
>> I am only able to make it work if I go with static linking by building it
>> with "buildall" without the "-so"
>>
>> Anyone facing the same issue?
>>
>
>


-- 
Henry Robinson
Software Engineer
Cloudera
415-994-6679

Re: Problem running Impala built with dynamic linking

[Henry Robinson]

Yep, you need to remove the downloaded version of gflags and replace it
with a recent toolchain version. See my mail from yesterday for
instructions:
https://lists.apache.org/api/source.lua/a154f43ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.impala.apache.org%3E

On 19 July 2017 at 16:56, Bikramjeet Vig 
wrote:

> After fetching latest from asf-gerrit (that has the toolchain commit
> related to gflags) and doing a manual toolchain refresh, I am unable to run
> impala when I build with "make_debug" or "buildall -so", both statestore
> and catalogd show the following error:
>
> ERROR: something wrong with flag 'flagfile' in file
> '/data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-
> package-ubuntu-16-04/toolchain/source/gflags/
> gflags-2.2.0-p1/src/gflags.cc'.
> One possibility: file
> '/data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-
> package-ubuntu-16-04/toolchain/source/gflags/
> gflags-2.2.0-p1/src/gflags.cc'
> is being linked both statically and dynamically into this executable.
>
> I am only able to make it work if I go with static linking by building it
> with "buildall" without the "-so"
>
> Anyone facing the same issue?
>

Problem running Impala built with dynamic linking

[Bikramjeet Vig]

After fetching latest from asf-gerrit (that has the toolchain commit
related to gflags) and doing a manual toolchain refresh, I am unable to run
impala when I build with "make_debug" or "buildall -so", both statestore
and catalogd show the following error:

ERROR: something wrong with flag 'flagfile' in file
'/data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/gflags-2.2.0-p1/src/gflags.cc'.
One possibility: file
'/data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/gflags-2.2.0-p1/src/gflags.cc'
is being linked both statically and dynamically into this executable.

I am only able to make it work if I go with static linking by building it
with "buildall" without the "-so"

Anyone facing the same issue?