[
https://issues.apache.org/jira/browse/ARROW-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063040#comment-17063040
]
Frank Du commented on ARROW-8166:
---------------------------------
I tried a quick build on docker context with ubuntu:18.04 image, the build
successfully, below is the command:
sudo docker run -it -v /home/pnp/arrow/:/mnt ubuntu:18.04
apt-get update
apt-get install llvm-8 cmake build-essential clang-8 autoconf libboost-dev
libboost-filesystem-dev libboost-system-dev libboost-regex-dev libjemalloc-dev
cmake -DARROW_WITH_SNAPPY=ON \
-DARROW_GANDIVA=ON \
-DARROW_PARQUET=ON \
-DARROW_BUILD_TESTS=ON \
-DARROW_BUILD_BENCHMARKS=ON \
-DARROW_SIMD_LEVEL=AVX512 \
..
make -j16
And below is the info of GCC and LLVM:
gcc -v
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/7/lto-wrapper
OFFLOAD_TARGET_NAMES=nvptx-none
OFFLOAD_TARGET_DEFAULT=1
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu
7.5.0-3ubuntu1~18.04' --with-bugurl=file:///usr/share/doc/gcc-7/README.Bugs
--enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --prefix=/usr
--with-gcc-major-version-only --program-suffix=-7
--program-prefix=x86_64-linux-gnu- --enable-shared --enable-linker-build-id
--libexecdir=/usr/lib --without-included-gettext --enable-threads=posix
--libdir=/usr/lib --enable-nls --enable-bootstrap --enable-clocale=gnu
--enable-libstdcxx-debug --enable-libstdcxx-time=yes
--with-default-libstdcxx-abi=new --enable-gnu-unique-object
--disable-vtable-verify --enable-libmpx --enable-plugin --enable-default-pie
--with-system-zlib --with-target-system-zlib --enable-objc-gc=auto
--enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64
--with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic
--enable-offload-targets=nvptx-none --without-cuda-driver
--enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu
--target=x86_64-linux-gnu
Thread model: posix
gcc version 7.5.0 (Ubuntu 7.5.0-3ubuntu1~18.04)
clang-8 -v
clang version 8.0.0-3~ubuntu18.04.2 (tags/RELEASE_800/final)
Target: x86_64-pc-linux-gnu
Thread model: posix
InstalledDir: /usr/bin
Found candidate GCC installation: /usr/bin/../lib/gcc/x86_64-linux-gnu/7
Found candidate GCC installation: /usr/bin/../lib/gcc/x86_64-linux-gnu/7.5.0
Found candidate GCC installation: /usr/bin/../lib/gcc/x86_64-linux-gnu/8
Found candidate GCC installation: /usr/lib/gcc/x86_64-linux-gnu/7
Found candidate GCC installation: /usr/lib/gcc/x86_64-linux-gnu/7.5.0
Found candidate GCC installation: /usr/lib/gcc/x86_64-linux-gnu/8
Selected GCC installation: /usr/bin/../lib/gcc/x86_64-linux-gnu/7.5.0
Candidate multilib: .;@m64
Selected multilib: .;@m64
> [C++] AVX512 intrinsics fail to compile with clang-8 on Ubuntu 18.04
> --------------------------------------------------------------------
>
> Key: ARROW-8166
> URL: https://issues.apache.org/jira/browse/ARROW-8166
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Reporter: Wes McKinney
> Priority: Major
> Fix For: 0.17.0
>
>
> cc [~frank.du]
> I have an i9-9960X AVX512-capable CPU but I see
> {code}
> /usr/bin/ccache /usr/bin/clang++-8 -DARROW_EXTRA_ERROR_CONTEXT -DARROW_HDFS
> -DARROW_JEMALLOC -DARROW_JEMALLOC_INCLUDE_DIR="" -DARROW_NO_DEPRECATED_API
> -DARROW_USE_SIMD -DARROW_WITH_BROTLI -DARROW_WITH_BZ2 -DARROW_WITH_LZ4
> -DARROW_WITH_SNAPPY -DARROW_WITH_TIMING_TESTS -DARROW_WITH_ZLIB
> -DARROW_WITH_ZSTD -DURI_STATIC_BUILD -Isrc -I../src -I../src/generated
> -isystem ../thirdparty/flatbuffers/include -isystem
> /home/wesm/cpp-toolchain/include -isystem jemalloc_ep-prefix/src -isystem
> ../thirdparty/hadoop/include -Qunused-arguments -fcolor-diagnostics
> -fuse-ld=gold -ggdb -O0 -Wall -Wextra -Wdocumentation -Wno-missing-braces
> -Wno-unused-parameter -Wno-unknown-warning-option
> -Wno-constant-logical-operand -Werror -Wno-unknown-warning-option
> -march=skylake-avx512 -maltivec -fno-omit-frame-pointer -g -fPIE -pthread
> -std=gnu++11 -MD -MT
> src/arrow/util/CMakeFiles/arrow-utility-test.dir/rle_encoding_test.cc.o -MF
> src/arrow/util/CMakeFiles/arrow-utility-test.dir/rle_encoding_test.cc.o.d -o
> src/arrow/util/CMakeFiles/arrow-utility-test.dir/rle_encoding_test.cc.o -c
> ../src/arrow/util/rle_encoding_test.cc
> In file included from ../src/arrow/util/rle_encoding_test.cc:33:
> In file included from ../src/arrow/util/bit_stream_utils.h:28:
> ../src/arrow/util/bpacking.h:49:5: error: use of undeclared identifier
> '__m512i_u'
> *(__m512i_u*)out = _mm512_and_epi32(_mm512_srlv_epi32(inls, shifts), masks);
> ^
> ../src/arrow/util/bpacking.h:49:15: error: expected expression
> *(__m512i_u*)out = _mm512_and_epi32(_mm512_srlv_epi32(inls, shifts), masks);
> ^
> ../src/arrow/util/bpacking.h:55:5: error: use of undeclared identifier
> '__m512i_u'
> *(__m512i_u*)out = _mm512_and_epi32(_mm512_srlv_epi32(inls, shifts), masks);
> ^
> ../src/arrow/util/bpacking.h:55:15: error: expected expression
> *(__m512i_u*)out = _mm512_and_epi32(_mm512_srlv_epi32(inls, shifts), masks);
> ^
> 4 errors generated.
> {code}
> I tried compiling with gcc 8.3 instead of clang-8 and it worked. So it seems
> that because the base gcc toolchain on Ubuntu 18.04 is gcc 7.x that the
> clang-* versions are using the gcc-7 toolchain headers. Evidently we will
> need to make this more robust
--
This message was sent by Atlassian Jira
(v8.3.4#803005)