Alon Amid created ARROW-1659: -------------------------------- Summary: "stdlib.h: No such file or directory" when cross-compiling for RISC-V with GCC 7.2 Key: ARROW-1659 URL: https://issues.apache.org/jira/browse/ARROW-1659 Project: Apache Arrow Issue Type: Bug Components: C++ Environment: RISC-V, Cross-compiling for RISC-V Linux with GCC 7.2 Reporter: Alon Amid
I’ve been attempting to cross-compile Arrow for RISC-V. I was trying to build Arrow with Plasma and Python, but without the compression libraries (snappy, brotli, zstd, lz4). I was getting several errors indicating that stdlib.h is missing. An example error is: | In file included from /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot/usr/include/c++/7.2.0/ext/string_conversions.h:41:0, | from /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot/usr/include/c++/7.2.0/bits/basic_string.h:6159, | from /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot/usr/include/c++/7.2.0/string:52, | from /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot/usr/include/c++/7.2.0/stdexcept:39, | from /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot/usr/include/c++/7.2.0/array:39, | from /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot/usr/include/c++/7.2.0/tuple:39, | from /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot/usr/include/c++/7.2.0/bits/unique_ptr.h:37, | from /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot/usr/include/c++/7.2.0/memory:80, | from /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/arrow-apache-arrow-0.7.1/cpp/src/arrow/io/interfaces.h:22, | from /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/arrow-apache-arrow-0.7.1/cpp/src/arrow/python/io.h:21, | from /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/arrow-apache-arrow-0.7.1/cpp/src/arrow/python/io.cc:18: | /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot/usr/include/c++/7.2.0/cstdlib:75:15: fatal error: stdlib.h: No such file or directory | #include_next <stdlib.h> | ^~~~~~~~~~ | compilation terminated. The relevant example call is: cd /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/build/src/arrow/python && /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot-native/usr/bin/riscv64-poky-linux/riscv64-poky-linux-g++ -isystem /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot/usr/include -isystem /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/build/src/rapidjson_ep/include -isystem /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/build/flatbuffers_ep-prefix/src/flatbuffers_ep-install/include -isystem /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/arrow-apache-arrow-0.7.1/cpp/thirdparty/hadoop/include -I/home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/arrow-apache-arrow-0.7.1/cpp/src -isystem /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/numpy/core/include -isystem /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot/usr/include/python2.7 --sysroot=/home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot -O2 -pipe -g -feliminate-unused-debug-types -fdebug-prefix-map=/home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0=/usr/src/debug/apache-arrow/0.7.1-r0 -fdebug-prefix-map=/home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot-native= -fdebug-prefix-map=/home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot= -fvisibility-inlines-hidden --sysroot=/home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot -ggdb -O0 -Wall -std=c++11 -g -fPIC -std=gnu++11 -o CMakeFiles/arrow_python_objlib.dir/io.cc.o -c /home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/arrow-apache-arrow-0.7.1/cpp/src/arrow/python/io.cc When I manually checked the highlighted path (/home/centos/riscv-poky/build/tmp/work/riscv64-poky-linux/apache-arrow/0.7.1-r0/recipe-sysroot/usr/include), stdlib.h is indeed there. While googling for similar errors, I found these references: https://github.com/OpenLightingProject/ola/pull/1132, https://gcc.gnu.org/bugzilla/show_bug.cgi?id=70129 , which seem to describe a similar scenario. As can be seen in the example call, most of the include directories are included using -isystem rather than -I. When looking further into Arrow’s cmake files, this seems intentional: ./cpp/cmake_modules/ThirdpartyToolchain.cmake:include_directories(SYSTEM ${Boost_INCLUDE_DIR}) ./cpp/cmake_modules/ThirdpartyToolchain.cmake: include_directories(SYSTEM ${GTEST_INCLUDE_DIR}) ./cpp/cmake_modules/ThirdpartyToolchain.cmake: include_directories(SYSTEM ${GFLAGS_INCLUDE_DIR}) ./cpp/cmake_modules/ThirdpartyToolchain.cmake: include_directories(SYSTEM ${GBENCHMARK_INCLUDE_DIR}) ./cpp/cmake_modules/ThirdpartyToolchain.cmake: include_directories(SYSTEM ${RAPIDJSON_INCLUDE_DIR}) ./cpp/cmake_modules/ThirdpartyToolchain.cmake: include_directories(SYSTEM ${FLATBUFFERS_INCLUDE_DIR}) ./cpp/cmake_modules/ThirdpartyToolchain.cmake: include_directories(SYSTEM ${JEMALLOC_INCLUDE_DIR}) ./cpp/cmake_modules/ThirdpartyToolchain.cmake:include_directories(SYSTEM "${HADOOP_HOME}/include") ./cpp/cmake_modules/ThirdpartyToolchain.cmake: include_directories(SYSTEM ${ZLIB_INCLUDE_DIR}) ./cpp/cmake_modules/ThirdpartyToolchain.cmake: include_directories(SYSTEM ${SNAPPY_INCLUDE_DIR}) ./cpp/cmake_modules/ThirdpartyToolchain.cmake: include_directories(SYSTEM ${BROTLI_INCLUDE_DIR}) ./cpp/cmake_modules/ThirdpartyToolchain.cmake: include_directories(SYSTEM ${LZ4_INCLUDE_DIR}) ./cpp/cmake_modules/ThirdpartyToolchain.cmake: include_directories(SYSTEM ${ZSTD_INCLUDE_DIR}) ./cpp/src/arrow/gpu/CMakeLists.txt:include_directories(SYSTEM ${CUDA_INCLUDE_DIRS}) ./cpp/src/plasma/CMakeLists.txt:include_directories(SYSTEM ${PYTHON_INCLUDE_DIRS}) ./cpp/CMakeLists.txt: include_directories(SYSTEM ./python/CMakeLists.txt:include_directories(SYSTEM ./python/CMakeLists.txt:include_directories(SYSTEM ${ARROW_INCLUDE_DIR}) ./python/CMakeLists.txt: include_directories(SYSTEM ${PARQUET_INCLUDE_DIR}) ./python/CMakeLists.txt: include_directories(SYSTEM ${PLASMA_INCLUDE_DIR}) Since compiling for RISC-V requires GCC 7.2, It is likely that this is the same issue that is exposed by using GCC version 6.0 and above is the previously mentioned references (https://gcc.gnu.org/bugzilla/show_bug.cgi?id=70129 and https://github.com/OpenLightingProject/ola/pull/1132) I mitigated the issue temporarily by setting the following in cpp/CMakeLists.txt: set(CMAKE_INCLUDE_SYSTEM_FLAG_CXX "-I ") However, I think this should be done anytime GCC 6.0 or higher is used. -- This message was sent by Atlassian JIRA (v6.4.14#64029)