Thanks for letting us know. If there are any improvements we can make to the developer documentation, please feel free to open a JIRA or a pull request to fix
On Mon, Sep 30, 2019 at 8:13 AM Tarek Allam Jr. <t.allam...@gmail.com> wrote: > > > Hi Wes, > > Thank you very much, that indeed fixed things and allowed me to complete a > build. > > After running conda install --file ci/conda_env_cpp.yml I was able to get > passed > the above error, but then was faced with the error message akin to that found > at > https://issues.apache.org/jira/browse/ARROW-4935 > > But this was easily solved with running the suggested solution of > > $ cd /Library/Developer/CommandLineTools/Packages/ > $ open macOS_SDK_headers_for_macOS_10.14.pkg > > (Just putting links to the errors/issues for my reference) > > Thanks again for your help getting me started. I'll now go in search of > possible > areas of where I can contribute! > > Cheers, > Tarek > > > On 2019/09/26 19:23:08, Wes McKinney <wesmck...@gmail.com> wrote: > > It looks like the development toolchain dependencies in > > conda_env_cpp.yml aren't installed in your "main" conda environment, > > e.g. > > > > https://github.com/apache/arrow/blob/master/ci/conda_env_cpp.yml#L42 > > > > You can see what's installed by running "conda list" > > > > Note that most of these dependencies are optional, but we provide the > > env files to simplify general development of the project so > > contributors aren't struggling to produce comprehensive builds. > > > > On Wed, Sep 25, 2019 at 11:33 AM Tarek Allam Jr. <t.allam...@gmail.com> > > wrote: > > > > > > Thanks for the advice Uwe and Neal. I tried your suggestion (as well as > > > turning many of the flags to off) but then ran into other errors > > > afterwards such as: > > > > > > -- Using ZSTD_ROOT: /usr/local/anaconda3/envs/main > > > CMake Error at > > > /usr/local/Cellar/cmake/3.15.3/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:137 > > > (message): > > > Could NOT find ZSTD (missing: ZSTD_LIB ZSTD_INCLUDE_DIR) > > > > > > /usr/local/Cellar/cmake/3.15.3/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:378 > > > (_FPHSA_FAILURE_MESSAGE) > > > cmake_modules/FindZSTD.cmake:61 (find_package_handle_standard_args) > > > cmake_modules/ThirdpartyToolchain.cmake:181 (find_package) > > > cmake_modules/ThirdpartyToolchain.cmake:2033 (resolve_dependency) > > > CMakeLists.txt:412 (include) > > > > > > I think I will spend some more time to understand CMAKE better and > > > familiarise myself with the codebase more before having another go. > > > Hopefully in this time conda-forge would have removed the SDK requirement > > > as well which like you say should make things much more similar. > > > > > > Thanks again, > > > > > > Regards, > > > Tarek > > > > > > On 2019/09/19 16:00:09, "Uwe L. Korn" <uw...@xhochy.com> wrote: > > > > Hello Tarek, > > > > > > > > this error message is normally the one you get when CONDA_BUILD_SYSROOT > > > > doesn't point to your 10.9 SDK. Please delete your build folder again > > > > and do `export CONDA_BUILD_SYSROOT=..` immediately before running > > > > cmake. Running e.g. a conda install will sadly reset this variable to > > > > something different and break the build. > > > > > > > > As a sidenote: It looks like in 1-2 months that conda-forge will get > > > > rid of the SDK requirement, then this will be a bit simpler. > > > > > > > > Cheers > > > > Uwe > > > > > > > > On Thu, Sep 19, 2019, at 5:24 PM, Tarek Allam Jr. wrote: > > > > > > > > > > Hi all, > > > > > > > > > > Firstly I must apologies if what I put here is extremely trivial, but > > > > > I am a > > > > > complete newcomer to the Apache Arrow project and contributing to > > > > > Apache in > > > > > general, but I am very keen to get involved. > > > > > > > > > > I'm hoping to help where I can so I recently attempted to complete a > > > > > build > > > > > following the instructions laid out in the 'Python Development' > > > > > section of the > > > > > documentation here: > > > > > > > > > > After completing the steps that specifically uses Conda I was able to > > > > > create an > > > > > environment but when it comes to building I am unable to do so. > > > > > > > > > > I am on macOS -- 10.14.6 and as outlined in the docs and here > > > > > (https://stackoverflow.com/a/55798942/4521950) I used use 10.9.sdk > > > > > instead > > > > > of the latest. I have both added this manually using ccmake and also > > > > > defining it > > > > > like so: > > > > > > > > > > cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \ > > > > > -DCMAKE_INSTALL_LIBDIR=lib \ > > > > > -DARROW_FLIGHT=ON \ > > > > > -DARROW_GANDIVA=ON \ > > > > > -DARROW_ORC=ON \ > > > > > -DARROW_PARQUET=ON \ > > > > > -DARROW_PYTHON=ON \ > > > > > -DARROW_PLASMA=ON \ > > > > > -DARROW_BUILD_TESTS=ON \ > > > > > -DCONDA_BUILD_SYSROOT=/opt/MacOSX10.9.sdk \ > > > > > -DARROW_DEPENDENCY_SOURCE=AUTO \ > > > > > .. > > > > > > > > > > But it seems that whatever I try, I seem to get errors, the main only > > > > > tripping > > > > > me up at the moment is: > > > > > > > > > > -- Building using CMake version: 3.15.3 > > > > > -- The C compiler identification is Clang 4.0.1 > > > > > -- The CXX compiler identification is Clang 4.0.1 > > > > > -- Check for working C compiler: > > > > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang > > > > > -- Check for working C compiler: > > > > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -- broken > > > > > CMake Error at > > > > > /usr/local/anaconda3/envs/pyarrow-dev/share/cmake-3.15/Modules/CMakeTestCCompiler.cmake:60 > > > > > (message): > > > > > The C compiler > > > > > > > > > > "/usr/local/anaconda3/envs/pyarrow-dev/bin/clang" > > > > > > > > > > is not able to compile a simple test program. > > > > > > > > > > It fails with the following output: > > > > > > > > > > Change Dir: > > > > > /Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp > > > > > > > > > > Run Build Command(s):/usr/local/bin/gmake cmTC_b252c/fast && > > > > > /usr/local/bin/gmake -f CMakeFiles/cmTC_b252c.dir/build.make > > > > > CMakeFiles/cmTC_b252c.dir/build > > > > > gmake[1]: Entering directory > > > > > '/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp' > > > > > Building C object CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o > > > > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -march=core2 > > > > > -mtune=haswell -mssse3 -ftree-vectorize -fPIC -fPIE > > > > > -fstack-protector-strong -O2 -pipe -isysroot /opt/MacOSX10.9.sdk -o > > > > > CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o -c > > > > > /Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp/testCCompiler.c > > > > > Linking C executable cmTC_b252c > > > > > /usr/local/anaconda3/envs/pyarrow-dev/bin/cmake -E > > > > > cmake_link_script CMakeFiles/cmTC_b252c.dir/link.txt --verbose=1 > > > > > /usr/local/anaconda3/envs/pyarrow-dev/bin/clang -march=core2 > > > > > -mtune=haswell -mssse3 -ftree-vectorize -fPIC -fPIE > > > > > -fstack-protector-strong -O2 -pipe -isysroot /opt/MacOSX10.9.sdk > > > > > -Wl,-search_paths_first -Wl,-headerpad_max_install_names -Wl,-pie > > > > > -Wl,-headerpad_max_install_names -Wl,-dead_strip_dylibs > > > > > CMakeFiles/cmTC_b252c.dir/testCCompiler.c.o -o cmTC_b252c > > > > > ld: warning: ignoring file > > > > > /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/lib/libSystem.tbd, > > > > > file was built for unsupported file format ( 0x2D 0x2D 0x2D 0x20 > > > > > 0x21 0x74 0x61 0x70 0x69 0x2D 0x74 0x62 0x64 0x2D 0x76 0x33 ) which > > > > > is not the architecture being linked (x86_64): > > > > > /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/lib/libSystem.tbd > > > > > ld: dynamic main executables must link with libSystem.dylib for > > > > > architecture x86_64 > > > > > clang-4.0: error: linker command failed with exit code 1 (use -v > > > > > to > > > > > see invocation) > > > > > gmake[1]: *** [CMakeFiles/cmTC_b252c.dir/build.make:87: > > > > > cmTC_b252c] > > > > > Error 1 > > > > > gmake[1]: Leaving directory > > > > > '/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeTmp' > > > > > gmake: *** [Makefile:121: cmTC_b252c/fast] Error 2 > > > > > > > > > > > > > > > CMake will not be able to correctly generate this project. > > > > > Call Stack (most recent call first): > > > > > CMakeLists.txt:32 (project) > > > > > > > > > > -- Configuring incomplete, errors occurred! > > > > > See also > > > > > "/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeOutput.log". > > > > > See also > > > > > "/Users/tallamjr/Github/arrow/cpp/build/CMakeFiles/CMakeError.log". > > > > > > > > > > Does anyone have any insight as to what might be happening and > > > > > causing this to > > > > > fail. I notice that eventhough I set to CONDA_BUILD_SYSROOT to > > > > > /opt/MacOSX10.9.sdk I also see that ld is looking in MacOSX10.14.sdk, > > > > > I assume > > > > > that is not right.. > > > > > > > > > > I have tried to compare steps with ones outlined in > > > > > https://lists.apache.org/list.html?dev@arrow.apache.org:2019-8 and in > > > > > other > > > > > corners of the internet but I feel very stuck at the moment. > > > > > > > > > > Any help would be greatly appreciated! Thank you > > > > > > > > > > > > > > > >