Re: Python development setup and LLVM 7 / Gandiva
Hello John, I guess you also have some other llvm-* packages installed on OSX. We currently have the problem that they override each other on OSX: https://github.com/conda-forge/llvmdev-feedstock/issues/60 The compilers shipped by conda-forge on OSX use llvm=4.0.1 and thus this is also installed at the same time. Uwe On Thu, May 23, 2019, at 9:31 PM, John Muehlhausen wrote: > Not sure why cmake isn't happy (as in original post). Environment is set > up as per instructions: > > (pyarrow-dev) JGM-KTG-Mac-Mini:python jmuehlhausen$ conda list llvmdev > # packages in environment at > /Users/jmuehlhausen/miniconda3/envs/pyarrow-dev: > # > # NameVersion Build Channel > llvmdev 7.0.0 h04f5b5a_1000conda-forge > > On Thu, May 23, 2019 at 1:46 PM Wes McKinney wrote: > > > llvmdev=7 is in the conda_env_cpp.yml requirements file, are you using > > something else? > > > > https://github.com/apache/arrow/blob/master/ci/conda_env_cpp.yml#L31 > > > > On Thu, May 23, 2019 at 12:53 PM John Muehlhausen wrote: > > > > > > The pyarrow-dev conda environment does not include llvm 7, which appears > > to > > > be a requirement for Gandiva. > > > > > > So I'm just trying to figure out a pain-free way to add llvm 7 in a way > > > that cmake can find it, for Mac. > > > > > > I had already solved the other Mac problem with > > > export CONDA_BUILD_SYSROOT=/Users/jmuehlhausen/sdks/MacOSX10.9.sdk > > > > > > On Wed, May 22, 2019 at 1:46 PM Wes McKinney > > wrote: > > > > > > > hi John, > > > > > > > > Some changes were just made to address the issue you are having, see > > > > the latest instructions at > > > > > > > > > > > > > > https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst > > > > > > > > Let us know if that does not work. > > > > > > > > - Wes > > > > > > > > On Wed, May 22, 2019 at 11:02 AM John Muehlhausen wrote: > > > > > > > > > > Set up pyarrow-dev conda environment as at > > > > > https://arrow.apache.org/docs/developers/python.html > > > > > > > > > > Got the following error. I will disable Gandiva for now but I'd > > like to > > > > > get it back at some point. I'm on Mac OS 10.13.6. > > > > > > > > > > CMake Error at cmake_modules/FindLLVM.cmake:33 (find_package): > > > > > Could not find a configuration file for package "LLVM" that is > > > > compatible > > > > > with requested version "7.0". > > > > > > > > > > The following configuration files were considered but not accepted: > > > > > > > > > > > > > > > > > > > > > /Users/jmuehlhausen/miniconda3/envs/pyarrow-dev/lib/cmake/llvm/LLVMConfig.cmake, > > > > > version: 4.0.1 > > > > > > > > > > > > > > > > /Users/jmuehlhausen/miniconda3/envs/pyarrow-dev/lib/cmake/llvm/llvm-config.cmake, > > > > > version: unknown > > > > > > > > > > Call Stack (most recent call first): > > > > > src/gandiva/CMakeLists.txt:31 (find_package) > > > > > > >
Re: Python development setup and LLVM 7 / Gandiva
Not sure why cmake isn't happy (as in original post). Environment is set up as per instructions: (pyarrow-dev) JGM-KTG-Mac-Mini:python jmuehlhausen$ conda list llvmdev # packages in environment at /Users/jmuehlhausen/miniconda3/envs/pyarrow-dev: # # NameVersion Build Channel llvmdev 7.0.0 h04f5b5a_1000conda-forge On Thu, May 23, 2019 at 1:46 PM Wes McKinney wrote: > llvmdev=7 is in the conda_env_cpp.yml requirements file, are you using > something else? > > https://github.com/apache/arrow/blob/master/ci/conda_env_cpp.yml#L31 > > On Thu, May 23, 2019 at 12:53 PM John Muehlhausen wrote: > > > > The pyarrow-dev conda environment does not include llvm 7, which appears > to > > be a requirement for Gandiva. > > > > So I'm just trying to figure out a pain-free way to add llvm 7 in a way > > that cmake can find it, for Mac. > > > > I had already solved the other Mac problem with > > export CONDA_BUILD_SYSROOT=/Users/jmuehlhausen/sdks/MacOSX10.9.sdk > > > > On Wed, May 22, 2019 at 1:46 PM Wes McKinney > wrote: > > > > > hi John, > > > > > > Some changes were just made to address the issue you are having, see > > > the latest instructions at > > > > > > > > > > https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst > > > > > > Let us know if that does not work. > > > > > > - Wes > > > > > > On Wed, May 22, 2019 at 11:02 AM John Muehlhausen wrote: > > > > > > > > Set up pyarrow-dev conda environment as at > > > > https://arrow.apache.org/docs/developers/python.html > > > > > > > > Got the following error. I will disable Gandiva for now but I'd > like to > > > > get it back at some point. I'm on Mac OS 10.13.6. > > > > > > > > CMake Error at cmake_modules/FindLLVM.cmake:33 (find_package): > > > > Could not find a configuration file for package "LLVM" that is > > > compatible > > > > with requested version "7.0". > > > > > > > > The following configuration files were considered but not accepted: > > > > > > > > > > > > > > > > /Users/jmuehlhausen/miniconda3/envs/pyarrow-dev/lib/cmake/llvm/LLVMConfig.cmake, > > > > version: 4.0.1 > > > > > > > > > > > > /Users/jmuehlhausen/miniconda3/envs/pyarrow-dev/lib/cmake/llvm/llvm-config.cmake, > > > > version: unknown > > > > > > > > Call Stack (most recent call first): > > > > src/gandiva/CMakeLists.txt:31 (find_package) > > > >
Re: Python development setup and LLVM 7 / Gandiva
llvmdev=7 is in the conda_env_cpp.yml requirements file, are you using something else? https://github.com/apache/arrow/blob/master/ci/conda_env_cpp.yml#L31 On Thu, May 23, 2019 at 12:53 PM John Muehlhausen wrote: > > The pyarrow-dev conda environment does not include llvm 7, which appears to > be a requirement for Gandiva. > > So I'm just trying to figure out a pain-free way to add llvm 7 in a way > that cmake can find it, for Mac. > > I had already solved the other Mac problem with > export CONDA_BUILD_SYSROOT=/Users/jmuehlhausen/sdks/MacOSX10.9.sdk > > On Wed, May 22, 2019 at 1:46 PM Wes McKinney wrote: > > > hi John, > > > > Some changes were just made to address the issue you are having, see > > the latest instructions at > > > > > > https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst > > > > Let us know if that does not work. > > > > - Wes > > > > On Wed, May 22, 2019 at 11:02 AM John Muehlhausen wrote: > > > > > > Set up pyarrow-dev conda environment as at > > > https://arrow.apache.org/docs/developers/python.html > > > > > > Got the following error. I will disable Gandiva for now but I'd like to > > > get it back at some point. I'm on Mac OS 10.13.6. > > > > > > CMake Error at cmake_modules/FindLLVM.cmake:33 (find_package): > > > Could not find a configuration file for package "LLVM" that is > > compatible > > > with requested version "7.0". > > > > > > The following configuration files were considered but not accepted: > > > > > > > > > > > /Users/jmuehlhausen/miniconda3/envs/pyarrow-dev/lib/cmake/llvm/LLVMConfig.cmake, > > > version: 4.0.1 > > > > > > > > /Users/jmuehlhausen/miniconda3/envs/pyarrow-dev/lib/cmake/llvm/llvm-config.cmake, > > > version: unknown > > > > > > Call Stack (most recent call first): > > > src/gandiva/CMakeLists.txt:31 (find_package) > >
Re: Python development setup and LLVM 7 / Gandiva
The pyarrow-dev conda environment does not include llvm 7, which appears to be a requirement for Gandiva. So I'm just trying to figure out a pain-free way to add llvm 7 in a way that cmake can find it, for Mac. I had already solved the other Mac problem with export CONDA_BUILD_SYSROOT=/Users/jmuehlhausen/sdks/MacOSX10.9.sdk On Wed, May 22, 2019 at 1:46 PM Wes McKinney wrote: > hi John, > > Some changes were just made to address the issue you are having, see > the latest instructions at > > > https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst > > Let us know if that does not work. > > - Wes > > On Wed, May 22, 2019 at 11:02 AM John Muehlhausen wrote: > > > > Set up pyarrow-dev conda environment as at > > https://arrow.apache.org/docs/developers/python.html > > > > Got the following error. I will disable Gandiva for now but I'd like to > > get it back at some point. I'm on Mac OS 10.13.6. > > > > CMake Error at cmake_modules/FindLLVM.cmake:33 (find_package): > > Could not find a configuration file for package "LLVM" that is > compatible > > with requested version "7.0". > > > > The following configuration files were considered but not accepted: > > > > > > > /Users/jmuehlhausen/miniconda3/envs/pyarrow-dev/lib/cmake/llvm/LLVMConfig.cmake, > > version: 4.0.1 > > > > > /Users/jmuehlhausen/miniconda3/envs/pyarrow-dev/lib/cmake/llvm/llvm-config.cmake, > > version: unknown > > > > Call Stack (most recent call first): > > src/gandiva/CMakeLists.txt:31 (find_package) >
Re: Python development setup and LLVM 7 / Gandiva
hi John, Some changes were just made to address the issue you are having, see the latest instructions at https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst Let us know if that does not work. - Wes On Wed, May 22, 2019 at 11:02 AM John Muehlhausen wrote: > > Set up pyarrow-dev conda environment as at > https://arrow.apache.org/docs/developers/python.html > > Got the following error. I will disable Gandiva for now but I'd like to > get it back at some point. I'm on Mac OS 10.13.6. > > CMake Error at cmake_modules/FindLLVM.cmake:33 (find_package): > Could not find a configuration file for package "LLVM" that is compatible > with requested version "7.0". > > The following configuration files were considered but not accepted: > > > /Users/jmuehlhausen/miniconda3/envs/pyarrow-dev/lib/cmake/llvm/LLVMConfig.cmake, > version: 4.0.1 > > /Users/jmuehlhausen/miniconda3/envs/pyarrow-dev/lib/cmake/llvm/llvm-config.cmake, > version: unknown > > Call Stack (most recent call first): > src/gandiva/CMakeLists.txt:31 (find_package)
Re: Python development setup and LLVM 7 / Gandiva
Since you seem to be using conda on macOS, I'll point you to this recent addition to the pyarrow dev docs (which has not been deployed to arrow.apache.org/docs): https://github.com/nealrichardson/arrow/blob/master/docs/source/developers/python.rst#using-conda Not sure if that's what's causing your issue, but thought it might be worth mention since it's not formally published yet. Neal On Wed, May 22, 2019 at 9:02 AM John Muehlhausen wrote: > Set up pyarrow-dev conda environment as at > https://arrow.apache.org/docs/developers/python.html > > Got the following error. I will disable Gandiva for now but I'd like to > get it back at some point. I'm on Mac OS 10.13.6. > > CMake Error at cmake_modules/FindLLVM.cmake:33 (find_package): > Could not find a configuration file for package "LLVM" that is compatible > with requested version "7.0". > > The following configuration files were considered but not accepted: > > > > /Users/jmuehlhausen/miniconda3/envs/pyarrow-dev/lib/cmake/llvm/LLVMConfig.cmake, > version: 4.0.1 > > > /Users/jmuehlhausen/miniconda3/envs/pyarrow-dev/lib/cmake/llvm/llvm-config.cmake, > version: unknown > > Call Stack (most recent call first): > src/gandiva/CMakeLists.txt:31 (find_package) >
