[jira] [Comment Edited] (ARROW-17374) [R] R Arrow install fails with SNAPPY_LIB-NOTFOUND

2022-11-22 Thread Arjan van der Velde (Jira)


[ 
https://issues.apache.org/jira/browse/ARROW-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17637494#comment-17637494
 ] 

Arjan van der Velde edited comment on ARROW-17374 at 11/22/22 10:57 PM:


I have a conda environment file. I haven't stripped it down to the minimum 
requirements for arrow but it illustrates the issue. The issue happens on a 
linux (centos) install and not on macOS where it seems to be using imported 
libraries from brew.

[^environment.yml]

 
{code:java}
# Set up conda environment and activate
conda env create -n testme -f environment.yml
conda activate testme

# Build required 'decor' which doesn't exist in any conda repo
R -e 'install.packages("decor", repos="http://cran.us.r-project.org;)'
# Build arrow
mkdir -p /tmp/git && \
  cd /tmp/git && git clone 'https://github.com/apache/arrow' arrow &&
  cd /tmp/git/arrow/r && \
  ARROW_S3=OFF LIBARROW_MINIMAL=FALSE ARROW_R_DEV=TRUE R CMD INSTALL . {code}
 

The build fails with:
{noformat}
_JSON -DARROW_R_WITH_GCS 
-I'/home/username/miniconda3/envs/testme/lib/R/library/cpp11/include' -DNDEBUG 
-D_FORTIFY_SOURCE=2 -O2 -isystem /home/username/miniconda3/envs/testme/include 
-I/home/username/miniconda3/envs/testme/include 
-Wl,-rpath-link,/home/username/miniconda3/envs/testme/lib   -fpic  
-fvisibility-inlines-hidden  -fmessage-length=0 -march=nocona -mtune=haswell 
-ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 
-ffunction-sections -pipe -isystem 
/home/username/miniconda3/envs/testme/include 
-fdebug-prefix-map=/home/conda/feedstock_root/build_artifacts/r-base-split_1665472261643/work=/usr/local/src/conda/r-base-4.1.3
 
-fdebug-prefix-map=/home/username/miniconda3/envs/testme=/usr/local/src/conda-prefix
  -c type_infer.cpp -o type_infer.ox86_64-conda-linux-gnu-c++ -std=gnu++17 
-shared -L/home/username/miniconda3/envs/testme/lib/R/lib -Wl,-O2 
-Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now 
-Wl,--disable-new-dtags -Wl,--gc-sections -Wl,--allow-shlib-undefined 
-Wl,-rpath,/home/username/miniconda3/envs/testme/lib 
-Wl,-rpath-link,/home/username/miniconda3/envs/testme/lib 
-L/home/username/miniconda3/envs/testme/lib -o arrow.so RTasks.o altrep.o 
array.o array_to_vector.o arraydata.o arrowExports.o bridge.o buffer.o 
chunkedarray.o compression.o compute-exec.o compute.o config.o csv.o dataset.o 
datatype.o expression.o extension-impl.o feather.o field.o filesystem.o 
imports.o io.o json.o memorypool.o message.o parquet.o r_to_arrow.o 
recordbatch.o recordbatchreader.o recordbatchwriter.o safe-call-into-r-impl.o 
scalar.o schema.o symbols.o table.o threadpool.o type_infer.o 
-L/tmp/git/arrow/r/libarrow/arrow-10.0.0.9000/lib -larrow_dataset -lparquet 
-Llibarrow/arrow-10.0.0.9000/lib -L/home/username/miniconda3/envs/testme/lib 
-larrow SNAPPY_LIB-NOTFOUND 
/home/username/miniconda3/envs/testme/lib/libre2.so.9.0.0 /usr/lib64/libbz2.so 
-pthread -larrow_bundled_dependencies -lbrotlidec -lbrotlienc -lbrotlicommon 
-lthrift -lz -llz4 -lzstd -lutf8proc -larrow -larrow_bundled_dependencies 
-larrow_dataset -lparquet -lssl -lcrypto -lcurl 
-L/home/username/miniconda3/envs/testme/lib/R/lib -lR
/home/username/miniconda3/envs/testme/bin/../lib/gcc/x86_64-conda-linux-gnu/12.2.0/../../../../x86_64-conda-linux-gnu/bin/ld:
 cannot find SNAPPY_LIB-NOTFOUND: No such file or directory
collect2: error: ld returned 1 exit status
make: *** [/home/username/miniconda3/envs/testme/lib/R/share/make/shlib.mk:10: 
arrow.so] Error 1
ERROR: compilation failed for package ‘arrow’
* removing ‘/home/username/miniconda3/envs/testme/lib/R/library/arrow’
* restoring previous 
‘/home/username/miniconda3/envs/testme/lib/R/library/arrow’{noformat}


was (Author: JIRAUSER297783):
I have a conda environment file. I haven't stripped it down to the minimum 
requirements for arrow but it illustrates the issue. The issue happens on a 
linux (centos) install and not on macOS where it seems to be using imported 
libraries from brew.

[^environment.yml]

 
{code:java}
# Set up conda environment and activate
conda env create -n testme -f environment.yml
conda activate testme

# Build required 'decor' which doesn't exist in any conda repo
R -e 'install.packages("decor", repos="http://cran.us.r-project.org;)'
# Build arrow
mkdir -p /tmp/git && \
  cd /tmp/git && git clone 'https://github.com/apache/arrow' arrow &&
  cd /tmp/git/arrow/r && \
  ARROW_S3=OFF LIBARROW_MINIMAL=FALSE ARROW_R_DEV=TRUE R CMD INSTALL . {code}
 

The build fails with:
{noformat}
_JSON -DARROW_R_WITH_GCS 
-I'/home/username/miniconda3/envs/testme/lib/R/library/cpp11/include' -DNDEBUG 
-D_FORTIFY_SOURCE=2 -O2 -isystem /home/username/miniconda3/envs/testme/include 
-I/home/username/miniconda3/envs/testme/include 
-Wl,-rpath-link,/home/username/miniconda3/envs/testme/lib   -fpic  
-fvisibility-inlines-hidden  -fmessage-length=0 -march=nocona -mtune=haswell 
-ftree-vectorize -fPIC 

[jira] [Comment Edited] (ARROW-17374) [R] R Arrow install fails with SNAPPY_LIB-NOTFOUND

2022-11-22 Thread Arjan van der Velde (Jira)


[ 
https://issues.apache.org/jira/browse/ARROW-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17637494#comment-17637494
 ] 

Arjan van der Velde edited comment on ARROW-17374 at 11/22/22 10:56 PM:


I have a conda environment file. I haven't stripped it down to the minimum 
requirements for arrow but it illustrates the issue. The issue happens on a 
linux (centos) install and not on macOS where it seems to be using imported 
libraries from brew.

[^environment.yml]

 
{code:java}
# Set up conda environment and activate
conda env create -n testme -f environment.yml
conda activate testme

# Build required 'decor' which doesn't exist in any conda repo
R -e 'install.packages("decor", repos="http://cran.us.r-project.org;)'
# Build arrow
mkdir -p /tmp/git && \
  cd /tmp/git && git clone 'https://github.com/apache/arrow' arrow &&
  cd /tmp/git/arrow/r && \
  ARROW_S3=OFF LIBARROW_MINIMAL=FALSE ARROW_R_DEV=TRUE R CMD INSTALL . {code}
 

The build fails with:
{noformat}
.._JSON DARROW_R_WITH_GCS 
-I'/home/username/miniconda3/envs/testme/lib/R/library/cpp11/include' -DNDEBUG 
-D_FORTIFY_SOURCE=2 -O2 -isystem /home/username/miniconda3/envs/testme/include 
-I/home/username/miniconda3/envs/testme/include 
-Wl,-rpath-link,/home/username/miniconda3/envs/testme/lib   -fpic  
-fvisibility-inlines-hidden  -fmessage-length=0 -march=nocona -mtune=haswell 
-ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 
-ffunction-sections -pipe -isystem 
/home/username/miniconda3/envs/testme/include 
-fdebug-prefix-map=/home/conda/feedstock_root/build_artifacts/r-base-split_1665472261643/work=/usr/local/src/conda/r-base-4.1.3
 
-fdebug-prefix-map=/home/username/miniconda3/envs/testme=/usr/local/src/conda-prefix
  -c type_infer.cpp -o type_infer.ox86_64-conda-linux-gnu-c++ -std=gnu++17 
-shared -L/home/username/miniconda3/envs/testme/lib/R/lib -Wl,-O2 
-Wl,sort-common -Wl,as-needed -Wl,-z,relro -Wl,-z,now -Wl,disable-new-dtags 
-Wl,gc-sections -Wl,-allow-shlib-undefined 
-Wl,-rpath,/home/username/miniconda3/envs/testme/lib 
-Wl,-rpath-link,/home/username/miniconda3/envs/testme/lib 
-L/home/username/miniconda3/envs/testme/lib -o arrow.so RTasks.o altrep.o 
array.o array_to_vector.o arraydata.o arrowExports.o bridge.o buffer.o 
chunkedarray.o compression.o compute-exec.o compute.o config.o csv.o dataset.o 
datatype.o expression.o extension-impl.o feather.o field.o filesystem.o 
imports.o io.o json.o memorypool.o message.o parquet.o r_to_arrow.o 
recordbatch.o recordbatchreader.o recordbatchwriter.o safe-call-into-r-impl.o 
scalar.o schema.o symbols.o table.o threadpool.o type_infer.o 
-L/tmp/git/arrow/r/libarrow/arrow-10.0.0.9000/lib -larrow_dataset -lparquet 
-Llibarrow/arrow-10.0.0.9000/lib -L/home/username/miniconda3/envs/testme/lib 
-larrow SNAPPY_LIB-NOTFOUND 
/home/username/miniconda3/envs/testme/lib/libre2.so.9.0.0 /usr/lib64/libbz2.so 
-pthread -larrow_bundled_dependencies -lbrotlidec -lbrotlienc -lbrotlicommon 
-lthrift -lz -llz4 -lzstd -lutf8proc -larrow -larrow_bundled_dependencies 
-larrow_dataset -lparquet -lssl -lcrypto -lcurl 
-L/home/username/miniconda3/envs/testme/lib/R/lib 
-lR/home/username/miniconda3/envs/testme/bin/../lib/gcc/x86_64-conda-linux-gnu/12.2.0/../../../../x86_64-conda-linux-gnu/bin/ld:
 cannot find SNAPPY_LIB-NOTFOUND: No such file or directory collect2: error: ld 
returned 1 exit status make: *** 
[/home/username/miniconda3/envs/testme/lib/R/share/make/shlib.mk:10: arrow.so] 
Error 1 ERROR: compilation failed for package ‘arrow’ * removing 
‘/home/username/miniconda3/envs/testme/lib/R/library/arrow’ * restoring 
previous ‘/home/username/miniconda3/envs/testme/lib/R/library/arrow’
 {noformat}


was (Author: JIRAUSER297783):
I have a conda environment file. I haven't stripped it down to the minimum 
requirements for arrow but it illustrates the issue. The issue happens on a 
linux (centos) install and not on macOS where it seems to be using imported 
libraries from brew.

[^environment.yml]

 
{code:java}
# Set up conda environment and activate
conda env create -n testme -f environment.yml
conda activate testme

# Build required 'decor' which doesn't exist in any conda repo
R -e 'install.packages("decor", repos="http://cran.us.r-project.org;)'
# Build arrow
mkdir -p /tmp/git && \
  cd /tmp/git && git clone 'https://github.com/apache/arrow' arrow &&
  cd /tmp/git/arrow/r && \
  ARROW_S3=OFF LIBARROW_MINIMAL=FALSE ARROW_R_DEV=TRUE R CMD INSTALL . {code}
 

The build fails with:

..

.._JSON -DARROW_R_WITH_GCS 
-I'/home/username/miniconda3/envs/testme/lib/R/library/cpp11/include' -DNDEBUG 
-D_FORTIFY_SOURCE=2 -O2 -isystem /home/username/miniconda3/envs/testme/include 
-I/home/username/miniconda3/envs/testme/include 
-Wl,-rpath-link,/home/username/miniconda3/envs/testme/lib   -fpic  
-fvisibility-inlines-hidden  -fmessage-length=0 -march=nocona -mtune=haswell 
-ftree-vectorize -fPIC 

[jira] [Comment Edited] (ARROW-17374) [R] R Arrow install fails with SNAPPY_LIB-NOTFOUND

2022-11-22 Thread Arjan van der Velde (Jira)


[ 
https://issues.apache.org/jira/browse/ARROW-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17637494#comment-17637494
 ] 

Arjan van der Velde edited comment on ARROW-17374 at 11/22/22 10:56 PM:


I have a conda environment file. I haven't stripped it down to the minimum 
requirements for arrow but it illustrates the issue. The issue happens on a 
linux (centos) install and not on macOS where it seems to be using imported 
libraries from brew.

[^environment.yml]

 
{code:java}
# Set up conda environment and activate
conda env create -n testme -f environment.yml
conda activate testme

# Build required 'decor' which doesn't exist in any conda repo
R -e 'install.packages("decor", repos="http://cran.us.r-project.org;)'
# Build arrow
mkdir -p /tmp/git && \
  cd /tmp/git && git clone 'https://github.com/apache/arrow' arrow &&
  cd /tmp/git/arrow/r && \
  ARROW_S3=OFF LIBARROW_MINIMAL=FALSE ARROW_R_DEV=TRUE R CMD INSTALL . {code}
 

The build fails with:
{noformat}
_JSON -DARROW_R_WITH_GCS 
-I'/home/username/miniconda3/envs/testme/lib/R/library/cpp11/include' -DNDEBUG 
-D_FORTIFY_SOURCE=2 -O2 -isystem /home/username/miniconda3/envs/testme/include 
-I/home/username/miniconda3/envs/testme/include 
-Wl,-rpath-link,/home/username/miniconda3/envs/testme/lib   -fpic  
-fvisibility-inlines-hidden  -fmessage-length=0 -march=nocona -mtune=haswell 
-ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 
-ffunction-sections -pipe -isystem 
/home/username/miniconda3/envs/testme/include 
-fdebug-prefix-map=/home/conda/feedstock_root/build_artifacts/r-base-split_1665472261643/work=/usr/local/src/conda/r-base-4.1.3
 
-fdebug-prefix-map=/home/username/miniconda3/envs/testme=/usr/local/src/conda-prefix
  -c type_infer.cpp -o type_infer.ox86_64-conda-linux-gnu-c++ -std=gnu++17 
-shared -L/home/username/miniconda3/envs/testme/lib/R/lib -Wl,-O2 
-Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now 
-Wl,--disable-new-dtags -Wl,--gc-sections -Wl,--allow-shlib-undefined 
-Wl,-rpath,/home/username/miniconda3/envs/testme/lib 
-Wl,-rpath-link,/home/username/miniconda3/envs/testme/lib 
-L/home/username/miniconda3/envs/testme/lib -o arrow.so RTasks.o altrep.o 
array.o array_to_vector.o arraydata.o arrowExports.o bridge.o buffer.o 
chunkedarray.o compression.o compute-exec.o compute.o config.o csv.o dataset.o 
datatype.o expression.o extension-impl.o feather.o field.o filesystem.o 
imports.o io.o json.o memorypool.o message.o parquet.o r_to_arrow.o 
recordbatch.o recordbatchreader.o recordbatchwriter.o safe-call-into-r-impl.o 
scalar.o schema.o symbols.o table.o threadpool.o type_infer.o 
-L/tmp/git/arrow/r/libarrow/arrow-10.0.0.9000/lib -larrow_dataset -lparquet 
-Llibarrow/arrow-10.0.0.9000/lib -L/home/username/miniconda3/envs/testme/lib 
-larrow SNAPPY_LIB-NOTFOUND 
/home/username/miniconda3/envs/testme/lib/libre2.so.9.0.0 /usr/lib64/libbz2.so 
-pthread -larrow_bundled_dependencies -lbrotlidec -lbrotlienc -lbrotlicommon 
-lthrift -lz -llz4 -lzstd -lutf8proc -larrow -larrow_bundled_dependencies 
-larrow_dataset -lparquet -lssl -lcrypto -lcurl 
-L/home/username/miniconda3/envs/testme/lib/R/lib 
-lR/home/username/miniconda3/envs/testme/bin/../lib/gcc/x86_64-conda-linux-gnu/12.2.0/../../../../x86_64-conda-linux-gnu/bin/ld:
 cannot find SNAPPY_LIB-NOTFOUND: No such file or directory
collect2: error: ld returned 1 exit status
make: *** [/home/username/miniconda3/envs/testme/lib/R/share/make/shlib.mk:10: 
arrow.so] Error 1
ERROR: compilation failed for package ‘arrow’
* removing ‘/home/username/miniconda3/envs/testme/lib/R/library/arrow’
* restoring previous 
‘/home/username/miniconda3/envs/testme/lib/R/library/arrow’{noformat}


was (Author: JIRAUSER297783):
I have a conda environment file. I haven't stripped it down to the minimum 
requirements for arrow but it illustrates the issue. The issue happens on a 
linux (centos) install and not on macOS where it seems to be using imported 
libraries from brew.

[^environment.yml]

 
{code:java}
# Set up conda environment and activate
conda env create -n testme -f environment.yml
conda activate testme

# Build required 'decor' which doesn't exist in any conda repo
R -e 'install.packages("decor", repos="http://cran.us.r-project.org;)'
# Build arrow
mkdir -p /tmp/git && \
  cd /tmp/git && git clone 'https://github.com/apache/arrow' arrow &&
  cd /tmp/git/arrow/r && \
  ARROW_S3=OFF LIBARROW_MINIMAL=FALSE ARROW_R_DEV=TRUE R CMD INSTALL . {code}
 

The build fails with:
{noformat}
.._JSON DARROW_R_WITH_GCS 
-I'/home/username/miniconda3/envs/testme/lib/R/library/cpp11/include' -DNDEBUG 
-D_FORTIFY_SOURCE=2 -O2 -isystem /home/username/miniconda3/envs/testme/include 
-I/home/username/miniconda3/envs/testme/include 
-Wl,-rpath-link,/home/username/miniconda3/envs/testme/lib   -fpic  
-fvisibility-inlines-hidden  -fmessage-length=0 -march=nocona -mtune=haswell 
-ftree-vectorize -fPIC 

[jira] [Comment Edited] (ARROW-17374) [R] R Arrow install fails with SNAPPY_LIB-NOTFOUND

2022-11-22 Thread Arjan van der Velde (Jira)


[ 
https://issues.apache.org/jira/browse/ARROW-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17637494#comment-17637494
 ] 

Arjan van der Velde edited comment on ARROW-17374 at 11/22/22 10:55 PM:


I have a conda environment file. I haven't stripped it down to the minimum 
requirements for arrow but it illustrates the issue. The issue happens on a 
linux (centos) install and not on macOS where it seems to be using imported 
libraries from brew.

[^environment.yml]

 
{code:java}
# Set up conda environment and activate
conda env create -n testme -f environment.yml
conda activate testme

# Build required 'decor' which doesn't exist in any conda repo
R -e 'install.packages("decor", repos="http://cran.us.r-project.org;)'
# Build arrow
mkdir -p /tmp/git && \
  cd /tmp/git && git clone 'https://github.com/apache/arrow' arrow &&
  cd /tmp/git/arrow/r && \
  ARROW_S3=OFF LIBARROW_MINIMAL=FALSE ARROW_R_DEV=TRUE R CMD INSTALL . {code}
 

The build fails with:

..

.._JSON -DARROW_R_WITH_GCS 
-I'/home/username/miniconda3/envs/testme/lib/R/library/cpp11/include' -DNDEBUG 
-D_FORTIFY_SOURCE=2 -O2 -isystem /home/username/miniconda3/envs/testme/include 
-I/home/username/miniconda3/envs/testme/include 
-Wl,-rpath-link,/home/username/miniconda3/envs/testme/lib   -fpic  
-fvisibility-inlines-hidden  -fmessage-length=0 -march=nocona -mtune=haswell 
-ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 
-ffunction-sections -pipe -isystem 
/home/username/miniconda3/envs/testme/include 
-fdebug-prefix-map=/home/conda/feedstock_root/build_artifacts/r-base-split_1665472261643/work=/usr/local/src/conda/r-base-4.1.3
 
-fdebug-prefix-map=/home/username/miniconda3/envs/testme=/usr/local/src/conda-prefix
  -c type_infer.cpp -o type_infer.ox86_64-conda-linux-gnu-c++ -std=gnu++17 
-shared -L/home/username/miniconda3/envs/testme/lib/R/lib -Wl,-O2 
-Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now 
-Wl,--disable-new-dtags -Wl,--gc-sections -Wl,--allow-shlib-undefined 
-Wl,-rpath,/home/username/miniconda3/envs/testme/lib 
-Wl,-rpath-link,/home/username/miniconda3/envs/testme/lib 
-L/home/username/miniconda3/envs/testme/lib -o arrow.so RTasks.o altrep.o 
array.o array_to_vector.o arraydata.o arrowExports.o bridge.o buffer.o 
chunkedarray.o compression.o compute-exec.o compute.o config.o csv.o dataset.o 
datatype.o expression.o extension-impl.o feather.o field.o filesystem.o 
imports.o io.o json.o memorypool.o message.o parquet.o r_to_arrow.o 
recordbatch.o recordbatchreader.o recordbatchwriter.o safe-call-into-r-impl.o 
scalar.o schema.o symbols.o table.o threadpool.o type_infer.o 
-L/tmp/git/arrow/r/libarrow/arrow-10.0.0.9000/lib -larrow_dataset -lparquet 
-Llibarrow/arrow-10.0.0.9000/lib -L/home/username/miniconda3/envs/testme/lib 
-larrow SNAPPY_LIB-NOTFOUND 
/home/username/miniconda3/envs/testme/lib/libre2.so.9.0.0 /usr/lib64/libbz2.so 
-pthread -larrow_bundled_dependencies -lbrotlidec -lbrotlienc -lbrotlicommon 
-lthrift -lz -llz4 -lzstd -lutf8proc -larrow -larrow_bundled_dependencies 
-larrow_dataset -lparquet -lssl -lcrypto -lcurl 
-L/home/username/miniconda3/envs/testme/lib/R/lib 
-lR/home/username/miniconda3/envs/testme/bin/../lib/gcc/x86_64-conda-linux-gnu/12.2.0/../../../../x86_64-conda-linux-gnu/bin/ld:
 cannot find SNAPPY_LIB-NOTFOUND: No such file or directory collect2: error: ld 
returned 1 exit status make: *** 
[/home/username/miniconda3/envs/testme/lib/R/share/make/shlib.mk:10: arrow.so] 
Error 1 ERROR: compilation failed for package ‘arrow’ * removing 
‘/home/username/miniconda3/envs/testme/lib/R/library/arrow’ * restoring 
previous ‘/home/username/miniconda3/envs/testme/lib/R/library/arrow’

 


was (Author: JIRAUSER297783):
I have a conda environment file. I haven't stripped it down to the minimum 
requirements for arrow but it illustrates the issue. The issue happens on a 
linux (centos) install and not on macOS where it seems to be using imported 
libraries from brew.

[^environment.yml]

 
{code:java}
# Set up conda environment and activate
conda env create -n testme -f environment.yml
conda activate testme

# Build required 'decor' which doesn't exist in any conda repo
R -e 'install.packages("decor", repos="http://cran.us.r-project.org;)'
# Build arrow
mkdir -p /tmp/git && \
  cd /tmp/git && git clone 'https://github.com/apache/arrow' arrow &&
  cd /tmp/git/arrow/r && \
  ARROW_S3=OFF LIBARROW_MINIMAL=FALSE ARROW_R_DEV=TRUE R CMD INSTALL . {code}
 

The build fails with:
{noformat}
.._JSON -DARROW_R_WITH_GCS 
-I'/home/username/miniconda3/envs/testme/lib/R/library/cpp11/include' -DNDEBUG 
-D_FORTIFY_SOURCE=2 -O2 -isystem /home/username/miniconda3/envs/testme/include 
-I/home/username/miniconda3/envs/testme/include 
-Wl,-rpath-link,/home/username/miniconda3/envs/testme/lib   -fpic  
-fvisibility-inlines-hidden  -fmessage-length=0 -march=nocona -mtune=haswell 
-ftree-vectorize -fPIC 

[jira] [Comment Edited] (ARROW-17374) [R] R Arrow install fails with SNAPPY_LIB-NOTFOUND

2022-11-22 Thread Arjan van der Velde (Jira)


[ 
https://issues.apache.org/jira/browse/ARROW-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17637494#comment-17637494
 ] 

Arjan van der Velde edited comment on ARROW-17374 at 11/22/22 10:53 PM:


I have a conda environment file. I haven't stripped it down to the minimum 
requirements for arrow but it illustrates the issue. The issue happens on a 
linux (centos) install and not on macOS where it seems to be using imported 
libraries from brew.

[^environment.yml]

 
{code:java}
# Set up conda environment and activate
conda env create -n testme -f environment.yml
conda activate testme

# Build required 'decor' which doesn't exist in any conda repo
R -e 'install.packages("decor", repos="http://cran.us.r-project.org;)'
# Build arrow
mkdir -p /tmp/git && \
  cd /tmp/git && git clone 'https://github.com/apache/arrow' arrow &&
  cd /tmp/git/arrow/r && \
  ARROW_S3=OFF LIBARROW_MINIMAL=FALSE ARROW_R_DEV=TRUE R CMD INSTALL . {code}
 

The build fails with:
{noformat}
.._JSON -DARROW_R_WITH_GCS 
-I'/home/username/miniconda3/envs/testme/lib/R/library/cpp11/include' -DNDEBUG 
-D_FORTIFY_SOURCE=2 -O2 -isystem /home/username/miniconda3/envs/testme/include 
-I/home/username/miniconda3/envs/testme/include 
-Wl,-rpath-link,/home/username/miniconda3/envs/testme/lib   -fpic  
-fvisibility-inlines-hidden  -fmessage-length=0 -march=nocona -mtune=haswell 
-ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 
-ffunction-sections -pipe -isystem 
/home/username/miniconda3/envs/testme/include 
-fdebug-prefix-map=/home/conda/feedstock_root/build_artifacts/r-base-split_1665472261643/work=/usr/local/src/conda/r-base-4.1.3
 
-fdebug-prefix-map=/home/username/miniconda3/envs/testme=/usr/local/src/conda-prefix
  -c type_infer.cpp -o type_infer.ox86_64-conda-linux-gnu-c++ -std=gnu++17 
-shared -L/home/username/miniconda3/envs/testme/lib/R/lib -Wl,-O2 
-Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now 
-Wl,--disable-new-dtags -Wl,--gc-sections -Wl,--allow-shlib-undefined 
-Wl,-rpath,/home/username/miniconda3/envs/testme/lib 
-Wl,-rpath-link,/home/username/miniconda3/envs/testme/lib 
-L/home/username/miniconda3/envs/testme/lib -o arrow.so RTasks.o altrep.o 
array.o array_to_vector.o arraydata.o arrowExports.o bridge.o buffer.o 
chunkedarray.o compression.o compute-exec.o compute.o config.o csv.o dataset.o 
datatype.o expression.o extension-impl.o feather.o field.o filesystem.o 
imports.o io.o json.o memorypool.o message.o parquet.o r_to_arrow.o 
recordbatch.o recordbatchreader.o recordbatchwriter.o safe-call-into-r-impl.o 
scalar.o schema.o symbols.o table.o threadpool.o type_infer.o 
-L/tmp/git/arrow/r/libarrow/arrow-10.0.0.9000/lib -larrow_dataset -lparquet 
-Llibarrow/arrow-10.0.0.9000/lib -L/home/username/miniconda3/envs/testme/lib 
-larrow SNAPPY_LIB-NOTFOUND 
/home/username/miniconda3/envs/testme/lib/libre2.so.9.0.0 /usr/lib64/libbz2.so 
-pthread -larrow_bundled_dependencies -lbrotlidec -lbrotlienc -lbrotlicommon 
-lthrift -lz -llz4 -lzstd -lutf8proc -larrow -larrow_bundled_dependencies 
-larrow_dataset -lparquet -lssl -lcrypto -lcurl 
-L/home/username/miniconda3/envs/testme/lib/R/lib 
-lR/home/username/miniconda3/envs/testme/bin/../lib/gcc/x86_64-conda-linux-gnu/12.2.0/../../../../x86_64-conda-linux-gnu/bin/ld:
 cannot find SNAPPY_LIB-NOTFOUND: No such file or directory
collect2: error: ld returned 1 exit status
make: *** [/home/username/miniconda3/envs/testme/lib/R/share/make/shlib.mk:10: 
arrow.so] Error 1
ERROR: compilation failed for package ‘arrow’
* removing ‘/home/username/miniconda3/envs/testme/lib/R/library/arrow’
* restoring previous 
‘/home/username/miniconda3/envs/testme/lib/R/library/arrow’{noformat}


was (Author: JIRAUSER297783):
I have a conda environment file. I haven't stripped it down to the minimum 
requirements for arrow but it illustrates the issue. The issue happens on a 
linux (centos) install and not on macOS where it seems to be using imported 
libraries from brew.

[^environment.yml]

 
{code:java}
# Set up conda environment and activate
conda env create -n testme -f environment.yml
conda activate testme

# Build required 'decor' which doesn't exist in any conda repo
R -e 'install.packages("decor", repos="http://cran.us.r-project.org;)'
# Build arrow
mkdir -p /tmp/git && \
  cd /tmp/git && git clone 'https://github.com/apache/arrow' arrow &&
  cd /tmp/git/arrow/r && \
  ARROW_S3=OFF LIBARROW_MINIMAL=FALSE ARROW_R_DEV=TRUE R CMD INSTALL . {code}

> [R] R Arrow install fails with SNAPPY_LIB-NOTFOUND
> --
>
> Key: ARROW-17374
> URL: https://issues.apache.org/jira/browse/ARROW-17374
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: R
>Affects Versions: 8.0.0, 8.0.1, 9.0.0
> Environment: Amazon Linux 2 (RHEL) - 5.10.102-99.473.amzn2.x86_64
>

[jira] [Comment Edited] (ARROW-17374) [R] R Arrow install fails with SNAPPY_LIB-NOTFOUND

2022-09-15 Thread Vincent Nijs (Jira)


[ 
https://issues.apache.org/jira/browse/ARROW-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17605546#comment-17605546
 ] 

Vincent Nijs edited comment on ARROW-17374 at 9/16/22 12:02 AM:


The code below works fine on x86_64 but fails with the errors below on aarch64

{{cp -a /usr/local/lib/R/etc/Makeconf /usr/local/lib/R/etc/Makeconf.bak;}}
{{sed -i 's/fpic/fPIC/g' /usr/local/lib/R/etc/Makeconf;}}
{{R -e "options(HTTPUserAgent = sprintf('R/%s R (%s)', getRversion(), 
paste(getRversion(), R.version['platform'], R.version['arch'], 
R.version['os']))); Sys.setenv('ARROW_R_DEV' = TRUE); install.packages('arrow', 
repos = 'https://cran.r-project.org', type='source', Ncpus=-1)"}}
{{mv /usr/local/lib/R/etc/Makeconf.bak /usr/local/lib/R/etc/Makeconf;}}

 

Errors on aarch64:

{{** R}}
{{** inst}}
{{** byte-compile and prepare package for lazy loading}}
{{** help}}
{{*** installing help indices}}
{{** building package indices}}
{{** installing vignettes}}
{{** testing if installed package can be loaded from temporary location}}
{{Error: package or namespace load failed for ‘arrow’ in dyn.load(file, DLLpath 
= DLLpath, ...):}}
{{ unable to load shared object 
'/usr/local/lib/R/site-library/00LOCK-arrow/00new/arrow/libs/arrow.so':}}
{{  /usr/local/lib/R/site-library/00LOCK-arrow/00new/arrow/libs/arrow.so: 
undefined symbol: _ZTIN6apache6thrift8protocol9TProtocolE}}
{{Error: loading failed}}
{{Execution halted}}
{{ERROR: loading failed}}
{{{}* removing '/usr/local/lib/R/site-library/arrow'{}}}{{{}The downloaded 
source packages are in{}}}
{{        '/tmp/RtmpnU3zrU/downloaded_packages'}}
{{Warning message:}}
{{In install.packages("arrow", repos = "https://cran.r-project.org;,  :}}
{{  installation of package 'arrow' had non-zero exit status}}


was (Author: vnijs):
The code below works fine on x86_64 but fails with the errors below on aarch64

{{cp -a /usr/local/lib/R/etc/Makeconf /usr/local/lib/R/etc/Makeconf.bak;}}
{{sed -i 's/fpic/fPIC/g' /usr/local/lib/R/etc/Makeconf;}}
{{R -e "options(HTTPUserAgent = sprintf('R/%s R (%s)', getRversion(), 
paste(getRversion(), R.version['platform'], R.version['arch'], 
R.version['os']))); Sys.setenv('ARROW_R_DEV' = TRUE); install.packages('arrow', 
repos = 'https://cran.r-project.org', type='source', Ncpus=-1)"}}
{{mv /usr/local/lib/R/etc/Makeconf.bak /usr/local/lib/R/etc/Makeconf;}}

 

** R
** inst
** byte-compile and prepare package for lazy loading
** help
*** installing help indices
** building package indices
** installing vignettes
** testing if installed package can be loaded from temporary location
Error: package or namespace load failed for ‘arrow’ in dyn.load(file, DLLpath = 
DLLpath, ...):
 unable to load shared object 
'/usr/local/lib/R/site-library/00LOCK-arrow/00new/arrow/libs/arrow.so':
  /usr/local/lib/R/site-library/00LOCK-arrow/00new/arrow/libs/arrow.so: 
undefined symbol: _ZTIN6apache6thrift8protocol9TProtocolE
Error: loading failed
Execution halted
ERROR: loading failed
* removing '/usr/local/lib/R/site-library/arrow'

The downloaded source packages are in
        '/tmp/RtmpnU3zrU/downloaded_packages'
Warning message:
In install.packages("arrow", repos = "https://cran.r-project.org;,  :
  installation of package 'arrow' had non-zero exit status

> [R] R Arrow install fails with SNAPPY_LIB-NOTFOUND
> --
>
> Key: ARROW-17374
> URL: https://issues.apache.org/jira/browse/ARROW-17374
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: R
>Affects Versions: 8.0.0, 9.0.0, 8.0.1
> Environment: Amazon Linux 2 (RHEL) - 5.10.102-99.473.amzn2.x86_64
>Reporter: Shane Brennan
>Priority: Blocker
> Attachments: build-images.out
>
>
> I've been trying to install Arrow on an R notebook within AWS SageMaker. 
> SageMaker provides Jupyter-like notebooks, with each instance running Amazon 
> Linux 2 as its OS, itself based on RHEL. 
> Trying to install a few ways, e.g., using the standard binaries, using the 
> nightly builds, setting ARROW_WITH_SNAPPY to ON and LIBARROW_MINIMAL all 
> still result in the following error. 
> {noformat}
> x86_64-conda-linux-gnu-c++ -std=gnu++11 -shared 
> -L/home/ec2-user/anaconda3/envs/R/lib/R/lib -Wl,-O2 -Wl,--sort-common 
> -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,--disable-new-dtags 
> -Wl,--gc-sections -Wl,--allow-shlib-undefined 
> -Wl,-rpath,/home/ec2-user/anaconda3/envs/R/lib 
> -Wl,-rpath-link,/home/ec2-user/anaconda3/envs/R/lib 
> -L/home/ec2-user/anaconda3/envs/R/lib -o arrow.so RTasks.o altrep.o array.o 
> array_to_vector.o arraydata.o arrowExports.o bridge.o buffer.o chunkedarray.o 
> compression.o compute-exec.o compute.o config.o csv.o dataset.o datatype.o 
> expression.o extension-impl.o feather.o field.o filesystem.o imports.o io.o 
> json.o memorypool.o message.o parquet.o 

[jira] [Comment Edited] (ARROW-17374) [R] R Arrow install fails with SNAPPY_LIB-NOTFOUND

2022-09-02 Thread Vincent Nijs (Jira)


[ 
https://issues.apache.org/jira/browse/ARROW-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599759#comment-17599759
 ] 

Vincent Nijs edited comment on ARROW-17374 at 9/3/22 2:03 AM:
--

Made some progress. I had to install `libsnappy-dev` and `libre2-dev` in Ubuntu 
22.04 and use 
[https://github.com/duckdb/duckdb/issues/3049#issuecomment-1096671708]

Arrow still doesn't compile successfully, however, and ends with the below. The 
build logs are attached ("build-images.out").

 

{{#21 1786.1 ** testing if installed package can be loaded from temporary 
location}}
{{#21 1786.4 Error: package or namespace load failed for ‘arrow’ in 
dyn.load(file, DLLpath = DLLpath, ...):}}
{{#21 1786.4  unable to load shared object 
'/usr/local/lib/R/site-library/00LOCK-arrow/00new/arrow/libs/arrow.so':}}
{{#21 1786.4   
/usr/local/lib/R/site-library/00LOCK-arrow/00new/arrow/libs/arrow.so: undefined 
symbol: _ZTIN6apache6thrift8protocol9TProtocolE}}

 

 

{{{}# workaround for fPIC issue 
[https://github.com/duckdb/duckdb/issues/3049#issuecomment-1096671708]{}}}{{{}cp
 -a /usr/local/lib/R/etc/Makeconf /usr/local/lib/R/etc/Makeconf.bak;{}}}
{{sed -i 's/fpic/fPIC/g' /usr/local/lib/R/etc/Makeconf;}}
{{R -e "options(HTTPUserAgent = sprintf('R/%s R (%s)', getRversion(), 
paste(getRversion(), R.version['platform'], R.version['arch'], 
R.version['os']))); Sys.setenv('ARROW_R_DEV' = TRUE); 
install.packages(c('duckdb', 'arrow'), repo='${CRAN}', Ncpus=${NCPUS})"}}
{{mv /usr/local/lib/R/etc/Makeconf.bak /usr/local/lib/R/etc/Makeconf;}}


was (Author: vnijs):
Made some progress. I had to install `libsnappy-dev` and `libre2-dev` in Ubuntu 
22.04 and use 
[https://github.com/duckdb/duckdb/issues/3049#issuecomment-1096671708]

Arrow still doesn't compile successfully, however, and ends with the below. The 
build logs are attached ("build-images.out").

 

```

#21 1786.1 ** testing if installed package can be loaded from temporary location
#21 1786.4 Error: package or namespace load failed for ‘arrow’ in 
dyn.load(file, DLLpath = DLLpath, ...):
#21 1786.4  unable to load shared object 
'/usr/local/lib/R/site-library/00LOCK-arrow/00new/arrow/libs/arrow.so':
#21 1786.4   
/usr/local/lib/R/site-library/00LOCK-arrow/00new/arrow/libs/arrow.so: undefined 
symbol: _ZTIN6apache6thrift8protocol9TProtocolE

```

 

``` 

# workaround for fPIC issue 
[https://github.com/duckdb/duckdb/issues/3049#issuecomment-1096671708]

cp -a /usr/local/lib/R/etc/Makeconf /usr/local/lib/R/etc/Makeconf.bak;
sed -i 's/fpic/fPIC/g' /usr/local/lib/R/etc/Makeconf;
R -e "options(HTTPUserAgent = sprintf('R/%s R (%s)', getRversion(), 
paste(getRversion(), R.version['platform'], R.version['arch'], 
R.version['os']))); Sys.setenv('ARROW_R_DEV' = TRUE); 
install.packages(c('duckdb', 'arrow'), repo='${CRAN}', Ncpus=${NCPUS})"
mv /usr/local/lib/R/etc/Makeconf.bak /usr/local/lib/R/etc/Makeconf;

```

> [R] R Arrow install fails with SNAPPY_LIB-NOTFOUND
> --
>
> Key: ARROW-17374
> URL: https://issues.apache.org/jira/browse/ARROW-17374
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: R
>Affects Versions: 8.0.0, 9.0.0, 8.0.1
> Environment: Amazon Linux 2 (RHEL) - 5.10.102-99.473.amzn2.x86_64
>Reporter: Shane Brennan
>Priority: Blocker
> Attachments: build-images.out
>
>
> I've been trying to install Arrow on an R notebook within AWS SageMaker. 
> SageMaker provides Jupyter-like notebooks, with each instance running Amazon 
> Linux 2 as its OS, itself based on RHEL. 
> Trying to install a few ways, e.g., using the standard binaries, using the 
> nightly builds, setting ARROW_WITH_SNAPPY to ON and LIBARROW_MINIMAL all 
> still result in the following error. 
> {noformat}
> x86_64-conda-linux-gnu-c++ -std=gnu++11 -shared 
> -L/home/ec2-user/anaconda3/envs/R/lib/R/lib -Wl,-O2 -Wl,--sort-common 
> -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,--disable-new-dtags 
> -Wl,--gc-sections -Wl,--allow-shlib-undefined 
> -Wl,-rpath,/home/ec2-user/anaconda3/envs/R/lib 
> -Wl,-rpath-link,/home/ec2-user/anaconda3/envs/R/lib 
> -L/home/ec2-user/anaconda3/envs/R/lib -o arrow.so RTasks.o altrep.o array.o 
> array_to_vector.o arraydata.o arrowExports.o bridge.o buffer.o chunkedarray.o 
> compression.o compute-exec.o compute.o config.o csv.o dataset.o datatype.o 
> expression.o extension-impl.o feather.o field.o filesystem.o imports.o io.o 
> json.o memorypool.o message.o parquet.o r_to_arrow.o recordbatch.o 
> recordbatchreader.o recordbatchwriter.o safe-call-into-r-impl.o scalar.o 
> schema.o symbols.o table.o threadpool.o type_infer.o 
> -L/tmp/Rtmpuh87oc/R.INSTALL67114493a3de/arrow/libarrow/arrow-9.0.0.20220809/lib
>  -larrow_dataset -lparquet -larrow -larrow_bundled_dependencies -lz 
> SNAPPY_LIB-NOTFOUND 

[jira] [Comment Edited] (ARROW-17374) [R] R Arrow install fails with SNAPPY_LIB-NOTFOUND

2022-09-02 Thread Vincent Nijs (Jira)


[ 
https://issues.apache.org/jira/browse/ARROW-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17585662#comment-17585662
 ] 

Vincent Nijs edited comment on ARROW-17374 at 9/3/22 1:51 AM:
--

I ran into the same issue installing arrow from source for R on aarch64. Python 
is installed using conda but R was installed from source. The docker container 
for aarch64 is 
[vnijs/rsm-jupyter]([https://hub.docker.com/repository/docker/vnijs/rsm-jupyter).]
 Note that the image is rather large.


was (Author: vnijs):
I ran into the same issue installing arrow from source for R on aarch64. Python 
is installed using conda but R was installed from source. The docker container 
for aarch64 is 
[vnijs/rsm-jupyter]([https://hub.docker.com/repository/docker/vnijs/rsm-jupyter).]
 Note that the image is rather large.

 

FYI I also tried installing using binaries but that gives the error below even 
though the file clearly exists.

!image-2022-08-26-21-42-13-338.png!

 

 

> [R] R Arrow install fails with SNAPPY_LIB-NOTFOUND
> --
>
> Key: ARROW-17374
> URL: https://issues.apache.org/jira/browse/ARROW-17374
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: R
>Affects Versions: 8.0.0, 9.0.0, 8.0.1
> Environment: Amazon Linux 2 (RHEL) - 5.10.102-99.473.amzn2.x86_64
>Reporter: Shane Brennan
>Priority: Blocker
> Attachments: image-2022-08-26-21-42-13-338.png
>
>
> I've been trying to install Arrow on an R notebook within AWS SageMaker. 
> SageMaker provides Jupyter-like notebooks, with each instance running Amazon 
> Linux 2 as its OS, itself based on RHEL. 
> Trying to install a few ways, e.g., using the standard binaries, using the 
> nightly builds, setting ARROW_WITH_SNAPPY to ON and LIBARROW_MINIMAL all 
> still result in the following error. 
> {noformat}
> x86_64-conda-linux-gnu-c++ -std=gnu++11 -shared 
> -L/home/ec2-user/anaconda3/envs/R/lib/R/lib -Wl,-O2 -Wl,--sort-common 
> -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,--disable-new-dtags 
> -Wl,--gc-sections -Wl,--allow-shlib-undefined 
> -Wl,-rpath,/home/ec2-user/anaconda3/envs/R/lib 
> -Wl,-rpath-link,/home/ec2-user/anaconda3/envs/R/lib 
> -L/home/ec2-user/anaconda3/envs/R/lib -o arrow.so RTasks.o altrep.o array.o 
> array_to_vector.o arraydata.o arrowExports.o bridge.o buffer.o chunkedarray.o 
> compression.o compute-exec.o compute.o config.o csv.o dataset.o datatype.o 
> expression.o extension-impl.o feather.o field.o filesystem.o imports.o io.o 
> json.o memorypool.o message.o parquet.o r_to_arrow.o recordbatch.o 
> recordbatchreader.o recordbatchwriter.o safe-call-into-r-impl.o scalar.o 
> schema.o symbols.o table.o threadpool.o type_infer.o 
> -L/tmp/Rtmpuh87oc/R.INSTALL67114493a3de/arrow/libarrow/arrow-9.0.0.20220809/lib
>  -larrow_dataset -lparquet -larrow -larrow_bundled_dependencies -lz 
> SNAPPY_LIB-NOTFOUND /home/ec2-user/anaconda3/envs/R/lib/libbz2.so -pthread 
> -larrow -larrow_bundled_dependencies -larrow_dataset -lparquet -lssl -lcrypto 
> -lcurl -lssl -lcrypto -lcurl -L/home/ec2-user/anaconda3/envs/R/lib/R/lib -lR
> x86_64-conda-linux-gnu-c++: error: SNAPPY_LIB-NOTFOUND: No such file or 
> directory
> make: *** [/home/ec2-user/anaconda3/envs/R/lib/R/share/make/shlib.mk:10: 
> arrow.so] Error 1{noformat}
> Snappy is installed on the systems, and both shared object (.so) and cmake 
> files are there, where I've tried setting the system env variables Snappy_DIR 
> and Snappy_LIB to point at them, but to no avail.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Comment Edited] (ARROW-17374) [R] R Arrow install fails with SNAPPY_LIB-NOTFOUND

2022-08-11 Thread Shane Brennan (Jira)


[ 
https://issues.apache.org/jira/browse/ARROW-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17578526#comment-17578526
 ] 

Shane Brennan edited comment on ARROW-17374 at 8/11/22 3:16 PM:


Thanks Kouhei and Neal for responding. 

The conda install fails both for the release and the nightly build. Seems like 
the Python 3.10 on the system doesn't play too well with the conda install 
package. The conda error is. 
{code:java}
(R) sh-4.2$ conda install -c conda-forge --strict-channel-priority r-arrow
Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible 
solve.
Solving environment: failed with repodata from current_repodata.json, will 
retry with next repodata source.

ResolvePackageNotFound: 
  - python=3.1{code}
However, I mostly was trying to install arrow within R using this setup
{code:java}
Sys.setenv(NOT_CRAN = TRUE)
Sys.setenv("ARROW_PARQUET" = "ON")
Sys.setenv("ARROW_S3" = "ON")
Sys.setenv("ARROW_WITH_SNAPPY" = "ON")
Sys.setenv("ARROW_R_DEV" = TRUE)
install.packages("arrow", repos = 
"https://arrow-r-nightly.s3.amazonaws.com;){code}


was (Author: JIRAUSER294234):
Thanks Kouhei and Neal for responding. 

The conda install fails both for the release and the nightly build. Seems like 
the Python 3.10 on the system doesn't play too well with the conda install 
package. The conda error is. 
{code:java}
(R) sh-4.2$ conda install -c conda-forge --strict-channel-priority r-arrow
Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible 
solve.
Solving environment: failed with repodata from current_repodata.json, will 
retry with next repodata source.

ResolvePackageNotFound: 
  - python=3.1{code}
However, I mostly was trying to install arrow within R using this setup

 
{code:java}
Sys.setenv(NOT_CRAN = TRUE)
Sys.setenv("ARROW_PARQUET" = "ON")
Sys.setenv("ARROW_S3" = "ON")
Sys.setenv("ARROW_WITH_SNAPPY" = "ON")
Sys.setenv("ARROW_R_DEV" = TRUE)
install.packages("arrow", repos = 
"https://arrow-r-nightly.s3.amazonaws.com;){code}
 

> [R] R Arrow install fails with SNAPPY_LIB-NOTFOUND
> --
>
> Key: ARROW-17374
> URL: https://issues.apache.org/jira/browse/ARROW-17374
> Project: Apache Arrow
>  Issue Type: Bug
>  Components: R
>Affects Versions: 8.0.0, 9.0.0, 8.0.1
> Environment: Amazon Linux 2 (RHEL) - 5.10.102-99.473.amzn2.x86_64
>Reporter: Shane Brennan
>Priority: Blocker
>
> I've been trying to install Arrow on an R notebook within AWS SageMaker. 
> SageMaker provides Jupyter-like notebooks, with each instance running Amazon 
> Linux 2 as its OS, itself based on RHEL. 
> Trying to install a few ways, e.g., using the standard binaries, using the 
> nightly builds, setting ARROW_WITH_SNAPPY to ON and LIBARROW_MINIMAL all 
> still result in the following error. 
> {noformat}
> x86_64-conda-linux-gnu-c++ -std=gnu++11 -shared 
> -L/home/ec2-user/anaconda3/envs/R/lib/R/lib -Wl,-O2 -Wl,--sort-common 
> -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,--disable-new-dtags 
> -Wl,--gc-sections -Wl,--allow-shlib-undefined 
> -Wl,-rpath,/home/ec2-user/anaconda3/envs/R/lib 
> -Wl,-rpath-link,/home/ec2-user/anaconda3/envs/R/lib 
> -L/home/ec2-user/anaconda3/envs/R/lib -o arrow.so RTasks.o altrep.o array.o 
> array_to_vector.o arraydata.o arrowExports.o bridge.o buffer.o chunkedarray.o 
> compression.o compute-exec.o compute.o config.o csv.o dataset.o datatype.o 
> expression.o extension-impl.o feather.o field.o filesystem.o imports.o io.o 
> json.o memorypool.o message.o parquet.o r_to_arrow.o recordbatch.o 
> recordbatchreader.o recordbatchwriter.o safe-call-into-r-impl.o scalar.o 
> schema.o symbols.o table.o threadpool.o type_infer.o 
> -L/tmp/Rtmpuh87oc/R.INSTALL67114493a3de/arrow/libarrow/arrow-9.0.0.20220809/lib
>  -larrow_dataset -lparquet -larrow -larrow_bundled_dependencies -lz 
> SNAPPY_LIB-NOTFOUND /home/ec2-user/anaconda3/envs/R/lib/libbz2.so -pthread 
> -larrow -larrow_bundled_dependencies -larrow_dataset -lparquet -lssl -lcrypto 
> -lcurl -lssl -lcrypto -lcurl -L/home/ec2-user/anaconda3/envs/R/lib/R/lib -lR
> x86_64-conda-linux-gnu-c++: error: SNAPPY_LIB-NOTFOUND: No such file or 
> directory
> make: *** [/home/ec2-user/anaconda3/envs/R/lib/R/share/make/shlib.mk:10: 
> arrow.so] Error 1{noformat}
> Snappy is installed on the systems, and both shared object (.so) and cmake 
> files are there, where I've tried setting the system env variables Snappy_DIR 
> and Snappy_LIB to point at them, but to no avail.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)