[
https://issues.apache.org/jira/browse/ARROW-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17608761#comment-17608761
]
Jacob Wujciak-Jens commented on ARROW-17791:
--------------------------------------------
Renaming the envvars is not an option because sccache would not detect them
then. But we found the issue, the sccache user needs explicit permission to
access any bucket. We have now added this and will add any other buckets that
need to be accessed in jobs that use sccache.
Successful run here:
https://github.com/ursacomputing/crossbow/actions/runs/3094438413/jobs/5047216106
> [Python][CI] Some nightly jobs are failing due to ACCESS_DENIED to S3 bucket
> ----------------------------------------------------------------------------
>
> Key: ARROW-17791
> URL: https://issues.apache.org/jira/browse/ARROW-17791
> Project: Apache Arrow
> Issue Type: Bug
> Components: Continuous Integration, Python
> Reporter: Raúl Cumplido
> Priority: Critical
> Labels: Nightly
>
> The following nitghly failures:
> *
> [test-conda-python-3.10|https://github.com/ursacomputing/crossbow/actions/runs/3094438413/jobs/5007812721]
> *
> [test-conda-python-3.7|https://github.com/ursacomputing/crossbow/actions/runs/3094412849/jobs/5007760110]
> *
> [test-conda-python-3.7-pandas-0.24|https://github.com/ursacomputing/crossbow/actions/runs/3094422644/jobs/5007779545]
> *
> [test-conda-python-3.7-pandas-latest|https://github.com/ursacomputing/crossbow/actions/runs/3094419759/jobs/5007773935]
> *
> [test-conda-python-3.8|https://github.com/ursacomputing/crossbow/actions/runs/3094444904/jobs/5007827002]
> *
> [test-conda-python-3.8-pandas-latest|https://github.com/ursacomputing/crossbow/actions/runs/3094405494/jobs/5007746062]
> *
> [test-conda-python-3.8-pandas-nightly|https://github.com/ursacomputing/crossbow/actions/runs/3094407475/jobs/5007750212]
> *
> [test-conda-python-3.9|https://github.com/ursacomputing/crossbow/actions/runs/3094450745/jobs/5007839959]
> *
> [test-conda-python-3.9-pandas-master|https://github.com/ursacomputing/crossbow/actions/runs/3094401032/jobs/5007736715]
> *
> [test-debian-11-python-3|https://github.com/ursacomputing/crossbow/runs/8465194776]
> Failed Python test_s3_real_aws_region_selection with ACCESS_DENIED:
> {code:java}
> =================================== FAILURES
> ===================================
> ______________________ test_s3_real_aws_region_selection
> _______________________ @pytest.mark.s3
> def test_s3_real_aws_region_selection():
> # Taken from a registry of open S3-hosted datasets
> # at https://github.com/awslabs/open-data-registry
> fs, path = FileSystem.from_uri('s3://mf-nwp-models/README.txt')
> assert fs.region == 'eu-west-1'
> > with fs.open_input_stream(path) as
> > f:opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/test_fs.py:1660:
> >
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> _
> pyarrow/_fs.pyx:805: in pyarrow._fs.FileSystem.open_input_stream
> ???
> pyarrow/error.pxi:144: in pyarrow.lib.pyarrow_internal_check_status
> ???
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> _ > ???
> E OSError: When reading information for key 'README.txt' in bucket
> 'mf-nwp-models': AWS Error ACCESS_DENIED during HeadObject operation: No
> response body.pyarrow/error.pxi:115: OSError {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
