Percy Camilo Triveño Aucahuasi created ARROW-17765:
------------------------------------------------------
Summary: Archery docker: multiplatform support on arm64
Key: ARROW-17765
URL: https://issues.apache.org/jira/browse/ARROW-17765
Project: Apache Arrow
Issue Type: Bug
Components: Archery
Reporter: Percy Camilo Triveño Aucahuasi
It seems right now is not possible to build/run arrow docker containers with
arch=arm64 (the default platform is amd64)
I tried first with this command:
{code:java}
ARCH=arm64 archery docker run conda-cpp-valgrind{code}
and got this error:
{code:java}
[+] Running 0/1
⠿ conda Error
1.8s
Pulling conda: Error response from daemon: manifest for
apache/arrow-dev:arm64-conda not found: manifest unknown: manifest unknown
[+] Running 0/1
⠿ conda-cpp Error
1.7s
Pulling conda-cpp: Error response from daemon: manifest for
apache/arrow-dev:arm64-conda-cpp not found: manifest unknown: manifest unknown
[+] Building 1.1s (3/3) FINISHED
=> [internal] load build definition from conda.dockerfile
0.0s
=> => transferring dockerfile: 38B
0.0s
=> [internal] load .dockerignore
0.0s
=> => transferring context: 35B
0.0s
=> ERROR [internal] load metadata for docker.io/arm64/ubuntu:18.04
1.0s
------
> [internal] load metadata for docker.io/arm64/ubuntu:18.04:
------
failed to solve: rpc error: code = Unknown desc = failed to solve with frontend
dockerfile.v0: failed to create LLB definition: pull access denied, repository
does not exist or may require authorization: server message:
insufficient_scope: authorization failed
Error: `docker-compose --file /arrow/docker-compose.yml build --build-arg
BUILDKIT_INLINE_CACHE=1 conda` exited with a non-zero exit code 17, see the
process log above.
The docker-compose command was invoked with the following parameters:
Defaults defined in .env:
ALMALINUX: 8
ALPINE_LINUX: 3.16
ARCH: amd64
ARCH_ALIAS: x86_64
ARCH_SHORT: amd64
ARROW_R_DEV: TRUE
BUILDKIT_INLINE_CACHE: 1
CLANG_TOOLS: 12
COMPOSE_DOCKER_CLI_BUILD: 1
CONAN: gcc10
CUDA: 11.0.3
DASK: latest
DEBIAN: 11
DEVTOOLSET_VERSION: -1
DOCKER_BUILDKIT: 1
DOCKER_VOLUME_PREFIX:
DOTNET: 6.0
FEDORA: 35
GCC_VERSION:
GO: 1.17
HDFS: 3.2.1
JDK: 8
KARTOTHEK: latest
LLVM: 13
MAVEN: 3.5.4
NODE: 16
NUMBA: latest
NUMPY: latest
PANDAS: latest
PYTHON: 3.8
PYTHON_WHEEL_WINDOWS_IMAGE_REVISION: 2022-06-12
R: 4.2
REPO: apache/arrow-dev
R_CUSTOM_CCACHE: false
R_IMAGE: ubuntu-gcc-release
R_ORG: rhub
R_PRUNE_DEPS: FALSE
R_TAG: latest
SPARK: master
STATICCHECK: v0.2.2
TURBODBC: latest
TZ: UTC
UBUNTU: 20.04
ULIMIT_CORE: -1
VCPKG: 38bb87c
Archery was called with:
export ARCH=arm64
{code}
Then, I tried to use the docker buildx plugin with this command:
{code:java}
ARCH=arm64 archery docker run --using-docker-buildx conda-cpp-valgrind{code}
and got this error:
{code:java}
Error response from daemon: manifest for apache/arrow-dev:arm64-conda not
found: manifest unknown: manifest unknown
docker pull apache/arrow-dev:arm64-conda exited with non-zero exit code 1
Error response from daemon: manifest for apache/arrow-dev:arm64-conda-cpp not
found: manifest unknown: manifest unknown
docker pull apache/arrow-dev:arm64-conda-cpp exited with non-zero exit code 1
[+] Building 0.0s (0/0)
ERROR: cache export feature is currently not supported for docker driver.
Please switch to a different driver (eg. "docker buildx create --use")
Error: docker buildx build --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg
arch=arm64 --cache-from type=registry,ref=apache/arrow-dev:arm64-conda-cache
--cache-to type=registry,ref=apache/arrow-dev:arm64-conda-cache,mode=max
--output type=docker -f /arrow/ci/docker/conda.dockerfile -t
apache/arrow-dev:arm64-conda /arrow exited with non-zero exit code 1{code}
My system env is:
{code:java}
uname -a
Darwin MacBook-Pro.local 21.6.0 Darwin Kernel Version 21.6.0: Mon Aug 22
20:19:52 PDT 2022; root:xnu-8020.140.49~2/RELEASE_ARM64_T6000 arm64
docker --version
Docker version 20.10.17, build 100c701
docker compose version
Docker Compose version v2.10.2
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
