Tim Hughes created SPARK-34315:
----------------------------------
Summary: docker-image-tool.sh debconf trying to configure kerberos
Key: SPARK-34315
URL: https://issues.apache.org/jira/browse/SPARK-34315
Project: Spark
Issue Type: Bug
Components: Kubernetes
Affects Versions: 3.0.1
Environment: ## Full logs
{{}}{{$ bin/docker-image-tool.sh build}}
{{Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet
msg.}}
{{STEP 1: FROM openjdk:8-jre-slim}}
{{STEP 2: ARG spark_uid=185}}
{{--> Using cache
d24913e4f80a167a2682380bc0565b0eefac2e7e5b94f1491b99712e1154dd3b}}
{{--> d24913e4f80}}
{{STEP 3: RUN set -ex && sed -i 's/http:\/\/deb.\(.*\)/https:\/\/deb.\1/g'
/etc/apt/sources.list && apt-get update && ln -s /lib /lib64 && apt install -y
bash tini libc6 libpam-modules krb5-user libnss3 && mkdir -p /opt/spark &&
mkdir -p /opt/spark/examples && mkdir -p /opt/spark/work-dir && touch
/opt/spark/RELEASE && rm /bin/sh && ln -sv /bin/bash /bin/sh && echo "auth
required pam_wheel.so use_uid" >> /etc/pam.d/su && chgrp root /etc/passwd &&
chmod ug+rw /etc/passwd && rm -rf /var/cache/apt/*}}
{{+ sed -i s/http:\/\/deb.\(.*\)/https:\/\/deb.\1/g /etc/apt/sources.list}}
{{+ apt-get update}}
{{Get:1 http://security.debian.org/debian-security buster/updates InRelease
[65.4 kB]}}
{{Get:2 https://deb.debian.org/debian buster InRelease [121 kB] }}
{{Get:3 https://deb.debian.org/debian buster-updates InRelease [51.9 kB]}}
{{Get:4 http://security.debian.org/debian-security buster/updates/main amd64
Packages [271 kB]}}
{{Get:5 https://deb.debian.org/debian buster/main amd64 Packages [7907 kB]}}
{{Get:6 https://deb.debian.org/debian buster-updates/main amd64 Packages [7848
B]}}
{{Fetched 8426 kB in 4s (1995 kB/s) }}
{{Reading package lists... Done}}
{{+ ln -s /lib /lib64}}
{{+ apt install -y bash tini libc6 libpam-modules krb5-user libnss3}}
{{Reading package lists... Done}}
{{Building dependency tree }}
{{Reading state information... Done}}
{{bash is already the newest version (5.0-4).}}
{{bash set to manually installed.}}
{{libc6 is already the newest version (2.28-10).}}
{{libc6 set to manually installed.}}
{{libpam-modules is already the newest version (1.3.1-5).}}
{{libpam-modules set to manually installed.}}
{{The following package was automatically installed and is no longer required:}}
{{ lsb-base}}
{{Use 'apt autoremove' to remove it.}}
{{The following additional packages will be installed:}}
{{ bind9-host geoip-database krb5-config krb5-locales libbind9-161 libcap2}}
{{ libdns1104 libfstrm0 libgeoip1 libgssapi-krb5-2 libgssrpc4 libicu63}}
{{ libisc1100 libisccc161 libisccfg163 libjson-c3 libk5crypto3}}
{{ libkadm5clnt-mit11 libkadm5srv-mit11 libkdb5-9 libkeyutils1 libkrb5-3}}
{{ libkrb5support0 liblmdb0 liblwres161 libnspr4 libprotobuf-c1 libsqlite3-0}}
{{ libxml2}}
{{Suggested packages:}}
{{ krb5-k5tls geoip-bin krb5-doc}}
{{The following NEW packages will be installed:}}
{{ bind9-host geoip-database krb5-config krb5-locales krb5-user libbind9-161}}
{{ libcap2 libdns1104 libfstrm0 libgeoip1 libgssapi-krb5-2 libgssrpc4 libicu63}}
{{ libisc1100 libisccc161 libisccfg163 libjson-c3 libk5crypto3}}
{{ libkadm5clnt-mit11 libkadm5srv-mit11 libkdb5-9 libkeyutils1 libkrb5-3}}
{{ libkrb5support0 liblmdb0 liblwres161 libnspr4 libnss3 libprotobuf-c1}}
{{ libsqlite3-0 libxml2 tini}}
{{0 upgraded, 32 newly installed, 0 to remove and 2 not upgraded.}}
{{Need to get 18.1 MB of archives.}}
{{After this operation, 61.3 MB of additional disk space will be used.}}
{{Get:1 https://deb.debian.org/debian buster/main amd64 libcap2 amd64 1:2.25-2
[17.6 kB]}}
{{Get:2 https://deb.debian.org/debian buster/main amd64 libfstrm0 amd64 0.4.0-1
[20.8 kB]}}
{{Get:3 https://deb.debian.org/debian buster/main amd64 libgeoip1 amd64
1.6.12-1 [93.1 kB]}}
{{Get:4 https://deb.debian.org/debian buster/main amd64 libjson-c3 amd64
0.12.1+ds-2+deb10u1 [27.3 kB]}}
{{Get:5 https://deb.debian.org/debian buster/main amd64 liblmdb0 amd64 0.9.22-1
[45.0 kB]}}
{{Get:6 https://deb.debian.org/debian buster/main amd64 libprotobuf-c1 amd64
1.3.1-1+b1 [26.5 kB]}}
{{Get:7 https://deb.debian.org/debian buster/main amd64 libicu63 amd64
63.1-6+deb10u1 [8300 kB]}}
{{Get:8 https://deb.debian.org/debian buster/main amd64 libxml2 amd64
2.9.4+dfsg1-7+deb10u1 [689 kB]}}
{{Get:9 https://deb.debian.org/debian buster/main amd64 libisc1100 amd64
1:9.11.5.P4+dfsg-5.1+deb10u2 [458 kB]}}
{{Get:10 https://deb.debian.org/debian buster/main amd64 libkeyutils1 amd64
1.6-6 [15.0 kB]}}
{{Get:11 https://deb.debian.org/debian buster/main amd64 libkrb5support0 amd64
1.17-3+deb10u1 [65.8 kB]}}
{{Get:12 https://deb.debian.org/debian buster/main amd64 libk5crypto3 amd64
1.17-3+deb10u1 [122 kB]}}
{{Get:13 https://deb.debian.org/debian buster/main amd64 libkrb5-3 amd64
1.17-3+deb10u1 [369 kB]}}
{{Get:14 https://deb.debian.org/debian buster/main amd64 libgssapi-krb5-2 amd64
1.17-3+deb10u1 [158 kB]}}
{{Get:15 https://deb.debian.org/debian buster/main amd64 libdns1104 amd64
1:9.11.5.P4+dfsg-5.1+deb10u2 [1223 kB]}}
{{Get:16 https://deb.debian.org/debian buster/main amd64 libisccc161 amd64
1:9.11.5.P4+dfsg-5.1+deb10u2 [236 kB]}}
{{Get:17 https://deb.debian.org/debian buster/main amd64 libisccfg163 amd64
1:9.11.5.P4+dfsg-5.1+deb10u2 [267 kB]}}
{{Get:18 https://deb.debian.org/debian buster/main amd64 libbind9-161 amd64
1:9.11.5.P4+dfsg-5.1+deb10u2 [247 kB]}}
{{Get:19 https://deb.debian.org/debian buster/main amd64 liblwres161 amd64
1:9.11.5.P4+dfsg-5.1+deb10u2 [251 kB]}}
{{Get:20 https://deb.debian.org/debian buster/main amd64 bind9-host amd64
1:9.11.5.P4+dfsg-5.1+deb10u2 [271 kB]}}
{{Get:21 https://deb.debian.org/debian buster/main amd64 krb5-locales all
1.17-3+deb10u1 [95.4 kB]}}
{{Get:22 https://deb.debian.org/debian buster/main amd64 geoip-database all
20181108-1 [2449 kB]}}
{{Get:23 https://deb.debian.org/debian buster/main amd64 krb5-config all 2.6
[24.6 kB]}}
{{Get:24 https://deb.debian.org/debian buster/main amd64 libgssrpc4 amd64
1.17-3+deb10u1 [91.2 kB]}}
{{Get:25 https://deb.debian.org/debian buster/main amd64 libkadm5clnt-mit11
amd64 1.17-3+deb10u1 [73.5 kB]}}
{{Get:26 https://deb.debian.org/debian buster/main amd64 libkdb5-9 amd64
1.17-3+deb10u1 [73.5 kB]}}
{{Get:27 https://deb.debian.org/debian buster/main amd64 libkadm5srv-mit11
amd64 1.17-3+deb10u1 [85.7 kB]}}
{{Get:28 https://deb.debian.org/debian buster/main amd64 krb5-user amd64
1.17-3+deb10u1 [150 kB]}}
{{Get:29 https://deb.debian.org/debian buster/main amd64 libnspr4 amd64
2:4.20-1 [112 kB]}}
{{Get:30 https://deb.debian.org/debian buster/main amd64 libsqlite3-0 amd64
3.27.2-3+deb10u1 [641 kB]}}
{{Get:31 https://deb.debian.org/debian buster/main amd64 libnss3 amd64
2:3.42.1-1+deb10u3 [1159 kB]}}
{{Get:32 https://deb.debian.org/debian buster/main amd64 tini amd64 0.18.0-1
[247 kB]}}
{{Fetched 18.1 MB in 3s (6061 kB/s)}}
{{debconf: delaying package configuration, since apt-utils is not installed}}
{{Selecting previously unselected package libcap2:amd64.}}
{{(Reading database ... 6889 files and directories currently installed.)}}
{{Preparing to unpack .../00-libcap2_1%3a2.25-2_amd64.deb ...}}
{{Unpacking libcap2:amd64 (1:2.25-2) ...}}
{{Selecting previously unselected package libfstrm0:amd64.}}
{{Preparing to unpack .../01-libfstrm0_0.4.0-1_amd64.deb ...}}
{{Unpacking libfstrm0:amd64 (0.4.0-1) ...}}
{{Selecting previously unselected package libgeoip1:amd64.}}
{{Preparing to unpack .../02-libgeoip1_1.6.12-1_amd64.deb ...}}
{{Unpacking libgeoip1:amd64 (1.6.12-1) ...}}
{{Selecting previously unselected package libjson-c3:amd64.}}
{{Preparing to unpack .../03-libjson-c3_0.12.1+ds-2+deb10u1_amd64.deb ...}}
{{Unpacking libjson-c3:amd64 (0.12.1+ds-2+deb10u1) ...}}
{{Selecting previously unselected package liblmdb0:amd64.}}
{{Preparing to unpack .../04-liblmdb0_0.9.22-1_amd64.deb ...}}
{{Unpacking liblmdb0:amd64 (0.9.22-1) ...}}
{{Selecting previously unselected package libprotobuf-c1:amd64.}}
{{Preparing to unpack .../05-libprotobuf-c1_1.3.1-1+b1_amd64.deb ...}}
{{Unpacking libprotobuf-c1:amd64 (1.3.1-1+b1) ...}}
{{Selecting previously unselected package libicu63:amd64.}}
{{Preparing to unpack .../06-libicu63_63.1-6+deb10u1_amd64.deb ...}}
{{Unpacking libicu63:amd64 (63.1-6+deb10u1) ...}}
{{Selecting previously unselected package libxml2:amd64.}}
{{Preparing to unpack .../07-libxml2_2.9.4+dfsg1-7+deb10u1_amd64.deb ...}}
{{Unpacking libxml2:amd64 (2.9.4+dfsg1-7+deb10u1) ...}}
{{Selecting previously unselected package libisc1100:amd64.}}
{{Preparing to unpack
.../08-libisc1100_1%3a9.11.5.P4+dfsg-5.1+deb10u2_amd64.deb ...}}
{{Unpacking libisc1100:amd64 (1:9.11.5.P4+dfsg-5.1+deb10u2) ...}}
{{Selecting previously unselected package libkeyutils1:amd64.}}
{{Preparing to unpack .../09-libkeyutils1_1.6-6_amd64.deb ...}}
{{Unpacking libkeyutils1:amd64 (1.6-6) ...}}
{{Selecting previously unselected package libkrb5support0:amd64.}}
{{Preparing to unpack .../10-libkrb5support0_1.17-3+deb10u1_amd64.deb ...}}
{{Unpacking libkrb5support0:amd64 (1.17-3+deb10u1) ...}}
{{Selecting previously unselected package libk5crypto3:amd64.}}
{{Preparing to unpack .../11-libk5crypto3_1.17-3+deb10u1_amd64.deb ...}}
{{Unpacking libk5crypto3:amd64 (1.17-3+deb10u1) ...}}
{{Selecting previously unselected package libkrb5-3:amd64.}}
{{Preparing to unpack .../12-libkrb5-3_1.17-3+deb10u1_amd64.deb ...}}
{{Unpacking libkrb5-3:amd64 (1.17-3+deb10u1) ...}}
{{Selecting previously unselected package libgssapi-krb5-2:amd64.}}
{{Preparing to unpack .../13-libgssapi-krb5-2_1.17-3+deb10u1_amd64.deb ...}}
{{Unpacking libgssapi-krb5-2:amd64 (1.17-3+deb10u1) ...}}
{{Selecting previously unselected package libdns1104:amd64.}}
{{Preparing to unpack
.../14-libdns1104_1%3a9.11.5.P4+dfsg-5.1+deb10u2_amd64.deb ...}}
{{Unpacking libdns1104:amd64 (1:9.11.5.P4+dfsg-5.1+deb10u2) ...}}
{{Selecting previously unselected package libisccc161:amd64.}}
{{Preparing to unpack
.../15-libisccc161_1%3a9.11.5.P4+dfsg-5.1+deb10u2_amd64.deb ...}}
{{Unpacking libisccc161:amd64 (1:9.11.5.P4+dfsg-5.1+deb10u2) ...}}
{{Selecting previously unselected package libisccfg163:amd64.}}
{{Preparing to unpack
.../16-libisccfg163_1%3a9.11.5.P4+dfsg-5.1+deb10u2_amd64.deb ...}}
{{Unpacking libisccfg163:amd64 (1:9.11.5.P4+dfsg-5.1+deb10u2) ...}}
{{Selecting previously unselected package libbind9-161:amd64.}}
{{Preparing to unpack
.../17-libbind9-161_1%3a9.11.5.P4+dfsg-5.1+deb10u2_amd64.deb ...}}
{{Unpacking libbind9-161:amd64 (1:9.11.5.P4+dfsg-5.1+deb10u2) ...}}
{{Selecting previously unselected package liblwres161:amd64.}}
{{Preparing to unpack
.../18-liblwres161_1%3a9.11.5.P4+dfsg-5.1+deb10u2_amd64.deb ...}}
{{Unpacking liblwres161:amd64 (1:9.11.5.P4+dfsg-5.1+deb10u2) ...}}
{{Selecting previously unselected package bind9-host.}}
{{Preparing to unpack
.../19-bind9-host_1%3a9.11.5.P4+dfsg-5.1+deb10u2_amd64.deb ...}}
{{Unpacking bind9-host (1:9.11.5.P4+dfsg-5.1+deb10u2) ...}}
{{Selecting previously unselected package krb5-locales.}}
{{Preparing to unpack .../20-krb5-locales_1.17-3+deb10u1_all.deb ...}}
{{Unpacking krb5-locales (1.17-3+deb10u1) ...}}
{{Selecting previously unselected package geoip-database.}}
{{Preparing to unpack .../21-geoip-database_20181108-1_all.deb ...}}
{{Unpacking geoip-database (20181108-1) ...}}
{{Selecting previously unselected package krb5-config.}}
{{Preparing to unpack .../22-krb5-config_2.6_all.deb ...}}
{{Unpacking krb5-config (2.6) ...}}
{{Selecting previously unselected package libgssrpc4:amd64.}}
{{Preparing to unpack .../23-libgssrpc4_1.17-3+deb10u1_amd64.deb ...}}
{{Unpacking libgssrpc4:amd64 (1.17-3+deb10u1) ...}}
{{Selecting previously unselected package libkadm5clnt-mit11:amd64.}}
{{Preparing to unpack .../24-libkadm5clnt-mit11_1.17-3+deb10u1_amd64.deb ...}}
{{Unpacking libkadm5clnt-mit11:amd64 (1.17-3+deb10u1) ...}}
{{Selecting previously unselected package libkdb5-9:amd64.}}
{{Preparing to unpack .../25-libkdb5-9_1.17-3+deb10u1_amd64.deb ...}}
{{Unpacking libkdb5-9:amd64 (1.17-3+deb10u1) ...}}
{{Selecting previously unselected package libkadm5srv-mit11:amd64.}}
{{Preparing to unpack .../26-libkadm5srv-mit11_1.17-3+deb10u1_amd64.deb ...}}
{{Unpacking libkadm5srv-mit11:amd64 (1.17-3+deb10u1) ...}}
{{Selecting previously unselected package krb5-user.}}
{{Preparing to unpack .../27-krb5-user_1.17-3+deb10u1_amd64.deb ...}}
{{Unpacking krb5-user (1.17-3+deb10u1) ...}}
{{Selecting previously unselected package libnspr4:amd64.}}
{{Preparing to unpack .../28-libnspr4_2%3a4.20-1_amd64.deb ...}}
{{Unpacking libnspr4:amd64 (2:4.20-1) ...}}
{{Selecting previously unselected package libsqlite3-0:amd64.}}
{{Preparing to unpack .../29-libsqlite3-0_3.27.2-3+deb10u1_amd64.deb ...}}
{{Unpacking libsqlite3-0:amd64 (3.27.2-3+deb10u1) ...}}
{{Selecting previously unselected package libnss3:amd64.}}
{{Preparing to unpack .../30-libnss3_2%3a3.42.1-1+deb10u3_amd64.deb ...}}
{{Unpacking libnss3:amd64 (2:3.42.1-1+deb10u3) ...}}
{{Selecting previously unselected package tini.}}
{{Preparing to unpack .../31-tini_0.18.0-1_amd64.deb ...}}
{{Unpacking tini (0.18.0-1) ...}}
{{Setting up liblmdb0:amd64 (0.9.22-1) ...}}
{{Setting up libjson-c3:amd64 (0.12.1+ds-2+deb10u1) ...}}
{{Setting up libkeyutils1:amd64 (1.6-6) ...}}
{{Setting up libfstrm0:amd64 (0.4.0-1) ...}}
{{Setting up libsqlite3-0:amd64 (3.27.2-3+deb10u1) ...}}
{{Setting up krb5-locales (1.17-3+deb10u1) ...}}
{{Setting up libprotobuf-c1:amd64 (1.3.1-1+b1) ...}}
{{Setting up libicu63:amd64 (63.1-6+deb10u1) ...}}
{{Setting up libcap2:amd64 (1:2.25-2) ...}}
{{Setting up libkrb5support0:amd64 (1.17-3+deb10u1) ...}}
{{Setting up libnspr4:amd64 (2:4.20-1) ...}}
{{Setting up tini (0.18.0-1) ...}}
{{Setting up libk5crypto3:amd64 (1.17-3+deb10u1) ...}}
{{Setting up libgeoip1:amd64 (1.6.12-1) ...}}
{{Setting up libkrb5-3:amd64 (1.17-3+deb10u1) ...}}
{{Setting up geoip-database (20181108-1) ...}}
{{Setting up libxml2:amd64 (2.9.4+dfsg1-7+deb10u1) ...}}
{{Setting up libnss3:amd64 (2:3.42.1-1+deb10u3) ...}}
{{Setting up libisc1100:amd64 (1:9.11.5.P4+dfsg-5.1+deb10u2) ...}}
{{Setting up liblwres161:amd64 (1:9.11.5.P4+dfsg-5.1+deb10u2) ...}}
{{Setting up libgssapi-krb5-2:amd64 (1.17-3+deb10u1) ...}}
{{Setting up libisccc161:amd64 (1:9.11.5.P4+dfsg-5.1+deb10u2) ...}}
{{Setting up libdns1104:amd64 (1:9.11.5.P4+dfsg-5.1+deb10u2) ...}}
{{Setting up libgssrpc4:amd64 (1.17-3+deb10u1) ...}}
{{Setting up libkdb5-9:amd64 (1.17-3+deb10u1) ...}}
{{Setting up libisccfg163:amd64 (1:9.11.5.P4+dfsg-5.1+deb10u2) ...}}
{{Setting up libkadm5srv-mit11:amd64 (1.17-3+deb10u1) ...}}
{{Setting up libkadm5clnt-mit11:amd64 (1.17-3+deb10u1) ...}}
{{Setting up libbind9-161:amd64 (1:9.11.5.P4+dfsg-5.1+deb10u2) ...}}
{{Setting up bind9-host (1:9.11.5.P4+dfsg-5.1+deb10u2) ...}}
{{Setting up krb5-config (2.6) ...}}
{{debconf: unable to initialize frontend: Dialog}}
{{debconf: (TERM is not set, so the dialog frontend is not usable.)}}
{{debconf: falling back to frontend: Readline}}
{{debconf: unable to initialize frontend: Readline}}
{{debconf: (Can't locate Term/ReadLine.pm in @INC (you may need to install the
Term::ReadLine module) (@INC contains: /etc/perl
/usr/local/lib/x86_64-linux-gnu/perl/5.28.1 /usr/local/share/perl/5.28.1
/usr/lib/x86_64-linux-gnu/perl5/5.28 /usr/share/perl5
/usr/lib/x86_64-linux-gnu/perl/5.28 /usr/share/perl/5.28
/usr/local/lib/site_perl /usr/lib/x86_64-linux-gnu/perl-base) at
/usr/share/perl5/Debconf/FrontEnd/Readline.pm line 7.)}}
{{debconf: falling back to frontend: Teletype}}
{{Configuring Kerberos Authentication}}
{{-----------------------------------}}{{When users attempt to use Kerberos and
specify a principal or user name without}}
{{specifying what administrative Kerberos realm that principal belongs to, the}}
{{system appends the default realm. The default realm may also be used as the}}
{{realm of a Kerberos service running on the local machine. Often, the default}}
{{realm is the uppercase version of the local DNS domain.}}{{Default Kerberos
version 5 realm: EXAMPLE.COM}}{{ }}{{^CFailed to build Spark JVM Docker image,
please refer to Docker build output for details}}
Reporter: Tim Hughes
When building the docker containers using the docker-image-tool.sh there is RUN
`apt install -y bash tini libc6 libpam-modules krb5-user libnss3` Which leads
to `debconf` trying to configure kerberos. I have tried putting nothing,
EXAMPLE.COM, my corporate kerberos realm and none of them work. it just hangs
after enter is pressed
{{Setting up krb5-config (2.6) ...}}
{{debconf: unable to initialize frontend: Dialog}}
{{debconf: (TERM is not set, so the dialog frontend is not usable.)}}
{{debconf: falling back to frontend: Readline}}
{{debconf: unable to initialize frontend: Readline}}
{{debconf: (Can't locate Term/ReadLine.pm in @INC (you may need to install the
Term::ReadLine module) (@INC contains: /etc/perl
/usr/local/lib/x86_64-linux-gnu/perl/5.28.1 /usr/local/share/perl/5.28.1
/usr/lib/x86_64-linux-gnu/perl5/5.28 /usr/share/perl5
/usr/lib/x86_64-linux-gnu/perl/5.28 /usr/share/perl/5.28
/usr/local/lib/site_perl /usr/lib/x86_64-linux-gnu/perl-base) at
/usr/share/perl5/Debconf/FrontEnd/Readline.pm line 7.)}}
{{debconf: falling back to frontend: Teletype}}
{{Configuring Kerberos Authentication}}
{{-----------------------------------}}
{{When users attempt to use Kerberos and specify a principal or user name
without}}
{{specifying what administrative Kerberos realm that principal belongs to, the}}
{{system appends the default realm. The default realm may also be used as the}}
{{realm of a Kerberos service running on the local machine. Often, the default}}
{{realm is the uppercase version of the local DNS domain.}}
{{Default Kerberos version 5 realm: EXAMPLE.ORG}}
{{^CFailed to build Spark JVM Docker image, please refer to Docker build output
for details.}}
{{## Steps to reproduce}}
{{```}}
{{wget -qO-
https://www.mirrorservice.org/sites/ftp.apache.org/spark/spark-3.0.1/spark-3.0.1-bin-hadoop3.2.tgz
| tar -xzf -}}
{{cd spark-3.0.1-bin-hadoop3.2/}}
{{./bin/docker-image-tool.sh build}}
{{```}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
