MonkeyCanCode commented on code in PR #896:
URL: https://github.com/apache/polaris/pull/896#discussion_r1932227591
##########
regtests/Dockerfile:
##########
@@ -17,14 +17,14 @@
# under the License.
#
-FROM docker.io/apache/spark:3.5.4-python3
+FROM docker.io/apache/spark:3.5.4-java17-python3
ARG POLARIS_HOST=polaris
ENV POLARIS_HOST=$POLARIS_HOST
ENV SPARK_HOME=/opt/spark
USER root
RUN apt update
-RUN apt-get install -y diffutils wget curl python3.8-venv
+RUN apt-get install -y diffutils wget curl python3.10-venv
Review Comment:
A bit more context for those base images...Official Spark JDK 11 is based
off `eclipse-temurin:11-jre-focal` which is built on top of `ubuntu:20.04`
while official Spark JDK 17 is based off `eclipse-temurin:17.0.3_7-jdk-jammy`
which is built on top of `ubuntu:22.04`. And here is the python3 will resolve
to for each of them when using apt with default repo (so to get diff version
and not compile from source, we can also try to point to diff branch of the
repo as well diff repo):
```
$ docker run -it ubuntu:20.04 /bin/bash
root@48dfe9519115:/# apt-cache madison python3
python3 | 3.8.2-0ubuntu2 | http://archive.ubuntu.com/ubuntu focal/main
amd64 Packages
$ docker run -it ubuntu:22.04 /bin/bash
root@1a6950f03ad8:/# apt-cache madison python3
python3 | 3.10.6-1~22.04.1 | http://archive.ubuntu.com/ubuntu
jammy-updates/main amd64 Packages
python3 | 3.10.6-1~22.04 | http://security.ubuntu.com/ubuntu
jammy-security/main amd64 Packages
python3 | 3.10.4-0ubuntu2 | http://archive.ubuntu.com/ubuntu jammy/main
amd64 Packages
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
