This is an automated email from the ASF dual-hosted git repository.
yikun pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark-docker.git
The following commit(s) were added to refs/heads/master by this push:
new 6f36415 [SPARK-44168] Add Apache Spark 3.4.1 Dockerfiles
6f36415 is described below
commit 6f3641534a97a80491cba926cc7a5e67972494ea
Author: Yikun Jiang
AuthorDate: Sun Jun 25 10:51:46 2023 +0800
[SPARK-44168] Add Apache Spark 3.4.1 Dockerfiles
### What changes were proposed in this pull request?
Add Apache Spark 3.4.1 Dockerfiles.
- Add 3.4.1 GPG key
- Add .github/workflows/build_3.4.1.yaml
- ./add-dockerfiles.sh 3.4.1
- Add version and tag info
### Why are the changes needed?
Apache Spark 3.4.1 released:
https://spark.apache.org/releases/spark-release-3-4-1.html
### Does this PR introduce _any_ user-facing change?
Docker image will be published.
### How was this patch tested?
Add workflow and CI passed
Closes #46 from Yikun/3.4.1.
Authored-by: Yikun Jiang
Signed-off-by: Yikun Jiang
---
.github/workflows/build_3.4.1.yaml | 41 +++
.github/workflows/publish.yml | 3 +-
.github/workflows/test.yml | 3 +-
3.4.1/scala2.12-java11-python3-r-ubuntu/Dockerfile | 30 +
3.4.1/scala2.12-java11-python3-ubuntu/Dockerfile | 27 +
3.4.1/scala2.12-java11-r-ubuntu/Dockerfile | 29 +
3.4.1/scala2.12-java11-ubuntu/Dockerfile | 81 ++
3.4.1/scala2.12-java11-ubuntu/entrypoint.sh| 123 +
tools/template.py | 2 +
versions.json | 42 +--
10 files changed, 372 insertions(+), 9 deletions(-)
diff --git a/.github/workflows/build_3.4.1.yaml
b/.github/workflows/build_3.4.1.yaml
new file mode 100644
index 000..2eba18e
--- /dev/null
+++ b/.github/workflows/build_3.4.1.yaml
@@ -0,0 +1,41 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+#
+
+name: "Build and Test (3.4.1)"
+
+on:
+ pull_request:
+branches:
+ - 'master'
+paths:
+ - '3.4.1/**'
+
+jobs:
+ run-build:
+strategy:
+ matrix:
+image-type: ["all", "python", "scala", "r"]
+name: Run
+secrets: inherit
+uses: ./.github/workflows/main.yml
+with:
+ spark: 3.4.1
+ scala: 2.12
+ java: 11
+ image-type: ${{ matrix.image-type }}
diff --git a/.github/workflows/publish.yml b/.github/workflows/publish.yml
index 3063bfe..1138a9f 100644
--- a/.github/workflows/publish.yml
+++ b/.github/workflows/publish.yml
@@ -25,9 +25,10 @@ on:
spark:
description: 'The Spark version of Spark image.'
required: true
-default: '3.4.0'
+default: '3.4.1'
type: choice
options:
+- 3.4.1
- 3.4.0
- 3.3.2
- 3.3.1
diff --git a/.github/workflows/test.yml b/.github/workflows/test.yml
index 06e2321..4136f1c 100644
--- a/.github/workflows/test.yml
+++ b/.github/workflows/test.yml
@@ -25,9 +25,10 @@ on:
spark:
description: 'The Spark version of Spark image.'
required: true
-default: '3.4.0'
+default: '3.4.1'
type: choice
options:
+- 3.4.1
- 3.4.0
- 3.3.2
- 3.3.1
diff --git a/3.4.1/scala2.12-java11-python3-r-ubuntu/Dockerfile
b/3.4.1/scala2.12-java11-python3-r-ubuntu/Dockerfile
new file mode 100644
index 000..95c98b9
--- /dev/null
+++ b/3.4.1/scala2.12-java11-python3-r-ubuntu/Dockerfile
@@ -0,0 +1,30 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+#http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+#
