[jira] [Updated] (SPARK-47206) Add official image Dockerfile for Apache Spark 3.5.1

2024-02-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-47206: Fix Version/s: 3.5.1 (was: 4.0.0) > Add official image Dockerfile for

[jira] [Assigned] (SPARK-47206) Add official image Dockerfile for Apache Spark 3.5.1

2024-02-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-47206: --- Assignee: Yikun Jiang > Add official image Dockerfile for Apache Spark 3.5.1 >

[jira] [Resolved] (SPARK-47206) Add official image Dockerfile for Apache Spark 3.5.1

2024-02-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-47206. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 59

[jira] [Updated] (SPARK-47206) Add official image Dockerfile for Apache Spark 3.5.1

2024-02-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-47206: Summary: Add official image Dockerfile for Apache Spark 3.5.1 (was: [SPARK-45169] Add official

[jira] [Created] (SPARK-47206) [SPARK-45169] Add official image Dockerfile for Apache Spark 3.5.1

2024-02-27 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-47206: --- Summary: [SPARK-45169] Add official image Dockerfile for Apache Spark 3.5.1 Key: SPARK-47206 URL: https://issues.apache.org/jira/browse/SPARK-47206 Project: Spark

[jira] [Resolved] (SPARK-46209) Add docker java 11 only publish workflow for version before v3.5

2023-12-02 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-46209. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 58

[jira] [Created] (SPARK-46209) Add docker java 11 only publish workflow for version before v3.5

2023-12-01 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-46209: --- Summary: Add docker java 11 only publish workflow for version before v3.5 Key: SPARK-46209 URL: https://issues.apache.org/jira/browse/SPARK-46209 Project: Spark

[jira] [Created] (SPARK-46185) Add Apache Spark 3.4.2 Dockerfiles

2023-11-30 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-46185: --- Summary: Add Apache Spark 3.4.2 Dockerfiles Key: SPARK-46185 URL: https://issues.apache.org/jira/browse/SPARK-46185 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-43305) Add Java17 dockerfiles for 3.5.0

2023-11-09 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17784669#comment-17784669 ] Yikun Jiang commented on SPARK-43305: - Resolved by https://github.com/apache/spark-docker/pull/56 >

[jira] [Updated] (SPARK-43305) Add Java17 dockerfiles for 3.5.0

2023-11-09 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-43305: Summary: Add Java17 dockerfiles for 3.5.0 (was: Add Java17 dockerfiles for 3.4.0) > Add Java17

[jira] [Resolved] (SPARK-45169) Add official image Dockerfile for Apache Spark 3.5.0

2023-09-14 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-45169. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 55

[jira] [Created] (SPARK-45169) Add official image Dockerfile for Apache Spark 3.5.0

2023-09-14 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-45169: --- Summary: Add official image Dockerfile for Apache Spark 3.5.0 Key: SPARK-45169 URL: https://issues.apache.org/jira/browse/SPARK-45169 Project: Spark Issue

[jira] [Resolved] (SPARK-44235) Add --batch to gpg command

2023-06-29 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-44235. - Fix Version/s: 3.5.0 Resolution: Fixed https://github.com/apache/spark-docker/pull/51 >

[jira] [Created] (SPARK-44235) Add --batch to gpg command

2023-06-28 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-44235: --- Summary: Add --batch to gpg command Key: SPARK-44235 URL: https://issues.apache.org/jira/browse/SPARK-44235 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-40513) SPIP: Support Docker Official Image for Spark

2023-06-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40513: --- Assignee: Yikun Jiang > SPIP: Support Docker Official Image for Spark >

[jira] [Resolved] (SPARK-40513) SPIP: Support Docker Official Image for Spark

2023-06-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40513. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 34

[jira] [Resolved] (SPARK-44175) Remove useless lib64 path link in dockerfile

2023-06-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-44175. - Fix Version/s: 3.5.0 Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-44177) Add 'set -eo pipefail' to entrypoint and quote variables

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-44177. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49

[jira] [Assigned] (SPARK-44177) Add 'set -eo pipefail' to entrypoint and quote variables

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-44177: --- Assignee: Yikun Jiang > Add 'set -eo pipefail' to entrypoint and quote variables >

[jira] [Updated] (SPARK-44177) Add 'set -eo pipefail' to entrypoint and quote variables

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-44177: Fix Version/s: 3.5.0 (was: 4.0.0) > Add 'set -eo pipefail' to entrypoint

[jira] [Resolved] (SPARK-44176) Change apt to apt-get and remove useless cleanup

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-44176. - Fix Version/s: 3.5.0 Resolution: Fixed > Change apt to apt-get and remove useless

[jira] [Assigned] (SPARK-44176) Change apt to apt-get and remove useless cleanup

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-44176: --- Assignee: Yikun Jiang > Change apt to apt-get and remove useless cleanup >

[jira] [Commented] (SPARK-44177) Add 'set -eo pipefail' to entrypoint and quote variables

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737004#comment-17737004 ] Yikun Jiang commented on SPARK-44177: - https://github.com/apache/spark-docker/pull/49 Harish Gontu

[jira] [Commented] (SPARK-44176) Change apt to apt-get and remove useless cleanup

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737003#comment-17737003 ] Yikun Jiang commented on SPARK-44176: - https://github.com/apache/spark-docker/pull/47 [~harry] I am

[jira] [Commented] (SPARK-44175) Remove useless lib64 path link in dockerfile

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737002#comment-17737002 ] Yikun Jiang commented on SPARK-44175: - https://github.com/apache/spark-docker/pull/48 [~harry]I'm

[jira] [Created] (SPARK-44177) Add 'set -eo pipefail' to entrypoint and quote variables

2023-06-25 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-44177: --- Summary: Add 'set -eo pipefail' to entrypoint and quote variables Key: SPARK-44177 URL: https://issues.apache.org/jira/browse/SPARK-44177 Project: Spark Issue

[jira] [Created] (SPARK-44176) Change apt to apt-get and remove useless cleanup

2023-06-25 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-44176: --- Summary: Change apt to apt-get and remove useless cleanup Key: SPARK-44176 URL: https://issues.apache.org/jira/browse/SPARK-44176 Project: Spark Issue Type:

[jira] [Created] (SPARK-44175) Remove useless lib64 path link in dockerfile

2023-06-25 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-44175: --- Summary: Remove useless lib64 path link in dockerfile Key: SPARK-44175 URL: https://issues.apache.org/jira/browse/SPARK-44175 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-44168) Add Apache Spark 3.4.1 Dockerfiles

2023-06-24 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-44168: --- Assignee: Yikun Jiang > Add Apache Spark 3.4.1 Dockerfiles >

[jira] [Created] (SPARK-44168) Add Apache Spark 3.4.1 Dockerfiles

2023-06-24 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-44168: --- Summary: Add Apache Spark 3.4.1 Dockerfiles Key: SPARK-44168 URL: https://issues.apache.org/jira/browse/SPARK-44168 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-43368) Address DOI comments about /etc/passwd

2023-06-01 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-43368: --- Assignee: Yikun Jiang > Address DOI comments about /etc/passwd >

[jira] [Resolved] (SPARK-43368) Address DOI comments about /etc/passwd

2023-06-01 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-43368. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 45

[jira] [Assigned] (SPARK-43370) Switch spark user only when run driver and executor

2023-06-01 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-43370: --- Assignee: Yikun Jiang > Switch spark user only when run driver and executor >

[jira] [Resolved] (SPARK-43370) Switch spark user only when run driver and executor

2023-06-01 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-43370. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 43

[jira] [Comment Edited] (SPARK-43369) Address comments about /etc/pam.d/su

2023-05-31 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17728207#comment-17728207 ] Yikun Jiang edited comment on SPARK-43369 at 6/1/23 4:15 AM: - This might not

[jira] [Commented] (SPARK-43369) Address comments about /etc/pam.d/su

2023-05-31 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17728207#comment-17728207 ] Yikun Jiang commented on SPARK-43369: - This might not a issue according to

[jira] [Comment Edited] (SPARK-43368) Address DOI comments about /etc/passwd

2023-05-31 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17728206#comment-17728206 ] Yikun Jiang edited comment on SPARK-43368 at 6/1/23 4:14 AM: - - The mainly

[jira] [Commented] (SPARK-43368) Address DOI comments about /etc/passwd

2023-05-31 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17728206#comment-17728206 ] Yikun Jiang commented on SPARK-43368: - - The mainly issue in here is wider permissions on

[jira] [Resolved] (SPARK-43806) Add awesome-spark-docker.md

2023-05-25 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-43806. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 28

[jira] [Assigned] (SPARK-43806) Add awesome-spark-docker.md

2023-05-25 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-43806: --- Assignee: Yikun Jiang > Add awesome-spark-docker.md > --- > >

[jira] [Created] (SPARK-43806) Add awesome-spark-docker.md

2023-05-25 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-43806: --- Summary: Add awesome-spark-docker.md Key: SPARK-43806 URL: https://issues.apache.org/jira/browse/SPARK-43806 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-43367) Recover sh support in Dockerfiles

2023-05-25 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-43367: --- Assignee: Yikun Jiang > Recover sh support in Dockerfiles >

[jira] [Resolved] (SPARK-43367) Recover sh support in Dockerfiles

2023-05-25 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-43367. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41

[jira] [Resolved] (SPARK-43793) Fix SPARK_EXECUTOR_JAVA_OPTS assignment bug

2023-05-25 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-43793. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42

[jira] [Created] (SPARK-43793) Fix SPARK_EXECUTOR_JAVA_OPTS assignment bug

2023-05-25 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-43793: --- Summary: Fix SPARK_EXECUTOR_JAVA_OPTS assignment bug Key: SPARK-43793 URL: https://issues.apache.org/jira/browse/SPARK-43793 Project: Spark Issue Type:

[jira] [Updated] (SPARK-43367) Recover sh support in Dockerfiles

2023-05-25 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-43367: Description: rm /bin/sh && ln -sv /bin/bash /bin/sh Does spark expect /bin/sh to be bash (in

[jira] [Assigned] (SPARK-43372) Use ; instead of && when enable set -ex

2023-05-07 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-43372: --- Assignee: Yikun Jiang > Use ; instead of && when enable set -ex >

[jira] [Resolved] (SPARK-43372) Use ; instead of && when enable set -ex

2023-05-07 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-43372. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 38

[jira] [Commented] (SPARK-43388) Latest docker Spark image has critical CVE

2023-05-07 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720368#comment-17720368 ] Yikun Jiang commented on SPARK-43388: - Thanks for report. - The critical issue is related to

[jira] [Resolved] (SPARK-43371) minimize duplication across layers for chmod

2023-05-06 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-43371. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 37

[jira] [Assigned] (SPARK-43371) minimize duplication across layers for chmod

2023-05-06 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-43371: --- Assignee: Yikun Jiang > minimize duplication across layers for chmod >

[jira] [Resolved] (SPARK-43365) Refactor Dockerfile and workflow based on base image

2023-05-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-43365. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 36

[jira] [Commented] (SPARK-43369) Address comments about /etc/pam.d/su

2023-05-04 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719223#comment-17719223 ] Yikun Jiang commented on SPARK-43369: - Related original change:

[jira] [Commented] (SPARK-43368) Address DOI comments about /etc/passwd

2023-05-04 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719220#comment-17719220 ] Yikun Jiang commented on SPARK-43368: - Related original changes:

[jira] [Created] (SPARK-43372) Use ; instead of && when enable set -ex

2023-05-03 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-43372: --- Summary: Use ; instead of && when enable set -ex Key: SPARK-43372 URL: https://issues.apache.org/jira/browse/SPARK-43372 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-43365) Refactor Dockerfile and workflow based on base image

2023-05-03 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719129#comment-17719129 ] Yikun Jiang commented on SPARK-43365: - I'm working on this > Refactor Dockerfile and workflow based

[jira] [Assigned] (SPARK-43365) Refactor Dockerfile and workflow based on base image

2023-05-03 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-43365: --- Assignee: Yikun Jiang > Refactor Dockerfile and workflow based on base image >

[jira] [Created] (SPARK-43371) minimize duplication across layers for chmod

2023-05-03 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-43371: --- Summary: minimize duplication across layers for chmod Key: SPARK-43371 URL: https://issues.apache.org/jira/browse/SPARK-43371 Project: Spark Issue Type:

[jira] [Created] (SPARK-43370) Switch spark user only when run driver and executor

2023-05-03 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-43370: --- Summary: Switch spark user only when run driver and executor Key: SPARK-43370 URL: https://issues.apache.org/jira/browse/SPARK-43370 Project: Spark Issue

[jira] [Created] (SPARK-43369) Address comments about /etc/pam.d/su

2023-05-03 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-43369: --- Summary: Address comments about /etc/pam.d/su Key: SPARK-43369 URL: https://issues.apache.org/jira/browse/SPARK-43369 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43368) Address DOI comments about /etc/passwd

2023-05-03 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-43368: --- Summary: Address DOI comments about /etc/passwd Key: SPARK-43368 URL: https://issues.apache.org/jira/browse/SPARK-43368 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43367) Recover sh support in Dockerfiles

2023-05-03 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-43367: --- Summary: Recover sh support in Dockerfiles Key: SPARK-43367 URL: https://issues.apache.org/jira/browse/SPARK-43367 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43365) Refactor Dockerfile and workflow based on base image

2023-05-03 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-43365: --- Summary: Refactor Dockerfile and workflow based on base image Key: SPARK-43365 URL: https://issues.apache.org/jira/browse/SPARK-43365 Project: Spark Issue

[jira] [Created] (SPARK-43305) Add Java17 dockerfiles for 3.4.0

2023-04-27 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-43305: --- Summary: Add Java17 dockerfiles for 3.4.0 Key: SPARK-43305 URL: https://issues.apache.org/jira/browse/SPARK-43305 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43247) Add apache/spark docker image overview

2023-04-24 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-43247: --- Summary: Add apache/spark docker image overview Key: SPARK-43247 URL: https://issues.apache.org/jira/browse/SPARK-43247 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-43148) Add official image dockerfile for Spark v3.4.0

2023-04-17 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-43148: --- Assignee: Yikun Jiang > Add official image dockerfile for Spark v3.4.0 >

[jira] [Resolved] (SPARK-43148) Add official image dockerfile for Spark v3.4.0

2023-04-17 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-43148. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 33

[jira] [Created] (SPARK-43148) Add official image dockerfile for Spark v3.4.0

2023-04-14 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-43148: --- Summary: Add official image dockerfile for Spark v3.4.0 Key: SPARK-43148 URL: https://issues.apache.org/jira/browse/SPARK-43148 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42787) in spark-py docker images, arrowkeys do not work in (scala) spark-shell

2023-03-29 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706653#comment-17706653 ] Yikun Jiang commented on SPARK-42787: - you can also paste the execute script here, to help us

[jira] [Updated] (SPARK-40513) SPIP: Support Docker Official Image for Spark

2023-03-23 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-40513: Affects Version/s: 3.5.0 (was: 3.4.0) > SPIP: Support Docker Official

[jira] [Commented] (SPARK-40513) SPIP: Support Docker Official Image for Spark

2023-03-23 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704085#comment-17704085 ] Yikun Jiang commented on SPARK-40513: - Due to

[jira] [Commented] (SPARK-42787) in spark-py docker images, arrowkeys do not work in (scala) spark-shell

2023-03-19 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702434#comment-17702434 ] Yikun Jiang commented on SPARK-42787: - > while it works for pyspark, it does not for the scala

[jira] [Commented] (SPARK-42788) spark binaries are not added to $PATH in public docker hub spark-py

2023-03-19 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702433#comment-17702433 ] Yikun Jiang commented on SPARK-42788: - Yes, I think we can add a line like: {code:java} ENV

[jira] [Comment Edited] (SPARK-42788) spark binaries are not added to $PATH in public docker hub spark-py

2023-03-19 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702433#comment-17702433 ] Yikun Jiang edited comment on SPARK-42788 at 3/20/23 4:04 AM: -- Yes, I think

[jira] [Resolved] (SPARK-42505) Apply entrypoint template change to 3.3.0/3.3.1

2023-02-21 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-42505. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 31

[jira] [Assigned] (SPARK-42505) Apply entrypoint template change to 3.3.0/3.3.1

2023-02-21 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-42505: --- Assignee: Yikun Jiang > Apply entrypoint template change to 3.3.0/3.3.1 >

[jira] [Created] (SPARK-42505) Apply entrypoint template change to 3.3.0/3.3.1

2023-02-20 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-42505: --- Summary: Apply entrypoint template change to 3.3.0/3.3.1 Key: SPARK-42505 URL: https://issues.apache.org/jira/browse/SPARK-42505 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-42494) Add official image Dockerfile for Spark v3.3.2

2023-02-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-42494. - Resolution: Fixed Resolved by https://github.com/apache/spark-docker/pull/30 > Add official

[jira] [Assigned] (SPARK-42494) Add official image Dockerfile for Spark v3.3.2

2023-02-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-42494: --- Assignee: Yikun Jiang > Add official image Dockerfile for Spark v3.3.2 >

[jira] [Created] (SPARK-42494) Add official image Dockerfile for Spark v3.3.2

2023-02-19 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-42494: --- Summary: Add official image Dockerfile for Spark v3.3.2 Key: SPARK-42494 URL: https://issues.apache.org/jira/browse/SPARK-42494 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-42214) Branch-3.4 daily test failed

2023-01-30 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-42214. - Assignee: Yikun Jiang Resolution: Fixed Branch-3.4 scheduled job recovered:

[jira] [Commented] (SPARK-42214) Branch-3.4 daily test failed

2023-01-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17681526#comment-17681526 ] Yikun Jiang commented on SPARK-42214: -

[jira] [Resolved] (SPARK-40520) Add a script to generate DOI mainifest

2022-12-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40520. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 27

[jira] [Assigned] (SPARK-40518) Add Spark Docker Official Image doc

2022-12-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40518: --- Assignee: Yikun Jiang > Add Spark Docker Official Image doc >

[jira] [Assigned] (SPARK-40520) Add a script to generate DOI mainifest

2022-12-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40520: --- Assignee: Yikun Jiang > Add a script to generate DOI mainifest >

[jira] [Assigned] (SPARK-40518) Add Spark Docker Official Image doc

2022-12-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40518: --- Assignee: (was: Yikun Jiang) > Add Spark Docker Official Image doc >

[jira] [Updated] (SPARK-40513) SPIP: Support Docker Official Image for Spark

2022-12-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-40513: Component/s: Spark Docker (was: PySpark) (was: SparkR)

[jira] [Updated] (SPARK-38921) Use k8s-client to create queue resource in Volcano IT

2022-12-03 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38921: Affects Version/s: 3.3.2 > Use k8s-client to create queue resource in Volcano IT >

[jira] [Updated] (SPARK-41253) Make K8s volcano IT work in Github Action

2022-12-03 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-41253: Affects Version/s: 3.3.2 > Make K8s volcano IT work in Github Action >

[jira] [Assigned] (SPARK-41287) Add a test workflow to help test image in fork repo

2022-11-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-41287: --- Assignee: Yikun Jiang > Add a test workflow to help test image in fork repo >

[jira] [Resolved] (SPARK-41287) Add a test workflow to help test image in fork repo

2022-11-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-41287. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 26

[jira] [Updated] (SPARK-41287) Add a test workflow to help test image in fork repo

2022-11-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-41287: Summary: Add a test workflow to help test image in fork repo (was: Add a test workflow to help

[jira] [Created] (SPARK-41287) Add a test workflow to help test image

2022-11-27 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-41287: --- Summary: Add a test workflow to help test image Key: SPARK-41287 URL: https://issues.apache.org/jira/browse/SPARK-41287 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-41269) Move image matrix into version's workflow

2022-11-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-41269. - Fix Version/s: 3.4.0 Assignee: Yikun Jiang Resolution: Fixed > Move image

[jira] [Updated] (SPARK-41269) Move image matrix into version's workflow

2022-11-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-41269: Parent: SPARK-40513 Issue Type: Sub-task (was: Bug) > Move image matrix into version's

[jira] [Commented] (SPARK-41269) Move image matrix into version's workflow

2022-11-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17639739#comment-17639739 ] Yikun Jiang commented on SPARK-41269: - Resolved by https://github.com/apache/spark-docker/pull/25 >

[jira] [Created] (SPARK-41269) Move image matrix into version's workflow

2022-11-25 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-41269: --- Summary: Move image matrix into version's workflow Key: SPARK-41269 URL: https://issues.apache.org/jira/browse/SPARK-41269 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-41258) Upgrade spark-docker actions

2022-11-24 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-41258: --- Assignee: Yikun Jiang > Upgrade spark-docker actions > > >

[jira] [Resolved] (SPARK-41258) Upgrade spark-docker actions

2022-11-24 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-41258. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 24

[jira] [Created] (SPARK-41258) Upgrade spark-docker actions

2022-11-24 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-41258: --- Summary: Upgrade spark-docker actions Key: SPARK-41258 URL: https://issues.apache.org/jira/browse/SPARK-41258 Project: Spark Issue Type: Sub-task

  1   2   3   4   5   6   7   >