Richard Kugler created SPARK-25516:
--------------------------------------

             Summary: spark-history and spark-shuffle-service scripts can not 
run in docker image
                 Key: SPARK-25516
                 URL: https://issues.apache.org/jira/browse/SPARK-25516
             Project: Spark
          Issue Type: Bug
          Components: Kubernetes
    Affects Versions: 2.3.1
         Environment: Docker 18.06
            Reporter: Richard Kugler


When attempting to run ./sbin/start-shuffle-service.sh the image errors with 
the following output:
{noformat}
ps: unrecognized option: p
{noformat}
Adding the {{procps}} package fixes this issue.


After correcting the issue with {{ps}}, the code will then error with:
{{}}
{noformat}
nohup: can't execute '--': No such file or directory{noformat}
This is remedied with the inclusion of {{coreutils}} to the apk add statement.

 

 

The ./sbin/start-history-server.sh also requires the added packages to 
successfully start.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to