Richard Kugler created SPARK-25516: -------------------------------------- Summary: spark-history and spark-shuffle-service scripts can not run in docker image Key: SPARK-25516 URL: https://issues.apache.org/jira/browse/SPARK-25516 Project: Spark Issue Type: Bug Components: Kubernetes Affects Versions: 2.3.1 Environment: Docker 18.06 Reporter: Richard Kugler
When attempting to run ./sbin/start-shuffle-service.sh the image errors with the following output: {noformat} ps: unrecognized option: p {noformat} Adding the {{procps}} package fixes this issue. After correcting the issue with {{ps}}, the code will then error with: {{}} {noformat} nohup: can't execute '--': No such file or directory{noformat} This is remedied with the inclusion of {{coreutils}} to the apk add statement. The ./sbin/start-history-server.sh also requires the added packages to successfully start. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org