GitHub user BYondRAK opened a pull request:
https://github.com/apache/spark/pull/22538
[k8s]Utilities needed for spark-history and spark-shuffle-service
## Summary
When attempting to run ./sbin/start-shuffle-service.sh the image errors
with the following output:
`ps: unrecognized option: p`
Adding the `procps` package fixes this issue.
After correcting the issue with `ps`, the code will then error with:
`nohup: can't execute '--': No such file or directory`
This is remedied with the inclusion of `coreutils` to the apk add statement.
The ./sbin/start-history-server.sh also requires the added packages to
successfully start.
## What changes were proposed in this pull request?
Adding procps and coreutils to enable this image to execute the
spark-history and spark-shuffle-service shell scripts.
## How was this patch tested?
Tested via docker manually
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/BYondRAK/spark dockerfile_apk_pkgs
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22538.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22538
----
commit a81c3515ed12e08ee17a510d5f3e5801d95676b0
Author: Richard Kugler <36081947+byondrak@...>
Date: 2018-09-24T18:06:27Z
Utilities needed for spark-history and spark-shuffle-service
Adding procps and coreutils to enable this image to execute the
spark-history and spark-shuffle-service shell scripts.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
