Re: Toward an "API" for spark images used by the Kubernetes back-end

I like being able to customize the docker image itself - but I realize this thread is more about “API” for the stock image. Environment is nice. Probably we need a way to set custom spark config (as a file??) From: Holden Karau Sent:

Re: Toward an "API" for spark images used by the Kubernetes back-end

I’m glad this discussion is happening on dev@ :) Personally I like customizing with shell env variables during rolling my own image, but definitely documentation the expectations/usage of the variables is needed before we can really call it an API. On the related question I suspect two of the

Toward an "API" for spark images used by the Kubernetes back-end

During the review of the recent PR to remove use of the init_container from kube pods as created by the Kubernetes back-end, the topic of documenting the "API" for these container images also came up. What information does the back-end provide to these containers? In what form? What assumptions

RE: Beginner searching for guidance with Jira and issues

Thanks a lot Jose, I’ll look into the issue you’ve recommended then. Will comment on Jira to indicate I’m working on it and ask further questions there if needed. BR, Efim From: Joseph Torres [mailto:joseph.tor...@databricks.com] Sent: Tuesday, March 20, 2018 8:41 PM To: Efim Poberezkin