Obligatory question: can we automate this? Specifically: can we publish the
ML-specific containers and then use them as appropriate without making it a
user-facing knob?

Kenn

On Mon, Jun 30, 2025 at 12:07 PM Danny McCormick via dev <
dev@beam.apache.org> wrote:

> Hey everyone, I'd like to propose publishing some ML-specific Beam
> containers alongside our normal base containers. The end result would be
> allowing users to specify `--sdk_container_image=ml` or
> `--sdk_container_image=gpu` so that their jobs run in containers which work
> well with ML/GPU jobs.
>
> I put together a tiny design, please take a look and let me know what you
> think.
>
>
> https://docs.google.com/document/d/1JcVFJsPbVvtvaYdGi-DzWy9PIIYJhL7LwWGEXt2NZMk/edit?usp=sharing
>
> Thanks,
> Danny
>

Reply via email to