https://github.com/GoogleCloudPlatform/python-docs-samples/tree/main/dataflow/flex-templates/pipeline_with_dependencies
is a great example.
On Mon, Jun 10, 2024 at 4:28 PM Valentyn Tymofieiev via user <
user@beam.apache.org> wrote:
> In this case the Python version will be defined by the Python
In this case the Python version will be defined by the Python version
installed in the docker image of your flex template. So, you'd have to
build your flex template from a base image with Python 3.11.
On Mon, Jun 10, 2024 at 12:50 PM Sofia’s World wrote:
> Hello
> no i am running my pipelien
Hello
no i am running my pipelien on GCP directly via a flex template,
configured using a Docker file
Any chances to do something in the Dockerfile to force the version at
runtime?
Thanks
On Mon, Jun 10, 2024 at 7:24 PM Anand Inguva via user
wrote:
> Hello,
>
> Are you running your pipeline
Hello,
Are you running your pipeline from the python 3.11 environment? If you are
running from a python 3.11 environment and don't use a custom docker
container image, DataflowRunner(Assuming Apache Beam on GCP means Apache
Beam on DataflowRunner), will use Python 3.11.
Thanks,
Anand
If you could use py 3.11 locally, you will get python 3.11 in your cloud
environment as well. Is that not happening?
When you run Apache Beam on GCP, the python version you are using in your
local virtual environment will be used in the cloud environment as well. I
believe this is true for
Hello
sorry for the partially off topic question
I am running a pipeline in which one of hte dependencies need to run on py
3.11
But i dont see any options that allow me to force the python version to be
used
Could anyone help?
Kind regards
Marco
