Re: Apache Bean on GCP / Forcing to use py 3.11
https://github.com/GoogleCloudPlatform/python-docs-samples/tree/main/dataflow/flex-templates/pipeline_with_dependencies is a great example. On Mon, Jun 10, 2024 at 4:28 PM Valentyn Tymofieiev via user < user@beam.apache.org> wrote: > In this case the Python version will be defined by the Python version > installed in the docker image of your flex template. So, you'd have to > build your flex template from a base image with Python 3.11. > > On Mon, Jun 10, 2024 at 12:50 PM Sofia’s World > wrote: > >> Hello >> no i am running my pipelien on GCP directly via a flex template, >> configured using a Docker file >> Any chances to do something in the Dockerfile to force the version at >> runtime? >> Thanks >> >> On Mon, Jun 10, 2024 at 7:24 PM Anand Inguva via user < >> user@beam.apache.org> wrote: >> >>> Hello, >>> >>> Are you running your pipeline from the python 3.11 environment? If you >>> are running from a python 3.11 environment and don't use a custom docker >>> container image, DataflowRunner(Assuming Apache Beam on GCP means Apache >>> Beam on DataflowRunner), will use Python 3.11. >>> >>> Thanks, >>> Anand >>> >>
Re: Apache Bean on GCP / Forcing to use py 3.11
In this case the Python version will be defined by the Python version installed in the docker image of your flex template. So, you'd have to build your flex template from a base image with Python 3.11. On Mon, Jun 10, 2024 at 12:50 PM Sofia’s World wrote: > Hello > no i am running my pipelien on GCP directly via a flex template, > configured using a Docker file > Any chances to do something in the Dockerfile to force the version at > runtime? > Thanks > > On Mon, Jun 10, 2024 at 7:24 PM Anand Inguva via user < > user@beam.apache.org> wrote: > >> Hello, >> >> Are you running your pipeline from the python 3.11 environment? If you >> are running from a python 3.11 environment and don't use a custom docker >> container image, DataflowRunner(Assuming Apache Beam on GCP means Apache >> Beam on DataflowRunner), will use Python 3.11. >> >> Thanks, >> Anand >> >
Re: Apache Bean on GCP / Forcing to use py 3.11
Hello no i am running my pipelien on GCP directly via a flex template, configured using a Docker file Any chances to do something in the Dockerfile to force the version at runtime? Thanks On Mon, Jun 10, 2024 at 7:24 PM Anand Inguva via user wrote: > Hello, > > Are you running your pipeline from the python 3.11 environment? If you > are running from a python 3.11 environment and don't use a custom docker > container image, DataflowRunner(Assuming Apache Beam on GCP means Apache > Beam on DataflowRunner), will use Python 3.11. > > Thanks, > Anand >
Re: Apache Bean on GCP / Forcing to use py 3.11
Hello, Are you running your pipeline from the python 3.11 environment? If you are running from a python 3.11 environment and don't use a custom docker container image, DataflowRunner(Assuming Apache Beam on GCP means Apache Beam on DataflowRunner), will use Python 3.11. Thanks, Anand
Re: Apache Bean on GCP / Forcing to use py 3.11
If you could use py 3.11 locally, you will get python 3.11 in your cloud environment as well. Is that not happening? When you run Apache Beam on GCP, the python version you are using in your local virtual environment will be used in the cloud environment as well. I believe this is true for non-GCP environments as well. On Mon, Jun 10, 2024 at 11:08 AM Sofia’s World wrote: > Hello > sorry for the partially off topic question > I am running a pipeline in which one of hte dependencies need to run on py > 3.11 > But i dont see any options that allow me to force the python version to be > used > > Could anyone help? > Kind regards > Marco >
Apache Bean on GCP / Forcing to use py 3.11
Hello sorry for the partially off topic question I am running a pipeline in which one of hte dependencies need to run on py 3.11 But i dont see any options that allow me to force the python version to be used Could anyone help? Kind regards Marco
