Re: Python 3.11 support in Apache Beam

Thanks Ahmet. I will check them out soon. On Thu, Apr 13, 2023 at 6:24 PM Ahmet Altay wrote: > I forgot to add the link, [1] was meant to be : > https://docs.python.org/3/whatsnew/3.11.html#faster-cpython > > On Thu, Apr 13, 2023 at 10:17 AM Anand Inguva > wrote: > >> Yes Ahmet. That would be g

Re: Python 3.11 support in Apache Beam

I forgot to add the link, [1] was meant to be : https://docs.python.org/3/whatsnew/3.11.html#faster-cpython On Thu, Apr 13, 2023 at 10:17 AM Anand Inguva wrote: > Yes Ahmet. That would be great. > > There are some load tests defined in the > https://github.com/apache/beam/blob/master/.test-infra

Re: Python 3.11 support in Apache Beam

Yes Ahmet. That would be great. There are some load tests defined in the https://github.com/apache/beam/blob/master/.test-infra which could be useful for performance testing of Beam between 3.10 and 3.11. Do you suggest any other tests? On Wed, Apr 12, 2023 at 8:04 PM Ahmet Altay wrote: > Thank

Re: Python 3.11 support in Apache Beam

Thank you, this is great! Python 3.11 announcement had a claim about performance [1]: "CPython 3.11 is an average of 25% faster than CPython 3.10 as measured with the pyperformance benchmark suite, when compiled with GCC on Ubuntu Linux. Depending on your workload, the overall speedup could be 10

Re: Python 3.11 support in Apache Beam

Python 3.11 support has been merged at https://github.com/apache/beam/pull/26121 targeting Beam 2.47.0 release. Please let me know if you have any questions. Thanks, Anand On Tue, Feb 21, 2023 at 6:04 PM Valentyn Tymofieiev wrote: > Thanks a lot Anand. I'll take a look at the PRs. > > On Tue,

Re: Python 3.11 support in Apache Beam

Thanks a lot Anand. I'll take a look at the PRs. On Tue, Feb 21, 2023 at 1:56 PM Anand Inguva wrote: > I was able to spin up a PR: https://github.com/apache/beam/pull/24599 > that updates the build dependencies of Apache Beam. > > Several GCP dependencies needed to be updated as well. I covered

Re: Python 3.11 support in Apache Beam

I was able to spin up a PR: https://github.com/apache/beam/pull/24599 that updates the build dependencies of Apache Beam. Several GCP dependencies needed to be updated as well. I covered them in the PR: https://github.com/apache/beam/pull/24599 On Thu, Feb 9, 2023 at 3:29 PM Anand Inguva wrote:

Re: Python 3.11 support in Apache Beam

Yes, we may need to update all of them . I can add more information once I dig into the issue(most likely next week). I will comment on my findings on the issue: https://github.com/apache/beam/issues/24569 and wi

Re: Python 3.11 support in Apache Beam

On Tue, Feb 7, 2023 at 2:35 PM Anand Inguva wrote: > Yes, it is related to protobuf only. But I think the update of these > dependencies are required for Python 3.11 since the newer versions have > support for Python 3.11 wheels. > Assuming you refer to protobuf. Yes, there are no wheels for 3.10

Re: Python 3.11 support in Apache Beam

Yes, it is related to protobuf only. But I think the update of these dependencies are required for Python 3.11 since the newer versions have support for Python 3.11 wheels. If we use older versions of these packages, then we have to depend on installing those packages on Python 3.11 from source dis

Re: Python 3.11 support in Apache Beam

Hi Anand, On Tue, Feb 7, 2023 at 1:35 PM Anand Inguva via dev wrote: > Hi all, > > We are planning to work on adding support for Python 3.11[1] to Apache > Beam Python SDK. > > As part of this effort, we are going to update the python build > dependencies defined at [2]. > > Right now, there is