Re: MultimapState missing from Python SDK

2025-06-20 Thread Jack McCluskey via dev
Python 3.13 is in a bit of a limbo state at the moment, as you can iterate on the core SDK with it but GCP subpackages (anything that depends on the google-apitools package, more specifically) do not currently work. I'm blocked waiting on an update from the team that owns that package. So while the

Re: MultimapState missing from Python SDK

2025-06-19 Thread XQ Hu via dev
https://github.com/apache/beam/issues/34869 is still going to support Python 3.13. On Thu, Jun 19, 2025 at 2:02 AM Rakesh Kumar wrote: > Hi Everyone, > > Thank you for sharing this information, it's very helpful! > > On a separate note, I'm currently setting up my environment using the wiki > li

Re: MultimapState missing from Python SDK

2025-06-18 Thread Rakesh Kumar
Hi Everyone, Thank you for sharing this information, it's very helpful! On a separate note, I'm currently setting up my environment using the wiki link (https://cwiki.apache.org/confluence/display/BEAM/Python+Tips). I've noticed that it doesn't include information for Python 3.13. Would someone

Re: MultimapState missing from Python SDK

2025-06-17 Thread Robert Burke
ULR = Universal Local Runner Largely meaning it's a Portable Local Runner, using Bean Portability, as that allows it to be used for any SDK. The python one replaced a Java attempt at one which wasn't complete enough, and wasn't as good as the existing (and current) Java Direct Runner. Prism (a G

Re: MultimapState missing from Python SDK

2025-06-17 Thread Joey Tran
On Tue, Jun 17, 2025 at 7:52 PM Robert Bradshaw wrote: > On Tue, Jun 17, 2025 at 3:57 PM Robert Burke wrote: > > > > +1 > > > > You should be able to use the Prism runner to implement this locally. > > > > Prism passes the full suite of java MultimapState tests, and will ensure > the implementat

Re: MultimapState missing from Python SDK

2025-06-17 Thread Robert Bradshaw
On Tue, Jun 17, 2025 at 3:57 PM Robert Burke wrote: > > +1 > > You should be able to use the Prism runner to implement this locally. > > Prism passes the full suite of java MultimapState tests, and will ensure the > implementation works on runners like Google Cloud Dataflow. > > I do not recommen

Re: MultimapState missing from Python SDK

2025-06-17 Thread Robert Burke
+1 You should be able to use the Prism runner to implement this locally. Prism passes the full suite of java MultimapState tests, and will ensure the implementation works on runners like Google Cloud Dataflow. I do not recommend spending time implementing multimap state in the python direct runn

Re: MultimapState missing from Python SDK

2025-06-17 Thread Shunping Huang via dev
+1 I think it will be great to have that in Python SDK. On Sun, Jun 15, 2025 at 5:22 PM Rakesh Kumar wrote: > Hey Everyone, > > While updating the stateful processing document [1] I noticed that Java > SDK has MultimapState >