Re: A user-deployable Beam Transform Service

2023-03-28 Thread Chamikara Jayalath via dev
Hi All, I've developed a version of this service using Docker Compose and it's available here: https://github.com/apache/beam/pull/26023 Currently it consists of a controller container and a single expansion service container (Java) but I hope to add a Python expansion service container to this a

Re: A user-deployable Beam Transform Service

2023-02-10 Thread Luke Cwik via dev
Seems like a useful thing to me and will make it easier for Beam users overall. On Fri, Feb 10, 2023 at 3:56 PM Robert Bradshaw via dev wrote: > Thanks. I added some comments to the doc. > > On Mon, Feb 6, 2023 at 1:33 PM Chamikara Jayalath via dev > wrote: > > > > Hi All, > > > > Beam PTransfo

Re: A user-deployable Beam Transform Service

2023-02-10 Thread Robert Bradshaw via dev
Thanks. I added some comments to the doc. On Mon, Feb 6, 2023 at 1:33 PM Chamikara Jayalath via dev wrote: > > Hi All, > > Beam PTransforms are currently primarily identified as operations in a > pipeline that perform specific tasks. PTransform implementations were > traditionally linked to spe

A user-deployable Beam Transform Service

2023-02-06 Thread Chamikara Jayalath via dev
Hi All, Beam PTransforms are currently primarily identified as operations in a pipeline that perform specific tasks. PTransform implementations were traditionally linked to specific Beam SDKs. With the advent of portability framework, multi-language pipelines