Sure!
Given a DoFn that has...
def process(self, sentence):
yield from sentence.split()
You could use it with SchemadParDo as:
(p | beam.Create([pvalue.Row(element="hello world", id="id")])
| SchemadParDo(SchemadParDo(SplitSentenceDoFn(), input_field="element",
output_field="word"))
And it'd produce Row(word="hello", id="id") and Row(word=""world", id="id")
On Fri, May 9, 2025, 9:57 PM Reuven Lax via dev <[email protected]> wrote:
> Can you explain a bit how SchemadParDo works?
>
> On Fri, May 9, 2025 at 4:49 PM Joey Tran <[email protected]>
> wrote:
>
>> I've written a `SchemadParDo(input_field: str, output_field, dofn:DoFn)`
>> transform for more easily writing a Schemad transform given a DoFn.
>>
>> Is this something worth upstreaming into the Beam Python SDK? I wrote it
>> to make it easier to convert our current set of dofn's into schemad dofns
>> for use with the YAML SDK. Just wanted to gauge interest before setting up
>> the dev env again
>>
>
