Re: Support existing IOs with Schema Transforms

[Chamikara Jayalath via dev]

Thanks for writing this. Added some comments. We should also consider
documenting Schema-Aware Transform API and SchemaTransform authoring
process in the Beam programming guide.

- Cham

On Thu, Nov 3, 2022 at 12:56 PM Ritesh Ghorse via dev 
wrote:

> Thanks for writing this! Having schema transform supported IOs would ease
> up writing multi-language wrappers in Go SDK.
>
> On Thu, Nov 3, 2022 at 2:36 PM Sachin Agarwal via dev 
> wrote:
>
>> I think this is a great idea - making any many existing IOs as possible
>> available to developers in any language is a huge win (and helps reduce the
>> need to re-implement IOs on a language-by-language basis going forward).
>>
>> On Thu, Nov 3, 2022 at 11:25 AM Ahmed Abualsaud via dev <
>> dev@beam.apache.org> wrote:
>>
>>> Hi all,
>>>
>>> There has been an effort to add SchemaTransform capabilities to our
>>> connectors to facilitate the use of multi-lang pipelines. I've drafted a
>>> document below that provides guidelines and examples of how to support IOs
>>> with SchemaTransforms. Please take a look and share your thoughts and
>>> suggestions!
>>>
>>>  Supporting existing connectors with SchemaTrans...
>>> 
>>>
>>>
>>> Best,
>>> Ahmed
>>>
>>

Re: Support existing IOs with Schema Transforms

[Ritesh Ghorse via dev]

Thanks for writing this! Having schema transform supported IOs would ease
up writing multi-language wrappers in Go SDK.

On Thu, Nov 3, 2022 at 2:36 PM Sachin Agarwal via dev 
wrote:

> I think this is a great idea - making any many existing IOs as possible
> available to developers in any language is a huge win (and helps reduce the
> need to re-implement IOs on a language-by-language basis going forward).
>
> On Thu, Nov 3, 2022 at 11:25 AM Ahmed Abualsaud via dev <
> dev@beam.apache.org> wrote:
>
>> Hi all,
>>
>> There has been an effort to add SchemaTransform capabilities to our
>> connectors to facilitate the use of multi-lang pipelines. I've drafted a
>> document below that provides guidelines and examples of how to support IOs
>> with SchemaTransforms. Please take a look and share your thoughts and
>> suggestions!
>>
>>  Supporting existing connectors with SchemaTrans...
>> 
>>
>>
>> Best,
>> Ahmed
>>
>

Re: Support existing IOs with Schema Transforms

[Sachin Agarwal via dev]

I think this is a great idea - making any many existing IOs as possible
available to developers in any language is a huge win (and helps reduce the
need to re-implement IOs on a language-by-language basis going forward).

On Thu, Nov 3, 2022 at 11:25 AM Ahmed Abualsaud via dev 
wrote:

> Hi all,
>
> There has been an effort to add SchemaTransform capabilities to our
> connectors to facilitate the use of multi-lang pipelines. I've drafted a
> document below that provides guidelines and examples of how to support IOs
> with SchemaTransforms. Please take a look and share your thoughts and
> suggestions!
>
>  Supporting existing connectors with SchemaTrans...
> 
>
>
> Best,
> Ahmed
>

Support existing IOs with Schema Transforms

[Ahmed Abualsaud via dev]

Hi all,

There has been an effort to add SchemaTransform capabilities to our
connectors to facilitate the use of multi-lang pipelines. I've drafted a
document below that provides guidelines and examples of how to support IOs
with SchemaTransforms. Please take a look and share your thoughts and
suggestions!

 Supporting existing connectors with SchemaTrans...



Best,
Ahmed