Thanks for writing this. Added some comments. We should also consider documenting Schema-Aware Transform API and SchemaTransform authoring process in the Beam programming guide.
- Cham On Thu, Nov 3, 2022 at 12:56 PM Ritesh Ghorse via dev <dev@beam.apache.org> wrote: > Thanks for writing this! Having schema transform supported IOs would ease > up writing multi-language wrappers in Go SDK. > > On Thu, Nov 3, 2022 at 2:36 PM Sachin Agarwal via dev <dev@beam.apache.org> > wrote: > >> I think this is a great idea - making any many existing IOs as possible >> available to developers in any language is a huge win (and helps reduce the >> need to re-implement IOs on a language-by-language basis going forward). >> >> On Thu, Nov 3, 2022 at 11:25 AM Ahmed Abualsaud via dev < >> dev@beam.apache.org> wrote: >> >>> Hi all, >>> >>> There has been an effort to add SchemaTransform capabilities to our >>> connectors to facilitate the use of multi-lang pipelines. I've drafted a >>> document below that provides guidelines and examples of how to support IOs >>> with SchemaTransforms. Please take a look and share your thoughts and >>> suggestions! >>> >>> Supporting existing connectors with SchemaTrans... >>> <https://docs.google.com/document/d/1qW9O3VxdGxUM887TdwhD1iH9AdNbpu0_wXbCGvFP0OM/edit?usp=drive_web> >>> >>> >>> Best, >>> Ahmed >>> >>