Thanks for adding these Charles. These should serve as production ready examples (tested on Direct runner and Dataflow) for Beam users who wish to use Beam YAML along with key transforms Charles mentioned.
- Cham On Tue, Jul 15, 2025 at 12:13 PM Charles Nguyen <phucnh...@gmail.com> wrote: > Hi all, > > As part of my GSoC project [1], I've been adding a few new YAML examples > involving Kafka, Iceberg and ML use cases. Some have been merged and some > are currently under review. We're at the halfway point of GSoC and there > are a few more examples to come. For those who are interested, please take > a look at these new examples ([2], [3], [4])! > > Best, > Charles > > [1] Proposal: > https://docs.google.com/document/d/1m7AKZYkTf_cuJKU1eCh8oX25lOxwixnVUblEj16aSDU/edit?usp=sharing > [2] Basic Kafka and Iceberg pipelines: > https://github.com/apache/beam/pull/35151 > [3] Streaming Sentiment Analysis Pipeline: > https://github.com/apache/beam/pull/35375 > [4] Streaming Taxi Fare Estimation Pipeline: > https://github.com/apache/beam/pull/35568 >
