[ANNOUNCE] Apache Beam 2.43.0 Released

2022-11-18 Thread Chamikara Jayalath via user
The Apache Beam team is pleased to announce the release of version 2.43.0. Apache Beam is an open source unified programming model to define and execute data processing pipelines, including ETL, batch and stream (continuous) processing. See https://beam.apache.org You can download the release her

Beam, Flink state and Avro Schema Evolution is problematic

2022-11-18 Thread Cristian Constantinescu
Hi everyone, I'm using Beam on Flink with Avro generated records. If the record schema changes, the Flink state cannot be restored. I just want to send this email out for anyone who may need this info in the future and also ask others for possible solutions as this problem is so easily hit, that I