Hey all!
Recently been updating Beam pipelines up to 2.19, and the following trigger
which previously worked with 2.15 flawlessly has stopped doing so and the
project doesn't even compile now.
.apply("15min Window",
Window.<GenericRecord>into(FixedWindows.of(Duration.standardMinutes(15)))
.triggering(AfterWatermark
.pastEndOfWindow())
.withAllowedLateness(Duration.standardMinutes(60))
.discardingFiredPanes()
)
And will complain with the following error.
Exception in thread "main" java.lang.IllegalArgumentException: Unsafe trigger
may lose data, see https://s.apache.org/finishing-triggers-drop-data:
AfterWatermark.pastEndOfWindow()
Reviewing the changelog I don't see any changes regarding AfterWatermark. Am I
missing something?