SQL does not support such joins with your requirement: write to sink after every 1 min after window closes.
You might can use state and timer API to achieve your goal. -Rui On Mon, Feb 24, 2020 at 9:50 AM shanta chakpram <shantachakp...@gmail.com> wrote: > Hi, > > I am trying to join inputs from Unbounded Sources then write to Bounded > Sink. > The pipeline I'm trying is: > Kafka Sources -> SqlTransform -> HCatalogIO Sink > And, a FixedWindow of 1 minute duration is applied. > > I'm expecting the inputs from unbounded sources joined within the current > window to be written to the HCatalogIO Sink after every 1 min i.e after > each window interval. > > Can someone please tell if this is a valid scenario and what is the > expected behaviour from this kind of scenario? > > Regards, > Shanta >
