The side input expires relative to the input watermark of the ParDo so what your suggesting could only happen if the runner had a bug and expired the side input before it should have happened or the user pipeline has a bug and is attempting to access a window for something that would always be considered beyond the maximum lookback which is also an error.
On Thu, Mar 8, 2018 at 1:07 PM, Shen Li <[email protected]> wrote: > Hi, > > When a main input element tries to access an expired side input window > (violating maximumLookback), should ParDo discard the element or treat it > as an error? > > Besides, what should ParDo do in the following situation: > 1. The side input window W is not expired but unready when the main input > element X arrives. So the ParDo pushes back the main input element. > 2. Later the side input window W expires before X is processed. > In this case, should ParDo throw away X? > > Thanks, > Shen >
