whats your pipeline look like?
1. dataflow -> 2. pubsub lite publish -> 3. pubsub lite subscribe -> 4.
[spark or dataflow or whatever]
then step 2 is where we think either publish requests are being throttled
or taking too long for pslite server to either process or ack the message
as you
In my application, the pubsubliteio seems never ack the message and the
data lateness is building up forever, my question is how does dataflow know
when to ack the message, How does the engine even know when it is
processed?