Re: pubsubliteio ack problem

2023-12-21 Thread Nirav Patel
whats your pipeline look like? 1. dataflow -> 2. pubsub lite publish -> 3. pubsub lite subscribe -> 4. [spark or dataflow or whatever] then step 2 is where we think either publish requests are being throttled or taking too long for pslite server to either process or ack the message as you

pubsubliteio ack problem

2023-12-21 Thread hsy...@gmail.com
In my application, the pubsubliteio seems never ack the message and the data lateness is building up forever, my question is how does dataflow know when to ack the message, How does the engine even know when it is processed?