Dear Spark teams. I hope this email finds you well. I am currently working with PySpark Streaming and need to implement a feature where, when a message matches a certain filter condition, I can retrieve past messages some small amount of time *before* that message arrives.
Is there a more efficient way to solve this problem? Thank you for your assistance. Best regards, Trang Phuong Mai NGS Holding