Hi, I am writing a structured streaming application, where I process records post some validation (lets say , not null). Want to keep a counter of invalid records in the long running streaming application while other valid records get processed. How can I achieve it ?
First thought was using LongAccumulator but it seems like it is per batch and not for the life of the application. Any other way or workaround to achieve this, please share. Thanks in advance. Regards, -- Chandan Prakash