Sudarshan Vasudevan created GOBBLIN-1470:
--------------------------------------------
Summary: Commit watermarks to state store for quiet topics with no
data
Key: GOBBLIN-1470
URL: https://issues.apache.org/jira/browse/GOBBLIN-1470
Project: Apache Gobblin
Issue Type: Improvement
Components: gobblin-kafka
Affects Versions: 0.15.0
Reporter: Sudarshan Vasudevan
Assignee: Sudarshan Vasudevan
Fix For: 0.16.0
Currently, quiet topics which see no data during a flush interval will not
commit watermark to state store. This can result in quiet topics not having any
prior stats resulting in an excess number of workunits for such topics. The
correct behavior should be to have watermarks with produce rates set to 0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
