KKcorps commented on issue #8717: URL: https://github.com/apache/pinot/issues/8717#issuecomment-1143653665
The issue for this error is still unclear. Most likely cause is the offset.retention period getting expired (which is different from topic retention period). Out of Range errors were not found in logs nor was any segment deleted manually. In future there are 2 ways to fix similar errors - * The new segment consumption resume API - https://github.com/apache/pinot/pull/8663 * Handle out of range in Kafka consumer (should handle the offset expiry as well) - https://github.com/apache/pinot/pull/8321 The metrics which currently can be used to track consumptions can be found in https://docs.pinot.apache.org/configuration-reference/monitoring-metrics. A new metric to track offset lag per Kafka topic partitions is also WIP - https://github.com/apache/pinot/pull/8280 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
