xdgrulez opened a new pull request #10897: URL: https://github.com/apache/kafka/pull/10897
Reduced severity for "skipping records" falling out of time windows/segments from "warn" to "debug" since this is, as mjsax called it on Slack, actually "regular processing", and we have metrics for skipped records anyway since Kafka Streams 2.0 (https://cwiki.apache.org/confluence/display/KAFKA/KIP-274%3A+Kafka+Streams+Skipped+Records+Metrics). Using severity "warn" or "info" results in lots of unnecessarily cluttered logs like this - even though the skipping is actually the intended processing behavior: {"@timestamp":"2021-06-17T19:04:44.194Z","@version":"1","message":"Skipping record for expired segment.","logger_name":"org.apache.kafka.streams.state.internals.AbstractRocksDBSegmentedBytesStore","thread_name":"prod.devices.manufacturing.pt.streamingetl.v3-5f937ad9-7f89-41c5-b4ba-591dabe838fd-StreamThread-1","level":"WARN","level_value":30000,"dd.service":"streaming-etl","dd.env":"prod","dd.span_id":"3790604313083202822","dd.trace_id":"2039260532201528974","dd.version":"1.0.0-20210616-master.4"} {"@timestamp":"2021-06-17T19:04:44.194Z","@version":"1","message":"Skipping record for expired segment.","logger_name":"org.apache.kafka.streams.state.internals.AbstractRocksDBSegmentedBytesStore","thread_name":"prod.devices.manufacturing.pt.streamingetl.v3-5f937ad9-7f89-41c5-b4ba-591dabe838fd-StreamThread-1","level":"WARN","level_value":30000,"dd.service":"streaming-etl","dd.env":"prod","dd.span_id":"3790604313083202822","dd.trace_id":"2039260532201528974","dd.version":"1.0.0-20210616-master.4"} {"@timestamp":"2021-06-17T19:04:44.194Z","@version":"1","message":"Skipping record for expired segment.","logger_name":"org.apache.kafka.streams.state.internals.AbstractRocksDBSegmentedBytesStore","thread_name":"prod.devices.manufacturing.pt.streamingetl.v3-5f937ad9-7f89-41c5-b4ba-591dabe838fd-StreamThread-1","level":"WARN","level_value":30000,"dd.service":"streaming-etl","dd.env":"prod","dd.span_id":"3790604313083202822","dd.trace_id":"2039260532201528974","dd.version":"1.0.0-20210616-master.4"} {"@timestamp":"2021-06-17T19:04:44.194Z","@version":"1","message":"Skipping record for expired segment.","logger_name":"org.apache.kafka.streams.state.internals.AbstractRocksDBSegmentedBytesStore","thread_name":"prod.devices.manufacturing.pt.streamingetl.v3-5f937ad9-7f89-41c5-b4ba-591dabe838fd-StreamThread-1","level":"WARN","level_value":30000,"dd.service":"streaming-etl","dd.env":"prod","dd.span_id":"3790604313083202822","dd.trace_id":"2039260532201528974","dd.version":"1.0.0-20210616-master.4"} {"@timestamp":"2021-06-17T19:04:44.194Z","@version":"1","message":"Skipping record for expired segment.","logger_name":"org.apache.kafka.streams.state.internals.AbstractRocksDBSegmentedBytesStore","thread_name":"prod.devices.manufacturing.pt.streamingetl.v3-5f937ad9-7f89-41c5-b4ba-591dabe838fd-StreamThread-1","level":"WARN","level_value":30000,"dd.service":"streaming-etl","dd.env":"prod","dd.span_id":"3790604313083202822","dd.trace_id":"2039260532201528974","dd.version":"1.0.0-20210616-master.4"} -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
