The problem is that the total metrics in streams are implemented using a Count,
which is a SampledStat, so the value it reports is the count over recent time
windows, not all of time. The behavior I was seeing was when a window is
purged, the reported total decreases. I’ll open a JIRA tomorrow.
On 8/1/18, 4:50 PM, "Guozhang Wang" <wangg...@gmail.com> wrote:
Hello Sam,
Your uploaded snapshot was rejected by apache mailing list, could you
upload it somewhere else, and share the link with us?
Guozhang
On Wed, Aug 1, 2018 at 4:37 PM, Sam Lendle <slen...@pandora.com> wrote:
> Is this a known issue? If not I can create a JIRA.
>
>
>
> For example, here’s a screenshot of the process-total metric for one
> processor node and task under stream-processor-node-metrics.
> Processor-total goes down over time when it shouldn’t. Same thing for
total
> metrics under stream-metrics, stream-*-state-metrics, stream-task-metrics.
> Total metrics look okay for producer and consumers that I’ve looked at.
>
>
>
> Technically most streams total metrics aren’t documented (
>
https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.confluent.io_current_streams_monitoring.html&d=DwIFaQ&c=gFTBenQ7Vj71sUi1A4CkFnmPzqwDo07QsHw-JRepxyw&r=BNCekDhngyXB6C2Ag7PIfHotiuqjAVwLOZLQHB7fyOM&m=zq-Fk2clMlUfF7RbFuEZnUqnn4o_8U0Jlz0X8RLkWEQ&s=dOQW97fklwzcYf8pBFafKmtiKkbDUwkKa9gL2eXfvLM&e=),
so maybe
> they’re not officially supported but they are mentioned in KIP 187
>
https://urldefense.proofpoint.com/v2/url?u=https-3A__cwiki.apache.org_confluence_display_KAFKA_KIP-2D&d=DwIFaQ&c=gFTBenQ7Vj71sUi1A4CkFnmPzqwDo07QsHw-JRepxyw&r=BNCekDhngyXB6C2Ag7PIfHotiuqjAVwLOZLQHB7fyOM&m=zq-Fk2clMlUfF7RbFuEZnUqnn4o_8U0Jlz0X8RLkWEQ&s=VxM4uo16_sukXVcW8ztzNnydCzoK568paxsrxfhPkEY&e=
> 187+-+Add+cumulative+count+metric+for+all+Kafka+rate+metrics.
>
>
>
> [image: cid:image001.png@01D429B1.2CED5AD0]
>
--
-- Guozhang
