I'm checking with prometheus using prometheus jmx exporter.
When I shutdown one broker I don't have any line with: "Shrinking ISR from
%s to %s" even though that ISR have been shrinked:
Topic:test-topic PartitionCount:4 ReplicationFactor:2
Configs:
Topic: test-topic Partition: 0 Leader: 3 Replicas:
3,1 Isr: 1,3
Topic: test-topic Partition: 1 Leader: 2 Replicas:
0,2 Isr: 2
Topic: test-topic Partition: 2 Leader: 1 Replicas:
1,3 Isr: 1,3
Topic: test-topic Partition: 3 Leader: 2 Replicas:
2,0 Isr: 2
I'm testing this with running producer that fills 'test-topic'.
On Wed, Apr 18, 2018 at 12:20 AM, Ismael Juma <[email protected]> wrote:
> How are you checking these metrics? They are per leader. That is, if broker
> A is the leader for topic partition topic-0 and broker B is a follower,
> then shutting down broker B should cause the IsrShrinksPerSec for broker A
> to be updated. You would also something like the following in the
> server.log of broker A:
>
> "Shrinking ISR from %s to %s"
>
> Ismael
>
> On Tue, Apr 17, 2018 at 8:11 AM, Stanislav Antic <
> [email protected]>
> wrote:
>
> > Problems are:
> > * JMX attribute:
> > `kafka.server<type=ReplicaManager,name=IsrShrinksPerSec><Count>`
> > Is always 0 for `Count` and all other attributes. If I shutdown any
> > broker I
> > would expect that this would increase.
> >
> > * JMX attribute:
> > `kafka.server<type=ReplicaManager,name=IsrExpandsPerSec><Count>`
> > Have random behavior sometimes on shutting down broker it increases and
> > on starting it also
> > increases. Expands works I just don't understand what are values that
> > increments total on
> > each broker.
> >
> > This behaviours are consistent through Kafka versions: 0.10.0 - 1.0.0
> > I'm using Confluent Kafka distribution with versions between: 3.1, 3.2,
> 3.3
> > & 4.0
> >
> > My question is this bug or something that I don't understand about Kafka?
> > --
> > Stanislav Antic
> >
>
--
Stanislav Antic