How did you add the host and when did you measure the lag? If you used the reassign-partitions script, it will move partitions to the new host, but the data copy will take time. in that period, those partitions will lag. However, once the reassign-partitions script finishes, the partitions on the new replica should be caught up and no longer demonstrate any lag.
On Fri, Dec 9, 2016 at 8:58 PM, Jeremy Hansen <jer...@skidrow.la> wrote: > Here’s the topic description: > > Topic:blumfrub PartitionCount:15 ReplicationFactor:5 Configs: > Topic: blumfrub Partition: 0 Leader: 1001 Replicas: > 1001,0,1,2,3 Isr: 0,1001,1,2,3 > Topic: blumfrub Partition: 1 Leader: 0 Replicas: > 0,1,2,3,4 Isr: 0,1,2,3,4 > Topic: blumfrub Partition: 2 Leader: 1 Replicas: > 1,2,3,4,1001 Isr: 1001,1,2,3,4 > Topic: blumfrub Partition: 3 Leader: 2 Replicas: > 2,3,4,1001,0 Isr: 0,1001,2,3,4 > Topic: blumfrub Partition: 4 Leader: 0 Replicas: > 3,4,1001,0,1 Isr: 0,1001,1,3,4 > Topic: blumfrub Partition: 5 Leader: 4 Replicas: > 4,1001,0,1,2 Isr: 0,1001,1,2,4 > Topic: blumfrub Partition: 6 Leader: 1001 Replicas: > 1001,1,2,3,4 Isr: 1001,1,2,3,4 > Topic: blumfrub Partition: 7 Leader: 0 Replicas: > 0,2,3,4,1001 Isr: 0,1001,2,3,4 > Topic: blumfrub Partition: 8 Leader: 1 Replicas: > 1,3,4,1001,0 Isr: 0,1001,1,3,4 > Topic: blumfrub Partition: 9 Leader: 2 Replicas: > 2,4,1001,0,1 Isr: 0,1001,1,2,4 > Topic: blumfrub Partition: 10 Leader: 0 Replicas: > 3,1001,0,1,2 Isr: 0,1001,1,2,3 > Topic: blumfrub Partition: 11 Leader: 4 Replicas: > 4,0,1,2,3 Isr: 0,1,2,3,4 > Topic: blumfrub Partition: 12 Leader: 1001 Replicas: > 1001,2,3,4,0 Isr: 0,1001,2,3,4 > Topic: blumfrub Partition: 13 Leader: 0 Replicas: > 0,3,4,1001,1 Isr: 0,1001,1,3,4 > Topic: blumfrub Partition: 14 Leader: 1 Replicas: > 1,4,1001,0,2 Isr: 0,1001,1,2,4 > > 1001 is the new broker. > > -jeremy > > > > > On Dec 9, 2016, at 8:55 PM, Jeremy Hansen <jer...@skidrow.la> wrote: > > > > I added a new host to kafka. Partitions that fall on this new host have > a very high lag and I’m trying to understand why this would be and how to > fix it. > > > > iloveconsuming blumfrub 0 > 5434682 7416933 1982251 iloveconsuming_kf0001.host. > com-1481225033576-47393b55-0 > > iloveconsuming blumfrub 1 > 7416828 7416875 47 iloveconsuming_kf0001.host. > com-1481225033769-17152bca-0 > > iloveconsuming blumfrub 2 > 7416799 7416848 49 iloveconsuming_kf0001.host. > com-1481225033791-77a30285-0 > > iloveconsuming blumfrub 3 > 7416898 7416903 5 iloveconsuming_kf0001.host. > com-1481225033822-d088f844-0 > > iloveconsuming blumfrub 4 > 7416891 7416925 34 iloveconsuming_kf0001.host. > com-1481225033846-78f8e5b5-0 > > iloveconsuming blumfrub 5 > 7416843 7416883 40 iloveconsuming_kf0001.host. > com-1481225033869-54027178-0 > > iloveconsuming blumfrub 6 > 5434720 7416896 1982176 iloveconsuming_kf0001.host. > com-1481225033891-cc3f6bf6-0 > > iloveconsuming blumfrub 7 > 7416896 7416954 58 iloveconsuming_kf0001.host. > com-1481225033915-79b49de8-0 > > iloveconsuming blumfrub 8 > 7416849 7416898 49 iloveconsuming_kf0001.host. > com-1481225033939-1fe784c0-0 > > iloveconsuming blumfrub 9 > 7416898 7416917 19 iloveconsuming_kf0001.host. > com-1481225033961-40cc3185-0 > > iloveconsuming blumfrub 10 > 35457186 35457221 35 iloveconsuming_kf0001.host. > com-1481225033998-a817062e-0 > > iloveconsuming blumfrub 11 > 7416866 7416909 43 iloveconsuming_kf0001.host. > com-1481225034020-7a15999e-0 > > iloveconsuming blumfrub 12 > 5434739 7416907 1982168 iloveconsuming_kf0001.host. > com-1481225034043-badde97c-0 > > iloveconsuming blumfrub 13 > 7416818 7416865 47 iloveconsuming_kf0001.host. > com-1481225034066-6e77e3dc-0 > > iloveconsuming blumfrub 14 > 7416901 7416947 46 iloveconsuming_kf0002.host. > com-1481225107317-32355c51-0 > > > > Why do the partitions that fall on the newly added host so lagged? > > > > Thanks > > -jeremy > >
