[
https://issues.apache.org/jira/browse/KAFKA-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16874182#comment-16874182
]
Karolis Pocius commented on KAFKA-8346:
---------------------------------------
I'm running into a similar issue, but with {{ReplicaAlterLogDirsThread}}:
{noformat}
[2019-06-27 13:42:48,089] ERROR [ReplicaAlterLogDirsThread-1]: Error due to
(kafka.server.ReplicaAlterLogDirsThread)
org.apache.kafka.common.KafkaException: Error processing data for partition
topic.0-19 offset 48854
at
kafka.server.AbstractFetcherThread.$anonfun$processFetchRequest$7(AbstractFetcherThread.scala:336)
at scala.Option.foreach(Option.scala:257)
at
kafka.server.AbstractFetcherThread.$anonfun$processFetchRequest$6(AbstractFetcherThread.scala:294)
at
kafka.server.AbstractFetcherThread.$anonfun$processFetchRequest$6$adapted(AbstractFetcherThread.scala:293)
at
scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:58)
at
scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:51)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)
at
kafka.server.AbstractFetcherThread.$anonfun$processFetchRequest$5(AbstractFetcherThread.scala:293)
at
scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:251)
at
kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:293)
at
kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3(AbstractFetcherThread.scala:132)
at
kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3$adapted(AbstractFetcherThread.scala:131)
at scala.Option.foreach(Option.scala:257)
at
kafka.server.AbstractFetcherThread.maybeFetch(AbstractFetcherThread.scala:131)
at
kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:113)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:82)
Caused by: java.lang.IllegalStateException: Offset mismatch for the future
replica topic.0-19: fetched offset = 48854, log end offset = 0.
at
kafka.server.ReplicaAlterLogDirsThread.processPartitionData(ReplicaAlterLogDirsThread.scala:107)
at
kafka.server.AbstractFetcherThread.$anonfun$processFetchRequest$7(AbstractFetcherThread.scala:305)
... 16 more
[2019-06-27 13:42:48,089] INFO [ReplicaAlterLogDirsThread-1]: Stopped
(kafka.server.ReplicaAlterLogDirsThread)
{noformat}
Looking at the changes in the PR
[https://github.com/apache/kafka/pull/6716/files] it seems that it will handle
{{ReplicaAlterLogDirsThread}} as well, but can someone please confirm it?
> Improve replica fetcher behavior in handling partition failures
> ---------------------------------------------------------------
>
> Key: KAFKA-8346
> URL: https://issues.apache.org/jira/browse/KAFKA-8346
> Project: Kafka
> Issue Type: Improvement
> Components: core
> Reporter: Aishwarya Gune
> Assignee: Aishwarya Gune
> Priority: Major
> Fix For: 2.3.0
>
>
> The replica fetcher thread terminates in case one of the partitions being
> monitored fails. This leads to under-replicated partitions. The thread
> behavior can be improved by dropping that particular partition and continuing
> with the rest of the partitions.
> KIP-461:
> [https://cwiki.apache.org/confluence/display/KAFKA/KIP-461+-+Improve+Replica+Fetcher+behavior+at+handling+partition+failure]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
