[jira] [Created] (KAFKA-7282) Failed to read `log header` from file channel

2018-08-13 Thread Alastair Munro (JIRA) 
Alastair Munro created KAFKA-7282:
-

 Summary: Failed to read `log header` from file channel
 Key: KAFKA-7282
 URL: https://issues.apache.org/jira/browse/KAFKA-7282
 Project: Kafka
  Issue Type: Bug
Affects Versions: 2.0.0, 1.1.1, 0.11.0.2
 Environment: Linux
Reporter: Alastair Munro


Full stack trace:
{code:java}
[2018-08-13 11:22:01,635] ERROR [ReplicaManager broker=2] Error processing 
fetch operation on partition segmenter-evt-v1-14, offset 96745 
(kafka.server.ReplicaManager)
org.apache.kafka.common.KafkaException: java.io.EOFException: Failed to read 
`log header` from file channel `sun.nio.ch.FileChannelImpl@6e6d8ddd`. Expected 
to read 17 bytes, but reached end of file after reading 0 bytes. Started read 
from position 25935.
at 
org.apache.kafka.common.record.RecordBatchIterator.makeNext(RecordBatchIterator.java:40)
at 
org.apache.kafka.common.record.RecordBatchIterator.makeNext(RecordBatchIterator.java:24)
at 
org.apache.kafka.common.utils.AbstractIterator.maybeComputeNext(AbstractIterator.java:79)
at 
org.apache.kafka.common.utils.AbstractIterator.hasNext(AbstractIterator.java:45)
at 
org.apache.kafka.common.record.FileRecords.searchForOffsetWithSize(FileRecords.java:286)
at kafka.log.LogSegment.translateOffset(LogSegment.scala:254)
at kafka.log.LogSegment.read(LogSegment.scala:277)
at kafka.log.Log$$anonfun$read$2.apply(Log.scala:1159)
at kafka.log.Log$$anonfun$read$2.apply(Log.scala:1114)
at kafka.log.Log.maybeHandleIOException(Log.scala:1837)
at kafka.log.Log.read(Log.scala:1114)
at 
kafka.server.ReplicaManager.kafka$server$ReplicaManager$$read$1(ReplicaManager.scala:912)
at 
kafka.server.ReplicaManager$$anonfun$readFromLocalLog$1.apply(ReplicaManager.scala:974)
at 
kafka.server.ReplicaManager$$anonfun$readFromLocalLog$1.apply(ReplicaManager.scala:973)
at 
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at kafka.server.ReplicaManager.readFromLocalLog(ReplicaManager.scala:973)
at kafka.server.ReplicaManager.readFromLog$1(ReplicaManager.scala:802)
at kafka.server.ReplicaManager.fetchMessages(ReplicaManager.scala:815)
at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:678)
at kafka.server.KafkaApis.handle(KafkaApis.scala:107)
at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:69)
at java.lang.Thread.run(Thread.java:748)
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Resolved] (KAFKA-6128) Shutdown script does not do a clean shutdown

2017-10-26 Thread Alastair Munro (JIRA) 

 [ 
https://issues.apache.org/jira/browse/KAFKA-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alastair Munro resolved KAFKA-6128.
---
   Resolution: Fixed
Fix Version/s: 0.11.0.0
   0.11.0.1

Broken zookeeper replication for /brokers/ids/.

> Shutdown script does not do a clean shutdown
> 
>
> Key: KAFKA-6128
> URL: https://issues.apache.org/jira/browse/KAFKA-6128
> Project: Kafka
>  Issue Type: Bug
>Affects Versions: 0.11.0.1
>Reporter: Alastair Munro
>Priority: Minor
> Fix For: 0.11.0.1, 0.11.0.0
>
>
> Shutdown script (sending term signal) does not do a clean shutdown.
> We are running kafka in kubernetes/openshift 0.11.0.0. The statefulset kafka 
> runs the shutdown script prior to stopping the pod kafka is running on:
> {code}
> lifecycle:
>   preStop:
> exec:
>   command:
>   - ./bin/kafka-server-stop.sh
> {code}
> This worked perfectly in 0.11.0.0 but doesn't in 0.11.0.1. Also we see the 
> same behaviour if we send a TERM signal to the kafka process (same as the 
> shutdown script).



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (KAFKA-6128) Shutdown script does not do a clean shutdown

2017-10-26 Thread Alastair Munro (JIRA) 
Alastair Munro created KAFKA-6128:
-

 Summary: Shutdown script does not do a clean shutdown
 Key: KAFKA-6128
 URL: https://issues.apache.org/jira/browse/KAFKA-6128
 Project: Kafka
  Issue Type: Bug
Affects Versions: 0.11.0.1
Reporter: Alastair Munro
Priority: Minor


Shutdown script (sending term signal) does not do a clean shutdown.

We are running kafka in kubernetes/openshift 0.11.0.0. The statefulset kafka 
runs the shutdown script prior to stopping the pod kafka is running on:

{code}
lifecycle:
  preStop:
exec:
  command:
  - ./bin/kafka-server-stop.sh
{code}

This worked perfectly in 0.11.0.0 but doesn't in 0.11.0.1. Also we see the same 
behaviour if we send a TERM signal to the kafka process (same as the shutdown 
script).



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)