[
https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14609220#comment-14609220
]
Michael Sandrof commented on KAFKA-2078:
----------------------------------------
We are experiencing the same issue in that we sporadically see "WARN 2015-06-30
17:05:15,269 (Selector) - Error in I/O with
ec2-54-173-14-137.compute-1.amazonaws.com/54.173.14.137 java.io.EOFException"
in the producer log with an identical stack trace a described by others in this
thread.
In our case, we are reproducing an RDBMS transaction log in kafka so we require
absolute ordering (single partition) and cannot tolerate any loss. We have
configured retries to 0 because of the caution in the documentation "Allowing
retries will potentially change the ordering of records because if two records
are sent to a single partition, and the first fails and is retried but the
second succeeds, then the second record may appear first." If these
EOFExceptions are lossy and since they aren't propagated out of the internals
of Kafka we would have a major problem with this solution.
So is there any way to know if these EOFExceptions are dropping messages?
> Getting Selector [WARN] Error in I/O with host java.io.EOFException
> -------------------------------------------------------------------
>
> Key: KAFKA-2078
> URL: https://issues.apache.org/jira/browse/KAFKA-2078
> Project: Kafka
> Issue Type: Bug
> Components: producer
> Affects Versions: 0.8.2.0
> Environment: OS Version: 2.6.39-400.209.1.el5uek and Hardware: 8 x
> Intel(R) Xeon(R) CPU X5660 @ 2.80GHz/44GB
> Reporter: Aravind
> Assignee: Jun Rao
>
> When trying to Produce 1000 (10 MB) messages, getting this below error some
> where between 997 to 1000th message. There is no pattern but able to
> reproduce.
> [PDT] 2015-03-31 13:53:50 Selector [WARN] Error in I/O with "our host"
> java.io.EOFException at
> org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62)
> at org.apache.kafka.common.network.Selector.poll(Selector.java:248) at
> org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192) at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191) at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122) at
> java.lang.Thread.run(Thread.java:724)
> This error I am getting some times @ 997th message or 999th message. There is
> no pattern but able to reproduce.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
