[
https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387612#comment-14387612
]
Aravind edited comment on KAFKA-2078 at 3/31/15 5:18 PM:
---------------------------------------------------------
Hi Harsha, thanks for reply.
On a other note: This is occurring only when the size of the message is 10 MB
and more. 1 MB, 2 MB, 5 MB are good. Memory on producer client is 6 GB.
below are the details:
Producer config:
kafka.compression.codec=gzip
producer.metadata.broker.list=host:9092
producer.logger=KafkaProducer
producer.max.request.size=104857600
producer.batch.num.messages=50
producer.queue.buffering.max.ms=5000
Server.properties:
broker.id=0
port=9092
num.network.threads=3
num.io.threads=8
socket.send.buffer.bytes=102400
socket.receive.buffer.bytes=102400
socket.request.max.bytes=104857600
log.dirs=/data/kafka-logs
num.partitions=1
num.recovery.threads.per.data.dir=1
log.retention.hours=1
log.segment.bytes=1073741824
log.retention.check.interval.ms=300000
log.cleaner.enable=false
zookeeper.connect=host1:2181
zookeeper.connection.timeout.ms=6000
message.max.bytes=104857600
replica.fetch.max.bytes=104857600
Thanks,
Aravind
was (Author: aravind2015):
Hi Harsha, thanks for reply. below are the details:
Producer config:
kafka.compression.codec=gzip
producer.metadata.broker.list=host:9092
producer.logger=KafkaProducer
producer.max.request.size=1073741824
producer.batch.num.messages=50
producer.queue.buffering.max.ms=5000
Server.properties:
broker.id=0
port=9092
num.network.threads=3
num.io.threads=8
socket.send.buffer.bytes=102400
socket.receive.buffer.bytes=102400
socket.request.max.bytes=104857600
log.dirs=/data/kafka-logs
num.partitions=1
num.recovery.threads.per.data.dir=1
log.retention.hours=1
log.segment.bytes=1073741824
log.retention.check.interval.ms=300000
log.cleaner.enable=false
zookeeper.connect=host1:2181
zookeeper.connection.timeout.ms=6000
message.max.bytes=104857600
replica.fetch.max.bytes=104857600
Thanks,
Aravind
> Getting Selector [WARN] Error in I/O with host java.io.EOFException
> -------------------------------------------------------------------
>
> Key: KAFKA-2078
> URL: https://issues.apache.org/jira/browse/KAFKA-2078
> Project: Kafka
> Issue Type: Bug
> Components: producer
> Affects Versions: 0.8.2.0
> Environment: OS Version: 2.6.39-400.209.1.el5uek and Hardware: 8 x
> Intel(R) Xeon(R) CPU X5660 @ 2.80GHz/44GB
> Reporter: Aravind
> Assignee: Jun Rao
>
> When trying to Produce 1000 (10 MB) messages, getting this below error some
> where between 997 to 1000th message. There is no pattern but able to
> reproduce.
> [PDT] 2015-03-31 13:53:50 Selector [WARN] Error in I/O with "our host"
> java.io.EOFException at
> org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62)
> at org.apache.kafka.common.network.Selector.poll(Selector.java:248) at
> org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192) at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191) at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122) at
> java.lang.Thread.run(Thread.java:724)
> This error I am getting some times @ 997th message or 999th message. There is
> no pattern but able to reproduce.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
