[jira] [Updated] (KAFKA-6887) Error in I/O with host (java.io.EOFException) raised in producer

2018-05-09 Thread Mohammad Tanvir Tasnim (JIRA) 

 [ 
https://issues.apache.org/jira/browse/KAFKA-6887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mohammad Tanvir Tasnim updated KAFKA-6887:
--
Description: The addition to the cloned issue is that the producer does not 
recover after the issue. It gets stuck for ever.  (was: In a situation with a 
Kafka broker in 0.9 and producers still in 0.8.2.x, producers seems to raise 
the following after a variable amount of time since start :

{noformat}
2016-01-29 14:33:13,066 WARN [] o.a.k.c.n.Selector: Error in I/O with 
172.22.2.170
java.io.EOFException: null
at 
org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62) 
~[org.apache.kafka.kafka-clients-0.8.2.0.jar:na]
at org.apache.kafka.common.network.Selector.poll(Selector.java:248) 
~[org.apache.kafka.kafka-clients-0.8.2.0.jar:na]
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192) 
[org.apache.kafka.kafka-clients-0.8.2.0.jar:na]
at 
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191) 
[org.apache.kafka.kafka-clients-0.8.2.0.jar:na]
at 
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122) 
[org.apache.kafka.kafka-clients-0.8.2.0.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_66-internal]
{noformat}

This can be reproduced successfully by doing the following :

 * Start a 0.8.2 producer connected to the 0.9 broker
 * Wait 15 minutes, exactly
 * See the error in the producer logs.

Oddly, this also shows up in an active producer but after 10 minutes of 
activity.

Kafka's server.properties :

{noformat}
broker.id=1
listeners=PLAINTEXT://:9092
port=9092
num.network.threads=2
num.io.threads=2
socket.send.buffer.bytes=1048576
socket.receive.buffer.bytes=1048576
socket.request.max.bytes=104857600
log.dirs=/mnt/data/kafka
num.partitions=4
auto.create.topics.enable=false
delete.topic.enable=true
num.recovery.threads.per.data.dir=1
log.retention.hours=48
log.retention.bytes=524288000
log.segment.bytes=52428800
log.retention.check.interval.ms=6
log.roll.hours=24
log.cleanup.policy=delete
log.cleaner.enable=true
zookeeper.connect=127.0.0.1:2181
zookeeper.connection.timeout.ms=100
{noformat}

Producer's configuration :

{noformat}
compression.type = none
metric.reporters = []
metadata.max.age.ms = 30
metadata.fetch.timeout.ms = 6
acks = all
batch.size = 16384
reconnect.backoff.ms = 10
bootstrap.servers = [127.0.0.1:9092]
receive.buffer.bytes = 32768
retry.backoff.ms = 500
buffer.memory = 33554432
timeout.ms = 3
key.serializer = class 
org.apache.kafka.common.serialization.StringSerializer
retries = 3
max.request.size = 500
block.on.buffer.full = true
value.serializer = class 
org.apache.kafka.common.serialization.StringSerializer
metrics.sample.window.ms = 3
send.buffer.bytes = 131072
max.in.flight.requests.per.connection = 5
metrics.num.samples = 2
linger.ms = 0
client.id = 
{noformat})

> Error in I/O with host (java.io.EOFException) raised in producer
> 
>
> Key: KAFKA-6887
> URL: https://issues.apache.org/jira/browse/KAFKA-6887
> Project: Kafka
>  Issue Type: Bug
>  Components: clients
>Affects Versions: 0.8.2.1, 0.9.0.0
>Reporter: Mohammad Tanvir Tasnim
>Priority: Major
>
> The addition to the cloned issue is that the producer does not recover after 
> the issue. It gets stuck for ever.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (KAFKA-6887) Error in I/O with host (java.io.EOFException) raised in producer

2018-05-09 Thread Mohammad Tanvir Tasnim (JIRA) 

 [ 
https://issues.apache.org/jira/browse/KAFKA-6887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mohammad Tanvir Tasnim updated KAFKA-6887:
--
Description: The addition to the cloned issue 
(https://issues.apache.org/jira/browse/KAFKA-3205) is that the producer does 
not recover after the issue. It gets stuck for ever.  (was: The addition to the 
cloned issue is that the producer does not recover after the issue. It gets 
stuck for ever.)

> Error in I/O with host (java.io.EOFException) raised in producer
> 
>
> Key: KAFKA-6887
> URL: https://issues.apache.org/jira/browse/KAFKA-6887
> Project: Kafka
>  Issue Type: Bug
>  Components: clients
>Affects Versions: 0.8.2.1, 0.9.0.0
>Reporter: Mohammad Tanvir Tasnim
>Priority: Major
>
> The addition to the cloned issue 
> (https://issues.apache.org/jira/browse/KAFKA-3205) is that the producer does 
> not recover after the issue. It gets stuck for ever.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (KAFKA-6887) Error in I/O with host (java.io.EOFException) raised in producer

2018-05-09 Thread Mohammad Tanvir Tasnim (JIRA) 
Mohammad Tanvir Tasnim created KAFKA-6887:
-

 Summary: Error in I/O with host (java.io.EOFException) raised in 
producer
 Key: KAFKA-6887
 URL: https://issues.apache.org/jira/browse/KAFKA-6887
 Project: Kafka
  Issue Type: Bug
  Components: clients
Affects Versions: 0.8.2.1, 0.9.0.0
Reporter: Mohammad Tanvir Tasnim


In a situation with a Kafka broker in 0.9 and producers still in 0.8.2.x, 
producers seems to raise the following after a variable amount of time since 
start :

{noformat}
2016-01-29 14:33:13,066 WARN [] o.a.k.c.n.Selector: Error in I/O with 
172.22.2.170
java.io.EOFException: null
at 
org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62) 
~[org.apache.kafka.kafka-clients-0.8.2.0.jar:na]
at org.apache.kafka.common.network.Selector.poll(Selector.java:248) 
~[org.apache.kafka.kafka-clients-0.8.2.0.jar:na]
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192) 
[org.apache.kafka.kafka-clients-0.8.2.0.jar:na]
at 
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191) 
[org.apache.kafka.kafka-clients-0.8.2.0.jar:na]
at 
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122) 
[org.apache.kafka.kafka-clients-0.8.2.0.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_66-internal]
{noformat}

This can be reproduced successfully by doing the following :

 * Start a 0.8.2 producer connected to the 0.9 broker
 * Wait 15 minutes, exactly
 * See the error in the producer logs.

Oddly, this also shows up in an active producer but after 10 minutes of 
activity.

Kafka's server.properties :

{noformat}
broker.id=1
listeners=PLAINTEXT://:9092
port=9092
num.network.threads=2
num.io.threads=2
socket.send.buffer.bytes=1048576
socket.receive.buffer.bytes=1048576
socket.request.max.bytes=104857600
log.dirs=/mnt/data/kafka
num.partitions=4
auto.create.topics.enable=false
delete.topic.enable=true
num.recovery.threads.per.data.dir=1
log.retention.hours=48
log.retention.bytes=524288000
log.segment.bytes=52428800
log.retention.check.interval.ms=6
log.roll.hours=24
log.cleanup.policy=delete
log.cleaner.enable=true
zookeeper.connect=127.0.0.1:2181
zookeeper.connection.timeout.ms=100
{noformat}

Producer's configuration :

{noformat}
compression.type = none
metric.reporters = []
metadata.max.age.ms = 30
metadata.fetch.timeout.ms = 6
acks = all
batch.size = 16384
reconnect.backoff.ms = 10
bootstrap.servers = [127.0.0.1:9092]
receive.buffer.bytes = 32768
retry.backoff.ms = 500
buffer.memory = 33554432
timeout.ms = 3
key.serializer = class 
org.apache.kafka.common.serialization.StringSerializer
retries = 3
max.request.size = 500
block.on.buffer.full = true
value.serializer = class 
org.apache.kafka.common.serialization.StringSerializer
metrics.sample.window.ms = 3
send.buffer.bytes = 131072
max.in.flight.requests.per.connection = 5
metrics.num.samples = 2
linger.ms = 0
client.id = 
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)