Hi Javier,
sorry for the late response. In the Error Mapping of Kafka, it says that
code 15 means: ConsumerCoordinatorNotAvailableCode.
https://github.com/apache/kafka/blob/0.9.0/core/src/main/scala/kafka/common/ErrorMapping.scala
How many brokers did you put into the list of bootstrap servers?
Can you maybe send me the full log of one of the Flink TaskManagers reading
from Kafka?
On Wed, Feb 17, 2016 at 11:10 AM, Lopez, Javier <javier.lo...@zalando.de>
wrote:
> Hi guys,
>
> We are using Flink 1.0-SNAPSHOT with Kafka 0.9 Consumer and we have not
> been able to retrieve data from our Kafka Cluster. The DEBUG data reports
> the following:
>
> 10:53:24,365 DEBUG org.apache.kafka.clients.NetworkClient
> - Sending metadata request ClientRequest(expectResponse=true,
> callback=null,
> request=RequestSend(header={api_key=3,api_version=0,correlation_id=1673,client_id=flink_test},
> body={topics=[stream_test_3]}), isInitiatedByNetworkClient,
> createdTimeMs=1455702804364, sendTimeMs=0) to node 35
> 10:53:24,398 DEBUG org.apache.kafka.clients.Metadata
> - Updated cluster metadata version 838 to Cluster(nodes = [Node(41,
> ip-XXXX.eu-west-1.compute.internal, 9092), Node(35,
> ip-XXXX.eu-west-1.compute.internal, 9092), Node(87,
> ip-XXXX.eu-west-1.compute.internal, 9092)], partitions = [Partition(topic =
> stream_test_3, partition = 0, leader = 87, replicas = [87,41,35,], isr =
> [87,41,35,], Partition(topic = stream_test_3, partition = 1, leader = 35,
> replicas = [35,41,87,], isr = [35,41,87,], Partition(topic = stream_test_3,
> partition = 4, leader = 87, replicas = [87,41,35,], isr = [87,41,35,],
> Partition(topic = stream_test_3, partition = 3, leader = 35, replicas =
> [35,87,41,], isr = [35,87,41,], Partition(topic = stream_test_3, partition
> = 2, leader = 41, replicas = [41,87,35,], isr = [41,87,35,]])
> 10:53:24,398 DEBUG
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator - Issuing
> group metadata request to broker 35
> 10:53:24,432 DEBUG
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator - Group
> metadata response ClientResponse(receivedTimeMs=1455702804432,
> disconnected=false, request=ClientRequest(expectResponse=true,
> callback=org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler@63b68d94,
> request=RequestSend(header={api_key=10,api_version=0,correlation_id=1674,client_id=flink_test},
> body={group_id=test}), createdTimeMs=1455702804398,
> sendTimeMs=1455702804398),
> responseBody={error_code=15,coordinator={node_id=-1,host=,port=-1}})
>
>
> We receive this message all the time. What we don't know understand is
> this "responseBody={error_code=15,coordinator={node_id=-1,host=,port=-1}}",
> as we see an error_code we suppose there was a problem. Our Kafka cluster
> works and we have some clients extracting data from it, so we don't know if
> this could be a Kafka issue or a Flink issue.
>
> Does anyone know, or understand, this response we are getting from Kafka?
>
> Thanks.
>
