Goutam Chowdhury created KAFKA-3113:
---------------------------------------
Summary: Kafka simple consumer inconsistent result
Key: KAFKA-3113
URL: https://issues.apache.org/jira/browse/KAFKA-3113
Project: Kafka
Issue Type: Bug
Components: kafka streams
Reporter: Goutam Chowdhury
I am trying to read kafka messages using spart api in batch mode.To achieve
this , I need start and last offset of the mentioned topic. To get start and
last offset I am creating simple consumer with below code
-----------------------------------------------------------------------------------------
var consumer = new SimpleConsumer(seedBroker, seedBrokerPort, 100000, 64 *
1024, clientName);
var topicAndPartition = new TopicAndPartition(topic, partition.toInt)
var requestInfo = new HashMap[TopicAndPartition,PartitionOffsetRequestInfo];
requestInfo.put(topicAndPartition, new PartitionOffsetRequestInfo(whichTime,
1))
logger.info("requestInfo - " + requestInfo);
var request = new kafka.javaapi.OffsetRequest(requestInfo,
OffsetRequest.CurrentVersion, clientName);
var response =consumer.getOffsetsBefore(request);
-------------------------------------------------------------------
I am using BIG IP addresses for seed broker which actually has four brokers .
Now if I do spark submit then some times it get exception with below response
response - OffsetResponse(0,Map([ecp.demo.patents.control,0] -> error:
kafka.common.UnknownTopicOrPartitionException offsets: ))
but some time i get proper response..... could anybody explain why it is like
that?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
