[
https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14317711#comment-14317711
]
Hongliang Su commented on KAFKA-1760:
-------------------------------------
Does the new consumer client work ?
I have error as follows, and I'm curious about the consumer which connects
directly to the kafka server, not using the zookeeper clusters?
logs:
[2015-02-12 14:25:30,664] INFO ConsumerConfig values:
rebalance.callback.class = class
org.apache.kafka.clients.consumer.internals.NoOpConsumerRebalanceCallback
check.crcs = true
retry.backoff.ms = 100
metrics.sample.window.ms = 30000
metadata.max.age.ms = 300000
receive.buffer.bytes = 32768
auto.commit.interval.ms = 5000
session.timeout.ms = 30000
group.id = henrytest
enable.auto.commit = true
metric.reporters = []
bootstrap.servers = [10.53.132.52:9092, 10.53.132.55:9092]
client.id =
fetch.max.wait.ms = 500
fetch.min.bytes = 1024
send.buffer.bytes = 131072
reconnect.backoff.ms = 50
key.deserializer = class
org.apache.kafka.common.serialization.StringDeserializer
auto.offset.reset = latest
metrics.num.samples = 2
value.deserializer = class
org.apache.kafka.common.serialization.StringDeserializer
max.partition.fetch.bytes = 1048576
partition.assignment.strategy = blah
(org.apache.kafka.clients.consumer.ConsumerConfig:113)
[2015-02-12 14:25:30,665] DEBUG Starting the Kafka consumer
(org.apache.kafka.clients.consumer.KafkaConsumer:512)
[2015-02-12 14:25:39,681] DEBUG Updated cluster metadata version 1 to
Cluster(nodes = [Node(-2, 10.53.132.55, 9092), Node(-1, 10.53.132.52, 9092)],
partitions = []) (org.apache.kafka.clients.Metadata:147)
[2015-02-12 14:25:39,729] DEBUG Kafka consumer created
(org.apache.kafka.clients.consumer.KafkaConsumer:581)
[2015-02-12 14:25:39,730] DEBUG Subscribed to topic(s):
(org.apache.kafka.clients.consumer.KafkaConsumer:612)
[2015-02-12 14:25:39,730] DEBUG Joining group henrytest
(org.apache.kafka.clients.consumer.KafkaConsumer:964)
[2015-02-12 14:25:39,735] DEBUG Issuing co-ordinator request: JOIN_GROUP:
{group_id=henrytest,session_timeout=30000,topics=[javatest],consumer_id=,partition_assignment_strategy=blah}
(org.apache.kafka.clients.consumer.KafkaConsumer:1188)
[2015-02-12 14:25:39,735] DEBUG No consumer co-ordinator known, attempting to
discover one. (org.apache.kafka.clients.consumer.KafkaConsumer:1251)
[2015-02-12 14:25:39,736] DEBUG Initiating connection to node -1 at
10.53.132.52:9092. (org.apache.kafka.clients.NetworkClient:483)
[2015-02-12 14:25:39,738] DEBUG Completed connection to node -1
(org.apache.kafka.clients.NetworkClient:419)
[2015-02-12 14:25:39,838] DEBUG Sending metadata request
ClientRequest(expectResponse=true, callback=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=0,client_id=consumer-1},
body={topics=[javatest]})) to node -1
(org.apache.kafka.clients.NetworkClient:460)
[2015-02-12 14:25:39,839] DEBUG Initiating connection to node -2 at
10.53.132.55:9092. (org.apache.kafka.clients.NetworkClient:483)
[2015-02-12 14:25:39,841] DEBUG Completed connection to node -2
(org.apache.kafka.clients.NetworkClient:419)
[2015-02-12 14:25:39,849] DEBUG Found consumer co-ordinator: Node(2147483646,
10.53.132.52, 9092) (org.apache.kafka.clients.consumer.KafkaConsumer:1258)
[2015-02-12 14:25:39,849] DEBUG Initiating connection to node 2147483646 at
10.53.132.52:9092. (org.apache.kafka.clients.NetworkClient:483)
[2015-02-12 14:25:39,849] DEBUG No connection to co-ordinator, attempting to
connect. (org.apache.kafka.clients.consumer.KafkaConsumer:1236)
[2015-02-12 14:25:39,855] DEBUG Updated cluster metadata version 2 to
Cluster(nodes = [Node(0, 10.53.132.55, 9092), Node(1, 10.53.132.52, 9092)],
partitions = [Partition(topic = javatest, partition = 0, leader = 0, replicas =
[0,], isr = [0,]]) (org.apache.kafka.clients.Metadata:147)
[2015-02-12 14:25:39,855] DEBUG Completed connection to node 2147483646
(org.apache.kafka.clients.NetworkClient:419)
[2015-02-12 14:25:39,858] DEBUG Joined group:
{error_code=-1,group_generation_id=-1,consumer_id=,assigned_partitions=[]}
(org.apache.kafka.clients.consumer.KafkaConsumer:985)
Exception in thread "Thread-0"
org.apache.kafka.common.errors.UnknownServerException: The server experienced
an unexpected error when processing the request
> Implement new consumer client
> -----------------------------
>
> Key: KAFKA-1760
> URL: https://issues.apache.org/jira/browse/KAFKA-1760
> Project: Kafka
> Issue Type: Sub-task
> Components: consumer
> Reporter: Jay Kreps
> Assignee: Jay Kreps
> Fix For: 0.8.3
>
> Attachments: KAFKA-1760.patch, KAFKA-1760_2015-01-11_16:57:15.patch,
> KAFKA-1760_2015-01-18_19:10:13.patch, KAFKA-1760_2015-01-21_08:42:20.patch,
> KAFKA-1760_2015-01-22_10:03:26.patch, KAFKA-1760_2015-01-22_20:21:56.patch,
> KAFKA-1760_2015-01-23_13:13:00.patch, KAFKA-1760_2015-01-29_03:20:20.patch
>
>
> Implement a consumer client.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
