Can you paste your list group command line here?
Guozhang
On Thu, Dec 10, 2015 at 2:45 PM, Kevin Carr wrote:
> I am using the new Subscriber API and I poll. The poll returns 2005
> messages. I process 2 of them, and then set the offset to the 2nd message
> offset that I processed.
>
> I then
Meghana,
As Ewen said in KAFKA-1650 we removed the support of multiple consumer
configs in MM, so that you cannot get one MM instance to pull from multiple
origin clusters, but instead you need to use one MM instance for each
origin.
The motivation for dropping this support is mainly operational:
Meghana,
It looks like this functionality was removed in
https://issues.apache.org/jira/browse/KAFKA-1650, although I don't see
explicit discussion of the issue in the JIRA so I'm not sure of the exact
motivation. Maybe Becket or Guozhang can offer some insight about if it is
necessary (that JIRA
I am using the new Subscriber API and I poll. The poll returns 2005
messages. I process 2 of them, and then set the offset to the 2nd message
offset that I processed.
I then call commitSync with the TopicPartition and this new offset. When I
list the group with the command line tool, it always
Hi,
We upgraded to the Confluent 2.0 platform today (we were earlier using the
Kafka 0.8 without the confluent platform). With the latest Kafka 0.9 that
is packaged with the platform we are facing issues starting the Mirror
maker with multiple consumer config files.
The original command that we w
I have created a local kafka with local zookeeper, and testing with this
setup, I am able to poll properly. So it is something to do with my setup.
On Thu, Dec 10, 2015 at 2:45 PM Jason Gustafson wrote:
> You just have to set "group.id" in the configuration. Please also include
> the version of
That it does. Thanks for the update Shri.
B
> On 10 Dec 2015, at 21:03, Shrikant Patel wrote:
>
> Figured it out.
>
> I was adding the ssl properties to producer.properties. We need to add this
> to separate file and provide that file as input to procuder bat\sh script
> --producer.config cli
Figured it out.
I was adding the ssl properties to producer.properties. We need to add this to
separate file and provide that file as input to procuder bat\sh script
--producer.config client-ssl.properties.
It seems the kafka.tools.ConsoleProducer class needs to have --producer.config
paramete
You just have to set "group.id" in the configuration. Please also include
the version of the broker.
-Jason
On Thu, Dec 10, 2015 at 12:38 PM, Kevin Carr wrote:
> Sounds like a plan. I will see about getting that.
>
> I don't have to register a group id do I?
>
> On Thu, Dec 10, 2015, 2:37 PM J
Sounds like a plan. I will see about getting that.
I don't have to register a group id do I?
On Thu, Dec 10, 2015, 2:37 PM Jason Gustafson wrote:
> And just to be clear, the broker is on 0.9? Perhaps you can enable debug
> logging and send a snippet?
>
> -Jason
>
> On Thu, Dec 10, 2015 at 12:2
And just to be clear, the broker is on 0.9? Perhaps you can enable debug
logging and send a snippet?
-Jason
On Thu, Dec 10, 2015 at 12:22 PM, Kevin Carr wrote:
> In this case I have just published the message via a producer and
> connecting to the same broker list to consume.
>
> On Thu, Dec 10
In this case I have just published the message via a producer and
connecting to the same broker list to consume.
On Thu, Dec 10, 2015, 2:18 PM Jason Gustafson wrote:
> Hi Kevin,
>
> At the moment, the timeout parameter in poll() really only applies when the
> consumer has an active partition ass
Hi Kevin,
At the moment, the timeout parameter in poll() really only applies when the
consumer has an active partition assignment. In particular, it will block
indefinitely to get that assignment. If there are no brokers to connect to
or if you accidentally point it to an 0.8 cluster, it will prob
I am trying to configure ssl communication between broker and producer.
I followed the instruction on the
https://cwiki.apache.org/confluence/display/KAFKA/Deploying+SSL+for+Kafka to
create the key and trust store.
My broker comes up without issue, I can run this command - openssl s_client
-de
I am configuring the way it says in the api doc.
Topic is 1 partition
I set the group.id, and subscribe to the topic.
If I call poll(100) the function never returns. I have to stop the unit
test, because it never stops. I have waited for up to 10 minutes.
Any Ideas?
Thanks for your help.
I want to say that the metrics only show up when the first message comes in,
but I could be thinking of another tool.
Try sending a message to the broker and see if metrics appear?
t.
-Original Message-
From: Wollert, Fabian [mailto:fabian.woll...@zalando.de]
Sent: Thursday, December 1
Roman,
Agreed, this is definitely a gap in the docs (both Kafka's and Confluent's)
right now. The reason it was lower priority for documentation than other
items is that we expect there will be relatively few converter
implementations, especially compared to the number of converters.
Converters co
Hi,
We are considering an architecture with a Kafka cluster of 3 nodes and a high
number of consumers. We see that with a low number of partitions, e.g. 3, and a
higher number of consumers, e.g. 16, there will be only 3 consumers actually
consuming data, because only the owners of partitions ca
Hi everyone, when i browse via jconsole through a freshly started kafka
0.8.2.1 JVM i can only find metrics for the whole broker (like
MessagesInPerSec in
kafka.server:name=MessagesInPerSec,type=BrokerTopicMetrics") but not
per topic. what am i missing, e.g. where can i find those metrics?
the doc
Thanks Ewen! This will help us.
From: Ewen Cheslack-Postava
Sent: Thursday, December 10, 2015 1:50 AM
To: users@kafka.apache.org
Cc: Michael Pasacrita; Satish Sankaranarayanan
Subject: Re: Match Producer and RecordMetadata with Consumer and ConsumerRecord
Ewen,
I just thought it would be helpful to have more detailed information on
converters (including what you described here) on
http://docs.confluent.io/2.0.0/connect/devguide.html
Thanks,
Roman
On Wednesday, November 11, 2015 6:59 AM, Ewen Cheslack-Postava
wrote:
Hi Venkatesh,
If you're
21 matches
Mail list logo
