I am using a kafka consumer where the partitions are assigned using maually
instead of automatic group assignment using a code similar to "consumer.
assign();"
In this case bin/kafka-consumer-groups fails with the message "Consumer
group `my_group1` does not exist or is rebalancing"
On debugging
Hi,
I am using kafka-connect-hdfs in a 2 nodes and one of the nodes had to be
rebooted when the process was running.
Upon restart the process fails with
16/08/02 21:43:30 ERROR hdfs.TopicPartitionWriter: Recovery failed at state
RECOVERY_PARTITION_PAUSED
org.apache.kafka.connect.errors.ConnectEx
The kafka-connect-hdfs just hangs if the "offset" that it expects is no
longer present (this happens when the message get deleted because of
retention time)
The process in this case does not write any output and the messages get
ignored.
Is this by design ?
The relevant code is
TopicPartitionWr
Hi,
Does the kafka.tools.GetOffsetShell utility work with a kerberized kafka
cluster ?
I doubt that it uses the old consumer which does not work with kerberos and
hence cannot be used with kerberos.
Is there a utlity that has this functionality in a kerberized cluster ?
I currently do this by t
the "condition". In this scenario
that there never will be more than one element in the "waiters" deque and
the producer thread is blocked.
If we have a multithreaded producer then it makes sense.
Please let me know if this is not the case.
Thanks,
Prabhu
On Tue, May 3
Whenever the BufferPool throws a "Failed to allocate memory within the
configured max blocking time" excepion, it should also remove the condition
object from the waiters deque. Otherwise the condition object is stays
forever in the deque.
(i.e) "this.waiters.remove(moreMemory);" should happen bef
We are writing messages at the rate of about 9000 records/sec into our
kafka cluster, at times we see that the producer performance degrades
considerably and then it never recovers. When this happens we see the
following error "unable to allocate buffer within timeout". The
"waiting-threads" metric
On Fri, Mar 11, 2016 at 10:43 PM, Christian Posta wrote:
> What exactly is outdated? Are you not able to grok Kafka with the current
> presentations?
>
> On Fri, Mar 11, 2016 at 1:01 AM, prabhu v wrote:
>
> > Hi,
> >
> > Can anyone please help me with the vid
Hi,
Can anyone please help me with the video presentations from Kafka experts?
Seems the link provided in Kafka home page
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+papers+and+presentations
is outdated..
Thanks in advance..
Hi,
Can anyone please help me with the video presentations from Kafka experts?
Seems the link provided in Kafka home page
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+papers+and+presentations
is
outdated..
Thanks in advance..
er
> > exclude.internal.topics=true
> >
> > *And a producer.properties template:*
> >
> > #Producer template to be used with the mirror maker
> > bootstrap.servers=
> > client.id=mirrormaker
> >
> > Because the internal topics can
, I have tried using
kafka.tools.ConsumerOffsetChecker, seems it is no longer supported in 0.9
release.. Can some one tell me on how to check the consumer position in 0.9
release?
Thanks,
Prabhu
Thanks,
Prabhu
On Wed, Mar 9, 2016 at 3:26 PM, prabhu v wrote:
> Hi Experts,
>
> I am
Hi Experts,
I am trying to mirror
--
Regards,
Prabhu.V
Partition: 1Leader: 0 Replicas: 0,1
Isr: 0,1
Thanks in advance,
On Tue, Jan 5, 2016 at 3:17 PM, prabhu v wrote:
> Hi Harsha,
>
> This is my Kafka_server_jaas.config file. This is passed as JVM param to
> the Kafka broker while s
t;
>
> keyTab="/vagrant/keytabs/kafka1.keytab"
>
> principal="kafka/kafka1.witzend@witzend.com";
> };
>
> and KafkaClient
> KafkaClient {
>
> com.sun.security.auth.module.Krb5LoginModule required
>
> useTicketCache=true
>
> serviceName="ka
eption: No key to store Will continue
> > connection to Zookeeper server without SASL authentication, if Zookeeper"
>
> did you try kinit with that keytab at the command line.
>
> -Harsha
> On Mon, Dec 28, 2015, at 04:07 AM, prabhu v wrote:
> > Thanks for the input Is
t; Hope this helps.
>
> Ismael
> On 28 Dec 2015 05:48, "prabhu v" wrote:
>
> > Hi Experts,
> >
> > I am getting the below error when running the consumer
> > "kafka-console-consumer.sh" .
> >
> > I am using the new version 0.9.0
Hi Experts,
I am getting the below error when running the consumer
"kafka-console-consumer.sh" .
I am using the new version 0.9.0.1.
Topic name: test
[2015-12-28 06:13:34,409] WARN
[console-consumer-61657_localhost-1451283204993-5512891d-leader-finder-thread],
Failed to find leader for Set([tes
;
<https://cwiki.apache.org/confluence/display/KAFKA/Kafka+papers+and+presentations>
Regards,
Prabhu
On Thu, Dec 17, 2015 at 11:58 PM, Jens Rantil wrote:
> Hi,
>
>
> In which part of the world?
>
>
>
>
> Cheers,
>
> Jens
>
>
>
>
>
> –
&g
Hi,
Can anyone provide me the link for the KAFKA USER Group meetings which
happened on Jun. 14, 2012 and June 3, 2014??
Link provided in the below wiki page is not a valid one..
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+papers+and+presentations
--
Regards,
Prabhu.V
--
Regar
20 matches
Mail list logo
