Hi,
So far in our experiment we have encountered 2 critical bugs.
1. If a thread takes more that MAX_POLL_INTERVAL_MS_CONFIG to compute a
cycle it gets evicted from group and rebalance takes place and it gets new
assignment.
However when this thread tries to commit offsets for the revoked partition
Yes setting client id works. Now we are able to add metrics as part of our
cron job.
One additional question I have is
http://kafka.apache.org/documentation.html#kafka_streams_monitoring
I am monitoring the commit latency and process latency.
Commit latency is usually say in 1000ms and process la
That is right, since client-id is used as the metrics name which should be
distinguishable.
https://kafka.apache.org/documentation/#streamsconfigs (I think we can
improve on the explanation of the client.id config)
A common client-id could contain the machine's host-port; of course, if you
have m
Hi Milind,
You can try the DumpSegmentTool to read the logs at broker machines
directly as well:
https://cwiki.apache.org/confluence/display/KAFKA/System+Tools#SystemTools-DumpLogSegment
Guozhang
On Sat, Mar 4, 2017 at 9:48 AM, Anish Mashankar
wrote:
> Try Presto https://prestodb.io. It may s
Stevo
Thanks for clarification.
Thanks,
Shri
-Original Message-
From: Stevo Slavić [mailto:ssla...@gmail.com]
Sent: Friday, March 03, 2017 1:55 AM
To: users@kafka.apache.org
Subject: Re: Kafka partition no migrating to another broker.
Hello Shri,
That behavior is by current Apache Kaf
I'd suggest you take a look at the Connector developer guide doc:
http://docs.confluent.io/3.2.0/connect/devguide.html
When you said "multiple data sources", do you mean multiple systems? In
general each connector is specific to one external system, because each
system may require its own specific
Try Presto https://prestodb.io. It may solve your problem.
On Sat, 4 Mar 2017, 03:18 Milind Vaidya, wrote:
> I have 6 broker kafka setup.
>
> I have retention period of 48 hrs.
>
> To debug if certain data has reached kafka or not I am using command line
> consumer to then piping to grep. But i
Hi Rajat,
It would be great if you could file a JIRA for this in Kafka issue
tracking site (https://issues.apache.org/jira/issues) so it can be easily
tracked and addressed.
Thanks.
--Vahid
From: "Rajat Yadav (Trainee, HO-IT)"
To: users@kafka.apache.org
Date: 03/04/2017 08:26 AM
Su
Dear Sir/Madam,
I just started exploring Kafka on Windows(10) but there are some of the
things that i found missing, not sure of all as i am still not completed
the exploration.
1.)Windows support should be provided in better way...
Just writing Windows platforms use bin\windows\ instead of bin/
