Hello Experts, We are planning to use Kafka for large message set ( size
various from 2 MB to 4 MB per event ). By setting message.max.bytes to 64
MB value this Kafka Producer allows large messages. But how does it
impacts performance (both producer and consumer)?
Would like to understand the
You can use AdminClient describeConfigs API to fetch topic/broker configs.
https://kafka.apache.org/20/javadoc/org/apache/kafka/clients/admin/KafkaAdminClient.html
On Tue, Sep 4, 2018 at 1:47 PM claude.war...@wipro.com <
claude.war...@wipro.com> wrote:
> Thank you for the reference but I don't s
We have partitions that are in the 100s of GBs.
It shouldn't have to shuffle around GB chunks of data unless you have done
partition moves, or had a broker offline for a while. Is that the case?
If not your ISR problem is probably related to something else other than
retention size.
On Fri, Sep
Hi,
Try it also,
https://medium.com/@danielmrosa/monitoring-kafka-b97d2d5a5434
I wrote, I hope that can help you and others.
Em qui, 6 de set de 2018 14:20, suresh.sar...@gmail.com <
suresh.sar...@gmail.com> escreveu:
>
>
> On 2018/09/06 12:03:48, darekAsz wrote:
> > I didn't see this page bef
Hi users,
What's the biggest topic you've seen in production use? The factors I'm
interested in are log.retention.* config parameters and number of
partitions.
We run several 200-partition topics that have log retention set to roughly
1GB per partition. Is this big by common usage standards, or n
Hi Tim,
>From your spec, I think that Kafka Streams has several ways to support
either scenario. Caveat: this is off the cuff, so I might have missed
something. For your context, I'll give you some thoughts on several ways
you could do it, with various tradeoffs.
Scenario 1 (every widget reports
On 2018/09/06 12:03:48, darekAsz wrote:
> I didn't see this page before, thanks, I will check this
>
> czw., 6 wrz 2018 o 13:55 M. Manna napisał(a):
>
> > Have you checked this wiki site -
> > https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem ?
> >
> > On Thu, 6 Sep 2018 at 12:51,
On 2018/09/03 09:45:30, "M. Manna" wrote:
> Hi Suresh,
>
> Can you please share your startup logs, and broker/zookeeper config with
> us? Also, which kafka version are you using?
>
> Regards,
>
> On Mon, 3 Sep 2018 at 10:18, suresh.sar...@gmail.com <
> suresh.sar...@gmail.com> wrote:
>
> >
Hi, looking for some beginner's help with architectural choices.
Scenario 1:
A stream of messages arrives on a Kafka topic. Each has the key being a widget
ID, and the value being an indication of whether the widget is connected or
disconnected. For each widget a message arrives every 30 second
I didn't see this page before, thanks, I will check this
czw., 6 wrz 2018 o 13:55 M. Manna napisał(a):
> Have you checked this wiki site -
> https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem ?
>
> On Thu, 6 Sep 2018 at 12:51, darekAsz wrote:
>
> > Hi,
> > is any tool or script to moni
Have you checked this wiki site -
https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem ?
On Thu, 6 Sep 2018 at 12:51, darekAsz wrote:
> Hi,
> is any tool or script to monitor a kafka broker? I want to know metrics
> from broker side, speed, delays, etc.
>
Hi,
is any tool or script to monitor a kafka broker? I want to know metrics
from broker side, speed, delays, etc.
Thank you, looking forward to testing it :-)
Best regards
Patrik
> Am 06.09.2018 um 02:24 schrieb Matthias J. Sax :
>
> I create https://issues.apache.org/jira/browse/KAFKA-7380 to track this.
>
> -Matthias
>
>> On 8/27/18 12:07 PM, Guozhang Wang wrote:
>> Hello Patrik,
>>
>> Thanks for the em
Hi,
Yes this help a lot !
Thanks !
Robin
Le 05/09/2018 à 22:29, John Roesler a écrit :
Hi Robin,
The AdminClient is what you want.
"Evolving" is just a heads-up that the API is relatively new and hasn't
stood the test of time, so you shouldn't be *too* surprised to see it
change in the fu
14 matches
Mail list logo
