Re: Visual tool for kafka?

2018-10-19 Thread Peter Bukowinski
https://github.com/yahoo/kafka-manager This does all that, and has admin features (which you can disable) that allow you to change or create topics, do partition reassignment and preferred leader election. — Peter > On Oct 18, 2018, at 11:52 PM, 1095193

Re: Visual tool for kafka?

2018-10-19 Thread Peter Birksmith
What about Landoop? https://www.landoop.com/ Cheers Peter Birksmith Senior Analyst Customer Labs Phone: +61 2 9292 9167 Ext. 29167 Fax: +61 (0)2 9292 Email: peter.birksm...@iag.com.au Tower Two, Darling Park, 201 Sussex Street, Sydney NSW 2000 We help make your world a safer place.

Re: [VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-10-19 Thread M. Manna
Since this has gone quiet, could I prequest 1 more vote here - if anyone thinks it's worth doing? Thanks, On Wed, 3 Oct 2018 at 16:14, M. Manna wrote: > Thanks for reminding me about the "Binding" vote Bill. I remember some > people with non-binding vote, so jumped the gun a bit too early. >

Re: Kafka Streams, when is considered processed?

2018-10-19 Thread Matthias J. Sax
A message is considered processed, if all state updates are done and all output messages are written. Note, that this notion of "processed" is based on sub-topologies, but not the full topology. Hope this helps. -Matthias On 10/18/18 4:28 AM, Tobias Johansson wrote: > Hi, > > > I can't find

Re: Kafka commit interval

2018-10-19 Thread Matthias J. Sax
There is not upper limit. And yes, you are right about rebalancing. This would be an issue and yes, you can use the rebalance listener to address it (it's the purpose of the rebalance listener to be used for cases like this). -Matthias On 10/16/18 2:19 PM, pradeep s wrote: > Hi, > I have a usec

AVRO Schema with optional field ("type": "record")

2018-10-19 Thread Mina Aslani
Hi, I am adding AVRO schema to the kafka messages, however, I would like to know how I can make a field of "type": "record" optional. *Note*: "default":null does not help. Any idea? Can you elaborate the solution/workaround with an example please? Best regards, Mina

Re: Kafka commit interval

2018-10-19 Thread pradeep s
Thanks Matthias On Fri, Oct 19, 2018 at 11:25 AM Matthias J. Sax wrote: > There is not upper limit. > > And yes, you are right about rebalancing. This would be an issue and > yes, you can use the rebalance listener to address it (it's the purpose > of the rebalance listener to be used for cases

Re: AVRO Schema with optional field ("type": "record")

2018-10-19 Thread Jacob Sheck
Can you use a union with null? This would be the IDL exmple. record RecordConfig { ... } union {null, RecordConfig} record = null; On Fri, Oct 19, 2018 at 2:44 PM Mina Aslani wrote: > Hi, > > I am adding AVRO schema to the kafka messages, however, I would like to > know how I can make a fiel