Re: Comparing Pulsar and Kafka: unified queuing and streaming

Thank you, Jason. Nice to see inputs from you about messaging retention. I have the same feeling that a centralized place for managing offsets (what Pulsar calls cursors) is actually much better than current kafka model. Would love to hear what is the plan for kafka community heading towards on

Re: Mirrormaker consumption slowness

Hi, any pointer will be highly appreciated On Thu, 30 Nov 2017 at 14:56 tao xiao wrote: > Hi There, > > > > We are running into a weird situation when using Mirrormaker to replicate > messages between Kafka clusters across datacenter and reach you for help in > case you

Re: Stream Processing Meetup@LinkedIn (Dec 4th)

Can some one post the link to the stream, please. Thanks. On Fri, Nov 17, 2017 at 3:49 PM, Becket Qin wrote: > Hi Paolo, > > Yes, we will stream the meetup. Usually the link will be posted to the > meetup website a couple of hours before the meetup. Feel free to ping me

Re: Comparing Pulsar and Kafka: unified queuing and streaming

Hi Khurrum, Thanks for sharing the article. I think one interesting aspect of Pulsar that stands out to me is its notion of a subscription and how it impacts message retention. In Kafka, consumers are more loosely coupled and retention is enforced independently of consumption. There are some

Re: Configuration: Retention and compaction

Topic can be configured in "dual" mode too via >> cleanup.policy="delete,compact" For this case, `retention.ms` is basically a TTL for a key that is not updated for this amount of time. -Matthias On 12/3/17 11:54 AM, Jan Filipiak wrote: > Hi > > the only retention time that applies for

Re: Incorrect auto-commited offsets

Hello Tom, It is indeed a bit weird, I remember someone else have reported similar issues before. Do you still have the client-side DEBUG logs when this happens? I'd like to exclude or narrow down the root cause of whether a reset indeed happens on the consumer, and if yes, it should contains the

Re: Multiple brokers - do they share the load?

Ben wrote: > If you set these configs at broker start they will automatically replicate > newly created topics: > > default.replication.factor > num.partitions=3 Thanks. (I assume the first config is missing a trailing "=3" bit). Final question (I think). If I restart my brokers with those

super.users or kafka-acls —cluster for broker ACLs?

Hi all, Is there any reason not to list broker principals as super.users? I know there is the —cluster shortcut for adding broker ACL permissions via the kafka-acls CLI. Adding them to super.users would be simpler, as it can more easily be done via configuration management. Thanks! - Andrew

Communicating with transaction coordinator in Kafka 11.

Hi, I wanted to know that whether there is any way to communicate with transaction coordinator to get meta data related to previous transaction of a particular transaction ID. Do you provide any high level API for communicating with transaction coordinator and ultimately transactional logs

Re: Seeking help on Repetitive "Error in Partition" in Kafka ...

Any pointers please.. On Dec 4, 2017 16:43, "Abhit Kalsotra" wrote: Dear * I am using librdkafka 0.9.2 and kafka 0.10.2.0 , did not update the librdkafka from 0.9.2 because it had been running satisfactory,in my stack. My Kafka Setup: *Setup: 3 ZK instances running on