Comparing Pulsar and Kafka: unified queuing and streaming

2017-12-03 Thread Khurrum Nasim
Dear Kafka Community, I happened to read this blog post comparing the messaging model between Apache Pulsar and Apache Kafka. It sounds interesting. Apache Pulsar claims to unify streaming (kafka) and queuing (rabbitmq) in one unified API. Pulsar also seems to support Kafka API. Have anyone taken

Advertised Listener parameter becomes redundant once the connection is estabished

2017-12-03 Thread Faraz Mateen
Hi, I have a Kafka server deployed on google cloud VM. It is getting data from a kafka (python) producer running on a remote machine that is connected to the VM through a VPN. I added VPN's tunnel interface's IP as advertised listener in kafka server properties so that client can connect to the ka

Re: Configuration: Retention and compaction

2017-12-03 Thread Jan Filipiak
Hi the only retention time that applies for compacted topics is the delete.retention.ms The duration that tombstones for deletes will be kept in the topic during compaction. A very detail explaination on what is going on can be found here: https://kafka.apache.org/documentation/#compaction

Configuration: Retention and compaction

2017-12-03 Thread Dmitry Minkovsky
This is a pretty stupid question. Mostly likely I should verify these by observation, but really I want to verify that my understanding of the documentation is correct: Suppose I have topic configurations like: retention.ms=$time cleanup.policy=compact My questions are: 1. After $time, any

Re: Documentation JIRA KAFKA-6301 and access to repo

2017-12-03 Thread Waleed Fateem
Thanks Guozhang. I appreciate your help! On Sun, Dec 3, 2017 at 11:36 AM, Guozhang Wang wrote: > Hello Waleed, > > Thanks for contributing to Kafka. > > Note that only committers can push changes directly to the Apache Kafka > repo. You may find this guidance helpful for submitting a PR: > > ht

Re: Documentation JIRA KAFKA-6301 and access to repo

2017-12-03 Thread Guozhang Wang
Hello Waleed, Thanks for contributing to Kafka. Note that only committers can push changes directly to the Apache Kafka repo. You may find this guidance helpful for submitting a PR: https://cwiki.apache.org/confluence/display/KAFKA/Contributing+Code+Changes#ContributingCodeChanges-PullRequest

Documentation JIRA KAFKA-6301 and access to repo

2017-12-03 Thread Waleed Fateem
Hello, I created a JIRA (KAFKA-6301) for a minor change to the documentation but it doesn't seem like I can assign the ticket to myself. Can someone help me out? I'm also trying to commit and push the change to the Kafka repository but I'm getting the following error: remote: Permission to apach

New release of Burrow!

2017-12-03 Thread Todd Palino
Hey, all. I wanted to let everyone know that I just released a brand new version of Burrow that resolves a lot of issues that have been collecting. We’ve been working hard on this internally for the last few months, and it’s been running in production at LinkedIn for a few weeks now. So I’m happy t