[VOTE] 0.9.0.0 Candiate 1

This is the first candidate for release of Apache Kafka 0.9.0.0. This a major release that includes (1) authentication (through SSL and SASL) and authorization, (2) a new java consumer, (3) a Kafka connect framework for data ingestion and egression, and (4) quotas. Since this is a major release, we

Directly access consumer offsets from the special offset topic (__consumer_offsets)

We are in the middle of moving to 0.8.2 and migrating consumer offsets from Zookeeper to Kafka is a major reason for the move. After upgrading, we see a new topic being created: Topic:__consumer_offsetsPartitionCount:50 ReplicationFactor:3 Configs:segment.bytes=xxx,cleanup.poli

Re: Consuming "backwards"?

Hi, obviously this should be build different IMHO (unless I fail to see something that prevents you from doing this). When you realize you fall behind do this: 1. remember your current 2. get the latest offset 3. fork a process to replicate from the current offset +1 to the latest one just fe

new KafkaProducer hangs when no write permissions to topic

Hello everyone, I am using 0.8.2 KafkaProducer in storm to publish to a topic. I create with no write acls, then use the new producer to try to publish and it will hang. I guess we would expect some exception instead. Best Regards, Zhuo Liu Yahoo Inc. Ph.D., CSSE of Auburn University http:/

RE: kafka java producer security to access kerberos

Thank you.. Just figured it out by adding it in producer config properties for kafka java producer. Thanks ben for quick response. Regards Surender Kudumula Big Data Consultant - EMEA Analytics & Data Management surender.kudum...@hpe.com M +44 7795970923 Hewlett-Packard Enterprise Cain Rd, Br

Re: kafka java producer security to access kerberos

Hi Surrender Try using the producer-property option to specify the relevant ssl properties as a set of key-value pairs. There is some helpful info here too B > On 9 Nov 2015, at 15:48, Kudumula, Surender wrote: >

kafka java producer security to access kerberos

Hi all Just a quick question is there any way we can pass the security protocol property to java producer client ./bin/kafka-console-producer.sh --broker-list c6401.ambari.apache.org:6667,c6402.ambari.apache.org:6667 --topic test_topic --security-protocol PLAINTEXTSASL Any reply will be apprecia