Kafka snappy compression

Hi, all I'm working on snappy compression in our Node.js client ( https://github.com/SOHU-Co/kafka-node),but I found the offset of message always 0 after snappy compression, for example: , I try to test it in kafka-cosole-producer.sh, but it seems not support snappy. So I can't figure out what's wr

Re: Kafka snappy compression

+Protocol > > > > > On Thu, Mar 27, 2014 at 3:22 AM, 小宇 > > wrote: > > > Hi, all > > I'm working on snappy compression in our Node.js client ( > > https://github.com/SOHU-Co/kafka-node),but I found the offset of message > > always 0 after snappy compress

Re: Kafka snappy compression

ssed messages: > ./rdkafka_example -P -t topic -p 0 -b mybroker -z snappy > > > > 2014-03-27 19:21 GMT+07:00 小宇 : > > > Yes,maybe I missed something, and how can I send message in snappy > > compression with Kafka-console-producer? > > Thanks. > > > >

Re: Kafka snappy compression

Hi, here is the issue. https://issues.apache.org/jira/browse/KAFKA-1344 2014-03-27 20:31 GMT+08:00 Neha Narkhede : > Currently the console producer only supports GZIP. Could you please file a > JIRA for the snappy support? > > > > > On Thu, Mar 27, 2014 at 5:21 AM, 小宇 wro

Exception with kafka 0.8

Hi,I'm new to kafka, and i follow the quickstart guide, when i come to the Step 2,i run bin/kafka-server-start.sh config/server.properties , but got exception: [2013-08-06 09:55:14,603] INFO 0 successfully elected as leader (kafka.server.ZookeeperLeaderElector) [2013-08-06 09:55:14,657] ERROR Erro

Topic related API

Hi All, why not provide CreateTopic and DeleteTopic api, we know when auto.create.topics.enable set true, kafka can auto create the topic, but the problem is it always take some time before we can lookup the topic in zookeeper, will this can be solved in the future version of kafka? Thanks! Best

Re: Topic related API

Anyone help? 2013/10/30 小宇 > Hi All, > > why not provide CreateTopic and DeleteTopic api, we know when > auto.create.topics.enable set true, kafka can auto create the topic, but > the problem is it always take some time before we can lookup the topic in > zookeeper, will thi

Re: Topic related API

/30 小宇 : > Anyone help? > > > 2013/10/30 小宇 > >> Hi All, >> >> why not provide CreateTopic and DeleteTopic api, we know when >> auto.create.topics.enable set true, kafka can auto create the topic, but >> the problem is it always tak

Re: Commit Offset per topic

offset commit API could solve your problem, it's for 0.8 version. ---Sent from Boxer | http://getboxer.com Thanks Neha! I guess auto-commit it is for now... On Tue, Nov 5, 2013 at 5:08 AM, Neha Narkhede wrote: > Currently, the only way to achieve that is to use the SimpleConsumer API.

Problem of FetchRequest API

Hi, I am now using kafka0.8, i have problem with FetchRequest API ( https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol#AGuideToTheKafkaProtocol-FetchRequest), the detail of the problem as follow: I send two FetchRequest [topic, partition, maxWaitTime] through 1 sock

Re: Problem of FetchRequest API

so, could you file a jira? > > Thanks, > > Jun > > > On Wed, Nov 20, 2013 at 12:05 AM, 小宇 wrote: > > > Hi, > > I am now using kafka0.8, i have problem with FetchRequest API ( > > > > > https://cwiki.apache.org/confluence/display/KAFKA/

Re: Problem of FetchRequest API

My apologies, I made mistake, the order in which Kafka server handle requests has no problem. Thanks. 2013/11/21 Jun Rao > Does the built-in java client have the same problem? > > Thanks, > > Jun > > > On Wed, Nov 20, 2013 at 7:00 PM, 小宇 wrote: > > > Yes, it

Re: are topics and partitions dynamic?

"auto.create.topics.enable" are default true, so you don't need care about it. And you can set it false in the server.properties 2013/12/4 Magnus Edenhill > See the configuration reference here: > > https://kafka.apache.org/documentation.html#configuration > > > 2013/12/4 Arjun > > > hi, > >

Re: node.js client library?

Hi, here is a Node.js client for latest Kafka: https://github.com/SOHU-Co/kafka-node.git 2013/12/25 Thomas > Hi Joe, > > I've started a node.js implementation for 0.8. (https://github.com/ > wurstmeister/node-kafka-0.8-plus) > > I'd welcome any feedback or help. > > Regards > > Thomas > > > > O

Re: node.js client library?

che.org/confluence/display/KAFKA/Clients > > I also added wurstmeister's port of storm-kafka for 0.8.0 also to the > client list and my company's Scala DSL too > > thnx =) Joestein > > > On Fri, Dec 27, 2013 at 1:15 AM, 小宇 wrote: > > > Hi, here is a Node.js

Kafka server - conflicted ephemeral node

Hi, all Our kafka server encounter an unexpected shut down last night, I checked the logs, it says there is a conflicted ephemeral node, but can't find what issue it is, can anyone help check this, thanks! [2015-04-21 03:00:00,562] INFO conflict in /brokers/ids/0 data: {"jmx_port":-1,"timestamp

Re: Kafka server - conflicted ephemeral node

gt; > Mayuresh > Sent from my iPhone > > > On Apr 20, 2015, at 8:22 PM, 小宇 wrote: > > > > 10.144.38.185 >

Re: Kafka server - conflicted ephemeral node

s, > > Mayuresh > > On Mon, Apr 20, 2015 at 8:52 PM, 小宇 > > wrote: > > > Thanks for your response gharatmayuresh1, but I don't know what you mean > > exactly. I have restart my server and I want to find out the cause in > case > > it happen again