Topic existance Java API

Hi, I am on Kafka 2.8.2. Looking for a way to check whether topic existed or not in Java. I saw there is a method called listTopics - TopicCommand.listTopics, but the return type is void. Is there an API to check topic existance? (preferable argument: (zkconnect, topic)) Thanks in advance!

Kafka ipv6

Hi, I am facing trouble in version 0.8.2.1. I saw this issue is closed. https://issues.apache.org/jira/browse/KAFKA-1123 The console-producer --broker-list option from command line tool does work with ipv6. But we are using the 'new Producer(config);', and

Re: Kafka ipv6

Resolved ... My cilent is compiled with a old version of kafka. Mingtao Best Regards, Mingtao On Wed, Apr 8, 2015 at 3:00 PM, Mingtao Zhang mail2ming...@gmail.com wrote: Hi, I am facing trouble in version 0.8.2.1. I saw this issue is closed. https://issues.apache.org/jira/browse/KAFKA-1123

Re: zookeeper upgrade or remove zookeeper dependency

?jql=project%20%3D%20Kafka%20and%20fixVersion%20%3D%200.8.2%20and%20status%20!%3D%20Resolved%20and%20status%20!%3D%20Closed . On Wed, Sep 17, 2014 at 10:00 AM, Mingtao Zhang mail2ming...@gmail.com wrote: Could you also share a rough time point of 0.8.2 release? Best Regards, Mingtao

Re: zookeeper upgrade or remove zookeeper dependency

Great :) Best Regards, Mingtao On Thu, Sep 18, 2014 at 2:04 PM, Guozhang Wang wangg...@gmail.com wrote: Hi Mingtao, We are shooting to cut the 0.8.2 branch this month. Guozhang On Thu, Sep 18, 2014 at 10:36 AM, Mingtao Zhang mail2ming...@gmail.com wrote: Good to know. Does it mean

zookeeper upgrade or remove zookeeper dependency

Hi, I could see kafka is using zookeeper 3.3.4. For my integration purpose, I want to use curator, which requires a higher version than 3.3.4 even in its lowest version. I there any plan to bump up zookeeper dependency? Or is there any plan to remove zookeeper dependency? Best Regards, Mingtao

Re: zookeeper upgrade or remove zookeeper dependency

at 8:55 AM, Mingtao Zhang mail2ming...@gmail.com wrote: Hi, I could see kafka is using zookeeper 3.3.4. For my integration purpose, I want to use curator, which requires a higher version than 3.3.4 even in its lowest version. I there any plan to bump up zookeeper dependency

Re: Consumer Parallelism

consumer fails, so the behavior you described will not be expected. Guozhang On Mon, Aug 11, 2014 at 6:27 PM, Mingtao Zhang mail2ming...@gmail.com wrote: Hi Guozhang, I do have another Email talking about Partitions per topic. I paste it within this Email. I am expecting those consumers

Re: Consumer Parallelism

, Aug 12, 2014 at 7:55 AM, Mingtao Zhang mail2ming...@gmail.com wrote: Hi Guozhang, Thank you! Could I say the consumer 'take turns to consume' is resulted by the correspond partition got the 'message write'? The problem I am facing is my 'enrichment' (getting more data based on raw data

Re: Consumer Parallelism

-Whyisdatanotevenlydistributedamongpartitionswhenapartitioningkeyisnotspecified ? On Tue, Aug 12, 2014 at 8:11 AM, Mingtao Zhang mail2ming...@gmail.com wrote: Hi Guozhang, I think what I am looking for is the real 'randomness' when producer write to the partitions. Based on my log, through a long time period, only one partition got the write

Consumer Parallelism

Hi, We are using the following method on ConsumerConnector to get multiple streams per topic, and we have multiple partitions per topic. It looks like only one of the runnable is active through a relative long time period. Is there anything we could possible missed? public K,V MapString,

Re: Consumer Parallelism

Is it anyhow related to the issue? WARN No previously checkpointed highwatermark value found for topic RAW partition 0. Returning 0 as the highwatermark (kafka.server.HighwaterMarkCheckpoint) Mingtao

Re: Consumer Parallelism

), --partition, 8 }; CreateTopicCommand.main(args); On Wed, Jul 23, 2014 at 4:38 PM, Mingtao Zhang mail2ming...@gmail.com wrote: Hi All, In kafka.properties, I put (forgot to change): num.partitions=1 While I create topics programatically: String[] args

Re: num.partitions vs CreateTopicCommand.main(args)

), --replica, config.getString(replicas), --partition, 8 }; CreateTopicCommand.main(args); On Wed, Jul 23, 2014 at 4:38 PM, Mingtao Zhang mail2ming...@gmail.com wrote: Hi All, In kafka.properties, I put (forgot to change): num.partitions=1 While

Re: Unclean kafka shutdown

Just curious about, whether the memory allocated is released or not. Mingtao Sent from iPhone On Jun 4, 2014, at 1:31 PM, Ryan Williams rwilli...@gmail.com wrote: I've noticed that kafka frequently fails to shut down completely when running the shutdown script. After executing

Cause and Recovery

if more log is needed. (It hangs the integration test, so I have 3.5G of them ... from a maven build) -- Best Regards, Mingtao Zhang