Hi All,
I have a question and that I want to get your guys inputs.

Subject: finding offsets of current consumers in kaka-storm

I have a topic with 8 partitions and my kafka brokers are running on 2
servers..

I am running Storm topology with Kafka Spout.
I would like to know my current offset of Kafka Spout and Kafka current
position in the topic.

What is the best way to find the current offest position of my Kafka Spout.
What is the delta.

My KafkaSpout is configured by the below method..

    public static KafkaSpout formKafkaSpoutForThisTopic(String zkConnString,
            String topicName) {
        BrokerHosts hosts = new ZkHosts(zkConnString);
        SpoutConfig spoutConfig = new SpoutConfig(hosts, topicName, "/"
                + topicName, topicName);
        spoutConfig.scheme = new SchemeAsMultiScheme(new
StringScheme());
        KafkaSpout kafkaSpout = new KafkaSpout(spoutConfig);

        return kafkaSpout;
    }

What is the best mechanism to find out the current offsets in the topic for
each partition and its consumers.

I tried various ways and am left with no luck.

I am very much interested in contributing to Storm project.

Also please tell me what is the best place to start with contribution.

Thanks,
Venkat

Reply via email to