Re: Kafka monitor unable to get offset lag

2017-02-02 Thread Priyank Shah
"user@storm.apache.org" <user@storm.apache.org> Subject: Re: Kafka monitor unable to get offset lag Yes running from command line gives me json with topic lag. What is secured setup? On Wed, Feb 1, 2017 at 10:28 PM, Priyank Shah <ps...@hortonworks.com<mailto:ps...@hortonworks.com&g

Re: Kafka monitor unable to get offset lag

2017-02-01 Thread Igor Kuzmenko
dnesday, February 1, 2017 at 5:05 AM > *To: *"user@storm.apache.org" <user@storm.apache.org> > *Subject: *Re: Kafka monitor unable to get offset lag > > > > Found in logs with debug level: > > 2017-02-01 14:06:54.053 o.a.s.u.TopologySpoutLag [DEBUG] spout class

Re: Kafka monitor unable to get offset lag

2017-02-01 Thread Priyank Shah
"user@storm.apache.org" <user@storm.apache.org> Date: Wednesday, February 1, 2017 at 5:05 AM To: "user@storm.apache.org" <user@storm.apache.org> Subject: Re: Kafka monitor unable to get offset lag Found in logs with debug level: 2017-02-01 14:06:54.053 o.a.s.u.To

Re: Kafka monitor unable to get offset lag

2017-02-01 Thread Igor Kuzmenko
Found in logs with debug level: 2017-02-01 14:06:54.053 o.a.s.u.TopologySpoutLag [DEBUG] spout classname: org.apache.storm.kafka.spout.KafkaSpout 2017-02-01 14:06:54.053 o.a.s.u.TopologySpoutLag [DEBUG] json configuration: {config.bootstrap.servers=dn-06.ru:6667,dn-10.ru:6667, config.topics=gtp,,

Re: Kafka monitor unable to get offset lag

2017-02-01 Thread Spico Florin
Hello! You can check how your topic is consumed and its health via the scripts: ./kafka-consumer-groups.sh --new-consumer --bootstrap-server :6667 --list ./kafka-consumer-groups.sh --new-consumer --bootstrap-server :6667 --describe --group I hope it helps. Florin On Wed, Feb 1, 2017 at

Re: Kafka monitor unable to get offset lag

2017-02-01 Thread Igor Kuzmenko
Yes, topology process data and works fine. I couldn't find any exceptions in storm logs. access-web-ui.log contains only these lines 2017-02-01 11:58:17.315 o.a.s.l.f.AccessLoggingFilter [INFO] Access from: 10.35.63.14 url: http://master001.s:8744/api/v1/cluster/summary principal: 2017-02-01

Re: Kafka monitor unable to get offset lag

2017-01-31 Thread Priyank Shah
Hi Igor, When you say topology is working fine do you mean you see data flowing? Can you try to look up the logs for ui server and paste relevant lines here if any? Priyank Sent from my iPhone On Jan 31, 2017, at 4:34 AM, Igor Kuzmenko > wrote:

Kafka monitor unable to get offset lag

2017-01-31 Thread Igor Kuzmenko
I've launched topology with new kafka spout. Topology by it self working fine, but looking at storm UI I see kafka-monitor exception: *Unable to get offset lags for kafka. Reason: org.apache.kafka.shaded.common.errors.TimeoutException: Timeout expired while fetching topic metadata* Maybe I forgot