Re: KafkaIO nothing received?

2017-05-10 Thread Conrad Crampton
works for you once Kafka is upgraded to 0.9+. I wish the Kafka 0.9 consumer failed more explicitly, rather than just hanging. Raghu. On Wed, May 10, 2017 at 5:17 AM, Conrad Crampton mailto:conrad.cramp...@secdata.com>> wrote: Hi Raghu, I would like to be running 0.9 Kafka servers, but I can

Re: KafkaIO nothing received?

2017-05-10 Thread Conrad Crampton
e from Kafka consumer itself. I think it ignores configuration settings that it does not know about and logs them<https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/clients/consumer/KafkaConsumer.java#L721>. Raghu. On Mon, May 8, 2017 at 1:57 AM, Conrad Crampton

Re: KafkaIO nothing received?

2017-05-08 Thread Conrad Crampton
it is just waiting for records, please ensure the topic has messages (using kafka-console-consumer.sh etc). Alternately you can try reading from another topic you mentioned that worked fine. Raghu. On Thu, May 4, 2017 at 10:07 AM, Conrad Crampton mailto:conrad.cramp...@secdata.com>> wrote

Re: KafkaIO nothing received?

2017-05-04 Thread Conrad Crampton
, I can run it in my local env. There're two points you may have a check: 1). does the topic have data there, you can confirm with kafka cli 'bin/kafka-console-consumer.sh'; 2). is the port in bootstrapServers right? By default it's 9092. On Thu, May 4, 2017 at 9:05

Slack access?

2017-05-04 Thread Conrad Crampton
Hi, Can I be added to the Slack channel please when next updated? conrad.cramp...@secdata.com Many thanks Conrad SecureData, combating cyber threats __ The information contained in this mess

KafkaIO nothing received?

2017-05-04 Thread Conrad Crampton
Hi, New to the group – ‘hello’! Just starting to look into Beam and I very much like the concepts, but have rather fallen at the first hurdle – that being trying to subscribe to a kafka topic and process results. Very simply the following code doesn’t get receive any records (the data is going