Could you telnet to the public ip from your local machine?
Thanks,
Jun
On Thu, Jun 12, 2014 at 4:04 AM, 傅駿浩 jamesw...@yahoo.com.tw wrote:
Hi all,
I want to use the KafkaSpout(where is
https://github.com/apache/incubator-storm/tree/master/external/storm-kafka)
to read data from kafka. But
From which consumer instance did you see these exceptions?
Guozhang
On Thu, Jun 12, 2014 at 4:39 PM, Bhavesh Mistry mistry.p.bhav...@gmail.com
wrote:
Hi Kafka Dev Team/ Users,
We have high level consumer group consuming from 32 partitions for a
topic. We have been running 48 consumers
Hi,
I found this caused by broker's config. I miss typed advertise.host.name.
Actually it should be advertised.host.name.
However, I still don't know what's different between host.name and
advertised.host.name. Why Kafka makes it so difficult to connect from public
ip. Thanks your reply.
Best
I wouldn't say that Kafka's making it difficult. The cloud environment is
making it difficult. The VM that the Kafka broker is running on can only
see it's private IP (at the OS level) so you have to add the
advertised.host.name config so that it knows what public IP is assigned to
it.
On Fri,
I have a consumer program that encountered an error when handling a message
and crashed. It does manual commits, and since it failed, it keeps failing
now because it gets the same bad message. I ran the ExportZkOffsets and
ImportZkOffsets tools successfully to advance the offset before when this
For some reason, your committed offsets are no longer in the zknode:
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode =
NoNode for /consumers/mytopic_group/offsets/mytopic/0
In this case, you may have to read from the head of the log with
duplicates, or read from the tail of
Hi,
Thank you very much. Your reply make me clear with Kafka and cloud environment
a lot. And it makes me remind that it seems advertised.host.name is available
after Kafka 0.8. Perhaps we can't access Kafka on GCE from local machine
before, is it correct?
Best regards,
James
Roger Hoover
We have 3 node cluster separate physical box for consumer group and
consumer that died mupd_logmon_hb_
events_sdc-q1-logstream-8-1402448850475-6521f70a. On the box, I show the
above Exception. What can I configure such way, that when a partition in
COnsumer Group does not have Owner other
I am not sure what you are trying to achieve but here is this:
https://github.com/joekiller/logstash-kafka
On Thu, Jun 12, 2014 at 11:06 AM, Sutanu Das sd2...@att.com wrote:
Hi Kafka Users,
1. Is there a plugin/client for Logstash for Kakfa 0.8 ?
2. Is there any example of
I found this embedded kafka example online (
https://gist.github.com/mardambey/2650743) which I am re-writing to work
with 0.8
Can someone help me re-write this portion:
val cons = new SimpleConsumer(localhost, 9090, 100, 1024)
var offset = 0L
var i = 0
while (true) {
val
I'm using Kafka 0.8.1.1.
I have a simple goal: use the high-level consumer to consume a message from
Kafka, publish the message to a different system, and then commit the
message in Kafka. Based on my reading of the docs and the mailing list, it
seems like this isn't so easy to achieve. Here is
Ok so now it is looping through the messages fine, and outputting the
actual message payload:
while (true) {
//val fetchRequest = new FetchRequest(TEST, 0, offset, 1024)
val fetchRequest = new FetchRequestBuilder().addFetch(topic, partition,
offset, 1024).build()
val fetchResponse:
Yes, I believe that prior to Kafka 0.8 there was no easy way for external
clients to talk to Kafka brokers running in a cloud environment.
I wrote a blog post about it here:
https://medium.com/hadoop-2/running-kafka-in-a-hybrid-cloud-environment-17a8f3cfc284
On Fri, Jun 13, 2014 at 10:08 AM,
Actually, there wasn't a way to do it prior to 0.8.1
On Fri, Jun 13, 2014 at 3:30 PM, Roger Hoover roger.hoo...@gmail.com
wrote:
Yes, I believe that prior to Kafka 0.8 there was no easy way for external
clients to talk to Kafka brokers running in a cloud environment.
I wrote a blog post
14 matches
Mail list logo
