Jay
What is the plan for applying this patch, i wanted to use feature.
On Tue, Mar 3, 2015 at 11:22 PM, Jay Kreps jay.kr...@gmail.com wrote:
Broker replication is available now and fully documented in the docs. This
approach to availability has a lot of advantages discussed in that ticket
and
Hi, Everyone,
Our new java producer in 0.8.2 now exposes message offset to the client. If
you are utilizing the returned offset, you will need to make sure that your
broker is on 0.8.2 too. This is because in 0.8.1, we had a bug in the
broker that returns inconsistent offset in the response to a
Hi Becket,
Can you list down an example for this. It would be easier to understand :)
Thanks,
Mayuresh
On Thu, Mar 19, 2015 at 4:46 PM, Jiangjie Qin j...@linkedin.com.invalid
wrote:
Hi Jason,
The round-robin strategy first takes the partitions of all the topics a
consumer is consuming
Hi,
Is there a plan to update the producer documentation on the wiki located
here:
https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+Producer+Example
This would be helpful for people working on implementing the new
producer class deployed in 0.8.2.x. If there are any patches available
for
SPM only works for Java consumers or, I guess consumers using the built-in
offset management in kafka
On Tue, Mar 17, 2015 at 11:44 PM, Otis Gospodnetic
otis.gospodne...@gmail.com wrote:
Mathias,
SPM for Kafka will give you Consumer Offsets by Host, Consumer Id, Topic,
and Partition, and
I have a .tgz file, I want to extract and read the contents in each file
and load to kafka using java,
anybody help me on this ?
--
Thanks,
Kishore.
Those are pretty much the best javadocs I've ever seen. :)
Nice job, Kafka team.
-James
On Mar 19, 2015, at 9:40 PM, Jay Kreps jay.kr...@gmail.com wrote:
Err, here:
http://kafka.apache.org/083/javadoc/index.html?org/apache/kafka/clients/consumer/KafkaConsumer.html
-Jay
On Thu, Mar
:-)
On Thursday, March 19, 2015, James Cheng jch...@tivo.com wrote:
Those are pretty much the best javadocs I've ever seen. :)
Nice job, Kafka team.
-James
On Mar 19, 2015, at 9:40 PM, Jay Kreps jay.kr...@gmail.com
javascript:; wrote:
Err, here:
Is there a link to the proposed new consumer non-blocking API?
Thanks,
Rajiv
The current work in progress is documented here:
On Thu, Mar 19, 2015 at 7:18 PM, Rajiv Kurian ra...@signalfuse.com wrote:
Is there a link to the proposed new consumer non-blocking API?
Thanks,
Rajiv
Hi Jason,
The round-robin strategy first takes the partitions of all the topics a
consumer is consuming from, then distributed them across all the consumers.
If different consumers are consuming from different topics, the assigning
algorithm will generate different answers on different consumers.
If you start first application with 3 threads (high level consumers) it’ll
consume all 6 partitions. When you start one more application (same group
id) with 3 threads all consumers threads (6) will be rebalanced and each
thread will consume one partition.
Dzmitry
Also you can use the other API that returns a Future and save those futures
into a list and do get() on them to check which message has been sent and
which returned an error so that they can be retried.
Thanks,
Mayuresh
On Thu, Mar 19, 2015 at 9:19 AM, Steven Wu stevenz...@gmail.com wrote:
in
If you are looking for sample code below are the links for Producers and
Consumers using kafka java api's
https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+Producer+Example
https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example
As far as extracting tgz file, I guess
You are correct. The consumer threads will be rebalanced.
liuyiming@foxmail.com
From: rmka rmka
Date: 2015-03-19 14:12
To: users
Subject: High level consumer group
If you start first application with 3 threads (high level consumers) it’ll
consume all 6 partitions. When you start one more
Yes. Thats right. I misunderstood, my bad.
Thanks,
Mayuresh
On Thu, Mar 19, 2015 at 11:05 AM, sunil kalva sambarc...@gmail.com wrote:
future returns RecordMetadata class which contains only metadata not the
actual message.
But i think *steven* had a point like saving the reference in impl
What kind of exceptions are caught and sent to callback method, i think
when there is IOException callback is not called ?
in NetworkClient.java class, from the following code snippet i dont think
callback is called for this exaception ?
try {
this.selector.poll(Math.min(timeout,
i can not just share this. take a look at KafkaRDD from our spark-kafka
library, or starting with spark 1.3.0 you can use the KafkaRDD that is
included with spark.
On Thu, Mar 19, 2015 at 2:58 PM, sunil kalva sambarc...@gmail.com wrote:
Koert
I am very new to spark, is it ok to you to share
in your callback impl object, you can save a reference to the actual
message.
On Wed, Mar 18, 2015 at 10:45 PM, sunil kalva kalva.ka...@gmail.com wrote:
Hi
How do i access the actual message which is failed to send to cluster using
Callback interface and onCompletion method.
Basically if
19 matches
Mail list logo
