Additional information. We currently using kafka 0.8 and client will be
written in java.
On Wed, Mar 12, 2014 at 10:41 PM, Vadim Keylis wrote:
> Good evening. I am writing consumer that is based on SimpleConsumer. I
> would like to write integration/unit tests that simulate different error
> re
Good evening. I am writing consumer that is based on SimpleConsumer. I
would like to write integration/unit tests that simulate different error
responses from kafka to make sure my code handles it properly. How do you
guys advised to do this within my unit test? Do you have some kind of mock
kafka
Hi guys,
I wrote up a quick blog post on the new stuff in 0.8.1:
http://blog.empathybox.com/post/79427855885/whats-new-in-kafka-0-8-1
This provides a little more human readable version of the release notes.
Let me know if I missed anything.
-Jay
I don't think this is a Kafka problem. We read from Kafka JMX every few
seconds with SPM and don't see this problem with 0.7.2. Maybe a Jolokia
bug?
Otis
--
Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/
On Wed, Mar 12, 2014 at 4:0
Yes:
https://cwiki.apache.org/confluence/display/KAFKA/Migrating+from+0.7+to+0.8
Otis
--
Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/
On Wed, Mar 12, 2014 at 6:01 PM, Kane Kane wrote:
> Is it possible to update from 0.8 on the f
That is a good point Michael. It looks like Joe fixed the typo. I added an
explanation of the scala versioning.
-Jay
On Wed, Mar 12, 2014 at 2:17 PM, Michael G. Noll
wrote:
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA1
>
> Many thanks to everyone involved in the release!
>
> Please let me s
>> Is it possible to update from 0.8 on the fly (rolling upgrade)?
Yes.
On Wed, Mar 12, 2014 at 3:59 PM, ted won wrote:
> Congrats!! I love Apache Kafka ~
> On Mar 13, 2014 1:34 AM, "Joe Stein" wrote:
>
> > The Apache Kafka community is pleased to announce the general
> availability
> > relea
Congrats!! I love Apache Kafka ~
On Mar 13, 2014 1:34 AM, "Joe Stein" wrote:
> The Apache Kafka community is pleased to announce the general availability
> release of Apache Kafka 0.8.1.
>
> The 0.8.1 release introduces log compaction
> http://kafka.apache.org/documentation.html#compaction and a
I apologize, you are correct. I forgot that you can pass in a list of
hosts. Using a balancer is the way we handle it here, mostly because we
have many producers, and they are not all under our direct control.
To answer the question of what load balancer, we have hardware load
balancers in place i
Is it possible to update from 0.8 on the fly (rolling upgrade)?
On Wed, Mar 12, 2014 at 2:17 PM, Michael G. Noll
wrote:
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA1
>
> Many thanks to everyone involved in the release!
>
> Please let me share two comments:
>
> One, there's a typo on the Downl
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
Many thanks to everyone involved in the release!
Please let me share two comments:
One, there's a typo on the Downloads page [1] for the text of the
source download link: It incorrectly says "kafka-0.8.0-src.tgz"
instead of "kafka-0.8.1-src.tgz". (
Hi Todd,
I am not very clear about you mentioned - "Both the producer and consumer
clients will take care of rebalancing if
there is a broker failure." "
For the producer side, you do need some sort of front end to handle the
metadata requests, or else you would constantly have to change your
pro
Hello,
I'm seeing a large number of sockets to JMX port in CLOSE_WAIT state with
one of our Kafka 0.7.2 brokers.
We use Jolokia to collect stats every minute.
Are there any known issues in this area?
Thanks,
Saulius
+1, as usual, thanks for the great work.
Cheers,
--
Olivier Pomel | CEO, Datadog | http://datadog.com
On Wed, Mar 12, 2014 at 12:43 PM, Dan Di Spaltro wrote:
> Congratulations, great release!
>
>
> On Wed, Mar 12, 2014 at 9:31 AM, Joe Stein wrote:
>
> > The Apache Kafka community is pleased to
Congratulations, great release!
On Wed, Mar 12, 2014 at 9:31 AM, Joe Stein wrote:
> The Apache Kafka community is pleased to announce the general availability
> release of Apache Kafka 0.8.1.
>
> The 0.8.1 release introduces log compaction
> http://kafka.apache.org/documentation.html#compaction
The Apache Kafka community is pleased to announce the general availability
release of Apache Kafka 0.8.1.
The 0.8.1 release introduces log compaction
http://kafka.apache.org/documentation.html#compaction and a move to Gradle for
builds.
Other changes in this release:
https://archive.apache.or
If all brokers are down, the async send will fail. In trunk, we have a new
producer written in java, which allows the caller to register a callback
during async send.
Thanks,
Jun
On Wed, Mar 12, 2014 at 6:52 AM, Yury Ruchin wrote:
> Hi,
>
> Having Kafka 0.8, I send messages using Producer in
Will the following help?
https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whycan'tmyconsumers/producersconnecttothebrokers
?
Thanks,
Jun
On Wed, Mar 12, 2014 at 12:31 AM, kamal wrote:
> Hi,
> We are running KAFKA behind firewall. How to configure the KAFKA outborne
> ports?
>
>
> Re
I had similar questions some time ago.
Here's answer I've got:
> In Kafka, we detect failures using ZK. So, if the network connectivity btw
> the producer and the broker is down, but the one btw the broker and ZK is
> up, we assume the broker is still alive and will continue to send the data
> to
Hi,
Having Kafka 0.8, I send messages using Producer in async mode. I wonder
what will happen if a message cannot be sent (e. g. all brokers get down).
In sync mode, error handling is straightforward: after
"message.send.max.retries" the send() method will throw
FailedToSendMessageException. Howe
Hello
Can you elaborate on what is your producer setup in terms of fetching the
metadata (in conjunction with a load balancer) and some sort of code skeleton?
New to Kafka here.
Also, if you don't mind sharing what do you use as load balancer in this
scenario?
Thanks
--- Original Message ---
Hi,
We are running KAFKA behind firewall. How to configure the KAFKA outborne ports?
Regards,
Kamal C
--
Open WebMail Project (http://openwebmail.org)
--
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.
Both the producer and consumer clients will take care of rebalancing if
there is a broker failure. The consumer handles this entirely in Zookeeper.
For the producer side, you do need some sort of front end to handle the
metadata requests, or else you would constantly have to change your
producer c
23 matches
Mail list logo
