Re: Kafka 0.8 Maven and IntelliJ

Try the one under core/targets? On Tue, Jun 11, 2013 at 3:34 PM, Florin Trofin wrote: > I downloaded the latest 0.8 snapshot and I want to build using Maven: > > ./sbt make-pom > > Generates a bunch of pom.xml files but when I try to open one of them in > IntelliJ they are not recognized. Do I

Re: Events stored in Apache Web Logs - how best to get these into Kafka?

As long as you can pipe log data to console-producer, you can get the data into Kafka. Thanks, Jun On Tue, Jun 11, 2013 at 2:57 PM, James Newhaven wrote: > I have a lot of user event data being sent to an apache web server and > written to web logs. Unfortunately I don't control this flow, but

getting git error, opened INFRA ticket already

https://issues.apache.org/jira/browse/INFRA-6381 anyone not having the issue? -- /* Joe Stein http://www.linkedin.com/in/charmalloc Twitter: @allthingshadoop */

Kafka 0.8 Maven and IntelliJ

I downloaded the latest 0.8 snapshot and I want to build using Maven: ./sbt make-pom Generates a bunch of pom.xml files but when I try to open one of them in IntelliJ they are not recognized. Do I need to do any other step? Which pom do I need to open? Thanks! Florin

Events stored in Apache Web Logs - how best to get these into Kafka?

I have a lot of user event data being sent to an apache web server and written to web logs. Unfortunately I don't control this flow, but do I have access to the server the logs are being written to. I need a way to access these events as soon as they have been written to the log file and send this

Re: kafka 0.8

Yeah probably a good idea to upgrade your end first, I'm sure some things might come up :) On Tue, Jun 11, 2013 at 1:02 PM, Soby Chacko wrote: > Jun, > > That is great to hear. Looking forward to it. > > Thanks, > Soby > > > On Tue, Jun 11, 2013 at 12:20 PM, Jun Rao wrote: > > > Soby, > > > >

Re: kafka 0.8

Jun, That is great to hear. Looking forward to it. Thanks, Soby On Tue, Jun 11, 2013 at 12:20 PM, Jun Rao wrote: > Soby, > > Sorry for the delay. This week and early next week, all Kafka committers at > LinkedIn are busy with upgrading Kafka to 0.8 internally at LinkedIn. We > will try to sta

Re: Arguments for Kafka over RabbitMQ ?

Hi Tim, While your comments regarding durability are accurate for 0.7 version of Kafka, it is a bit greyer with 0.8. In 0.8 you have the ability to configure Kafka to have the durability you need. This is what I was referring to with the link to Jun’s ApacheCon slides ( http://www.slideshare.net

Re: Kakfa Failures and Recovery

At LinkedIn, the most common type of failure is controlled shutdown for code/config pushes. For that, we have a tool for reducing the unavailability window ( https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools). This can happen once or twice a month. The next common type of failure

Re: kafka 0.8

Soby, Sorry for the delay. This week and early next week, all Kafka committers at LinkedIn are busy with upgrading Kafka to 0.8 internally at LinkedIn. We will try to start the release process as soon as we have things under control. Thanks, Jun On Mon, Jun 10, 2013 at 6:54 PM, Soby Chacko wr

Re: Arguments for Kafka over RabbitMQ ?

Hi Jonathan, So, thanks for replying - that's all useful info. On 10 Jun 2013, at 14:19, Jonathan Hodges wrote: > Kafka has a configurable rolling window of time it keeps the messages per > topic. The default is 7 days and after this time the messages are removed > from disk by the broker. > Cor

Kakfa Failures and Recovery

Hi, We are using 0.8 version of Kafka and are planning for high availability testing with replication. While the entire scheme to enable the cluster to be highly available is clear, I wanted to get some idea about Kafka Service lifetime in terms of Mean-Time to Failure and Time of Recovery in c