S Ahmed, This combination of Kafka and Storm to process streaming data is becoming pretty common. Definitely worth looking at.
The throughput will vary depending on your workload (cpu usage, etc.) and if you're talking to a backend, of course. But it scales very well. -Suren On Mon, Dec 2, 2013 at 5:49 PM, S Ahmed <[email protected]> wrote: > Interesting. So twitter storm is used to basically process the messages on > kafka? I'll have to read-up on storm b/c I always thought the use case > was a bit different. > > > > On Sun, Dec 1, 2013 at 9:59 PM, Joe Stein <[email protected]> wrote: > > > Awesome Philip, thanks for sharing! > > > > On Sun, Dec 1, 2013 at 9:17 PM, Philip O'Toole <[email protected]> > wrote: > > > > > A couple of us here at Loggly recently spoke at AWS reinvent, on how we > > > use Kafka 0.72 in our ingestion pipeline. The slides are at the link > > below, > > > and may be of interest to people on this list. > > > > > > > > > > > > http://www.slideshare.net/AmazonWebServices/infrastructure-at-scale-apache-kafka-twitter-storm-elastic-search-arc303-aws-reinvent-2013 > > > > > > Any questions, let me know, though I can't promise I can answer > > > everything. Can't give the complete game away. :-) > > > > > > As always, Kafka rocks! > > > > > > Philip > > > > > > > > > > > > > > > -- ___________________________________________ Available at these partners: [image: CloudFlare | shopify | Bigcommerce] SUREN HIRAMAN, VP TECHNOLOGY SOCIOCAST Simple. Powerful. Predictions. 96 SPRING STREET, 7TH FLOOR NEW YORK, NY 10012 O: (917) 525-2466 ext. 105 F: 646.349.4063 E: [email protected] W: www.sociocast.com Increase Conversion Rates up to 500%. Go to www.sociocast.com and enter your URL for a free trial!
