Re: Which streaming platform is best? Kafka or Spark Streaming?
Thank you very much guys. My question may sound little bit off but was somewhat confused so wanted to get some expert advice on this. I will take a look at the links mentioned in the replies. I really appreciate your suggestions. These are the kind of answers I needed to clear my doubts. Have a nice day ahead. On Fri, Mar 10, 2017 at 6:18 PM, vaquar khan wrote: > Please read Spark documents at least once before asking question. > > http://spark.apache.org/docs/latest/streaming-programming-guide.html > > http://2s7gjr373w3x22jf92z99mgm5w-wpengine.netdna-ssl.com/wp- > content/uploads/2015/11/spark-streaming-datanami.png > > > Regards, > Vaquar khan > > > On Fri, Mar 10, 2017 at 6:17 AM, Sean Owen wrote: > >> Kafka and Spark Streaming don't do the same thing. Kafka stores and >> transports data, Spark Streaming runs computations on a stream of data. >> Neither is itself a streaming platform in its entirety. >> >> It's kind of like asking whether you should build a website using just >> MySQL, or nginx. >> >> >>> On 9 Mar 2017, at 20:37, Gaurav1809 wrote: >>> >>> Hi All, Would you please let me know which streaming platform is best. >>> Be it >>> server log processing, social media feeds ot any such streaming data. I >>> want >>> to know the comparison between Kafka & Spark Streaming. >>> >>> > > > -- > Regards, > Vaquar Khan > +1 -224-436-0783 > > IT Architect / Lead Consultant > Greater Chicago >
Re: Which streaming platform is best? Kafka or Spark Streaming?
Please read Spark documents at least once before asking question. http://spark.apache.org/docs/latest/streaming-programming-guide.html http://2s7gjr373w3x22jf92z99mgm5w-wpengine.netdna-ssl.com/wp-content/uploads/2015/11/spark-streaming-datanami.png Regards, Vaquar khan On Fri, Mar 10, 2017 at 6:17 AM, Sean Owen wrote: > Kafka and Spark Streaming don't do the same thing. Kafka stores and > transports data, Spark Streaming runs computations on a stream of data. > Neither is itself a streaming platform in its entirety. > > It's kind of like asking whether you should build a website using just > MySQL, or nginx. > > >> On 9 Mar 2017, at 20:37, Gaurav1809 wrote: >> >> Hi All, Would you please let me know which streaming platform is best. Be >> it >> server log processing, social media feeds ot any such streaming data. I >> want >> to know the comparison between Kafka & Spark Streaming. >> >> -- Regards, Vaquar Khan +1 -224-436-0783 IT Architect / Lead Consultant Greater Chicago
Re: Which streaming platform is best? Kafka or Spark Streaming?
Kafka and Spark Streaming don't do the same thing. Kafka stores and transports data, Spark Streaming runs computations on a stream of data. Neither is itself a streaming platform in its entirety. It's kind of like asking whether you should build a website using just MySQL, or nginx. > On 9 Mar 2017, at 20:37, Gaurav1809 wrote: > > Hi All, Would you please let me know which streaming platform is best. Be > it > server log processing, social media feeds ot any such streaming data. I > want > to know the comparison between Kafka & Spark Streaming. > >
Re: Which streaming platform is best? Kafka or Spark Streaming?
As Jorn says there is no best. I would start with https://www.oreilly.com/ideas/the-world-beyond-batch-streaming-101. This will help you form some meaningful questions about what tools suit which use cases. Most places have a selection of tools such as spark, kafka, flink, storm, flume and so on. --- Robin East Spark GraphX in Action Michael Malak and Robin East Manning Publications Co. http://www.manning.com/books/spark-graphx-in-action <http://www.manning.com/books/spark-graphx-in-action> > On 9 Mar 2017, at 20:04, Jörn Franke wrote: > > I find this question strange. There is no best tool for every use case. For > example, both tools mentioned below are suitable for different purposes, > sometimes also complementary. > >> On 9 Mar 2017, at 20:37, Gaurav1809 wrote: >> >> Hi All, Would you please let me know which streaming platform is best. Be it >> server log processing, social media feeds ot any such streaming data. I want >> to know the comparison between Kafka & Spark Streaming. >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Which-streaming-platform-is-best-Kafka-or-Spark-Streaming-tp28474.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> - >> To unsubscribe e-mail: user-unsubscr...@spark.apache.org >> > > - > To unsubscribe e-mail: user-unsubscr...@spark.apache.org >
Re: Which streaming platform is best? Kafka or Spark Streaming?
I find this question strange. There is no best tool for every use case. For example, both tools mentioned below are suitable for different purposes, sometimes also complementary. > On 9 Mar 2017, at 20:37, Gaurav1809 wrote: > > Hi All, Would you please let me know which streaming platform is best. Be it > server log processing, social media feeds ot any such streaming data. I want > to know the comparison between Kafka & Spark Streaming. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Which-streaming-platform-is-best-Kafka-or-Spark-Streaming-tp28474.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > - To unsubscribe e-mail: user-unsubscr...@spark.apache.org
Which streaming platform is best? Kafka or Spark Streaming?
Hi All, Would you please let me know which streaming platform is best. Be it server log processing, social media feeds ot any such streaming data. I want to know the comparison between Kafka & Spark Streaming. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Which-streaming-platform-is-best-Kafka-or-Spark-Streaming-tp28474.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org
