Well, you are posting on the Spark mailing list. Though for streaming I'd recommend Flink over Spark any day of the week. Flink was written as a streaming platform from the beginning quickly aligning the API with the theoretical framework of Google's Dataflow whitepaper. It's awesome for streaming. Spark not so much so far. Might become better, though the inital use case for Spark wasn't streaming, they might overcome that or not. I'd still go with Flink for streaming.
If you need cross platform support you can take a look at Beam. Beam has Dataflow, Spark and Flink runners among others. Regards, Magnus On Wed, Aug 21, 2019 at 8:43 AM Eliza <e...@chinabuckets.com> wrote: > Hello, > > We have all of spark, flink, storm, kafka installed. > For realtime streaming calculation, which one is the best above? > Like other big players, the logs in our stack are huge. > > Thanks. > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
