I don't think so. we were using spark integarted with Kafka for streaming computing and realtime reports. that just works.
SPARK is now just an overhyped and overcomplicated ETL tool, nothing more, there is another distributed AI called as Ray, which should be the next billion dollar company instead of just building those features in SPARK natively using a different computation engine :)
--------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org