Re: Streaming on Exponential Data

and it was acting as expected. But when there was exponential data in Kafka, my program started crashing saying Cannot Compute split on input data... also I found on console logs that it was adding data continuously in memory while receiving from Kafka. How Spark Streaming behaves towards exponential

Streaming on Exponential Data

Cannot Compute split on input data... also I found on console logs that it was adding data continuously in memory while receiving from Kafka. How Spark Streaming behaves towards exponential data.