Unsubscribe

Measuring cluster utilization of a streaming job

Hi, I was wondering if anyone has done some work around measuring the cluster resource utilization of a "typical" spark streaming job. We are trying to build a message ingestion system which will read from Kafka and do some processing. We have had some concerns raised in the team that a 24*7