I created a simple Spark Streaming program - it received numbers and computed averages and sent the results to Kafka.
It worked perfectly in local mode as well as standalone master/slave mode across a two-node cluster. It did not work however in yarn-client or yarn-cluster mode. The job was accepted and running on a node but did not produce any outputs... Any suggestions? Thanks! cloud