Hi, I am doing spark-submit with same resources from a bash script on EC2 Cluster. But, the time taken in running this application is varying a lot from 5 mins to 60 mins across multiple iterations. I am restarting spark cluster with stop-all.sh and start-all.sh scripts after every run of application. What else I need to do so that app runs as fresh ?
Harsh Rathi