Hello Everyone, Could you please let me know if there any optimal way to request executors while submitting job in yarn mode.
My job is running slow by printing out following statements. Is there a way to speed up process? 16/11/17 14:03:49 WARN spark.SparkContext: Requesting executors is only supported in coarse-grained mode 16/11/17 14:03:49 WARN spark.ExecutorAllocationManager: Unable to reach the cluster manager to request 2 total executors! 16/11/17 14:03:50 WARN spark.SparkContext: Requesting executors is only supported in coarse-grained mode 16/11/17 14:03:50 WARN spark.ExecutorAllocationManager: Unable to reach the cluster manager to request 3 total executors! 16/11/17 14:03:51 WARN spark.SparkContext: Requesting executors is only supported in coarse-grained mode 16/11/17 14:03:51 WARN spark.ExecutorAllocationManager: Unable to reach the cluster manager to request 4 total executors! 16/11/17 14:03:52 WARN spark.SparkContext: Requesting executors is only supported in coarse-grained mode 16/11/17 14:03:52 WARN spark.ExecutorAllocationManager: Unable to reach the cluster manager to request 5 total executors! 16/11/17 14:03:53 WARN spark.SparkContext: Requesting executors is only supported in coarse-grained mode 16/11/17 14:03:53 WARN spark.ExecutorAllocationManager: Unable to reach the cluster manager to request 6 total executors! 16/11/17 14:03:54 WARN spark.SparkContext: Requesting executors is only supported in coarse-grained mode 16/11/17 14:03:54 WARN spark.ExecutorAllocationManager: Unable to reach the cluster manager to request 7 total executors! 16/11/17 14:03:55 WARN spark.SparkContext: Requesting executors is only supported in coarse-grained mode 16/11/17 14:03:55 WARN spark.ExecutorAllocationManager: Unable to reach the cluster manager to request 8 total executors! 16/11/17 14:03:56 WARN spark.SparkContext: Requesting executors is only supported in coarse-grained mode 16/11/17 14:03:56 WARN spark.ExecutorAllocationManager: Unable to reach the cluster manager to request 9 total executors! 16/11/17 14:03:57 WARN spark.SparkContext: Requesting executors is only supported in coarse-grained mode 16/11/17 14:03:57 WARN spark.ExecutorAllocationManager: Unable to reach the cluster manager to request 10 total executors! 16/11/17 14:03:58 WARN spark.SparkContext: Requesting executors is only supported in coarse-grained mode 16/11/17 14:03:58 WARN spark.ExecutorAllocationManager: Unable to reach the cluster manager to request 11 total executors! 16/11/17 14:03:59 WARN spark.SparkContext: Requesting executors is only supported in coarse-grained mode 16/11/17 14:03:59 WARN spark.ExecutorAllocationManager: Unable to reach the cluster manager to request 12 total executors! 16/11/17 14:04:00 WARN spark.SparkContext: Requesting executors is only supported in coarse-grained mode Thanks, Asmath.