Re: Exception not failing Python applications (in yarn client mode) - SparkLauncher says app succeeded, where app actually has failed

It's a known issue. There was one jira which was marked resolved but I still faced it in 1.6. On 12 Nov 2016 14:33, "Elkhan Dadashov" wrote: > Hi, > > *Problem*: > Spark job fails, but RM page says the job succeeded, also > > appHandle = sparkLauncher.startApplication() > ... > > appHandle.getSta

Exception not failing Python applications (in yarn client mode) - SparkLauncher says app succeeded, where app actually has failed

Hi, *Problem*: Spark job fails, but RM page says the job succeeded, also appHandle = sparkLauncher.startApplication() ... appHandle.getState() returns Finished state - which indicates The application finished with a successful status, whereas the Spark job actually failed. *Environment*: Macint