juliuszsompolski commented on pull request #28963:
URL: https://github.com/apache/spark/pull/28963#issuecomment-652382625


   @LantaoJin changed it the other way around in 
https://github.com/apache/spark/pull/25960, to display the actual error in AQE, 
I think there are more cases where the more useful internal error gets obscured 
- e.g. when a task fails, you would get actual reason for failure from the root 
cause, as opposed to just a "Task failed 4 times" RuntimeException.
   We've been recently investigating another issue, where 
"SparkUpgradeException" would not be displayed by thriftserver, because it was 
going for the root cause.
   
   Maybe we should do it in general, but then whitelist a few cases that should 
go for the rootcause
   - AQE exception
   - Job/stage failed
   - ...
   ?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to