sarutak commented on PR #55869: URL: https://github.com/apache/spark/pull/55869#issuecomment-4517783682
Hi @yadavay-amzn, I'm skeptical if the solution is valid. I have some questions. 1. Did you reproduce the issue even with `master` branch? 2. Did you find the root cause of the issue? I traced the classloader chain and `jarClassLoader`'s parent should be SparkSubmit's `MutableURLClassLoader` which already contains `spark.jars`. So parent delegation should work. I don't understand why you think like "This delegation is not reliable in ThriftServer's thread pool threads". 3. If you found the root cause, why do you think the proposed solution is valid for the root cause? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
