Github user vanzin commented on the issue: https://github.com/apache/spark/pull/21756 I really dislike exposing this a something that others can override. We should be going the other way, and making that code as generic as possible. If there's something that you can fix in the existing code to enable your use case, that would be better. Otherwise, I suggest just patching the needed code in your deployment; sounds from your e-mails like you're already modifying Spark, so...
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org