Github user holdenk commented on the issue: https://github.com/apache/spark/pull/13599 So for what its worth I made a quick POC of supporting similar functionality without requiring any changes to Spark its self ( https://github.com/nteract/coffee_boat ) which should also work in standalone mode. I'm going to poke at it a bit more and explore if pex might be better than conda (although given the packages most folks want conda seems better).
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org