I’m not sure whether this is something controllable via Spark, but when you call spark-submit with --packages you get a lot of output. Is there any way to suppress it? Does it come from Apache Ivy?
I posted more details about what I’m seeing on Stack Overflow <https://stackoverflow.com/q/49000342/877069>. Nick