Hi,
I was profiling the startup time of Spark Interpreter in our environment,
and it looks like
a total of 5 seconds is spent at this line in
SparkScala212Interpreter.scala:
sparkILoop.initializeSynchronous()
That line, eventually, calls nsc.Global constructor, which spends 5 seconds
creating mirrors
of every class on the classpath. Obviously, most users will never care
about most of those
classes.
Any ideas on how this can be sped up, maybe by only looking at key spark
classes?
[image: image.png]
--
Vladimir Prus
http://vladimirprus.com
