We're not using Ooyala's job server. We are holding the spark context for reuse within our own REST server (with a service to run each job).
Our low-latency job now reads all its data from a memory cached RDD, instead of from HDFS seq file (upstream jobs cache resultant RDDs for downstream jobs to read). -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Job-initialization-performance-of-Spark-standalone-mode-vs-YARN-tp2016p2384.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
