we have spark 1.5.x, 1.6.x and 2.0.0 job running on yarn but yarn can have only one spark history server.
what to do? is it safe to use the spark 2 history server to report on spark 1 jobs?
we have spark 1.5.x, 1.6.x and 2.0.0 job running on yarn but yarn can have only one spark history server.
what to do? is it safe to use the spark 2 history server to report on spark 1 jobs?