I'm interested in what the "best practice" is for running pyspark jobs against a mesos cluster.
Right now, we're simply passing the --master mesos://host:5050 flag, which appears to register a framework properly. However, I was told this isn't "cluster mode" - and I'm a bit confused. What is the recommended method of doing this? Thanks, June Taylor System Administrator, Minnesota Population Center University of Minnesota