Tachyon should be co-located with Spark in this case. Best,
Haoyuan On Tue, Mar 31, 2015 at 4:30 PM, Ankur Chauhan <achau...@brightcove.com> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hi, > > I am fairly new to the spark ecosystem and I have been trying to setup > a spark on mesos deployment. I can't seem to figure out the "best > practices" around HDFS and Tachyon. The documentation about Spark's > data-locality section seems to point that each of my mesos slave nodes > should also run a hdfs datanode. This seems fine but I can't seem to > figure out how I would go about pushing tachyon into the mix. > > How should i organize my cluster? > Should tachyon be colocated on my mesos worker nodes? or should all > the spark jobs reach out to a separate hdfs/tachyon cluster. > > - -- Ankur Chauhan > -----BEGIN PGP SIGNATURE----- > > iQEcBAEBAgAGBQJVGy4bAAoJEOSJAMhvLp3L5bkH/0MECyZkh3ptWzmsNnSNfGWp > Oh93TUfD+foXO2ya9D+hxuyAxbjfXs/68aCWZsUT6qdlBQU9T1vX+CmPOnpY1KPN > NJP3af+VK0osaFPo6k28OTql1iTnvb9Nq+WDlohxBC/hZtoYl4cVxu8JmRlou/nb > /wfpp0ShmJnlxsoPa6mVdwzjUjVQAfEpuet3Ow5veXeA9X7S55k/h0ZQrZtO8eXL > jJsKaT8ne9WZPhZwA4PkdzTxkXF3JNveCIKPzNttsJIaLlvd0nLA/wu6QWmxskp6 > iliGSmEk5P1zZWPPnk+TPIqbA0Ttue7PeXpSrbA9+pYiNT4R/wAneMvmpTABuR4= > =8ijP > -----END PGP SIGNATURE----- > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > > -- Haoyuan Li AMPLab, EECS, UC Berkeley http://www.cs.berkeley.edu/~haoyuan/
