More updates: Seems in TachyonBlockManager.scala(line 118) of Spark 1.1.0, the TachyonFS.mkdir() method is called, which creates a directory in Tachyon. Right after that, TachyonFS.getFile() method is called. In all the versions of Tachyon I tried (0.4.1, 0.4.0), the second method will return a null on directory paths. Is it just me? Anyone else using Spark with Tachyon had any problems?
Thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Cannot-create-dir-in-Tachyon-when-running-Spark-with-OFF-HEAP-caching-FileDoesNotExistException-tp8959p9110.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
