how often you use Tachyon to accelerate Spark

2015-12-06 Thread Arvin
Hi,all Well, I have some questions about Tachyon and Spark. I found the interactive between Spark and Tachyon is the caching RDD use off-heap. I wonder if you guys use Tachyon frequently, such caching RDD by Tachyon? Is this action(caching rdd by tachyon) has a profound effect to accelerate

Re: AnalysisException Handling for unspecified field in Spark SQL

2015-11-10 Thread Arvin
Hi,you can add a the new column to your DataFrame just before your query. The added column will be null in your new table, so you can have what you want. -- View this message in context: