Hi again Mich, "But the thing is that I don't explicitly cache the tempTables ..". > > I believe tempTable is created in-memory and is already cached >
That surprises me since there is a sqlContext.cacheTable method to explicitly cache a table in memory. Or am I missing something? This could explain why I'm seeing somewhat worse performance than I'd expect. Cheers, Michael
