Hi everyone!

I'm continuing to investigate the Spark/Shark ecosystem and am fascinated by 
the potential. In noticing that I can cache a DStream, it occurred to me to 
wonder whether there's a way to run Shark queries against a cached DStream? I 
guess this would imply that a cached DStream has "similar enough" structure to 
a Shark table, or could somehow be treated as a (memory-based) "external 
table," for the sake of being representable in the metastore.

Does this make any sense?

Thanks!
Paul

Reply via email to