Hive: Centralized HDFS Caching

2014-08-01 Thread Uli Bethke
Hi. in Hive can I make use of the centralized cache management introduced in Hadoop 2.3 (http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html)? If not implemented yet, is this on the roadmap? My use case is that I want to pin a fact table that

Re: Hive: Centralized HDFS Caching

2014-08-01 Thread Nitin Pawar
Please take a look at hive with tez as execution engine on hadoop 2.3. it may help you compare it with what you want to achieve On Fri, Aug 1, 2014 at 4:13 PM, Uli Bethke uli.bet...@sonra.io wrote: Hi. in Hive can I make use of the centralized cache management introduced in Hadoop 2.3 (

Re: Hive: Centralized HDFS Caching

2014-08-01 Thread Uli Bethke
I am already using tez as the execution engine and used hdfs cacheadmin to pin a file to memroy. However querying that file through Hive still goes to disk. Any ideas? On 01 August 2014 at 11:46 Nitin Pawar nitinpawar...@gmail.com wrote: Please take a look at hive with tez as execution