[
https://issues.apache.org/jira/browse/HIVE-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gopal V updated HIVE-7313:
--------------------------
Description:
With HDFS storage policies implementation, temporary tables can be written with
different storage/reliability policies.
Any session with an in-memory table can create HDFS in-memory pools with
default caching semantics and add its files into the cache pool.
Example code to implement the behaviour was prototyped for the Tez Application
Master, but the AM does not have enough information to determine the cache
policies.
https://github.com/rajeshbalamohan/hdfs-cache-tool/blob/master/src/main/java/org/apache/hadoop/hdfs/tools/HDFSCache.java#L74
was:
When the hadoop-2.3C shims are in action, APIs which can pin small tables into
memory are available.
Any session with an in-memory table can create HDFS in-memory pools with
default caching semantics and add its files into the cache pool.
Example code to implement the behaviour was prototyped for the Tez Application
Master, but the AM does not have enough information to determine the cache
policies.
https://github.com/rajeshbalamohan/hdfs-cache-tool/blob/master/src/main/java/org/apache/hadoop/hdfs/tools/HDFSCache.java#L74
> Allow in-memory/ssd session-level temp-tables
> ---------------------------------------------
>
> Key: HIVE-7313
> URL: https://issues.apache.org/jira/browse/HIVE-7313
> Project: Hive
> Issue Type: Improvement
> Components: Tez
> Affects Versions: 0.14.0
> Reporter: Gopal V
> Assignee: Gopal V
> Labels: InMemory, Performance
>
> With HDFS storage policies implementation, temporary tables can be written
> with different storage/reliability policies.
> Any session with an in-memory table can create HDFS in-memory pools with
> default caching semantics and add its files into the cache pool.
> Example code to implement the behaviour was prototyped for the Tez
> Application Master, but the AM does not have enough information to determine
> the cache policies.
> https://github.com/rajeshbalamohan/hdfs-cache-tool/blob/master/src/main/java/org/apache/hadoop/hdfs/tools/HDFSCache.java#L74
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
