[
https://issues.apache.org/jira/browse/HIVE-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gopal V updated HIVE-7313:
--------------------------
Description:
With HDFS storage policies implementation, temporary tables can be written with
different storage/reliability policies.
In-session temporary tables can be targetted at both SSD and memory storage
policies, with fallbacks onto the disk and the associated reliability
trade-offs.
was:
With HDFS storage policies implementation, temporary tables can be written with
different storage/reliability policies.
Any session with an in-memory table can create HDFS in-memory pools with
default caching semantics and add its files into the cache pool.
Example code to implement the behaviour was prototyped for the Tez Application
Master, but the AM does not have enough information to determine the cache
policies.
https://github.com/rajeshbalamohan/hdfs-cache-tool/blob/master/src/main/java/org/apache/hadoop/hdfs/tools/HDFSCache.java#L74
> Allow in-memory/ssd session-level temp-tables
> ---------------------------------------------
>
> Key: HIVE-7313
> URL: https://issues.apache.org/jira/browse/HIVE-7313
> Project: Hive
> Issue Type: Improvement
> Components: Tez
> Affects Versions: 0.14.0
> Reporter: Gopal V
> Assignee: Gopal V
> Labels: InMemory, Performance
>
> With HDFS storage policies implementation, temporary tables can be written
> with different storage/reliability policies.
> In-session temporary tables can be targetted at both SSD and memory storage
> policies, with fallbacks onto the disk and the associated reliability
> trade-offs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
