[
https://issues.apache.org/jira/browse/HIVE-29411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
László Bodor updated HIVE-29411:
--------------------------------
Description:
Currently, Hive has a generic Docker image for HS2 + full execution, as
implemented in HIVE-26400, and for HMS, as implemented in HIVE-27275.
These images are great for testing and demonstration purposes; however, for
real distributed execution, we need additional improvements. There are two ways
to achieve this:
1) LLAP execution - in a Docker image, implemented here
HS2 -> TezAM -> Daemon
2) Tez container execution - in a Docker image, implemented under TEZ-4662
HS2 -> TezAM -> TezContainer
Both 1) and 2) need TezAM container to be implemented under TEZ-4682, but 1) is
easier from Hive perspective, becuase for the TezContainer docker mode, we also
need TEZ-4665
Assuming that this Jira and TEZ-4682 are resolved, one should be able to deploy
a fully distributed Hive warehouse with the components: HS2, HMS, TezAM,
LlapDaemon
was:
Currently, Hive has a generic Docker image for HS2 + full execution as
implemented in HIVE-26400 and for HMS as implemented in HIVE-27275.
These images are great for testing and demonstration purposes; however, for
real distributed execution, we need additional improvements. There are two ways
to achieve this:
1) LLAP execution - in a docker image, implemented here
HS2 -> TezAM -> Daemon
2) Tez container execution - in a docker image, implemented under TEZ-4662
HS2 -> TezAM -> TezContainer
Both 1) and 2) need TezAM container to be implemented under TEZ-4682, but 1) is
easier from Hive perspective, becuase for the Tez TezContainer docker mode, we
need TEZ-4665 also
Assuming that this jira and TEZ-4682 is resolved, one should able to deploy a
fully distributed hive warehouse with the components: HS2, HMS, TezAM,
LlapDaemon
> Provide docker image for LLAP
> -----------------------------
>
> Key: HIVE-29411
> URL: https://issues.apache.org/jira/browse/HIVE-29411
> Project: Hive
> Issue Type: Sub-task
> Reporter: László Bodor
> Priority: Major
>
> Currently, Hive has a generic Docker image for HS2 + full execution, as
> implemented in HIVE-26400, and for HMS, as implemented in HIVE-27275.
> These images are great for testing and demonstration purposes; however, for
> real distributed execution, we need additional improvements. There are two
> ways to achieve this:
> 1) LLAP execution - in a Docker image, implemented here
> HS2 -> TezAM -> Daemon
> 2) Tez container execution - in a Docker image, implemented under TEZ-4662
> HS2 -> TezAM -> TezContainer
> Both 1) and 2) need TezAM container to be implemented under TEZ-4682, but 1)
> is easier from Hive perspective, becuase for the TezContainer docker mode, we
> also need TEZ-4665
> Assuming that this Jira and TEZ-4682 are resolved, one should be able to
> deploy a fully distributed Hive warehouse with the components: HS2, HMS,
> TezAM, LlapDaemon
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
