[
https://issues.apache.org/jira/browse/HIVE-27855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kiran Velumuri updated HIVE-27855:
----------------------------------
Description:
Come up with external tables for log files generated by HiveProtoLoggingHook in
Hive and ProtoHistoryLoggingService in Tez.
Notes:
* To enable protologging in Hive,
HIVE_PROTO_EVENTS_BASE_PATH(hive.hook.proto.base-directory) has to be set, and
in Tez TEZ_HISTORY_LOGGING_PROTO_BASE_DIR(tez.history.logging.proto-base-dir)
has to be set.
* In case, these configs are not set, protologging will not be done.
* In that case when protologging is disabled, the locations for
HIVE_PROTO_EVENTS_BASE_PATH(hive.hook.proto.base-directory)
TEZ_HISTORY_LOGGING_PROTO_BASE_DIR(tez.history.logging.proto-base-dir) and will
be
"/tmp/query_data" and "/tmp" respectively in the tables' location. This is done
as a failsafe mechanism to avoid errors while initialising the schema file.
However, protologging will not be done as the required 2 configs are not set.
* For the case when protologging is enabled later on, or either of the
required 2 configs are updated, the corresponding tables' locations have to
updated manually using ALTER TABLE table_name SET LOCATION
'path/to/new/location'.
was:
Come up with external tables for log files generated by HiveProtoLoggingHook in
Hive and ProtoHistoryLoggingService in Tez.
Notes:
To use this feature,
> Create external tables for Hive and Tez protologging events
> -----------------------------------------------------------
>
> Key: HIVE-27855
> URL: https://issues.apache.org/jira/browse/HIVE-27855
> Project: Hive
> Issue Type: Task
> Components: Hive, Logging, Tez
> Reporter: Kiran Velumuri
> Assignee: Kiran Velumuri
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.1.0
>
>
> Come up with external tables for log files generated by HiveProtoLoggingHook
> in Hive and ProtoHistoryLoggingService in Tez.
>
> Notes:
> * To enable protologging in Hive,
> HIVE_PROTO_EVENTS_BASE_PATH(hive.hook.proto.base-directory) has to be set,
> and in Tez
> TEZ_HISTORY_LOGGING_PROTO_BASE_DIR(tez.history.logging.proto-base-dir) has to
> be set.
> * In case, these configs are not set, protologging will not be done.
> * In that case when protologging is disabled, the locations for
> HIVE_PROTO_EVENTS_BASE_PATH(hive.hook.proto.base-directory)
> TEZ_HISTORY_LOGGING_PROTO_BASE_DIR(tez.history.logging.proto-base-dir) and
> will be
> "/tmp/query_data" and "/tmp" respectively in the tables' location. This is
> done as a failsafe mechanism to avoid errors while initialising the schema
> file. However, protologging will not be done as the required 2 configs are
> not set.
> * For the case when protologging is enabled later on, or either of the
> required 2 configs are updated, the corresponding tables' locations have to
> updated manually using ALTER TABLE table_name SET LOCATION
> 'path/to/new/location'.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
