[
https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
anishek updated HIVE-18352:
---------------------------
Description:
* Introduce a METADATAONLY option as part of the REPL DUMP command which will
only try and dump out events for DDL changes, this will be faster as we wont
need scan of files on HDFS for DML changes.
* Additionally since we are only going to dump metadata operations, it might be
useful to include acid tables as well via an option as well. This option can be
removed when ACID support is complete via HIVE-18320
it will be good to support the "WITH" clause as part of REPL DUMP command as
well (repl dump already supports it viaHIVE-17757) to achieve the above as that
will prevent less changes to the syntax of the statement and provide more
flexibility in future to include additional options as well.
{code}
REPL DUMP [db_name] {FROM [event_id]} {TO [event_id]} {WITH
(['key'='value'],.....)}
{code}
This will enable other tools like security / schema registry / metadata
discovery to use replication related subsystem for their needs as well.
was:
Introduce a METADATAONLY option as part of the REPL DUMP command which will
only try and dump out events for DDL changes, this will be faster as we wont
need scan of files on HDFS for DML changess
{code}
REPL DUMP [db_name] {METADATAONLY} {FROM [event_id]} {TO [event_id]}
{code}
This will enable other tools like security / schema registry / metadata
discovery to use replication related subsystem for their needs as well.
> introduce a METADATAONLY option while doing REPL DUMP to allow integrations
> of other tools
> -------------------------------------------------------------------------------------------
>
> Key: HIVE-18352
> URL: https://issues.apache.org/jira/browse/HIVE-18352
> Project: Hive
> Issue Type: Bug
> Affects Versions: 3.0.0
> Reporter: anishek
> Assignee: anishek
> Fix For: 3.0.0
>
>
> * Introduce a METADATAONLY option as part of the REPL DUMP command which will
> only try and dump out events for DDL changes, this will be faster as we wont
> need scan of files on HDFS for DML changes.
> * Additionally since we are only going to dump metadata operations, it might
> be useful to include acid tables as well via an option as well. This option
> can be removed when ACID support is complete via HIVE-18320
> it will be good to support the "WITH" clause as part of REPL DUMP command as
> well (repl dump already supports it viaHIVE-17757) to achieve the above as
> that will prevent less changes to the syntax of the statement and provide
> more flexibility in future to include additional options as well.
> {code}
> REPL DUMP [db_name] {FROM [event_id]} {TO [event_id]} {WITH
> (['key'='value'],.....)}
> {code}
> This will enable other tools like security / schema registry / metadata
> discovery to use replication related subsystem for their needs as well.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
