[
https://issues.apache.org/jira/browse/HADOOP-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Wittenauer updated HADOOP-12563:
--------------------------------------
Description:
hdfs fetchdt is missing some critical features and is geared almost exclusively
towards HDFS operations. Additionally, the token files that are created use
Java serializations which are hard/impossible to deal with in other languages.
It should be replaced with a better utility in common that can read/write
protobuf-based token files, has enough flexibility to be used with other
services, and offers key functionality such as append and rename. The old
version file format should still be supported for backward compatibility, but
will be effectively deprecated.
A follow-on JIRA will deprecrate fetchdt.
was:hdfs fetchdt is missing some critical features and is geared almost
exclusively towards HDFS operations. Additionally, the token files that are
created use Java serializations which are hard/impossible to deal with in other
languages. It should be replaced with a better utility in common that can
read/write protobuf-based token files, has enough flexibility to be used with
other services, and offers key functionality such as append and rename.
> Updated utility to create/modify token files
> --------------------------------------------
>
> Key: HADOOP-12563
> URL: https://issues.apache.org/jira/browse/HADOOP-12563
> Project: Hadoop Common
> Issue Type: New Feature
> Affects Versions: 3.0.0
> Reporter: Allen Wittenauer
> Assignee: Matthew Paduano
>
> hdfs fetchdt is missing some critical features and is geared almost
> exclusively towards HDFS operations. Additionally, the token files that are
> created use Java serializations which are hard/impossible to deal with in
> other languages. It should be replaced with a better utility in common that
> can read/write protobuf-based token files, has enough flexibility to be used
> with other services, and offers key functionality such as append and rename.
> The old version file format should still be supported for backward
> compatibility, but will be effectively deprecated.
> A follow-on JIRA will deprecrate fetchdt.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
