[
https://issues.apache.org/jira/browse/FLUME-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hari updated FLUME-2703:
------------------------
Description:
HDFS sinks always append time counter to filenames which is not configurable.
In some use cases, it is desirable to retain the original filename.
For e.g. While ingesting a blob using Spool directory source, it's desirable to
retain the original filename (basename) in HDFS.
This patch allows to configure a HDFS sink to override this behavior retaining
the backward compatible file naming convention by default i.e,
hdfs.appendTimeCounter = false
was:
HDFS sinks always append time counter to filenames which is not configurable.
In some use cases, it is desirable to retain the original filename.
For e.g. While ingesting a blob using Spool directory source, it's desirable to
retain the original filename (basename) in HDFS.
> HDFS sink: Ability to exclude time counter in fileName via sink configuration
> ------------------------------------------------------------------------------
>
> Key: FLUME-2703
> URL: https://issues.apache.org/jira/browse/FLUME-2703
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v1.7.0
> Reporter: Hari
> Priority: Minor
> Attachments: FLUME-2703-0.patch
>
>
> HDFS sinks always append time counter to filenames which is not configurable.
> In some use cases, it is desirable to retain the original filename.
> For e.g. While ingesting a blob using Spool directory source, it's desirable
> to retain the original filename (basename) in HDFS.
> This patch allows to configure a HDFS sink to override this behavior
> retaining the backward compatible file naming convention by default i.e,
> hdfs.appendTimeCounter = false
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
