[
https://issues.apache.org/jira/browse/DATAFU-71?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthew Hayes closed DATAFU-71.
-------------------------------
Resolution: Won't Do
Closing this as it is quite old and there have been no updates.
> Create IncrementalAvroStorage UDF for incrementally processing date
> partitioned data
> ------------------------------------------------------------------------------------
>
> Key: DATAFU-71
> URL: https://issues.apache.org/jira/browse/DATAFU-71
> Project: DataFu
> Issue Type: New Feature
> Reporter: Matthew Hayes
> Assignee: Matthew Hayes
> Priority: Major
> Attachments: DATAFU-71.patch
>
>
> Data can sometimes be stored in HDFS in a time-partitioned manner, e.g.
> /some/input/yyyy/mm/dd. You may want to process this data incrementally,
> where the output has a format like /some/output/yyyy/mm/dd. It be useful if
> there is a UDF that handles the incremental processing for you.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
