[
https://issues.apache.org/jira/browse/DATAFU-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthew Hayes closed DATAFU-13.
-------------------------------
Resolution: Won't Fix
Closing this as it is quite old and there have been no updates.
> Hourglass fixed-length windows should be robust to reappearing data
> -------------------------------------------------------------------
>
> Key: DATAFU-13
> URL: https://issues.apache.org/jira/browse/DATAFU-13
> Project: DataFu
> Issue Type: Improvement
> Reporter: Matthew Hayes
> Assignee: Matthew Hayes
> Priority: Major
>
> For a fixed-length window where output is being reused, the oldest day is
> "subtracted" from the previous output as the window advances. However it's
> possible a day may be missing when output is computed. If the data then
> reappears later, it will eventually be subtracted off, even though it wasn't
> included in the output previously. This could yield "negative" values.
> Hourglass doesn't currently track the intervals included in the output, only
> the start and end time. This could easily be solved by including the interval
> coverage as well. It also means that when the data reappears it can be
> included in the next output.
> From: [Issue #76 on GitHub|https://github.com/linkedin/datafu/issues/76]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
