[
https://issues.apache.org/jira/browse/FLINK-4800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kostas Kloudas updated FLINK-4800:
----------------------------------
Description:
Introduce the TimestampedFileInputSplit which extends the class FileInputSplit
and also contains:
i) the modification time of the file the split belongs to and also, and
ii) when checkpointing, the point the reader is currently reading from.
The latter will be useful for rescaling. With this addition, the
ContinuousFileMonitoringFunction sends TimestampedFileInputSplits
to the Readers, and the Readers' state now contain only
TimestampedFileInputSplits.
was:
Currently the code in the FileMonitoringFunction can be simplified.
The same holds for the test code.
This is the goal of this issue.
> Refactor the ContinuousFileMonitoringFunction code and the related tests.
> -------------------------------------------------------------------------
>
> Key: FLINK-4800
> URL: https://issues.apache.org/jira/browse/FLINK-4800
> Project: Flink
> Issue Type: Bug
> Components: Streaming Connectors
> Reporter: Kostas Kloudas
> Assignee: Kostas Kloudas
> Priority: Minor
>
> Introduce the TimestampedFileInputSplit which extends the class
> FileInputSplit and also contains:
> i) the modification time of the file the split belongs to and also, and
> ii) when checkpointing, the point the reader is currently reading from.
> The latter will be useful for rescaling. With this addition, the
> ContinuousFileMonitoringFunction sends TimestampedFileInputSplits
> to the Readers, and the Readers' state now contain only
> TimestampedFileInputSplits.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
