[
https://issues.apache.org/jira/browse/FLUME-1683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated FLUME-1683:
-----------------------------------
Attachment: FLUME-1683.v1.txt
> Fix Time Granularity Bug in SpoolingFileLineReader
> --------------------------------------------------
>
> Key: FLUME-1683
> URL: https://issues.apache.org/jira/browse/FLUME-1683
> Project: Flume
> Issue Type: Bug
> Reporter: Patrick Wendell
> Assignee: Patrick Wendell
> Attachments: FLUME-1683.v1.txt
>
>
> This patch fixes a test in the SpoolingFileLineReader, and a bug associated
> with that test:
> The issue is related to the way that the source sorts files which are
> candidates for ingestion. It sorts the files by timestamp, and the unit test
> assumes that if it creates two files:
> x = new File()
> Files.write("something", x)
> y = new File()
> Files.write("something", y)
> // Read from files
> that x will be processed before y. In my filesystem, the time granularity is
> only 1 second, so these files were actually processed in a non-deterministic
> order. On your filesystem, they were processed in the correct order, and the
> test (correctly) failed.
> I didn't notice that the test was mixed up because it was passing for me due
> to this issue.
> I updated the sorting order to take into account filename when there is a tie
> in the timestamp, so at least we have a consistent ordering we can test.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
