[ https://issues.apache.org/jira/browse/BEAM-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ismaël Mejía resolved BEAM-5910. -------------------------------- Resolution: Fixed Fix Version/s: 2.11.0 > FileSystems should retrieve lastModified time > --------------------------------------------- > > Key: BEAM-5910 > URL: https://issues.apache.org/jira/browse/BEAM-5910 > Project: Beam > Issue Type: Improvement > Components: sdk-java-core > Reporter: Jeff Klukas > Assignee: Jeff Klukas > Priority: Minor > Fix For: 2.11.0 > > Time Spent: 4.5h > Remaining Estimate: 0h > > In the Java SDK, the Filesystems.match facilities are aimed at listing file > names and collect very limited additional metadata from the filesystem > (sizeBytes and isReadSeekEfficient). I propose adding a new field for > lastModified time to MatchResult.Metadata that each FileSystem would populate > when listing files. > This would be a basis for a future improvement to > FileIO.match(...).continuously(...) where we could let the user opt to poll > not just for new file names, but also for existing file names if their > content has been updated. > In the near term, the addition of lastModified to Metadata would allow users > to implement their own polling logic on top of Filesystems.match to detect > and download new files from any of the supported filesystems. -- This message was sent by Atlassian JIRA (v7.6.3#76005)