[
https://issues.apache.org/jira/browse/AIRFLOW-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16613269#comment-16613269
]
Szymon Bilinski edited comment on AIRFLOW-1686 at 9/13/18 9:50 AM:
-------------------------------------------------------------------
Any updates on this? I found a year-old PR
([https://github.com/apache/incubator-airflow/pull/2716]), but it seems to be
Closed.
I think a generic {{list_objects}} method would be a nice addition, as it would
allow to sort/filter files by any criteria needed ( {{last_modified}} date in
particular ).
was (Author: sbilinski):
Any updates on this? I found a year-old PR
[here|[https://github.com/apache/incubator-airflow/pull/2716],] but it seems to
be Closed.
I think a generic {{list_objects}} method would be a nice addition, as it would
allow to sort/filter files by any criteria needed ( {{last_modified}} date in
particular ).
> S3Hook expose boto list_objects and deletion methods
> ----------------------------------------------------
>
> Key: AIRFLOW-1686
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1686
> Project: Apache Airflow
> Issue Type: Improvement
> Components: boto3, hooks
> Reporter: Andy Hadjigeorgiou
> Assignee: Andy Hadjigeorgiou
> Priority: Minor
>
> To make S3Hook more useful, I propose exposing both list_objects and delete
> functions from boto into the wrapper. Both of these methods span common tasks
> related to s3, and list_objects provides the added value over list_keys with
> additional context (last modified timestamps).
> I'm working on adding both, will link PR here when ready.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
