vincbeck closed issue #35449: Reduce memory usage in `S3Hook`
URL: https://github.com/apache/airflow/issues/35449
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe
ellisms commented on issue #35449:
URL: https://github.com/apache/airflow/issues/35449#issuecomment-1944623918
I started digging into this, and converting boto3.resource to boto3.client
could introduce a breaking change. For example, `get_key` returns a
resource.Object (and the object.load
ellisms commented on issue #35449:
URL: https://github.com/apache/airflow/issues/35449#issuecomment-1943606217
@ferruzzi Can you assign this one to me? Finally have some time to start
looking at it.
--
This is an automated message from the Apache Git Service.
To respond to the message
ferruzzi commented on issue #35449:
URL: https://github.com/apache/airflow/issues/35449#issuecomment-1885915557
@ellisms - That would be great. You can look at the newer hooks and see
lots of examples of how this could be reworked to use boto3.client instead of
boto3.resources, and they sh
ferruzzi commented on issue #35449:
URL: https://github.com/apache/airflow/issues/35449#issuecomment-1823483591
I'd love to see someone take/make the time to do a full rewrite on the
S3Hook. It's so convoluted and nothing like any of the other hooks. Knowing
what we know now about how to
Taragolis opened a new issue, #35449:
URL: https://github.com/apache/airflow/issues/35449
### Body
Original stacktrace from the Slack
```console
Error:
File "/usr/local/airflow/plugins/plugins/others/data_source_monitor.py",
line 53, in retrieve_data
get_time_query =
