[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719484#comment-17719484 ] ASF GitHub Bot commented on HADOOP-18028: - steveloughran closed pull request #5605:

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2023-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717618#comment-17717618 ] ASF GitHub Bot commented on HADOOP-18028: - steveloughran commented on PR #5605: URL:

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2023-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717252#comment-17717252 ] ASF GitHub Bot commented on HADOOP-18028: - hadoop-yetus commented on PR #5605: URL:

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2023-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717140#comment-17717140 ] ASF GitHub Bot commented on HADOOP-18028: - steveloughran opened a new pull request, #5605: URL:

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2023-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17715906#comment-17715906 ] ASF GitHub Bot commented on HADOOP-18028: - steveloughran closed pull request #5559:

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2023-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17715905#comment-17715905 ] ASF GitHub Bot commented on HADOOP-18028: - steveloughran commented on PR #5559: URL:

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2023-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17715902#comment-17715902 ] ASF GitHub Bot commented on HADOOP-18028: - steveloughran commented on PR #5559: URL:

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2023-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713065#comment-17713065 ] ASF GitHub Bot commented on HADOOP-18028: - ahmarsuhail commented on PR #5559: URL:

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2023-04-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712473#comment-17712473 ] ASF GitHub Bot commented on HADOOP-18028: - steveloughran opened a new pull request, #5559: URL:

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-08-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581345#comment-17581345 ] Steve Loughran commented on HADOOP-18028: - this is now merged into trunk. as such, i think we

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-08-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581342#comment-17581342 ] ASF GitHub Bot commented on HADOOP-18028: - steveloughran merged PR #4752: URL:

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-08-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580888#comment-17580888 ] ASF GitHub Bot commented on HADOOP-18028: - hadoop-yetus commented on PR #4752: URL:

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-08-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580761#comment-17580761 ] ASF GitHub Bot commented on HADOOP-18028: - steveloughran commented on PR #4752: URL:

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-08-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580760#comment-17580760 ] ASF GitHub Bot commented on HADOOP-18028: - steveloughran opened a new pull request, #4752: URL:

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-07-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572463#comment-17572463 ] Steve Loughran commented on HADOOP-18028: - rebasing to trunk in

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-06-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556477#comment-17556477 ] Steve Loughran commented on HADOOP-18028: - assume someone with a 192 vcore system will be

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-06-20 Thread Ahmar Suhail (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556348#comment-17556348 ] Ahmar Suhail commented on HADOOP-18028: --- [~ste...@apache.org] On memory usage, it's using a

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-06-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554991#comment-17554991 ] Steve Loughran commented on HADOOP-18028: - update on this: I can see that some things are going

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-06-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552157#comment-17552157 ] Steve Loughran commented on HADOOP-18028: - think we might want to review the error handling

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-04-26 Thread Ahmar Suhail (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528330#comment-17528330 ] Ahmar Suhail commented on HADOOP-18028: --- [https://github.com/apache/hadoop/pull/4212] fixes the

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-04-26 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528323#comment-17528323 ] Steve Loughran commented on HADOOP-18028: - this branch is going to need rebasing. what

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-04-04 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516821#comment-17516821 ] Daniel Carl Jones commented on HADOOP-18028: Hey [~pj.fanning], the AWS SDK V1 -> V2

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-03-30 Thread PJ Fanning (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17514996#comment-17514996 ] PJ Fanning commented on HADOOP-18028: - Would it be possible to consider switching the AWS v2 SDK

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-03-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513556#comment-17513556 ] Steve Loughran commented on HADOOP-18028: - prefetchBlockSize to use longBytesOption so that you

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-03-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513468#comment-17513468 ] Steve Loughran commented on HADOOP-18028: - other issues/changes to consider *