Re: [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream

] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. Thanks to everyone who attended. Notes/AI's fro

Re: [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream

: dev@iceberg.apache.org Subject: RE: [EXTERNAL] [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. Hi

Re: [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream

.apache.org" > *Date: *Thursday, 21 August 2025 at 09:37 > *To: *"dev@iceberg.apache.org" > *Subject: *RE: [EXTERNAL] [Discuss] Analytics Accelerator Library for > Amazon S3 as default S3 Input Stream > > > > *CAUTION*: This email originated from outside of

Re: [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream

y to: "dev@iceberg.apache.org" Date: Thursday, 21 August 2025 at 09:37 To: "dev@iceberg.apache.org" Subject: RE: [EXTERNAL] [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream CAUTION: This email originated from outside of the organization. Do not click li

Re: [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream

I would like to join and 27th works well for me. Best, Fuat. From: "Stubbs, Michael" Reply-To: "dev@iceberg.apache.org" Date: Tuesday, 19 August 2025 at 14:34 To: "dev@iceberg.apache.org" Subject: RE: [EXTERNAL] [Discuss] Analytics Accelerator Library for Amazon

Re: [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream

g" Subject: RE: [EXTERNAL] [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. I agree Chee

Re: Re: [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream

I agree Cheers, Tushar Choudhary On Wed, 13 Aug 2025 at 10:39 PM, Kevin Liu wrote: > Hey everyone, > > As discussed on the community sync today, there's enough interest around > AAL, S3FileIO, and FileIO in general that we would like to schedule an ad > hoc sync for this topic. > > I'll work w

Re: Re: [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream

Hey everyone, As discussed on the community sync today, there's enough interest around AAL, S3FileIO, and FileIO in general that we would like to schedule an ad hoc sync for this topic. I'll work with Michael to find a suitable time. We'll add it to the "Iceberg Dev Events"

Re: Re: [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream

Let's bring this up in the next community sync on Wed 8/13 and see if it warrants another adhoc sync about FileIO. Best, Kevin Liu On Wed, Aug 6, 2025 at 1:21 PM Stubbs, Michael wrote: > I think Kevin has raised a few good points on the future of FileIO and the > maintainability of the project

RE: Re: [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream

I think Kevin has raised a few good points on the future of FileIO and the maintainability of the project going forwarded with the AAL default on Proposal. I think we should schedule community sync about this. Thank you! On 2025/07/31 13:12:48 Steve Loughran wrote: > On Fri, 25 Jul 2025 at 17:2

Re: [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream

On Fri, 25 Jul 2025 at 17:28, Kevin Liu wrote: *> I think it would be great to also make these improvements available to older Iceberg clients.* Use the S3A connector and turn on vector reads through parquert and you currently get the same performance, about at 30% speedup in TPC benchmarks (I k

Re: [Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream

Thank you for the write up. This is super interesting. I've added a few comments on the doc. I think it would be great to also make these improvements available to older Iceberg clients. BTW, we have one-off community syncs about specific topics, I would be interested to talk more about this as we

[Discuss] Analytics Accelerator Library for Amazon S3 as default S3 Input Stream

Hi Iceberg community, Following up on this thread, we've done additional testing and would like to propose making the Analytics stream the new default stream for S3FileIO. To provide more context and outline the reasoning, we've

Analytics Accelerator Library for Amazon S3

Hi everyone, We (Andy, Fuat, Michael and Sanjay) are from the Amazon S3 team. We recently released the Analytics Accelerator Library for Amazon S3 under the Apache 2.0 license (https://github.com/awslabs/analytics-accelerator-s3) that optimises access to S3 for Parquet data accessed by