encies?
Kind regards,
Dan
________
From: Oxlade, Dan
Sent: 03 April 2024 15:49
To: Oxlade, Dan ; Aaron Grubb
; user@spark.apache.org
Subject: Re: [EXTERNAL] Re: [Spark]: Spark / Iceberg / hadoop-aws compatibility
matrix
Swapping out the iceberg-aws-bundle for the very latest aws provided sdk
(
tFootersInParallel$1(ParquetFileFormat.scala:429)
____________
From: Oxlade, Dan
Sent: 03 April 2024 14:33
To: Aaron Grubb ; user@spark.apache.org
Subject: Re: [EXTERNAL] Re: [Spark]: Spark / Iceberg / hadoop-aws compatibility
matrix
[sorry; replying all this time]
With hadoop-*-3.3.6 i
AWS.
From: Oxlade, Dan
Sent: Wednesday, April 3, 2024 2:41:11 PM
To: user@spark.apache.org
Subject: [Spark]: Spark / Iceberg / hadoop-aws compatibility matrix
Hi all,
I’ve struggled with this for quite some time.
My requirement is to read a parquet file from s3 t
Hi all,
I've struggled with this for quite some time.
My requirement is to read a parquet file from s3 to a Dataframe then append to
an existing iceberg table.
In order to read the parquet I need the hadoop-aws dependency for s3a:// . In
order to write to iceberg I need the iceberg dependency.
