nm, I missed *iceberg-data*.
On Thu, Aug 5, 2021 at 12:07 PM Huadong Liu wrote:
> Thank you Russell. I wasn't able to make positive progress in either
> direction. Is it possible to use the unshaded iceberg-spark3 jar and do
> *spark.read().format("iceberg").load(table)*? Without the shaded
> ic
Thank you Russell. I wasn't able to make positive progress in either
direction. Is it possible to use the unshaded iceberg-spark3 jar and do
*spark.read().format("iceberg").load(table)*? Without the shaded
iceberg-spark3-runtime, I got "Failed to find data source: iceberg".
On Mon, Aug 2, 2021 at
I think you have two options,
Use the unshaded iceberg jar and reshade your resultant app so that it is
shaded identically to iceberg-spark3-runtime,
Compile against the shaded iceberg-spark-3 runtime jar and shaded parquet
libs
On Mon, Aug 2, 2021 at 2:28 PM Huadong Liu wrote:
> Hi,
>
> I hav
Hi,
I have a Java app that writes Iceberg files with the core API. As a result,
it uses the unshaded parquet package. I am now extending the app to read
the table with Spark. Unfortunately the iceberg-spark3-runtime uses the
shaded parquet package and I am getting:
*java.lang.ClassCastException:
