So I think this sounds like a bug to me, in the help options for both
regular spark-submit and ./sbin/start-connect-server.sh we say:
" --packages Comma-separated list of maven coordinates of
jars to include
on the driver and executor classpaths. Will
The issue you're encountering with the iceberg-spark-runtime dependency not
being properly passed to the executors in your Spark Connect server
deployment could be due to a couple of factors:
1.
*Spark Submit Packaging:* When you use the --packages parameter in
spark-submit, it only adds
Hi, Spark community,
I encountered a weird bug when using Spark Connect server to integrate with
Iceberg. I added the iceberg-spark-runtime dependency with `--packages`
param, the driver/connect-server pod did get the correct dependencies. But
when looking at the executor's library, the jar was no
