Great!
Thanks a lot.
Best,
Pablo.
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
Hi,
This has been fixed here: https://github.com/apache/spark/pull/23546. Will
be available with Spark 3.0.0
Best,
Stavros
On Wed, Jun 5, 2019 at 11:18 PM pacuna wrote:
> I'm trying to run a sample code that reads a file from s3 so I need the aws
> sdk and aws hadoop dependencies.
> If I
I'm trying to run a sample code that reads a file from s3 so I need the aws
sdk and aws hadoop dependencies.
If I assemble these deps into the main jar everything works fine. But when I
try using --packages, the deps are not seen by the pods.
This is my submit command:
spark-submit
--master
