I often define vals and vars in spark shell and after some time I forget
the ones I defined. I want to see only the ones I had defined and the ones
that come from spark. I have tried the following commands but all of them
show the variables and defs defined by spark also
$intp.definedTerms
Hello folks,
I have a spark app with a custom implementation of
*fs.s3a.s3.client.factory.impl* which is packaged into the same jar.
Output of *jar tf*
*2620 Mon Dec 12 11:23:00 IST 2022 aws/utils/MyS3ClientFactory.class*
However when I run the my spark app with spark-submit in cluster mode, it
