Re: [issue] not able to add external libs to pyspark job while using spark-submit

2021-11-24 Thread Atheer Alabdullatif
Hello Owen, Thank you for your prompt reply! We will check it out. best, Atheer Alabdullatif From: Sean Owen Sent: Wednesday, November 24, 2021 5:06 PM To: Atheer Alabdullatif Cc: user@spark.apache.org ; Data Engineering Subject: Re: [issue] not able to add

[issue] not able to add external libs to pyspark job while using spark-submit

2021-11-24 Thread Atheer Alabdullatif
s function used to install external python libs in yarn ''' os.system("pip3 install configparser") if