Unable to run bash script when using spark-submit in cluster mode.

Hi Spark Users, I am trying to execute bash script from my spark app. I can run the below command without issues from spark-shell however when I use it in the spark-app and submit with spark-submit, container is not able to find the directories. val result = "export LD_LIBRARY_PATH=/

RE: Unable to run bash script when using spark-submit in cluster mode.

Are local paths not exposed in containers ? Thanks, Nasrulla From: Nasrulla Khan Haris Sent: Thursday, July 23, 2020 6:13 PM To: user@spark.apache.org Subject: Unable to run bash script when using spark-submit in cluster mode. Importance: High Hi Spark Users, I am trying to execute bash

RE: Does Spark SQL support GRANT/REVOKE operations on Tables?

I did enable auth related configs in hive-site.xml as per below document. I tried this on Spark 2.4.4. Is it supported ? https://cwiki.apache.org/confluence/display/Hive/Storage+Based+Authorization+in+the+Metastore+Server From: Nasrulla Khan Haris Sent: Wednesday, June 10, 2020 5:55 PM

Does Spark SQL support GRANT/REVOKE operations on Tables?

HI Spark users, I see REVOKE/GRANT operations In list of supported operations but when I run the on a table. I see Error: org.apache.spark.sql.catalyst.parser.ParseException: Operation not allowed: GRANT(line 1, pos 0) == SQL == GRANT INSERT ON table_priv1 TO USER user2 ^^^ at