Re: Does Spark SQL support GRANT/REVOKE operations on Tables?

Hi, Should the grant statement be this below? GRANT INSERT ON TABLE table_priv1 TO user2; and not GRANT INSERT ON table_priv1 TO USER user2; Hope this helps. Regards, Bill On Wed, Jun 10, 2020 at 11:47 PM Nasrulla Khan Haris wrote: > I did enable auth related configs in hive-site.xml as

RE: Does Spark SQL support GRANT/REVOKE operations on Tables?

I did enable auth related configs in hive-site.xml as per below document. I tried this on Spark 2.4.4. Is it supported ? https://cwiki.apache.org/confluence/display/Hive/Storage+Based+Authorization+in+the+Metastore+Server From: Nasrulla Khan Haris Sent: Wednesday, June 10, 2020 5:55 PM To:

Re: [ANNOUNCE] Apache Spark 2.4.6 released

Congrats and thanks, Holden! Bests, Takeshi On Thu, Jun 11, 2020 at 11:16 AM Dongjoon Hyun wrote: > Thank you so much, Holden! :) > > On Wed, Jun 10, 2020 at 6:59 PM Hyukjin Kwon wrote: > >> Yay! >> >> 2020년 6월 11일 (목) 오전 10:38, Holden Karau 님이 작성: >> >>> We are happy to announce the

Re: [ANNOUNCE] Apache Spark 2.4.6 released

Thank you so much, Holden! :) On Wed, Jun 10, 2020 at 6:59 PM Hyukjin Kwon wrote: > Yay! > > 2020년 6월 11일 (목) 오전 10:38, Holden Karau 님이 작성: > >> We are happy to announce the availability of Spark 2.4.6! >> >> Spark 2.4.6 is a maintenance release containing stability, correctness, >> and

Re: [ANNOUNCE] Apache Spark 2.4.6 released

Yay! 2020년 6월 11일 (목) 오전 10:38, Holden Karau 님이 작성: > We are happy to announce the availability of Spark 2.4.6! > > Spark 2.4.6 is a maintenance release containing stability, correctness, > and security fixes. > This release is based on the branch-2.4 maintenance branch of Spark. We > strongly

[ANNOUNCE] Apache Spark 2.4.6 released

We are happy to announce the availability of Spark 2.4.6! Spark 2.4.6 is a maintenance release containing stability, correctness, and security fixes. This release is based on the branch-2.4 maintenance branch of Spark. We strongly recommend all 2.4 users to upgrade to this stable release. To

Does Spark SQL support GRANT/REVOKE operations on Tables?

HI Spark users, I see REVOKE/GRANT operations In list of supported operations but when I run the on a table. I see Error: org.apache.spark.sql.catalyst.parser.ParseException: Operation not allowed: GRANT(line 1, pos 0) == SQL == GRANT INSERT ON table_priv1 TO USER user2 ^^^ at

Broadcast join data reuse

We have a case where data the is small enough to be broadcasted in joined with multiple tables in a single plan. Looking at the physical plan, I do not see anything that indicates if the broadcast data is done only once i.e., the BroadcastExchange is being reused i.i.e., that data is not

Accessing Teradata DW data from Spark

Using JDBC drivers much like accessing Oracle data, one can utilise the power of Spark on Teradata via JDBC drivers. I have seen connections in some articles which indicates this process is pretty mature. My question is if anyone has done this work and how is performance in Spark vis-a-vis

Issue with pyspark query

Hi, This is a general question regarding moving spark SQL query to PySpark, if needed I will add some more from the errors log and query syntax. I'm trying to move a spark SQL query to run through PySpark. The query syntax and spark configuration are the same. For some reason the query failed to