Thanks Ayan and Dennis,
'@Ayan. if I use Ranger to manage HDFS ACLS, as you mentioned it will
coarse grain control over file. I might have few fine grained use cases at
row/column level
I was going through the below JIRAS and thinking if anyone might have used
it and any user documentation for
AFAIK, Ranger secures Hive (JDBC) server only. Unfortunately Spark does not
interact with HS2, but directly interacts with Metastore. Hence, the only
way to use Ranger policies if you use Hive via JDBC. Another option is HDFS
or Storage ACLs, which are coarse grain control over file path etc. You
Hi Joyan,
Spark uses its own metastore. Using Ranger you need to use the Hive Metastore.
For this you need to point to Hive Metastore and use HiveContext in your Spark
Code.
Br,
Dennis
Von meinem iPhone gesendet
> Am 23.11.2020 um 19:04 schrieb joyan sil :
>
>
> Hi,
>
> We have ranger
Hi,
We have ranger policies defined on the hive table and authorization works
as expected when we use hive cli and beeline. But when we access those hive
tables using spark-shell or spark-submit it does not work.
Any suggestions to make Ranger work with Spark?
Regards
Joyan