My understanding is if I can disable a parquet datasource, the user will get an error when they try spark.read.parquet()
To give context my main objective is that I provide a few dataframes to my users, and I don't want them to be able to access any data other than these specific dataframes. So, is there a way for me to get a list of "leaf" dataframes/RDD that they are using in their logic ? Would appreciate any other approaches/inputs to handle this. Thanks On Thu, May 5, 2022 at 1:08 PM wilson <wil...@4shield.net> wrote: > it's maybe impossible to disable that? user can run spark.read... to > read any datasource he can reach. > > > Aditya wrote: > > 2. But I am not able to figure out how to "disable" all other data > sources > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
