Hi Ankit, While not a part of Spark, there is a project called 'WaggleDance' that can federate multiple Hive metastores so that they are accessible via a single URI: https://github.com/ExpediaGroup/waggle-dance
This may be useful or perhaps serve as inspiration. Thanks, Elliot. On Mon, 17 Apr 2023 at 16:38, Ankit Gupta <info.ank...@gmail.com> wrote: > ++ > User Mailing List > > Just a reminder, anyone who can help on this. > > Thanks a lot ! > > Ankit Prakash Gupta > > On Wed, Apr 12, 2023 at 8:22 AM Ankit Gupta <info.ank...@gmail.com> wrote: > >> Hi All >> >> The question is regarding the support of multiple Remote Hive Metastore >> catalogs with Spark. Starting Spark 3, multiple catalog support is added in >> spark, but have we implemented any CatalogPlugin that can help us configure >> multiple Remote Hive Metastore Catalogs ? If yes, can anyone help me with >> the Fully Qualified Class Name that I can try using for configuring a Hive >> Metastore Catalog. If not, I would like to work on the implementation of >> the CatalogPlugin that we can use to configure multiple Hive Metastore >> Servers' . >> >> Thanks and Regards. >> >> Ankit Prakash Gupta >> +91 8750101321 >> info.ank...@gmail.com >> >>
