vasudhamsr opened a new issue, #10227:
URL: https://github.com/apache/iceberg/issues/10227

   ### Query engine
   
   Spark
   
   ### Question
   
   We have a scenario where the catalog object keeps changing and the custom 
FileIO underneath as well. But the loadTable function 
(org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:185)) is 
picking up the older catalog impl class with stale FileIO(which doesn't hold 
access to new tables) and is throwing. From looks of it, it seems spark catalog 
is loading catalog impl class on initialization and even there are further 
changes, its not picking up. Is there a way to forceRefresh object of catalog 
in SparkCatalog?  Thank you in advance!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to