parisni commented on PR #8683: URL: https://github.com/apache/hudi/pull/8683#issuecomment-1646829280
@danny0405 just learned [here why the spark data source stuff shall be kept within hms](https://cwiki.apache.org/confluence/plugins/servlet/mobile?contentId=147427331#content/view/147427331) > With the above, all of Spark SQL queries will use Hudi DataSource and hence end up using the custom FileIndex for doing the listing. Then there is a need to update the datasource code to be aware of comments within hive sync. @prashantwason can you confirm this part is still applicable and as a result `hoodie.datasource.hive_sync.sync_as_datasource` is highly encouraged ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
