codope commented on PR #5771: URL: https://github.com/apache/hudi/pull/5771#issuecomment-1195822628
> We need some exception handling to handle cases where key fields are suddenly introduced after a few commits? This is like adding a key to an existing table, which some databases allow, but for simplicity, we can just error out for now. > > Plus a bigger discussion is whether we disable metafields as well. This will make simple data size and write performance on par, and simplify it for the simple spark user (as we saw with the recent benchmarks put out) > > Can you comment on whether clustering will work on this. I think it will - but something to verify Yes, verified that clustering works. So, there are couple of followups in this PR: 1. validations to ensure user is not updating w/o record key 2. disable meta fields when doing bulk insert w/o key or precombine field. I'll address them shortly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
