GitHub user nsivabalan added a comment to the discussion: Use config `hoodie.index.scope=global|partition` to avoid having variants of the same index type
yes. existing tables has to work w/o needing any additional writer config overrides from user. If not, it may wipe out the data or result in data consistency issues. Vinoth: for record index, we managed to retain the same type for `hoodie.index.type` which is `RECORD_INDEX`. Based on the write configs set (`hoodie.metadata.record.index.enable` or `hoodie.metadata.partitioned.record.index.enable`) the indexing will figure out whether its global RLI or partitioned RLI. but from user standpoint, they need to set `hoodie.index.type` to `RECORD_INDEX`. GitHub link: https://github.com/apache/hudi/discussions/13864#discussioncomment-14408693 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
