hudi-bot opened a new issue, #16627: URL: https://github.com/apache/hudi/issues/16627
We need table services to operate on tables based on the current table version. This generally helps us manage tables compatible with writer versions, as well as call them during upgrade/downgrade path. e.g [https://github.com/apache/hudi/pull/11866#discussion_r1765447834] talks about how validation may need to turned off to run compaction during upgrade/downgrade. Currently rollback is performed as a part of upgrade-downgrade, which also needs to be table version specific.. ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-8227 - Type: Improvement - Epic: https://issues.apache.org/jira/browse/HUDI-7856 - Fix version(s): - 1.1.0 --- ## Comments 26/Oct/24 01:47;vinoth;1. preventing table services from upgrading the table.. only writers should do that. need to study existing entry points.. 2. today table services may not throw errors if table version is mismatched, because we instruct them to be offline for version upgrade.. Do we need a 0.15.1 or 0.14.x patch release for this failure.. 3.1.x code writing t.v 6, working with 0.14 code running async table services.. what will break. if any? (concern is less about storage format, but more about behavior changes in code between 0.14 and 1.x) - can we limit the flow to : stop async table services, rollout 1.x with t.v=6 to writers, upgrade async table services to 1.x with t.v=6, start async table services. 4. Would upgrade/downgrade finsih/cancel all pending table services? - else we need to handle plans written by t.v=6 or t.v=8.. even in this case: the 1.x code needs to be able to execute table services as t.v=6 in the upgrade path? ;;; --- 08/Nov/24 06:26;vinoth;we need to ensure table services in 1.x will throw an error if table version is mismatched. ;;; -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
