XiaoHongbo-Hope opened a new pull request, #1195: URL: https://github.com/apache/paimon-rust/pull/1195
### Problem Each sparse Data Evolution read that selects an immutable ROW sidecar calls object storage `stat` to learn the sidecar length, even when the same file is queried repeatedly. This adds a remote request before the ROW reader can seek to its footer. ### Change Cache the size of registered ROW sidecars in the existing FileIO metadata-cache context. Keys use the storage namespace and canonical object path, so distinct storage targets cannot share a cached size. The cache is bounded to 4,096 entries, is disabled when the metadata cache is disabled or the provider has no stable namespace, bypasses inherited state after fork, and is invalidated on FileIO file/directory deletion. No public option or file-format change is introduced. ### Validation - `cargo test --locked -p paimon test_immutable_row_sidecar_size_cache_is_scoped_and_disabled_with_metadata_cache --features storage-memory --lib` - `cargo test --locked -p paimon --test data_evolution_row_sidecar_test` (14 passed) - `cargo clippy --locked -p paimon --lib --features storage-memory -- -D warnings` - `cargo fmt --all -- --check`; `git diff --check` This PR optimizes the existing ROW sidecar path. It does not add the separate scalar `.srow` format used in the DROID prototype. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
