suryaprasanna commented on issue #19063: URL: https://github.com/apache/hudi/issues/19063#issuecomment-4795435377
Overall scope looks good to me. +1 on the Deployment scenarios the integration must support listed. Distributed registry should work for all such scenarios. Regarding the tests required, please include tests for complete ingestion path, especially around record_index lookup phase. Key metrics to verify are the No. of shards read, hit/miss ratio, log block metrics emitted from the scanner classes and I would also suggest to simulate task retries and make sure the metrics read are accurate. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
