steveloughran commented on PR #1330: URL: https://github.com/apache/parquet-mr/pull/1330#issuecomment-2091434499
looks great. If there's another 14.0 RC, will this go in to it? Note we create lots and lots of IOstatistics, for vector reads we include #of bytes read and discarded along with all the other timings. My WiP to make that accessible via reflection will help, but it'd still need work in parquet to aggregate. https://github.com/apache/hadoop/pull/6686 you can have all the stats as a piece of JSON if that helps, then parquet lib just has its own copy of the stats class to parse it... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
