lilianm commented on PR #8260: URL: https://github.com/apache/arrow-rs/pull/8260#issuecomment-3308139377
Sorry i read to fast #8162 @adamreeve It's already needed to expose 'ArrowRowGroupWriter' actual change allow to parallelize column encoding but not row group encoding. This can allow to encoding different row group in different thread or dispatch different kind of data in different row group for improve push down filters. I think it's better way to expose 'ArrowRowGroupWriter' and add function `into_writers` ArrowRowGroupWriter it's helpers structure for use `Vec<ArrowColumnWriter>` And for ticket #8162 expose `create_row_group_writer` in 'ArrowRowGroupWriterFactory' instead create new function 'create_column_writers' -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
