tustvold commented on issue #4973: URL: https://github.com/apache/arrow-datafusion/issues/4973#issuecomment-1461028917
Hmm... Perhaps I could add an option to RowConverter to hydrate dictionaries to allow trading off space in this way 🤔 The main reason advantage of the arrow format, aside from reducing the number of formats we need to maintain, is so that aggregators can easily spill sorted state, which can then be cheaply recombined. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
