edrevo edited a comment on pull request #9523: URL: https://github.com/apache/arrow/pull/9523#issuecomment-786199330
By the way, I am trying to repartition 100GB of data and with this change I get OOMKilled (unfortunately for me I don't have 100GB of RAM 😂 ) and without this change the memory usage is normal (but it hangs) ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
