EB80 commented on issue #11665: URL: https://github.com/apache/arrow/issues/11665#issuecomment-972958931
Thanks all- I read the file in with feather::read_feather, and there was not an issue. I'm assuming this was the problem with arrow::read_feather (i.e., the file was written with feather vice arrow), but now we're back to the writing error. When I attempt to write the dataframe with arrow::write_feather, there is not disk activity once it encounters the indefinite hanging. There is a ton of memory usage, but that's expected with a huge dataframe in the RStudio workspace. I excluded the possibility of some sort of an issue with the dataframe itself by writing successfully with data.table::fwrite. Regarding dbg, the MinGW download failed for some reason, and I haven't figured out an alternative way to debug via the Windows Command Prompt. (Help for a simpleton would be appreciated.) Interestingly, while the arrow::write_feather has hung every time so far, it stopped at 156MB one time and 78MB every other time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
