TheNeuralBit commented on issue #24091: URL: https://github.com/apache/beam/issues/24091#issuecomment-1310644385
It's difficult for users to workaround this, since we reject calls to `reset_index` as non-parallelizable. A better workaround would be to use to_parquet instead. A long-term fix is also challenging. We could resolve in our to_feather implementation by calling reset_index on each partition before it is written, but that would have the effect of erasing the index. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
