wjones127 commented on PR #13650: URL: https://github.com/apache/arrow/pull/13650#issuecomment-1192863193
> any thoughts on whether or not this is too large of a change to merge? I don't know how many users we have of map_batches()...this does restrict what one can do with the result of map_batches() (for example, an exec plan that ends with head() won't work). One option is to add a lazy = TRUE|FALSE argument to allow the streaming behaviour but default to non-streaming like we did before. On one hand we do mark this as experimental, so I'm no super worried about breaking it right now. But also I find "an exec plan that ends with head() won't work" alarming. Why wouldn't that work? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
