Github user wesm commented on the issue: https://github.com/apache/spark/pull/15821 Thanks all! Apache Arrow has advanced a great deal since November, so I expect we can make a number of follow up PRs to support more data types and optimize use of the streaming record batch machinery (if you haven't already!) for lower memory utilization and better overall throughput to Python users.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org