lidavidm commented on PR #28: URL: https://github.com/apache/arrow-flight-sql-postgresql/pull/28#issuecomment-1462038241
It seems reasonable from first glance. Do you have a good idea of the current bottlenecks? A log scale on the y-axis might make that graph a little easier to parse. I took a quick glance at the current implementation. If I understand right, we're passing serialized record batches over shared memory(?). We could explore things like binary-format COPY to possibly speed up transfer from Postgres, right? (That's what the ADBC PostgreSQL driver does, though that approach complicates things a lot.) Also, a benchmark not over localhost may be interesting down the line (since presumably we should be able to interleave conversion/wire transfer - the current structure seems like it should basically already do that due to the ring buffer). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
