zeroshade commented on issue #3169: URL: https://github.com/apache/arrow-adbc/issues/3169#issuecomment-3089770725
If we can get Snowflake to allow actual parameters / options to be used for `gosnowflake`, then we can easily propagate those options through ADBC to allow configuration of it. So the ball is in Snowflake's court there, feel free to file an issue on gosnowflake and reference this! In addition to the options that @CurtHagenlocher mentioned for managing the parallelization and concurrency options for the driver, I also wanted to address two of the questions: > 4. What can be done to maximize throughput (batching, parallelism, or other configurations)? > 5. Do we have any ability to configure the chunk size or exclude, if possible? Currently, as far as I'm aware, Snowflake does not expose any way for a client to configure the chunk size or anything else about the way the batching is done for how it returns the stream of results. So, similar to my comment above, if snowflake adds a way to influence the batch and chunk sizes (through session parameters, client parameters, or anything else) we can easily pipe that through the ADBC driver options. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
