[ https://issues.apache.org/jira/browse/DRILL-7459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arina Ielchiieva resolved DRILL-7459. ------------------------------------- Resolution: Fixed Was fixed in the scope of DRILL-7467. The following plugin configuration should be used to support batches: {noformat} { "type": "jdbc", "driver": "org.postgresql.Driver", "url": "jdbc:postgresql://localhost:5959/my_db?defaultRowFetchSize=2", "username": "my_user", "password": "my_pass", "caseInsensitiveTableNames": false, "sourceParameters": { "defaultAutoCommit": false }, "enabled": true } {noformat} > Fetch size does not work on Postgres JDBC plugin > ------------------------------------------------ > > Key: DRILL-7459 > URL: https://issues.apache.org/jira/browse/DRILL-7459 > Project: Apache Drill > Issue Type: Bug > Components: Storage - JDBC > Affects Versions: 1.15.0 > Reporter: Priyanka Bhoir > Assignee: Arina Ielchiieva > Priority: Major > Fix For: 1.18.0 > > > To prevent the drill from going out of memory, it is suggested to set the > fetch size in Jdbc URL to enable data streaming([#DRILL-6794 | > https://issues.apache.org/jira/browse/DRILL-6794] discusses this). This does > not work on Postgres for the following reason: > For fetchSize size to work on Postgres, the connection must not be in > autocommit mode. There is no parameter to set autocommit to false in > connection string other than programmatically calling > conn.setAutoCommit(false). > See > [https://jdbc.postgresql.org/documentation/93/query.html#fetchsize-example] > See [https://jdbc.postgresql.org/documentation/head/connect.html] for the > list of all connection string properties. > Fix is to add a property 'defaultAutoCommit' to JdbcStorageConfig and call > BasicDataSource#setDefaultAutoCommit in JdbcStoragePlugin. -- This message was sent by Atlassian Jira (v8.3.4#803005)