JDBC sessionInitStatement for writes?

2021-11-25 Thread trsell
Hello, Regarding JDBC sinks, the docs state: https://spark.apache.org/docs/latest/sql-data-sources-jdbc.html sessionInitStatement: After each database session is opened to the remote DB and before starting to read data, this option executes a custom SQL statement (or a PL/SQL block). Use this to i

Re: JDBC sessionInitStatement for writes?

2021-11-25 Thread trsell
Sorry I somehow missed the "Scope" column in the docs, which explicitly states its for reads only. I don't suppose anyone knows of some other method I can submit SET statements for write sessions? On Fri, Nov 26, 2021 at 12:51 PM wrote: > Hello, > > Regarding JDBC sinks, the docs state: > https:

Re: JDBC sessionInitStatement for writes?

2021-11-26 Thread Sebastian Piu
For datasources it's just something that is run on the connection before you statement is executed, it doesn't seem to depend on the specific jdbc driver. See here https://github.com/apache/spark/blob/95fc4c56426706546601d339067ce6e3e7f4e03f/sql/core/src/main/scala/org/apache/spark/sql/execution/d