Re: Inserting date into ignite with spark jdbc

Hi, It seems that a dataset internally uses built-in org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider instead of org.apache.ignite.spark.impl.IgniteRelationProvider in case you force it to use JDBC. The provider from spark obviously doesn't tolerate Ignite custom properties.

Re: Inserting date into ignite with spark jdbc

Did anyone had a chance to look at the code? Should I make a Java one, or is Kotlin good enough? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Inserting date into ignite with spark jdbc

Hello, I made a reproducer here Can 2 classes to run, * nl/hlopez/ignitesparkjdbc/server/ServerApplication.kt * nl/hlopez/ignitesparkjdbc/spark/SparkApplication.kt ServerApplication starts a Ignite Server Node SparkApplication starts the spark

Re: Inserting date into ignite with spark jdbc

Hi, It will be great if you share the reproducer. BR, Andrei 11/3/2020 10:17 AM, Humphrey пишет: Let me have a summarize here. Working with | IgniteDataFrameSettings.OPTION_CONFIG_FILE(), configPath | seems to work fine. But when I'm using the JDBC thin client connection, (like connecting to

Re: Inserting date into ignite with spark jdbc

Let me have a summarize here. Working with | IgniteDataFrameSettings.OPTION_CONFIG_FILE(), configPath | seems to work fine. But when I'm using the JDBC thin client connection, (like connecting to a database through JDBC Driver) it was giving me the error: *java.sql.SQLException: No PRIMARY KEY

Re: Inserting date into ignite with spark jdbc

Yes I don't want to supply an Ignite Configuration XML I would like to connect through JDBC like any other database. And there is no way to supply the primary key. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Inserting date into ignite with spark jdbc

Denis, I can check it out soon. The mentioned problem can probably only be related to JDBC data frames. In this case, I will create a JIRA ticket. But as I know using OPTION_CREATE_TABLE_PRIMARY_KEY_FIELDS should be the same as I showed in my example. BR, Andrei 10/30/2020 6:01 PM, Denis

Re: Inserting date into ignite with spark jdbc

Andrey, Do we need to update our docs? It feels like the docs miss these details or have an outdated example. - Denis On Fri, Oct 30, 2020 at 7:03 AM Andrei Aleksandrov wrote: > Hi, > > Here's an example with correct syntax that should work fine: > > DataFrameWriter < Row > df = resultDF >

Re: Inserting date into ignite with spark jdbc

Hi, Here's an example with correct syntax that should work fine: |DataFrameWriter < Row > df = resultDF .write() .format(IgniteDataFrameSettings.FORMAT_IGNITE()) .option(IgniteDataFrameSettings.OPTION_CONFIG_FILE(), configPath) .option(IgniteDataFrameSettings.OPTION_TABLE(), "Person")

Inserting date into ignite with spark jdbc

Hello guys this question has been asked on Stack Overflow but yet no answer is a provided. I'm facing the same issue (trying to insert data in ignite using spark.jdbc):