Re: Ignite not able to persist spark rdd to RDBMS in master slave mode

2019-03-13 Thread Ilya Kasnacheev
Hello! With otherwrite=true, Data Streamer used in underlying implementation will skip Cache Store (along with other things). Regards, -- Ilya Kasnacheev ср, 13 мар. 2019 г. в 18:10, Harshal Patil : > Hi Ilya , > Thanks for the solution , it worked . > But can you please explain why overwrit

Re: Ignite not able to persist spark rdd to RDBMS in master slave mode

2019-03-13 Thread Harshal Patil
Hi Ilya , Thanks for the solution , it worked . But can you please explain why overwrite = true is required in case when i run spark in master slave configuration . On Wed, Mar 13, 2019 at 8:26 PM Ilya Kasnacheev wrote: > Hello! > > Please try savePairs(rdd, true). > > Hope it helps! > -- > Ily

Re: Ignite not able to persist spark rdd to RDBMS in master slave mode

2019-03-13 Thread Ilya Kasnacheev
Hello! Please try savePairs(rdd, true). Hope it helps! -- Ilya Kasnacheev ср, 13 мар. 2019 г. в 17:41, Harshal Patil : > Hi , > I am using SPARK 2.3.0 and Ignite 2.7.0 . I have enabled POSTGRES as > persistent store through gridgain automatic RDBMS integration .I have > enabled write through

Ignite not able to persist spark rdd to RDBMS in master slave mode

2019-03-13 Thread Harshal Patil
Hi , I am using SPARK 2.3.0 and Ignite 2.7.0 . I have enabled POSTGRES as persistent store through gridgain automatic RDBMS integration .I have enabled write through cache . I could see data being persisted in POSTGRES when I am running SPARK in standalone mode , with *val *conf = *new *SparkCon