Re: How to retrieve multiple columns values (in one row) to variables in Spark Scala method

2019-04-06 Thread Mich Talebzadeh
Thanks Ayan! Much appreciated your help. Regards, Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com

writing into oracle database is very slow

2019-04-06 Thread Lian Jiang
Hi, My spark job writes into oracle db using: df.coalesce(10).write.format("jdbc").option("url", url) .option("driver", driver).option("user", user) .option("batchsize", 2000) .option("password", password).option("dbtable", tableName).mode("append").save() It is much slow than writting