What is the size of the data? How much time does it need on HDFS and how much
on Oracle? How many partitions do you have on Oracle side?
> Am 06.04.2019 um 16:59 schrieb Lian Jiang <jiangok2...@gmail.com>:
>
> Hi,
>
> My spark job writes into oracle db using:
> df.coalesce(10).write.format("jdbc").option("url", url)
> .option("driver", driver).option("user", user)
> .option("batchsize", 2000)
> .option("password", password).option("dbtable",
> tableName).mode("append").save()
> It is much slow than writting into HDFS. The data to write is small.
> Is this expected? Thanks for any clue.
>
