Re: Why Spark JDBC Writing in a sequential order

2018-05-25 Thread Yong Zhang
this and coordinating all tasks and executors as I observed? Yong From: Jörn Franke <jornfra...@gmail.com> Sent: Friday, May 25, 2018 10:50 AM To: Yong Zhang Cc: user@spark.apache.org Subject: Re: Why Spark JDBC Writing in a sequential order Can your database receive the

Re: Why Spark JDBC Writing in a sequential order

2018-05-25 Thread Jörn Franke
Can your database receive the writes concurrently ? Ie do you make sure that each executor writes into a different partition at database side ? > On 25. May 2018, at 16:42, Yong Zhang wrote: > > Spark version 2.2.0 > > > We are trying to write a DataFrame to remote