You could use an object in Scala, of which only one instance will be created on each JVM / Executor. E.g.
object MyDatabseSingleton { var dbConn = ??? } On Sat, 28 Jul 2018, 08:34 kant kodali, <kanth...@gmail.com> wrote: > Hi All, > > I understand creating a connection forEachPartition but I am wondering can > I create one DB connection per executor and close it after the job is done? > any sample code would help. you can imagine I am running a simple batch > processing application. > > Thanks! >