Yeah the main way to do this would be to have your own static cache of
connections. These could be using an object in Scala or just a static
variable in Java (for instance a set of connections that you can
borrow from).
- Patrick
On Thu, Dec 4, 2014 at 5:26 PM, Tobias Pfeiffer t...@preferred.jp
Is it possible to have some state across multiple calls to mapPartitions on
each partition, for instance, if I want to keep a database connection open?
details ?
What do you nerd to do with db cpnnection?
Paolo
Inviata dal mio Windows Phone
--
Da: Akshat Aranya aara...@gmail.com
Inviato: 04/12/2014 18:57
A: user@spark.apache.org
Oggetto: Stateful mapPartitions
Is it possible to have some state across
Hi,
On Fri, Dec 5, 2014 at 3:56 AM, Akshat Aranya aara...@gmail.com wrote:
Is it possible to have some state across multiple calls to mapPartitions
on each partition, for instance, if I want to keep a database connection
open?
If you're using Scala, you can use a singleton object, this will
