Re: Using HiveContext.set in multipul threads

2016-05-24 Thread Silvio Fiorito
; Date: Tuesday, May 24, 2016 at 7:01 AM To: "user@spark.apache.org" <user@spark.apache.org> Subject: Using HiveContext.set in multipul threads Hi, I have a DataFrame I compute from a long chain of transformations. I cache it, and then perform two additional transformations on it. I

Using HiveContext.set in multipul threads

2016-05-24 Thread Amir Gershman
Hi, I have a DataFrame I compute from a long chain of transformations. I cache it, and then perform two additional transformations on it. I use two Futures - each Future will insert the content of one of the above Dataframe to a different hive table. One Future must SET