Re: problem with HiveContext inside Actor

2014-09-26 Thread Cheng Lian
...@databricks.com mailto:mich...@databricks.com, Cheng, Hao hao.ch...@intel.com mailto:hao.ch...@intel.com, user@spark.apache.org mailto:user@spark.apache.org user@spark.apache.org mailto:user@spark.apache.org Subject: Re: problem with HiveContext inside Actor Akka actor are managed under a thread

Re: problem with HiveContext inside Actor

2014-09-26 Thread Cheng Lian
...@databricks.com mailto:mich...@databricks.com, Cheng, Hao hao.ch...@intel.com mailto:hao.ch...@intel.com, user@spark.apache.org mailto:user@spark.apache.org user@spark.apache.org mailto:user@spark.apache.org Subject: Re: problem with HiveContext inside Actor Akka actor are managed under

Re: problem with HiveContext inside Actor

2014-09-18 Thread Du Li
@spark.apache.orgmailto:user@spark.apache.org Subject: Re: problem with HiveContext inside Actor Akka actor are managed under a thread pool, so the same actor can be under different thread. If you create HiveContext in the actor, is it possible that you are essentially create different instance of HiveContext

problem with HiveContext inside Actor

2014-09-17 Thread Du Li
Hi, Wonder anybody had similar experience or any suggestion here. I have an akka Actor that processes database requests in high-level messages. Inside this Actor, it creates a HiveContext object that does the actual db work. The main thread creates the needed SparkContext and passes in to the

RE: problem with HiveContext inside Actor

2014-09-17 Thread Cheng, Hao
the null value when retrieving HiveConf. Cheng Hao From: Du Li [mailto:l...@yahoo-inc.com.INVALID] Sent: Thursday, September 18, 2014 7:51 AM To: user@spark.apache.org; d...@spark.apache.org Subject: problem with HiveContext inside Actor Hi, Wonder anybody had similar experience or any suggestion here

Re: problem with HiveContext inside Actor

2014-09-17 Thread Michael Armbrust
:* Du Li [mailto:l...@yahoo-inc.com.INVALID] *Sent:* Thursday, September 18, 2014 7:51 AM *To:* user@spark.apache.org; d...@spark.apache.org *Subject:* problem with HiveContext inside Actor Hi, Wonder anybody had similar experience or any suggestion here. I have an akka Actor

Re: problem with HiveContext inside Actor

2014-09-17 Thread Du Li
...@intel.com Cc: Du Li l...@yahoo-inc.com.invalidmailto:l...@yahoo-inc.com.invalid, user@spark.apache.orgmailto:user@spark.apache.org user@spark.apache.orgmailto:user@spark.apache.org Subject: Re: problem with HiveContext inside Actor - dev Is it possible that you are constructing more than one