Re: Spark streaming on standalone cluster

2015-07-01 Thread Borja Garrido Bear
? is it spark.akka.threads ? *From:* Tathagata Das [mailto:t...@databricks.com] *Sent:* 01 July 2015 01:32 *To:* Borja Garrido Bear *Cc:* user *Subject:* Re: Spark streaming on standalone cluster How many receivers do you have in the streaming program? You have to have more numbers of core in reserver

Spark streaming on standalone cluster

2015-06-30 Thread Borja Garrido Bear
Hi all, I'm running a spark standalone cluster with one master and one slave (different machines and both in version 1.4.0), the thing is I have a spark streaming job that gets data from Kafka, and the just prints it. To configure the cluster I just started the master and then the slaves

Re: Spark standalone mode and kerberized cluster

2015-06-16 Thread Borja Garrido Bear
when I start a worker, so maybe those aren't think to use kerberos... On Tue, Jun 16, 2015 at 12:10 PM, Steve Loughran ste...@hortonworks.com wrote: On 15 Jun 2015, at 15:43, Borja Garrido Bear kazebo...@gmail.com wrote: I tried running the job in a standalone cluster and I'm getting

Re: Spark standalone mode and kerberized cluster

2015-06-15 Thread Borja Garrido Bear
I tried running the job in a standalone cluster and I'm getting this: java.io.IOException: Failed on local exception: java.io.IOException: org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN, KERBEROS]; Host Details : local host is: worker-node/0.0.0.0;