Unable to deploy a working 10 node hadoop cluster

2015-02-10 Thread Ken Williams
Hi, I'm trying to deploy a basic hadoop cluster on Amazon (AWS). It should have just 10 nodes to simply run hadoop map-reduce jobs and just store data on hdfs. Nothing else. No hive or spark or anything. These are the commands I enter. juju quickstart juju deploy hdp-

Re: Problem deploying bundle data-analytics-with-sql-like

2015-02-05 Thread Ken Williams
tp://ubuntu.com> / Canonical UK LTD <http://canonical.com> / > Juju <https://jujucharms.com> > samuel.cozan...@canonical.com > mob: +33 616 702 389 > skype: samnco > Twitter: @SaMnCo_23 > > On Thu, Feb 5, 2015 at 1:55 PM, Ken Williams wrote: > >> >&

Problem deploying bundle data-analytics-with-sql-like

2015-02-05 Thread Ken Williams
Hi all, I'm currently using the 'data-analytics-with-sql-like' bundle. Sometimes it works fine but sometimes it deploys with an error and I don't know how to fix it without doing 'destroy-environment' and deploy again (which takes time). The error (in 'juju stat') is, yarn-h

Deploying Spark charm to data-analytics-with-sql-like loses HDFS configuration

2015-02-03 Thread Ken Williams
Hi, I'm able to deploy the 'data-analytics-with-sql-like' bundle successfully. When it's deployed I can run the hdfs and hive smoke tests described here ( https://api.jujucharms.com/v4/bundle/data-analytics-with-sql-like-5/archive/README.md) successfully. I then need to deploy the Spark c

Re: How best to install Spark?

2015-02-02 Thread Ken Williams
ARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Pi is roughly 3.1405888 Many thanks again for all your help, Best Regards, Ken On 30 January 2015 at 18:11, Ken Williams wrote: > > Ok - Sam, I'll try th

Re: How best to install Spark?

2015-01-30 Thread Ken Williams
nical.com> / > Juju <https://jujucharms.com> > samuel.cozan...@canonical.com > mob: +33 616 702 389 > skype: samnco > Twitter: @SaMnCo_23 > > On Fri, Jan 30, 2015 at 7:01 PM, Ken Williams wrote: > >> Hi Sam, >> >> Attached is my bundles.yaml file.

Re: How best to install Spark?

2015-01-30 Thread Ken Williams
hanging the Future of Cloud > Ubuntu <http://ubuntu.com> / Canonical UK LTD <http://canonical.com> / > Juju <https://jujucharms.com> > samuel.cozan...@canonical.com > mob: +33 616 702 389 > skype: samnco > Twitter: @SaMnCo_23 > > On Fri, Jan 30, 2015 at 3:46

flight-delay-demo problem

2015-01-30 Thread Ken Williams
Hi, I'm trying to install the flight-delay-demo from here https://demo.jujucharms.com/~samuel-cozannet/trusty/flight-delay-demo-7 If I follow the instructions in the Readme file to git clone the code and then juju-quickstart the bundle, I get this error, root@adminuser-VirtualBox:~# root@ad

Re: How best to install Spark?

2015-01-30 Thread Ken Williams
/ubuntu.com> / Canonical UK LTD <http://canonical.com> / > Juju <https://jujucharms.com> > samuel.cozan...@canonical.com > mob: +33 616 702 389 > skype: samnco > Twitter: @SaMnCo_23 > > On Fri, Jan 30, 2015 at 1:09 PM, Ken Williams wrote: > >> Hi

Re: How best to install Spark?

2015-01-30 Thread Ken Williams
om> / Canonical UK LTD <http://canonical.com> / > Juju <https://jujucharms.com> > samuel.cozan...@canonical.com > mob: +33 616 702 389 > skype: samnco > Twitter: @SaMnCo_23 > > On Fri, Jan 30, 2015 at 11:51 AM, Ken Williams wrote: > >> >> Thanks,

Re: How best to install Spark?

2015-01-30 Thread Ken Williams
apil Thangavelu < kapil.thangav...@canonical.com> wrote: > > > On Wed, Jan 28, 2015 at 1:54 PM, Ken Williams wrote: > >> >> Hi Sam/Amir, >> >> I've been able to 'juju ssh spark-master/0' and I successfully ran >> the two >> sim

Re: How best to install Spark?

2015-01-28 Thread Ken Williams
tps://jujucharms.com> > samuel.cozan...@canonical.com > mob: +33 616 702 389 > skype: samnco > Twitter: @SaMnCo_23 > > On Wed, Jan 28, 2015 at 6:15 PM, Ken Williams wrote: > >> >> Hi Sam (and Maarten), >> >> Cloning Spark 1.2.0 from github seems t

Re: How best to install Spark?

2015-01-28 Thread Ken Williams
t; / Canonical UK LTD <http://canonical.com> / > Juju <https://jujucharms.com> > samuel.cozan...@canonical.com > mob: +33 616 702 389 > skype: samnco > Twitter: @SaMnCo_23 > > On Wed, Jan 28, 2015 at 4:44 PM, Ken Williams wrote: > >> >> Hi fol

How best to install Spark?

2015-01-28 Thread Ken Williams
Hi folks, I'm completely new to juju so any help is appreciated. I'm trying to create a hadoop/analytics-type platform. I've managed to install the 'data-analytics-with-sql-like' bundle (using this command) juju quickstart bundle:data-analytics-with-sql-like/data-analytics-with-sql-like Th