Re: Availability of alpha "Easy Juju on Azure" disk image

[Marco Ceppi]

Hey Andrew,

I agree with you on the feedback, since it's an HTML page at the moment
it's hard to incorporate those items, but I've forked the repo and started
building a lightweight Python app to provide that feedback to the user.

Marco

On Tue Feb 10 2015 at 9:37:48 PM Andrew Wilkins <
andrew.wilk...@canonical.com> wrote:

> Hi Samuel,
>
> Looks neat. A few things:
>  1. Once the VM is ready, the entire landing page keeps refreshing at 1s
> intervals. That doesn't leave a lot of time to add the .publishsettings
> file and upload.
>  2. There's no feedback to say whether or not the .publishsetttings file
> has been uploaded, and whether bootstrapping is underway. I guess I did it
> twice because of point 1, because now I have two "juju bootstrap" processes
> on the machine :)
>  3. When the GUI eventually came up, it wouldn't accept the password that
> the page displayed. This is related to point 2: the page gave me the link
> to the GUI for one env, and the password for the other.
>
> It'd be great if the "upload credentials" bit greyed out once uploaded,
> and then under "3. Wait for a few minutes..." there was something
> describing the current status. e.g. "Installing Juju", "Deploying Juju GUI".
>
> Cheers,
> Andrew
>
> On Tue, Feb 10, 2015 at 11:01 PM, Samuel Cozannet <
> samuel.cozan...@canonical.com> wrote:
>
>> Dear All,
>>
>> Yesterday we released an alpha of a new Ubuntu image on MS Azure VM
>> Depot: https://vmdepot.msopentech.com/Vhd/Show?vhdId=50248
>>
>> If you use that image and spin a VM with it, you'll be able to upload
>> your Azure .publishsettings file to its web interface. From that moment,
>> the VM will boostrap a Juju environment, install the Juju GUI.
>> The main web page auto refreshes, and presents the link to the Juju GUI
>> with a password when it's ready.
>>
>> The whole process from upload to Juju GUI takes about 10min to complete,
>> and does not require any knowledge of Juju or Ubuntu to start playing.
>> It leaves you with a fully functional Juju environment using your default
>> subscription as your main Azure provider.
>>
>> We hope you enjoy that new and easy way to start with Juju. We aim at
>> making this image available from the Marketplace when we gather enough
>> feedback and fix bugs that remain.
>>
>> The whole code and explanations are available on
>> https://github.com/SaMnCo/juju-azure. Please use that repo to send
>> feedback while we make it better. You can also answer to this thread on the
>> list to ask any question or feature request you may have.
>>
>> Best,
>> Samuel
>>
>> --
>> Samuel Cozannet
>> Cloud, Big Data and IoT Strategy Team
>> Business Development - Cloud and ISV Ecosystem
>> Changing the Future of Cloud
>> Ubuntu   / Canonical UK LTD  /
>> Juju 
>> samuel.cozan...@canonical.com
>> mob: +33 616 702 389
>> skype: samnco
>> Twitter: @SaMnCo_23
>>
>> --
>> Juju mailing list
>> Juju@lists.ubuntu.com
>> Modify settings or unsubscribe at:
>> https://lists.ubuntu.com/mailman/listinfo/juju
>>
>>
> --
> Juju mailing list
> Juju@lists.ubuntu.com
> Modify settings or unsubscribe at: https://lists.ubuntu.com/
> mailman/listinfo/juju
>
-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

Re: Availability of alpha "Easy Juju on Azure" disk image

[Andrew Wilkins]

Hi Samuel,

Looks neat. A few things:
 1. Once the VM is ready, the entire landing page keeps refreshing at 1s
intervals. That doesn't leave a lot of time to add the .publishsettings
file and upload.
 2. There's no feedback to say whether or not the .publishsetttings file
has been uploaded, and whether bootstrapping is underway. I guess I did it
twice because of point 1, because now I have two "juju bootstrap" processes
on the machine :)
 3. When the GUI eventually came up, it wouldn't accept the password that
the page displayed. This is related to point 2: the page gave me the link
to the GUI for one env, and the password for the other.

It'd be great if the "upload credentials" bit greyed out once uploaded, and
then under "3. Wait for a few minutes..." there was something describing
the current status. e.g. "Installing Juju", "Deploying Juju GUI".

Cheers,
Andrew

On Tue, Feb 10, 2015 at 11:01 PM, Samuel Cozannet <
samuel.cozan...@canonical.com> wrote:

> Dear All,
>
> Yesterday we released an alpha of a new Ubuntu image on MS Azure VM Depot:
> https://vmdepot.msopentech.com/Vhd/Show?vhdId=50248
>
> If you use that image and spin a VM with it, you'll be able to upload your
> Azure .publishsettings file to its web interface. From that moment, the VM
> will boostrap a Juju environment, install the Juju GUI.
> The main web page auto refreshes, and presents the link to the Juju GUI
> with a password when it's ready.
>
> The whole process from upload to Juju GUI takes about 10min to complete,
> and does not require any knowledge of Juju or Ubuntu to start playing.
> It leaves you with a fully functional Juju environment using your default
> subscription as your main Azure provider.
>
> We hope you enjoy that new and easy way to start with Juju. We aim at
> making this image available from the Marketplace when we gather enough
> feedback and fix bugs that remain.
>
> The whole code and explanations are available on
> https://github.com/SaMnCo/juju-azure. Please use that repo to send
> feedback while we make it better. You can also answer to this thread on the
> list to ask any question or feature request you may have.
>
> Best,
> Samuel
>
> --
> Samuel Cozannet
> Cloud, Big Data and IoT Strategy Team
> Business Development - Cloud and ISV Ecosystem
> Changing the Future of Cloud
> Ubuntu   / Canonical UK LTD  /
> Juju 
> samuel.cozan...@canonical.com
> mob: +33 616 702 389
> skype: samnco
> Twitter: @SaMnCo_23
>
> --
> Juju mailing list
> Juju@lists.ubuntu.com
> Modify settings or unsubscribe at:
> https://lists.ubuntu.com/mailman/listinfo/juju
>
>
-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

Juju devel 1.22-beta3 is available for testing.

[Curtis Hovey-Canonical]

# juju-core 1.22-beta3

A new development release of Juju, juju-core 1.22-beta3, is now available.
This release replaces 1.22-beta2.

## Getting Juju

juju-core 1.22-beta3 is available for utopic and backported to earlier
series in the following PPA:

https://launchpad.net/~juju/+archive/devel

The devel packages in this archive use the devel simple-streams.
You must configure the 'agent-stream' option in your
environments.yaml to use the matching juju agents.

agent-stream: devel

Upgrading from stable releases to development releases is not
supported. You can upgrade test environments to development releases
to test new features and fixes, but it is not advised to upgrade
production environments to 1.22-beta3.

## Notable Changes

This releases addresses stability and performance issues.

## Resolved issues

* Failure to retrieve the template to clone: lxc container with 1.22
  beta2
  Lp 1417594

* Charm download behind the enterprise proxy fails
  Lp 1403225

* Unit ports not populated by api megawatcher
  Lp 1418433

* Apt-proxy can be incorrectly set when the fallback from http-proxy
  is used
  Lp 1417617

Finally

We encourage everyone to subscribe the mailing list at
juju-...@lists.canonical.com, or join us on #juju-dev on freenode.


-- 
Curtis Hovey
Canonical Cloud Development and Operations
http://launchpad.net/~sinzui

-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

Re: Bug filed for Juju Quickstart Documentation

[Richard Harding]

On Mon, 09 Feb 2015, Charles Butler wrote:

> I've been working my way through documenting some of the newer workload
> enablement items coming out of my team, and in doing so I've run across
> Quickstart being under-represented in the docs.
>
>
> https://github.com/juju/docs/issues/261
>
>
> With quickstart being a pointed at defacto utility to rapidly deploy
> bundles and configure your cloud environment, this gap is a fairly large
> concern to me. What I propose is I can scaffold out some baseline user
> documentation - but it would be great to see a Juju User Interface team
> member step into maintaining this particular tool documentation once I've
> got a PR up for review.
>
> Also, if there are any existing blog posts I can consume you can point me
> to I'd certainly appreciate it.
>
> Cheers

Thanks Chuck, definitely something we should look to improve. We have
decent help in the app, but not great exernal docs.

The best place to look for blog posts (and one is a video walk through) is
searching on the team's blog:

https://jujugui.wordpress.com/?s=quickstart

We'll look to help pull together some better 'readable' docs. Thanks for
bringing this up.

--

Rick Harding

Juju UI Engineering
https://launchpad.net/~rharding
@mitechie

-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

[Review Queue]: Openbook

[Matt Bruzek]

For my time in the review queue I did another round on the Talligent
Openbook charm.  The previous problem was fixed, but it had another
configuration related problem.

https://bugs.launchpad.net/charms/+bug/1411402

   - Matt Bruzek 
-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

juju-core 1.21.2 is proposed for release

[Curtis Hovey-Canonical]

# juju-core 1.21.2

A new stable release of Juju, juju-core 1.21.2, is proposed.
This release may replace 1.21.1 on 2015-02-12 after a period
of evaluation.


## Getting Juju

juju-core 1.21.2 is available for utopic and backported to earlier
series in the following PPA:

https://launchpad.net/~juju/+archive/proposed

The proposed packages in this archive use the proposed simple-streams.
You must configure the 'agent-stream' option in your
environments.yaml to use the matching juju agents.

agent-stream: proposed


## Notable Changes

This releases addresses stability and performance issues.


## Resolved issues

* Unable to override network-bridge if container type is kvm (local
  provider)
  Lp 1416134

* Src/bitbucket.org/kardianos/osext/license is wrong
  Lp 1416425

* Github.com/juju/syslog has contradicting licensing info
  Lp 1416433

* Some files refer to an include license file that is not included
  Lp 1416430

* Github.com/juju/utils has contradictory licence info
  Lp 1416436

* Juju restore no longer works with azure: error: cannot re-bootstrap
  environment: cannot determine state server instances: environment is
  not bootstrapped
  Lp 1417178

* Unit ports not populated by api megawatcher
  Lp 1418433

* Apt-proxy can be incorrectly set when the fallback from http-proxy
  is used
  Lp 1417617


Finally

We encourage everyone to subscribe the mailing list at
juju-...@lists.canonical.com, or join us on #juju-dev on freenode.

-- 
Curtis Hovey
Canonical Cloud Development and Operations
http://launchpad.net/~sinzui

-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

Re: Unable to deploy a working 10 node hadoop cluster

[Cory Johns]

Ken,

Unfortunately, this is due to an upstream change in the openjdk
package.  A bug has been filed[1] and it has been noted that this
breaks all of the Big Data charms in the store.  Please indicate on
that bug that this is affecting you.

There is a symlink work-around mentioned on the bug, but it is
per-process.  You could also manually install the previous Java
version using apt[2], but this is not recommended and would require
removing and re-adding all of the relations, at least.

[1] https://bugs.launchpad.net/ubuntu/+source/openjdk-6/+bug/1417962
[2] sudo apt-get install openjdk-7-jdk=7u51-2.4.6-1ubuntu4
openjdk-7-jre=7u51-2.4.6-1ubuntu4
openjdk-7-jre-headless=7u51-2.4.6-1ubuntu4

On Tue, Feb 10, 2015 at 11:59 AM, Ken Williams  wrote:
>
> Hi,
>
> I'm trying to deploy a basic hadoop cluster on Amazon (AWS).
> It should have just 10 nodes to simply run hadoop map-reduce
> jobs and just store data on hdfs. Nothing else. No hive or
> spark or anything.
>
> These are the commands I enter.
>
> juju quickstart
> juju deploy hdp-hadoop yarn-hdfs-master
> juju deploy hdp-hadoop compute-node
> juju add-unit -n 10 compute-node
> juju add-relation yarn-hdfs-master:namenode compute-node:datanode
> juju add-relation yarn-hdfs-master:resourcemanager
> compute-node:nodemanager
>
> In 'juju status' I can see all the nodes are being added and
> I wait until all their statuses are 'running'.
>
> If I 'juju ssh' to *any* of the compute-node machines I
> cannot list any hdfs directories, and get this message
>
> root@ip-172-31-28-205:~# su hdfs
> hdfs@ip-172-31-28-205:/home/ubuntu$ hdfs dfs -ls /
> ls: Incomplete HDFS URI, no host: hdfs://TODO-NAMENODE-HOSTNAME:PORT
> hdfs@ip-172-31-28-205:/home/ubuntu$
>
>
> Also, there is no 'DataNode' process running on the machine,
> which would be needed to access HDFS.
> Am I doing something wrong or am I meant to edit
> the 'hdfs-site.xml' file myself ?
> On all 10 machines ?
>
> Also, if I 'juju ssh' onto the yarn-hdfs-master/0 machine
> and try to run a hdfsadmin -report, it tells me that
> hdfs has no data-nodes running (see below) - so when
> I try to put data on to hdfs it fails with an error
> message 'There are 0 datanode(s) running'.
>
> hdfs@ip-172-31-21-161:/home/ubuntu$ hdfs dfsadmin -report
> Configured Capacity: 0 (0 B)
> Present Capacity: 0 (0 B)
> DFS Remaining: 0 (0 B)
> DFS Used: 0 (0 B)
> DFS Used%: NaN%
> Under replicated blocks: 0
> Blocks with corrupt replicas: 0
> Missing blocks: 0
>
> -
> Datanodes available: 0 (0 total, 0 dead)
>
>
> I don't understand if I am doing something wrong.
>
> What is the recommended way for deploying a
> hadoop and hdfs cluster using juju ?
>
> Thankyou for any help,
>
> Ken
>
>
>
> --
> Juju mailing list
> Juju@lists.ubuntu.com
> Modify settings or unsubscribe at:
> https://lists.ubuntu.com/mailman/listinfo/juju
>

-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

[Review Queue] Dell-OMSA, Seafile, Nagios, Quassel-Core

[Charles Butler]

I reviewed the Dell OpenManageServerAdministrator charm which is a
brilliant use of a localized juju charm for deploying some added "zing" to
dell servers.
https://bugs.launchpad.net/charms/+bug/1325700

This landed today and was +1'd thanks to mwennings hard work.

MariaDB had an ISV Maintainer contribution by dbart - who's hard work has
been ack'd as the upstream charm
https://bugs.launchpad.net/charms/+bug/1028093

There were 2 seafile merges proposed that were accepted today. 1 was for
some bug fixups
https://code.launchpad.net/~jose/charms/precise/seafile/fixes/+merge/244636

Another was for test inclusion
https://code.launchpad.net/~marcoceppi/charms/precise/seafile/tests/+merge/240964

This work was landed due in part to our prior abandoned charms work - and
has a bug associated with it:
https://bugs.launchpad.net/charms/+source/seafile/+bug/1420374


Nagios template config update:
https://code.launchpad.net/~larry-e-works/charms/trusty/nagios/nagios-added-template-config/+merge/242444

This merge was marked as "needs work" due to missing test coverage and
documentation. Minor fixups to bring the submission up to charm store
guidelines.





-- 
All the best,

Charles Butler  - Juju Charmer
Come see the future of datacenter orchestration: http://jujucharms.com
-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

Unable to deploy a working 10 node hadoop cluster

[Ken Williams]

Hi,

I'm trying to deploy a basic hadoop cluster on Amazon (AWS).
It should have just 10 nodes to simply run hadoop map-reduce
jobs and just store data on hdfs. Nothing else. No hive or
spark or anything.

These are the commands I enter.

juju quickstart
juju deploy hdp-hadoop yarn-hdfs-master
juju deploy hdp-hadoop compute-node
juju add-unit -n 10 compute-node
juju add-relation yarn-hdfs-master:namenode compute-node:datanode
juju add-relation yarn-hdfs-master:resourcemanager
compute-node:nodemanager

In 'juju status' I can see all the nodes are being added and
I wait until all their statuses are 'running'.

If I 'juju ssh' to *any* of the compute-node machines I
cannot list any hdfs directories, and get this message

root@ip-172-31-28-205:~# su hdfs
hdfs@ip-172-31-28-205:/home/ubuntu$ hdfs dfs -ls /
ls: Incomplete HDFS URI, no host: hdfs://TODO-NAMENODE-HOSTNAME:PORT
hdfs@ip-172-31-28-205:/home/ubuntu$


Also, there is no 'DataNode' process running on the machine,
which would be needed to access HDFS.
Am I doing something wrong or am I meant to edit
the 'hdfs-site.xml' file myself ?
On all 10 machines ?

Also, if I 'juju ssh' onto the yarn-hdfs-master/0 machine
and try to run a hdfsadmin -report, it tells me that
hdfs has no data-nodes running (see below) - so when
I try to put data on to hdfs it fails with an error
message 'There are 0 datanode(s) running'.

hdfs@ip-172-31-21-161:/home/ubuntu$ hdfs dfsadmin -report
Configured Capacity: 0 (0 B)
Present Capacity: 0 (0 B)
DFS Remaining: 0 (0 B)
DFS Used: 0 (0 B)
DFS Used%: NaN%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0

-
Datanodes available: 0 (0 total, 0 dead)


I don't understand if I am doing something wrong.

What is the recommended way for deploying a
hadoop and hdfs cluster using juju ?

Thankyou for any help,

Ken
-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

Availability of alpha "Easy Juju on Azure" disk image

[Samuel Cozannet]

Dear All,

Yesterday we released an alpha of a new Ubuntu image on MS Azure VM Depot:
https://vmdepot.msopentech.com/Vhd/Show?vhdId=50248

If you use that image and spin a VM with it, you'll be able to upload your
Azure .publishsettings file to its web interface. From that moment, the VM
will boostrap a Juju environment, install the Juju GUI.
The main web page auto refreshes, and presents the link to the Juju GUI
with a password when it's ready.

The whole process from upload to Juju GUI takes about 10min to complete,
and does not require any knowledge of Juju or Ubuntu to start playing.
It leaves you with a fully functional Juju environment using your default
subscription as your main Azure provider.

We hope you enjoy that new and easy way to start with Juju. We aim at
making this image available from the Marketplace when we gather enough
feedback and fix bugs that remain.

The whole code and explanations are available on
https://github.com/SaMnCo/juju-azure. Please use that repo to send feedback
while we make it better. You can also answer to this thread on the list to
ask any question or feature request you may have.

Best,
Samuel

--
Samuel Cozannet
Cloud, Big Data and IoT Strategy Team
Business Development - Cloud and ISV Ecosystem
Changing the Future of Cloud
Ubuntu   / Canonical UK LTD  / Juju

samuel.cozan...@canonical.com
mob: +33 616 702 389
skype: samnco
Twitter: @SaMnCo_23
-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju