packer for building cloudstack templates

2014-01-24 Thread Brian Galura
At my company we use packer to build ec2 images and really like it. I would 
like to use it for cloudstack also.

I found this: https://github.com/vogxn/packer-builtin

Which appears to be a centos6 image builder for cloudstack but it lacks 
instructions to convert the resultant image into something I can import to 
cloudstack.

Has anyone successfully done this?

How do you build cloudstack templates?


Re: mem.overprovisioning.facto and KVM

2014-01-24 Thread Nitin Mehta
Just the cluster should be fine, changing the global will not affect the
existing cluster's settings, but newly created clusters will inherit from
them.
For more info do read
https://cwiki.apache.org/confluence/display/CLOUDSTACK/CPU+and+RAM+Overcomm
it

Thanks,
-Nitin

On 24/01/14 2:28 PM, "Marcus Sorensen"  wrote:

>Looks like it works as of 4.2, but you need to update existing cluster
>settings, rather than global (or both, I suppose).
>
>On Fri, Jan 24, 2014 at 3:17 PM, Marcus Sorensen 
>wrote:
>> I guess not. It should work though. We ran into the same issue with
>> storage, everything hardcoded to only work with vmware. I'll take a
>> look.
>>
>> On Mon, Oct 7, 2013 at 1:09 PM, Sebastien Goasguen 
>>wrote:
>>>
>>> On Sep 25, 2013, at 2:59 AM, Harikrishna Patnala
>>> wrote:
>>>
 As far as I know men over provisioning is intended to work only with
VMWare hypervisor to allocate reserved memory for VM.

>>>
>>> @Marcus, could you comment on this: is mem over provisioning supposed
>>>to work with KVM ?
>>>
 On 25-Sep-2013, at 11:11 AM, Nikolay Kabadjov 
wrote:

> Yes Kirk, I did
>
>
>
> 
> From: Kirk Jantzer 
> To: Cloudstack users mailing list ;
>Nikolay Kabadjov 
> Sent: Tuesday, September 24, 2013 5:50 PM
> Subject: Re: mem.overprovisioning.facto and KVM
>
>
>
> Did you restart the management service after making the change?
>
>
>
> Regards,
>
> Kirk Jantzer
> http://about.me/kirkjantzer
>
>
>
> On Tue, Sep 24, 2013 at 10:25 AM, Nikolay Kabadjov
> wrote:
>
> Hi all,
>> I've noticed that increasing mem.overprovisioning.factor doesn't
>>take effect?
>> I mean I still see in the dashboard the exact amount of memory I
>>have multiplying the memory of all the hosts.
>>
>> It's CS 4.1.1 with one zone, one pod, one cluster, 6 KVM hosts
>>
>> Any idea?
>>
>> Thanks
>> Niki

>>>



Re: mem.overprovisioning.facto and KVM

2014-01-24 Thread Marcus Sorensen
Looks like it works as of 4.2, but you need to update existing cluster
settings, rather than global (or both, I suppose).

On Fri, Jan 24, 2014 at 3:17 PM, Marcus Sorensen  wrote:
> I guess not. It should work though. We ran into the same issue with
> storage, everything hardcoded to only work with vmware. I'll take a
> look.
>
> On Mon, Oct 7, 2013 at 1:09 PM, Sebastien Goasguen  wrote:
>>
>> On Sep 25, 2013, at 2:59 AM, Harikrishna Patnala 
>>  wrote:
>>
>>> As far as I know men over provisioning is intended to work only with VMWare 
>>> hypervisor to allocate reserved memory for VM.
>>>
>>
>> @Marcus, could you comment on this: is mem over provisioning supposed to 
>> work with KVM ?
>>
>>> On 25-Sep-2013, at 11:11 AM, Nikolay Kabadjov  wrote:
>>>
 Yes Kirk, I did



 
 From: Kirk Jantzer 
 To: Cloudstack users mailing list ; Nikolay 
 Kabadjov 
 Sent: Tuesday, September 24, 2013 5:50 PM
 Subject: Re: mem.overprovisioning.facto and KVM



 Did you restart the management service after making the change?



 Regards,

 Kirk Jantzer
 http://about.me/kirkjantzer



 On Tue, Sep 24, 2013 at 10:25 AM, Nikolay Kabadjov  
 wrote:

 Hi all,
> I've noticed that increasing mem.overprovisioning.factor doesn't take 
> effect?
> I mean I still see in the dashboard the exact amount of memory I have 
> multiplying the memory of all the hosts.
>
> It's CS 4.1.1 with one zone, one pod, one cluster, 6 KVM hosts
>
> Any idea?
>
> Thanks
> Niki
>>>
>>


Re: mem.overprovisioning.facto and KVM

2014-01-24 Thread Marcus Sorensen
I guess not. It should work though. We ran into the same issue with
storage, everything hardcoded to only work with vmware. I'll take a
look.

On Mon, Oct 7, 2013 at 1:09 PM, Sebastien Goasguen  wrote:
>
> On Sep 25, 2013, at 2:59 AM, Harikrishna Patnala 
>  wrote:
>
>> As far as I know men over provisioning is intended to work only with VMWare 
>> hypervisor to allocate reserved memory for VM.
>>
>
> @Marcus, could you comment on this: is mem over provisioning supposed to work 
> with KVM ?
>
>> On 25-Sep-2013, at 11:11 AM, Nikolay Kabadjov  wrote:
>>
>>> Yes Kirk, I did
>>>
>>>
>>>
>>> 
>>> From: Kirk Jantzer 
>>> To: Cloudstack users mailing list ; Nikolay 
>>> Kabadjov 
>>> Sent: Tuesday, September 24, 2013 5:50 PM
>>> Subject: Re: mem.overprovisioning.facto and KVM
>>>
>>>
>>>
>>> Did you restart the management service after making the change?
>>>
>>>
>>>
>>> Regards,
>>>
>>> Kirk Jantzer
>>> http://about.me/kirkjantzer
>>>
>>>
>>>
>>> On Tue, Sep 24, 2013 at 10:25 AM, Nikolay Kabadjov  
>>> wrote:
>>>
>>> Hi all,
 I've noticed that increasing mem.overprovisioning.factor doesn't take 
 effect?
 I mean I still see in the dashboard the exact amount of memory I have 
 multiplying the memory of all the hosts.

 It's CS 4.1.1 with one zone, one pod, one cluster, 6 KVM hosts

 Any idea?

 Thanks
 Niki
>>
>


Re: CS 4.2 VM Deployments slow and/or broken

2014-01-24 Thread Nick Wales
listen_tls=0


listen_tcp=1


tcp_port="16509"


auth_tcp="none"
mdns_adv = 0

is all i have in libvirtd.conf (partly regarding the question on IRC)


On 24 January 2014 15:22, Nick Wales  wrote:

> Cloudstack - 4.2
>
> libvirt-0.10.2-18
>
> Running on centos 6.2 with netapp nfs.
>
>
> On 24 January 2014 15:20, David Nalley  wrote:
>
>> What version?
>>
>>
>>
>> On Fri, Jan 24, 2014 at 3:37 PM, Nick Wales  wrote:
>> > Hey, I'm having awful performance spinning up machines, with some taking
>> > ages to eventually fail.
>> >
>> > The majority of the error messages seem to stem from this:
>> >
>> >
>> > ==> cloudstack-agent.out <==
>> > 2014-01-24 14:14:30,779{GMT} WARN  [cloud.agent.Agent]
>> > (agentRequest-Handler-1:) Caught:
>> > java.lang.NullPointerException
>> > at
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2469)
>> > at
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1230)
>> > at com.cloud.agent.Agent.processRequest(Agent.java:525)
>> > at
>> com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)
>> > at com.cloud.utils.nio.Task.run(Task.java:83)
>> > at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>> > at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> > at java.lang.Thread.run(Thread.java:679)
>> >
>> > and
>> >
>> > 2014-01-24 19:22:30.842+: 6099: error : virNetSocketReadWire:1184
>> > : End of file while reading data: Input/output error
>> > Any ideas / help much appreciated!
>> >
>> > Nick
>>
>
>


Re: CS 4.2 VM Deployments slow and/or broken

2014-01-24 Thread Nick Wales
Cloudstack - 4.2

libvirt-0.10.2-18

Running on centos 6.2 with netapp nfs.


On 24 January 2014 15:20, David Nalley  wrote:

> What version?
>
>
>
> On Fri, Jan 24, 2014 at 3:37 PM, Nick Wales  wrote:
> > Hey, I'm having awful performance spinning up machines, with some taking
> > ages to eventually fail.
> >
> > The majority of the error messages seem to stem from this:
> >
> >
> > ==> cloudstack-agent.out <==
> > 2014-01-24 14:14:30,779{GMT} WARN  [cloud.agent.Agent]
> > (agentRequest-Handler-1:) Caught:
> > java.lang.NullPointerException
> > at
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2469)
> > at
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1230)
> > at com.cloud.agent.Agent.processRequest(Agent.java:525)
> > at
> com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)
> > at com.cloud.utils.nio.Task.run(Task.java:83)
> > at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> > at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:679)
> >
> > and
> >
> > 2014-01-24 19:22:30.842+: 6099: error : virNetSocketReadWire:1184
> > : End of file while reading data: Input/output error
> > Any ideas / help much appreciated!
> >
> > Nick
>


Re: CS 4.2 VM Deployments slow and/or broken

2014-01-24 Thread David Nalley
What version?



On Fri, Jan 24, 2014 at 3:37 PM, Nick Wales  wrote:
> Hey, I'm having awful performance spinning up machines, with some taking
> ages to eventually fail.
>
> The majority of the error messages seem to stem from this:
>
>
> ==> cloudstack-agent.out <==
> 2014-01-24 14:14:30,779{GMT} WARN  [cloud.agent.Agent]
> (agentRequest-Handler-1:) Caught:
> java.lang.NullPointerException
> at 
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2469)
> at 
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1230)
> at com.cloud.agent.Agent.processRequest(Agent.java:525)
> at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)
> at com.cloud.utils.nio.Task.run(Task.java:83)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:679)
>
> and
>
> 2014-01-24 19:22:30.842+: 6099: error : virNetSocketReadWire:1184
> : End of file while reading data: Input/output error
> Any ideas / help much appreciated!
>
> Nick


CS 4.2 VM Deployments slow and/or broken

2014-01-24 Thread Nick Wales
Hey, I'm having awful performance spinning up machines, with some taking
ages to eventually fail.

The majority of the error messages seem to stem from this:


==> cloudstack-agent.out <==
2014-01-24 14:14:30,779{GMT} WARN  [cloud.agent.Agent]
(agentRequest-Handler-1:) Caught:
java.lang.NullPointerException
at 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2469)
at 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1230)
at com.cloud.agent.Agent.processRequest(Agent.java:525)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)
at com.cloud.utils.nio.Task.run(Task.java:83)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)

and

2014-01-24 19:22:30.842+: 6099: error : virNetSocketReadWire:1184
: End of file while reading data: Input/output error
Any ideas / help much appreciated!

Nick


Re: Need help with advanced zone/2 nics

2014-01-24 Thread Derek Cole
To update anyone following:

I have verified that my switch ports are correct and that both nics are
plugged into the the 203 vlan. When I was checking this out, I actually
changed the vlan of the storage network to be 203 (from 200) because I
think 200 was incorrect.

Everything else was the same. I can still ping and connect out from the VR,
SSVM and that other system VM, but I cannot get out from the guest VMs.
When I do a traceroute to an external interface, the last hop is the VR.
When I try to do a ping or something I get Destination Host unreachable.

Still at a loss here as to what is going wrong.


On Fri, Jan 24, 2014 at 8:47 AM, Derek Cole  wrote:

> I saw those egress rules and I set it to allow all. If I try to ping
> out, I can see the request going through all of my system vms and the
> VR. Does this imply that this setup is correct and maybe I have some
> vlan problem on my switch?
>
> Sent from my Windows Phone From: Sanjeev Neelarapu
> Sent: 1/23/2014 11:59 PM
> To: users@cloudstack.apache.org
> Subject: RE: Need help with advanced zone/2 nics
> Hi,
>
> If you have used the default network offering
> (DefaultIsolatedNetworkOfferingWithSourceNatService) to create the
> guest network then by default egress traffic is blocked because the
> egress default policy is set to denied in the default offering.
> You may need to allow the required traffic using egress rules.
>
> Thanks,
> Sanjeev
>
> -Original Message-
> From: Derek Cole [mailto:derek.c...@gmail.com]
> Sent: Friday, January 24, 2014 5:13 AM
> To: users@cloudstack.apache.org
> Subject: Need help with advanced zone/2 nics
>
> Hello,
>
> I have attempted to set up an advanced zone, using xenserver, and
> giving my guest vm's their own CIDR of 192.168.0.0/24
>
> I have two physical networks, and one of them i called "management"
> and one i called "traffic"
>
> I put public and guest traffic on "traffic" and storage and management
> on "management"
>
> My guest VM's get one network, which gives them an address from that
> 192.168.0.0 network, and they can ping each other. My virtual router
> has an internet connection and can ping out to the internet. What is
> failing is gaining internet access from my guest VM's.
> The VR gets 3 connections, a cloud_link_local_network, and an IP from
> my public CIDR, and an IP from my guest CIDR.
>
> It almost seems as if the VR isnt routing/NATing traffic to the
> outside world from the guest VM's. Can anyone tell me what may be
> wrong with my scenario?
>
> Pertinent info:
>
> storage range; 10.20.0.20-30 gw 10.20.0.1 vlan 200 Management range:
> 10.20.4.15-24 gw 10.20.4.1 public range: 10.20.4.25-254 vlan 203 gw
> 10.20.4.1 guest VLAN range 203-203
>
> networks 10.20.0/24 and 10.20.4/24 are my enterprise networks that
> provide connectivity out to the world.
>
> Any insight is appreciated. THis is my first attempt at an advanced
> network after getting a simpler basic network up and going
>


RE: Need help with advanced zone/2 nics

2014-01-24 Thread Derek Cole
I saw those egress rules and I set it to allow all. If I try to ping
out, I can see the request going through all of my system vms and the
VR. Does this imply that this setup is correct and maybe I have some
vlan problem on my switch?

Sent from my Windows Phone From: Sanjeev Neelarapu
Sent: 1/23/2014 11:59 PM
To: users@cloudstack.apache.org
Subject: RE: Need help with advanced zone/2 nics
Hi,

If you have used the default network offering
(DefaultIsolatedNetworkOfferingWithSourceNatService) to create the
guest network then by default egress traffic is blocked because the
egress default policy is set to denied in the default offering.
You may need to allow the required traffic using egress rules.

Thanks,
Sanjeev

-Original Message-
From: Derek Cole [mailto:derek.c...@gmail.com]
Sent: Friday, January 24, 2014 5:13 AM
To: users@cloudstack.apache.org
Subject: Need help with advanced zone/2 nics

Hello,

I have attempted to set up an advanced zone, using xenserver, and
giving my guest vm's their own CIDR of 192.168.0.0/24

I have two physical networks, and one of them i called "management"
and one i called "traffic"

I put public and guest traffic on "traffic" and storage and management
on "management"

My guest VM's get one network, which gives them an address from that
192.168.0.0 network, and they can ping each other. My virtual router
has an internet connection and can ping out to the internet. What is
failing is gaining internet access from my guest VM's.
The VR gets 3 connections, a cloud_link_local_network, and an IP from
my public CIDR, and an IP from my guest CIDR.

It almost seems as if the VR isnt routing/NATing traffic to the
outside world from the guest VM's. Can anyone tell me what may be
wrong with my scenario?

Pertinent info:

storage range; 10.20.0.20-30 gw 10.20.0.1 vlan 200 Management range:
10.20.4.15-24 gw 10.20.4.1 public range: 10.20.4.25-254 vlan 203 gw
10.20.4.1 guest VLAN range 203-203

networks 10.20.0/24 and 10.20.4/24 are my enterprise networks that
provide connectivity out to the world.

Any insight is appreciated. THis is my first attempt at an advanced
network after getting a simpler basic network up and going


RE: Cloudstack agent and hyper v agent cloudstack 4.3

2014-01-24 Thread Radhika Puthiyetath
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Creating+Hyperv+Agent+Installer
 follow the instruction to build Hyper V agent. As far as I know the Hyper-V 
agent (agent installed on each host) is named as CloudStack agent.

-Original Message-
From: Tejas Gadaria [mailto:refond.g...@gmail.com] 
Sent: Friday, January 24, 2014 2:37 PM
To: users@cloudstack.apache.org
Subject: Cloudstack agent and hyper v agent cloudstack 4.3

Hi,

what is the difference between cloudstack agent and hyper v agent, and what is 
the procedure to build hyper v agent.

Regards,
Tejas


Re: Cloudstack agent and hyper v agent cloudstack 4.3

2014-01-24 Thread sebgoa

On Jan 24, 2014, at 10:07 AM, Tejas Gadaria  wrote:

> Hi,
> 
> what is the difference between cloudstack agent and hyper v agent, and what
> is the procedure to build hyper v agent.
> 

Tejas, here is the wiki to create the hyper-v agent:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Creating+Hyperv+Agent+Installer

We are actually polishing that up and discussing hosting a .msi

> Regards,
> Tejas



Cloudstack agent and hyper v agent cloudstack 4.3

2014-01-24 Thread Tejas Gadaria
Hi,

what is the difference between cloudstack agent and hyper v agent, and what
is the procedure to build hyper v agent.

Regards,
Tejas