Could this be related to the following bug? https://bugzilla.redhat.com/show_bug.cgi?id=1083030
On Sat, Jun 11, 2016 at 1:29 AM, Cloud List <cloud-l...@sg.or.id> wrote: > Dear all, > > Anyone implemented LXC on CloudStack before and can provide some advice? > Documentation is a bit limited on this area. Other than below > documentations, any other pointers anyone can provide? > > > http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.8/hypervisor/lxc.html > > https://cwiki.apache.org/confluence/display/CLOUDSTACK/LXC+Template+creation > > https://cwiki.apache.org/confluence/display/CLOUDSTACK/LXC+Support+in+Cloudstack > https://cwiki.apache.org/confluence/display/CLOUDSTACK/LXC+Enhancements > > Looking forward to your reply, thank you. > > Cheers. > > -ip- > > > On Fri, Jun 10, 2016 at 6:39 PM, Cloud List <cloud-l...@sg.or.id> wrote: > > > Dear all, > > > > We tried to setup an LXC cluster and add an LXC host into a test > > CloudStack 4.8.0.1 environment. The cluster is created and the LXC host > is > > created successfully. We also tried to follow below documentation to > create > > an Ubuntu LXC template -- we are running Ubuntu 12.04.5 LTS. > > > > > > > https://cwiki.apache.org/confluence/display/CLOUDSTACK/LXC+Template+creation > > > > === > > Install lxc: apt-get install lxc > > > > Create a container with any name, in our case 'ubuntu': > > > > sudo lxc-create -t download -n ubuntu -- --dist ubuntu --release trusty > > --arch amd64 > > > > Creation of the LXC container will take a lot of time, it will be stored > > here: /var/lib/lxc/ubuntu > > > > Next stop the container: > > sudo lxc-stop -n ubuntu > > > > Next create a temp director, tar the rootfs and export the template: > > mkdir -p /tmp/lxc-template > > cd /tmp/lxc-template > > sudo tar --numeric-owner -czf /tmp/lxc-template/template.tar.gz > > /var/lib/lxc/ubuntu/rootfs/ > > === > > > > As per suggestion from Rohit on another thread, I saved the template file > > as .tar and register it to cloudstack with HVM disabled. I then tried to > > create an LXC container instance using the template, but after a long > > "Creating" process, the provisioning will fail with insufficient capacity > > error. > > > > === > > 2016-06-10 18:24:45,468 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > > (API-Job-Executor-44:ctx-c8a4afdc job-232) (logid:523a0c37) Complete > async > > job-232, jobStatus: FAILED, resultCode: 530, result: > > org.apache.cloudstack.api.response.ExceptionR > > esponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to start > a > > VM due to insufficient capacity"} > > === > > > > Further check on the LXC host's agent.log shows that the provisioning > > failed due to libvirt exception, which says that the configuration is > > unsupported because the system lacks NETNS support > > > > "LibvirtException: unsupported configuration: System lacks NETNS support" > > > > See excerpts of the logs below: > > > > === > > 2016-06-10 18:24:43,740 DEBUG > > [resource.wrapper.LibvirtStartCommandWrapper] > (agentRequest-Handler-1:null) > > starting i-2-42-VM: <domain type='lxc'> > > <name>i-2-42-VM</name> > > <uuid>c29a74fb-e4bc-4aa2-bef4-3c8844de87df</uuid> > > <description>Ubuntu 14.04 (64-bit)</description> > > <clock offset='utc'> > > <timer name='kvmclock' > > > </timer> > > </clock> > > <features> > > <pae/> > > <apic/> > > <acpi/> > > </features> > > <devices> > > <emulator></emulator> > > <interface type='bridge'> > > <source bridge='cloudbr0'/> > > <mac address='06:a5:1c:00:00:2a'/> > > <model type='virtio'/> > > </interface> > > <filesystem type='mount'> > > <source > > > dir='/mnt/d7678837-9f9f-32ab-99f3-b508feb3595a/6d26a879-999f-4cba-bfcc-1d2d9e70af5c'/> > > <target dir='/'/> > > </filesystem> > > <serial type='pty'> > > <target port='0'/> > > </serial> > > <console type='pty'> > > <target port='0'/> > > </console> > > </devices> > > <memory>1048576</memory> > > <devices> > > <memballoon model='none'/> > > </devices> > > <vcpu>1</vcpu> > > <os> > > <type>exe</type> > > <init>/sbin/init</init> > > </os> > > <cputune> > > <shares>1000</shares> > > </cputune> > > <cpu></cpu><on_reboot>restart</on_reboot> > > <on_poweroff>destroy</on_poweroff> > > <on_crash>destroy</on_crash> > > </domain> > > > > 2016-06-10 18:24:43,743 WARN > > [resource.wrapper.LibvirtStartCommandWrapper] > (agentRequest-Handler-1:null) > > LibvirtException > > org.libvirt.LibvirtException: unsupported configuration: System lacks > > NETNS support > > at org.libvirt.ErrorHandler.processError(Unknown Source) > > at org.libvirt.ErrorHandler.processError(Unknown Source) > > at org.libvirt.Connect.domainCreateXML(Unknown Source) > > at > > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1293) > > at > > > com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStartCommandWrapper.execute(LibvirtStartCommandWrapper.java:82) > > at > > > com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStartCommandWrapper.execute(LibvirtStartCommandWrapper.java:46) > > at > > > com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:75) > > at > > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1317) > > at com.cloud.agent.Agent.processRequest(Agent.java:522) > > at > com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:830) > > at com.cloud.utils.nio.Task.call(Task.java:83) > > at com.cloud.utils.nio.Task.call(Task.java:29) > > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > > at > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > > at > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > > at java.lang.Thread.run(Thread.java:745) > > 2016-06-10 18:24:43,744 DEBUG [kvm.storage.KVMStoragePoolManager] > > (agentRequest-Handler-1:null) Disconnecting disk > > 6d26a879-999f-4cba-bfcc-1d2d9e70af5c > > 2016-06-10 18:24:43,744 INFO [kvm.storage.LibvirtStorageAdaptor] > > (agentRequest-Handler-1:null) Trying to fetch storage pool > > d7678837-9f9f-32ab-99f3-b508feb3595a from libvirt > > 2016-06-10 18:24:43,744 DEBUG [kvm.resource.LibvirtConnection] > > (agentRequest-Handler-1:null) Looking for libvirtd connection at: lxc:/// > > 2016-06-10 18:24:43,751 DEBUG [kvm.storage.LibvirtStorageAdaptor] > > (agentRequest-Handler-1:null) Succesfully refreshed pool > > d7678837-9f9f-32ab-99f3-b508feb3595a Capacity: 483387244544 Used: > > 127107334144 Available: 356279910400 > > 2016-06-10 18:24:43,757 DEBUG [cloud.agent.Agent] > > (agentRequest-Handler-1:null) Seq 7-8790463522673787745: { Ans: , > MgmtId: > > 181122461655966, via: 7, Ver: v1, Flags: 10, > > > [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":42,"name":"i-2-42-VM","type":"User","cpus":1,"minSpeed":1000,"maxSpeed":2000,"minRam":1073741824,"maxRam":1073741824,"arch":"x86_64","os":"Ubuntu > > 14.04 (64-bit)","platformEmulator":"Ubuntu > > > 14.04","bootArgs":"","enableHA":true,"limitCpuUse":true,"enableDynamicallyScaleVm":false,"vncPassword":"hOWX3h7K6kkOpL316OApzQ","vncAddr":"192.168.3.202","params":{"memoryOvercommitRatio":"1.0","cpuOvercommitRatio":"2.0","Message.ReservedCapacityFreed.Flag":"false"},"uuid":"c29a74fb-e4bc-4aa2-bef4-3c8844de87df","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"6d26a879-999f-4cba-bfcc-1d2d9e70af5c","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"d7678837-9f9f-32ab-99f3-b508feb3595a","id":5,"poolType":"NetworkFilesystem","host":"192.168.0.242","path":"/export/cloudstack3","port":2049,"url":"NetworkFilesystem:// > > > 192.168.0.242/export/cloudstack3/?ROLE=Primary&STOREUUID=d7678837-9f9f-32ab-99f3-b508feb3595a > "}},"name":"ROOT-42","size":479057920,"path":"6d26a879-999f-4cba-bfcc-1d2d9e70af5c","volumeId":50,"vmName":"i-2-42-VM","accountId":2,"format":"DIR","provisioningType":"THIN","id":50,"deviceId":0,"cacheMode":"NONE","hypervisorType":"LXC"}},"diskSeq":0,"path":"6d26a879-999f-4cba-bfcc-1d2d9e70af5c","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"192.168.0.242","volumeSize":"479057920"}},{"data":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"id":0,"format":"ISO","accountId":0,"hvm":false}},"diskSeq":3,"type":"ISO"}],"nics":[{"deviceId":0,"networkRateMbps":100,"defaultNic":true,"pxeDisable":false,"nicUuid":"938ed009-54fa-4dd9-be7c-e5c95ab4fd27","uuid":"4b8f3aa8-21bb-4362-b695-ab4e41141227","ip":"192.168.0.192","netmask":"255.255.255.0","gateway":"192.168.0.1","mac":"06:a5:1c:00:00:2a","dns1":"8.8.8.8","dns2":"8.8.4.4","broadcastType":"Native","type":"Guest","broadcastUri":"vlan://untagged","isSecurityGroupEnabled":true}]},"result":false,"details":"unsupported > > configuration: System lacks NETNS support","wait":0}}] } > > 2016-06-10 18:24:43,935 DEBUG [cloud.agent.Agent] > > (agentRequest-Handler-2:null) Request:Seq 7-8790463522673787746: { Cmd , > > MgmtId: 181122461655966, via: 7, Ver: v1, Flags: 100011, > > > [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-42-VM","wait":0}}] > > } > > 2016-06-10 18:24:43,936 DEBUG [cloud.agent.Agent] > > (agentRequest-Handler-2:null) Processing command: > > com.cloud.agent.api.StopCommand > > 2016-06-10 18:24:43,936 DEBUG [kvm.resource.LibvirtConnection] > > (agentRequest-Handler-2:null) Looking for libvirtd connection at: > > qemu:///system > > 2016-06-10 18:24:43,937 DEBUG [kvm.resource.LibvirtConnection] > > (agentRequest-Handler-2:null) Can not find KVM connection for Instance: > > i-2-42-VM, continuing. > > 2016-06-10 18:24:43,938 DEBUG [kvm.resource.LibvirtConnection] > > (agentRequest-Handler-2:null) Looking for libvirtd connection at: lxc:/// > > 2016-06-10 18:24:43,939 DEBUG [kvm.resource.LibvirtConnection] > > (agentRequest-Handler-2:null) Can not find LXC connection for Instance: > > i-2-42-VM, continuing. > > 2016-06-10 18:24:43,939 WARN [kvm.resource.LibvirtConnection] > > (agentRequest-Handler-2:null) Can not find a connection for Instance > > i-2-42-VM. Assuming the default connection. > > 2016-06-10 18:24:43,939 DEBUG [kvm.resource.LibvirtConnection] > > (agentRequest-Handler-2:null) Looking for libvirtd connection at: lxc:/// > > 2016-06-10 18:24:43,940 DEBUG [kvm.resource.LibvirtComputingResource] > > (agentRequest-Handler-2:null) Failed to get dom xml: > > org.libvirt.LibvirtException: Domain not found: No domain with matching > > name 'i-2-42-VM' > > 2016-06-10 18:24:43,941 DEBUG [kvm.resource.LibvirtComputingResource] > > (agentRequest-Handler-2:null) Failed to get dom xml: > > org.libvirt.LibvirtException: Domain not found: No domain with matching > > name 'i-2-42-VM' > > 2016-06-10 18:24:43,941 DEBUG [kvm.resource.LibvirtComputingResource] > > (agentRequest-Handler-2:null) Try to stop the vm at first > > 2016-06-10 18:24:43,942 DEBUG [kvm.resource.LibvirtComputingResource] > > (agentRequest-Handler-2:null) VM i-2-42-VM doesn't exist, no need to > stop it > > 2016-06-10 18:24:43,943 DEBUG [cloud.agent.Agent] > > (agentRequest-Handler-2:null) Seq 7-8790463522673787746: { Ans: , > MgmtId: > > 181122461655966, via: 7, Ver: v1, Flags: 10, > > [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] } > > 2016-06-10 18:25:02,268 DEBUG [kvm.resource.LibvirtConnection] > > (UgentTask-5:null) Looking for libvirtd connection at: lxc:/// > > 2016-06-10 18:25:02,271 DEBUG [kvm.resource.LibvirtConnection] > > (UgentTask-5:null) Looking for libvirtd connection at: qemu:///system > > === > > > > I checked and the system indeed supports namespace as per below result: > > > > === > > root@sc-test-kvm-04:/var/log/cloudstack/agent# ip netns show > > blue > > === > > > > Any pointers on how we can resolve the problem? > > > > Looking forward to your reply, thank you. > > > > Cheers. > > > > -ip- > > > > >
