RE: Cold VM migration across datacenters
Hi Vladimir I would like to mention we have had issues with master-master-master galara replication for the database, locks are not replicated. We had to make sure all CS management servers are using the same master server at the same time. A proxy and a vip works fine. Was just a little gotcha for us. Adam -Original Message- From: Vladimir Dombrovski Sent: 21 July 2021 16:09 To: users@cloudstack.apache.org Subject: Re: Cold VM migration across datacenters ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello Andrija, Thank you for the swift response. You did correctly understand our setup, which is aimed towards disaster recovery (DRP), rather than business continuity (BCP). From a strictly technical point of view, we know that running a unique cluster is the only way to migrate compute resources between our datacenters when using KVM. Our Ceph storage is indeed running as a stretch cluster, and is provisioned with a CRUSH map that allows for the loss of a datacenter. We have currently tested the 4.15 release of Cloudstack, which doesn't yet integrate the changes you've described in (1). However, due to the fact that the latency between our datacenters is quite low (~2ms), we could allow less isolation between entities. What we are however looking into, is to ensure that in our configuration, any and all resources are pointed towards the correct local endpoint. To be more specific, these endpoints include: - The address of the manager, which we could technically move to a VIP, as our hosts are plugged on the same subnet. From there, as we have master-master MySQL replication setup, the agents on the DR site should reconnect with the backup manager without much issue (we are still testing this hypothesis). - The address of our primary storage, with which we're struggling. Technically we have a Ceph endpoint on each site, and we would like to keep it that way. This implies that we add multiple addresses for the same storage. This is possible in libvird as you can define multiple tags in the declaration XML. We haven't found a way to do the same via Cloudstack - The address of our secondary storage, which is in our case NFS and is simply plugged into Ceph using a different pool. All this being said, I believe that we would eventually brute-force our way into a working setup, that would look similar to the solution (2) you've described. We are still looking for ways to do this more elegantly so we would be glad to hear any more ideas. As a side note, are the DB hacks you have mentioned simple IP replacements? Or are there deeper modifications to be made? Vladimir On 2021/07/21 13:48:29, Andrija Panic wrote: > Migration between zones is NOT possible in any shape or form, so this > is a route you should, IMO, abandon (you can always export VMs in this > way or another, but this is not feasible in production) > > I understand you have 2 DCs and you want VMs to, eventually, become > alive in 2nd DC, if the plane crashes on 1st DC? (well, your data is > there, unless CEPH is stretched/distributed across 2 DCs and could > survive the whole DC1 going down) > > If you are insisting on that HA level - then you could do it in 2 > ways, that cross my mind right now. > (CEPH as distributed storage, zone wide, some nodes DC1, some DC2 - > make sure your CEPH setup survives whole DC going down (this requires > that CRUSH maps correctly configured etc) > > > (1) DC1 = Pod1 (1/2/3) and DC2 = Pod2 (or Pod 4/5/6 etc) - i.e. multiple > Pods per DC - they all will be using zone-wide Ceph storage - your VMs > are on your storage, that is the crucial part to not lose data. > -- you can't really migrate VMs between Pods, only within cluster (and > in some cases between clusters in the same Pod, staring from 4.16) > -- this is OK if you have not-low-enough-latency between DC1 and DC2 > (but then CEPH will also suffer from that higher latency) > > (2) A very untipical, not recommends, but technically possible setup - > DC1+DC2 = one large DC = 1 POD = 1 cluster (or more clusters if > DC1+needed) - > still using CEPH as before > -- requires ultra-low latency between DC1 and DC2 - and if plane > crashes on > DC1 (taking this example, as I've been to some Zurich DCs next to the > airport...) - you can still start VM on hosts in DC2 in case it was a > single cluster. In case you had multiple clusters - then it get's more > complicated (minor DB hacks) etc. > > In both cases you still have to sort out Secondary Storage NFS HA > > In general, you can't achieve what you want that easy nor you should > be stretching the possibilities (that I just explained, as I would, > probably, never use them in production) > > I guess I didn't help - but there you go. > > Andrija > > > > On Tue, 20 Jul 2021 at 16:28, Vladimir Dombrovski < > vladimir.dombrov...@bso.co> wrote: > > > Hello, > > > > We're trying to dra
RE: VM console keeps pausing to the point of being unusable
Hi Andrija, No there is no improvement with the console proxy and the instance being on the same host. It even affects the console of the console proxy itself. Thanks Ada, -Original Message- From: Andrija Panic Sent: 28 June 2021 17:05 To: users Subject: Re: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** my bad, wrongly understood you are using no-VNC. Try migrating the target VM and the SSVM to the same host, and try again then - is there any improvement? Best, On Mon, 28 Jun 2021 at 17:58, Adam Witwicki wrote: > > I don’t have that option in CS version 4.13.1.0, This is the old VNC > way is it not? > > Thanks > > Adam > > -Original Message- > From: Andrija Panic > Sent: 28 June 2021 16:55 > To: users > Subject: Re: VM console keeps pausing to the point of being unusable > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Did you try switching back to VNC-based access - i.e. modify the > global setting novnc.console.default=false and see if the old VNC way works > fine. > > Best, > > On Mon, 28 Jun 2021 at 17:49, Adam Witwicki > wrote: > > > Hi Andrija > > > > Yes, no issues accessing the VNC port directly on the KVM server. > > > > Thanks > > > > Adam > > > > > > -Original Message- > > From: Andrija Panic > > Sent: 28 June 2021 16:48 > > To: users > > Subject: Re: VM console keeps pausing to the point of being unusable > > > > ** This mail originated from OUTSIDE the Oakford corporate network. > > Treat hyperlinks and attachments in this email with caution. ** > > > > Adam, > > > > " > > Adam, > > > > did you try accessing the VM console via standalone VNC viewer, > > based on the way Rohit explained - dump the XML of the VM, check > > the IP/port and password details - and use those to access > > and see if that connections is established quick > enough. > > > > Best, > > " > > > > Best, > > > > On Mon, 28 Jun 2021 at 11:32, Adam Witwicki > > > > wrote: > > > > > Am I able to get some help with this? > > > > > > Cloudstack really is unusable > > > Is it related to the speed issues with SSL? > > > > > > Thanks > > > > > > Adam > > > > > > > > > -Original Message- > > > From: Adam Witwicki > > > Sent: 07 June 2021 14:08 > > > To: users@cloudstack.apache.org > > > Subject: RE: VM console keeps pausing to the point of being > > > unusable > > > > > > Forgive me if I am wrong > > > > > > But this is where the exception lies > > > https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d4 > > > 7b > > > 9a > > > 403cb88bab99/services/console-proxy/server/src/main/java/com/cloud > > > /c > > > on > > > soleproxy/vnc/VncClientPacketSender.java#L42 > > > private final BlockingQueue queue = new > > > ArrayBlockingQueue(30); > > > > > > I guess I need to understand why objects are not leaving the queue? > > > > > > > > > Thanks > > > > > > Adam > > > > > > > > > -Original Message- > > > From: Adam Witwicki > > > Sent: 07 June 2021 11:49 > > > To: users@cloudstack.apache.org > > > Subject: RE: VM console keeps pausing to the point of being > > > unusable > > > > > > ** This mail originated from OUTSIDE the Oakford corporate network. > > > Treat hyperlinks and attachments in this email with caution. ** > > > > > > Rohit, sorry the long delay > > > > > > Yes all servers and VMs are in time sync. > > > It does seem to be an issue with the console proxy, no attempt of > > > increasing its resources is improving the situation. > > > What else can we try? > > > > > > Thanks > > > > > > Adam > > > > > > > > > -Original Message- > > > From: Rohit Yadav > > > Sent: 05 May 2021 09:21 > > > To: users@cloudstack.apache.org > > > Subject: Re: VM console keeps pausing to the point of being > > > unusable > > > > > > ** This mail originated from OUTSIDE the Oakford corporate network. > > > Treat
RE: VM console keeps pausing to the point of being unusable
I don’t have that option in CS version 4.13.1.0, This is the old VNC way is it not? Thanks Adam -Original Message- From: Andrija Panic Sent: 28 June 2021 16:55 To: users Subject: Re: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Did you try switching back to VNC-based access - i.e. modify the global setting novnc.console.default=false and see if the old VNC way works fine. Best, On Mon, 28 Jun 2021 at 17:49, Adam Witwicki wrote: > Hi Andrija > > Yes, no issues accessing the VNC port directly on the KVM server. > > Thanks > > Adam > > > -Original Message- > From: Andrija Panic > Sent: 28 June 2021 16:48 > To: users > Subject: Re: VM console keeps pausing to the point of being unusable > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Adam, > > " > Adam, > > did you try accessing the VM console via standalone VNC viewer, based > on the way Rohit explained - dump the XML of the VM, check the > IP/port and password details - and use those to access > and see if that connections is established quick enough. > > Best, > " > > Best, > > On Mon, 28 Jun 2021 at 11:32, Adam Witwicki > wrote: > > > Am I able to get some help with this? > > > > Cloudstack really is unusable > > Is it related to the speed issues with SSL? > > > > Thanks > > > > Adam > > > > > > -Original Message- > > From: Adam Witwicki > > Sent: 07 June 2021 14:08 > > To: users@cloudstack.apache.org > > Subject: RE: VM console keeps pausing to the point of being unusable > > > > Forgive me if I am wrong > > > > But this is where the exception lies > > https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d47b > > 9a > > 403cb88bab99/services/console-proxy/server/src/main/java/com/cloud/c > > on > > soleproxy/vnc/VncClientPacketSender.java#L42 > > private final BlockingQueue queue = new > > ArrayBlockingQueue(30); > > > > I guess I need to understand why objects are not leaving the queue? > > > > > > Thanks > > > > Adam > > > > > > -Original Message- > > From: Adam Witwicki > > Sent: 07 June 2021 11:49 > > To: users@cloudstack.apache.org > > Subject: RE: VM console keeps pausing to the point of being unusable > > > > ** This mail originated from OUTSIDE the Oakford corporate network. > > Treat hyperlinks and attachments in this email with caution. ** > > > > Rohit, sorry the long delay > > > > Yes all servers and VMs are in time sync. > > It does seem to be an issue with the console proxy, no attempt of > > increasing its resources is improving the situation. > > What else can we try? > > > > Thanks > > > > Adam > > > > > > -Original Message- > > From: Rohit Yadav > > Sent: 05 May 2021 09:21 > > To: users@cloudstack.apache.org > > Subject: Re: VM console keeps pausing to the point of being unusable > > > > ** This mail originated from OUTSIDE the Oakford corporate network. > > Treat hyperlinks and attachments in this email with caution. ** > > > > Hi Adam - can you check and sync time on your KVM hosts, management > > servers and CPVM using ntp? This is because SSL-enabled connection > > are time sensitive. > > In order to test VNC directly, you can ssh into the host and do > > something > > like: > > > > # virsh list # find the VM > > > > Then run dumpxml and grab the IP/port and password, for example: > > > > # virsh dumpxml --security-info s-180-VM | grep vnc > > > passwd='_u6LayCdnCrr_JuUwCrq2A'> > > > > > > If you're on the management network, you can use any VNC client and > > details you find to connect to the VNC directly. I often connect > > virt-manager (UI) to a KVM host over SSH and use the console > > directly (the only trick is to grab the password, by clicking the > > information tab -> go to VNC -> click on show password -> copy and > > use it to see > console). > > > > > > Regards. > > > > > > From: David Jumani > > Sent: Wednesday, May 5, 2021 10:32 > > To: users@cloudstack.apache.org > > Subject: Re: VM console keeps pausing to the point of being unusable > > > > I a
RE: VM console keeps pausing to the point of being unusable
Hi Andrija Yes, no issues accessing the VNC port directly on the KVM server. Thanks Adam -Original Message- From: Andrija Panic Sent: 28 June 2021 16:48 To: users Subject: Re: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Adam, " Adam, did you try accessing the VM console via standalone VNC viewer, based on the way Rohit explained - dump the XML of the VM, check the IP/port and password details - and use those to access and see if that connections is established quick enough. Best, " Best, On Mon, 28 Jun 2021 at 11:32, Adam Witwicki wrote: > Am I able to get some help with this? > > Cloudstack really is unusable > Is it related to the speed issues with SSL? > > Thanks > > Adam > > > -Original Message- > From: Adam Witwicki > Sent: 07 June 2021 14:08 > To: users@cloudstack.apache.org > Subject: RE: VM console keeps pausing to the point of being unusable > > Forgive me if I am wrong > > But this is where the exception lies > https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d47b9a > 403cb88bab99/services/console-proxy/server/src/main/java/com/cloud/con > soleproxy/vnc/VncClientPacketSender.java#L42 > private final BlockingQueue queue = new > ArrayBlockingQueue(30); > > I guess I need to understand why objects are not leaving the queue? > > > Thanks > > Adam > > > -Original Message- > From: Adam Witwicki > Sent: 07 June 2021 11:49 > To: users@cloudstack.apache.org > Subject: RE: VM console keeps pausing to the point of being unusable > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Rohit, sorry the long delay > > Yes all servers and VMs are in time sync. > It does seem to be an issue with the console proxy, no attempt of > increasing its resources is improving the situation. > What else can we try? > > Thanks > > Adam > > > -Original Message- > From: Rohit Yadav > Sent: 05 May 2021 09:21 > To: users@cloudstack.apache.org > Subject: Re: VM console keeps pausing to the point of being unusable > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam - can you check and sync time on your KVM hosts, management > servers and CPVM using ntp? This is because SSL-enabled connection are > time sensitive. > In order to test VNC directly, you can ssh into the host and do > something > like: > > # virsh list # find the VM > > Then run dumpxml and grab the IP/port and password, for example: > > # virsh dumpxml --security-info s-180-VM | grep vnc > passwd='_u6LayCdnCrr_JuUwCrq2A'> > > > If you're on the management network, you can use any VNC client and > details you find to connect to the VNC directly. I often connect > virt-manager (UI) to a KVM host over SSH and use the console directly > (the only trick is to grab the password, by clicking the information > tab -> go to VNC -> click on show password -> copy and use it to see console). > > > Regards. > > > From: David Jumani > Sent: Wednesday, May 5, 2021 10:32 > To: users@cloudstack.apache.org > Subject: Re: VM console keeps pausing to the point of being unusable > > I agree, try checking the number of concurrent connections as well as > increasing the CPVM capacity. > Also check the network for any glitches / lag between the CPVM and the > KVM hosts > From: Hean Seng > Sent: Tuesday, May 4, 2021 4:03 PM > To: users@cloudstack.apache.org > Subject: Re: VM console keeps pausing to the point of being unusable > > Do you know how many concurrent access to VNC from your user ? > > Or you want to increase the Console Proxy Capacity? > > Also, please make sure the console proxy Ip/Network is up when you > having issue on it. > > > > > On Tue, May 4, 2021 at 5:43 PM Adam Witwicki > wrote: > > > This bug is making cloudstack completely unusable > > > > Is there a way to test VNC directly on KVM? > > > > Thanks > > > > Adam > > > > > > -Original Message- > > From: Adam Witwicki > > Sent: 29 April 2021 14:04 > > To: 'users@cloudstack.apache.org' > > Subject: RE: VM console keeps pausing to the point of being unusable > > > > It didn't go away forever, and now the same issue is back Same logs > > as before h
RE: VM console keeps pausing to the point of being unusable
Am I able to get some help with this? Cloudstack really is unusable Is it related to the speed issues with SSL? Thanks Adam -Original Message- From: Adam Witwicki Sent: 07 June 2021 14:08 To: users@cloudstack.apache.org Subject: RE: VM console keeps pausing to the point of being unusable Forgive me if I am wrong But this is where the exception lies https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d47b9a403cb88bab99/services/console-proxy/server/src/main/java/com/cloud/consoleproxy/vnc/VncClientPacketSender.java#L42 private final BlockingQueue queue = new ArrayBlockingQueue(30); I guess I need to understand why objects are not leaving the queue? Thanks Adam -Original Message- From: Adam Witwicki Sent: 07 June 2021 11:49 To: users@cloudstack.apache.org Subject: RE: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Rohit, sorry the long delay Yes all servers and VMs are in time sync. It does seem to be an issue with the console proxy, no attempt of increasing its resources is improving the situation. What else can we try? Thanks Adam -Original Message- From: Rohit Yadav Sent: 05 May 2021 09:21 To: users@cloudstack.apache.org Subject: Re: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam - can you check and sync time on your KVM hosts, management servers and CPVM using ntp? This is because SSL-enabled connection are time sensitive. In order to test VNC directly, you can ssh into the host and do something like: # virsh list # find the VM Then run dumpxml and grab the IP/port and password, for example: # virsh dumpxml --security-info s-180-VM | grep vnc If you're on the management network, you can use any VNC client and details you find to connect to the VNC directly. I often connect virt-manager (UI) to a KVM host over SSH and use the console directly (the only trick is to grab the password, by clicking the information tab -> go to VNC -> click on show password -> copy and use it to see console). Regards. From: David Jumani Sent: Wednesday, May 5, 2021 10:32 To: users@cloudstack.apache.org Subject: Re: VM console keeps pausing to the point of being unusable I agree, try checking the number of concurrent connections as well as increasing the CPVM capacity. Also check the network for any glitches / lag between the CPVM and the KVM hosts From: Hean Seng Sent: Tuesday, May 4, 2021 4:03 PM To: users@cloudstack.apache.org Subject: Re: VM console keeps pausing to the point of being unusable Do you know how many concurrent access to VNC from your user ? Or you want to increase the Console Proxy Capacity? Also, please make sure the console proxy Ip/Network is up when you having issue on it. On Tue, May 4, 2021 at 5:43 PM Adam Witwicki wrote: > This bug is making cloudstack completely unusable > > Is there a way to test VNC directly on KVM? > > Thanks > > Adam > > > -Original Message- > From: Adam Witwicki > Sent: 29 April 2021 14:04 > To: 'users@cloudstack.apache.org' > Subject: RE: VM console keeps pausing to the point of being unusable > > It didn't go away forever, and now the same issue is back Same logs as > before https://pastebin.com/YS6XCy6y > > Adam > -Original Message- > From: Adam Witwicki > Sent: 27 April 2021 07:30 > To: users@cloudstack.apache.org > Subject: RE: VM console keeps pausing to the point of being unusable > > Hi Nicolas, > > It was persisting over console systemVM destroy and creation, and any > instance over 3 KVM hosts. > Annoying we did not see the error in the console VM logs yesterday and > users are reporting the console is currently working ok. > > Kind Regards > > Adam > > -Original Message- > From: Nicolas Vazquez > Sent: 26 April 2021 21:26 > To: users@cloudstack.apache.org > Subject: Re: VM console keeps pausing to the point of being unusable > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam, > > That's an error I've never hit before, does the issue persist after > destroying and recreating the console proxy VM? > > Regards, > Nicolas Vazquez > > From: Adam Witwicki > Sent: Thursday, April 22, 2021 7:17 AM > To: users@cloudstack.apache.org > Subject: RE: VM console keeps pausing to the point of being unusable > > Paste is now working! > > Thanks > >
RE: VM console keeps pausing to the point of being unusable
Forgive me if I am wrong But this is where the exception lies https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d47b9a403cb88bab99/services/console-proxy/server/src/main/java/com/cloud/consoleproxy/vnc/VncClientPacketSender.java#L42 private final BlockingQueue queue = new ArrayBlockingQueue(30); I guess I need to understand why objects are not leaving the queue? Thanks Adam -Original Message- From: Adam Witwicki Sent: 07 June 2021 11:49 To: users@cloudstack.apache.org Subject: RE: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Rohit, sorry the long delay Yes all servers and VMs are in time sync. It does seem to be an issue with the console proxy, no attempt of increasing its resources is improving the situation. What else can we try? Thanks Adam -Original Message- From: Rohit Yadav Sent: 05 May 2021 09:21 To: users@cloudstack.apache.org Subject: Re: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam - can you check and sync time on your KVM hosts, management servers and CPVM using ntp? This is because SSL-enabled connection are time sensitive. In order to test VNC directly, you can ssh into the host and do something like: # virsh list # find the VM Then run dumpxml and grab the IP/port and password, for example: # virsh dumpxml --security-info s-180-VM | grep vnc If you're on the management network, you can use any VNC client and details you find to connect to the VNC directly. I often connect virt-manager (UI) to a KVM host over SSH and use the console directly (the only trick is to grab the password, by clicking the information tab -> go to VNC -> click on show password -> copy and use it to see console). Regards. From: David Jumani Sent: Wednesday, May 5, 2021 10:32 To: users@cloudstack.apache.org Subject: Re: VM console keeps pausing to the point of being unusable I agree, try checking the number of concurrent connections as well as increasing the CPVM capacity. Also check the network for any glitches / lag between the CPVM and the KVM hosts From: Hean Seng Sent: Tuesday, May 4, 2021 4:03 PM To: users@cloudstack.apache.org Subject: Re: VM console keeps pausing to the point of being unusable Do you know how many concurrent access to VNC from your user ? Or you want to increase the Console Proxy Capacity? Also, please make sure the console proxy Ip/Network is up when you having issue on it. On Tue, May 4, 2021 at 5:43 PM Adam Witwicki wrote: > This bug is making cloudstack completely unusable > > Is there a way to test VNC directly on KVM? > > Thanks > > Adam > > > -Original Message- > From: Adam Witwicki > Sent: 29 April 2021 14:04 > To: 'users@cloudstack.apache.org' > Subject: RE: VM console keeps pausing to the point of being unusable > > It didn't go away forever, and now the same issue is back Same logs as > before https://pastebin.com/YS6XCy6y > > Adam > -Original Message- > From: Adam Witwicki > Sent: 27 April 2021 07:30 > To: users@cloudstack.apache.org > Subject: RE: VM console keeps pausing to the point of being unusable > > Hi Nicolas, > > It was persisting over console systemVM destroy and creation, and any > instance over 3 KVM hosts. > Annoying we did not see the error in the console VM logs yesterday and > users are reporting the console is currently working ok. > > Kind Regards > > Adam > > -Original Message- > From: Nicolas Vazquez > Sent: 26 April 2021 21:26 > To: users@cloudstack.apache.org > Subject: Re: VM console keeps pausing to the point of being unusable > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam, > > That's an error I've never hit before, does the issue persist after > destroying and recreating the console proxy VM? > > Regards, > Nicolas Vazquez > > From: Adam Witwicki > Sent: Thursday, April 22, 2021 7:17 AM > To: users@cloudstack.apache.org > Subject: RE: VM console keeps pausing to the point of being unusable > > Paste is now working! > > Thanks > > Adam > > nicolas.vazq...@shapeblue.com > www.shapeblue.com<http://www.shapeblue.com> > 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK > @shapeblue > > > > > -Original Message- > From: Adam Witwicki > Sent: 22 April 2021 09:18 > To:
RE: VM console keeps pausing to the point of being unusable
Rohit, sorry the long delay Yes all servers and VMs are in time sync. It does seem to be an issue with the console proxy, no attempt of increasing its resources is improving the situation. What else can we try? Thanks Adam -Original Message- From: Rohit Yadav Sent: 05 May 2021 09:21 To: users@cloudstack.apache.org Subject: Re: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam - can you check and sync time on your KVM hosts, management servers and CPVM using ntp? This is because SSL-enabled connection are time sensitive. In order to test VNC directly, you can ssh into the host and do something like: # virsh list # find the VM Then run dumpxml and grab the IP/port and password, for example: # virsh dumpxml --security-info s-180-VM | grep vnc If you're on the management network, you can use any VNC client and details you find to connect to the VNC directly. I often connect virt-manager (UI) to a KVM host over SSH and use the console directly (the only trick is to grab the password, by clicking the information tab -> go to VNC -> click on show password -> copy and use it to see console). Regards. From: David Jumani Sent: Wednesday, May 5, 2021 10:32 To: users@cloudstack.apache.org Subject: Re: VM console keeps pausing to the point of being unusable I agree, try checking the number of concurrent connections as well as increasing the CPVM capacity. Also check the network for any glitches / lag between the CPVM and the KVM hosts From: Hean Seng Sent: Tuesday, May 4, 2021 4:03 PM To: users@cloudstack.apache.org Subject: Re: VM console keeps pausing to the point of being unusable Do you know how many concurrent access to VNC from your user ? Or you want to increase the Console Proxy Capacity? Also, please make sure the console proxy Ip/Network is up when you having issue on it. On Tue, May 4, 2021 at 5:43 PM Adam Witwicki wrote: > This bug is making cloudstack completely unusable > > Is there a way to test VNC directly on KVM? > > Thanks > > Adam > > > -Original Message- > From: Adam Witwicki > Sent: 29 April 2021 14:04 > To: 'users@cloudstack.apache.org' > Subject: RE: VM console keeps pausing to the point of being unusable > > It didn't go away forever, and now the same issue is back Same logs as > before https://pastebin.com/YS6XCy6y > > Adam > -Original Message- > From: Adam Witwicki > Sent: 27 April 2021 07:30 > To: users@cloudstack.apache.org > Subject: RE: VM console keeps pausing to the point of being unusable > > Hi Nicolas, > > It was persisting over console systemVM destroy and creation, and any > instance over 3 KVM hosts. > Annoying we did not see the error in the console VM logs yesterday and > users are reporting the console is currently working ok. > > Kind Regards > > Adam > > -Original Message- > From: Nicolas Vazquez > Sent: 26 April 2021 21:26 > To: users@cloudstack.apache.org > Subject: Re: VM console keeps pausing to the point of being unusable > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam, > > That's an error I've never hit before, does the issue persist after > destroying and recreating the console proxy VM? > > Regards, > Nicolas Vazquez > > From: Adam Witwicki > Sent: Thursday, April 22, 2021 7:17 AM > To: users@cloudstack.apache.org > Subject: RE: VM console keeps pausing to the point of being unusable > > Paste is now working! > > Thanks > > Adam > > nicolas.vazq...@shapeblue.com > www.shapeblue.com<http://www.shapeblue.com> > 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK > @shapeblue > > > > > -Original Message- > From: Adam Witwicki > Sent: 22 April 2021 09:18 > To: users@cloudstack.apache.org > Subject: VM console keeps pausing to the point of being unusable > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hello, > > We have an annoying issue, when using the cloudstack console to access > a running instance the viewer will keep pausing every 10 to 15 mins, > then its fine for a bit. > I have found the cloud.log from the console proxy which is showing > java exceptions queue full, could this be related? > > https://pastebin.com/YS6XCy6y > > CS version 4.13.1.0 > > Any help appreciated > > Thanks > > A
RE: VM console keeps pausing to the point of being unusable
This bug is making cloudstack completely unusable Is there a way to test VNC directly on KVM? Thanks Adam -Original Message- From: Adam Witwicki Sent: 29 April 2021 14:04 To: 'users@cloudstack.apache.org' Subject: RE: VM console keeps pausing to the point of being unusable It didn’t go away forever, and now the same issue is back Same logs as before https://pastebin.com/YS6XCy6y Adam -Original Message----- From: Adam Witwicki Sent: 27 April 2021 07:30 To: users@cloudstack.apache.org Subject: RE: VM console keeps pausing to the point of being unusable Hi Nicolas, It was persisting over console systemVM destroy and creation, and any instance over 3 KVM hosts. Annoying we did not see the error in the console VM logs yesterday and users are reporting the console is currently working ok. Kind Regards Adam -Original Message- From: Nicolas Vazquez Sent: 26 April 2021 21:26 To: users@cloudstack.apache.org Subject: Re: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, That's an error I've never hit before, does the issue persist after destroying and recreating the console proxy VM? Regards, Nicolas Vazquez ____ From: Adam Witwicki Sent: Thursday, April 22, 2021 7:17 AM To: users@cloudstack.apache.org Subject: RE: VM console keeps pausing to the point of being unusable Paste is now working! Thanks Adam nicolas.vazq...@shapeblue.com www.shapeblue.com 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK @shapeblue -Original Message- From: Adam Witwicki Sent: 22 April 2021 09:18 To: users@cloudstack.apache.org Subject: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello, We have an annoying issue, when using the cloudstack console to access a running instance the viewer will keep pausing every 10 to 15 mins, then its fine for a bit. I have found the cloud.log from the console proxy which is showing java exceptions queue full, could this be related? https://pastebin.com/YS6XCy6y CS version 4.13.1.0 Any help appreciated Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and des
RE: VM console keeps pausing to the point of being unusable
It didn’t go away forever, and now the same issue is back Same logs as before https://pastebin.com/YS6XCy6y Adam -Original Message- From: Adam Witwicki Sent: 27 April 2021 07:30 To: users@cloudstack.apache.org Subject: RE: VM console keeps pausing to the point of being unusable Hi Nicolas, It was persisting over console systemVM destroy and creation, and any instance over 3 KVM hosts. Annoying we did not see the error in the console VM logs yesterday and users are reporting the console is currently working ok. Kind Regards Adam -Original Message- From: Nicolas Vazquez Sent: 26 April 2021 21:26 To: users@cloudstack.apache.org Subject: Re: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, That's an error I've never hit before, does the issue persist after destroying and recreating the console proxy VM? Regards, Nicolas Vazquez ____ From: Adam Witwicki Sent: Thursday, April 22, 2021 7:17 AM To: users@cloudstack.apache.org Subject: RE: VM console keeps pausing to the point of being unusable Paste is now working! Thanks Adam nicolas.vazq...@shapeblue.com www.shapeblue.com 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK @shapeblue -Original Message----- From: Adam Witwicki Sent: 22 April 2021 09:18 To: users@cloudstack.apache.org Subject: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello, We have an annoying issue, when using the cloudstack console to access a running instance the viewer will keep pausing every 10 to 15 mins, then its fine for a bit. I have found the cloud.log from the console proxy which is showing java exceptions queue full, could this be related? https://pastebin.com/YS6XCy6y CS version 4.13.1.0 Any help appreciated Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before
RE: VM console keeps pausing to the point of being unusable
Hi Andrija, Sorry for not being clear, the pastebin link was held for moderation for a few hours, that link now works. We have not moved to 4.15 nor NoVNC, does anyone know if this is supported by hostbill? Kind Regards Adam -Original Message- From: Andrija Panic Sent: 26 April 2021 21:58 To: users Subject: Re: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Adam, you are agan talking to yourself, and that is not healthy ;) Joke aside, since "paste is now working" - that means you moved to noVNC, that means you upgraded to 4.14.0.0 at least, right? Share some feedback, so we can help. Cheers On Mon, 26 Apr 2021 at 22:27, Nicolas Vazquez wrote: > Hi Adam, > > That's an error I've never hit before, does the issue persist after > destroying and recreating the console proxy VM? > > Regards, > Nicolas Vazquez > ____ > From: Adam Witwicki > Sent: Thursday, April 22, 2021 7:17 AM > To: users@cloudstack.apache.org > Subject: RE: VM console keeps pausing to the point of being unusable > > Paste is now working! > > Thanks > > Adam > > nicolas.vazq...@shapeblue.com > www.shapeblue.com > 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK > @shapeblue > > > > > -Original Message- > From: Adam Witwicki > Sent: 22 April 2021 09:18 > To: users@cloudstack.apache.org > Subject: VM console keeps pausing to the point of being unusable > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hello, > > We have an annoying issue, when using the cloudstack console to access > a running instance the viewer will keep pausing every 10 to 15 mins, > then its fine for a bit. > I have found the cloud.log from the console proxy which is showing > java exceptions queue full, could this be related? > > https://pastebin.com/YS6XCy6y > > CS version 4.13.1.0 > > Any help appreciated > > Thanks > > Adam > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, The Manor House, > Potterne, Wiltshire. SN10 5PN. > Registered in England and Wales No. 5971519 > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, The Manor House, > Potterne, Wiltshire. SN10 5PN. > Registered in England and Wales No. 5971519 > > -- Andrija Panić Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they
RE: VM console keeps pausing to the point of being unusable
Hi Nicolas, It was persisting over console systemVM destroy and creation, and any instance over 3 KVM hosts. Annoying we did not see the error in the console VM logs yesterday and users are reporting the console is currently working ok. Kind Regards Adam -Original Message- From: Nicolas Vazquez Sent: 26 April 2021 21:26 To: users@cloudstack.apache.org Subject: Re: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, That's an error I've never hit before, does the issue persist after destroying and recreating the console proxy VM? Regards, Nicolas Vazquez ____ From: Adam Witwicki Sent: Thursday, April 22, 2021 7:17 AM To: users@cloudstack.apache.org Subject: RE: VM console keeps pausing to the point of being unusable Paste is now working! Thanks Adam nicolas.vazq...@shapeblue.com www.shapeblue.com 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK @shapeblue -Original Message----- From: Adam Witwicki Sent: 22 April 2021 09:18 To: users@cloudstack.apache.org Subject: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello, We have an annoying issue, when using the cloudstack console to access a running instance the viewer will keep pausing every 10 to 15 mins, then its fine for a bit. I have found the cloud.log from the console proxy which is showing java exceptions queue full, could this be related? https://pastebin.com/YS6XCy6y CS version 4.13.1.0 Any help appreciated Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: VM console keeps pausing to the point of being unusable
Paste is now working! Thanks Adam -Original Message- From: Adam Witwicki Sent: 22 April 2021 09:18 To: users@cloudstack.apache.org Subject: VM console keeps pausing to the point of being unusable ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello, We have an annoying issue, when using the cloudstack console to access a running instance the viewer will keep pausing every 10 to 15 mins, then its fine for a bit. I have found the cloud.log from the console proxy which is showing java exceptions queue full, could this be related? https://pastebin.com/YS6XCy6y CS version 4.13.1.0 Any help appreciated Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
VM console keeps pausing to the point of being unusable
Hello, We have an annoying issue, when using the cloudstack console to access a running instance the viewer will keep pausing every 10 to 15 mins, then its fine for a bit. I have found the cloud.log from the console proxy which is showing java exceptions queue full, could this be related? https://pastebin.com/YS6XCy6y CS version 4.13.1.0 Any help appreciated Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
Centos EVPN bug
Hi Guys, I know some of us are using EVPN and I think we are all doing it in slightly different ways. We are using IPV4 addresses on the loopback interface advertising via 2 link-local IPv6 to a spine switch We added a new KVM node and after what we now know is around 4 hours bgp routes in FRR start to be rejected B>r 10.10.216.20/32 [20/0] via fe80::aa2b:b5ff:feb5:20b3, enp113s0f0, 3d10h19m rvia fe80::aa2b:b5ff:feb5:2a59, enp113s0f1, 3d10h19m B>* 10.10.216.21/32 [20/0] via fe80::aa2b:b5ff:feb5:20b3, enp113s0f0, 01w4d22h *via fe80::aa2b:b5ff:feb5:2a59, enp113s0f1, 01w4d22h B>r 10.10.216.22/32 [20/0] via fe80::aa2b:b5ff:feb5:20b3, enp113s0f0, 19:24:51 rvia fe80::aa2b:b5ff:feb5:2a59, enp113s0f1, 19:24:51 B>* 10.10.216.30/32 [20/0] via fe80::aa2b:b5ff:feb5:20b3, enp113s0f0, 01w4d22h *via fe80::aa2b:b5ff:feb5:2a59, enp113s0f1, 01w4d22h B>r 10.10.216.31/32 [20/0] via fe80::aa2b:b5ff:feb5:20b3, enp113s0f0, 5d13h03m rvia fe80::aa2b:b5ff:feb5:2a59, enp113s0f1, 5d13h03m B>r 10.10.216.32/32 [20/0] via fe80::aa2b:b5ff:feb5:20b3, enp113s0f0, 2d21h0 It turns out there seems to be an incompatibility issue between the kernel and FRR versions. We rolled back the kernel of this node and now it's working as intended. Bugged kernel - 3.10.0-1160.2.2.el7 Working kernel - 3.10.0-1127.19.1.el7 FRR version 7.2-01 At some point I will setup a test system to replicate and let the relevant communities know. I thought to raise it here for visibility in case other people are struggling with a similar issue. Thanks Adam Witwicki Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: reserved CPU?
That setting seems fine, I can start an instance. I cannot start a system VM due to reserved capacity? Thanks Adam -Original Message- From: Alireza Eskandari Sent: 22 December 2020 11:33 To: users@cloudstack.apache.org Subject: Re: reserved CPU? ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi, From "Home > Infrastructure > Clusters > your_cluster" click on "Settings" tab. In search bar type "cpu" and you will see a list of variables that controls CPU usage and allocation in your cluster. You can "increase cpu.overprovisioning.factor" or change "cluster.cpu.allocated.capacity.disablethreshold" Regards On Tue, Dec 22, 2020 at 12:39 PM Adam Witwicki wrote: > Hello > > I am unable to start any routers due to this error > > Host does not have enough reserved CPU available, cannot allocate to > this host. > > I cannot find any setting to adjust the reserved CPU for a host - > these have plenty > > Can someone point me in the right direction please > > CS 4.13.1.0 - KVM hosts > > > Adam > > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, The Manor House, > Potterne, Wiltshire. SN10 5PN. > Registered in England and Wales No. 5971519 > > Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
reserved CPU?
Hello I am unable to start any routers due to this error Host does not have enough reserved CPU available, cannot allocate to this host. I cannot find any setting to adjust the reserved CPU for a host - these have plenty Can someone point me in the right direction please CS 4.13.1.0 - KVM hosts Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: Local-link address change issue
Hi Robert I think you may need to restart your agents - the new value should be written to /etc/cloudstack/agent/agent.properties control.cidr= Thanks Adam -Original Message- From: Robert Ward Sent: 24 August 2020 04:22 To: users@cloudstack.apache.org Subject: Local-link address change issue ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello all, I am attempting to change the KVM System VM's local-link address and am not having much success. I have changed the global setting: control.cidr (CS 4.14.0) to both 10.254.0.0/16 and 172.31.0.0/16, restarted the MS, destroyed and re-created the VM's but I am still stuck in the 169.254.0.0/16 subnet. Not seeing anything in the logs that would indicate an issue. Can anyone suggest where I might be going wrong here? Thanks, Robert Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
Cant add additional management servers with multiple IPs
Hi Guys Trying to set up cloudstack 4.13.1, but I am getting SSL cert errors on the 2 additional management servers I'm trying to setup. These servers have more than one IP - could it be related to this bug https://github.com/apache/cloudstack/issues/2530 Name: cloudstack-management Arch: x86_64 Version : 4.13.1.0 Release : shapeblue0.el7 Error from 1st management server 2020-08-17 10:43:56,747 ERROR [o.a.c.c.p.RootCACustomTrustManager] (pool-60-thread-1:null) (logid:) Certificate ownership verification failed for client: 10.10.216.221 2020-08-17 10:43:56,747 ERROR [c.c.u.n.Link] (AgentManager-SSLHandshakeHandler-5:null) (logid:) SSL error caught during wrap data: General SSLEngine problem, for local address=/10.10.216.200:8250, remote address=/10.10.216.221:53568. 2020-08-17 10:43:56,797 ERROR [o.a.c.c.p.RootCACustomTrustManager] (pool-61-thread-1:null) (logid:) Certificate ownership verification failed for client: 10.10.216.221 2020-08-17 10:43:56,798 ERROR [c.c.u.n.Link] (AgentManager-SSLHandshakeHandler-5:null) (logid:) SSL error caught during wrap data: General SSLEngine problem, for local address=/10.10.216.200:8250, remote address=/10.10.216.221:53570. Error from additional management server I'm trying to add 2020-08-17 10:43:56,640 ERROR [c.c.u.n.Link] (StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) SSL error caught during unwrap data: Received fatal alert: certificate_unknown, for local address=/10.10.216.221:53564, remote address=/10.10.216.200:8250. The client may have invalid ca-certificates. 2020-08-17 10:43:56,641 WARN [c.c.a.m.ClusteredAgentManagerImpl] (StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) Unable to connect to peer management server: 168482836, ip: 10.10.216.200 due to SSL: Fail to init SSL! java.io.IOException: SSL: Handshake failed with peer management server '168482836' on 10.10.216.200:8250 java.io.IOException: SSL: Fail to init SSL! java.io.IOException: SSL: Handshake failed with peer management server '168482836' on 10.10.216.200:8250 2020-08-17 10:43:56,641 DEBUG [c.c.a.m.ClusteredAgentAttache] (StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) Seq 66-1928103590467993603: Unable to forward null 2020-08-17 10:43:56,641 WARN [c.c.a.m.AgentManagerImpl] (StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) Resource [Host:66] is unreachable: Host 66: Unable to reach the peer that the agent is connected 2020-08-17 10:43:56,641 WARN [c.c.r.ResourceManagerImpl] (StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) Unable to obtain host 66 statistics. 2020-08-17 10:43:56,641 WARN [c.c.s.StatsCollector] (StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) The Host stats is null for host: 66 2020-08-17 10:43:56,698 ERROR [c.c.u.n.Link] (StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) SSL error caught during unwrap data: Received fatal alert: certificate_unknown, for local address=/10.10.216.221:53566, remote address=/10.10.216.200:8250. The client may have invalid ca-certificates. 2020-08-17 10:43:56,698 WARN [c.c.a.m.ClusteredAgentManagerImpl] (StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) Unable to connect to peer management server: 168482836, ip: 10.10.216.200 due to SSL: Fail to init SSL! java.io.IOException: SSL: Handshake failed with peer management server '168482836' on 10.10.216.200:8250 java.io.IOException: SSL: Fail to init SSL! java.io.IOException: SSL: Handshake failed with peer management server '168482836' on 10.10.216.200:8250 2020-08-17 10:43:56,699 DEBUG [c.c.a.m.ClusteredAgentAttache] (StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) Seq 69-2867104112774742021: Unable to forward null 2020-08-17 10:43:56,748 ERROR [c.c.u.n.Link] (StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) SSL error caught during unwrap data: Received fatal alert: certificate_unknown, for local address=/10.10.216.221:53568, remote address=/10.10.216.200:8250. The client may have invalid ca-certificates. I thought I solved this by following http://mail-archives.apache.org/mod_mbox/cloudstack-users/201805.mbox/%3cvi1pr0701mb186911b8e6ba4b81e00ea963e9...@vi1pr0701mb1869.eurprd07.prod.outlook.com%3E But when adding KVM agents I get this on the management server address=/10.10.216.222:38570. 2020-08-17 11:18:13,195 ERROR [o.a.c.c.p.RootCACustomTrustManager] (pool-13-thread-1:null) (logid:) Certificate ownership verification failed for client: 10.10.216.221 2020-08-17 11:18:13,196 ERROR [c.c.u.n.Link] (AgentManager-SSLHandshakeHandler-1:null) (logid:) SSL error caught during wrap data: General SSLEngine problem, for local address=/10.10.216.200:8250, remote address=/10.10.216.221:33998. 2020-08-17 11:18:13,277 ERROR [o.a.c.c.p.RootCACustomTrustManager] (pool-14-thread-1:null) (logid:) Certificate ownership verification failed for client: 10.10.216.221 2020-08-17 11:18:13,278 ERROR [c.c.u.n.Link] (AgentManager-SSLHandshakeHandler-1:null) (logid:) SSL error caught during wrap data: General SSLEngine problem, for local addre
A quick question
Hi guys, Just a quick question, why do all the docs say to use binlog-format = 'ROW' for mysql? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
HA
Hello Does anyone use the instance HA function with KVM, and are they ways to make it less sensitive? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: I might be crazy
I need db.props and keys Thanks :D -Original Message- From: Adam Witwicki Sent: 15 April 2020 09:34 To: users@cloudstack.apache.org Subject: I might be crazy ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello, I am trying to copy a Cloudstack 4.11.0 database to a new 4.11.0 management server But the MS fails to start due to cert and encryption errors Are there some files I would also need to copy over to the new MS server? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
I might be crazy
Hello, I am trying to copy a Cloudstack 4.11.0 database to a new 4.11.0 management server But the MS fails to start due to cert and encryption errors Are there some files I would also need to copy over to the new MS server? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: Instances lose internet
We are using this version 20/03/2018 100.76.104.14900 -Original Message- From: Andrija Panic Sent: 07 April 2020 17:44 To: users Subject: Re: Instances lose internet ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** (and then some more virtio causing BSOD on every other win2008/2012 VM, yes) On Tue, 7 Apr 2020 at 17:23, Simon Weller wrote: > Is the version current? I remember a bug related to this in virtio a > couple of years ago. > > From: Adam Witwicki > Sent: Tuesday, April 7, 2020 10:22 AM > To: users > Subject: Re: Instances lose internet > > Yes using virtio for nics and storage > > Thanks > Adam > > > From: Simon Weller > Sent: Tuesday, April 7, 2020 4:19:59 PM > To: users@cloudstack.apache.org > Subject: Re: Instances lose internet > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Are you using the virtio drivers? > > From: Adam Witwicki > Sent: Tuesday, April 7, 2020 1:33 AM > To: users@cloudstack.apache.org > Subject: Instances lose internet > > Hello, > > I wonder if anyone else has seen this, problerly not cloudstack but a > user on our systems says that their instances randomly lose connection > to the internet. > The windows instance says the nic is connected but can not ping any > other server. There is no Virtual router as it's a L2 network I found > a post that mentioned an issue with bonding - but I can not see any > bonding errors in the syslog > > Thanks > > Adam > > > Cloudstack Version 4.11 > Ubuntu 16 KVM > Bonded Nics > > /usr/bin/qemu-system-x86_64 --version > QEMU emulator version 2.5.0 (Debian 1:2.5+dfsg-5ubuntu10.31), > Copyright > (c) 2003-2008 Fabrice Bellard > > virsh version > Compiled against library: libvirt 1.3.1 Using library: libvirt 1.3.1 > Using API: QEMU 1.3.1 Running hypervisor: QEMU 2.5.0 > > Distributor ID: Ubuntu > Description:Ubuntu 16.04.4 LTS > Release:16.04 > Codename: xenial > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, The Manor House, > Potterne, Wiltshire. SN10 5PN. > Registered in England and Wales No. 5971519 > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, The Manor House, > Potterne, Wiltshire. SN10 5PN. > Registered in England and Wales No. 5971519 > > -- Andrija Panić Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and
Re: Instances lose internet
Yes using virtio for nics and storage Thanks Adam From: Simon Weller Sent: Tuesday, April 7, 2020 4:19:59 PM To: users@cloudstack.apache.org Subject: Re: Instances lose internet ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Are you using the virtio drivers? From: Adam Witwicki Sent: Tuesday, April 7, 2020 1:33 AM To: users@cloudstack.apache.org Subject: Instances lose internet Hello, I wonder if anyone else has seen this, problerly not cloudstack but a user on our systems says that their instances randomly lose connection to the internet. The windows instance says the nic is connected but can not ping any other server. There is no Virtual router as it's a L2 network I found a post that mentioned an issue with bonding - but I can not see any bonding errors in the syslog Thanks Adam Cloudstack Version 4.11 Ubuntu 16 KVM Bonded Nics /usr/bin/qemu-system-x86_64 --version QEMU emulator version 2.5.0 (Debian 1:2.5+dfsg-5ubuntu10.31), Copyright (c) 2003-2008 Fabrice Bellard virsh version Compiled against library: libvirt 1.3.1 Using library: libvirt 1.3.1 Using API: QEMU 1.3.1 Running hypervisor: QEMU 2.5.0 Distributor ID: Ubuntu Description:Ubuntu 16.04.4 LTS Release:16.04 Codename: xenial Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
Instances lose internet
Hello, I wonder if anyone else has seen this, problerly not cloudstack but a user on our systems says that their instances randomly lose connection to the internet. The windows instance says the nic is connected but can not ping any other server. There is no Virtual router as it's a L2 network I found a post that mentioned an issue with bonding - but I can not see any bonding errors in the syslog Thanks Adam Cloudstack Version 4.11 Ubuntu 16 KVM Bonded Nics /usr/bin/qemu-system-x86_64 --version QEMU emulator version 2.5.0 (Debian 1:2.5+dfsg-5ubuntu10.31), Copyright (c) 2003-2008 Fabrice Bellard virsh version Compiled against library: libvirt 1.3.1 Using library: libvirt 1.3.1 Using API: QEMU 1.3.1 Running hypervisor: QEMU 2.5.0 Distributor ID: Ubuntu Description:Ubuntu 16.04.4 LTS Release:16.04 Codename: xenial Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: RE: Deploy VM error
You have to add a rule for your network -Original Message- From: F5 Sent: 01 April 2020 13:51 To: users@cloudstack.apache.org Subject: Re: RE: Deploy VM error ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** egress rules nothing configured. in Instance resolv.conf is with dns 8.8.8.8 but it does not solve even for that address. Is there any light of what can be? Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: Deploy VM error
Network egress rules? Network > your isolated network name > egress rules tab Adam -Original Message- From: F5 Sent: 01 April 2020 13:24 To: users@cloudstack.apache.org Subject: Re: Deploy VM error ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Perfect, that was it, manually adding the range and it worked. Thanks. Taking advantage of the moment, I am new to ACS, now that I have created a VM, what causes it not to be surfing the internet, is there any additional configuration for this? Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: Agent staying in alert mode
Restarting libvirtd helped Thanks everyone Adam -Original Message- From: Simon Weller Sent: 18 March 2020 14:31 To: users@cloudstack.apache.org Subject: Re: Agent staying in alert mode ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** No, it will not. All VMs will stay up. From: Adam Witwicki Sent: Wednesday, March 18, 2020 9:27 AM To: users@cloudstack.apache.org Subject: RE: Agent staying in alert mode Will that stop all the Instances? Thanks Adam -Original Message- From: Simon Weller Sent: 18 March 2020 14:26 To: users@cloudstack.apache.org Subject: Re: Agent staying in alert mode ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Have you tried restarting libvirtd and then restarting the cloudstack agent? From: Adam Witwicki Sent: Wednesday, March 18, 2020 3:06 AM To: users@cloudstack.apache.org Subject: RE: Agent staying in alert mode Hi Andrija, Setting the host to management IP, and not our LB VIP. The agent process seems to stall 2020-03-18 07:44:01,969 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) cpus=32, speed=3800, ram=269385596928, _dom0MinMem=1073741824, _dom0OvercommitMem=0, cpu sockets=2 2020-03-18 07:44:01,972 DEBUG [cloud.resource.ServerResourceBase] (Agent-Handler-1:null) (logid:) Parameters for private nic: 10.10.240.126 - a0:36:9f:24:32:6a-255.255.255.0 2020-03-18 07:44:01,973 DEBUG [cloud.resource.ServerResourceBase] (Agent-Handler-1:null) (logid:) Parameters for storage nic: 10.10.240.126 - a0:36:9f:24:32:6a-255.255.255.0 2020-03-18 07:44:01,973 DEBUG [cloud.resource.ServerResourceBase] (Agent-Handler-1:null) (logid:) Parameters for public nic: 10.10.240.126 - a0:36:9f:24:32:6a-255.255.255.0 2020-03-18 07:44:01,973 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) Executing: /usr/share/cloudstack-common/scripts/vm/hypervisor/versions.sh 2020-03-18 07:44:01,984 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) Execution is successful. 2020-03-18 07:44:01,985 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) Executing: sudo grep InitiatorName= /etc/iscsi/initiatorname.iscsi 2020-03-18 07:44:01,992 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) Execution is successful. 2020-03-18 07:44:01,993 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 257c9140-3863-4be2-85e2-9835650f1b45 (Filesystem) in libvirt 2020-03-18 07:44:01,993 DEBUG [kvm.resource.LibvirtConnection] (Agent-Handler-1:null) (logid:) Looking for libvirtd connection at: qemu:///system HALTS HERE AND DOES NOT CONTINUE I waited 10 mins for a timeout then stopped the agent Thanks Adam -Original Message- From: Andrija Panic Sent: 17 March 2020 18:52 To: users Subject: Re: Agent staying in alert mode ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Can you change that to the IP of the mgmt server and then restart the agent? it should always point to the IP not hostname (what is that value there, "who put it there" etc - perhaps a valid question?) Best, On Tue, 17 Mar 2020 at 15:38, Adam Witwicki wrote: > Hi Suresh > > /etc/cloudstack/agent/agent.properties > host=cs.cloudstack > > telnet > user@ois-mh-p1-c1-h2-b:~$ telnet cs.cloudstack 8250 Trying > 10.10.240.10... > Connected to cs.cloudstack. > Escape character is '^]'. > > > Same for all my other KVM nodes. 7 of 8 connected > > Thanks > > Adam > > -Original Message- > From: Suresh Kumar Anaparti > Sent: 17 March 2020 13:11 > To: users@cloudstack.apache.org > Subject: Re: Agent staying in alert mode > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam, > > What is the value of the host parameter in > "/etc/cloudstack/agent/agent.properties" file of the KVM host with > agent connectivity issue. Can you telnet to that management server on > port 8250 from the KVM host. > > Are other KVM agents connected to same management server? > > Thanks, > Suresh > > On Tue, Mar 17, 2020 at 3:05 PM Adam Witwicki > > wrote: > > > Hi Suresh, > > > > Thanks for looking > > > > All KVM hosts can connect to management server - via ping > > > > The mgmt_server_id is Null for the alert host > > > > Host > > > > name;uuid;status;type;private_ip_address;private_netmask;private_mac &g
RE: Agent staying in alert mode
Will that stop all the Instances? Thanks Adam -Original Message- From: Simon Weller Sent: 18 March 2020 14:26 To: users@cloudstack.apache.org Subject: Re: Agent staying in alert mode ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Have you tried restarting libvirtd and then restarting the cloudstack agent? From: Adam Witwicki Sent: Wednesday, March 18, 2020 3:06 AM To: users@cloudstack.apache.org Subject: RE: Agent staying in alert mode Hi Andrija, Setting the host to management IP, and not our LB VIP. The agent process seems to stall 2020-03-18 07:44:01,969 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) cpus=32, speed=3800, ram=269385596928, _dom0MinMem=1073741824, _dom0OvercommitMem=0, cpu sockets=2 2020-03-18 07:44:01,972 DEBUG [cloud.resource.ServerResourceBase] (Agent-Handler-1:null) (logid:) Parameters for private nic: 10.10.240.126 - a0:36:9f:24:32:6a-255.255.255.0 2020-03-18 07:44:01,973 DEBUG [cloud.resource.ServerResourceBase] (Agent-Handler-1:null) (logid:) Parameters for storage nic: 10.10.240.126 - a0:36:9f:24:32:6a-255.255.255.0 2020-03-18 07:44:01,973 DEBUG [cloud.resource.ServerResourceBase] (Agent-Handler-1:null) (logid:) Parameters for public nic: 10.10.240.126 - a0:36:9f:24:32:6a-255.255.255.0 2020-03-18 07:44:01,973 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) Executing: /usr/share/cloudstack-common/scripts/vm/hypervisor/versions.sh 2020-03-18 07:44:01,984 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) Execution is successful. 2020-03-18 07:44:01,985 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) Executing: sudo grep InitiatorName= /etc/iscsi/initiatorname.iscsi 2020-03-18 07:44:01,992 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) Execution is successful. 2020-03-18 07:44:01,993 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 257c9140-3863-4be2-85e2-9835650f1b45 (Filesystem) in libvirt 2020-03-18 07:44:01,993 DEBUG [kvm.resource.LibvirtConnection] (Agent-Handler-1:null) (logid:) Looking for libvirtd connection at: qemu:///system HALTS HERE AND DOES NOT CONTINUE I waited 10 mins for a timeout then stopped the agent Thanks Adam -Original Message- From: Andrija Panic Sent: 17 March 2020 18:52 To: users Subject: Re: Agent staying in alert mode ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Can you change that to the IP of the mgmt server and then restart the agent? it should always point to the IP not hostname (what is that value there, "who put it there" etc - perhaps a valid question?) Best, On Tue, 17 Mar 2020 at 15:38, Adam Witwicki wrote: > Hi Suresh > > /etc/cloudstack/agent/agent.properties > host=cs.cloudstack > > telnet > user@ois-mh-p1-c1-h2-b:~$ telnet cs.cloudstack 8250 Trying > 10.10.240.10... > Connected to cs.cloudstack. > Escape character is '^]'. > > > Same for all my other KVM nodes. 7 of 8 connected > > Thanks > > Adam > > -Original Message- > From: Suresh Kumar Anaparti > Sent: 17 March 2020 13:11 > To: users@cloudstack.apache.org > Subject: Re: Agent staying in alert mode > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam, > > What is the value of the host parameter in > "/etc/cloudstack/agent/agent.properties" file of the KVM host with > agent connectivity issue. Can you telnet to that management server on > port 8250 from the KVM host. > > Are other KVM agents connected to same management server? > > Thanks, > Suresh > > On Tue, Mar 17, 2020 at 3:05 PM Adam Witwicki > > wrote: > > > Hi Suresh, > > > > Thanks for looking > > > > All KVM hosts can connect to management server - via ping > > > > The mgmt_server_id is Null for the alert host > > > > Host > > > > name;uuid;status;type;private_ip_address;private_netmask;private_mac > > _a > > ddress;storage_ip_address;storage_netmask;storage_mac_address;storag > > e_ > > ip_address_2;storage_mac_address_2;storage_netmask_2;cluster_id;publ > > ic > > _ip_address;public_netmask;public_mac_address;proxy_port;data_center > > _i > > d;pod_id;cpu_sockets;cpus;speed;url;fs_type;hypervisor_type;hypervis > > or > > _version;ram;resource;version;parent;total_size;capabilities;guid;av > > ai > > lable;setup;dom0_memory;last_ping;mgmt_serv
RE: Agent staying in alert mode
Hi Andrija, Setting the host to management IP, and not our LB VIP. The agent process seems to stall 2020-03-18 07:44:01,969 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) cpus=32, speed=3800, ram=269385596928, _dom0MinMem=1073741824, _dom0OvercommitMem=0, cpu sockets=2 2020-03-18 07:44:01,972 DEBUG [cloud.resource.ServerResourceBase] (Agent-Handler-1:null) (logid:) Parameters for private nic: 10.10.240.126 - a0:36:9f:24:32:6a-255.255.255.0 2020-03-18 07:44:01,973 DEBUG [cloud.resource.ServerResourceBase] (Agent-Handler-1:null) (logid:) Parameters for storage nic: 10.10.240.126 - a0:36:9f:24:32:6a-255.255.255.0 2020-03-18 07:44:01,973 DEBUG [cloud.resource.ServerResourceBase] (Agent-Handler-1:null) (logid:) Parameters for public nic: 10.10.240.126 - a0:36:9f:24:32:6a-255.255.255.0 2020-03-18 07:44:01,973 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) Executing: /usr/share/cloudstack-common/scripts/vm/hypervisor/versions.sh 2020-03-18 07:44:01,984 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) Execution is successful. 2020-03-18 07:44:01,985 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) Executing: sudo grep InitiatorName= /etc/iscsi/initiatorname.iscsi 2020-03-18 07:44:01,992 DEBUG [kvm.resource.LibvirtComputingResource] (Agent-Handler-1:null) (logid:) Execution is successful. 2020-03-18 07:44:01,993 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 257c9140-3863-4be2-85e2-9835650f1b45 (Filesystem) in libvirt 2020-03-18 07:44:01,993 DEBUG [kvm.resource.LibvirtConnection] (Agent-Handler-1:null) (logid:) Looking for libvirtd connection at: qemu:///system HALTS HERE AND DOES NOT CONTINUE I waited 10 mins for a timeout then stopped the agent Thanks Adam -Original Message- From: Andrija Panic Sent: 17 March 2020 18:52 To: users Subject: Re: Agent staying in alert mode ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Can you change that to the IP of the mgmt server and then restart the agent? it should always point to the IP not hostname (what is that value there, "who put it there" etc - perhaps a valid question?) Best, On Tue, 17 Mar 2020 at 15:38, Adam Witwicki wrote: > Hi Suresh > > /etc/cloudstack/agent/agent.properties > host=cs.cloudstack > > telnet > user@ois-mh-p1-c1-h2-b:~$ telnet cs.cloudstack 8250 Trying > 10.10.240.10... > Connected to cs.cloudstack. > Escape character is '^]'. > > > Same for all my other KVM nodes. 7 of 8 connected > > Thanks > > Adam > > -Original Message- > From: Suresh Kumar Anaparti > Sent: 17 March 2020 13:11 > To: users@cloudstack.apache.org > Subject: Re: Agent staying in alert mode > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam, > > What is the value of the host parameter in > "/etc/cloudstack/agent/agent.properties" file of the KVM host with > agent connectivity issue. Can you telnet to that management server on > port 8250 from the KVM host. > > Are other KVM agents connected to same management server? > > Thanks, > Suresh > > On Tue, Mar 17, 2020 at 3:05 PM Adam Witwicki > > wrote: > > > Hi Suresh, > > > > Thanks for looking > > > > All KVM hosts can connect to management server - via ping > > > > The mgmt_server_id is Null for the alert host > > > > Host > > > > name;uuid;status;type;private_ip_address;private_netmask;private_mac > > _a > > ddress;storage_ip_address;storage_netmask;storage_mac_address;storag > > e_ > > ip_address_2;storage_mac_address_2;storage_netmask_2;cluster_id;publ > > ic > > _ip_address;public_netmask;public_mac_address;proxy_port;data_center > > _i > > d;pod_id;cpu_sockets;cpus;speed;url;fs_type;hypervisor_type;hypervis > > or > > _version;ram;resource;version;parent;total_size;capabilities;guid;av > > ai > > lable;setup;dom0_memory;last_ping;mgmt_server_id;disconnected;create > > d; > > removed;update_count;resource_state;owner;lastUpdated;engine_state > > ois-mh-p1-c1-h2-b;3d5e4c35-7e10-4560-8a2e-5ebf770e837d;Alert;Routing > > ;1 > > 0.10.240.126;255.255.255.0;a0:36:9f:24:32:6a;10.10.240.126;255.255.2 > > 55 > > .0;a0:36:9f:24:32:6a;\N;\N;\N;5;10.10.240.126;255.255.255.0;a0:36:9f > > :2 > > 4:32:6a;\N;5;5;2;32;3800;iqn.1993-08.org.debian:01:7c8e527ccba4;\N;K > > VM > > ;\N;269385596928;\N;4.11.0.0;\N;\N;hvm,snapshot;44190139-5b1b-3642-b > > 78 > &g
RE: Agent staying in alert mode
Hi Suresh /etc/cloudstack/agent/agent.properties host=cs.cloudstack telnet user@ois-mh-p1-c1-h2-b:~$ telnet cs.cloudstack 8250 Trying 10.10.240.10... Connected to cs.cloudstack. Escape character is '^]'. Same for all my other KVM nodes. 7 of 8 connected Thanks Adam -Original Message- From: Suresh Kumar Anaparti Sent: 17 March 2020 13:11 To: users@cloudstack.apache.org Subject: Re: Agent staying in alert mode ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, What is the value of the host parameter in "/etc/cloudstack/agent/agent.properties" file of the KVM host with agent connectivity issue. Can you telnet to that management server on port 8250 from the KVM host. Are other KVM agents connected to same management server? Thanks, Suresh On Tue, Mar 17, 2020 at 3:05 PM Adam Witwicki wrote: > Hi Suresh, > > Thanks for looking > > All KVM hosts can connect to management server - via ping > > The mgmt_server_id is Null for the alert host > > Host > > name;uuid;status;type;private_ip_address;private_netmask;private_mac_a > ddress;storage_ip_address;storage_netmask;storage_mac_address;storage_ > ip_address_2;storage_mac_address_2;storage_netmask_2;cluster_id;public > _ip_address;public_netmask;public_mac_address;proxy_port;data_center_i > d;pod_id;cpu_sockets;cpus;speed;url;fs_type;hypervisor_type;hypervisor > _version;ram;resource;version;parent;total_size;capabilities;guid;avai > lable;setup;dom0_memory;last_ping;mgmt_server_id;disconnected;created; > removed;update_count;resource_state;owner;lastUpdated;engine_state > ois-mh-p1-c1-h2-b;3d5e4c35-7e10-4560-8a2e-5ebf770e837d;Alert;Routing;1 > 0.10.240.126;255.255.255.0;a0:36:9f:24:32:6a;10.10.240.126;255.255.255 > .0;a0:36:9f:24:32:6a;\N;\N;\N;5;10.10.240.126;255.255.255.0;a0:36:9f:2 > 4:32:6a;\N;5;5;2;32;3800;iqn.1993-08.org.debian:01:7c8e527ccba4;\N;KVM > ;\N;269385596928;\N;4.11.0.0;\N;\N;hvm,snapshot;44190139-5b1b-3642-b78 > 6-41ca577081e9-LibvirtComputingResource;1;0;0;1546450279;\N;2019-12-24 > 09:25:53;2019-06-11 21:59:43;\N;2516;Enabled;\N;\N;Disabled > > mshost > > msid;runid;name;state;version;service_ip;service_port;last_update;remo > ved;alert_count > 91765225987;1584406841937;ois-mh-csmg-01;Up;4.11.0.0;10.10.240.21;9090 > ;2020-03-17 > 09:33:07;\N;0 > 91765663747;1584406829845;ois-mh-csmg-02;Up;4.11.0.0;10.10.240.22;9090 > ;2020-03-17 > 09:33:09;\N;0 > 91766390275;1584406828383;ois-mh-csmg-03;Up;4.11.0.0;10.10.240.23;9090 > ;2020-03-17 > 09:33:05;\N;0 > > > Adam > > -Original Message- > From: Suresh Kumar Anaparti > Sent: 16 March 2020 19:35 > To: users@cloudstack.apache.org > Subject: Re: Agent staying in alert mode > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam, > > Seems it is clustered environment and other node(s) are being > disconnected, from the logs. Can you check the management host of > connected agents in the KVM host using net stat and the host value in > "/etc/cloudstack/agent/agent.properties". > > Also, check the ownership of the host in mgmt_server_id column of the > host table and validate it against the management server details in mshost > table. > > Thanks, > Suresh > > On Mon, Mar 16, 2020 at 4:37 PM Adam Witwicki > > wrote: > > > Hi Guys, > > > > I need some help, > > > > One of my KVM agents is stuck in alert state - no amount of > > restarting the agent helps > > > > > > > > Cloudstack version 4.11.0.0 > > > > Logs > > Management https://pastebin.com/JY2bvqmM Agent > > https://pastebin.com/G7g8wXNN > > > > All the other agents connect fine > > > > Thanks > > > > Adam > > > > > > > > Disclaimer Notice: > > This email has been sent by Oakford Technology Limited, while we > > have checked this e-mail and any attachments for viruses, we can not > > guarantee that they are virus-free. You must therefore take full > > responsibility for virus checking. > > This message and any attachments are confidential and should only be > > read by those to whom they are addressed. If you are not the > > intended recipient, please contact us, delete the message from your > > computer and destroy any copies. Any distribution or copying without > > our prior permission is prohibited. > > Internet communications are not always secure and therefore Oakford > > Technology Limited does not accept legal responsibility for this message. > > The recipient is responsible for v
RE: Agent staying in alert mode
Hi Suresh, Thanks for looking All KVM hosts can connect to management server - via ping The mgmt_server_id is Null for the alert host Host name;uuid;status;type;private_ip_address;private_netmask;private_mac_address;storage_ip_address;storage_netmask;storage_mac_address;storage_ip_address_2;storage_mac_address_2;storage_netmask_2;cluster_id;public_ip_address;public_netmask;public_mac_address;proxy_port;data_center_id;pod_id;cpu_sockets;cpus;speed;url;fs_type;hypervisor_type;hypervisor_version;ram;resource;version;parent;total_size;capabilities;guid;available;setup;dom0_memory;last_ping;mgmt_server_id;disconnected;created;removed;update_count;resource_state;owner;lastUpdated;engine_state ois-mh-p1-c1-h2-b;3d5e4c35-7e10-4560-8a2e-5ebf770e837d;Alert;Routing;10.10.240.126;255.255.255.0;a0:36:9f:24:32:6a;10.10.240.126;255.255.255.0;a0:36:9f:24:32:6a;\N;\N;\N;5;10.10.240.126;255.255.255.0;a0:36:9f:24:32:6a;\N;5;5;2;32;3800;iqn.1993-08.org.debian:01:7c8e527ccba4;\N;KVM;\N;269385596928;\N;4.11.0.0;\N;\N;hvm,snapshot;44190139-5b1b-3642-b786-41ca577081e9-LibvirtComputingResource;1;0;0;1546450279;\N;2019-12-24 09:25:53;2019-06-11 21:59:43;\N;2516;Enabled;\N;\N;Disabled mshost msid;runid;name;state;version;service_ip;service_port;last_update;removed;alert_count 91765225987;1584406841937;ois-mh-csmg-01;Up;4.11.0.0;10.10.240.21;9090;2020-03-17 09:33:07;\N;0 91765663747;1584406829845;ois-mh-csmg-02;Up;4.11.0.0;10.10.240.22;9090;2020-03-17 09:33:09;\N;0 91766390275;1584406828383;ois-mh-csmg-03;Up;4.11.0.0;10.10.240.23;9090;2020-03-17 09:33:05;\N;0 Adam -Original Message- From: Suresh Kumar Anaparti Sent: 16 March 2020 19:35 To: users@cloudstack.apache.org Subject: Re: Agent staying in alert mode ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, Seems it is clustered environment and other node(s) are being disconnected, from the logs. Can you check the management host of connected agents in the KVM host using net stat and the host value in "/etc/cloudstack/agent/agent.properties". Also, check the ownership of the host in mgmt_server_id column of the host table and validate it against the management server details in mshost table. Thanks, Suresh On Mon, Mar 16, 2020 at 4:37 PM Adam Witwicki wrote: > Hi Guys, > > I need some help, > > One of my KVM agents is stuck in alert state - no amount of restarting > the agent helps > > > > Cloudstack version 4.11.0.0 > > Logs > Management https://pastebin.com/JY2bvqmM Agent > https://pastebin.com/G7g8wXNN > > All the other agents connect fine > > Thanks > > Adam > > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, The Manor House, > Potterne, Wiltshire. SN10 5PN. > Registered in England and Wales No. 5971519 > > Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
Agent staying in alert mode
Hi Guys, I need some help, One of my KVM agents is stuck in alert state - no amount of restarting the agent helps Cloudstack version 4.11.0.0 Logs Management https://pastebin.com/JY2bvqmM Agent https://pastebin.com/G7g8wXNN All the other agents connect fine Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
SSL error on fresh agent install
CS version 4.13 When I am trying to add an agent - it fails to connect to the management server, how can I diagnose this? 2020-02-24 10:10:05,786 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = new : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 192.168.240.1 : port = 8250 2020-02-24 10:10:05,791 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 192.168.240.1:8250 2020-02-24 10:10:05,795 INFO [utils.nio.Link] (main:null) (logid:) Conf file found: /etc/cloudstack/agent/agent.properties 2020-02-24 10:10:20,891 WARN [utils.nio.Link] (main:null) (logid:) SSL Handshake has taken more than 15s to connect to: /192.168.240.1:8250. Please investigate this connection. 2020-02-24 10:10:20,892 ERROR [utils.nio.NioClient] (main:null) (logid:) SSL Handshake failed while connecting to host: 192.168.240.1 port: 8250 2020-02-24 10:10:20,893 ERROR [utils.nio.NioConnection] (main:null) (logid:) Unable to initialize the threads. java.io.IOException: SSL Handshake failed while connecting to host: 192.168.240.1 port: 8250 at com.cloud.utils.nio.NioClient.init(NioClient.java:67) at com.cloud.utils.nio.NioConnection.start(NioConnection.java:95) at com.cloud.agent.Agent.start(Agent.java:282) at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:455) at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:422) at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:406) at com.cloud.agent.AgentShell.start(AgentShell.java:512) at com.cloud.agent.AgentShell.main(AgentShell.java:547) 2020-02-24 10:10:20,898 INFO [utils.exception.CSExceptionErrorCode] (main:null) (logid:) Could not find exception: com.cloud.utils.exception.NioConnectionException in error code list for exceptions 2020-02-24 10:10:20,898 WARN [cloud.agent.Agent] (main:null) (logid:) NIO Connection Exception com.cloud.utils.exception.NioConnectionException: SSL Handshake failed while connecting to host: 192.168.240.1 port: 8250 2020-02-24 10:10:20,898 INFO [cloud.agent.Agent] (main:null) (logid:) Attempted to connect to the server, but received an unexpected exception, trying again... The correct files seem to have been created ls /etc/cloudstack/agent/ agent.properties cloud.ca.crt cloud.crt cloud.csr cloud.jks cloud.key environment.properties log4j-cloud.xml The management server only shows 2020-02-24 10:11:20,535 WARN [c.c.u.n.Link] (AgentManager-SSLHandshakeHandler-1:null) (logid:) SSL Handshake has taken more than 15s to connect to: /192.168.240.3:59940. Please investigate this connection. Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
Migration between zones
Hello, Is there a way to migrate Instances between zones? Gui or Database Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: Password in URL
But its then displayed on the users screen - where anyone can see it? Thanks Adam -Original Message- From: Andrija Panic Sent: 13 December 2019 11:21 To: users Subject: Re: Password in URL ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** (and assuming you are using SSL/443 - that's not a problem in that sense) On Fri, 13 Dec 2019 at 12:20, Andrija Panic wrote: > Password IS sent in the clear text when you log in initially - you can > check that via developer tools while doing a successful login. > > On Fri, 13 Dec 2019 at 11:15, Thomas Joseph > wrote: > >> It must be a design feature then, you can redirect it to the dev group. >> >> With regards >> Thomas >> >> On Fri, 13 Dec 2019, 8:57 am Adam Witwicki, >> wrote: >> >> > Hi Thomas >> > >> > 443, the concern is its displayed in full view on the screen. >> > >> > Version 4.11 btw >> > >> > Thanks >> > >> > Adam >> > >> > -Original Message- >> > From: Thomas Joseph >> > Sent: 13 December 2019 08:55 >> > To: users@cloudstack.apache.org >> > Subject: Re: Password in URL >> > >> > ** This mail originated from OUTSIDE the Oakford corporate network. >> Treat >> > hyperlinks and attachments in this email with caution. ** >> > >> > Hello Adam >> > >> > Are you using port 80 instead for 443 for the console login? >> > >> > With regards >> > Thomas >> > >> > On Fri, 13 Dec 2019, 8:34 am Adam Witwicki, >> > >> > wrote: >> > >> > > Sorry, its not a hash it is the password! >> > > >> > > -Original Message- >> > > From: Adam Witwicki >> > > Sent: 13 December 2019 08:32 >> > > To: users@cloudstack.apache.org >> > > Subject: Password in URL >> > > >> > > ** This mail originated from OUTSIDE the Oakford corporate network. >> > > Treat hyperlinks and attachments in this email with caution. ** >> > > >> > > Hello, >> > > >> > > When I have failed logon (cloudstack is unable to read from >> > > database) the redirected url shows the password hash >> > > >> > > /client/?username=admin&password=MASKMASKMASKMASK&domain=&languag >> > > e= >> > > >> > > Is this an issue? >> > > >> > > Thanks >> > > >> > > Adam >> > > >> > > >> > > >> > > Disclaimer Notice: >> > > This email has been sent by Oakford Technology Limited, while we >> > > have checked this e-mail and any attachments for viruses, we can >> > > not guarantee that they are virus-free. You must therefore take >> > > full responsibility for virus checking. >> > > This message and any attachments are confidential and should only >> > > be read by those to whom they are addressed. If you are not the >> > > intended recipient, please contact us, delete the message from >> > > your computer and destroy any copies. Any distribution or copying >> > > without our prior permission is prohibited. >> > > Internet communications are not always secure and therefore >> > > Oakford Technology Limited does not accept legal responsibility >> > > for this >> message. >> > > The recipient is responsible for verifying its authenticity >> > > before acting on the contents. Any views or opinions presented >> > > are solely those of the author and do not necessarily represent >> > > those of Oakford >> > Technology Limited. >> > > Registered address: Oakford Technology Limited, The Manor House, >> > > Potterne, Wiltshire. SN10 5PN. >> > > Registered in England and Wales No. 5971519 >> > > >> > > Disclaimer Notice: >> > > This email has been sent by Oakford Technology Limited, while we >> > > have checked this e-mail and any attachments for viruses, we can >> > > not guarantee that they are virus-free. You must therefore take >> > > full responsibility for virus checking. >> > > This message and any attachments are confidential and should only >> > > be read by those to whom they are addressed. If you are not the >> > > intended recipient, please contact us, delete the message from >> &g
RE: Password in URL
Hi Thomas 443, the concern is its displayed in full view on the screen. Version 4.11 btw Thanks Adam -Original Message- From: Thomas Joseph Sent: 13 December 2019 08:55 To: users@cloudstack.apache.org Subject: Re: Password in URL ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello Adam Are you using port 80 instead for 443 for the console login? With regards Thomas On Fri, 13 Dec 2019, 8:34 am Adam Witwicki, wrote: > Sorry, its not a hash it is the password! > > -Original Message- > From: Adam Witwicki > Sent: 13 December 2019 08:32 > To: users@cloudstack.apache.org > Subject: Password in URL > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hello, > > When I have failed logon (cloudstack is unable to read from database) > the redirected url shows the password hash > > /client/?username=admin&password=MASKMASKMASKMASK&domain=&language= > > Is this an issue? > > Thanks > > Adam > > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, The Manor House, > Potterne, Wiltshire. SN10 5PN. > Registered in England and Wales No. 5971519 > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, The Manor House, > Potterne, Wiltshire. SN10 5PN. > Registered in England and Wales No. 5971519 > > Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: Password in URL
Sorry, its not a hash it is the password! -Original Message- From: Adam Witwicki Sent: 13 December 2019 08:32 To: users@cloudstack.apache.org Subject: Password in URL ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello, When I have failed logon (cloudstack is unable to read from database) the redirected url shows the password hash /client/?username=admin&password=MASKMASKMASKMASK&domain=&language= Is this an issue? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
Password in URL
Hello, When I have failed logon (cloudstack is unable to read from database) the redirected url shows the password hash /client/?username=admin&password=MASKMASKMASKMASK&domain=&language= Is this an issue? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: Unable to view console
Restarting the remaining nodes got it going again.. Strange :) -Original Message- From: Adam Witwicki Sent: 26 September 2019 16:10 To: users@cloudstack.apache.org Subject: RE: Unable to view console ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Issue is related to management server HA Dropping to 1 node allowed connection Thanks Adam -Original Message- From: Adam Witwicki Sent: 26 September 2019 16:04 To: users@cloudstack.apache.org Subject: Unable to view console ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello, I am unable to view any console - this is the console VM log 019-09-26 15:01:44,641 ERROR [cloud.consoleproxy.ConsoleProxyHttpHandlerHelper] (Thread-8:null) decode token. host info is not found! 2019-09-26 15:01:44,649 WARN [cloud.consoleproxy.ConsoleProxyAjaxHandler] (Thread-8:null) Exception, java.lang.IllegalArgumentException at com.cloud.consoleproxy.ConsoleProxyAjaxHandler.doHandle(ConsoleProxyAjaxHandler.java:98) at com.cloud.consoleproxy.ConsoleProxyAjaxHandler.handle(ConsoleProxyAjaxHandler.java:51) at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:79) at sun.net.httpserver.AuthFilter.doFilter(AuthFilter.java:83) at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:82) at sun.net.httpserver.ServerImpl$Exchange$LinkHandler.handle(ServerImpl.java:675) at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:79) at sun.net.httpserver.ServerImpl$Exchange.run(ServerImpl.java:645) at java.lang.Thread.run(Thread.java:748) There is nothing in the management logs Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN
RE: Unable to view console
Issue is related to management server HA Dropping to 1 node allowed connection Thanks Adam -Original Message- From: Adam Witwicki Sent: 26 September 2019 16:04 To: users@cloudstack.apache.org Subject: Unable to view console ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello, I am unable to view any console - this is the console VM log 019-09-26 15:01:44,641 ERROR [cloud.consoleproxy.ConsoleProxyHttpHandlerHelper] (Thread-8:null) decode token. host info is not found! 2019-09-26 15:01:44,649 WARN [cloud.consoleproxy.ConsoleProxyAjaxHandler] (Thread-8:null) Exception, java.lang.IllegalArgumentException at com.cloud.consoleproxy.ConsoleProxyAjaxHandler.doHandle(ConsoleProxyAjaxHandler.java:98) at com.cloud.consoleproxy.ConsoleProxyAjaxHandler.handle(ConsoleProxyAjaxHandler.java:51) at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:79) at sun.net.httpserver.AuthFilter.doFilter(AuthFilter.java:83) at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:82) at sun.net.httpserver.ServerImpl$Exchange$LinkHandler.handle(ServerImpl.java:675) at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:79) at sun.net.httpserver.ServerImpl$Exchange.run(ServerImpl.java:645) at java.lang.Thread.run(Thread.java:748) There is nothing in the management logs Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
Unable to view console
Hello, I am unable to view any console - this is the console VM log 019-09-26 15:01:44,641 ERROR [cloud.consoleproxy.ConsoleProxyHttpHandlerHelper] (Thread-8:null) decode token. host info is not found! 2019-09-26 15:01:44,649 WARN [cloud.consoleproxy.ConsoleProxyAjaxHandler] (Thread-8:null) Exception, java.lang.IllegalArgumentException at com.cloud.consoleproxy.ConsoleProxyAjaxHandler.doHandle(ConsoleProxyAjaxHandler.java:98) at com.cloud.consoleproxy.ConsoleProxyAjaxHandler.handle(ConsoleProxyAjaxHandler.java:51) at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:79) at sun.net.httpserver.AuthFilter.doFilter(AuthFilter.java:83) at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:82) at sun.net.httpserver.ServerImpl$Exchange$LinkHandler.handle(ServerImpl.java:675) at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:79) at sun.net.httpserver.ServerImpl$Exchange.run(ServerImpl.java:645) at java.lang.Thread.run(Thread.java:748) There is nothing in the management logs Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: System Capacity Limits
I have not re tested Thanks Adam -Original Message- From: Andrija Panic Sent: 17 September 2019 10:05 To: users Subject: Re: System Capacity Limits ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Adam, Any conclusions, did you find something in the log? On Sat, Sep 14, 2019, 23:54 Sven Vogel wrote: > Hi Adam, > > Take a look here. Maybe it helps. > > https://www.slideshare.net/AlexTian/cloud-stack-troubleshooting > > Cheers, > > Sven > > Von meinem iPhone gesendet > > > __ > > Sven Vogel > Teamlead Platform > > EWERK DIGITAL GmbH > Brühl 24, D-04109 Leipzig > P +49 341 42649 - 99 > F +49 341 42649 - 98 > s.vo...@ewerk.com > www.ewerk.com > > Geschäftsführer: > Dr. Erik Wende, Hendrik Schubert, Frank Richter > Registergericht: Leipzig HRB 9065 > > Zertifiziert nach: > ISO/IEC 27001:2013 > DIN EN ISO 9001:2015 > DIN ISO/IEC 2-1:2011 > > EWERK-Blog | LinkedIn | Xing | Twitter | Facebook > > Auskünfte und Angebote per Mail sind freibleibend und unverbindlich. > > Disclaimer Privacy: > Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien) > ist vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht > der bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung, > Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte > informieren Sie in diesem Fall unverzüglich den Absender und löschen > Sie die E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem System. > Vielen Dank. > > The contents of this e-mail (including any attachments) are > confidential and may be legally privileged. If you are not the > intended recipient of this e-mail, any disclosure, copying, > distribution or use of its contents is strictly prohibited, and you > should please notify the sender immediately and then delete it (including any > attachments) from your system. Thank you. > > Am 13.09.2019 um 19:06 schrieb Andrija Panic : > > > > Hi Adam, > > > > That insufficient capacity exception message has probably nothing to > > do with the number of CPU cores (and most of the time with anything > > capacity-related, it's just that we are lazy to pass the real error > > to as the API reaponse...) but is a general message that can mean > > 100 different things. > > > > The real reason you'll only find in the mgmt logs. > > > > And, I have tested 4.11.2 and 4.13/master - number of CPU cores is > > NOT taken into the consideration/math - with or without > > overprovisioning (I have cpu.overprovisioning.factor set to 2. 0 and > > was able to provision > 250% > > of my CPU core). > > > > Dig the logs and see what is really the exception. > > > > Best, > > Andrija > > > > > >> On Fri, Sep 13, 2019, 05:23 Adam Witwicki > wrote: > >> > >> Hello, > >> > >> Going back to "unable to start MV due to insufficient capacity" > >> errors Is there a way to turn these off as I can overprovision for > >> "CPU" but > not > >> "# of CPU Cores"? > >> > >> CS ver 4.11.0.0 > >> > >> Thanks > >> > >> Adam > >> > >> > >> Disclaimer Notice: > >> This email has been sent by Oakford Technology Limited, while we > >> have checked this e-mail and any attachments for viruses, we can > >> not > guarantee > >> that they are virus-free. You must therefore take full > >> responsibility > for > >> virus checking. > >> This message and any attachments are confidential and should only > >> be > read > >> by those to whom they are addressed. If you are not the intended > recipient, > >> please contact us, delete the message from your computer and > >> destroy any copies. Any distribution or copying without our prior > >> permission is prohibited. > >> Internet communications are not always secure and therefore Oakford > >> Technology Limited does not accept legal responsibility for this > message. > >> The recipient is responsible for verifying its authenticity before > acting > >> on the contents. Any views or opinions presented are solely those > >> of the author and do not necessarily represent those of Oakford > >> Technology > Limited. > >> Registered address: Oakford Technology Limited, The Manor House, > Potterne, > >> Wiltshire. SN10 5PN. > >> Registered in England and Wales No. 5971519 > >>
System Capacity Limits
Hello, Going back to "unable to start MV due to insufficient capacity" errors Is there a way to turn these off as I can overprovision for "CPU" but not "# of CPU Cores"? CS ver 4.11.0.0 Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: Changing cpu.overprovisioning
Andrija - would migrating work? Thanks Adam -Original Message- From: Andrija Panic Sent: 21 August 2019 16:07 To: users Subject: Re: Changing cpu.overprovisioning ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** On order to change calculations (bring down those 85% to say 42% with doubled the over provisioning factor), you do need to stop and start VMs. Currently it is this way... After changing the cpu (and God forbid RAM) overprovisioning factros AT THE CLUSTER LEVEL), no need to restrart mgmt server. On Wed, Aug 21, 2019, 16:03 Adam Witwicki wrote: > It's taken effect, but it's the same percentage - there is a warning > about changing it with running VMs - "check the manual" not that > helpful > > Thanks > > Adam > > -Original Message- > From: Simon Weller > Sent: 21 August 2019 14:01 > To: users@cloudstack.apache.org > Subject: Re: Changing cpu.overprovisioning > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam, > > You shouldn't have to restart any instances. At worst, after the > change, restart your management server(s) if it doesn't take effect. > > > From: Adam Witwicki > Sent: Wednesday, August 21, 2019 7:52 AM > To: users@cloudstack.apache.org > Subject: Changing cpu.overprovisioning > > Hi Guys > > > How can I change cpu.overprovisioning without having to restart all > the instances? > > It would be extremely inconvenient to do so, I am at 85% of allocated > capacity, and by hosts are not breaking a sweat > > > > > > Ver 4.11.0.0 > > > > > > Thanks > > > > Adam > > > > > > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, The Manor House, > Potterne, Wiltshire. SN10 5PN. > Registered in England and Wales No. 5971519 > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, The Manor House, > Potterne, Wiltshire. SN10 5PN. > Registered in England and Wales No. 5971519 > > Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this m
RE: Changing cpu.overprovisioning
It's taken effect, but it's the same percentage - there is a warning about changing it with running VMs - "check the manual" not that helpful Thanks Adam -Original Message- From: Simon Weller Sent: 21 August 2019 14:01 To: users@cloudstack.apache.org Subject: Re: Changing cpu.overprovisioning ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, You shouldn't have to restart any instances. At worst, after the change, restart your management server(s) if it doesn't take effect. ____ From: Adam Witwicki Sent: Wednesday, August 21, 2019 7:52 AM To: users@cloudstack.apache.org Subject: Changing cpu.overprovisioning Hi Guys How can I change cpu.overprovisioning without having to restart all the instances? It would be extremely inconvenient to do so, I am at 85% of allocated capacity, and by hosts are not breaking a sweat Ver 4.11.0.0 Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
Changing cpu.overprovisioning
Hi Guys How can I change cpu.overprovisioning without having to restart all the instances? It would be extremely inconvenient to do so, I am at 85% of allocated capacity, and by hosts are not breaking a sweat Ver 4.11.0.0 Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: CPU compatibility issue
It might be because I'm using a Westmere CPU? Doh Adam -Original Message- From: Adam Witwicki Sent: 05 June 2019 13:08 To: users@cloudstack.apache.org Subject: CPU compatibility issue ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello, I am having an issue on a new test system, cloudstack version 4.11.00 (shapeblue) with KVM (Ubuntu 16.04), In production and in the past I have used these settings in the agent.properties guest.cpu.model=SandyBridge guest.cpu.mode=custom As this was needed to allow windows 2016 to boot and allow live migration Yet now on a clean install I get this error when trying to start any instance (console, router, instance) 2019-06-05 13:03:13,282 WARN [resource.wrapper.LibvirtStartCommandWrapper] (agentRequest-Handler-5:null) (logid:2df290f8) LibvirtException org.libvirt.LibvirtException: unsupported configuration: guest and host CPU are not compatible: Host CPU does not provide required features: avx, xsave, aes, tsc-deadline, x2apic, pclmuldq If I use host-passthrough it works This may be a clue https://github.com/ustcweizhou/cloudstack/commit/16e87a80d85d283d52c3d72001cd94d9fda25278 but I am not sure. Can anyone explain what is going on? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
CPU compatibility issue
Hello, I am having an issue on a new test system, cloudstack version 4.11.00 (shapeblue) with KVM (Ubuntu 16.04), In production and in the past I have used these settings in the agent.properties guest.cpu.model=SandyBridge guest.cpu.mode=custom As this was needed to allow windows 2016 to boot and allow live migration Yet now on a clean install I get this error when trying to start any instance (console, router, instance) 2019-06-05 13:03:13,282 WARN [resource.wrapper.LibvirtStartCommandWrapper] (agentRequest-Handler-5:null) (logid:2df290f8) LibvirtException org.libvirt.LibvirtException: unsupported configuration: guest and host CPU are not compatible: Host CPU does not provide required features: avx, xsave, aes, tsc-deadline, x2apic, pclmuldq If I use host-passthrough it works This may be a clue https://github.com/ustcweizhou/cloudstack/commit/16e87a80d85d283d52c3d72001cd94d9fda25278 but I am not sure. Can anyone explain what is going on? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: Change an instances NIC
Cheers Ivan, that does the job Adam -Original Message- From: Ivan Kudryavtsev Sent: 20 February 2019 14:27 To: users Subject: Re: Change an instances NIC ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Adam, just change OS family to the Linux for templates, ISOs which use your VMs and restart VMs via stop/start. ср, 20 февр. 2019 г., 8:39 Adam Witwicki awitwi...@oakfordis.com: > Hello, > > I would like to change an instances nic from e1000 to vmxnet3 or even > virtio, How can I do this? > > Is there something I can add to the user_vm_details table? > > > Thanks > > Adam > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, The Manor House, > Potterne, Wiltshire. SN10 5PN. > Registered in England and Wales No. 5971519 > > Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
Change an instances NIC
Hello, I would like to change an instances nic from e1000 to vmxnet3 or even virtio, How can I do this? Is there something I can add to the user_vm_details table? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: Converting a VPC
Cheers Andrija, that does the job. Adam -Original Message- From: Andrija Panic Sent: 07 February 2019 08:08 To: users@cloudstack.apache.org Subject: RE: Converting a VPC ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, You probably want to do a "migration" to another network - i.e. go to the specific VM's NIC tab: - Add a new Network to the VM (add an existing L2 network - TBH, I never tried this with L2 network, but I can confirm it works for any VPC, Shared or Isolated network) - effectively you are adding additional NIC to your VM - Make this new network Default, so you can... - ...remove original Network from the VM (When you say L2, I assume the new model in 4.11 that has no IP settings no VR, nothing...) This way you have performed "migration" of VM from on network to another. Kind regards, Andrija andrija.pa...@shapeblue.com www.shapeblue.com Amadeus House, Floral Street, London WC2E 9DPUK @shapeblue -Original Message- From: Adam Witwicki Sent: 06 February 2019 17:29 To: users@cloudstack.apache.org Subject: Converting a VPC Hi Everybody. Is there a way to convert a VPC to a Layer2 network to avoid me recreating all the instances? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
Converting a VPC
Hi Everybody. Is there a way to convert a VPC to a Layer2 network to avoid me recreating all the instances? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, The Manor House, Potterne, Wiltshire. SN10 5PN. Registered in England and Wales No. 5971519
RE: Local storage
Ivan, It was odd, after waiting for the jobs to clear, everything ended up working Thanks Adam -Original Message- From: Ivan Kudryavtsev Sent: 10 December 2018 18:10 To: users Subject: Re: Local storage ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam. Doesn't look like the problem is connected with local storage. Please enable the debug mode for the agent and share. Also, the corresponding log from the management server is welcome. PS: We use only local storage in our cloud, everything should work great out of the box (at least for Ubuntu 16.04). пн, 10 дек. 2018 г. в 03:59, Adam Witwicki : > Guys > > Some issues with this, I have tried to spin up an instance on local > storage - the agent then became disconnected and I have this in the > logs > > Dec 10 08:30:03 xxx sh[303588]: INFO [cloud.agent.Agent] > (Agent-Handler-4:) (logid:) Lost connection to the server. Dealing > with the remaining commands... > Dec 10 08:30:03 xxx sh[303588]: INFO [cloud.agent.Agent] > (Agent-Handler-4:) (logid:) Cannot connect because we still have 5 > commands in progress. > Dec 10 08:30:08 xxx sh[303588]: INFO [cloud.agent.Agent] > (Agent-Handler-4:) (logid:) Lost connection to the server. Dealing > with the remaining commands... > > Are the permisions correct? > > user@xxx:~$ sudo ls -l /var/lib/libvirt/images total 113465560 > -rw-r--r-- 1 root root 24601165824 Dec 10 08:21 > e5a2f086-0e61-41ff-acba-1a190c1583b0 > -rw-r--r-- 1 root root 107390828544 Dec 10 08:34 > ed9b2ed4-54f6-476d-80b4-8b78c3420a6c > > -Original Message- > From: Adam Witwicki > Sent: 07 December 2018 16:33 > To: users@cloudstack.apache.org > Subject: RE: Local storage > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > 4.11.0 > > -Original Message- > From: McClune, James > Sent: 07 December 2018 16:30 > To: users@cloudstack.apache.org > Subject: Re: Local storage > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam, > > My apologies, what version of CloudStack are you running? > > Like Ivan said, you would need to enable local storage for the zone. > > libvirt should create a local storage pool, like you stated. The UUID > & path would be in /etc/cloudstack/agent.properties. virsh pool-list > will verify. > > Best, > James > > On Fri, Dec 7, 2018 at 10:59 AM Adam Witwicki > > wrote: > > > I thought it related to this in the agent.props > > > > > > local.storage.uuid= > > local.storage.path=/var/lib/libvirt/images/ > > > > > > and enabling local storage in the zone?? > > > > The link you sent shows none of that? > > > > > > Thanks > > > > Adam > > > > -Original Message- > > From: McClune, James > > Sent: 07 December 2018 15:55 > > To: users@cloudstack.apache.org > > Subject: Re: Local storage > > > > ** This mail originated from OUTSIDE the Oakford corporate network. > > Treat hyperlinks and attachments in this email with caution. ** > > > > Hi Adam, > > > > This should do it: > > > > http://docs.cloudstack.apache.org/en/latest/adminguide/storage.html# > > us > > ing-local-storage-for-data-volumes > > > > Best, > > James > > > > On Fri, Dec 7, 2018 at 10:49 AM Adam Witwicki > > > > wrote: > > > > > Hello > > > > > > Is there a guide on how to set up local storage using KVM in > cloudstack? > > > > > > Thanks > > > > > > Adam > > > > > > > > > > > > Disclaimer Notice: > > > This email has been sent by Oakford Technology Limited, while we > > > have checked this e-mail and any attachments for viruses, we can > > > not guarantee that they are virus-free. You must therefore take > > > full responsibility for virus checking. > > > This message and any attachments are confidential and should only > > > be read by those to whom they are addressed. If you are not the > > > intended recipient, please contact us, delete the message from > > > your computer and destroy any copies. Any distribution or copying > > > without our prior permission is prohibited. > > > Internet communications are not always secure and therefore > > > Oakford Technology Limited does not accept legal responsibility > > > for this
RE: Local storage
Guys Some issues with this, I have tried to spin up an instance on local storage - the agent then became disconnected and I have this in the logs Dec 10 08:30:03 xxx sh[303588]: INFO [cloud.agent.Agent] (Agent-Handler-4:) (logid:) Lost connection to the server. Dealing with the remaining commands... Dec 10 08:30:03 xxx sh[303588]: INFO [cloud.agent.Agent] (Agent-Handler-4:) (logid:) Cannot connect because we still have 5 commands in progress. Dec 10 08:30:08 xxx sh[303588]: INFO [cloud.agent.Agent] (Agent-Handler-4:) (logid:) Lost connection to the server. Dealing with the remaining commands... Are the permisions correct? user@xxx:~$ sudo ls -l /var/lib/libvirt/images total 113465560 -rw-r--r-- 1 root root 24601165824 Dec 10 08:21 e5a2f086-0e61-41ff-acba-1a190c1583b0 -rw-r--r-- 1 root root 107390828544 Dec 10 08:34 ed9b2ed4-54f6-476d-80b4-8b78c3420a6c -Original Message- From: Adam Witwicki Sent: 07 December 2018 16:33 To: users@cloudstack.apache.org Subject: RE: Local storage ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** 4.11.0 -Original Message- From: McClune, James Sent: 07 December 2018 16:30 To: users@cloudstack.apache.org Subject: Re: Local storage ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, My apologies, what version of CloudStack are you running? Like Ivan said, you would need to enable local storage for the zone. libvirt should create a local storage pool, like you stated. The UUID & path would be in /etc/cloudstack/agent.properties. virsh pool-list will verify. Best, James On Fri, Dec 7, 2018 at 10:59 AM Adam Witwicki wrote: > I thought it related to this in the agent.props > > > local.storage.uuid= > local.storage.path=/var/lib/libvirt/images/ > > > and enabling local storage in the zone?? > > The link you sent shows none of that? > > > Thanks > > Adam > > -Original Message- > From: McClune, James > Sent: 07 December 2018 15:55 > To: users@cloudstack.apache.org > Subject: Re: Local storage > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam, > > This should do it: > > http://docs.cloudstack.apache.org/en/latest/adminguide/storage.html#us > ing-local-storage-for-data-volumes > > Best, > James > > On Fri, Dec 7, 2018 at 10:49 AM Adam Witwicki > > wrote: > > > Hello > > > > Is there a guide on how to set up local storage using KVM in cloudstack? > > > > Thanks > > > > Adam > > > > > > > > Disclaimer Notice: > > This email has been sent by Oakford Technology Limited, while we > > have checked this e-mail and any attachments for viruses, we can not > > guarantee that they are virus-free. You must therefore take full > > responsibility for virus checking. > > This message and any attachments are confidential and should only be > > read by those to whom they are addressed. If you are not the > > intended recipient, please contact us, delete the message from your > > computer and destroy any copies. Any distribution or copying without > > our prior permission is prohibited. > > Internet communications are not always secure and therefore Oakford > > Technology Limited does not accept legal responsibility for this message. > > The recipient is responsible for verifying its authenticity before > > acting on the contents. Any views or opinions presented are solely > > those of the author and do not necessarily represent those of > > Oakford > Technology Limited. > > Registered address: Oakford Technology Limited, 10 Prince Maurice > > Court, Devizes, Wiltshire. SN10 2RT. > > Registered in England and Wales No. 5971519 > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or
RE: Local storage
4.11.0 -Original Message- From: McClune, James Sent: 07 December 2018 16:30 To: users@cloudstack.apache.org Subject: Re: Local storage ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, My apologies, what version of CloudStack are you running? Like Ivan said, you would need to enable local storage for the zone. libvirt should create a local storage pool, like you stated. The UUID & path would be in /etc/cloudstack/agent.properties. virsh pool-list will verify. Best, James On Fri, Dec 7, 2018 at 10:59 AM Adam Witwicki wrote: > I thought it related to this in the agent.props > > > local.storage.uuid= > local.storage.path=/var/lib/libvirt/images/ > > > and enabling local storage in the zone?? > > The link you sent shows none of that? > > > Thanks > > Adam > > -Original Message- > From: McClune, James > Sent: 07 December 2018 15:55 > To: users@cloudstack.apache.org > Subject: Re: Local storage > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam, > > This should do it: > > http://docs.cloudstack.apache.org/en/latest/adminguide/storage.html#us > ing-local-storage-for-data-volumes > > Best, > James > > On Fri, Dec 7, 2018 at 10:49 AM Adam Witwicki > > wrote: > > > Hello > > > > Is there a guide on how to set up local storage using KVM in cloudstack? > > > > Thanks > > > > Adam > > > > > > > > Disclaimer Notice: > > This email has been sent by Oakford Technology Limited, while we > > have checked this e-mail and any attachments for viruses, we can not > > guarantee that they are virus-free. You must therefore take full > > responsibility for virus checking. > > This message and any attachments are confidential and should only be > > read by those to whom they are addressed. If you are not the > > intended recipient, please contact us, delete the message from your > > computer and destroy any copies. Any distribution or copying without > > our prior permission is prohibited. > > Internet communications are not always secure and therefore Oakford > > Technology Limited does not accept legal responsibility for this message. > > The recipient is responsible for verifying its authenticity before > > acting on the contents. Any views or opinions presented are solely > > those of the author and do not necessarily represent those of > > Oakford > Technology Limited. > > Registered address: Oakford Technology Limited, 10 Prince Maurice > > Court, Devizes, Wiltshire. SN10 2RT. > > Registered in England and Wales No. 5971519 > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, 10 Prince Maurice > Court, Devizes, Wiltshire. SN10 2RT. > Registered in England and Wales No. 5971519 > Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
RE: Local storage
Thanks Ivan -Original Message- From: Ivan Kudryavtsev Sent: 07 December 2018 16:07 To: users Subject: Re: Local storage ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Adam, EXT4, XFS work just fine. If you want to use extra features, you can use ZFS as well, as Proxmox already uses it as default and considers it as stable. We also use it in one host about 6 months without downtime. But if you are most interested in performance, then XFS, EXT4. пт, 7 дек. 2018 г. в 11:04, Adam Witwicki : > Can anyone recommend a good file system to format this local storage with? > > Thanks > > Adam > > -Original Message- > From: Adam Witwicki > Sent: 07 December 2018 16:01 > To: users@cloudstack.apache.org > Subject: RE: Local storage > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > I thought it related to this in the agent.props > > > local.storage.uuid= > local.storage.path=/var/lib/libvirt/images/ > > > and enabling local storage in the zone?? > > The link you sent shows none of that? > > > Thanks > > Adam > > -Original Message- > From: McClune, James > Sent: 07 December 2018 15:55 > To: users@cloudstack.apache.org > Subject: Re: Local storage > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam, > > This should do it: > > http://docs.cloudstack.apache.org/en/latest/adminguide/storage.html#us > ing-local-storage-for-data-volumes > > Best, > James > > On Fri, Dec 7, 2018 at 10:49 AM Adam Witwicki > > wrote: > > > Hello > > > > Is there a guide on how to set up local storage using KVM in cloudstack? > > > > Thanks > > > > Adam > > > > > > > > Disclaimer Notice: > > This email has been sent by Oakford Technology Limited, while we > > have checked this e-mail and any attachments for viruses, we can not > > guarantee that they are virus-free. You must therefore take full > > responsibility for virus checking. > > This message and any attachments are confidential and should only be > > read by those to whom they are addressed. If you are not the > > intended recipient, please contact us, delete the message from your > > computer and destroy any copies. Any distribution or copying without > > our prior permission is prohibited. > > Internet communications are not always secure and therefore Oakford > > Technology Limited does not accept legal responsibility for this message. > > The recipient is responsible for verifying its authenticity before > > acting on the contents. Any views or opinions presented are solely > > those of the author and do not necessarily represent those of > > Oakford > Technology Limited. > > Registered address: Oakford Technology Limited, 10 Prince Maurice > > Court, Devizes, Wiltshire. SN10 2RT. > > Registered in England and Wales No. 5971519 > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, 10 Prince Maurice > Court, Devizes, Wiltshire. SN10 2RT. > Registered in England and Wales No. 5971519 > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete
RE: Local storage
Can anyone recommend a good file system to format this local storage with? Thanks Adam -Original Message- From: Adam Witwicki Sent: 07 December 2018 16:01 To: users@cloudstack.apache.org Subject: RE: Local storage ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** I thought it related to this in the agent.props local.storage.uuid= local.storage.path=/var/lib/libvirt/images/ and enabling local storage in the zone?? The link you sent shows none of that? Thanks Adam -Original Message- From: McClune, James Sent: 07 December 2018 15:55 To: users@cloudstack.apache.org Subject: Re: Local storage ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, This should do it: http://docs.cloudstack.apache.org/en/latest/adminguide/storage.html#using-local-storage-for-data-volumes Best, James On Fri, Dec 7, 2018 at 10:49 AM Adam Witwicki wrote: > Hello > > Is there a guide on how to set up local storage using KVM in cloudstack? > > Thanks > > Adam > > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, 10 Prince Maurice > Court, Devizes, Wiltshire. SN10 2RT. > Registered in England and Wales No. 5971519 > Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
RE: Local storage
I thought it related to this in the agent.props local.storage.uuid= local.storage.path=/var/lib/libvirt/images/ and enabling local storage in the zone?? The link you sent shows none of that? Thanks Adam -Original Message- From: McClune, James Sent: 07 December 2018 15:55 To: users@cloudstack.apache.org Subject: Re: Local storage ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, This should do it: http://docs.cloudstack.apache.org/en/latest/adminguide/storage.html#using-local-storage-for-data-volumes Best, James On Fri, Dec 7, 2018 at 10:49 AM Adam Witwicki wrote: > Hello > > Is there a guide on how to set up local storage using KVM in cloudstack? > > Thanks > > Adam > > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, 10 Prince Maurice > Court, Devizes, Wiltshire. SN10 2RT. > Registered in England and Wales No. 5971519 > Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
Local storage
Hello Is there a guide on how to set up local storage using KVM in cloudstack? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
RE: Help
Andrija, You are correct, I was assuming I only used nfs on secondary storage, I also have primary nfs storage for the VR system offering, Doh I feel that modifying the script to shout a lot and not reboot will help us in the first instance Thanks :) Adam -Original Message- From: Andrija Panic Sent: 27 November 2018 12:07 To: users Subject: Re: Help ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** /usr/share/cloudstack-common/scripts/vm/hypervisor/kvm/kvmheartbeat.sh comment the 6th from the bottom line: echo b > /proc/sysrq-trigger That stops reboot process - been there, done that for years now :) But then investigate what is going on - since it's not "normal" to trigger this script (reboot actually) in healthy environment. FYI, there is no such heartbeat checks for CEPH, afaik. It's strange, that this also affects Secondary Storage NFS - I had idea it's only made for Primary Storage - actually I'm almost sure it's NOT checking Secondary Storage, since on PRimary NFS there is automatically created folder KVMHA, and inside it a file for each KVM node which should be updated (modification time) revery minute if KVM can access the NFS... Cheers On Tue, 27 Nov 2018 at 12:56, Adam Witwicki wrote: > There seems to have been an issue with connectivity on a host that was > causing the VRs to silently fail. > > How can I stop this script rebooting when it detects an issue with NFS? > Would setting up another NFS pool work? > > Nov 27 08:23:41 OIS-MH-P1-C1-H1-C heartbeat: kvmheartbeat.sh rebooted > system because it was unable to write the heartbeat to the storage. > > > Thanks > > Adam > > -Original Message- > From: Adam Witwicki > Sent: 27 November 2018 11:09 > To: users@cloudstack.apache.org > Subject: RE: Help > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Swen > > I use ceph for primary storage > And NFS for secondary storage > > Using KVM hosts I got this error > Nov 27 08:23:41 OIS-MH-P1-C1-H1-C heartbeat: kvmheartbeat.sh rebooted > system because it was unable to write the heartbeat to the storage. > > I fixed the issue with NFS > And now a lot of instances are stuck in starting state, after the > hosts went into a reboot flap > > Thanks > > Adam > > -Original Message- > From: Swen - swen.io > Sent: 27 November 2018 11:05 > To: users@cloudstack.apache.org > Subject: AW: Help > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam, > > can you please explain a little bit more why your VR are stuck because > of your problem with secondary storage? Are you using the same storage > as primary storage for your VRs? > Is the problem already fixed with your secondary storage? Can you > restart a network? > > Cu Swen > > -Ursprüngliche Nachricht- > Von: Adam Witwicki > Gesendet: Dienstag, 27. November 2018 11:12 > An: users@cloudstack.apache.org > Betreff: RE: Help > > > Hi Guys > > All my hosts went down due to a delay in writing to secondary nfs > storage, I have a lot of Virtual Routers in a stuck starting state. > > Any tips? > > Thanks > > Adam > > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, 10 Prince Maurice > Court, Devizes, Wiltshire. SN10 2RT. > Registered in England and Wales No. 5971519 > > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are vir
RE: Help
There seems to have been an issue with connectivity on a host that was causing the VRs to silently fail. How can I stop this script rebooting when it detects an issue with NFS? Would setting up another NFS pool work? Nov 27 08:23:41 OIS-MH-P1-C1-H1-C heartbeat: kvmheartbeat.sh rebooted system because it was unable to write the heartbeat to the storage. Thanks Adam -Original Message- From: Adam Witwicki Sent: 27 November 2018 11:09 To: users@cloudstack.apache.org Subject: RE: Help ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Swen I use ceph for primary storage And NFS for secondary storage Using KVM hosts I got this error Nov 27 08:23:41 OIS-MH-P1-C1-H1-C heartbeat: kvmheartbeat.sh rebooted system because it was unable to write the heartbeat to the storage. I fixed the issue with NFS And now a lot of instances are stuck in starting state, after the hosts went into a reboot flap Thanks Adam -Original Message- From: Swen - swen.io Sent: 27 November 2018 11:05 To: users@cloudstack.apache.org Subject: AW: Help ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, can you please explain a little bit more why your VR are stuck because of your problem with secondary storage? Are you using the same storage as primary storage for your VRs? Is the problem already fixed with your secondary storage? Can you restart a network? Cu Swen -Ursprüngliche Nachricht- Von: Adam Witwicki Gesendet: Dienstag, 27. November 2018 11:12 An: users@cloudstack.apache.org Betreff: RE: Help Hi Guys All my hosts went down due to a delay in writing to secondary nfs storage, I have a lot of Virtual Routers in a stuck starting state. Any tips? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered
RE: Help
The VRs are now up, except for a flappy HA router Instances are still stuck -Original Message- From: Andrija Panic Sent: 27 November 2018 11:05 To: users Subject: Re: Help ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Can you restart VRs, or complete VPC (if VPC) or Restart Network (if isolated network, etc) there is also script for restarting VRs and CPVM and SSVM (i.e. after ACS upgrade) if you have many of them. cloudstack-sysvmadm -d -u cloud -p -s hope that helps... Andrija On Tue, 27 Nov 2018 at 11:11, Adam Witwicki wrote: > > Hi Guys > > All my hosts went down due to a delay in writing to secondary nfs > storage, I have a lot of Virtual Routers in a stuck starting state. > > Any tips? > > Thanks > > Adam > > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, 10 Prince Maurice > Court, Devizes, Wiltshire. SN10 2RT. > Registered in England and Wales No. 5971519 > > -- Andrija Panić Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
RE: Help
Hi Swen I use ceph for primary storage And NFS for secondary storage Using KVM hosts I got this error Nov 27 08:23:41 OIS-MH-P1-C1-H1-C heartbeat: kvmheartbeat.sh rebooted system because it was unable to write the heartbeat to the storage. I fixed the issue with NFS And now a lot of instances are stuck in starting state, after the hosts went into a reboot flap Thanks Adam -Original Message- From: Swen - swen.io Sent: 27 November 2018 11:05 To: users@cloudstack.apache.org Subject: AW: Help ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, can you please explain a little bit more why your VR are stuck because of your problem with secondary storage? Are you using the same storage as primary storage for your VRs? Is the problem already fixed with your secondary storage? Can you restart a network? Cu Swen -Ursprüngliche Nachricht- Von: Adam Witwicki Gesendet: Dienstag, 27. November 2018 11:12 An: users@cloudstack.apache.org Betreff: RE: Help Hi Guys All my hosts went down due to a delay in writing to secondary nfs storage, I have a lot of Virtual Routers in a stuck starting state. Any tips? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
RE: Help
Hi Guys All my hosts went down due to a delay in writing to secondary nfs storage, I have a lot of Virtual Routers in a stuck starting state. Any tips? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
RE: Guest DHCP issue
Sorted with sudo ufw default allow FORWARD Thanks guys :) -Original Message- From: Adam Witwicki Sent: 16 November 2018 09:35 To: users@cloudstack.apache.org Subject: Guest DHCP issue ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello I have recently added 2 new hosts to our cluster, but ran into an issue where guests do not receive a DHCP lease from the virtual router. If I set the interface as static I can ping the router and all networking is fine. I'm sure must have missed a configuration step. Any ideas? CS version 4.11.0.0 libvirtd (libvirt) 1.3.1 Ubuntu 16.04 bridge-utils, 1.5 Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
RE: Guest DHCP issue
Its related to UFW, if I disable that on the host it works, but all the rules look the same between hosts? Thanks Adam -Original Message- From: Adam Witwicki Sent: 16 November 2018 09:35 To: users@cloudstack.apache.org Subject: Guest DHCP issue ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello I have recently added 2 new hosts to our cluster, but ran into an issue where guests do not receive a DHCP lease from the virtual router. If I set the interface as static I can ping the router and all networking is fine. I'm sure must have missed a configuration step. Any ideas? CS version 4.11.0.0 libvirtd (libvirt) 1.3.1 Ubuntu 16.04 bridge-utils, 1.5 Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
Guest DHCP issue
Hello I have recently added 2 new hosts to our cluster, but ran into an issue where guests do not receive a DHCP lease from the virtual router. If I set the interface as static I can ping the router and all networking is fine. I'm sure must have missed a configuration step. Any ideas? CS version 4.11.0.0 libvirtd (libvirt) 1.3.1 Ubuntu 16.04 bridge-utils, 1.5 Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
RE: Disk controller type
Andrija, It seems to be an issue with windows, it won't correctly add the driver for virtio until a device exists. I tried may times right clicking on the inf files, and selecting install then rebooting, in safe mode etc, with different BCDedit values, all failed to boot windows. But hot-adding a virtio disk (and controller) and then installing the drivers worked repeatedly. The old tricks of the XP days changing from IDE to SATA controllers no longer seem to work ;) Thanks Adam -Original Message- From: Andrija Panic Sent: 26 September 2018 13:50 To: users Subject: Re: Disk controller type ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, Glad you solved the problem! But I need to say this work sounds "crazy" in a sense that this is not (per my knowledge) how it should be done "properly". Im wondering if this is something in 4.11 that makes you make such workaround... Anyway, glad you worked it out. Cheers On Wed, Sep 26, 2018, 04:39 Adam Witwicki wrote: > Ok Guys, I have cracked it - this is for 4.11 but should work on most > versions > > To change the controller type of an existing windows 2012 and 2016 > server from IDE ATA to virtio do the following > > > On the Host > > Create an empty disk > dd if=/dev/zero of=/home/user/blank.img bs=1M count=4096 > > Create a device xml file for a virtio disk /home/user/virtodisk.xml > with the following contains > > > > > > > > > > > Attach this disk to the running VM > > Virsh > attach-device /home/user/virtodisk.xml exit > > insert the Virtio Driver iso and install drivers on VM > > Shutdown VM using cloudstack control (stop instance) > > Add the following to the “user_vm_detail” table in the database, where > XXX is the 3 digits in the internal VM name i-83-XXX-VM > > INSERT INTO `user_vm_details` (`vm_id`, `name`, `value`, `display`) > VALUES (xxx, 'rootDiskController', 'virtio', 1); > > Start the VM and all is good > > > Thanks for everyone's help and suggestions > > Adam > > > -Original Message- > From: Andrija Panic > Sent: 21 September 2018 16:50 > To: users > Subject: Re: Disk controller type > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Or in other words, again based on ACS 4.8, simply use Windows PV as > the OS type, but make sure that you have a clean driver install > process in your head - if install windows from zero - that is simple, > just detach win.iso,attach virtidrivers ISO file and load scsi > drivers... later install network Virtio etc :) > > But if converting existing IDE version of Windows, make some tests > with /detecthal to avoid long downtime :) > > On Fri, Sep 21, 2018, 16:14 Simon Weller wrote: > > > Your two options are virtio blk or virtio-scsi. If your imported VM > > doesn't have the correct controller specified, you're going to have > > to modify it before enabling virtio in libvirt. > > > > Check out this guide: > > https://access.redhat.com/articles/2470791#installing-the-kvm-window > > s- > > virtio-drivers-5 > > > > > > > > > > From: Adam Witwicki > > Sent: Friday, September 21, 2018 5:28 AM > > To: users@cloudstack.apache.org > > Subject: RE: Disk controller type > > > > Win 2016 doesn’t use Virtio by default, but we need too as disk > > performance is rubbish if we don’t > > > > > > > > > > -Original Message- > > From: Andrija Panic > > Sent: 21 September 2018 11:25 > > To: users > > Subject: Re: Disk controller type > > > > ** This mail originated from OUTSIDE the Oakford corporate network. > > Treat hyperlinks and attachments in this email with caution. ** > > > > Hrm... Im mot aware of Windows 2016 OS type, that is probably in > > newer version of ACS, so far, up to Windows 2012 OS type, it was all IDE... > > > > Can you do silly check with either 'ps aux | grep VMNAME' or with > > 'virsh dumpxml VMNAME' so we see what controller type is used. > > > > I have hard time believing that Win 2016 OS type would use Virtio by > > default, since afaik no Virtio drivers are builtin inaide Windows by > > default (in contrast to Hype-V drivers being available in stock > > Linux kernel for some tome now :) ) > > > > > > On Fri, Sep 21, 2018, 10:31 Adam Witwicki >
RE: Disk controller type
Ok Guys, I have cracked it - this is for 4.11 but should work on most versions To change the controller type of an existing windows 2012 and 2016 server from IDE ATA to virtio do the following On the Host Create an empty disk dd if=/dev/zero of=/home/user/blank.img bs=1M count=4096 Create a device xml file for a virtio disk /home/user/virtodisk.xml with the following contains Attach this disk to the running VM Virsh attach-device /home/user/virtodisk.xml exit insert the Virtio Driver iso and install drivers on VM Shutdown VM using cloudstack control (stop instance) Add the following to the “user_vm_detail” table in the database, where XXX is the 3 digits in the internal VM name i-83-XXX-VM INSERT INTO `user_vm_details` (`vm_id`, `name`, `value`, `display`) VALUES (xxx, 'rootDiskController', 'virtio', 1); Start the VM and all is good Thanks for everyone's help and suggestions Adam -Original Message- From: Andrija Panic Sent: 21 September 2018 16:50 To: users Subject: Re: Disk controller type ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Or in other words, again based on ACS 4.8, simply use Windows PV as the OS type, but make sure that you have a clean driver install process in your head - if install windows from zero - that is simple, just detach win.iso,attach virtidrivers ISO file and load scsi drivers... later install network Virtio etc :) But if converting existing IDE version of Windows, make some tests with /detecthal to avoid long downtime :) On Fri, Sep 21, 2018, 16:14 Simon Weller wrote: > Your two options are virtio blk or virtio-scsi. If your imported VM > doesn't have the correct controller specified, you're going to have to > modify it before enabling virtio in libvirt. > > Check out this guide: > https://access.redhat.com/articles/2470791#installing-the-kvm-windows- > virtio-drivers-5 > > > > > From: Adam Witwicki > Sent: Friday, September 21, 2018 5:28 AM > To: users@cloudstack.apache.org > Subject: RE: Disk controller type > > Win 2016 doesn’t use Virtio by default, but we need too as disk > performance is rubbish if we don’t > > > > > -Original Message- > From: Andrija Panic > Sent: 21 September 2018 11:25 > To: users > Subject: Re: Disk controller type > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hrm... Im mot aware of Windows 2016 OS type, that is probably in newer > version of ACS, so far, up to Windows 2012 OS type, it was all IDE... > > Can you do silly check with either 'ps aux | grep VMNAME' or with > 'virsh dumpxml VMNAME' so we see what controller type is used. > > I have hard time believing that Win 2016 OS type would use Virtio by > default, since afaik no Virtio drivers are builtin inaide Windows by > default (in contrast to Hype-V drivers being available in stock Linux > kernel for some tome now :) ) > > > On Fri, Sep 21, 2018, 10:31 Adam Witwicki wrote: > > > Andrija, > > > > I have something weird, I have a template which uses the OS type of > > Windows Server 2016 (64-bit), this was imported into Cloudstack and > > this template uses a VirtIO controller I have another template that > > was created from a disk also with OS type of Windows Server 2016 > > (64-bit) but has an ID controller. > > > > I am trying to work out why this happened and now I can make the > > disk template always select the VirtIO controller. > > Setting the instance to windows PV causes BSOD on boot, well before > > hal can be redetected > > > > > > Thanks > > > > Adam > > > > -Original Message- > > From: Andrija Panic > > Sent: 20 September 2018 11:18 > > To: users > > Subject: Re: Disk controller type > > > > ** This mail originated from OUTSIDE the Oakford corporate network. > > Treat hyperlinks and attachments in this email with caution. ** > > > > Sooo... here is my experience: > > > > if using correct VirtIO OS TYPE (set on template/VM) - i.e. ubuntu > > 14.04, Centos 6.x or 7.x, Windows PV, other PV (but NOT centos 6.0 > > or > > 7.0 - these "dot zero" versions are NOT virtio at least in ACS 4.8), > > then when VM is STARTED FROM ACS (power on VM) - all drives should > > be > attached as VirtIO. > > > > BUT if you do same as above, then additionally create and HOTPLUG > > new drives/volumes to KVM - it will be IDE - some strange default
RE: Disk controller type
Win 2016 doesn’t use Virtio by default, but we need too as disk performance is rubbish if we don’t -Original Message- From: Andrija Panic Sent: 21 September 2018 11:25 To: users Subject: Re: Disk controller type ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hrm... Im mot aware of Windows 2016 OS type, that is probably in newer version of ACS, so far, up to Windows 2012 OS type, it was all IDE... Can you do silly check with either 'ps aux | grep VMNAME' or with 'virsh dumpxml VMNAME' so we see what controller type is used. I have hard time believing that Win 2016 OS type would use Virtio by default, since afaik no Virtio drivers are builtin inaide Windows by default (in contrast to Hype-V drivers being available in stock Linux kernel for some tome now :) ) On Fri, Sep 21, 2018, 10:31 Adam Witwicki wrote: > Andrija, > > I have something weird, I have a template which uses the OS type of > Windows Server 2016 (64-bit), this was imported into Cloudstack and > this template uses a VirtIO controller I have another template that > was created from a disk also with OS type of Windows Server 2016 > (64-bit) but has an ID controller. > > I am trying to work out why this happened and now I can make the disk > template always select the VirtIO controller. > Setting the instance to windows PV causes BSOD on boot, well before > hal can be redetected > > > Thanks > > Adam > > -Original Message- > From: Andrija Panic > Sent: 20 September 2018 11:18 > To: users > Subject: Re: Disk controller type > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Sooo... here is my experience: > > if using correct VirtIO OS TYPE (set on template/VM) - i.e. ubuntu > 14.04, Centos 6.x or 7.x, Windows PV, other PV (but NOT centos 6.0 or > 7.0 - these "dot zero" versions are NOT virtio at least in ACS 4.8), > then when VM is STARTED FROM ACS (power on VM) - all drives should be > attached as VirtIO. > > BUT if you do same as above, then additionally create and HOTPLUG new > drives/volumes to KVM - it will be IDE - some strange default behavior > during hotplug action just stop VM/start and it will become VirtIO > again... > > In order to "troubleshoot" these instances - you need to be careful to > which OS TYPE was the instance set to (this is inherited from > TEMPLATE, if you used some template - but it CAN be changed on an > deployed&&stopped > instance) > > In case you plan to i.e. move your Windows instances from IDE to > VirtIO - be aware that it might fail miserably, and OS will fail to > boot - but there is a fix with *"* bcdedit /set detecthal boolean > (where boolean is one of 1, on, yes or true) " after which Windows > will detect HAL again and boot just fine. > > Let me know if more help needed > > Cheers > > On Thu, 20 Sep 2018 at 11:22, Adam Witwicki > wrote: > > > > > > > It looks like I can just add > > > > rootDiskController virtio > > > > To the templates settings tab? > > > > Can anyone confirm? > > > > Thanks > > > > Adam > > > > -Original Message- > > From: Ivan Kudryavtsev > > Sent: 20 September 2018 10:20 > > To: users > > Subject: Re: Disk controller type > > > > ** This mail originated from OUTSIDE the Oakford corporate network. > > Treat hyperlinks and attachments in this email with caution. ** > > > > Rakesh, It doesn't work like that for CS as it uses stateless XML > configs. > > > > чт, 20 сент. 2018 г., 16:12 Rakesh Venkatesh > > >: > > > > > I think you can change the controller type in XML file of the VM > > > but not sure if that works or not. > > > > > > virsh dumpxml > > > virsh edit > > > change the controller type, save and start the vm again > > > > > > On Thu, Sep 20, 2018 at 9:59 AM Adam Witwicki > > > > > > wrote: > > > > > > > Hello, > > > > > > > > I have a number of of instances using the wrong controller type > > > > (ATA) > > > does > > > > anyone know where this is set in the database so I can start > > > > them with > > > the > > > > VirtIO scsi controller? > > > > > > > > Thanks > > > > > > > > Adam > > > > > > > > > > > > > > > > > > > > Disclaimer No
RE: Disk controller type
That didn’t format correctly Set this is the user_vm_details table Idvm_id name valuedisplay 3625 201rootDiskController virtio 1 -Original Message- From: Adam Witwicki Sent: 21 September 2018 10:59 To: users@cloudstack.apache.org Subject: RE: Disk controller type ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Ok, I have found were to force the controller type for a VM Set this is the user_vm_details table idvm_idnamevaluedisplay 3625201rootDiskControllervirtio1 My issue now is slipstreaming the windows ISO and the operating system bcdedit /set detecthal Boolean 1 isnt working for me Thanks Adam -Original Message- From: Adam Witwicki Sent: 21 September 2018 09:31 To: users@cloudstack.apache.org Subject: RE: Disk controller type ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Andrija, I have something weird, I have a template which uses the OS type of Windows Server 2016 (64-bit), this was imported into Cloudstack and this template uses a VirtIO controller I have another template that was created from a disk also with OS type of Windows Server 2016 (64-bit) but has an ID controller. I am trying to work out why this happened and now I can make the disk template always select the VirtIO controller. Setting the instance to windows PV causes BSOD on boot, well before hal can be redetected Thanks Adam -Original Message- From: Andrija Panic Sent: 20 September 2018 11:18 To: users Subject: Re: Disk controller type ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Sooo... here is my experience: if using correct VirtIO OS TYPE (set on template/VM) - i.e. ubuntu 14.04, Centos 6.x or 7.x, Windows PV, other PV (but NOT centos 6.0 or 7.0 - these "dot zero" versions are NOT virtio at least in ACS 4.8), then when VM is STARTED FROM ACS (power on VM) - all drives should be attached as VirtIO. BUT if you do same as above, then additionally create and HOTPLUG new drives/volumes to KVM - it will be IDE - some strange default behavior during hotplug action just stop VM/start and it will become VirtIO again... In order to "troubleshoot" these instances - you need to be careful to which OS TYPE was the instance set to (this is inherited from TEMPLATE, if you used some template - but it CAN be changed on an deployed&&stopped instance) In case you plan to i.e. move your Windows instances from IDE to VirtIO - be aware that it might fail miserably, and OS will fail to boot - but there is a fix with *"* bcdedit /set detecthal boolean (where boolean is one of 1, on, yes or true) " after which Windows will detect HAL again and boot just fine. Let me know if more help needed Cheers On Thu, 20 Sep 2018 at 11:22, Adam Witwicki wrote: > > > It looks like I can just add > > rootDiskController virtio > > To the templates settings tab? > > Can anyone confirm? > > Thanks > > Adam > > -Original Message- > From: Ivan Kudryavtsev > Sent: 20 September 2018 10:20 > To: users > Subject: Re: Disk controller type > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Rakesh, It doesn't work like that for CS as it uses stateless XML configs. > > чт, 20 сент. 2018 г., 16:12 Rakesh Venkatesh : > > > I think you can change the controller type in XML file of the VM but > > not sure if that works or not. > > > > virsh dumpxml > > virsh edit > > change the controller type, save and start the vm again > > > > On Thu, Sep 20, 2018 at 9:59 AM Adam Witwicki > > > > wrote: > > > > > Hello, > > > > > > I have a number of of instances using the wrong controller type > > > (ATA) > > does > > > anyone know where this is set in the database so I can start them > > > with > > the > > > VirtIO scsi controller? > > > > > > Thanks > > > > > > Adam > > > > > > > > > > > > > > > Disclaimer Notice: > > > This email has been sent by Oakford Technology Limited, while we > > > have checked this e-mail and any attachments for viruses, we can > > > not guarantee that they are virus-free. You must therefore take > > > full responsibility for virus checking. > > > This message and any attachments are confidential and should only > > > be read by those to whom they are addressed. If you are not the > > &
RE: Disk controller type
Ok, I have found were to force the controller type for a VM Set this is the user_vm_details table idvm_idnamevaluedisplay 3625201rootDiskControllervirtio1 My issue now is slipstreaming the windows ISO and the operating system bcdedit /set detecthal Boolean 1 isnt working for me Thanks Adam -Original Message- From: Adam Witwicki Sent: 21 September 2018 09:31 To: users@cloudstack.apache.org Subject: RE: Disk controller type ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Andrija, I have something weird, I have a template which uses the OS type of Windows Server 2016 (64-bit), this was imported into Cloudstack and this template uses a VirtIO controller I have another template that was created from a disk also with OS type of Windows Server 2016 (64-bit) but has an ID controller. I am trying to work out why this happened and now I can make the disk template always select the VirtIO controller. Setting the instance to windows PV causes BSOD on boot, well before hal can be redetected Thanks Adam -Original Message- From: Andrija Panic Sent: 20 September 2018 11:18 To: users Subject: Re: Disk controller type ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Sooo... here is my experience: if using correct VirtIO OS TYPE (set on template/VM) - i.e. ubuntu 14.04, Centos 6.x or 7.x, Windows PV, other PV (but NOT centos 6.0 or 7.0 - these "dot zero" versions are NOT virtio at least in ACS 4.8), then when VM is STARTED FROM ACS (power on VM) - all drives should be attached as VirtIO. BUT if you do same as above, then additionally create and HOTPLUG new drives/volumes to KVM - it will be IDE - some strange default behavior during hotplug action just stop VM/start and it will become VirtIO again... In order to "troubleshoot" these instances - you need to be careful to which OS TYPE was the instance set to (this is inherited from TEMPLATE, if you used some template - but it CAN be changed on an deployed&&stopped instance) In case you plan to i.e. move your Windows instances from IDE to VirtIO - be aware that it might fail miserably, and OS will fail to boot - but there is a fix with *"* bcdedit /set detecthal boolean (where boolean is one of 1, on, yes or true) " after which Windows will detect HAL again and boot just fine. Let me know if more help needed Cheers On Thu, 20 Sep 2018 at 11:22, Adam Witwicki wrote: > > > It looks like I can just add > > rootDiskController virtio > > To the templates settings tab? > > Can anyone confirm? > > Thanks > > Adam > > -Original Message- > From: Ivan Kudryavtsev > Sent: 20 September 2018 10:20 > To: users > Subject: Re: Disk controller type > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Rakesh, It doesn't work like that for CS as it uses stateless XML configs. > > чт, 20 сент. 2018 г., 16:12 Rakesh Venkatesh : > > > I think you can change the controller type in XML file of the VM but > > not sure if that works or not. > > > > virsh dumpxml > > virsh edit > > change the controller type, save and start the vm again > > > > On Thu, Sep 20, 2018 at 9:59 AM Adam Witwicki > > > > wrote: > > > > > Hello, > > > > > > I have a number of of instances using the wrong controller type > > > (ATA) > > does > > > anyone know where this is set in the database so I can start them > > > with > > the > > > VirtIO scsi controller? > > > > > > Thanks > > > > > > Adam > > > > > > > > > > > > > > > Disclaimer Notice: > > > This email has been sent by Oakford Technology Limited, while we > > > have checked this e-mail and any attachments for viruses, we can > > > not guarantee that they are virus-free. You must therefore take > > > full responsibility for virus checking. > > > This message and any attachments are confidential and should only > > > be read by those to whom they are addressed. If you are not the > > > intended > > recipient, > > > please contact us, delete the message from your computer and > > > destroy any copies. Any distribution or copying without our prior > > > permission is prohibited. > > > Internet communications are not always secure and therefore > > > Oakford Technology Limited does not accept legal responsibility > > > for this > message. > > > The recipient is res
RE: Disk controller type
Andrija, I have something weird, I have a template which uses the OS type of Windows Server 2016 (64-bit), this was imported into Cloudstack and this template uses a VirtIO controller I have another template that was created from a disk also with OS type of Windows Server 2016 (64-bit) but has an ID controller. I am trying to work out why this happened and now I can make the disk template always select the VirtIO controller. Setting the instance to windows PV causes BSOD on boot, well before hal can be redetected Thanks Adam -Original Message- From: Andrija Panic Sent: 20 September 2018 11:18 To: users Subject: Re: Disk controller type ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Sooo... here is my experience: if using correct VirtIO OS TYPE (set on template/VM) - i.e. ubuntu 14.04, Centos 6.x or 7.x, Windows PV, other PV (but NOT centos 6.0 or 7.0 - these "dot zero" versions are NOT virtio at least in ACS 4.8), then when VM is STARTED FROM ACS (power on VM) - all drives should be attached as VirtIO. BUT if you do same as above, then additionally create and HOTPLUG new drives/volumes to KVM - it will be IDE - some strange default behavior during hotplug action just stop VM/start and it will become VirtIO again... In order to "troubleshoot" these instances - you need to be careful to which OS TYPE was the instance set to (this is inherited from TEMPLATE, if you used some template - but it CAN be changed on an deployed&&stopped instance) In case you plan to i.e. move your Windows instances from IDE to VirtIO - be aware that it might fail miserably, and OS will fail to boot - but there is a fix with *"* bcdedit /set detecthal boolean (where boolean is one of 1, on, yes or true) " after which Windows will detect HAL again and boot just fine. Let me know if more help needed Cheers On Thu, 20 Sep 2018 at 11:22, Adam Witwicki wrote: > > > It looks like I can just add > > rootDiskController virtio > > To the templates settings tab? > > Can anyone confirm? > > Thanks > > Adam > > -Original Message- > From: Ivan Kudryavtsev > Sent: 20 September 2018 10:20 > To: users > Subject: Re: Disk controller type > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Rakesh, It doesn't work like that for CS as it uses stateless XML configs. > > чт, 20 сент. 2018 г., 16:12 Rakesh Venkatesh : > > > I think you can change the controller type in XML file of the VM but > > not sure if that works or not. > > > > virsh dumpxml > > virsh edit > > change the controller type, save and start the vm again > > > > On Thu, Sep 20, 2018 at 9:59 AM Adam Witwicki > > > > wrote: > > > > > Hello, > > > > > > I have a number of of instances using the wrong controller type > > > (ATA) > > does > > > anyone know where this is set in the database so I can start them > > > with > > the > > > VirtIO scsi controller? > > > > > > Thanks > > > > > > Adam > > > > > > > > > > > > > > > Disclaimer Notice: > > > This email has been sent by Oakford Technology Limited, while we > > > have checked this e-mail and any attachments for viruses, we can > > > not guarantee that they are virus-free. You must therefore take > > > full responsibility for virus checking. > > > This message and any attachments are confidential and should only > > > be read by those to whom they are addressed. If you are not the > > > intended > > recipient, > > > please contact us, delete the message from your computer and > > > destroy any copies. Any distribution or copying without our prior > > > permission is prohibited. > > > Internet communications are not always secure and therefore > > > Oakford Technology Limited does not accept legal responsibility > > > for this > message. > > > The recipient is responsible for verifying its authenticity before > > > acting on the contents. Any views or opinions presented are solely > > > those of the author and do not necessarily represent those of > > > Oakford Technology > > Limited. > > > Registered address: Oakford Technology Limited, 10 Prince Maurice > > > Court, Devizes, Wiltshire. SN10 2RT. > > > Registered in England and Wales No. 5971519 > > > > > > > > > > -- > > Thanks and regards > > Rakesh venkatesh > > > Disclai
RE: Disk controller type
It looks like I can just add rootDiskController virtio To the templates settings tab? Can anyone confirm? Thanks Adam -Original Message- From: Ivan Kudryavtsev Sent: 20 September 2018 10:20 To: users Subject: Re: Disk controller type ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Rakesh, It doesn't work like that for CS as it uses stateless XML configs. чт, 20 сент. 2018 г., 16:12 Rakesh Venkatesh : > I think you can change the controller type in XML file of the VM but > not sure if that works or not. > > virsh dumpxml > virsh edit > change the controller type, save and start the vm again > > On Thu, Sep 20, 2018 at 9:59 AM Adam Witwicki > > wrote: > > > Hello, > > > > I have a number of of instances using the wrong controller type > > (ATA) > does > > anyone know where this is set in the database so I can start them > > with > the > > VirtIO scsi controller? > > > > Thanks > > > > Adam > > > > > > > > > > Disclaimer Notice: > > This email has been sent by Oakford Technology Limited, while we > > have checked this e-mail and any attachments for viruses, we can not > > guarantee that they are virus-free. You must therefore take full > > responsibility for virus checking. > > This message and any attachments are confidential and should only be > > read by those to whom they are addressed. If you are not the > > intended > recipient, > > please contact us, delete the message from your computer and destroy > > any copies. Any distribution or copying without our prior permission > > is prohibited. > > Internet communications are not always secure and therefore Oakford > > Technology Limited does not accept legal responsibility for this message. > > The recipient is responsible for verifying its authenticity before > > acting on the contents. Any views or opinions presented are solely > > those of the author and do not necessarily represent those of > > Oakford Technology > Limited. > > Registered address: Oakford Technology Limited, 10 Prince Maurice > > Court, Devizes, Wiltshire. SN10 2RT. > > Registered in England and Wales No. 5971519 > > > > > > -- > Thanks and regards > Rakesh venkatesh > Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
Disk controller type
Hello, I have a number of of instances using the wrong controller type (ATA) does anyone know where this is set in the database so I can start them with the VirtIO scsi controller? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
RE: Removing a rule from VCP router
Ignore me, its not an iptables issue Thanks Adam -Original Message- From: Adam Witwicki Sent: 01 August 2018 13:41 To: users@cloudstack.apache.org Subject: RE: Removing a rule from VCP router ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Dan I need to allow DHCP requests from a private gateway to the servers in cloudstack. It MUST be persistent. Thanks Adam -Original Message- From: Dag Sonstebo Sent: 01 August 2018 13:38 To: users@cloudstack.apache.org Subject: Re: Removing a rule from VCP router ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, I assume you are asking as the rule in question can’t be changed from the cloudstack GUI? If so the easiest is: iptables-save > myrules edit myrules iptables-restore < myrules Just keep in mind the change will not be persistent across VR restarts. Regards, Dag Sonstebo Cloud Architect ShapeBlue On 01/08/2018, 13:18, "Adam Witwicki" wrote: Hello I need to remove a rule in Chain INPUT (policy drop) from my VPC build, what is the best way to do this? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519 dag.sonst...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
RE: Removing a rule from VCP router
Hi Dan I need to allow DHCP requests from a private gateway to the servers in cloudstack. It MUST be persistent. Thanks Adam -Original Message- From: Dag Sonstebo Sent: 01 August 2018 13:38 To: users@cloudstack.apache.org Subject: Re: Removing a rule from VCP router ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, I assume you are asking as the rule in question can’t be changed from the cloudstack GUI? If so the easiest is: iptables-save > myrules edit myrules iptables-restore < myrules Just keep in mind the change will not be persistent across VR restarts. Regards, Dag Sonstebo Cloud Architect ShapeBlue On 01/08/2018, 13:18, "Adam Witwicki" wrote: Hello I need to remove a rule in Chain INPUT (policy drop) from my VPC build, what is the best way to do this? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519 dag.sonst...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
Removing a rule from VCP router
Hello I need to remove a rule in Chain INPUT (policy drop) from my VPC build, what is the best way to do this? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
VPC static NAT with Private gateways
Hello If we add a static nat to a server in a VPC, after a while it is unable to route to the Private gateways assigned in the same VPC. Has anyone else seen this? Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
VPC ACLs SRC and DST
Hello Is there a way we can add the DST IP to the ACL lists in a VPC as well as the SRC IP (outbound) Thanks Adam Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
RE: Unable to upload volumes 4.11.0
Hi Paul That was accepted but returned this error, cert issue. Failed to upload volume: e6638e70-f346-4a98-aab7-91046e9fcfc7 with error: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target Yet I am able to import as a template from the same source.? A confusing one Thanks Adam -Original Message- From: Paul Angus Sent: 16 July 2018 11:06 To: users@cloudstack.apache.org Subject: RE: Unable to upload volumes 4.11.0 ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Full disclosure - I used 4.11.1 but I uploaded a 'volume' from centos without a problem. Could you test the same link? https://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow2 Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message----- From: Adam Witwicki Sent: 16 July 2018 08:02 To: users@cloudstack.apache.org Subject: RE: Unable to upload volumes 4.11.0 Hi Paul, The SSVM can curl the file, and the template import (add) works without issue, it’s the volume import (add) that fails Thanks Adam -Original Message- From: Paul Angus Sent: 14 July 2018 07:36 To: users@cloudstack.apache.org Subject: RE: Unable to upload volumes 4.11.0 ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, That error is coming from: if (httpClient.executeMethod(httphead) != HttpStatus.SC_OK) { throw new IllegalArgumentException("Invalid URL: " + url); have you tried checking that you can reach the download from the management server and the SSVM? Also does the hostname resolve to an IP which is within the cloudstack management networks? If so you need to add the IP(s) to secstorage.allowed.internal.sites paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Adam Witwicki Sent: 13 July 2018 09:21 To: users@cloudstack.apache.org Subject: Unable to upload volumes 4.11.0 Hello I cant seem to upload (add) a qcow2 volume via a URL, any ideas or other methods? we really need to import other systems disks. I get this in the logs 2018-07-13 09:08:18,435 DEBUG [c.c.s.VolumeApiServiceImpl] (API-Job-Executor-42:ctx-a1afd9f2 job-6668 ctx-7da8ec40) (logid:d97e88ec) Checking url: http://ingestion.xxx.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2 2018-07-13 09:08:18,509 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-42:ctx-a1afd9f2 job-6668) (logid:d97e88ec) Unexpected exception while executing org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd java.lang.IllegalArgumentException: Invalid URL: http://ingestion.xx.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2 at com.cloud.utils.UriUtils.checkUrlExistence(UriUtils.java:395) at com.cloud.storage.VolumeApiServiceImpl.validateVolume(VolumeApiServiceImpl.java:415) at com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:296) at com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:338) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:197) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174) at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy201.uploadVolume(Unknow
RE: Unable to upload volumes 4.11.0
Hi Paul, The SSVM can curl the file, and the template import (add) works without issue, it’s the volume import (add) that fails Thanks Adam -Original Message- From: Paul Angus Sent: 14 July 2018 07:36 To: users@cloudstack.apache.org Subject: RE: Unable to upload volumes 4.11.0 ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, That error is coming from: if (httpClient.executeMethod(httphead) != HttpStatus.SC_OK) { throw new IllegalArgumentException("Invalid URL: " + url); have you tried checking that you can reach the download from the management server and the SSVM? Also does the hostname resolve to an IP which is within the cloudstack management networks? If so you need to add the IP(s) to secstorage.allowed.internal.sites paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message----- From: Adam Witwicki Sent: 13 July 2018 09:21 To: users@cloudstack.apache.org Subject: Unable to upload volumes 4.11.0 Hello I cant seem to upload (add) a qcow2 volume via a URL, any ideas or other methods? we really need to import other systems disks. I get this in the logs 2018-07-13 09:08:18,435 DEBUG [c.c.s.VolumeApiServiceImpl] (API-Job-Executor-42:ctx-a1afd9f2 job-6668 ctx-7da8ec40) (logid:d97e88ec) Checking url: http://ingestion.xxx.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2 2018-07-13 09:08:18,509 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-42:ctx-a1afd9f2 job-6668) (logid:d97e88ec) Unexpected exception while executing org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd java.lang.IllegalArgumentException: Invalid URL: http://ingestion.xx.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2 at com.cloud.utils.UriUtils.checkUrlExistence(UriUtils.java:395) at com.cloud.storage.VolumeApiServiceImpl.validateVolume(VolumeApiServiceImpl.java:415) at com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:296) at com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:338) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:197) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174) at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy201.uploadVolume(Unknown Source) at org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd.execute(UploadVolumeCmd.java:145) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150) at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:581) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:529) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTas
RE: Unable to upload volumes 4.11.0
Hi Andrija I also tried http://ingestion.xxx.com/Flowmon/1.qcow2 Thanks Adam -Original Message- From: Andrija Panic Sent: 13 July 2018 09:34 To: users Subject: Re: Unable to upload volumes 4.11.0 ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, can you try volume name without underscores ? Andrija On Fri, 13 Jul 2018 at 10:21, Adam Witwicki wrote: > Hello > > I cant seem to upload (add) a qcow2 volume via a URL, any ideas or > other methods? we really need to import other systems disks. > > I get this in the logs > > 2018-07-13 09:08:18,435 DEBUG [c.c.s.VolumeApiServiceImpl] > (API-Job-Executor-42:ctx-a1afd9f2 job-6668 ctx-7da8ec40) > (logid:d97e88ec) Checking url: > http://ingestion.xxx.com/Flowmon/Flowmon_Collector_Virtual_All_Plu > gins-disk-1.qcow2 > 2018-07-13 > <http://ingestion.xxx.com/Flowmon/Flowmon_Collector_Virtual_All_Pl > ugins-disk-1.qcow22018-07-13> > 09:08:18,509 ERROR [c.c.a.ApiAsyncJobDispatcher] > (API-Job-Executor-42:ctx-a1afd9f2 job-6668) (logid:d97e88ec) > Unexpected exception while executing > org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd > java.lang.IllegalArgumentException: Invalid URL: > http://ingestion.xx.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2 > at com.cloud.utils.UriUtils.checkUrlExistence(UriUtils.java:395) > at > com.cloud.storage.VolumeApiServiceImpl.validateVolume(VolumeApiServiceImpl.java:415) > at > com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:296) > at > com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:179) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:338) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:197) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) > at > org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174) > at > com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174) > at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185) > at > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) > at com.sun.proxy.$Proxy201.uploadVolume(Unknown Source) > at > org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd.execute(UploadVolumeCmd.java:145) > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150) > at > com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:581) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:529) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
Unable to upload volumes 4.11.0
Hello I cant seem to upload (add) a qcow2 volume via a URL, any ideas or other methods? we really need to import other systems disks. I get this in the logs 2018-07-13 09:08:18,435 DEBUG [c.c.s.VolumeApiServiceImpl] (API-Job-Executor-42:ctx-a1afd9f2 job-6668 ctx-7da8ec40) (logid:d97e88ec) Checking url: http://ingestion.xxx.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2 2018-07-13 09:08:18,509 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-42:ctx-a1afd9f2 job-6668) (logid:d97e88ec) Unexpected exception while executing org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd java.lang.IllegalArgumentException: Invalid URL: http://ingestion.xx.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2 at com.cloud.utils.UriUtils.checkUrlExistence(UriUtils.java:395) at com.cloud.storage.VolumeApiServiceImpl.validateVolume(VolumeApiServiceImpl.java:415) at com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:296) at com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:338) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:197) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174) at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy201.uploadVolume(Unknown Source) at org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd.execute(UploadVolumeCmd.java:145) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150) at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:581) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:529) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-07-13 09:08:18,511 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-42:ctx-a1afd9f2 job-6668) (logid:d97e88ec) Complete async job-6668, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Invalid URL: http://ingestion.x.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2"} Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distr
RE: Importing Hyper-V to Cloudstack 4.11.0 UEFI and GPT
Fixed using this https://www.sevenforums.com/installation-setup/320700-boot-windows-7-8-gpt-bios-system-no-hybrid-mbrs-duet.html ROOT MBR disk, Attached GPT disk (imported windows partitions) select disk 0 clean create partition primary [size=##] format select partition 1 active list volume select volume 1 assign list volume exit bcdboot C:\Windows /l en-us /s D: bootsect /nt60 D: /mbr /force bcdedit /store D:\boot\bcd /set {bootmgr} device boot Thanks Everyone Adam -Original Message- From: Adam Witwicki Sent: 10 July 2018 15:09 To: users Subject: RE: Importing Hyper-V to Cloudstack 4.11.0 UEFI and GPT Is there any way to get cloudstack to boot a GPT disk? This needs to be made clearer in the documentation, we have lots of hyper-v GEN2 boxes we need to import. I have found one bootloader on a CD that will boot the windows OS, but am having a nightmare getting this installed on the first HDD https://sourceforge.net/projects/cloverefiboot/ Thanks Adam -Original Message- From: Andrija Panic Sent: 09 July 2018 14:09 To: users Subject: Re: Importing Hyper-V to Cloudstack 4.11.0 ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Ah yes... if ti has anything to do with UEFI, than it's not possible. But if plain GPT - there should be a fix possible - check this one: https://forum.proxmox.com/threads/hyper-v-export-with-gpt-partition-table-will-not-boot.23716/ Cheers On Mon, 9 Jul 2018 at 14:48, Adam Witwicki wrote: > Andrija > > It looks like we cannot boot a GPT disk, this will be a huge pain, as > most of the systems we want to migrate are GPT > > Thanks > > Aadm > > -Original Message- > From: Andrija Panic > Sent: 06 July 2018 14:27 > To: users > Subject: Re: Importing Hyper-V to Cloudstack 4.11.0 > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > I would not be sure... > > Silly question, can you check (ps aux | grep VMNAME) or with virsh > dumpxml etc... that the volume is actually really attached to the VM ? > If so, then I would try to mount the volume on the hypervisor host > (there are ways to mount qcow2 and same with ceph, using rbd map, > etc...) to "enter" the volume and see if all fine.. or perhaps doing > qemu-img check... just from top of my head. I find it hard that > conversion produces damaged volume, but it;s possible, > > Actually, pay attention on the conversion process - not sure how/with > which tool you do conversion - but's it's good idea to export VM (from > HyperV) to get clean/single VHDX file, and then convert (check the > VHDX previously also with qemu-img check) Here there is a Windows > version, that should work (did NOT test it though): > https://cloudbase.it/qemu-img-windows/ > > Let me know, really curious what is going on... > > > > > On Fri, 6 Jul 2018 at 14:49, Adam Witwicki > wrote: > > > Andrija, > > > > I used qemu-img to convert to qcow2 since I am using KVM with ceph - > > when I view the console I get the emulated BIOS saying no bootable > > device found > > - this must be before any IDE or VirtIO drivers. > > I have also tried with NFS storage and get the same boot error. > > > > This process worked on 4.9, I notice there are more template options > > on > > 4.11.0 do I need to do any thing different? > > > > Thanks > > > > Adam > > > > -Original Message- > > From: Andrija Panic > > Sent: 06 July 2018 13:45 > > To: users > > Subject: Re: Importing Hyper-V to Cloudstack 4.11.0 > > > > ** This mail originated from OUTSIDE the Oakford corporate network. > > Treat hyperlinks and attachments in this email with caution. ** > > > > Hi Adam, > > > > havent done that myslef (but helped some customers) - if you are > > running OS TYpe :"Windows XXX" - anything concrete version - this > > means no VirtIO drives are needed, since all IDE, so no drivers > > needed) If using "Windows PV" this means you need to have installed > > VirtIO drivers inside the OS (I suggest, on HyperV VM, adding new > > hardware via device manager and loading correct VirtIO drivers for > > SCSI controller, or also for the network...up to > > you) - and only then exporting VHDX to qcow2. > > > > Btw, I don't know if VHDX can be imported into ACS directly ? - > > perhaps it needs previous conversion to QCOW2 format, and then > > upload > > qcow2 natively (again, not sure, so I might be wrong here). > > > > > > Also please note that t
RE: Importing Hyper-V to Cloudstack 4.11.0 UEFI and GPT
Is there any way to get cloudstack to boot a GPT disk? This needs to be made clearer in the documentation, we have lots of hyper-v GEN2 boxes we need to import. I have found one bootloader on a CD that will boot the windows OS, but am having a nightmare getting this installed on the first HDD https://sourceforge.net/projects/cloverefiboot/ Thanks Adam -Original Message- From: Andrija Panic Sent: 09 July 2018 14:09 To: users Subject: Re: Importing Hyper-V to Cloudstack 4.11.0 ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Ah yes... if ti has anything to do with UEFI, than it's not possible. But if plain GPT - there should be a fix possible - check this one: https://forum.proxmox.com/threads/hyper-v-export-with-gpt-partition-table-will-not-boot.23716/ Cheers On Mon, 9 Jul 2018 at 14:48, Adam Witwicki wrote: > Andrija > > It looks like we cannot boot a GPT disk, this will be a huge pain, as > most of the systems we want to migrate are GPT > > Thanks > > Aadm > > -Original Message- > From: Andrija Panic > Sent: 06 July 2018 14:27 > To: users > Subject: Re: Importing Hyper-V to Cloudstack 4.11.0 > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > I would not be sure... > > Silly question, can you check (ps aux | grep VMNAME) or with virsh > dumpxml etc... that the volume is actually really attached to the VM ? > If so, then I would try to mount the volume on the hypervisor host > (there are ways to mount qcow2 and same with ceph, using rbd map, > etc...) to "enter" the volume and see if all fine.. or perhaps doing > qemu-img check... just from top of my head. I find it hard that > conversion produces damaged volume, but it;s possible, > > Actually, pay attention on the conversion process - not sure how/with > which tool you do conversion - but's it's good idea to export VM (from > HyperV) to get clean/single VHDX file, and then convert (check the > VHDX previously also with qemu-img check) Here there is a Windows > version, that should work (did NOT test it though): > https://cloudbase.it/qemu-img-windows/ > > Let me know, really curious what is going on... > > > > > On Fri, 6 Jul 2018 at 14:49, Adam Witwicki > wrote: > > > Andrija, > > > > I used qemu-img to convert to qcow2 since I am using KVM with ceph - > > when I view the console I get the emulated BIOS saying no bootable > > device found > > - this must be before any IDE or VirtIO drivers. > > I have also tried with NFS storage and get the same boot error. > > > > This process worked on 4.9, I notice there are more template options > > on > > 4.11.0 do I need to do any thing different? > > > > Thanks > > > > Adam > > > > -Original Message- > > From: Andrija Panic > > Sent: 06 July 2018 13:45 > > To: users > > Subject: Re: Importing Hyper-V to Cloudstack 4.11.0 > > > > ** This mail originated from OUTSIDE the Oakford corporate network. > > Treat hyperlinks and attachments in this email with caution. ** > > > > Hi Adam, > > > > havent done that myslef (but helped some customers) - if you are > > running OS TYpe :"Windows XXX" - anything concrete version - this > > means no VirtIO drives are needed, since all IDE, so no drivers > > needed) If using "Windows PV" this means you need to have installed > > VirtIO drivers inside the OS (I suggest, on HyperV VM, adding new > > hardware via device manager and loading correct VirtIO drivers for > > SCSI controller, or also for the network...up to > > you) - and only then exporting VHDX to qcow2. > > > > Btw, I don't know if VHDX can be imported into ACS directly ? - > > perhaps it needs previous conversion to QCOW2 format, and then > > upload > > qcow2 natively (again, not sure, so I might be wrong here). > > > > > > Also please note that there is something related to Hardware > > Abstraction Layer in Windows (if Windows at all ?), when some of the > > changes (even installing VirtIO in some cases on existing KVM VM) > > will bring server down unable to boot - bcdedit /detecthal - google > > for this one - i.e. force OS to detect HAL again, for proper boot/fix. > > > > > > > > Hope that helps > > > > Andrija > > > > On Fri, 6 Jul 2018 at 12:39, Adam Witwicki > > wrote: > > > > > Hello, > > > > > > I wonder if anyone can help, I am having issues im
RE: Importing Hyper-V to Cloudstack 4.11.0
Andrija It looks like we cannot boot a GPT disk, this will be a huge pain, as most of the systems we want to migrate are GPT Thanks Aadm -Original Message- From: Andrija Panic Sent: 06 July 2018 14:27 To: users Subject: Re: Importing Hyper-V to Cloudstack 4.11.0 ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** I would not be sure... Silly question, can you check (ps aux | grep VMNAME) or with virsh dumpxml etc... that the volume is actually really attached to the VM ? If so, then I would try to mount the volume on the hypervisor host (there are ways to mount qcow2 and same with ceph, using rbd map, etc...) to "enter" the volume and see if all fine.. or perhaps doing qemu-img check... just from top of my head. I find it hard that conversion produces damaged volume, but it;s possible, Actually, pay attention on the conversion process - not sure how/with which tool you do conversion - but's it's good idea to export VM (from HyperV) to get clean/single VHDX file, and then convert (check the VHDX previously also with qemu-img check) Here there is a Windows version, that should work (did NOT test it though): https://cloudbase.it/qemu-img-windows/ Let me know, really curious what is going on... On Fri, 6 Jul 2018 at 14:49, Adam Witwicki wrote: > Andrija, > > I used qemu-img to convert to qcow2 since I am using KVM with ceph - > when I view the console I get the emulated BIOS saying no bootable > device found > - this must be before any IDE or VirtIO drivers. > I have also tried with NFS storage and get the same boot error. > > This process worked on 4.9, I notice there are more template options > on > 4.11.0 do I need to do any thing different? > > Thanks > > Adam > > -Original Message- > From: Andrija Panic > Sent: 06 July 2018 13:45 > To: users > Subject: Re: Importing Hyper-V to Cloudstack 4.11.0 > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Hi Adam, > > havent done that myslef (but helped some customers) - if you are > running OS TYpe :"Windows XXX" - anything concrete version - this > means no VirtIO drives are needed, since all IDE, so no drivers > needed) If using "Windows PV" this means you need to have installed > VirtIO drivers inside the OS (I suggest, on HyperV VM, adding new > hardware via device manager and loading correct VirtIO drivers for > SCSI controller, or also for the network...up to > you) - and only then exporting VHDX to qcow2. > > Btw, I don't know if VHDX can be imported into ACS directly ? - > perhaps it needs previous conversion to QCOW2 format, and then upload > qcow2 natively (again, not sure, so I might be wrong here). > > > Also please note that there is something related to Hardware > Abstraction Layer in Windows (if Windows at all ?), when some of the > changes (even installing VirtIO in some cases on existing KVM VM) will > bring server down unable to boot - bcdedit /detecthal - google for > this one - i.e. force OS to detect HAL again, for proper boot/fix. > > > > Hope that helps > > Andrija > > On Fri, 6 Jul 2018 at 12:39, Adam Witwicki > wrote: > > > Hello, > > > > I wonder if anyone can help, I am having issues importing a > > converted Hyper-V (VHDX) to KVM (qcow2). > > After importing the template and starting the instance, the instance > > will fail to find the boot device. > > > > This worked in 4.9 > > > > > > Thanks > > > > Adam Witwicki > > > > > > Disclaimer Notice: > > This email has been sent by Oakford Technology Limited, while we > > have checked this e-mail and any attachments for viruses, we can not > > guarantee that they are virus-free. You must therefore take full > > responsibility for virus checking. > > This message and any attachments are confidential and should only be > > read by those to whom they are addressed. If you are not the > > intended recipient, please contact us, delete the message from your > > computer and destroy any copies. Any distribution or copying without > > our prior permission is prohibited. > > Internet communications are not always secure and therefore Oakford > > Technology Limited does not accept legal responsibility for this message. > > The recipient is responsible for verifying its authenticity before > > acting on the contents. Any views or opinions presented are solely > > those of the author and do not necessarily represent those of > > Oakford > Technology Limited. > > Registered address: Oa
RE: Importing Hyper-V to Cloudstack 4.11.0
Andrija, I used qemu-img to convert to qcow2 since I am using KVM with ceph - when I view the console I get the emulated BIOS saying no bootable device found - this must be before any IDE or VirtIO drivers. I have also tried with NFS storage and get the same boot error. This process worked on 4.9, I notice there are more template options on 4.11.0 do I need to do any thing different? Thanks Adam -Original Message- From: Andrija Panic Sent: 06 July 2018 13:45 To: users Subject: Re: Importing Hyper-V to Cloudstack 4.11.0 ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, havent done that myslef (but helped some customers) - if you are running OS TYpe :"Windows XXX" - anything concrete version - this means no VirtIO drives are needed, since all IDE, so no drivers needed) If using "Windows PV" this means you need to have installed VirtIO drivers inside the OS (I suggest, on HyperV VM, adding new hardware via device manager and loading correct VirtIO drivers for SCSI controller, or also for the network...up to you) - and only then exporting VHDX to qcow2. Btw, I don't know if VHDX can be imported into ACS directly ? - perhaps it needs previous conversion to QCOW2 format, and then upload qcow2 natively (again, not sure, so I might be wrong here). Also please note that there is something related to Hardware Abstraction Layer in Windows (if Windows at all ?), when some of the changes (even installing VirtIO in some cases on existing KVM VM) will bring server down unable to boot - bcdedit /detecthal - google for this one - i.e. force OS to detect HAL again, for proper boot/fix. Hope that helps Andrija On Fri, 6 Jul 2018 at 12:39, Adam Witwicki wrote: > Hello, > > I wonder if anyone can help, I am having issues importing a converted > Hyper-V (VHDX) to KVM (qcow2). > After importing the template and starting the instance, the instance > will fail to find the boot device. > > This worked in 4.9 > > > Thanks > > Adam Witwicki > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, 10 Prince Maurice > Court, Devizes, Wiltshire. SN10 2RT. > Registered in England and Wales No. 5971519 > > -- Andrija Panić Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
Importing Hyper-V to Cloudstack 4.11.0
Hello, I wonder if anyone can help, I am having issues importing a converted Hyper-V (VHDX) to KVM (qcow2). After importing the template and starting the instance, the instance will fail to find the boot device. This worked in 4.9 Thanks Adam Witwicki Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
RE: CloudStack - KVM / Ceph Performance
The speed difference between Centos and Ubuntu KVM hosts is 3 fold. How do I check the rbd cache configuration on KVM hosts? Thanks Adam -Original Message- From: Andrija Panic Sent: 26 June 2018 15:00 To: users Subject: Re: CloudStack - KVM / Ceph Performance ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** You are obviously hitting some issues on Centos vs Ubuntu as KVM host, and can be due to difference in kernel, ceph (librbd), libvirt/qemu... But we have been using ceph (older, hammer release) with Ubuntu 14.04 and dont expect any miracle on single volume. BUT if you i.e. start Bitlocker drive encryption on multiple VMs at same time, you will be able to nicely saturate cluster to its full performance capacity. It's known feature that CEPH "excellent on parallel streams /io" i.e. single volume can't really reach nowhere near full performance of the cluster. Again questions about rbd cache configuration on KVM hosts? If you will eventually put more serious workloads on this specific cluster, it ain't gonna perform satisfactory for any customer - that is reality - been there, done that... moved away... Sorry for being too honest... (We had same size cluster, just used Intel DC ssds for journals, collocated few journals on single SSD - not very optimal thought) Cheers On Jun 26, 2018 15:40, "Adam Witwicki" wrote: Used the same guest VM, with a Ubuntu and Centos KVM host The Ubuntu host performed as expected, the guest on Centos KVM host is very slow I have been testing with KVM virtio drivers packaged in centos7 and downloaded them for windows guests Thanks Adam -Original Message- From: Simon Weller Sent: 26 June 2018 13:35 To: users Subject: Re: CloudStack - KVM / Ceph Performance ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** I assume you've checked to make sure you're using the KVM virtio drivers, right? - Si From: Ivan Kudryavtsev Sent: Tuesday, June 26, 2018 6:35 AM To: users Subject: Re: CloudStack - KVM / Ceph Performance Hello, Adam. Try to attach md raid0 of two Ceph vols inside VM. I have heard that people who run ceph use that practice to improve results. I don't know what you are expecting, but read somewhere that all ops to a single RBD volume are queued in a single IO queue, thus RAID0 helps here, increasing the speed almost twice. I mean you don't see a ceph cluster overall performance, you see a librbd+qemu performance in your tests. вт, 26 июн. 2018 г., 15:57 Adam Witwicki : > We are days away from completing our production CloudStack / Ceph > deployment but have run into a small challenge in regards to Ceph > performance. As you run a setup similar to ours I was wondering if > you've seen a similar issue? > > > > Our Ceph cluster consists of 60 X 7.2K SAS drive, spread over 5 nodes > each with a 960GB Samsung NVMe. Our KVM hypervisors are connected to > this nodes via 2 x 10Gbps links, per node. > > > > 3 centos Cloudstack management servers 4.11.0 > > 4 centos KVM hosts > > > > The RAW Ceph performance looks great! > > > > CEPH RAW > > *Average IOPS* > > *Max IOPS* > > *MB/sec* > > *Write 4K* > > 5,885 > > 6,190 > > 22.9907 > > *Read 4K* > > 28,985 > > 35,025 > > 113 > > *Write 4MB* > > 204 > > 219 > > 816 > > *Read 4MB* > > 361 > > 399 > > 1447.51 > > > > However when we run the tests from within KVM we get significantly > reduced performance, particular in writes: > > > > VM Running on KVM Hypervisor > > *Average IOPS* > > *Max IOPS* > > *MB/sec* > > *Write 4K* > > 946.07 > > 1390 > > 3.69 > > *Write 4MB* > > 472 > > 614 > > 116 > > > > We believe the libvirt/ceph library could be causing the problem with > in centos as we don't see this on a Ubuntu KVM HOST > > > > Kind Regards, > > [image: Oakford Internet Services] <http://www.oakfordis.com/> > > *Adam Witwicki* | Hosted Systems Specialist > > 01380 710278 / awitwi...@oakfordis.com > > *Oakford Internet Services* Office: 01380 888088 > 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT > www.oakfordis.com<http://www.oakfordis.com> sa...@oakfordis.com > > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message an
RE: CloudStack - KVM / Ceph Performance
Used the same guest VM, with a Ubuntu and Centos KVM host The Ubuntu host performed as expected, the guest on Centos KVM host is very slow I have been testing with KVM virtio drivers packaged in centos7 and downloaded them for windows guests Thanks Adam -Original Message- From: Simon Weller Sent: 26 June 2018 13:35 To: users Subject: Re: CloudStack - KVM / Ceph Performance ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** I assume you've checked to make sure you're using the KVM virtio drivers, right? - Si From: Ivan Kudryavtsev Sent: Tuesday, June 26, 2018 6:35 AM To: users Subject: Re: CloudStack - KVM / Ceph Performance Hello, Adam. Try to attach md raid0 of two Ceph vols inside VM. I have heard that people who run ceph use that practice to improve results. I don't know what you are expecting, but read somewhere that all ops to a single RBD volume are queued in a single IO queue, thus RAID0 helps here, increasing the speed almost twice. I mean you don't see a ceph cluster overall performance, you see a librbd+qemu performance in your tests. вт, 26 июн. 2018 г., 15:57 Adam Witwicki : > We are days away from completing our production CloudStack / Ceph > deployment but have run into a small challenge in regards to Ceph > performance. As you run a setup similar to ours I was wondering if > you've seen a similar issue? > > > > Our Ceph cluster consists of 60 X 7.2K SAS drive, spread over 5 nodes > each with a 960GB Samsung NVMe. Our KVM hypervisors are connected to > this nodes via 2 x 10Gbps links, per node. > > > > 3 centos Cloudstack management servers 4.11.0 > > 4 centos KVM hosts > > > > The RAW Ceph performance looks great! > > > > CEPH RAW > > *Average IOPS* > > *Max IOPS* > > *MB/sec* > > *Write 4K* > > 5,885 > > 6,190 > > 22.9907 > > *Read 4K* > > 28,985 > > 35,025 > > 113 > > *Write 4MB* > > 204 > > 219 > > 816 > > *Read 4MB* > > 361 > > 399 > > 1447.51 > > > > However when we run the tests from within KVM we get significantly > reduced performance, particular in writes: > > > > VM Running on KVM Hypervisor > > *Average IOPS* > > *Max IOPS* > > *MB/sec* > > *Write 4K* > > 946.07 > > 1390 > > 3.69 > > *Write 4MB* > > 472 > > 614 > > 116 > > > > We believe the libvirt/ceph library could be causing the problem with > in centos as we don't see this on a Ubuntu KVM HOST > > > > Kind Regards, > > [image: Oakford Internet Services] <http://www.oakfordis.com/> > > *Adam Witwicki* | Hosted Systems Specialist > > 01380 710278 / awitwi...@oakfordis.com > > *Oakford Internet Services* Office: 01380 888088 > 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT > www.oakfordis.com<http://www.oakfordis.com> sa...@oakfordis.com > > > > Disclaimer Notice: > This email has been sent by Oakford Technology Limited, while we have > checked this e-mail and any attachments for viruses, we can not > guarantee that they are virus-free. You must therefore take full > responsibility for virus checking. > This message and any attachments are confidential and should only be > read by those to whom they are addressed. If you are not the intended > recipient, please contact us, delete the message from your computer > and destroy any copies. Any distribution or copying without our prior > permission is prohibited. > Internet communications are not always secure and therefore Oakford > Technology Limited does not accept legal responsibility for this message. > The recipient is responsible for verifying its authenticity before > acting on the contents. Any views or opinions presented are solely > those of the author and do not necessarily represent those of Oakford > Technology Limited. > Registered address: Oakford Technology Limited, 10 Prince Maurice > Court, Devizes, Wiltshire. SN10 2RT. > Registered in England and Wales No. 5971519 > Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefor
CloudStack - KVM / Ceph Performance
We are days away from completing our production CloudStack / Ceph deployment but have run into a small challenge in regards to Ceph performance. As you run a setup similar to ours I was wondering if you've seen a similar issue? Our Ceph cluster consists of 60 X 7.2K SAS drive, spread over 5 nodes each with a 960GB Samsung NVMe. Our KVM hypervisors are connected to this nodes via 2 x 10Gbps links, per node. 3 centos Cloudstack management servers 4.11.0 4 centos KVM hosts The RAW Ceph performance looks great! CEPH RAW Average IOPS Max IOPS MB/sec Write 4K 5,885 6,190 22.9907 Read 4K 28,985 35,025 113 Write 4MB 204 219 816 Read 4MB 361 399 1447.51 However when we run the tests from within KVM we get significantly reduced performance, particular in writes: VM Running on KVM Hypervisor Average IOPS Max IOPS MB/sec Write 4K 946.07 1390 3.69 Write 4MB 472 614 116 We believe the libvirt/ceph library could be causing the problem with in centos as we don't see this on a Ubuntu KVM HOST Kind Regards, [Oakford Internet Services]<http://www.oakfordis.com/> Adam Witwicki | Hosted Systems Specialist 01380 710278 / awitwi...@oakfordis.com<mailto:awitwi...@oakfordis.com> Oakford Internet Services Office: 01380 888088 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT www.oakfordis.com<http://www.oakfordis.com/> sa...@oakfordis.com<mailto:sa...@oakfordis.com> Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
RE: Agents not reconnecting after reboot.
Hi, This might be due to the hosts being in maintenance mode, I got an internal error when cancelling maintenance - but the hosts then showed as UP Thanks Adam -Original Message- From: Adam Witwicki Sent: 15 June 2018 16:21 To: users@cloudstack.apache.org Subject: Agents not reconnecting after reboot. ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hello, I am experiencing an issue where hosts agents are not reconnecting after a host reboot. They stay in alert state, When I restart the management servers the agents then connect. Any ideas? Kind Regards Adam Witwicki Cloudstack 4.11.0 KVM hosts HA proxy sticky sessions Global setting Host: points to HA proxy Server log: http://termbin.com/4b5z Agent log: http://termbin.com/9g34 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
Agents not reconnecting after reboot.
Hello, I am experiencing an issue where hosts agents are not reconnecting after a host reboot. They stay in alert state, When I restart the management servers the agents then connect. Any ideas? Kind Regards Adam Witwicki Cloudstack 4.11.0 KVM hosts HA proxy sticky sessions Global setting Host: points to HA proxy Server log: http://termbin.com/4b5z Agent log: http://termbin.com/9g34 Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT. Registered in England and Wales No. 5971519
RE: KVM Problem by deploying VPC
Hi Ben " Now i moved back to centos7 and have another problem. all vlan bridges that will be created by cloudstack-agent not manual get in ifup state. if i ifup the vlan bridges manual all works fine. Have someone a idea how i can force centos to automaticly bring up new if devices ?" I had this issue with 4.9 and ending up writing a dirty script to check the down bridges every minute via cron and if up them. iface=`/usr/sbin/ip add | grep -E "brbond.*DOWN" | awk -F ':' '{print $2}'` echo "$iface" | while read -r a; do /usr/sbin/ip link set dev $a up; done Thanks Adam -Original Message- From: Benjamin Naber Sent: 24 May 2018 14:37 To: users@cloudstack.apache.org Subject: Re: KVM Problem by deploying VPC ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Andrija, ty for reply. i solved the error. Now i have an other error. Problem was that it failed witout a bonding device. i created a bonding device (bond0) wiht a single nic now it works without problems On Ubuntu. Example (didnt work): auto enp8s0f0 iface enp8s0f0 inet manual auto cloudbr0 iface cloudbr0 inet static address 10.253.250.230 gateway 10.253.250.1 netmask 255.255.255.0 dns-nameservers 8.8.8.8 8.8.4.4 bridge_ports enp8s0f0 bridge_fd 5 bridge_stp off bridge_maxwait 1 Example (works fine): auto enp8s0f0 iface enp8s0f0 inet manual bond-master bond0 auto bond0 iface bond0 inet manual bond-mode active-backup bond-miimon 100 bond-slaves none auto cloudbr0 iface cloudbr0 inet static address 10.253.250.230 gateway 10.253.250.1 netmask 255.255.255.0 dns-nameservers 8.8.8.8 8.8.4.4 bridge_ports bond0 bridge_fd 5 bridge_stp off bridge_maxwait 1 Now i moved back to centos7 and have another problem. all vlan bridges that will be created by cloudstack-agent not manual get in ifup state. if i ifup the vlan bridges manual all works fine. Have someone a idea how i can force centos to automaticly bring up new if devices ? Kind regards Ben > > Andrija Panic hat am 24. Mai 2018 um 00:37 > geschrieben: > > Hi Ben, > > interesting parts seems to be: > 2018-05-23 12:59:47,213 DEBUG [kvm.resource.LibvirtComputingResource] > (agentRequest-Handler-5:null) (logid:ef8b353e) getting broadcast uri for > pif enp8s0f0.233 and bridge brenp8s0f0-233 > 2018-05-23 12:59:47,213 DEBUG > [resource.virtualnetwork.VirtualRoutingResource] > (agentRequest-Handler-5:null) (logid:ef8b353e) Transforming > com.cloud.agent.api.routing.IpAssocVpcCommand to ConfigItems > 2018-05-23 12:59:47,581 DEBUG > [resource.virtualnetwork.VirtualRoutingResource] > (agentRequest-Handler-5:null) (logid:ef8b353e) Processing FileConfigItem, > copying 257 characters to ip_associations.json took 340ms > 2018-05-23 12:59:47,582 DEBUG [kvm.resource.LibvirtComputingResource] > (agentRequest-Handler-5:null) (logid:ef8b353e) Executing: > /usr/share/cloudstack-common/scripts/network/domr/router_proxy.sh > update_config.py 169.254.2.247 ip_associations.json > 2018-05-23 12:59:47,766 DEBUG [kvm.resource.LibvirtComputingResource] > (agentRequest-Handler-5:null) (logid:ef8b353e) Exit value is 1 > > What I believe we see here, is that IP association fails for some reason > (exit value is 1) and after that ACS will just stop the VM and do the > cleanup (all log lines after this one)... > > Can you check your broadcast URI in the DB ? ACtually... I see it vlan 223 > > * I did have some issues in past releases, when we wanted to use > untagged > vlans for Public network, but it seems not to be case here... > > Not sure, if it's possible that you also SSH to the VR during this > creation > process, in order to collect logs from inside the VR - before Qemu > destroys > the VR? > > ssh -p 3922 -i .ssh/id_rsa.cloud root@ 169.254.2.247 and then try to fetch > (SCP or something) whole /var/log/ folder to the localhost - from there, > there is cloud.log and auth.log where most of the commands outputs are > located (success or failure) > > or something like rsync -av -e "ssh -p 3992 -i .ssh.id_rsa.cloud" > root@169... > /local/dir/ > and keep repeating until you fetch whatever data to be able to analyze it > > Perhaps someone else will have better suggestion... > > Best > Andrija > > On 23 May 2018 at 13:08, Benjamin Naber > wrote: > > > > > > Hi Andrija, > > > > first of all thanks for your reply. I have now testet the setup on a > > Ubuntu Xenial. Same issu with Default VPC Offering. Redundant VPC > > offering > > works also without any problems. Same as on CentOS. > > > > See delow the debug log (censored public Ips): > > > > 2018-05-23 12:58:05,161 INFO [cloud.agent.Agent] > > (agentRequest-Handler-2:null) (logid:0806b407) Proccess agent ready > > comman
RE: Upgrading from 4.9 to 4.11
All good now Thanks -Original Message- From: Rohit Yadav Sent: 09 May 2018 17:49 To: users@cloudstack.apache.org Subject: Re: Upgrading from 4.9 to 4.11 ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Adam, With your new setup, were you able to solve the issue or is this still an issue? If this is still an issue, ensure that the ca strictness global setting is false, remove any cert/jks files on KVM host and use provisionCertificate API to force provisioning of certificate to an already connected KVM host. Backup/remove the rpmsave file, looks like you choose to install the package provided agent.properties file instead of what you already have. For an already added host, you should keep your old agent.properties file instead of use the new one which will be blank (empty of configuration). - Rohit <https://cloudstack.apache.org> From: Adam Witwicki Sent: Friday, May 4, 2018 5:45:39 PM To: users@cloudstack.apache.org Subject: RE: Upgrading from 4.9 to 4.11 Hi Rohit, Those instructions were followed There was no keystore.passphrase= in agent.properties, it was found in agent.properties.rpmsave Removing cloud.jks hasn't worked I now get in management log 2018-05-04 13:03:33,246 DEBUG [c.c.u.s.SSHCmdHelper] (qtp510113906-18:ctx-4f329b77 ctx-c350b74b) (logid:29765313) SSH command: /usr/share/cloudstack-common/scripts/util/keystore-cert-import /etc/cloudstack/agent/agent.properties /etc/cloudstack/agent/ 2018-05-04 13:03:33,247 ERROR [c.c.h.k.d.LibvirtServerDiscoverer] (qtp510113906-18:ctx-4f329b77 ctx-c350b74b) (logid:29765313) Failed to setup certificate in the KVM agent's keystore file, please configure manually! I can't find any instructions configure manually! Is anyone able to provide some? Thanks Adam rohit.ya...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rohit Yadav Sent: 04 May 2018 13:02 To: users@cloudstack.apache.org Subject: Re: Upgrading from 4.9 to 4.11 ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Hi Adam, If you're upgrading to 4.11.0.0, please use the correct release notes: http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.11.0.0/ When you upgrade, you'll need to upgrade both management server(s) and kvm host agents to make it work. By default, the new CA service will keep the global setting 'ca.plugin.root.auth.strictness ' to false for an existing deployment (this is only true for new/fresh installations). When the above global setting is false, and you want legacy behaviour make sure you don't have any cloud.jks in your KVM hosts's /etc/cloudstack/agent/ path. On the management server side, 4.11.0.0 creates a cloud.jks which holds a random certificate (starting 4.11.1.0 this won't be necessary, and this file will not be created in mgmt server's /etc/cloudstack/management/ path). If you make any changes (and after upgrades), try to restart the management server(s) and kvm host agent(s). - Rohit <https://cloudstack.apache.org> From: Adam Witwicki Sent: Friday, May 4, 2018 1:06:48 PM To: users@cloudstack.apache.org Subject: Upgrading from 4.9 to 4.11 Hello Upgrading from 4.9 t0 4.11 using this guide http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.10/upgrade/upgrade-4.9.html None of my KVM hosts are connecting with this in the management server log 2018-05-04 08:31:13,774 WARN [c.c.u.n.Link] (AgentManager-SSLHandshakeHandler-4:null) (logid:) SSL Handshake has taken more than 15s to connect to: /192.168.200.109:50492. Please investigate this connection. Any Ideas? Thanks Adam Witwicki Disclaimer Notice: This email has been sent by Oakford Technology Limited, while we have checked this e-mail and any attachments for viruses, we can not guarantee that they are virus-free. You must therefore take full responsibility for virus checking. This message and any attachments are confidential and should only be read by those to whom they are addressed. If you are not the intended recipient, please contact us, delete the message from your computer and destroy any copies. Any distribution or copying without our prior permission is prohibited. Internet communications are not always secure and therefore Oakford Technology Limited does not accept legal responsibility for this message. The recipient is responsible for verifying its authenticity before acting on the contents. Any views or opinions presented are solely those of the author and do not necessarily represent those of Oakford Technology Limited. Registered address: Oakford Technology Limited, 10 Prince Maurice Court
RE: Issue upgrading 4.9 to 4.11 Database?
It may have been my DB connection failing during the update, or running /usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt before cloudstack-setup-management Is up now Thanks Adam -Original Message- From: Adam Witwicki Sent: 08 May 2018 10:49 To: users@cloudstack.apache.org Subject: RE: Issue upgrading 4.9 to 4.11 Database? ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** I'm getting the same error on a clean database trying to install Name: cloudstack-management Arch: x86_64 Version : 4.11.0.0 Release : shapeblue0.el7.centos Size: 100 M Repo: installed >From repo : cloudstack-4.11 Summary : CloudStack management server UI Licence : ASL 2.0 Description : The CloudStack management server is the central point of coordination, : management, and intelligence in CloudStack. -Original Message- From: Rohit Yadav Sent: 05 May 2018 17:39 To: users Subject: Re: Issue upgrading 4.9 to 4.11 Database? ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Thanks for reporting and sharing, the fix would be to simply add the same upgrade path which would be applicable for 4.9.3.1. I'll post a fix on Monday. - Rohit <https://cloudstack.apache.org> From: Rafael Weingärtner Sent: Friday, May 4, 2018 9:40:26 PM To: users Subject: Re: Issue upgrading 4.9 to 4.11 Database? Just an update. I will try to fix this for 4.11.1.0 On Fri, May 4, 2018 at 11:36 AM, Rafael Weingärtner < rafaelweingart...@gmail.com> wrote: > So, there you are. This is a consequence of the DB upgrade method we > are using :((( > 4.9.3.1 was launched after 4.11. There is no upgrade path from 4.9.3.1 > to 4.11. > > What is the state of your version table? > > On Fri, May 4, 2018 at 11:28 AM, Adam Witwicki > > wrote: > >> ACS 4.9.3.1 >> >> Thanks >> >> Adam >> >> >> -Original Message- >> From: Rafael Weingärtner >> Sent: 04 May 2018 15:27 >> To: users >> Subject: Re: Issue upgrading 4.9 to 4.11 Database? >> >> ** This mail originated from OUTSIDE the Oakford corporate network. >> Treat hyperlinks and attachments in this email with caution. ** >> >> I forgot that was only for people with Apache ID. >> So is in Unknown column 'network_offerings.supports_public_access' in >> 'field list' . It seems that some scripts were not executed. >> >> That field is created with script "schema-4930to41000.sql". What was >> your ACS 4.9 version? >> >> On Fri, May 4, 2018 at 11:20 AM, Adam Witwicki >> >> wrote: >> >> > That URL required a username and password >> > >> > Here is the log @ pastebin https://pastebin.com/0xRnqPV3 >> > >> > Thanks >> > >> > Adam >> > >> > -Original Message- >> > From: Rafael Weingärtner >> > Sent: 04 May 2018 15:17 >> > To: users >> > Subject: Re: Issue upgrading 4.9 to 4.11 Database? >> > >> > ** This mail originated from OUTSIDE the Oakford corporate network. >> > Treat hyperlinks and attachments in this email with caution. ** >> > >> > Attachements are stripped... >> > Instead, you can use: https://paste.apache.org/ >> > >> > On Fri, May 4, 2018 at 11:02 AM, Adam Witwicki >> > >> > wrote: >> > >> > > Please find attached >> > > >> > > >> > > >> > > -Original Message- >> > > From: Rafael Weingärtner >> > > Sent: 04 May 2018 14:52 >> > > To: users >> > > Subject: Re: Issue upgrading 4.9 to 4.11 Database? >> > > >> > > ** This mail originated from OUTSIDE the Oakford corporate network. >> > > Treat hyperlinks and attachments in this email with caution. ** >> > > >> > > We will need more log entries. However, this is looking like a DB >> > > version issue. >> > > >> > > On Fri, May 4, 2018 at 10:49 AM, Adam Witwicki >> > > >> > > wrote: >> > > >> > > > Hello, >> > > > >> > > > The management service won't start after update, I get this in >> > > > the log >> > > > >> > > > Failed startup of context o.e.j.w.WebAppContext@4148db48 >> > > > {/client,file:///usr/share/clo
RE: Issue upgrading 4.9 to 4.11 Database?
I'm getting the same error on a clean database trying to install Name: cloudstack-management Arch: x86_64 Version : 4.11.0.0 Release : shapeblue0.el7.centos Size: 100 M Repo: installed >From repo : cloudstack-4.11 Summary : CloudStack management server UI Licence : ASL 2.0 Description : The CloudStack management server is the central point of coordination, : management, and intelligence in CloudStack. -Original Message- From: Rohit Yadav Sent: 05 May 2018 17:39 To: users Subject: Re: Issue upgrading 4.9 to 4.11 Database? ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** Thanks for reporting and sharing, the fix would be to simply add the same upgrade path which would be applicable for 4.9.3.1. I'll post a fix on Monday. - Rohit <https://cloudstack.apache.org> From: Rafael Weingärtner Sent: Friday, May 4, 2018 9:40:26 PM To: users Subject: Re: Issue upgrading 4.9 to 4.11 Database? Just an update. I will try to fix this for 4.11.1.0 On Fri, May 4, 2018 at 11:36 AM, Rafael Weingärtner < rafaelweingart...@gmail.com> wrote: > So, there you are. This is a consequence of the DB upgrade method we > are using :((( > 4.9.3.1 was launched after 4.11. There is no upgrade path from 4.9.3.1 > to 4.11. > > What is the state of your version table? > > On Fri, May 4, 2018 at 11:28 AM, Adam Witwicki > > wrote: > >> ACS 4.9.3.1 >> >> Thanks >> >> Adam >> >> >> -Original Message- >> From: Rafael Weingärtner >> Sent: 04 May 2018 15:27 >> To: users >> Subject: Re: Issue upgrading 4.9 to 4.11 Database? >> >> ** This mail originated from OUTSIDE the Oakford corporate network. >> Treat hyperlinks and attachments in this email with caution. ** >> >> I forgot that was only for people with Apache ID. >> So is in Unknown column 'network_offerings.supports_public_access' in >> 'field list' . It seems that some scripts were not executed. >> >> That field is created with script "schema-4930to41000.sql". What was >> your ACS 4.9 version? >> >> On Fri, May 4, 2018 at 11:20 AM, Adam Witwicki >> >> wrote: >> >> > That URL required a username and password >> > >> > Here is the log @ pastebin https://pastebin.com/0xRnqPV3 >> > >> > Thanks >> > >> > Adam >> > >> > -Original Message- >> > From: Rafael Weingärtner >> > Sent: 04 May 2018 15:17 >> > To: users >> > Subject: Re: Issue upgrading 4.9 to 4.11 Database? >> > >> > ** This mail originated from OUTSIDE the Oakford corporate network. >> > Treat hyperlinks and attachments in this email with caution. ** >> > >> > Attachements are stripped... >> > Instead, you can use: https://paste.apache.org/ >> > >> > On Fri, May 4, 2018 at 11:02 AM, Adam Witwicki >> > >> > wrote: >> > >> > > Please find attached >> > > >> > > >> > > >> > > -Original Message- >> > > From: Rafael Weingärtner >> > > Sent: 04 May 2018 14:52 >> > > To: users >> > > Subject: Re: Issue upgrading 4.9 to 4.11 Database? >> > > >> > > ** This mail originated from OUTSIDE the Oakford corporate network. >> > > Treat hyperlinks and attachments in this email with caution. ** >> > > >> > > We will need more log entries. However, this is looking like a DB >> > > version issue. >> > > >> > > On Fri, May 4, 2018 at 10:49 AM, Adam Witwicki >> > > >> > > wrote: >> > > >> > > > Hello, >> > > > >> > > > The management service won't start after update, I get this in >> > > > the log >> > > > >> > > > Failed startup of context o.e.j.w.WebAppContext@4148db48 >> > > > {/client,file:///usr/share/cloudstack-management/webapp/, >> > > > UNAVAILABLE}{/usr/share/cloudstack-management/webapp} >> > > > org.springframework.context.ApplicationContextException: Failed >> > > > to start bean 'cloudStackLifeCycle'; nested exception is >> > > com.cloud.utils.exception.CloudRuntimeException: >> > > > DB Exception on: com.mysql.jdbc.JDBC4PreparedStatement@ed1d2cf: >> > > > SELECT network
RE: Issue upgrading 4.9 to 4.11 Database?
ACS 4.9.3.1 Thanks Adam -Original Message- From: Rafael Weingärtner Sent: 04 May 2018 15:27 To: users Subject: Re: Issue upgrading 4.9 to 4.11 Database? ** This mail originated from OUTSIDE the Oakford corporate network. Treat hyperlinks and attachments in this email with caution. ** I forgot that was only for people with Apache ID. So is in Unknown column 'network_offerings.supports_public_access' in 'field list' . It seems that some scripts were not executed. That field is created with script "schema-4930to41000.sql". What was your ACS 4.9 version? On Fri, May 4, 2018 at 11:20 AM, Adam Witwicki wrote: > That URL required a username and password > > Here is the log @ pastebin https://pastebin.com/0xRnqPV3 > > Thanks > > Adam > > -Original Message- > From: Rafael Weingärtner > Sent: 04 May 2018 15:17 > To: users > Subject: Re: Issue upgrading 4.9 to 4.11 Database? > > ** This mail originated from OUTSIDE the Oakford corporate network. > Treat hyperlinks and attachments in this email with caution. ** > > Attachements are stripped... > Instead, you can use: https://paste.apache.org/ > > On Fri, May 4, 2018 at 11:02 AM, Adam Witwicki > > wrote: > > > Please find attached > > > > > > > > -Original Message- > > From: Rafael Weingärtner > > Sent: 04 May 2018 14:52 > > To: users > > Subject: Re: Issue upgrading 4.9 to 4.11 Database? > > > > ** This mail originated from OUTSIDE the Oakford corporate network. > > Treat hyperlinks and attachments in this email with caution. ** > > > > We will need more log entries. However, this is looking like a DB > > version issue. > > > > On Fri, May 4, 2018 at 10:49 AM, Adam Witwicki > > > > wrote: > > > > > Hello, > > > > > > The management service won't start after update, I get this in the > > > log > > > > > > Failed startup of context o.e.j.w.WebAppContext@4148db48 > > > {/client,file:///usr/share/cloudstack-management/webapp/, > > > UNAVAILABLE}{/usr/share/cloudstack-management/webapp} > > > org.springframework.context.ApplicationContextException: Failed to > > > start bean 'cloudStackLifeCycle'; nested exception is > > com.cloud.utils.exception.CloudRuntimeException: > > > DB Exception on: com.mysql.jdbc.JDBC4PreparedStatement@ed1d2cf: > > > SELECT network_offerings.id, network_offerings.name, > > > network_offerings.unique_name, network_offerings.display_text, > > > network_offerings.nw_rate, network_offerings.mc_rate, > > > network_offerings.traffic_type, network_offerings.specify_vlan, > > > network_offerings.system_only, > > > network_offerings.service_offering_id, > > > network_offerings.tags, network_offerings.default, > > > network_offerings.availability, network_offerings.state, > > > network_offerings.removed, network_offerings.created, > > > network_offerings.guest_type, > > > network_offerings.dedicated_lb_service, > > > network_offerings.shared_source_nat_service, > > > network_offerings.specify_ip_ranges, network_offerings.sort_key, > > > network_offerings.uuid, > > > network_offerings.redundant_router_service, > > > network_offerings.conserve_mode, > > > network_offerings.elastic_ip_service, > > > network_offerings.eip_associate_public_ip, > > > network_offerings.elastic_lb_service, > > > network_offerings.inline, network_offerings.is_persistent, > > > network_offerings.for_vpc, > > > network_offerings.egress_default_policy, > > > network_offerings.concurrent_connections, > > > network_offerings.keep_alive_enabled, > > > network_offerings.supports_streched_l2, > > > network_offerings.supports_public_access, > > > network_offerings.internal_lb, network_offerings.public_lb, > > > network_offerings.service_package_id FROM network_offerings WHERE > > > network_offerings.unique_name = _binary'QuickCloudNoServices' AND > > > network_offerings.removed IS NULL ORDER BY RAND() LIMIT 1 > > > > > > > > > Thanks > > > > > > Adam > > > > > > Disclaimer Notice: > > > This email has been sent by Oakford Technology Limited, while we > > > have checked this e-mail and any attachments for viruses, we can > > > not guarantee that they are virus-free. You must therefore take > > > full responsibility for virus checking. > > > This message and any attachments are confidential and should only > > > b