RE: Cold VM migration across datacenters

2021-07-21 Thread Adam Witwicki
Hi Vladimir

I would like to mention we have had issues with master-master-master galara 
replication for the database, locks are not replicated. We had to make sure all 
CS management servers are using the same master server at the same time.
A proxy and a vip works fine.
Was just a little gotcha for us.

Adam

-Original Message-
From: Vladimir Dombrovski 
Sent: 21 July 2021 16:09
To: users@cloudstack.apache.org
Subject: Re: Cold VM migration across datacenters

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello Andrija,

Thank you for the swift response. You did correctly understand our setup, which 
is aimed towards disaster recovery (DRP), rather than business continuity (BCP).

From a strictly technical point of view, we know that running a unique cluster 
is the only way to migrate compute resources between our datacenters when using 
KVM. Our Ceph storage is indeed running as a stretch cluster, and is 
provisioned with a CRUSH map that allows for the loss of a datacenter.

We have currently tested the 4.15 release of Cloudstack, which doesn't yet 
integrate the changes you've described in (1). However, due to the fact that 
the latency between our datacenters is quite low (~2ms), we could allow less 
isolation between entities.

What we are however looking into, is to ensure that in our configuration, any 
and all resources are pointed towards the correct local endpoint. To be more 
specific, these endpoints include:

- The address of the manager, which we could technically move to a VIP, as our 
hosts are plugged on the same subnet. From there, as we have master-master 
MySQL replication setup, the agents on the DR site should reconnect with the 
backup manager without much issue (we are still testing this hypothesis).
- The address of our primary storage, with which we're struggling. Technically 
we have a Ceph endpoint on each site, and we would like to keep it that way. 
This implies that we add multiple addresses for the same storage. This is 
possible in libvird as you can define multiple  tags in the  
declaration XML. We haven't found a way to do the same via Cloudstack
- The address of our secondary storage, which is in our case NFS and is simply 
plugged into Ceph using a different pool.

All this being said, I believe that we would eventually brute-force our way 
into a working setup, that would look similar to the solution (2) you've 
described. We are still looking for ways to do this more elegantly so we would 
be glad to hear any more ideas.

As a side note, are the DB hacks you have mentioned simple IP replacements? Or 
are there deeper modifications to be made?

Vladimir

On 2021/07/21 13:48:29, Andrija Panic  wrote:
> Migration between zones is NOT possible in any shape or form, so this
> is a route you should, IMO, abandon (you can always export VMs in this
> way or another, but this is not feasible in production)
>
> I understand you have 2 DCs and you want VMs to, eventually, become
> alive in 2nd DC, if the plane crashes on 1st DC? (well, your data is
> there, unless CEPH is stretched/distributed across 2 DCs and could
> survive the whole DC1 going down)
>
> If you are insisting on that HA level - then you could do it in 2
> ways, that cross my mind right now.
> (CEPH as distributed storage, zone wide, some nodes DC1, some DC2 -
> make sure your CEPH setup survives whole DC going down (this requires
> that CRUSH maps correctly configured etc)
>
>
> (1)   DC1 = Pod1 (1/2/3) and DC2 = Pod2 (or Pod 4/5/6 etc) - i.e. multiple
> Pods per DC - they all will be using zone-wide Ceph storage - your VMs
> are on your storage, that is the crucial part to not lose data.
> -- you can't really migrate VMs between Pods, only within cluster (and
> in some cases between clusters in the same Pod, staring from 4.16)
> -- this is OK if you have not-low-enough-latency between DC1 and DC2
> (but then CEPH will also suffer from that  higher latency)
>
> (2) A very untipical, not recommends, but technically possible setup -
> DC1+DC2 = one large DC = 1 POD = 1 cluster (or more clusters if
> DC1+needed) -
> still using CEPH as before
> -- requires ultra-low latency between DC1 and DC2 - and if plane
> crashes on
> DC1 (taking this example, as I've been to some Zurich DCs next to the
> airport...) - you can still start VM on hosts in DC2 in case it was a
> single cluster. In case you had multiple clusters - then it get's more
> complicated (minor DB hacks) etc.
>
> In both cases you still have to sort out Secondary Storage NFS HA
>
> In general,  you can't achieve what you want that easy nor you should
> be stretching the possibilities (that I just explained, as I would,
> probably, never use them in production)
>
> I guess I didn't help - but there you go.
>
> Andrija
>
>
>
> On Tue, 20 Jul 2021 at 16:28, Vladimir Dombrovski <
> vladimir.dombrov...@bso.co> wrote:
>
> > Hello,
> >
> > We're trying to dra

RE: VM console keeps pausing to the point of being unusable

2021-06-28 Thread Adam Witwicki
Hi Andrija,

No there is no improvement  with the console proxy and the instance being on 
the same host. It even affects the console of the console proxy itself.


Thanks

Ada,

-Original Message-
From: Andrija Panic 
Sent: 28 June 2021 17:05
To: users 
Subject: Re: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

my bad, wrongly understood you are using no-VNC.

Try migrating the target VM and the SSVM to the same host, and try again then - 
is there any improvement?

Best,

On Mon, 28 Jun 2021 at 17:58, Adam Witwicki  wrote:

>
> I don’t have that option in CS version 4.13.1.0, This is the old VNC
> way is it not?
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Andrija Panic 
> Sent: 28 June 2021 16:55
> To: users 
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Did you try switching back to VNC-based access - i.e. modify the
> global setting novnc.console.default=false and see if the old VNC way works 
> fine.
>
> Best,
>
> On Mon, 28 Jun 2021 at 17:49, Adam Witwicki 
> wrote:
>
> > Hi Andrija
> >
> > Yes, no issues accessing the VNC port directly on the KVM server.
> >
> > Thanks
> >
> > Adam
> >
> >
> > -Original Message-
> > From: Andrija Panic 
> > Sent: 28 June 2021 16:48
> > To: users 
> > Subject: Re: VM console keeps pausing to the point of being unusable
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Adam,
> >
> > "
> > Adam,
> >
> > did you try accessing the VM console via standalone VNC viewer,
> > based on the way Rohit explained  - dump the XML of the VM, check
> > the IP/port and password details - and use those to access
> >  and see if that connections is established quick
> enough.
> >
> > Best,
> > "
> >
> > Best,
> >
> > On Mon, 28 Jun 2021 at 11:32, Adam Witwicki
> > 
> > wrote:
> >
> > > Am I able to get some help with this?
> > >
> > > Cloudstack really is unusable
> > > Is it related to the speed issues with SSL?
> > >
> > > Thanks
> > >
> > > Adam
> > >
> > >
> > > -Original Message-
> > > From: Adam Witwicki
> > > Sent: 07 June 2021 14:08
> > > To: users@cloudstack.apache.org
> > > Subject: RE: VM console keeps pausing to the point of being
> > > unusable
> > >
> > > Forgive me if I am wrong
> > >
> > > But this is where the exception lies
> > > https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d4
> > > 7b
> > > 9a
> > > 403cb88bab99/services/console-proxy/server/src/main/java/com/cloud
> > > /c
> > > on
> > > soleproxy/vnc/VncClientPacketSender.java#L42
> > > private final BlockingQueue queue = new
> > > ArrayBlockingQueue(30);
> > >
> > > I guess I need to understand why objects are not leaving the queue?
> > >
> > >
> > > Thanks
> > >
> > > Adam
> > >
> > >
> > > -Original Message-
> > > From: Adam Witwicki 
> > > Sent: 07 June 2021 11:49
> > > To: users@cloudstack.apache.org
> > > Subject: RE: VM console keeps pausing to the point of being
> > > unusable
> > >
> > > ** This mail originated from OUTSIDE the Oakford corporate network.
> > > Treat hyperlinks and attachments in this email with caution. **
> > >
> > > Rohit, sorry the long delay
> > >
> > > Yes all servers and VMs are in time sync.
> > > It does seem to be an issue with the console proxy, no attempt of
> > > increasing its resources is improving the situation.
> > > What else can we try?
> > >
> > > Thanks
> > >
> > > Adam
> > >
> > >
> > > -Original Message-
> > > From: Rohit Yadav 
> > > Sent: 05 May 2021 09:21
> > > To: users@cloudstack.apache.org
> > > Subject: Re: VM console keeps pausing to the point of being
> > > unusable
> > >
> > > ** This mail originated from OUTSIDE the Oakford corporate network.
> > > Treat 

RE: VM console keeps pausing to the point of being unusable

2021-06-28 Thread Adam Witwicki

I don’t have that option in CS version 4.13.1.0, This is the old VNC way is it 
not?

Thanks

Adam

-Original Message-
From: Andrija Panic 
Sent: 28 June 2021 16:55
To: users 
Subject: Re: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Did you try switching back to VNC-based access - i.e. modify the global setting 
novnc.console.default=false and see if the old VNC way works fine.

Best,

On Mon, 28 Jun 2021 at 17:49, Adam Witwicki  wrote:

> Hi Andrija
>
> Yes, no issues accessing the VNC port directly on the KVM server.
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Andrija Panic 
> Sent: 28 June 2021 16:48
> To: users 
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Adam,
>
> "
> Adam,
>
> did you try accessing the VM console via standalone VNC viewer, based
> on the way Rohit explained  - dump the XML of the VM, check the
> IP/port and password details - and use those to access
>  and see if that connections is established quick enough.
>
> Best,
> "
>
> Best,
>
> On Mon, 28 Jun 2021 at 11:32, Adam Witwicki 
> wrote:
>
> > Am I able to get some help with this?
> >
> > Cloudstack really is unusable
> > Is it related to the speed issues with SSL?
> >
> > Thanks
> >
> > Adam
> >
> >
> > -Original Message-
> > From: Adam Witwicki
> > Sent: 07 June 2021 14:08
> > To: users@cloudstack.apache.org
> > Subject: RE: VM console keeps pausing to the point of being unusable
> >
> > Forgive me if I am wrong
> >
> > But this is where the exception lies
> > https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d47b
> > 9a
> > 403cb88bab99/services/console-proxy/server/src/main/java/com/cloud/c
> > on
> > soleproxy/vnc/VncClientPacketSender.java#L42
> > private final BlockingQueue queue = new
> > ArrayBlockingQueue(30);
> >
> > I guess I need to understand why objects are not leaving the queue?
> >
> >
> > Thanks
> >
> > Adam
> >
> >
> > -Original Message-
> > From: Adam Witwicki 
> > Sent: 07 June 2021 11:49
> > To: users@cloudstack.apache.org
> > Subject: RE: VM console keeps pausing to the point of being unusable
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Rohit, sorry the long delay
> >
> > Yes all servers and VMs are in time sync.
> > It does seem to be an issue with the console proxy, no attempt of
> > increasing its resources is improving the situation.
> > What else can we try?
> >
> > Thanks
> >
> > Adam
> >
> >
> > -Original Message-
> > From: Rohit Yadav 
> > Sent: 05 May 2021 09:21
> > To: users@cloudstack.apache.org
> > Subject: Re: VM console keeps pausing to the point of being unusable
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Hi Adam - can you check and sync time on your KVM hosts, management
> > servers and CPVM using ntp? This is because SSL-enabled connection
> > are time sensitive.
> > In order to test VNC directly, you can ssh into the host and do
> > something
> > like:
> >
> > # virsh list # find the VM
> >
> > Then run dumpxml and grab the IP/port and password, for example:
> >
> > # virsh dumpxml --security-info s-180-VM | grep vnc
> >  > passwd='_u6LayCdnCrr_JuUwCrq2A'>
> >
> >
> > If you're on the management network, you can use any VNC client and
> > details you find to connect to the VNC directly. I often connect
> > virt-manager (UI) to a KVM host over SSH and use the console
> > directly (the only trick is to grab the password, by clicking the
> > information tab -> go to VNC -> click on show password -> copy and
> > use it to see
> console).
> >
> >
> > Regards.
> >
> > 
> > From: David Jumani 
> > Sent: Wednesday, May 5, 2021 10:32
> > To: users@cloudstack.apache.org 
> > Subject: Re: VM console keeps pausing to the point of being unusable
> >
> > I a

RE: VM console keeps pausing to the point of being unusable

2021-06-28 Thread Adam Witwicki
Hi Andrija

Yes, no issues accessing the VNC port directly on the KVM server.

Thanks

Adam


-Original Message-
From: Andrija Panic 
Sent: 28 June 2021 16:48
To: users 
Subject: Re: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Adam,

"
Adam,

did you try accessing the VM console via standalone VNC viewer, based on the 
way Rohit explained  - dump the XML of the VM, check the IP/port and password 
details - and use those to access  and see if that 
connections is established quick enough.

Best,
"

Best,

On Mon, 28 Jun 2021 at 11:32, Adam Witwicki  wrote:

> Am I able to get some help with this?
>
> Cloudstack really is unusable
> Is it related to the speed issues with SSL?
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Adam Witwicki
> Sent: 07 June 2021 14:08
> To: users@cloudstack.apache.org
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> Forgive me if I am wrong
>
> But this is where the exception lies
> https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d47b9a
> 403cb88bab99/services/console-proxy/server/src/main/java/com/cloud/con
> soleproxy/vnc/VncClientPacketSender.java#L42
> private final BlockingQueue queue = new
> ArrayBlockingQueue(30);
>
> I guess I need to understand why objects are not leaving the queue?
>
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Adam Witwicki 
> Sent: 07 June 2021 11:49
> To: users@cloudstack.apache.org
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Rohit, sorry the long delay
>
> Yes all servers and VMs are in time sync.
> It does seem to be an issue with the console proxy, no attempt of
> increasing its resources is improving the situation.
> What else can we try?
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Rohit Yadav 
> Sent: 05 May 2021 09:21
> To: users@cloudstack.apache.org
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam - can you check and sync time on your KVM hosts, management
> servers and CPVM using ntp? This is because SSL-enabled connection are
> time sensitive.
> In order to test VNC directly, you can ssh into the host and do
> something
> like:
>
> # virsh list # find the VM
>
> Then run dumpxml and grab the IP/port and password, for example:
>
> # virsh dumpxml --security-info s-180-VM | grep vnc
>  passwd='_u6LayCdnCrr_JuUwCrq2A'>
>
>
> If you're on the management network, you can use any VNC client and
> details you find to connect to the VNC directly. I often connect
> virt-manager (UI) to a KVM host over SSH and use the console directly
> (the only trick is to grab the password, by clicking the information
> tab -> go to VNC -> click on show password -> copy and use it to see console).
>
>
> Regards.
>
> 
> From: David Jumani 
> Sent: Wednesday, May 5, 2021 10:32
> To: users@cloudstack.apache.org 
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> I agree, try checking the number of concurrent connections as well as
> increasing the CPVM capacity.
> Also check the network for any glitches / lag between the CPVM and the
> KVM hosts 
> From: Hean Seng 
> Sent: Tuesday, May 4, 2021 4:03 PM
> To: users@cloudstack.apache.org 
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> Do you know how many concurrent access to VNC  from your user ?
>
> Or you want to increase the Console Proxy Capacity?
>
> Also, please make sure the console proxy Ip/Network is up when you
> having issue on it.
>
>
>
>
> On Tue, May 4, 2021 at 5:43 PM Adam Witwicki 
> wrote:
>
> > This bug is making cloudstack  completely unusable
> >
> > Is there a way to test VNC directly on KVM?
> >
> > Thanks
> >
> > Adam
> >
> >
> > -Original Message-
> > From: Adam Witwicki
> > Sent: 29 April 2021 14:04
> > To: 'users@cloudstack.apache.org' 
> > Subject: RE: VM console keeps pausing to the point of being unusable
> >
> > It didn't go away forever, and now the same issue is back Same logs
> > as before h

RE: VM console keeps pausing to the point of being unusable

2021-06-28 Thread Adam Witwicki
Am I able to get some help with this?

Cloudstack really is unusable
Is it related to the speed issues with SSL?

Thanks

Adam


-Original Message-
From: Adam Witwicki
Sent: 07 June 2021 14:08
To: users@cloudstack.apache.org
Subject: RE: VM console keeps pausing to the point of being unusable

Forgive me if I am wrong

But this is where the exception lies 
https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d47b9a403cb88bab99/services/console-proxy/server/src/main/java/com/cloud/consoleproxy/vnc/VncClientPacketSender.java#L42
private final BlockingQueue queue = new 
ArrayBlockingQueue(30);

I guess I need to understand why objects are not leaving the queue?


Thanks

Adam


-Original Message-
From: Adam Witwicki 
Sent: 07 June 2021 11:49
To: users@cloudstack.apache.org
Subject: RE: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Rohit, sorry the long delay

Yes all servers and VMs are in time sync.
It does seem to be an issue with the console proxy, no attempt of increasing 
its resources is improving the situation.
What else can we try?

Thanks

Adam


-Original Message-
From: Rohit Yadav 
Sent: 05 May 2021 09:21
To: users@cloudstack.apache.org
Subject: Re: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam - can you check and sync time on your KVM hosts, management servers and 
CPVM using ntp? This is because SSL-enabled connection are time sensitive.
In order to test VNC directly, you can ssh into the host and do something like:

# virsh list # find the VM

Then run dumpxml and grab the IP/port and password, for example:

# virsh dumpxml --security-info s-180-VM | grep vnc



If you're on the management network, you can use any VNC client and details you 
find to connect to the VNC directly. I often connect virt-manager (UI) to a KVM 
host over SSH and use the console directly (the only trick is to grab the 
password, by clicking the information tab -> go to VNC -> click on show 
password -> copy and use it to see console).


Regards.


From: David Jumani 
Sent: Wednesday, May 5, 2021 10:32
To: users@cloudstack.apache.org 
Subject: Re: VM console keeps pausing to the point of being unusable

I agree, try checking the number of concurrent connections as well as 
increasing the CPVM capacity.
Also check the network for any glitches / lag between the CPVM and the KVM 
hosts 
From: Hean Seng 
Sent: Tuesday, May 4, 2021 4:03 PM
To: users@cloudstack.apache.org 
Subject: Re: VM console keeps pausing to the point of being unusable

Do you know how many concurrent access to VNC  from your user ?

Or you want to increase the Console Proxy Capacity?

Also, please make sure the console proxy Ip/Network is up when you having issue 
on it.




On Tue, May 4, 2021 at 5:43 PM Adam Witwicki 
wrote:

> This bug is making cloudstack  completely unusable
>
> Is there a way to test VNC directly on KVM?
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Adam Witwicki
> Sent: 29 April 2021 14:04
> To: 'users@cloudstack.apache.org' 
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> It didn't go away forever, and now the same issue is back Same logs as
> before https://pastebin.com/YS6XCy6y
>
> Adam
> -Original Message-
> From: Adam Witwicki
> Sent: 27 April 2021 07:30
> To: users@cloudstack.apache.org
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> Hi Nicolas,
>
> It was persisting over console systemVM destroy and creation, and any
> instance over 3 KVM hosts.
> Annoying we did not see the error in the console VM logs yesterday and
> users are reporting the console is currently working ok.
>
> Kind Regards
>
> Adam
>
> -Original Message-
> From: Nicolas Vazquez 
> Sent: 26 April 2021 21:26
> To: users@cloudstack.apache.org
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> That's an error I've never hit before, does the issue persist after
> destroying and recreating the console proxy VM?
>
> Regards,
> Nicolas Vazquez
> 
> From: Adam Witwicki 
> Sent: Thursday, April 22, 2021 7:17 AM
> To: users@cloudstack.apache.org 
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> Paste is now working!
>
> Thanks
>
>

RE: VM console keeps pausing to the point of being unusable

2021-06-07 Thread Adam Witwicki
Forgive me if I am wrong

But this is where the exception lies 
https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d47b9a403cb88bab99/services/console-proxy/server/src/main/java/com/cloud/consoleproxy/vnc/VncClientPacketSender.java#L42
private final BlockingQueue queue = new 
ArrayBlockingQueue(30);

I guess I need to understand why objects are not leaving the queue?


Thanks

Adam


-Original Message-
From: Adam Witwicki 
Sent: 07 June 2021 11:49
To: users@cloudstack.apache.org
Subject: RE: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Rohit, sorry the long delay

Yes all servers and VMs are in time sync.
It does seem to be an issue with the console proxy, no attempt of increasing 
its resources is improving the situation.
What else can we try?

Thanks

Adam


-Original Message-
From: Rohit Yadav 
Sent: 05 May 2021 09:21
To: users@cloudstack.apache.org
Subject: Re: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam - can you check and sync time on your KVM hosts, management servers and 
CPVM using ntp? This is because SSL-enabled connection are time sensitive.
In order to test VNC directly, you can ssh into the host and do something like:

# virsh list # find the VM

Then run dumpxml and grab the IP/port and password, for example:

# virsh dumpxml --security-info s-180-VM | grep vnc



If you're on the management network, you can use any VNC client and details you 
find to connect to the VNC directly. I often connect virt-manager (UI) to a KVM 
host over SSH and use the console directly (the only trick is to grab the 
password, by clicking the information tab -> go to VNC -> click on show 
password -> copy and use it to see console).


Regards.


From: David Jumani 
Sent: Wednesday, May 5, 2021 10:32
To: users@cloudstack.apache.org 
Subject: Re: VM console keeps pausing to the point of being unusable

I agree, try checking the number of concurrent connections as well as 
increasing the CPVM capacity.
Also check the network for any glitches / lag between the CPVM and the KVM 
hosts 
From: Hean Seng 
Sent: Tuesday, May 4, 2021 4:03 PM
To: users@cloudstack.apache.org 
Subject: Re: VM console keeps pausing to the point of being unusable

Do you know how many concurrent access to VNC  from your user ?

Or you want to increase the Console Proxy Capacity?

Also, please make sure the console proxy Ip/Network is up when you having issue 
on it.




On Tue, May 4, 2021 at 5:43 PM Adam Witwicki 
wrote:

> This bug is making cloudstack  completely unusable
>
> Is there a way to test VNC directly on KVM?
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Adam Witwicki
> Sent: 29 April 2021 14:04
> To: 'users@cloudstack.apache.org' 
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> It didn't go away forever, and now the same issue is back Same logs as
> before https://pastebin.com/YS6XCy6y
>
> Adam
> -Original Message-
> From: Adam Witwicki
> Sent: 27 April 2021 07:30
> To: users@cloudstack.apache.org
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> Hi Nicolas,
>
> It was persisting over console systemVM destroy and creation, and any
> instance over 3 KVM hosts.
> Annoying we did not see the error in the console VM logs yesterday and
> users are reporting the console is currently working ok.
>
> Kind Regards
>
> Adam
>
> -Original Message-
> From: Nicolas Vazquez 
> Sent: 26 April 2021 21:26
> To: users@cloudstack.apache.org
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> That's an error I've never hit before, does the issue persist after
> destroying and recreating the console proxy VM?
>
> Regards,
> Nicolas Vazquez
> 
> From: Adam Witwicki 
> Sent: Thursday, April 22, 2021 7:17 AM
> To: users@cloudstack.apache.org 
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> Paste is now working!
>
> Thanks
>
> Adam
>
> nicolas.vazq...@shapeblue.com
> www.shapeblue.com<http://www.shapeblue.com>
> 3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Adam Witwicki 
> Sent: 22 April 2021 09:18
> To: 

RE: VM console keeps pausing to the point of being unusable

2021-06-07 Thread Adam Witwicki
Rohit, sorry the long delay

Yes all servers and VMs are in time sync.
It does seem to be an issue with the console proxy, no attempt of increasing 
its resources is improving the situation.
What else can we try?

Thanks

Adam


-Original Message-
From: Rohit Yadav 
Sent: 05 May 2021 09:21
To: users@cloudstack.apache.org
Subject: Re: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam - can you check and sync time on your KVM hosts, management servers and 
CPVM using ntp? This is because SSL-enabled connection are time sensitive.
In order to test VNC directly, you can ssh into the host and do something like:

# virsh list # find the VM

Then run dumpxml and grab the IP/port and password, for example:

# virsh dumpxml --security-info s-180-VM | grep vnc



If you're on the management network, you can use any VNC client and details you 
find to connect to the VNC directly. I often connect virt-manager (UI) to a KVM 
host over SSH and use the console directly (the only trick is to grab the 
password, by clicking the information tab -> go to VNC -> click on show 
password -> copy and use it to see console).


Regards.


From: David Jumani 
Sent: Wednesday, May 5, 2021 10:32
To: users@cloudstack.apache.org 
Subject: Re: VM console keeps pausing to the point of being unusable

I agree, try checking the number of concurrent connections as well as 
increasing the CPVM capacity.
Also check the network for any glitches / lag between the CPVM and the KVM 
hosts 
From: Hean Seng 
Sent: Tuesday, May 4, 2021 4:03 PM
To: users@cloudstack.apache.org 
Subject: Re: VM console keeps pausing to the point of being unusable

Do you know how many concurrent access to VNC  from your user ?

Or you want to increase the Console Proxy Capacity?

Also, please make sure the console proxy Ip/Network is up when you having issue 
on it.




On Tue, May 4, 2021 at 5:43 PM Adam Witwicki 
wrote:

> This bug is making cloudstack  completely unusable
>
> Is there a way to test VNC directly on KVM?
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Adam Witwicki
> Sent: 29 April 2021 14:04
> To: 'users@cloudstack.apache.org' 
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> It didn't go away forever, and now the same issue is back Same logs as
> before https://pastebin.com/YS6XCy6y
>
> Adam
> -Original Message-
> From: Adam Witwicki
> Sent: 27 April 2021 07:30
> To: users@cloudstack.apache.org
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> Hi Nicolas,
>
> It was persisting over console systemVM destroy and creation, and any
> instance over 3 KVM hosts.
> Annoying we did not see the error in the console VM logs yesterday and
> users are reporting the console is currently working ok.
>
> Kind Regards
>
> Adam
>
> -Original Message-
> From: Nicolas Vazquez 
> Sent: 26 April 2021 21:26
> To: users@cloudstack.apache.org
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> That's an error I've never hit before, does the issue persist after
> destroying and recreating the console proxy VM?
>
> Regards,
> Nicolas Vazquez
> 
> From: Adam Witwicki 
> Sent: Thursday, April 22, 2021 7:17 AM
> To: users@cloudstack.apache.org 
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> Paste is now working!
>
> Thanks
>
> Adam
>
> nicolas.vazq...@shapeblue.com
> www.shapeblue.com<http://www.shapeblue.com>
> 3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Adam Witwicki 
> Sent: 22 April 2021 09:18
> To: users@cloudstack.apache.org
> Subject: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hello,
>
> We have an annoying issue, when using the cloudstack console to access
> a running instance the viewer will keep pausing every 10 to 15 mins,
> then its fine for a bit.
> I have found the cloud.log from the console proxy which is showing
> java exceptions queue full, could this be related?
>
> https://pastebin.com/YS6XCy6y
>
> CS version 4.13.1.0
>
> Any help appreciated
>
> Thanks
>
> A

RE: VM console keeps pausing to the point of being unusable

2021-05-04 Thread Adam Witwicki
This bug is making cloudstack  completely unusable

Is there a way to test VNC directly on KVM?

Thanks

Adam


-Original Message-
From: Adam Witwicki
Sent: 29 April 2021 14:04
To: 'users@cloudstack.apache.org' 
Subject: RE: VM console keeps pausing to the point of being unusable

It didn’t go away forever, and now the same issue is back Same logs as before 
https://pastebin.com/YS6XCy6y

Adam
-Original Message-----
From: Adam Witwicki
Sent: 27 April 2021 07:30
To: users@cloudstack.apache.org
Subject: RE: VM console keeps pausing to the point of being unusable

Hi Nicolas,

It was persisting over console systemVM destroy and creation, and any instance 
over 3 KVM hosts.
Annoying we did not see the error in the console VM logs yesterday and users 
are reporting the console is currently working ok.

Kind Regards

Adam

-Original Message-
From: Nicolas Vazquez 
Sent: 26 April 2021 21:26
To: users@cloudstack.apache.org
Subject: Re: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

That's an error I've never hit before, does the issue persist after destroying 
and recreating the console proxy VM?

Regards,
Nicolas Vazquez
____
From: Adam Witwicki 
Sent: Thursday, April 22, 2021 7:17 AM
To: users@cloudstack.apache.org 
Subject: RE: VM console keeps pausing to the point of being unusable

Paste is now working!

Thanks

Adam

nicolas.vazq...@shapeblue.com
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK @shapeblue




-Original Message-
From: Adam Witwicki 
Sent: 22 April 2021 09:18
To: users@cloudstack.apache.org
Subject: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello,

We have an annoying issue, when using the cloudstack console to access a 
running instance the viewer will keep pausing every 10 to 15 mins, then its 
fine for a bit.
I have found the cloud.log from the console proxy which is showing java 
exceptions queue full, could this be related?

https://pastebin.com/YS6XCy6y

CS version 4.13.1.0

Any help appreciated

Thanks

Adam

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and des

RE: VM console keeps pausing to the point of being unusable

2021-04-29 Thread Adam Witwicki
It didn’t go away forever, and now the same issue is back
Same logs as before
https://pastebin.com/YS6XCy6y

Adam
-Original Message-
From: Adam Witwicki
Sent: 27 April 2021 07:30
To: users@cloudstack.apache.org
Subject: RE: VM console keeps pausing to the point of being unusable

Hi Nicolas,

It was persisting over console systemVM destroy and creation, and any instance 
over 3 KVM hosts.
Annoying we did not see the error in the console VM logs yesterday and users 
are reporting the console is currently working ok.

Kind Regards

Adam

-Original Message-
From: Nicolas Vazquez 
Sent: 26 April 2021 21:26
To: users@cloudstack.apache.org
Subject: Re: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

That's an error I've never hit before, does the issue persist after destroying 
and recreating the console proxy VM?

Regards,
Nicolas Vazquez
____
From: Adam Witwicki 
Sent: Thursday, April 22, 2021 7:17 AM
To: users@cloudstack.apache.org 
Subject: RE: VM console keeps pausing to the point of being unusable

Paste is now working!

Thanks

Adam

nicolas.vazq...@shapeblue.com
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK @shapeblue




-Original Message-----
From: Adam Witwicki 
Sent: 22 April 2021 09:18
To: users@cloudstack.apache.org
Subject: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello,

We have an annoying issue, when using the cloudstack console to access a 
running instance the viewer will keep pausing every 10 to 15 mins, then its 
fine for a bit.
I have found the cloud.log from the console proxy which is showing java 
exceptions queue full, could this be related?

https://pastebin.com/YS6XCy6y

CS version 4.13.1.0

Any help appreciated

Thanks

Adam

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before

RE: VM console keeps pausing to the point of being unusable

2021-04-26 Thread Adam Witwicki
Hi Andrija,

Sorry for not being clear, the pastebin link was held for moderation for a few 
hours, that link now works.

We have not moved to 4.15 nor NoVNC, does anyone know if this is supported by 
hostbill?

Kind Regards

Adam

-Original Message-
From: Andrija Panic 
Sent: 26 April 2021 21:58
To: users 
Subject: Re: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Adam, you are agan talking to yourself, and that is not healthy ;)

Joke aside, since "paste is now working" - that means you moved to noVNC, that 
means you upgraded to 4.14.0.0 at least, right?

Share some feedback, so we can help.

Cheers

On Mon, 26 Apr 2021 at 22:27, Nicolas Vazquez 
wrote:

> Hi Adam,
>
> That's an error I've never hit before, does the issue persist after
> destroying and recreating the console proxy VM?
>
> Regards,
> Nicolas Vazquez
> ____
> From: Adam Witwicki 
> Sent: Thursday, April 22, 2021 7:17 AM
> To: users@cloudstack.apache.org 
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> Paste is now working!
>
> Thanks
>
> Adam
>
> nicolas.vazq...@shapeblue.com
> www.shapeblue.com
> 3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Adam Witwicki 
> Sent: 22 April 2021 09:18
> To: users@cloudstack.apache.org
> Subject: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hello,
>
> We have an annoying issue, when using the cloudstack console to access
> a running instance the viewer will keep pausing every 10 to 15 mins,
> then its fine for a bit.
> I have found the cloud.log from the console proxy which is showing
> java exceptions queue full, could this be related?
>
> https://pastebin.com/YS6XCy6y
>
> CS version 4.13.1.0
>
> Any help appreciated
>
> Thanks
>
> Adam
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, The Manor House,
> Potterne, Wiltshire. SN10 5PN.
> Registered in England and Wales No. 5971519
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, The Manor House,
> Potterne, Wiltshire. SN10 5PN.
> Registered in England and Wales No. 5971519
>
>

--

Andrija Panić
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they 

RE: VM console keeps pausing to the point of being unusable

2021-04-26 Thread Adam Witwicki
Hi Nicolas,

It was persisting over console systemVM destroy and creation, and any instance 
over 3 KVM hosts.
Annoying we did not see the error in the console VM logs yesterday and users 
are reporting the console is currently working ok.

Kind Regards

Adam

-Original Message-
From: Nicolas Vazquez 
Sent: 26 April 2021 21:26
To: users@cloudstack.apache.org
Subject: Re: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

That's an error I've never hit before, does the issue persist after destroying 
and recreating the console proxy VM?

Regards,
Nicolas Vazquez
____
From: Adam Witwicki 
Sent: Thursday, April 22, 2021 7:17 AM
To: users@cloudstack.apache.org 
Subject: RE: VM console keeps pausing to the point of being unusable

Paste is now working!

Thanks

Adam

nicolas.vazq...@shapeblue.com
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK @shapeblue




-Original Message-----
From: Adam Witwicki 
Sent: 22 April 2021 09:18
To: users@cloudstack.apache.org
Subject: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello,

We have an annoying issue, when using the cloudstack console to access a 
running instance the viewer will keep pausing every 10 to 15 mins, then its 
fine for a bit.
I have found the cloud.log from the console proxy which is showing java 
exceptions queue full, could this be related?

https://pastebin.com/YS6XCy6y

CS version 4.13.1.0

Any help appreciated

Thanks

Adam

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: VM console keeps pausing to the point of being unusable

2021-04-22 Thread Adam Witwicki
Paste is now working!

Thanks

Adam

-Original Message-
From: Adam Witwicki 
Sent: 22 April 2021 09:18
To: users@cloudstack.apache.org
Subject: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello,

We have an annoying issue, when using the cloudstack console to access a 
running instance the viewer will keep pausing every 10 to 15 mins, then its 
fine for a bit.
I have found the cloud.log from the console proxy which is showing java 
exceptions queue full, could this be related?

https://pastebin.com/YS6XCy6y

CS version 4.13.1.0

Any help appreciated

Thanks

Adam

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



VM console keeps pausing to the point of being unusable

2021-04-22 Thread Adam Witwicki
Hello,

We have an annoying issue, when using the cloudstack console to access a 
running instance the viewer will keep pausing every 10 to 15 mins, then its 
fine for a bit.
I have found the cloud.log from the console proxy which is showing java 
exceptions queue full, could this be related?

https://pastebin.com/YS6XCy6y

CS version 4.13.1.0

Any help appreciated

Thanks

Adam

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



Centos EVPN bug

2021-01-12 Thread Adam Witwicki
Hi Guys,

I know some of us are using EVPN and I think we are all doing it in slightly 
different ways.
We are using IPV4 addresses on the loopback interface advertising via 2 
link-local IPv6 to a spine switch

We added a new KVM node and after what we now know is around 4 hours bgp routes 
in FRR start to be rejected

B>r 10.10.216.20/32 [20/0] via fe80::aa2b:b5ff:feb5:20b3, enp113s0f0, 3d10h19m
   rvia fe80::aa2b:b5ff:feb5:2a59, enp113s0f1, 3d10h19m
B>* 10.10.216.21/32 [20/0] via fe80::aa2b:b5ff:feb5:20b3, enp113s0f0, 01w4d22h
  *via fe80::aa2b:b5ff:feb5:2a59, enp113s0f1, 01w4d22h
B>r 10.10.216.22/32 [20/0] via fe80::aa2b:b5ff:feb5:20b3, enp113s0f0, 19:24:51
  rvia fe80::aa2b:b5ff:feb5:2a59, enp113s0f1, 19:24:51
B>* 10.10.216.30/32 [20/0] via fe80::aa2b:b5ff:feb5:20b3, enp113s0f0, 01w4d22h
  *via fe80::aa2b:b5ff:feb5:2a59, enp113s0f1, 01w4d22h
B>r 10.10.216.31/32 [20/0] via fe80::aa2b:b5ff:feb5:20b3, enp113s0f0, 5d13h03m
  rvia fe80::aa2b:b5ff:feb5:2a59, enp113s0f1, 5d13h03m
B>r 10.10.216.32/32 [20/0] via fe80::aa2b:b5ff:feb5:20b3, enp113s0f0, 2d21h0

It turns out there seems to be an incompatibility issue between the kernel and 
FRR versions.
We rolled back the kernel of this node and now it's working as intended.

Bugged kernel - 3.10.0-1160.2.2.el7
Working kernel - 3.10.0-1127.19.1.el7
FRR version 7.2-01

At some point I will setup a test system to replicate and let the relevant 
communities know.
I thought to raise it here for visibility in case other people are struggling 
with a similar issue.

Thanks

Adam Witwicki




Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: reserved CPU?

2020-12-22 Thread Adam Witwicki
That setting seems fine, I can start an instance.

I cannot start a system VM due to reserved capacity?

Thanks

Adam

-Original Message-
From: Alireza Eskandari 
Sent: 22 December 2020 11:33
To: users@cloudstack.apache.org
Subject: Re: reserved CPU?

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi,
From "Home > Infrastructure > Clusters > your_cluster" click on "Settings"
tab. In search bar type "cpu" and you will see a list of variables that 
controls CPU usage and allocation in your cluster.
You can "increase cpu.overprovisioning.factor" or change 
"cluster.cpu.allocated.capacity.disablethreshold"
Regards

On Tue, Dec 22, 2020 at 12:39 PM Adam Witwicki 
wrote:

> Hello
>
> I am unable to start any routers due to this error
>
> Host does not have enough reserved CPU available, cannot allocate to
> this host.
>
> I cannot find any setting to adjust the reserved CPU for a host -
> these have plenty
>
> Can someone point me in the right direction please
>
> CS 4.13.1.0 - KVM hosts
>
>
> Adam
>
>
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, The Manor House,
> Potterne, Wiltshire. SN10 5PN.
> Registered in England and Wales No. 5971519
>
>
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



reserved CPU?

2020-12-22 Thread Adam Witwicki
Hello

I am unable to start any routers due to this error

Host does not have enough reserved CPU available, cannot allocate to this host.

I cannot find any setting to adjust the reserved CPU for a host - these have 
plenty

Can someone point me in the right direction please

CS 4.13.1.0 - KVM hosts


Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: Local-link address change issue

2020-08-24 Thread Adam Witwicki
Hi Robert

I think you may need to restart your agents - the new value should be written 
to /etc/cloudstack/agent/agent.properties

control.cidr=

Thanks

Adam

-Original Message-
From: Robert Ward 
Sent: 24 August 2020 04:22
To: users@cloudstack.apache.org
Subject: Local-link address change issue

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello all,

I am attempting to change the KVM System VM's local-link address and am not 
having much success. I have changed the global setting: control.cidr (CS 
4.14.0) to both 10.254.0.0/16 and 172.31.0.0/16, restarted the MS, destroyed 
and re-created the VM's but I am still stuck in the 169.254.0.0/16 subnet. Not 
seeing anything in the logs that would indicate an issue.

Can anyone suggest where I might be going wrong here?

Thanks,

Robert
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



Cant add additional management servers with multiple IPs

2020-08-17 Thread Adam Witwicki
Hi Guys

Trying to set up cloudstack 4.13.1, but I am getting SSL cert errors on the 2 
additional management servers I'm trying to setup.
These servers have more than one IP - could it be related to this bug 
https://github.com/apache/cloudstack/issues/2530





Name: cloudstack-management
Arch: x86_64
Version : 4.13.1.0
Release : shapeblue0.el7

Error from 1st management server
2020-08-17 10:43:56,747 ERROR [o.a.c.c.p.RootCACustomTrustManager] 
(pool-60-thread-1:null) (logid:) Certificate ownership verification failed for 
client: 10.10.216.221
2020-08-17 10:43:56,747 ERROR [c.c.u.n.Link] 
(AgentManager-SSLHandshakeHandler-5:null) (logid:) SSL error caught during wrap 
data: General SSLEngine problem, for local address=/10.10.216.200:8250, remote 
address=/10.10.216.221:53568.
2020-08-17 10:43:56,797 ERROR [o.a.c.c.p.RootCACustomTrustManager] 
(pool-61-thread-1:null) (logid:) Certificate ownership verification failed for 
client: 10.10.216.221
2020-08-17 10:43:56,798 ERROR [c.c.u.n.Link] 
(AgentManager-SSLHandshakeHandler-5:null) (logid:) SSL error caught during wrap 
data: General SSLEngine problem, for local address=/10.10.216.200:8250, remote 
address=/10.10.216.221:53570.


Error from additional management server I'm trying to add
2020-08-17 10:43:56,640 ERROR [c.c.u.n.Link] (StatsCollector-2:ctx-aa7d0a75) 
(logid:10ec5992) SSL error caught during unwrap data: Received fatal alert: 
certificate_unknown, for local address=/10.10.216.221:53564, remote 
address=/10.10.216.200:8250. The client may have invalid ca-certificates.
2020-08-17 10:43:56,641 WARN  [c.c.a.m.ClusteredAgentManagerImpl] 
(StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) Unable to connect to peer 
management server: 168482836, ip: 10.10.216.200 due to SSL: Fail to init SSL! 
java.io.IOException: SSL: Handshake failed with peer management server 
'168482836' on 10.10.216.200:8250
java.io.IOException: SSL: Fail to init SSL! java.io.IOException: SSL: Handshake 
failed with peer management server '168482836' on 10.10.216.200:8250
2020-08-17 10:43:56,641 DEBUG [c.c.a.m.ClusteredAgentAttache] 
(StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) Seq 66-1928103590467993603: 
Unable to forward null
2020-08-17 10:43:56,641 WARN  [c.c.a.m.AgentManagerImpl] 
(StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) Resource [Host:66] is 
unreachable: Host 66: Unable to reach the peer that the agent is connected
2020-08-17 10:43:56,641 WARN  [c.c.r.ResourceManagerImpl] 
(StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) Unable to obtain host 66 
statistics.
2020-08-17 10:43:56,641 WARN  [c.c.s.StatsCollector] 
(StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) The Host stats is null for 
host: 66
2020-08-17 10:43:56,698 ERROR [c.c.u.n.Link] (StatsCollector-2:ctx-aa7d0a75) 
(logid:10ec5992) SSL error caught during unwrap data: Received fatal alert: 
certificate_unknown, for local address=/10.10.216.221:53566, remote 
address=/10.10.216.200:8250. The client may have invalid ca-certificates.
2020-08-17 10:43:56,698 WARN  [c.c.a.m.ClusteredAgentManagerImpl] 
(StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) Unable to connect to peer 
management server: 168482836, ip: 10.10.216.200 due to SSL: Fail to init SSL! 
java.io.IOException: SSL: Handshake failed with peer management server 
'168482836' on 10.10.216.200:8250
java.io.IOException: SSL: Fail to init SSL! java.io.IOException: SSL: Handshake 
failed with peer management server '168482836' on 10.10.216.200:8250
2020-08-17 10:43:56,699 DEBUG [c.c.a.m.ClusteredAgentAttache] 
(StatsCollector-2:ctx-aa7d0a75) (logid:10ec5992) Seq 69-2867104112774742021: 
Unable to forward null
2020-08-17 10:43:56,748 ERROR [c.c.u.n.Link] (StatsCollector-2:ctx-aa7d0a75) 
(logid:10ec5992) SSL error caught during unwrap data: Received fatal alert: 
certificate_unknown, for local address=/10.10.216.221:53568, remote 
address=/10.10.216.200:8250. The client may have invalid ca-certificates.


I thought I solved this by following  
http://mail-archives.apache.org/mod_mbox/cloudstack-users/201805.mbox/%3cvi1pr0701mb186911b8e6ba4b81e00ea963e9...@vi1pr0701mb1869.eurprd07.prod.outlook.com%3E



But when adding KVM agents I get this on the management server

address=/10.10.216.222:38570.
2020-08-17 11:18:13,195 ERROR [o.a.c.c.p.RootCACustomTrustManager] 
(pool-13-thread-1:null) (logid:) Certificate ownership verification failed for 
client: 10.10.216.221
2020-08-17 11:18:13,196 ERROR [c.c.u.n.Link] 
(AgentManager-SSLHandshakeHandler-1:null) (logid:) SSL error caught during wrap 
data: General SSLEngine problem, for local address=/10.10.216.200:8250, remote 
address=/10.10.216.221:33998.
2020-08-17 11:18:13,277 ERROR [o.a.c.c.p.RootCACustomTrustManager] 
(pool-14-thread-1:null) (logid:) Certificate ownership verification failed for 
client: 10.10.216.221
2020-08-17 11:18:13,278 ERROR [c.c.u.n.Link] 
(AgentManager-SSLHandshakeHandler-1:null) (logid:) SSL error caught during wrap 
data: General SSLEngine problem, for local addre

A quick question

2020-07-17 Thread Adam Witwicki
Hi guys,

Just a quick question, why do all the docs say to use  binlog-format = 'ROW' 
for mysql?

Thanks

Adam


Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



HA

2020-04-20 Thread Adam Witwicki
Hello

Does anyone use the instance HA function with KVM, and are they ways to make it 
less sensitive?

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: I might be crazy

2020-04-15 Thread Adam Witwicki
I need db.props and keys


Thanks :D



-Original Message-
From: Adam Witwicki 
Sent: 15 April 2020 09:34
To: users@cloudstack.apache.org
Subject: I might be crazy

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello,

I am trying to copy a Cloudstack 4.11.0 database to a new 4.11.0 management 
server But the MS fails to start due to cert and encryption errors

Are there some files I would also need to copy over to the new MS server?

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



I might be crazy

2020-04-15 Thread Adam Witwicki
Hello,

I am trying to copy a Cloudstack 4.11.0 database to a new 4.11.0 management 
server
But the MS fails to start due to cert and encryption errors

Are there some files I would also need to copy over to the new MS server?

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: Instances lose internet

2020-04-08 Thread Adam Witwicki
We are using this version

20/03/2018
100.76.104.14900


-Original Message-
From: Andrija Panic 
Sent: 07 April 2020 17:44
To: users 
Subject: Re: Instances lose internet

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

(and then some more virtio causing BSOD on every other win2008/2012 VM,
yes)

On Tue, 7 Apr 2020 at 17:23, Simon Weller  wrote:

> Is the version current? I remember a bug related to this in virtio a
> couple of years ago.
> 
> From: Adam Witwicki 
> Sent: Tuesday, April 7, 2020 10:22 AM
> To: users 
> Subject: Re: Instances lose internet
>
> Yes using virtio for nics and storage
>
> Thanks
> Adam
>
> 
> From: Simon Weller 
> Sent: Tuesday, April 7, 2020 4:19:59 PM
> To: users@cloudstack.apache.org 
> Subject: Re: Instances lose internet
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Are you using the virtio drivers?
> 
> From: Adam Witwicki 
> Sent: Tuesday, April 7, 2020 1:33 AM
> To: users@cloudstack.apache.org 
> Subject: Instances lose internet
>
> Hello,
>
> I wonder if anyone else has seen this, problerly not cloudstack but a
> user on our systems says that their instances randomly lose connection
> to the internet.
> The windows instance says the nic is connected but can not ping any
> other server. There is no Virtual router as it's a L2 network I found
> a post that mentioned an issue with bonding - but I can not see any
> bonding errors in the syslog
>
> Thanks
>
> Adam
>
>
> Cloudstack Version 4.11
> Ubuntu 16 KVM
> Bonded Nics
>
> /usr/bin/qemu-system-x86_64 --version
> QEMU emulator version 2.5.0 (Debian 1:2.5+dfsg-5ubuntu10.31),
> Copyright
> (c) 2003-2008 Fabrice Bellard
>
> virsh version
> Compiled against library: libvirt 1.3.1 Using library: libvirt 1.3.1
> Using API: QEMU 1.3.1 Running hypervisor: QEMU 2.5.0
>
> Distributor ID: Ubuntu
> Description:Ubuntu 16.04.4 LTS
> Release:16.04
> Codename:   xenial
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, The Manor House,
> Potterne, Wiltshire. SN10 5PN.
> Registered in England and Wales No. 5971519
>
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, The Manor House,
> Potterne, Wiltshire. SN10 5PN.
> Registered in England and Wales No. 5971519
>
>

--

Andrija Panić
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and

Re: Instances lose internet

2020-04-07 Thread Adam Witwicki
Yes using virtio for nics and storage

Thanks
Adam


From: Simon Weller 
Sent: Tuesday, April 7, 2020 4:19:59 PM
To: users@cloudstack.apache.org 
Subject: Re: Instances lose internet

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Are you using the virtio drivers?

From: Adam Witwicki 
Sent: Tuesday, April 7, 2020 1:33 AM
To: users@cloudstack.apache.org 
Subject: Instances lose internet

Hello,

I wonder if anyone else has seen this, problerly not cloudstack but a user on 
our systems says that their instances randomly lose connection to the internet.
The windows instance says the nic is connected but can not ping any other 
server. There is no Virtual router as it's a L2 network
I found a post that mentioned an issue with bonding - but I can not see any 
bonding errors in the syslog

Thanks

Adam


Cloudstack Version 4.11
Ubuntu 16 KVM
Bonded Nics

/usr/bin/qemu-system-x86_64 --version
QEMU emulator version 2.5.0 (Debian 1:2.5+dfsg-5ubuntu10.31), Copyright (c) 
2003-2008 Fabrice Bellard

virsh version
Compiled against library: libvirt 1.3.1
Using library: libvirt 1.3.1
Using API: QEMU 1.3.1
Running hypervisor: QEMU 2.5.0

Distributor ID: Ubuntu
Description:Ubuntu 16.04.4 LTS
Release:16.04
Codename:   xenial

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519


Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



Instances lose internet

2020-04-06 Thread Adam Witwicki
Hello,

I wonder if anyone else has seen this, problerly not cloudstack but a user on 
our systems says that their instances randomly lose connection to the internet.
The windows instance says the nic is connected but can not ping any other 
server. There is no Virtual router as it's a L2 network
I found a post that mentioned an issue with bonding - but I can not see any 
bonding errors in the syslog

Thanks

Adam


Cloudstack Version 4.11
Ubuntu 16 KVM
Bonded Nics

/usr/bin/qemu-system-x86_64 --version
QEMU emulator version 2.5.0 (Debian 1:2.5+dfsg-5ubuntu10.31), Copyright (c) 
2003-2008 Fabrice Bellard

virsh version
Compiled against library: libvirt 1.3.1
Using library: libvirt 1.3.1
Using API: QEMU 1.3.1
Running hypervisor: QEMU 2.5.0

Distributor ID: Ubuntu
Description:Ubuntu 16.04.4 LTS
Release:16.04
Codename:   xenial

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: RE: Deploy VM error

2020-04-01 Thread Adam Witwicki
You have to add a rule for your network

-Original Message-
From: F5 
Sent: 01 April 2020 13:51
To: users@cloudstack.apache.org
Subject: Re: RE: Deploy VM error

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

egress rules nothing configured.

in Instance resolv.conf is with dns 8.8.8.8

but it does not solve even for that address.

Is there any light of what can be?
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: Deploy VM error

2020-04-01 Thread Adam Witwicki
Network egress rules?

Network > your isolated network name > egress rules tab


Adam

-Original Message-
From: F5 
Sent: 01 April 2020 13:24
To: users@cloudstack.apache.org
Subject: Re: Deploy VM error

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Perfect, that was it, manually adding the range and it worked.

Thanks.

Taking advantage of the moment, I am new to ACS, now that I have created a VM, 
what causes it not to be surfing the internet, is there any additional 
configuration for this?
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: Agent staying in alert mode

2020-03-20 Thread Adam Witwicki
Restarting libvirtd helped

Thanks everyone

Adam

-Original Message-
From: Simon Weller 
Sent: 18 March 2020 14:31
To: users@cloudstack.apache.org
Subject: Re: Agent staying in alert mode

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

No, it will not. All VMs will stay up.

From: Adam Witwicki 
Sent: Wednesday, March 18, 2020 9:27 AM
To: users@cloudstack.apache.org 
Subject: RE: Agent staying in alert mode

Will that stop all the Instances?

Thanks

Adam

-Original Message-
From: Simon Weller 
Sent: 18 March 2020 14:26
To: users@cloudstack.apache.org
Subject: Re: Agent staying in alert mode

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Have you tried restarting libvirtd and then restarting the cloudstack agent?


From: Adam Witwicki 
Sent: Wednesday, March 18, 2020 3:06 AM
To: users@cloudstack.apache.org 
Subject: RE: Agent staying in alert mode

Hi Andrija,

Setting the host to management IP, and not our LB VIP. The agent process seems 
to stall

2020-03-18 07:44:01,969 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) cpus=32, speed=3800, ram=269385596928, 
_dom0MinMem=1073741824, _dom0OvercommitMem=0, cpu sockets=2
2020-03-18 07:44:01,972 DEBUG [cloud.resource.ServerResourceBase] 
(Agent-Handler-1:null) (logid:) Parameters for private nic: 10.10.240.126 - 
a0:36:9f:24:32:6a-255.255.255.0
2020-03-18 07:44:01,973 DEBUG [cloud.resource.ServerResourceBase] 
(Agent-Handler-1:null) (logid:) Parameters for storage nic: 10.10.240.126 - 
a0:36:9f:24:32:6a-255.255.255.0
2020-03-18 07:44:01,973 DEBUG [cloud.resource.ServerResourceBase] 
(Agent-Handler-1:null) (logid:) Parameters for public nic: 10.10.240.126 - 
a0:36:9f:24:32:6a-255.255.255.0
2020-03-18 07:44:01,973 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) Executing: 
/usr/share/cloudstack-common/scripts/vm/hypervisor/versions.sh
2020-03-18 07:44:01,984 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) Execution is successful.
2020-03-18 07:44:01,985 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) Executing: sudo grep InitiatorName= 
/etc/iscsi/initiatorname.iscsi
2020-03-18 07:44:01,992 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) Execution is successful.
2020-03-18 07:44:01,993 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(Agent-Handler-1:null) (logid:) Attempting to create storage pool 
257c9140-3863-4be2-85e2-9835650f1b45 (Filesystem) in libvirt
2020-03-18 07:44:01,993 DEBUG [kvm.resource.LibvirtConnection] 
(Agent-Handler-1:null) (logid:) Looking for libvirtd connection at: 
qemu:///system HALTS HERE AND DOES NOT CONTINUE

I waited 10 mins for a timeout then stopped the agent

Thanks

Adam


-Original Message-
From: Andrija Panic 
Sent: 17 March 2020 18:52
To: users 
Subject: Re: Agent staying in alert mode

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Can you change that to the IP of the mgmt server and then restart the agent? it 
should always point to the IP not hostname (what is that value there, "who put 
it there" etc - perhaps  a valid
question?)

Best,


On Tue, 17 Mar 2020 at 15:38, Adam Witwicki  wrote:

> Hi Suresh
>
> /etc/cloudstack/agent/agent.properties
> host=cs.cloudstack
>
> telnet
> user@ois-mh-p1-c1-h2-b:~$ telnet cs.cloudstack 8250 Trying
> 10.10.240.10...
> Connected to cs.cloudstack.
> Escape character is '^]'.
>
>
> Same for all my other KVM nodes. 7 of 8 connected
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Suresh Kumar Anaparti 
> Sent: 17 March 2020 13:11
> To: users@cloudstack.apache.org
> Subject: Re: Agent staying in alert mode
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> What is the value of the host parameter in
> "/etc/cloudstack/agent/agent.properties" file of the KVM host with
> agent connectivity issue. Can you telnet to that management server on
> port 8250 from the KVM host.
>
> Are other KVM agents connected to same management server?
>
> Thanks,
> Suresh
>
> On Tue, Mar 17, 2020 at 3:05 PM Adam Witwicki
> 
> wrote:
>
> > Hi Suresh,
> >
> > Thanks for looking
> >
> > All KVM hosts can connect to management server - via ping
> >
> > The mgmt_server_id is Null for the alert host
> >
> > Host
> >
> > name;uuid;status;type;private_ip_address;private_netmask;private_mac
&g

RE: Agent staying in alert mode

2020-03-18 Thread Adam Witwicki
Will that stop all the Instances?

Thanks

Adam

-Original Message-
From: Simon Weller 
Sent: 18 March 2020 14:26
To: users@cloudstack.apache.org
Subject: Re: Agent staying in alert mode

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Have you tried restarting libvirtd and then restarting the cloudstack agent?


From: Adam Witwicki 
Sent: Wednesday, March 18, 2020 3:06 AM
To: users@cloudstack.apache.org 
Subject: RE: Agent staying in alert mode

Hi Andrija,

Setting the host to management IP, and not our LB VIP. The agent process seems 
to stall

2020-03-18 07:44:01,969 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) cpus=32, speed=3800, ram=269385596928, 
_dom0MinMem=1073741824, _dom0OvercommitMem=0, cpu sockets=2
2020-03-18 07:44:01,972 DEBUG [cloud.resource.ServerResourceBase] 
(Agent-Handler-1:null) (logid:) Parameters for private nic: 10.10.240.126 - 
a0:36:9f:24:32:6a-255.255.255.0
2020-03-18 07:44:01,973 DEBUG [cloud.resource.ServerResourceBase] 
(Agent-Handler-1:null) (logid:) Parameters for storage nic: 10.10.240.126 - 
a0:36:9f:24:32:6a-255.255.255.0
2020-03-18 07:44:01,973 DEBUG [cloud.resource.ServerResourceBase] 
(Agent-Handler-1:null) (logid:) Parameters for public nic: 10.10.240.126 - 
a0:36:9f:24:32:6a-255.255.255.0
2020-03-18 07:44:01,973 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) Executing: 
/usr/share/cloudstack-common/scripts/vm/hypervisor/versions.sh
2020-03-18 07:44:01,984 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) Execution is successful.
2020-03-18 07:44:01,985 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) Executing: sudo grep InitiatorName= 
/etc/iscsi/initiatorname.iscsi
2020-03-18 07:44:01,992 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) Execution is successful.
2020-03-18 07:44:01,993 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(Agent-Handler-1:null) (logid:) Attempting to create storage pool 
257c9140-3863-4be2-85e2-9835650f1b45 (Filesystem) in libvirt
2020-03-18 07:44:01,993 DEBUG [kvm.resource.LibvirtConnection] 
(Agent-Handler-1:null) (logid:) Looking for libvirtd connection at: 
qemu:///system HALTS HERE AND DOES NOT CONTINUE

I waited 10 mins for a timeout then stopped the agent

Thanks

Adam


-Original Message-
From: Andrija Panic 
Sent: 17 March 2020 18:52
To: users 
Subject: Re: Agent staying in alert mode

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Can you change that to the IP of the mgmt server and then restart the agent? it 
should always point to the IP not hostname (what is that value there, "who put 
it there" etc - perhaps  a valid
question?)

Best,


On Tue, 17 Mar 2020 at 15:38, Adam Witwicki  wrote:

> Hi Suresh
>
> /etc/cloudstack/agent/agent.properties
> host=cs.cloudstack
>
> telnet
> user@ois-mh-p1-c1-h2-b:~$ telnet cs.cloudstack 8250 Trying
> 10.10.240.10...
> Connected to cs.cloudstack.
> Escape character is '^]'.
>
>
> Same for all my other KVM nodes. 7 of 8 connected
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Suresh Kumar Anaparti 
> Sent: 17 March 2020 13:11
> To: users@cloudstack.apache.org
> Subject: Re: Agent staying in alert mode
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> What is the value of the host parameter in
> "/etc/cloudstack/agent/agent.properties" file of the KVM host with
> agent connectivity issue. Can you telnet to that management server on
> port 8250 from the KVM host.
>
> Are other KVM agents connected to same management server?
>
> Thanks,
> Suresh
>
> On Tue, Mar 17, 2020 at 3:05 PM Adam Witwicki
> 
> wrote:
>
> > Hi Suresh,
> >
> > Thanks for looking
> >
> > All KVM hosts can connect to management server - via ping
> >
> > The mgmt_server_id is Null for the alert host
> >
> > Host
> >
> > name;uuid;status;type;private_ip_address;private_netmask;private_mac
> > _a
> > ddress;storage_ip_address;storage_netmask;storage_mac_address;storag
> > e_
> > ip_address_2;storage_mac_address_2;storage_netmask_2;cluster_id;publ
> > ic
> > _ip_address;public_netmask;public_mac_address;proxy_port;data_center
> > _i
> > d;pod_id;cpu_sockets;cpus;speed;url;fs_type;hypervisor_type;hypervis
> > or
> > _version;ram;resource;version;parent;total_size;capabilities;guid;av
> > ai
> > lable;setup;dom0_memory;last_ping;mgmt_serv

RE: Agent staying in alert mode

2020-03-18 Thread Adam Witwicki
Hi Andrija,

Setting the host to management IP, and not our LB VIP. The agent process seems 
to stall

2020-03-18 07:44:01,969 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) cpus=32, speed=3800, ram=269385596928, 
_dom0MinMem=1073741824, _dom0OvercommitMem=0, cpu sockets=2
2020-03-18 07:44:01,972 DEBUG [cloud.resource.ServerResourceBase] 
(Agent-Handler-1:null) (logid:) Parameters for private nic: 10.10.240.126 - 
a0:36:9f:24:32:6a-255.255.255.0
2020-03-18 07:44:01,973 DEBUG [cloud.resource.ServerResourceBase] 
(Agent-Handler-1:null) (logid:) Parameters for storage nic: 10.10.240.126 - 
a0:36:9f:24:32:6a-255.255.255.0
2020-03-18 07:44:01,973 DEBUG [cloud.resource.ServerResourceBase] 
(Agent-Handler-1:null) (logid:) Parameters for public nic: 10.10.240.126 - 
a0:36:9f:24:32:6a-255.255.255.0
2020-03-18 07:44:01,973 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) Executing: 
/usr/share/cloudstack-common/scripts/vm/hypervisor/versions.sh
2020-03-18 07:44:01,984 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) Execution is successful.
2020-03-18 07:44:01,985 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) Executing: sudo grep InitiatorName= 
/etc/iscsi/initiatorname.iscsi
2020-03-18 07:44:01,992 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) (logid:) Execution is successful.
2020-03-18 07:44:01,993 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(Agent-Handler-1:null) (logid:) Attempting to create storage pool 
257c9140-3863-4be2-85e2-9835650f1b45 (Filesystem) in libvirt
2020-03-18 07:44:01,993 DEBUG [kvm.resource.LibvirtConnection] 
(Agent-Handler-1:null) (logid:) Looking for libvirtd connection at: 
qemu:///system
HALTS HERE AND DOES NOT CONTINUE

I waited 10 mins for a timeout then stopped the agent

Thanks

Adam


-Original Message-
From: Andrija Panic 
Sent: 17 March 2020 18:52
To: users 
Subject: Re: Agent staying in alert mode

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Can you change that to the IP of the mgmt server and then restart the agent? it 
should always point to the IP not hostname (what is that value there, "who put 
it there" etc - perhaps  a valid
question?)

Best,


On Tue, 17 Mar 2020 at 15:38, Adam Witwicki  wrote:

> Hi Suresh
>
> /etc/cloudstack/agent/agent.properties
> host=cs.cloudstack
>
> telnet
> user@ois-mh-p1-c1-h2-b:~$ telnet cs.cloudstack 8250 Trying
> 10.10.240.10...
> Connected to cs.cloudstack.
> Escape character is '^]'.
>
>
> Same for all my other KVM nodes. 7 of 8 connected
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Suresh Kumar Anaparti 
> Sent: 17 March 2020 13:11
> To: users@cloudstack.apache.org
> Subject: Re: Agent staying in alert mode
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> What is the value of the host parameter in
> "/etc/cloudstack/agent/agent.properties" file of the KVM host with
> agent connectivity issue. Can you telnet to that management server on
> port 8250 from the KVM host.
>
> Are other KVM agents connected to same management server?
>
> Thanks,
> Suresh
>
> On Tue, Mar 17, 2020 at 3:05 PM Adam Witwicki
> 
> wrote:
>
> > Hi Suresh,
> >
> > Thanks for looking
> >
> > All KVM hosts can connect to management server - via ping
> >
> > The mgmt_server_id is Null for the alert host
> >
> > Host
> >
> > name;uuid;status;type;private_ip_address;private_netmask;private_mac
> > _a
> > ddress;storage_ip_address;storage_netmask;storage_mac_address;storag
> > e_
> > ip_address_2;storage_mac_address_2;storage_netmask_2;cluster_id;publ
> > ic
> > _ip_address;public_netmask;public_mac_address;proxy_port;data_center
> > _i
> > d;pod_id;cpu_sockets;cpus;speed;url;fs_type;hypervisor_type;hypervis
> > or
> > _version;ram;resource;version;parent;total_size;capabilities;guid;av
> > ai
> > lable;setup;dom0_memory;last_ping;mgmt_server_id;disconnected;create
> > d;
> > removed;update_count;resource_state;owner;lastUpdated;engine_state
> > ois-mh-p1-c1-h2-b;3d5e4c35-7e10-4560-8a2e-5ebf770e837d;Alert;Routing
> > ;1
> > 0.10.240.126;255.255.255.0;a0:36:9f:24:32:6a;10.10.240.126;255.255.2
> > 55
> > .0;a0:36:9f:24:32:6a;\N;\N;\N;5;10.10.240.126;255.255.255.0;a0:36:9f
> > :2
> > 4:32:6a;\N;5;5;2;32;3800;iqn.1993-08.org.debian:01:7c8e527ccba4;\N;K
> > VM
> > ;\N;269385596928;\N;4.11.0.0;\N;\N;hvm,snapshot;44190139-5b1b-3642-b
> > 78
> &g

RE: Agent staying in alert mode

2020-03-17 Thread Adam Witwicki
Hi Suresh

/etc/cloudstack/agent/agent.properties
host=cs.cloudstack

telnet
user@ois-mh-p1-c1-h2-b:~$ telnet cs.cloudstack 8250
Trying 10.10.240.10...
Connected to cs.cloudstack.
Escape character is '^]'.


Same for all my other KVM nodes. 7 of 8 connected

Thanks

Adam

-Original Message-
From: Suresh Kumar Anaparti 
Sent: 17 March 2020 13:11
To: users@cloudstack.apache.org
Subject: Re: Agent staying in alert mode

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

What is the value of the host parameter in 
"/etc/cloudstack/agent/agent.properties" file of the KVM host with agent 
connectivity issue. Can you telnet to that management server on port 8250 from 
the KVM host.

Are other KVM agents connected to same management server?

Thanks,
Suresh

On Tue, Mar 17, 2020 at 3:05 PM Adam Witwicki 
wrote:

> Hi Suresh,
>
> Thanks for looking
>
> All KVM hosts can connect to management server - via ping
>
> The mgmt_server_id is Null for the alert host
>
> Host
>
> name;uuid;status;type;private_ip_address;private_netmask;private_mac_a
> ddress;storage_ip_address;storage_netmask;storage_mac_address;storage_
> ip_address_2;storage_mac_address_2;storage_netmask_2;cluster_id;public
> _ip_address;public_netmask;public_mac_address;proxy_port;data_center_i
> d;pod_id;cpu_sockets;cpus;speed;url;fs_type;hypervisor_type;hypervisor
> _version;ram;resource;version;parent;total_size;capabilities;guid;avai
> lable;setup;dom0_memory;last_ping;mgmt_server_id;disconnected;created;
> removed;update_count;resource_state;owner;lastUpdated;engine_state
> ois-mh-p1-c1-h2-b;3d5e4c35-7e10-4560-8a2e-5ebf770e837d;Alert;Routing;1
> 0.10.240.126;255.255.255.0;a0:36:9f:24:32:6a;10.10.240.126;255.255.255
> .0;a0:36:9f:24:32:6a;\N;\N;\N;5;10.10.240.126;255.255.255.0;a0:36:9f:2
> 4:32:6a;\N;5;5;2;32;3800;iqn.1993-08.org.debian:01:7c8e527ccba4;\N;KVM
> ;\N;269385596928;\N;4.11.0.0;\N;\N;hvm,snapshot;44190139-5b1b-3642-b78
> 6-41ca577081e9-LibvirtComputingResource;1;0;0;1546450279;\N;2019-12-24
> 09:25:53;2019-06-11 21:59:43;\N;2516;Enabled;\N;\N;Disabled
>
> mshost
>
> msid;runid;name;state;version;service_ip;service_port;last_update;remo
> ved;alert_count
> 91765225987;1584406841937;ois-mh-csmg-01;Up;4.11.0.0;10.10.240.21;9090
> ;2020-03-17
> 09:33:07;\N;0
> 91765663747;1584406829845;ois-mh-csmg-02;Up;4.11.0.0;10.10.240.22;9090
> ;2020-03-17
> 09:33:09;\N;0
> 91766390275;1584406828383;ois-mh-csmg-03;Up;4.11.0.0;10.10.240.23;9090
> ;2020-03-17
> 09:33:05;\N;0
>
>
> Adam
>
> -Original Message-
> From: Suresh Kumar Anaparti 
> Sent: 16 March 2020 19:35
> To: users@cloudstack.apache.org
> Subject: Re: Agent staying in alert mode
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> Seems it is clustered environment and other node(s) are being
> disconnected, from the logs. Can you check the management host of
> connected agents in the KVM host using net stat and the host value in
> "/etc/cloudstack/agent/agent.properties".
>
> Also, check the ownership of the host in mgmt_server_id column of the
> host table and validate it against the management server details in mshost 
> table.
>
> Thanks,
> Suresh
>
> On Mon, Mar 16, 2020 at 4:37 PM Adam Witwicki
> 
> wrote:
>
> > Hi Guys,
> >
> > I need some help,
> >
> > One of my KVM agents is stuck in alert state - no amount of
> > restarting the agent helps
> >
> >
> >
> > Cloudstack version 4.11.0.0
> >
> > Logs
> > Management https://pastebin.com/JY2bvqmM Agent
> > https://pastebin.com/G7g8wXNN
> >
> > All the other agents connect fine
> >
> > Thanks
> >
> > Adam
> >
> >
> >
> > Disclaimer Notice:
> > This email has been sent by Oakford Technology Limited, while we
> > have checked this e-mail and any attachments for viruses, we can not
> > guarantee that they are virus-free. You must therefore take full
> > responsibility for virus checking.
> > This message and any attachments are confidential and should only be
> > read by those to whom they are addressed. If you are not the
> > intended recipient, please contact us, delete the message from your
> > computer and destroy any copies. Any distribution or copying without
> > our prior permission is prohibited.
> > Internet communications are not always secure and therefore Oakford
> > Technology Limited does not accept legal responsibility for this message.
> > The recipient is responsible for v

RE: Agent staying in alert mode

2020-03-17 Thread Adam Witwicki
Hi Suresh,

Thanks for looking

All KVM hosts can connect to management server - via ping

The mgmt_server_id is Null for the alert host

Host
name;uuid;status;type;private_ip_address;private_netmask;private_mac_address;storage_ip_address;storage_netmask;storage_mac_address;storage_ip_address_2;storage_mac_address_2;storage_netmask_2;cluster_id;public_ip_address;public_netmask;public_mac_address;proxy_port;data_center_id;pod_id;cpu_sockets;cpus;speed;url;fs_type;hypervisor_type;hypervisor_version;ram;resource;version;parent;total_size;capabilities;guid;available;setup;dom0_memory;last_ping;mgmt_server_id;disconnected;created;removed;update_count;resource_state;owner;lastUpdated;engine_state
ois-mh-p1-c1-h2-b;3d5e4c35-7e10-4560-8a2e-5ebf770e837d;Alert;Routing;10.10.240.126;255.255.255.0;a0:36:9f:24:32:6a;10.10.240.126;255.255.255.0;a0:36:9f:24:32:6a;\N;\N;\N;5;10.10.240.126;255.255.255.0;a0:36:9f:24:32:6a;\N;5;5;2;32;3800;iqn.1993-08.org.debian:01:7c8e527ccba4;\N;KVM;\N;269385596928;\N;4.11.0.0;\N;\N;hvm,snapshot;44190139-5b1b-3642-b786-41ca577081e9-LibvirtComputingResource;1;0;0;1546450279;\N;2019-12-24
 09:25:53;2019-06-11 21:59:43;\N;2516;Enabled;\N;\N;Disabled

mshost
msid;runid;name;state;version;service_ip;service_port;last_update;removed;alert_count
91765225987;1584406841937;ois-mh-csmg-01;Up;4.11.0.0;10.10.240.21;9090;2020-03-17
 09:33:07;\N;0
91765663747;1584406829845;ois-mh-csmg-02;Up;4.11.0.0;10.10.240.22;9090;2020-03-17
 09:33:09;\N;0
91766390275;1584406828383;ois-mh-csmg-03;Up;4.11.0.0;10.10.240.23;9090;2020-03-17
 09:33:05;\N;0


Adam

-Original Message-
From: Suresh Kumar Anaparti 
Sent: 16 March 2020 19:35
To: users@cloudstack.apache.org
Subject: Re: Agent staying in alert mode

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

Seems it is clustered environment and other node(s) are being disconnected, 
from the logs. Can you check the management host of connected agents in the KVM 
host using net stat and the host value in 
"/etc/cloudstack/agent/agent.properties".

Also, check the ownership of the host in mgmt_server_id column of the host 
table and validate it against the management server details in mshost table.

Thanks,
Suresh

On Mon, Mar 16, 2020 at 4:37 PM Adam Witwicki 
wrote:

> Hi Guys,
>
> I need some help,
>
> One of my KVM agents is stuck in alert state - no amount of restarting
> the agent helps
>
>
>
> Cloudstack version 4.11.0.0
>
> Logs
> Management https://pastebin.com/JY2bvqmM Agent
> https://pastebin.com/G7g8wXNN
>
> All the other agents connect fine
>
> Thanks
>
> Adam
>
>
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, The Manor House,
> Potterne, Wiltshire. SN10 5PN.
> Registered in England and Wales No. 5971519
>
>
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



Agent staying in alert mode

2020-03-16 Thread Adam Witwicki
Hi Guys,

I need some help,

One of my KVM agents is stuck in alert state - no amount of restarting the 
agent helps



Cloudstack version 4.11.0.0

Logs
Management https://pastebin.com/JY2bvqmM
Agent https://pastebin.com/G7g8wXNN

All the other agents connect fine

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



SSL error on fresh agent install

2020-02-24 Thread Adam Witwicki
CS version 4.13

When I am trying to add an agent - it fails to connect to the management 
server, how can I diagnose this?


2020-02-24 10:10:05,786 INFO  [cloud.agent.Agent] (main:null) (logid:) Agent 
[id = new : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 
: host = 192.168.240.1 : port = 8250
2020-02-24 10:10:05,791 INFO  [utils.nio.NioClient] (main:null) (logid:) 
Connecting to 192.168.240.1:8250
2020-02-24 10:10:05,795 INFO  [utils.nio.Link] (main:null) (logid:) Conf file 
found: /etc/cloudstack/agent/agent.properties
2020-02-24 10:10:20,891 WARN  [utils.nio.Link] (main:null) (logid:) SSL 
Handshake has taken more than 15s to connect to: /192.168.240.1:8250. Please 
investigate this connection.
2020-02-24 10:10:20,892 ERROR [utils.nio.NioClient] (main:null) (logid:) SSL 
Handshake failed while connecting to host: 192.168.240.1 port: 8250
2020-02-24 10:10:20,893 ERROR [utils.nio.NioConnection] (main:null) (logid:) 
Unable to initialize the threads.
java.io.IOException: SSL Handshake failed while connecting to host: 
192.168.240.1 port: 8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:67)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:95)
at com.cloud.agent.Agent.start(Agent.java:282)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:455)
at 
com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:422)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:406)
at com.cloud.agent.AgentShell.start(AgentShell.java:512)
at com.cloud.agent.AgentShell.main(AgentShell.java:547)
2020-02-24 10:10:20,898 INFO  [utils.exception.CSExceptionErrorCode] 
(main:null) (logid:) Could not find exception: 
com.cloud.utils.exception.NioConnectionException in error code list for 
exceptions
2020-02-24 10:10:20,898 WARN  [cloud.agent.Agent] (main:null) (logid:) NIO 
Connection Exception  com.cloud.utils.exception.NioConnectionException: SSL 
Handshake failed while connecting to host: 192.168.240.1 port: 8250
2020-02-24 10:10:20,898 INFO  [cloud.agent.Agent] (main:null) (logid:) 
Attempted to connect to the server, but received an unexpected exception, 
trying again...

The correct files seem to have been created
ls /etc/cloudstack/agent/
agent.properties  cloud.ca.crt  cloud.crt  cloud.csr  cloud.jks  cloud.key  
environment.properties  log4j-cloud.xml

The management server only shows

2020-02-24 10:11:20,535 WARN  [c.c.u.n.Link] 
(AgentManager-SSLHandshakeHandler-1:null) (logid:) SSL Handshake has taken more 
than 15s to connect to: /192.168.240.3:59940. Please investigate this 
connection.

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



Migration between zones

2019-12-18 Thread Adam Witwicki
Hello,

Is there a way to migrate Instances between zones? Gui or Database

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: Password in URL

2019-12-13 Thread Adam Witwicki
But its then displayed on the users screen - where anyone can see it?

Thanks

Adam

-Original Message-
From: Andrija Panic 
Sent: 13 December 2019 11:21
To: users 
Subject: Re: Password in URL

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

(and assuming you are using SSL/443 - that's not a problem in that sense)

On Fri, 13 Dec 2019 at 12:20, Andrija Panic  wrote:

> Password IS sent in the clear text when you log in initially - you can
> check that via developer tools while doing a successful login.
>
> On Fri, 13 Dec 2019 at 11:15, Thomas Joseph 
> wrote:
>
>> It must be a design feature then, you can redirect it to the dev group.
>>
>> With regards
>> Thomas
>>
>> On Fri, 13 Dec 2019, 8:57 am Adam Witwicki, 
>> wrote:
>>
>> > Hi Thomas
>> >
>> > 443, the concern is its displayed in full view on the screen.
>> >
>> > Version 4.11 btw
>> >
>> > Thanks
>> >
>> > Adam
>> >
>> > -Original Message-
>> > From: Thomas Joseph 
>> > Sent: 13 December 2019 08:55
>> > To: users@cloudstack.apache.org
>> > Subject: Re: Password in URL
>> >
>> > ** This mail originated from OUTSIDE the Oakford corporate network.
>> Treat
>> > hyperlinks and attachments in this email with caution. **
>> >
>> > Hello Adam
>> >
>> > Are you using port 80 instead for 443 for the console login?
>> >
>> > With regards
>> > Thomas
>> >
>> > On Fri, 13 Dec 2019, 8:34 am Adam Witwicki,
>> > 
>> > wrote:
>> >
>> > > Sorry, its not a hash it is the password!
>> > >
>> > > -Original Message-
>> > > From: Adam Witwicki 
>> > > Sent: 13 December 2019 08:32
>> > > To: users@cloudstack.apache.org
>> > > Subject: Password in URL
>> > >
>> > > ** This mail originated from OUTSIDE the Oakford corporate network.
>> > > Treat hyperlinks and attachments in this email with caution. **
>> > >
>> > > Hello,
>> > >
>> > > When I have failed logon (cloudstack is unable to read from
>> > > database) the redirected url shows the password hash
>> > >
>> > > /client/?username=admin&password=MASKMASKMASKMASK&domain=&languag
>> > > e=
>> > >
>> > > Is this an issue?
>> > >
>> > > Thanks
>> > >
>> > > Adam
>> > >
>> > >
>> > >
>> > > Disclaimer Notice:
>> > > This email has been sent by Oakford Technology Limited, while we
>> > > have checked this e-mail and any attachments for viruses, we can
>> > > not guarantee that they are virus-free. You must therefore take
>> > > full responsibility for virus checking.
>> > > This message and any attachments are confidential and should only
>> > > be read by those to whom they are addressed. If you are not the
>> > > intended recipient, please contact us, delete the message from
>> > > your computer and destroy any copies. Any distribution or copying
>> > > without our prior permission is prohibited.
>> > > Internet communications are not always secure and therefore
>> > > Oakford Technology Limited does not accept legal responsibility
>> > > for this
>> message.
>> > > The recipient is responsible for verifying its authenticity
>> > > before acting on the contents. Any views or opinions presented
>> > > are solely those of the author and do not necessarily represent
>> > > those of Oakford
>> > Technology Limited.
>> > > Registered address: Oakford Technology Limited, The Manor House,
>> > > Potterne, Wiltshire. SN10 5PN.
>> > > Registered in England and Wales No. 5971519
>> > >
>> > > Disclaimer Notice:
>> > > This email has been sent by Oakford Technology Limited, while we
>> > > have checked this e-mail and any attachments for viruses, we can
>> > > not guarantee that they are virus-free. You must therefore take
>> > > full responsibility for virus checking.
>> > > This message and any attachments are confidential and should only
>> > > be read by those to whom they are addressed. If you are not the
>> > > intended recipient, please contact us, delete the message from
>> &g

RE: Password in URL

2019-12-13 Thread Adam Witwicki
Hi Thomas

443, the concern is its displayed in full view on the screen.

Version 4.11 btw

Thanks

Adam

-Original Message-
From: Thomas Joseph 
Sent: 13 December 2019 08:55
To: users@cloudstack.apache.org
Subject: Re: Password in URL

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello Adam

Are you using port 80 instead for 443 for the console login?

With regards
Thomas

On Fri, 13 Dec 2019, 8:34 am Adam Witwicki,  wrote:

> Sorry, its not a hash it is the password!
>
> -Original Message-
> From: Adam Witwicki 
> Sent: 13 December 2019 08:32
> To: users@cloudstack.apache.org
> Subject: Password in URL
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hello,
>
> When I have failed logon (cloudstack is unable to read from database)
> the redirected url shows the password hash
>
> /client/?username=admin&password=MASKMASKMASKMASK&domain=&language=
>
> Is this an issue?
>
> Thanks
>
> Adam
>
>
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, The Manor House,
> Potterne, Wiltshire. SN10 5PN.
> Registered in England and Wales No. 5971519
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, The Manor House,
> Potterne, Wiltshire. SN10 5PN.
> Registered in England and Wales No. 5971519
>
>
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: Password in URL

2019-12-13 Thread Adam Witwicki
Sorry, its not a hash it is the password!

-Original Message-
From: Adam Witwicki 
Sent: 13 December 2019 08:32
To: users@cloudstack.apache.org
Subject: Password in URL

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello,

When I have failed logon (cloudstack is unable to read from database) the 
redirected url shows the password hash

/client/?username=admin&password=MASKMASKMASKMASK&domain=&language=

Is this an issue?

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



Password in URL

2019-12-13 Thread Adam Witwicki
Hello,

When I have failed logon (cloudstack is unable to read from database) the 
redirected url shows the password hash

/client/?username=admin&password=MASKMASKMASKMASK&domain=&language=

Is this an issue?

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: Unable to view console

2019-09-26 Thread Adam Witwicki
Restarting the remaining nodes got it going again..


Strange :)



-Original Message-
From: Adam Witwicki 
Sent: 26 September 2019 16:10
To: users@cloudstack.apache.org
Subject: RE: Unable to view console

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Issue is related to management server HA Dropping to 1 node allowed connection

Thanks

Adam




-Original Message-
From: Adam Witwicki 
Sent: 26 September 2019 16:04
To: users@cloudstack.apache.org
Subject: Unable to view console

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello,

I am unable to view any console - this is the console VM log

019-09-26 15:01:44,641 ERROR [cloud.consoleproxy.ConsoleProxyHttpHandlerHelper] 
(Thread-8:null) decode token. host info is not found!
2019-09-26 15:01:44,649 WARN  [cloud.consoleproxy.ConsoleProxyAjaxHandler] 
(Thread-8:null) Exception, java.lang.IllegalArgumentException
at 
com.cloud.consoleproxy.ConsoleProxyAjaxHandler.doHandle(ConsoleProxyAjaxHandler.java:98)
at 
com.cloud.consoleproxy.ConsoleProxyAjaxHandler.handle(ConsoleProxyAjaxHandler.java:51)
at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:79)
at sun.net.httpserver.AuthFilter.doFilter(AuthFilter.java:83)
at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:82)
at 
sun.net.httpserver.ServerImpl$Exchange$LinkHandler.handle(ServerImpl.java:675)
at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:79)
at sun.net.httpserver.ServerImpl$Exchange.run(ServerImpl.java:645)
at java.lang.Thread.run(Thread.java:748)

There is nothing in the management logs

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN

RE: Unable to view console

2019-09-26 Thread Adam Witwicki
Issue is related to management server HA
Dropping to 1 node allowed connection

Thanks

Adam




-Original Message-
From: Adam Witwicki 
Sent: 26 September 2019 16:04
To: users@cloudstack.apache.org
Subject: Unable to view console

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello,

I am unable to view any console - this is the console VM log

019-09-26 15:01:44,641 ERROR [cloud.consoleproxy.ConsoleProxyHttpHandlerHelper] 
(Thread-8:null) decode token. host info is not found!
2019-09-26 15:01:44,649 WARN  [cloud.consoleproxy.ConsoleProxyAjaxHandler] 
(Thread-8:null) Exception, java.lang.IllegalArgumentException
at 
com.cloud.consoleproxy.ConsoleProxyAjaxHandler.doHandle(ConsoleProxyAjaxHandler.java:98)
at 
com.cloud.consoleproxy.ConsoleProxyAjaxHandler.handle(ConsoleProxyAjaxHandler.java:51)
at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:79)
at sun.net.httpserver.AuthFilter.doFilter(AuthFilter.java:83)
at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:82)
at 
sun.net.httpserver.ServerImpl$Exchange$LinkHandler.handle(ServerImpl.java:675)
at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:79)
at sun.net.httpserver.ServerImpl$Exchange.run(ServerImpl.java:645)
at java.lang.Thread.run(Thread.java:748)

There is nothing in the management logs

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



Unable to view console

2019-09-26 Thread Adam Witwicki
Hello,

I am unable to view any console - this is the console VM log

019-09-26 15:01:44,641 ERROR [cloud.consoleproxy.ConsoleProxyHttpHandlerHelper] 
(Thread-8:null) decode token. host info is not found!
2019-09-26 15:01:44,649 WARN  [cloud.consoleproxy.ConsoleProxyAjaxHandler] 
(Thread-8:null) Exception,
java.lang.IllegalArgumentException
at 
com.cloud.consoleproxy.ConsoleProxyAjaxHandler.doHandle(ConsoleProxyAjaxHandler.java:98)
at 
com.cloud.consoleproxy.ConsoleProxyAjaxHandler.handle(ConsoleProxyAjaxHandler.java:51)
at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:79)
at sun.net.httpserver.AuthFilter.doFilter(AuthFilter.java:83)
at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:82)
at 
sun.net.httpserver.ServerImpl$Exchange$LinkHandler.handle(ServerImpl.java:675)
at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:79)
at sun.net.httpserver.ServerImpl$Exchange.run(ServerImpl.java:645)
at java.lang.Thread.run(Thread.java:748)

There is nothing in the management logs

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: System Capacity Limits

2019-09-17 Thread Adam Witwicki
I have not re tested

Thanks

Adam

-Original Message-
From: Andrija Panic 
Sent: 17 September 2019 10:05
To: users 
Subject: Re: System Capacity Limits

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Adam,

Any conclusions, did you find something in the log?


On Sat, Sep 14, 2019, 23:54 Sven Vogel  wrote:

> Hi Adam,
>
> Take a look here. Maybe it helps.
>
> https://www.slideshare.net/AlexTian/cloud-stack-troubleshooting
>
> Cheers,
>
> Sven
>
> Von meinem iPhone gesendet
>
>
> __
>
> Sven Vogel
> Teamlead Platform
>
> EWERK DIGITAL GmbH
> Brühl 24, D-04109 Leipzig
> P +49 341 42649 - 99
> F +49 341 42649 - 98
> s.vo...@ewerk.com
> www.ewerk.com
>
> Geschäftsführer:
> Dr. Erik Wende, Hendrik Schubert, Frank Richter
> Registergericht: Leipzig HRB 9065
>
> Zertifiziert nach:
> ISO/IEC 27001:2013
> DIN EN ISO 9001:2015
> DIN ISO/IEC 2-1:2011
>
> EWERK-Blog | LinkedIn | Xing | Twitter | Facebook
>
> Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.
>
> Disclaimer Privacy:
> Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien)
> ist vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht
> der bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung,
> Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte
> informieren Sie in diesem Fall unverzüglich den Absender und löschen
> Sie die E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem System.
> Vielen Dank.
>
> The contents of this e-mail (including any attachments) are
> confidential and may be legally privileged. If you are not the
> intended recipient of this e-mail, any disclosure, copying,
> distribution or use of its contents is strictly prohibited, and you
> should please notify the sender immediately and then delete it (including any 
> attachments) from your system. Thank you.
> > Am 13.09.2019 um 19:06 schrieb Andrija Panic :
> >
> > Hi Adam,
> >
> > That insufficient capacity exception message has probably nothing to
> > do with the number of CPU cores (and most of the time with anything
> > capacity-related, it's just that we are lazy to pass the real error
> > to as the API reaponse...) but is a general message that can mean
> > 100 different things.
> >
> > The real reason you'll only find in the mgmt logs.
> >
> > And, I have tested 4.11.2 and 4.13/master - number of CPU cores is
> > NOT taken into the consideration/math - with or without
> > overprovisioning (I have cpu.overprovisioning.factor set to 2. 0 and
> > was able to provision
> 250%
> > of my CPU core).
> >
> > Dig the logs and see what is really the exception.
> >
> > Best,
> > Andrija
> >
> >
> >> On Fri, Sep 13, 2019, 05:23 Adam Witwicki 
> wrote:
> >>
> >> Hello,
> >>
> >> Going back to "unable to start MV due to insufficient capacity"
> >> errors Is there a way to turn these off as I can overprovision for
> >> "CPU" but
> not
> >> "# of CPU Cores"?
> >>
> >> CS ver 4.11.0.0
> >>
> >> Thanks
> >>
> >> Adam
> >>
> >>
> >> Disclaimer Notice:
> >> This email has been sent by Oakford Technology Limited, while we
> >> have checked this e-mail and any attachments for viruses, we can
> >> not
> guarantee
> >> that they are virus-free. You must therefore take full
> >> responsibility
> for
> >> virus checking.
> >> This message and any attachments are confidential and should only
> >> be
> read
> >> by those to whom they are addressed. If you are not the intended
> recipient,
> >> please contact us, delete the message from your computer and
> >> destroy any copies. Any distribution or copying without our prior
> >> permission is prohibited.
> >> Internet communications are not always secure and therefore Oakford
> >> Technology Limited does not accept legal responsibility for this
> message.
> >> The recipient is responsible for verifying its authenticity before
> acting
> >> on the contents. Any views or opinions presented are solely those
> >> of the author and do not necessarily represent those of Oakford
> >> Technology
> Limited.
> >> Registered address: Oakford Technology Limited, The Manor House,
> Potterne,
> >> Wiltshire. SN10 5PN.
> >> Registered in England and Wales No. 5971519
> >>

System Capacity Limits

2019-09-13 Thread Adam Witwicki
Hello,

Going back to "unable to start MV due to insufficient capacity" errors
Is there a way to turn these off as I can overprovision for "CPU" but not "# of 
CPU Cores"?

CS ver 4.11.0.0

Thanks

Adam


Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: Changing cpu.overprovisioning

2019-08-21 Thread Adam Witwicki
Andrija - would migrating work?

Thanks

Adam

-Original Message-
From: Andrija Panic 
Sent: 21 August 2019 16:07
To: users 
Subject: Re: Changing cpu.overprovisioning

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

On order to change calculations (bring down those 85% to say 42% with doubled 
the over provisioning factor), you do need to stop and start VMs.
Currently it is this way...

After changing the cpu (and God forbid RAM) overprovisioning factros AT THE 
CLUSTER LEVEL), no need to restrart mgmt server.

On Wed, Aug 21, 2019, 16:03 Adam Witwicki  wrote:

> It's taken effect, but it's the same percentage - there is a warning
> about changing it with running VMs - "check the manual" not that
> helpful
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Simon Weller 
> Sent: 21 August 2019 14:01
> To: users@cloudstack.apache.org
> Subject: Re: Changing cpu.overprovisioning
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> You shouldn't have to restart any instances. At worst, after the
> change, restart your management server(s) if it doesn't take effect.
>
> 
> From: Adam Witwicki 
> Sent: Wednesday, August 21, 2019 7:52 AM
> To: users@cloudstack.apache.org 
> Subject: Changing cpu.overprovisioning
>
> Hi Guys
>
>
> How can I change cpu.overprovisioning without having to restart all
> the instances?
>
> It would be extremely inconvenient to do so, I am at 85% of allocated
> capacity, and by hosts are not breaking a sweat
>
>
>
>
>
> Ver 4.11.0.0
>
>
>
>
>
> Thanks
>
>
>
> Adam
>
>
>
>
>
>
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, The Manor House,
> Potterne, Wiltshire. SN10 5PN.
> Registered in England and Wales No. 5971519
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, The Manor House,
> Potterne, Wiltshire. SN10 5PN.
> Registered in England and Wales No. 5971519
>
>
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this m

RE: Changing cpu.overprovisioning

2019-08-21 Thread Adam Witwicki
It's taken effect, but it's the same percentage - there is a warning about 
changing it with running VMs - "check the manual" not that helpful

Thanks

Adam

-Original Message-
From: Simon Weller 
Sent: 21 August 2019 14:01
To: users@cloudstack.apache.org
Subject: Re: Changing cpu.overprovisioning

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

You shouldn't have to restart any instances. At worst, after the change, 
restart your management server(s) if it doesn't take effect.

____
From: Adam Witwicki 
Sent: Wednesday, August 21, 2019 7:52 AM
To: users@cloudstack.apache.org 
Subject: Changing cpu.overprovisioning

Hi Guys


How can I change cpu.overprovisioning without having to restart all the 
instances?

It would be extremely inconvenient to do so, I am at 85% of allocated capacity, 
and by hosts are not breaking a sweat





Ver 4.11.0.0





Thanks



Adam







Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



Changing cpu.overprovisioning

2019-08-21 Thread Adam Witwicki
Hi Guys


How can I change cpu.overprovisioning without having to restart all the 
instances?

It would be extremely inconvenient to do so, I am at 85% of allocated capacity, 
and by hosts are not breaking a sweat





Ver 4.11.0.0





Thanks



Adam







Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: CPU compatibility issue

2019-06-05 Thread Adam Witwicki
It might be because I'm using a Westmere CPU?


Doh

Adam

-Original Message-
From: Adam Witwicki 
Sent: 05 June 2019 13:08
To: users@cloudstack.apache.org
Subject: CPU compatibility issue

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello,

I am having an issue on a new test system, cloudstack version 4.11.00 
(shapeblue) with KVM (Ubuntu 16.04), In production and in the past I have used 
these settings in the agent.properties

guest.cpu.model=SandyBridge
guest.cpu.mode=custom

As this was needed to allow windows 2016 to boot and allow live migration

Yet now on a clean install I get this error when trying to start any instance 
(console, router, instance)

2019-06-05 13:03:13,282 WARN  [resource.wrapper.LibvirtStartCommandWrapper] 
(agentRequest-Handler-5:null) (logid:2df290f8) LibvirtException
org.libvirt.LibvirtException: unsupported configuration: guest and host CPU are 
not compatible: Host CPU does not provide required features: avx, xsave, aes, 
tsc-deadline, x2apic, pclmuldq

If I use host-passthrough it works

This may be a clue 
https://github.com/ustcweizhou/cloudstack/commit/16e87a80d85d283d52c3d72001cd94d9fda25278
 but I am not sure.


Can anyone explain what is going on?

Thanks

Adam




Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



CPU compatibility issue

2019-06-05 Thread Adam Witwicki
Hello,

I am having an issue on a new test system, cloudstack version 4.11.00 
(shapeblue) with KVM (Ubuntu 16.04), In production and in the past I have used 
these settings in the agent.properties

guest.cpu.model=SandyBridge
guest.cpu.mode=custom

As this was needed to allow windows 2016 to boot and allow live migration

Yet now on a clean install I get this error when trying to start any instance 
(console, router, instance)

2019-06-05 13:03:13,282 WARN  [resource.wrapper.LibvirtStartCommandWrapper] 
(agentRequest-Handler-5:null) (logid:2df290f8) LibvirtException
org.libvirt.LibvirtException: unsupported configuration: guest and host CPU are 
not compatible: Host CPU does not provide required features: avx, xsave, aes, 
tsc-deadline, x2apic, pclmuldq

If I use host-passthrough it works

This may be a clue 
https://github.com/ustcweizhou/cloudstack/commit/16e87a80d85d283d52c3d72001cd94d9fda25278
 but I am not sure.


Can anyone explain what is going on?

Thanks

Adam




Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: Change an instances NIC

2019-02-20 Thread Adam Witwicki
Cheers Ivan, that does the job

Adam

-Original Message-
From: Ivan Kudryavtsev 
Sent: 20 February 2019 14:27
To: users 
Subject: Re: Change an instances NIC

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Adam,

just change OS family to the Linux for templates, ISOs which use your VMs and 
restart VMs via stop/start.

ср, 20 февр. 2019 г., 8:39 Adam Witwicki awitwi...@oakfordis.com:

> Hello,
>
> I would like to change an instances nic from e1000 to vmxnet3 or even
> virtio, How can I do this?
>
> Is there something I can add to the user_vm_details table?
>
>
> Thanks
>
> Adam
>
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, The Manor House,
> Potterne, Wiltshire. SN10 5PN.
> Registered in England and Wales No. 5971519
>
>
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



Change an instances NIC

2019-02-20 Thread Adam Witwicki
Hello,

I would like to change an instances nic from e1000 to vmxnet3 or even virtio, 
How can I do this?

Is there something I can add to the user_vm_details table?


Thanks

Adam


Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: Converting a VPC

2019-02-07 Thread Adam Witwicki
Cheers Andrija, that does the job.

Adam

-Original Message-
From: Andrija Panic 
Sent: 07 February 2019 08:08
To: users@cloudstack.apache.org
Subject: RE: Converting a VPC

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

You probably want to do a "migration" to another network - i.e. go to the 
specific VM's NIC tab:
-  Add a new Network to the VM (add an existing L2 network - TBH, I never tried 
this with L2 network, but I can confirm it works for any VPC, Shared or 
Isolated network) - effectively you are adding additional NIC to your VM
-  Make this new network Default, so you can...
-  ...remove original Network from the VM

(When you say L2, I assume the new model in 4.11 that has no IP settings no VR, 
nothing...)

This way you have performed "migration" of VM from on network to another.

Kind regards,
Andrija

andrija.pa...@shapeblue.com
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue




-Original Message-
From: Adam Witwicki 
Sent: 06 February 2019 17:29
To: users@cloudstack.apache.org
Subject: Converting a VPC

Hi Everybody.

Is there a way to convert a VPC to a Layer2 network to avoid me recreating all 
the instances?

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



Converting a VPC

2019-02-06 Thread Adam Witwicki
Hi Everybody.

Is there a way to convert a VPC to a Layer2 network to avoid me recreating all 
the instances?

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519



RE: Local storage

2018-12-11 Thread Adam Witwicki
Ivan,

It was odd, after waiting for the jobs to clear, everything ended up working

Thanks

Adam

-Original Message-
From: Ivan Kudryavtsev 
Sent: 10 December 2018 18:10
To: users 
Subject: Re: Local storage

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam.
Doesn't look like the problem is connected with local storage. Please enable 
the debug mode for the agent and share. Also, the corresponding log from the 
management server is welcome.

PS: We use only local storage in our cloud, everything should work great out of 
the box (at least for Ubuntu 16.04).



пн, 10 дек. 2018 г. в 03:59, Adam Witwicki :

> Guys
>
> Some issues with this, I have tried to spin up an instance on local
> storage - the agent then became disconnected and I have this in the
> logs
>
> Dec 10 08:30:03 xxx sh[303588]: INFO  [cloud.agent.Agent]
> (Agent-Handler-4:) (logid:) Lost connection to the server. Dealing
> with the remaining commands...
> Dec 10 08:30:03 xxx sh[303588]: INFO  [cloud.agent.Agent]
> (Agent-Handler-4:) (logid:) Cannot connect because we still have 5
> commands in progress.
> Dec 10 08:30:08 xxx sh[303588]: INFO  [cloud.agent.Agent]
> (Agent-Handler-4:) (logid:) Lost connection to the server. Dealing
> with the remaining commands...
>
> Are the permisions correct?
>
> user@xxx:~$ sudo ls -l /var/lib/libvirt/images total 113465560
> -rw-r--r-- 1 root root  24601165824 Dec 10 08:21
> e5a2f086-0e61-41ff-acba-1a190c1583b0
> -rw-r--r-- 1 root root 107390828544 Dec 10 08:34
> ed9b2ed4-54f6-476d-80b4-8b78c3420a6c
>
> -Original Message-
> From: Adam Witwicki 
> Sent: 07 December 2018 16:33
> To: users@cloudstack.apache.org
> Subject: RE: Local storage
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> 4.11.0
>
> -Original Message-
> From: McClune, James 
> Sent: 07 December 2018 16:30
> To: users@cloudstack.apache.org
> Subject: Re: Local storage
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> My apologies, what version of CloudStack are you running?
>
> Like Ivan said, you would need to enable local storage for the zone.
>
> libvirt should create a local storage pool, like you stated. The UUID
> & path would be in /etc/cloudstack/agent.properties. virsh pool-list
> will verify.
>
> Best,
> James
>
> On Fri, Dec 7, 2018 at 10:59 AM Adam Witwicki
> 
> wrote:
>
> > I thought it related to this in the agent.props
> >
> >
> > local.storage.uuid=
> > local.storage.path=/var/lib/libvirt/images/
> >
> >
> > and enabling local storage in the zone??
> >
> > The link you sent shows none of that?
> >
> >
> > Thanks
> >
> > Adam
> >
> > -Original Message-
> > From: McClune, James 
> > Sent: 07 December 2018 15:55
> > To: users@cloudstack.apache.org
> > Subject: Re: Local storage
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Hi Adam,
> >
> > This should do it:
> >
> > http://docs.cloudstack.apache.org/en/latest/adminguide/storage.html#
> > us
> > ing-local-storage-for-data-volumes
> >
> > Best,
> > James
> >
> > On Fri, Dec 7, 2018 at 10:49 AM Adam Witwicki
> > 
> > wrote:
> >
> > > Hello
> > >
> > > Is there a guide on how to set up local storage using KVM in
> cloudstack?
> > >
> > > Thanks
> > >
> > > Adam
> > >
> > >
> > >
> > > Disclaimer Notice:
> > > This email has been sent by Oakford Technology Limited, while we
> > > have checked this e-mail and any attachments for viruses, we can
> > > not guarantee that they are virus-free. You must therefore take
> > > full responsibility for virus checking.
> > > This message and any attachments are confidential and should only
> > > be read by those to whom they are addressed. If you are not the
> > > intended recipient, please contact us, delete the message from
> > > your computer and destroy any copies. Any distribution or copying
> > > without our prior permission is prohibited.
> > > Internet communications are not always secure and therefore
> > > Oakford Technology Limited does not accept legal responsibility
> > > for this

RE: Local storage

2018-12-10 Thread Adam Witwicki
Guys

Some issues with this, I have tried to spin up an instance on local storage - 
the agent then became disconnected and I have this in the logs

Dec 10 08:30:03 xxx sh[303588]: INFO  [cloud.agent.Agent] (Agent-Handler-4:) 
(logid:) Lost connection to the server. Dealing with the remaining commands...
Dec 10 08:30:03 xxx sh[303588]: INFO  [cloud.agent.Agent] (Agent-Handler-4:) 
(logid:) Cannot connect because we still have 5 commands in progress.
Dec 10 08:30:08 xxx sh[303588]: INFO  [cloud.agent.Agent] (Agent-Handler-4:) 
(logid:) Lost connection to the server. Dealing with the remaining commands...

Are the permisions correct?

user@xxx:~$ sudo ls -l /var/lib/libvirt/images
total 113465560
-rw-r--r-- 1 root root  24601165824 Dec 10 08:21 
e5a2f086-0e61-41ff-acba-1a190c1583b0
-rw-r--r-- 1 root root 107390828544 Dec 10 08:34 
ed9b2ed4-54f6-476d-80b4-8b78c3420a6c

-Original Message-
From: Adam Witwicki 
Sent: 07 December 2018 16:33
To: users@cloudstack.apache.org
Subject: RE: Local storage

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

4.11.0

-Original Message-
From: McClune, James 
Sent: 07 December 2018 16:30
To: users@cloudstack.apache.org
Subject: Re: Local storage

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

My apologies, what version of CloudStack are you running?

Like Ivan said, you would need to enable local storage for the zone.

libvirt should create a local storage pool, like you stated. The UUID & path 
would be in /etc/cloudstack/agent.properties. virsh pool-list will verify.

Best,
James

On Fri, Dec 7, 2018 at 10:59 AM Adam Witwicki 
wrote:

> I thought it related to this in the agent.props
>
>
> local.storage.uuid=
> local.storage.path=/var/lib/libvirt/images/
>
>
> and enabling local storage in the zone??
>
> The link you sent shows none of that?
>
>
> Thanks
>
> Adam
>
> -Original Message-
> From: McClune, James 
> Sent: 07 December 2018 15:55
> To: users@cloudstack.apache.org
> Subject: Re: Local storage
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> This should do it:
>
> http://docs.cloudstack.apache.org/en/latest/adminguide/storage.html#us
> ing-local-storage-for-data-volumes
>
> Best,
> James
>
> On Fri, Dec 7, 2018 at 10:49 AM Adam Witwicki
> 
> wrote:
>
> > Hello
> >
> > Is there a guide on how to set up local storage using KVM in cloudstack?
> >
> > Thanks
> >
> > Adam
> >
> >
> >
> > Disclaimer Notice:
> > This email has been sent by Oakford Technology Limited, while we
> > have checked this e-mail and any attachments for viruses, we can not
> > guarantee that they are virus-free. You must therefore take full
> > responsibility for virus checking.
> > This message and any attachments are confidential and should only be
> > read by those to whom they are addressed. If you are not the
> > intended recipient, please contact us, delete the message from your
> > computer and destroy any copies. Any distribution or copying without
> > our prior permission is prohibited.
> > Internet communications are not always secure and therefore Oakford
> > Technology Limited does not accept legal responsibility for this message.
> > The recipient is responsible for verifying its authenticity before
> > acting on the contents. Any views or opinions presented are solely
> > those of the author and do not necessarily represent those of
> > Oakford
> Technology Limited.
> > Registered address: Oakford Technology Limited, 10 Prince Maurice
> > Court, Devizes, Wiltshire. SN10 2RT.
> > Registered in England and Wales No. 5971519
> >
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or

RE: Local storage

2018-12-07 Thread Adam Witwicki
4.11.0

-Original Message-
From: McClune, James 
Sent: 07 December 2018 16:30
To: users@cloudstack.apache.org
Subject: Re: Local storage

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

My apologies, what version of CloudStack are you running?

Like Ivan said, you would need to enable local storage for the zone.

libvirt should create a local storage pool, like you stated. The UUID & path 
would be in /etc/cloudstack/agent.properties. virsh pool-list will verify.

Best,
James

On Fri, Dec 7, 2018 at 10:59 AM Adam Witwicki 
wrote:

> I thought it related to this in the agent.props
>
>
> local.storage.uuid=
> local.storage.path=/var/lib/libvirt/images/
>
>
> and enabling local storage in the zone??
>
> The link you sent shows none of that?
>
>
> Thanks
>
> Adam
>
> -Original Message-
> From: McClune, James 
> Sent: 07 December 2018 15:55
> To: users@cloudstack.apache.org
> Subject: Re: Local storage
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> This should do it:
>
> http://docs.cloudstack.apache.org/en/latest/adminguide/storage.html#us
> ing-local-storage-for-data-volumes
>
> Best,
> James
>
> On Fri, Dec 7, 2018 at 10:49 AM Adam Witwicki
> 
> wrote:
>
> > Hello
> >
> > Is there a guide on how to set up local storage using KVM in cloudstack?
> >
> > Thanks
> >
> > Adam
> >
> >
> >
> > Disclaimer Notice:
> > This email has been sent by Oakford Technology Limited, while we
> > have checked this e-mail and any attachments for viruses, we can not
> > guarantee that they are virus-free. You must therefore take full
> > responsibility for virus checking.
> > This message and any attachments are confidential and should only be
> > read by those to whom they are addressed. If you are not the
> > intended recipient, please contact us, delete the message from your
> > computer and destroy any copies. Any distribution or copying without
> > our prior permission is prohibited.
> > Internet communications are not always secure and therefore Oakford
> > Technology Limited does not accept legal responsibility for this message.
> > The recipient is responsible for verifying its authenticity before
> > acting on the contents. Any views or opinions presented are solely
> > those of the author and do not necessarily represent those of
> > Oakford
> Technology Limited.
> > Registered address: Oakford Technology Limited, 10 Prince Maurice
> > Court, Devizes, Wiltshire. SN10 2RT.
> > Registered in England and Wales No. 5971519
> >
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, 10 Prince Maurice
> Court, Devizes, Wiltshire. SN10 2RT.
> Registered in England and Wales No. 5971519
>
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



RE: Local storage

2018-12-07 Thread Adam Witwicki
Thanks Ivan

-Original Message-
From: Ivan Kudryavtsev 
Sent: 07 December 2018 16:07
To: users 
Subject: Re: Local storage

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Adam, EXT4, XFS work just fine. If you want to use extra features, you can use 
ZFS as well, as Proxmox already uses it as default and considers it as stable. 
We also use it in one host about 6 months without downtime. But if you are most 
interested in performance, then XFS, EXT4.

пт, 7 дек. 2018 г. в 11:04, Adam Witwicki :

> Can anyone recommend a good file system to format this local storage with?
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Adam Witwicki 
> Sent: 07 December 2018 16:01
> To: users@cloudstack.apache.org
> Subject: RE: Local storage
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> I thought it related to this in the agent.props
>
>
> local.storage.uuid=
> local.storage.path=/var/lib/libvirt/images/
>
>
> and enabling local storage in the zone??
>
> The link you sent shows none of that?
>
>
> Thanks
>
> Adam
>
> -Original Message-
> From: McClune, James 
> Sent: 07 December 2018 15:55
> To: users@cloudstack.apache.org
> Subject: Re: Local storage
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> This should do it:
>
> http://docs.cloudstack.apache.org/en/latest/adminguide/storage.html#us
> ing-local-storage-for-data-volumes
>
> Best,
> James
>
> On Fri, Dec 7, 2018 at 10:49 AM Adam Witwicki
> 
> wrote:
>
> > Hello
> >
> > Is there a guide on how to set up local storage using KVM in cloudstack?
> >
> > Thanks
> >
> > Adam
> >
> >
> >
> > Disclaimer Notice:
> > This email has been sent by Oakford Technology Limited, while we
> > have checked this e-mail and any attachments for viruses, we can not
> > guarantee that they are virus-free. You must therefore take full
> > responsibility for virus checking.
> > This message and any attachments are confidential and should only be
> > read by those to whom they are addressed. If you are not the
> > intended recipient, please contact us, delete the message from your
> > computer and destroy any copies. Any distribution or copying without
> > our prior permission is prohibited.
> > Internet communications are not always secure and therefore Oakford
> > Technology Limited does not accept legal responsibility for this message.
> > The recipient is responsible for verifying its authenticity before
> > acting on the contents. Any views or opinions presented are solely
> > those of the author and do not necessarily represent those of
> > Oakford
> Technology Limited.
> > Registered address: Oakford Technology Limited, 10 Prince Maurice
> > Court, Devizes, Wiltshire. SN10 2RT.
> > Registered in England and Wales No. 5971519
> >
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, 10 Prince Maurice
> Court, Devizes, Wiltshire. SN10 2RT.
> Registered in England and Wales No. 5971519
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete 

RE: Local storage

2018-12-07 Thread Adam Witwicki
Can anyone recommend a good file system to format this local storage with?

Thanks

Adam

-Original Message-
From: Adam Witwicki 
Sent: 07 December 2018 16:01
To: users@cloudstack.apache.org
Subject: RE: Local storage

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

I thought it related to this in the agent.props


local.storage.uuid=
local.storage.path=/var/lib/libvirt/images/


and enabling local storage in the zone??

The link you sent shows none of that?


Thanks

Adam

-Original Message-
From: McClune, James 
Sent: 07 December 2018 15:55
To: users@cloudstack.apache.org
Subject: Re: Local storage

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

This should do it:
http://docs.cloudstack.apache.org/en/latest/adminguide/storage.html#using-local-storage-for-data-volumes

Best,
James

On Fri, Dec 7, 2018 at 10:49 AM Adam Witwicki 
wrote:

> Hello
>
> Is there a guide on how to set up local storage using KVM in cloudstack?
>
> Thanks
>
> Adam
>
>
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, 10 Prince Maurice
> Court, Devizes, Wiltshire. SN10 2RT.
> Registered in England and Wales No. 5971519
>
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



RE: Local storage

2018-12-07 Thread Adam Witwicki
I thought it related to this in the agent.props


local.storage.uuid=
local.storage.path=/var/lib/libvirt/images/


and enabling local storage in the zone??

The link you sent shows none of that?


Thanks

Adam

-Original Message-
From: McClune, James 
Sent: 07 December 2018 15:55
To: users@cloudstack.apache.org
Subject: Re: Local storage

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

This should do it:
http://docs.cloudstack.apache.org/en/latest/adminguide/storage.html#using-local-storage-for-data-volumes

Best,
James

On Fri, Dec 7, 2018 at 10:49 AM Adam Witwicki 
wrote:

> Hello
>
> Is there a guide on how to set up local storage using KVM in cloudstack?
>
> Thanks
>
> Adam
>
>
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, 10 Prince Maurice
> Court, Devizes, Wiltshire. SN10 2RT.
> Registered in England and Wales No. 5971519
>
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



Local storage

2018-12-07 Thread Adam Witwicki
Hello

Is there a guide on how to set up local storage using KVM in cloudstack?

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



RE: Help

2018-11-27 Thread Adam Witwicki
Andrija,

You are correct, I was assuming I only used nfs on secondary storage, I also 
have primary nfs storage for the VR system offering, Doh

I feel that modifying the script to shout a lot and not reboot will help us in 
the first instance

Thanks :)

Adam

-Original Message-
From: Andrija Panic 
Sent: 27 November 2018 12:07
To: users 
Subject: Re: Help

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

/usr/share/cloudstack-common/scripts/vm/hypervisor/kvm/kvmheartbeat.sh

comment the 6th from the bottom line:   echo b > /proc/sysrq-trigger

That stops reboot process - been there, done that for years now :)

But then investigate what is going on - since it's not "normal" to trigger this 
script (reboot actually) in healthy environment.

FYI, there is no such heartbeat checks for CEPH, afaik.
It's strange, that this also affects Secondary Storage NFS - I had idea it's 
only made for Primary Storage - actually I'm almost sure it's NOT checking 
Secondary Storage, since on PRimary NFS there is automatically created folder 
KVMHA, and inside it a file for each KVM node which should be updated 
(modification time) revery minute if KVM can access the NFS...


Cheers

On Tue, 27 Nov 2018 at 12:56, Adam Witwicki  wrote:

> There seems to have been an issue with connectivity on a host that was
> causing the VRs to silently fail.
>
> How can I stop this script rebooting when it detects an issue with NFS?
> Would setting up another NFS pool work?
>
> Nov 27 08:23:41 OIS-MH-P1-C1-H1-C heartbeat: kvmheartbeat.sh rebooted
> system because it was unable to write the heartbeat to the storage.
>
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Adam Witwicki 
> Sent: 27 November 2018 11:09
> To: users@cloudstack.apache.org
> Subject: RE: Help
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Swen
>
> I use ceph for primary storage
> And NFS for secondary storage
>
> Using KVM hosts I got this error
> Nov 27 08:23:41 OIS-MH-P1-C1-H1-C heartbeat: kvmheartbeat.sh rebooted
> system because it was unable to write the heartbeat to the storage.
>
> I fixed the issue with NFS
> And now a lot of instances are stuck in starting state, after the
> hosts went into a reboot flap
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Swen - swen.io 
> Sent: 27 November 2018 11:05
> To: users@cloudstack.apache.org
> Subject: AW: Help
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> can you please explain a little bit more why your VR are stuck because
> of your problem with secondary storage? Are you using the same storage
> as primary storage for your VRs?
> Is the problem already fixed with your secondary storage? Can you
> restart a network?
>
> Cu Swen
>
> -Ursprüngliche Nachricht-
> Von: Adam Witwicki 
> Gesendet: Dienstag, 27. November 2018 11:12
> An: users@cloudstack.apache.org
> Betreff: RE: Help
>
>
> Hi Guys
>
> All my hosts went down due to a delay in writing to secondary nfs
> storage, I have a lot of Virtual Routers in a stuck starting state.
>
> Any tips?
>
> Thanks
>
> Adam
>
>
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, 10 Prince Maurice
> Court, Devizes, Wiltshire. SN10 2RT.
> Registered in England and Wales No. 5971519
>
>
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are vir

RE: Help

2018-11-27 Thread Adam Witwicki
There seems to have been an issue with connectivity on a host that was causing 
the VRs to silently fail.

How can I stop this script rebooting when it detects an issue with NFS? Would 
setting up another NFS pool work?

Nov 27 08:23:41 OIS-MH-P1-C1-H1-C heartbeat: kvmheartbeat.sh rebooted system 
because it was unable to write the heartbeat to the storage.


Thanks

Adam

-Original Message-
From: Adam Witwicki 
Sent: 27 November 2018 11:09
To: users@cloudstack.apache.org
Subject: RE: Help

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Swen

I use ceph for primary storage
And NFS for secondary storage

Using KVM hosts I got this error
Nov 27 08:23:41 OIS-MH-P1-C1-H1-C heartbeat: kvmheartbeat.sh rebooted system 
because it was unable to write the heartbeat to the storage.

I fixed the issue with NFS
And now a lot of instances are stuck in starting state, after the hosts went 
into a reboot flap

Thanks

Adam

-Original Message-
From: Swen - swen.io 
Sent: 27 November 2018 11:05
To: users@cloudstack.apache.org
Subject: AW: Help

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

can you please explain a little bit more why your VR are stuck because of your 
problem with secondary storage? Are you using the same storage as primary 
storage for your VRs?
Is the problem already fixed with your secondary storage? Can you restart a 
network?

Cu Swen

-Ursprüngliche Nachricht-
Von: Adam Witwicki 
Gesendet: Dienstag, 27. November 2018 11:12
An: users@cloudstack.apache.org
Betreff: RE: Help


Hi Guys

All my hosts went down due to a delay in writing to secondary nfs storage, I 
have a lot of Virtual Routers in a stuck starting state.

Any tips?

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message.
The recipient is responsible for verifying its authenticity before acting on 
the contents. Any views or opinions presented are solely those of the author 
and do not necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered

RE: Help

2018-11-27 Thread Adam Witwicki
The VRs are now up, except for a flappy HA router

Instances are still stuck

-Original Message-
From: Andrija Panic 
Sent: 27 November 2018 11:05
To: users 
Subject: Re: Help

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Can you restart VRs, or complete VPC (if VPC) or Restart Network (if isolated 
network, etc)

there is also script for restarting VRs and CPVM and SSVM (i.e. after ACS
upgrade) if you have many of them.

cloudstack-sysvmadm -d  -u cloud -p -s


hope that helps...

Andrija

On Tue, 27 Nov 2018 at 11:11, Adam Witwicki  wrote:

>
> Hi Guys
>
> All my hosts went down due to a delay in writing to secondary nfs
> storage, I have a lot of Virtual Routers in a stuck starting state.
>
> Any tips?
>
> Thanks
>
> Adam
>
>
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, 10 Prince Maurice
> Court, Devizes, Wiltshire. SN10 2RT.
> Registered in England and Wales No. 5971519
>
>

--

Andrija Panić
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



RE: Help

2018-11-27 Thread Adam Witwicki
Hi Swen

I use ceph for primary storage
And NFS for secondary storage

Using KVM hosts I got this error
Nov 27 08:23:41 OIS-MH-P1-C1-H1-C heartbeat: kvmheartbeat.sh rebooted system 
because it was unable to write the heartbeat to the storage.

I fixed the issue with NFS
And now a lot of instances are stuck in starting state, after the hosts went 
into a reboot flap

Thanks

Adam

-Original Message-
From: Swen - swen.io 
Sent: 27 November 2018 11:05
To: users@cloudstack.apache.org
Subject: AW: Help

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

can you please explain a little bit more why your VR are stuck because of your 
problem with secondary storage? Are you using the same storage as primary 
storage for your VRs?
Is the problem already fixed with your secondary storage? Can you restart a 
network?

Cu Swen

-Ursprüngliche Nachricht-
Von: Adam Witwicki 
Gesendet: Dienstag, 27. November 2018 11:12
An: users@cloudstack.apache.org
Betreff: RE: Help


Hi Guys

All my hosts went down due to a delay in writing to secondary nfs storage, I 
have a lot of Virtual Routers in a stuck starting state.

Any tips?

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message.
The recipient is responsible for verifying its authenticity before acting on 
the contents. Any views or opinions presented are solely those of the author 
and do not necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



RE: Help

2018-11-27 Thread Adam Witwicki

Hi Guys

All my hosts went down due to a delay in writing to secondary nfs storage,
I have a lot of Virtual Routers in a stuck starting state.

Any tips?

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



RE: Guest DHCP issue

2018-11-16 Thread Adam Witwicki
Sorted with sudo ufw default allow FORWARD

Thanks guys :)

-Original Message-
From: Adam Witwicki 
Sent: 16 November 2018 09:35
To: users@cloudstack.apache.org
Subject: Guest DHCP issue

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello

I have recently added 2 new hosts to our cluster, but ran into an issue where 
guests do not receive a DHCP lease from the virtual router.
If I set the interface as static I can ping the router and all networking is 
fine. I'm sure must have missed a configuration step.

Any ideas?


CS version 4.11.0.0
libvirtd (libvirt) 1.3.1
Ubuntu 16.04
bridge-utils, 1.5

Thanks

Adam

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



RE: Guest DHCP issue

2018-11-16 Thread Adam Witwicki
Its related to UFW, if I disable that on the host it works, but all the rules 
look the same between hosts?

Thanks

Adam

-Original Message-
From: Adam Witwicki 
Sent: 16 November 2018 09:35
To: users@cloudstack.apache.org
Subject: Guest DHCP issue

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello

I have recently added 2 new hosts to our cluster, but ran into an issue where 
guests do not receive a DHCP lease from the virtual router.
If I set the interface as static I can ping the router and all networking is 
fine. I'm sure must have missed a configuration step.

Any ideas?


CS version 4.11.0.0
libvirtd (libvirt) 1.3.1
Ubuntu 16.04
bridge-utils, 1.5

Thanks

Adam

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



Guest DHCP issue

2018-11-16 Thread Adam Witwicki
Hello

I have recently added 2 new hosts to our cluster, but ran into an issue where 
guests do not receive a DHCP lease from the virtual router.
If I set the interface as static I can ping the router and all networking is 
fine. I'm sure must have missed a configuration step.

Any ideas?


CS version 4.11.0.0
libvirtd (libvirt) 1.3.1
Ubuntu 16.04
bridge-utils, 1.5

Thanks

Adam

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



RE: Disk controller type

2018-09-26 Thread Adam Witwicki
Andrija,

It seems to be an issue with windows, it won't correctly add the driver for 
virtio until a device exists.
I tried may times right clicking on the inf files, and selecting install then 
rebooting, in safe mode etc, with different BCDedit values, all failed to boot 
windows.

But hot-adding a virtio disk (and controller) and then installing the drivers 
worked repeatedly.

The old tricks of the XP days changing from IDE to SATA controllers no longer 
seem to work ;)

Thanks

Adam


-Original Message-
From: Andrija Panic 
Sent: 26 September 2018 13:50
To: users 
Subject: Re: Disk controller type

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

Glad you solved the problem! But I need to say this work sounds "crazy" in a 
sense that this is not (per my knowledge) how it should be done "properly".

Im wondering if this is something in 4.11 that makes you make such workaround...

Anyway, glad you worked it out.

Cheers

On Wed, Sep 26, 2018, 04:39 Adam Witwicki  wrote:

> Ok Guys, I have cracked it - this is for 4.11 but should work on most
> versions
>
> To change the controller type of an existing  windows 2012 and 2016
> server from IDE ATA to virtio  do the following
>
>
> On the Host
>
> Create an empty disk
> dd if=/dev/zero of=/home/user/blank.img bs=1M count=4096
>
> Create a device xml file for a virtio disk /home/user/virtodisk.xml
> with the following contains
>
> 
>   
>   
>   
>   
>   
>   
>   
>
> Attach this disk to the running VM
>
> Virsh
> attach-device  /home/user/virtodisk.xml exit
>
> insert the Virtio Driver iso and install drivers on VM
>
> Shutdown VM using cloudstack control (stop instance)
>
> Add the following to the “user_vm_detail” table in the database, where
> XXX is the 3 digits in the internal VM name i-83-XXX-VM
>
> INSERT INTO `user_vm_details` (`vm_id`, `name`, `value`, `display`)
> VALUES (xxx, 'rootDiskController', 'virtio', 1);
>
> Start the VM and all is good
>
>
> Thanks for everyone's help and suggestions
>
> Adam
>
>
> -Original Message-
> From: Andrija Panic 
> Sent: 21 September 2018 16:50
> To: users 
> Subject: Re: Disk controller type
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Or in other words, again based on ACS 4.8, simply use Windows PV as
> the OS type, but make sure that you have a clean driver install
> process in your head - if install windows from zero - that is simple,
> just detach win.iso,attach virtidrivers ISO file and load scsi
> drivers... later install network Virtio etc :)
>
> But if converting existing IDE version of Windows, make some tests
> with /detecthal to avoid long downtime :)
>
> On Fri, Sep 21, 2018, 16:14 Simon Weller  wrote:
>
> > Your two options are virtio blk or virtio-scsi. If your imported VM
> > doesn't have the correct controller specified, you're going to have
> > to modify it before enabling virtio in libvirt.
> >
> > Check out this guide:
> > https://access.redhat.com/articles/2470791#installing-the-kvm-window
> > s-
> > virtio-drivers-5
> >
> >
> >
> > 
> > From: Adam Witwicki 
> > Sent: Friday, September 21, 2018 5:28 AM
> > To: users@cloudstack.apache.org
> > Subject: RE: Disk controller type
> >
> > Win 2016 doesn’t use Virtio by default, but we need too as disk
> > performance is rubbish if we don’t
> >
> >
> >
> >
> > -Original Message-
> > From: Andrija Panic 
> > Sent: 21 September 2018 11:25
> > To: users 
> > Subject: Re: Disk controller type
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Hrm... Im mot aware of Windows 2016 OS type, that is probably in
> > newer version of ACS, so far, up to Windows 2012 OS type, it was all IDE...
> >
> > Can you do silly check with either 'ps aux | grep VMNAME' or with
> > 'virsh dumpxml VMNAME' so we see what controller type is used.
> >
> > I have hard time believing that Win 2016 OS type would use Virtio by
> > default, since afaik no Virtio drivers are builtin inaide Windows by
> > default (in contrast to Hype-V drivers being available in stock
> > Linux kernel for some tome now :) )
> >
> >
> > On Fri, Sep 21, 2018, 10:31 Adam Witwicki 
>

RE: Disk controller type

2018-09-26 Thread Adam Witwicki
Ok Guys, I have cracked it - this is for 4.11 but should work on most versions

To change the controller type of an existing  windows 2012 and 2016 server from 
IDE ATA to virtio  do the following


On the Host

Create an empty disk
dd if=/dev/zero of=/home/user/blank.img bs=1M count=4096

Create a device xml file for a virtio disk
/home/user/virtodisk.xml with the following contains


  
  
  
  
  
  
  

Attach this disk to the running VM

Virsh
attach-device  /home/user/virtodisk.xml
exit

insert the Virtio Driver iso and install drivers on VM

Shutdown VM using cloudstack control (stop instance)

Add the following to the “user_vm_detail” table in the database, where XXX is 
the 3 digits in the internal VM name i-83-XXX-VM

INSERT INTO `user_vm_details` (`vm_id`, `name`, `value`, `display`) VALUES 
(xxx, 'rootDiskController', 'virtio', 1);

Start the VM and all is good


Thanks for everyone's help and suggestions

Adam


-Original Message-
From: Andrija Panic 
Sent: 21 September 2018 16:50
To: users 
Subject: Re: Disk controller type

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Or in other words, again based on ACS 4.8, simply use Windows PV as the OS 
type, but make sure that you have a clean driver install process in your head - 
if install windows from zero - that is simple, just detach win.iso,attach 
virtidrivers ISO file and load scsi drivers... later install network Virtio etc 
:)

But if converting existing IDE version of Windows, make some tests with 
/detecthal to avoid long downtime :)

On Fri, Sep 21, 2018, 16:14 Simon Weller  wrote:

> Your two options are virtio blk or virtio-scsi. If your imported VM
> doesn't have the correct controller specified, you're going to have to
> modify it before enabling virtio in libvirt.
>
> Check out this guide:
> https://access.redhat.com/articles/2470791#installing-the-kvm-windows-
> virtio-drivers-5
>
>
>
> 
> From: Adam Witwicki 
> Sent: Friday, September 21, 2018 5:28 AM
> To: users@cloudstack.apache.org
> Subject: RE: Disk controller type
>
> Win 2016 doesn’t use Virtio by default, but we need too as disk
> performance is rubbish if we don’t
>
>
>
>
> -Original Message-
> From: Andrija Panic 
> Sent: 21 September 2018 11:25
> To: users 
> Subject: Re: Disk controller type
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hrm... Im mot aware of Windows 2016 OS type, that is probably in newer
> version of ACS, so far, up to Windows 2012 OS type, it was all IDE...
>
> Can you do silly check with either 'ps aux | grep VMNAME' or with
> 'virsh dumpxml VMNAME' so we see what controller type is used.
>
> I have hard time believing that Win 2016 OS type would use Virtio by
> default, since afaik no Virtio drivers are builtin inaide Windows by
> default (in contrast to Hype-V drivers being available in stock Linux
> kernel for some tome now :) )
>
>
> On Fri, Sep 21, 2018, 10:31 Adam Witwicki  wrote:
>
> > Andrija,
> >
> > I have something weird, I have a template which uses the OS type of
> > Windows Server 2016 (64-bit), this was imported into Cloudstack  and
> > this template uses a VirtIO controller I have another template that
> > was created from a disk also with OS type of Windows Server 2016
> > (64-bit) but has an ID controller.
> >
> > I am trying to work out why this happened and now I can make the
> > disk template always select the VirtIO controller.
> > Setting the instance to windows PV causes BSOD on boot, well before
> > hal can be redetected
> >
> >
> > Thanks
> >
> > Adam
> >
> > -Original Message-
> > From: Andrija Panic 
> > Sent: 20 September 2018 11:18
> > To: users 
> > Subject: Re: Disk controller type
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Sooo... here is my experience:
> >
> > if using correct VirtIO OS TYPE (set on template/VM) - i.e. ubuntu
> > 14.04, Centos 6.x or 7.x, Windows PV, other PV (but NOT centos 6.0
> > or
> > 7.0 - these "dot zero" versions are NOT virtio at least in ACS 4.8),
> > then when VM is STARTED FROM ACS (power on VM) - all drives should
> > be
> attached as VirtIO.
> >
> > BUT if you do same as above, then additionally create and HOTPLUG
> > new drives/volumes to KVM - it will be IDE - some strange default

RE: Disk controller type

2018-09-21 Thread Adam Witwicki
Win 2016 doesn’t use Virtio by default, but we need too as disk performance is 
rubbish if we don’t




-Original Message-
From: Andrija Panic 
Sent: 21 September 2018 11:25
To: users 
Subject: Re: Disk controller type

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hrm... Im mot aware of Windows 2016 OS type, that is probably in newer version 
of ACS, so far, up to Windows 2012 OS type, it was all IDE...

Can you do silly check with either 'ps aux | grep VMNAME' or with 'virsh 
dumpxml VMNAME' so we see what controller type is used.

I have hard time believing that Win 2016 OS type would use Virtio by default, 
since afaik no Virtio drivers are builtin inaide Windows by default (in 
contrast to Hype-V drivers being available in stock Linux kernel for some tome 
now :) )


On Fri, Sep 21, 2018, 10:31 Adam Witwicki  wrote:

> Andrija,
>
> I have something weird, I have a template which uses the OS type of
> Windows Server 2016 (64-bit), this was imported into Cloudstack  and
> this template uses a VirtIO controller I have another template that
> was created from a disk also with OS type of Windows Server 2016
> (64-bit) but has an ID controller.
>
> I am trying to work out why this happened and now I can make the disk
> template always select the VirtIO controller.
> Setting the instance to windows PV causes BSOD on boot, well before
> hal can be redetected
>
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Andrija Panic 
> Sent: 20 September 2018 11:18
> To: users 
> Subject: Re: Disk controller type
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Sooo... here is my experience:
>
> if using correct VirtIO OS TYPE (set on template/VM) - i.e. ubuntu
> 14.04, Centos 6.x or 7.x, Windows PV, other PV (but NOT centos 6.0 or
> 7.0 - these "dot zero" versions are NOT virtio at least in ACS 4.8),
> then when VM is STARTED FROM ACS (power on VM) - all drives should be 
> attached as VirtIO.
>
> BUT if you do same as above, then additionally create and HOTPLUG new
> drives/volumes to KVM - it will be IDE - some strange default behavior
> during hotplug action just stop VM/start and it will become VirtIO
> again...
>
> In order to "troubleshoot" these instances - you need to be careful to
> which OS TYPE was the instance set to (this is inherited from
> TEMPLATE, if you used some template - but it CAN be changed on an
> deployed&&stopped
> instance)
>
> In case you plan to i.e. move your Windows instances from IDE to
> VirtIO - be aware that it might fail miserably, and OS will fail to
> boot - but there is a fix with *"* bcdedit /set detecthal boolean
> (where boolean is one of 1,  on, yes or true) " after which Windows
> will detect HAL again and boot just fine.
>
> Let me know if more help needed
>
> Cheers
>
> On Thu, 20 Sep 2018 at 11:22, Adam Witwicki 
> wrote:
>
> >
> >
> > It looks like I can just add
> >
> > rootDiskController virtio
> >
> > To the templates settings tab?
> >
> > Can anyone confirm?
> >
> > Thanks
> >
> > Adam
> >
> > -Original Message-
> > From: Ivan Kudryavtsev 
> > Sent: 20 September 2018 10:20
> > To: users 
> > Subject: Re: Disk controller type
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Rakesh, It doesn't work like that for CS as it uses stateless XML
> configs.
> >
> > чт, 20 сент. 2018 г., 16:12 Rakesh Venkatesh
> > >:
> >
> > > I think you can change the controller type in XML file of the VM
> > > but not sure if that works or not.
> > >
> > > virsh dumpxml 
> > > virsh edit 
> > > change the controller type, save and start the vm again
> > >
> > > On Thu, Sep 20, 2018 at 9:59 AM Adam Witwicki
> > > 
> > > wrote:
> > >
> > > > Hello,
> > > >
> > > > I have a number of of instances using the wrong controller type
> > > > (ATA)
> > > does
> > > > anyone know where this is set in the database so I can start
> > > > them with
> > > the
> > > > VirtIO scsi controller?
> > > >
> > > > Thanks
> > > >
> > > > Adam
> > > >
> > > >
> > > >
> > > >
> > > > Disclaimer No

RE: Disk controller type

2018-09-21 Thread Adam Witwicki
That didn’t format correctly

Set this is the user_vm_details table

Idvm_id   name valuedisplay
3625  201rootDiskController  virtio 1



-Original Message-
From: Adam Witwicki 
Sent: 21 September 2018 10:59
To: users@cloudstack.apache.org
Subject: RE: Disk controller type

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Ok, I have found were to force the controller type for a VM

Set this is the user_vm_details table

idvm_idnamevaluedisplay
3625201rootDiskControllervirtio1

My issue now is slipstreaming the windows ISO and the operating system

bcdedit /set detecthal Boolean 1 isnt working for me

Thanks

Adam


-Original Message-
From: Adam Witwicki 
Sent: 21 September 2018 09:31
To: users@cloudstack.apache.org
Subject: RE: Disk controller type

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Andrija,

I have something weird, I have a template which uses the OS type of Windows 
Server 2016 (64-bit), this was imported into Cloudstack  and this template uses 
a VirtIO controller I have another template that was created from a disk also 
with OS type of Windows Server 2016 (64-bit) but has an ID controller.

I am trying to work out why this happened and now I can make the disk template 
always select the VirtIO controller.
Setting the instance to windows PV causes BSOD on boot, well before hal can be 
redetected


Thanks

Adam

-Original Message-
From: Andrija Panic 
Sent: 20 September 2018 11:18
To: users 
Subject: Re: Disk controller type

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Sooo... here is my experience:

if using correct VirtIO OS TYPE (set on template/VM) - i.e. ubuntu 14.04, 
Centos 6.x or 7.x, Windows PV, other PV (but NOT centos 6.0 or 7.0 - these "dot 
zero" versions are NOT virtio at least in ACS 4.8), then when VM is STARTED 
FROM ACS (power on VM) - all drives should be attached as VirtIO.

BUT if you do same as above, then additionally create and HOTPLUG new 
drives/volumes to KVM - it will be IDE - some strange default behavior during 
hotplug action just stop VM/start and it will become VirtIO again...

In order to "troubleshoot" these instances - you need to be careful to which OS 
TYPE was the instance set to (this is inherited from TEMPLATE, if you used some 
template - but it CAN be changed on an deployed&&stopped
instance)

In case you plan to i.e. move your Windows instances from IDE to VirtIO - be 
aware that it might fail miserably, and OS will fail to boot - but there is a 
fix with *"* bcdedit /set detecthal boolean (where boolean is one of 1,  on, 
yes or true) " after which Windows will detect HAL again and boot just fine.

Let me know if more help needed

Cheers

On Thu, 20 Sep 2018 at 11:22, Adam Witwicki  wrote:

>
>
> It looks like I can just add
>
> rootDiskController virtio
>
> To the templates settings tab?
>
> Can anyone confirm?
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Ivan Kudryavtsev 
> Sent: 20 September 2018 10:20
> To: users 
> Subject: Re: Disk controller type
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Rakesh, It doesn't work like that for CS as it uses stateless XML configs.
>
> чт, 20 сент. 2018 г., 16:12 Rakesh Venkatesh :
>
> > I think you can change the controller type in XML file of the VM but
> > not sure if that works or not.
> >
> > virsh dumpxml 
> > virsh edit 
> > change the controller type, save and start the vm again
> >
> > On Thu, Sep 20, 2018 at 9:59 AM Adam Witwicki
> > 
> > wrote:
> >
> > > Hello,
> > >
> > > I have a number of of instances using the wrong controller type
> > > (ATA)
> > does
> > > anyone know where this is set in the database so I can start them
> > > with
> > the
> > > VirtIO scsi controller?
> > >
> > > Thanks
> > >
> > > Adam
> > >
> > >
> > >
> > >
> > > Disclaimer Notice:
> > > This email has been sent by Oakford Technology Limited, while we
> > > have checked this e-mail and any attachments for viruses, we can
> > > not guarantee that they are virus-free. You must therefore take
> > > full responsibility for virus checking.
> > > This message and any attachments are confidential and should only
> > > be read by those to whom they are addressed. If you are not the
> > &

RE: Disk controller type

2018-09-21 Thread Adam Witwicki
Ok, I have found were to force the controller type for a VM

Set this is the user_vm_details table

idvm_idnamevaluedisplay
3625201rootDiskControllervirtio1

My issue now is slipstreaming the windows ISO and the operating system

bcdedit /set detecthal Boolean 1 isnt working for me

Thanks

Adam


-Original Message-
From: Adam Witwicki 
Sent: 21 September 2018 09:31
To: users@cloudstack.apache.org
Subject: RE: Disk controller type

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Andrija,

I have something weird, I have a template which uses the OS type of Windows 
Server 2016 (64-bit), this was imported into Cloudstack  and this template uses 
a VirtIO controller I have another template that was created from a disk also 
with OS type of Windows Server 2016 (64-bit) but has an ID controller.

I am trying to work out why this happened and now I can make the disk template 
always select the VirtIO controller.
Setting the instance to windows PV causes BSOD on boot, well before hal can be 
redetected


Thanks

Adam

-Original Message-
From: Andrija Panic 
Sent: 20 September 2018 11:18
To: users 
Subject: Re: Disk controller type

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Sooo... here is my experience:

if using correct VirtIO OS TYPE (set on template/VM) - i.e. ubuntu 14.04, 
Centos 6.x or 7.x, Windows PV, other PV (but NOT centos 6.0 or 7.0 - these "dot 
zero" versions are NOT virtio at least in ACS 4.8), then when VM is STARTED 
FROM ACS (power on VM) - all drives should be attached as VirtIO.

BUT if you do same as above, then additionally create and HOTPLUG new 
drives/volumes to KVM - it will be IDE - some strange default behavior during 
hotplug action just stop VM/start and it will become VirtIO again...

In order to "troubleshoot" these instances - you need to be careful to which OS 
TYPE was the instance set to (this is inherited from TEMPLATE, if you used some 
template - but it CAN be changed on an deployed&&stopped
instance)

In case you plan to i.e. move your Windows instances from IDE to VirtIO - be 
aware that it might fail miserably, and OS will fail to boot - but there is a 
fix with *"* bcdedit /set detecthal boolean (where boolean is one of 1,  on, 
yes or true) " after which Windows will detect HAL again and boot just fine.

Let me know if more help needed

Cheers

On Thu, 20 Sep 2018 at 11:22, Adam Witwicki  wrote:

>
>
> It looks like I can just add
>
> rootDiskController virtio
>
> To the templates settings tab?
>
> Can anyone confirm?
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Ivan Kudryavtsev 
> Sent: 20 September 2018 10:20
> To: users 
> Subject: Re: Disk controller type
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Rakesh, It doesn't work like that for CS as it uses stateless XML configs.
>
> чт, 20 сент. 2018 г., 16:12 Rakesh Venkatesh :
>
> > I think you can change the controller type in XML file of the VM but
> > not sure if that works or not.
> >
> > virsh dumpxml 
> > virsh edit 
> > change the controller type, save and start the vm again
> >
> > On Thu, Sep 20, 2018 at 9:59 AM Adam Witwicki
> > 
> > wrote:
> >
> > > Hello,
> > >
> > > I have a number of of instances using the wrong controller type
> > > (ATA)
> > does
> > > anyone know where this is set in the database so I can start them
> > > with
> > the
> > > VirtIO scsi controller?
> > >
> > > Thanks
> > >
> > > Adam
> > >
> > >
> > >
> > >
> > > Disclaimer Notice:
> > > This email has been sent by Oakford Technology Limited, while we
> > > have checked this e-mail and any attachments for viruses, we can
> > > not guarantee that they are virus-free. You must therefore take
> > > full responsibility for virus checking.
> > > This message and any attachments are confidential and should only
> > > be read by those to whom they are addressed. If you are not the
> > > intended
> > recipient,
> > > please contact us, delete the message from your computer and
> > > destroy any copies. Any distribution or copying without our prior
> > > permission is prohibited.
> > > Internet communications are not always secure and therefore
> > > Oakford Technology Limited does not accept legal responsibility
> > > for this
> message.
> > > The recipient is res

RE: Disk controller type

2018-09-21 Thread Adam Witwicki
Andrija,

I have something weird, I have a template which uses the OS type of Windows 
Server 2016 (64-bit), this was imported into Cloudstack  and this template uses 
a VirtIO controller
I have another template that was created from a disk also with OS type of 
Windows Server 2016 (64-bit) but has an ID controller.

I am trying to work out why this happened and now I can make the disk template 
always select the VirtIO controller.
Setting the instance to windows PV causes BSOD on boot, well before hal can be 
redetected


Thanks

Adam

-Original Message-
From: Andrija Panic 
Sent: 20 September 2018 11:18
To: users 
Subject: Re: Disk controller type

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Sooo... here is my experience:

if using correct VirtIO OS TYPE (set on template/VM) - i.e. ubuntu 14.04, 
Centos 6.x or 7.x, Windows PV, other PV (but NOT centos 6.0 or 7.0 - these "dot 
zero" versions are NOT virtio at least in ACS 4.8), then when VM is STARTED 
FROM ACS (power on VM) - all drives should be attached as VirtIO.

BUT if you do same as above, then additionally create and HOTPLUG new 
drives/volumes to KVM - it will be IDE - some strange default behavior during 
hotplug action just stop VM/start and it will become VirtIO again...

In order to "troubleshoot" these instances - you need to be careful to which OS 
TYPE was the instance set to (this is inherited from TEMPLATE, if you used some 
template - but it CAN be changed on an deployed&&stopped
instance)

In case you plan to i.e. move your Windows instances from IDE to VirtIO - be 
aware that it might fail miserably, and OS will fail to boot - but there is a 
fix with *"* bcdedit /set detecthal boolean (where boolean is one of 1,  on, 
yes or true) " after which Windows will detect HAL again and boot just fine.

Let me know if more help needed

Cheers

On Thu, 20 Sep 2018 at 11:22, Adam Witwicki  wrote:

>
>
> It looks like I can just add
>
> rootDiskController virtio
>
> To the templates settings tab?
>
> Can anyone confirm?
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Ivan Kudryavtsev 
> Sent: 20 September 2018 10:20
> To: users 
> Subject: Re: Disk controller type
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Rakesh, It doesn't work like that for CS as it uses stateless XML configs.
>
> чт, 20 сент. 2018 г., 16:12 Rakesh Venkatesh :
>
> > I think you can change the controller type in XML file of the VM but
> > not sure if that works or not.
> >
> > virsh dumpxml 
> > virsh edit 
> > change the controller type, save and start the vm again
> >
> > On Thu, Sep 20, 2018 at 9:59 AM Adam Witwicki
> > 
> > wrote:
> >
> > > Hello,
> > >
> > > I have a number of of instances using the wrong controller type
> > > (ATA)
> > does
> > > anyone know where this is set in the database so I can start them
> > > with
> > the
> > > VirtIO scsi controller?
> > >
> > > Thanks
> > >
> > > Adam
> > >
> > >
> > >
> > >
> > > Disclaimer Notice:
> > > This email has been sent by Oakford Technology Limited, while we
> > > have checked this e-mail and any attachments for viruses, we can
> > > not guarantee that they are virus-free. You must therefore take
> > > full responsibility for virus checking.
> > > This message and any attachments are confidential and should only
> > > be read by those to whom they are addressed. If you are not the
> > > intended
> > recipient,
> > > please contact us, delete the message from your computer and
> > > destroy any copies. Any distribution or copying without our prior
> > > permission is prohibited.
> > > Internet communications are not always secure and therefore
> > > Oakford Technology Limited does not accept legal responsibility
> > > for this
> message.
> > > The recipient is responsible for verifying its authenticity before
> > > acting on the contents. Any views or opinions presented are solely
> > > those of the author and do not necessarily represent those of
> > > Oakford Technology
> > Limited.
> > > Registered address: Oakford Technology Limited, 10 Prince Maurice
> > > Court, Devizes, Wiltshire. SN10 2RT.
> > > Registered in England and Wales No. 5971519
> > >
> > >
> >
> > --
> > Thanks and regards
> > Rakesh venkatesh
> >
> Disclai

RE: Disk controller type

2018-09-20 Thread Adam Witwicki


It looks like I can just add

rootDiskController virtio

To the templates settings tab?

Can anyone confirm?

Thanks

Adam

-Original Message-
From: Ivan Kudryavtsev 
Sent: 20 September 2018 10:20
To: users 
Subject: Re: Disk controller type

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Rakesh, It doesn't work like that for CS as it uses stateless XML configs.

чт, 20 сент. 2018 г., 16:12 Rakesh Venkatesh :

> I think you can change the controller type in XML file of the VM but
> not sure if that works or not.
>
> virsh dumpxml 
> virsh edit 
> change the controller type, save and start the vm again
>
> On Thu, Sep 20, 2018 at 9:59 AM Adam Witwicki
> 
> wrote:
>
> > Hello,
> >
> > I have a number of of instances using the wrong controller type
> > (ATA)
> does
> > anyone know where this is set in the database so I can start them
> > with
> the
> > VirtIO scsi controller?
> >
> > Thanks
> >
> > Adam
> >
> >
> >
> >
> > Disclaimer Notice:
> > This email has been sent by Oakford Technology Limited, while we
> > have checked this e-mail and any attachments for viruses, we can not
> > guarantee that they are virus-free. You must therefore take full
> > responsibility for virus checking.
> > This message and any attachments are confidential and should only be
> > read by those to whom they are addressed. If you are not the
> > intended
> recipient,
> > please contact us, delete the message from your computer and destroy
> > any copies. Any distribution or copying without our prior permission
> > is prohibited.
> > Internet communications are not always secure and therefore Oakford
> > Technology Limited does not accept legal responsibility for this message.
> > The recipient is responsible for verifying its authenticity before
> > acting on the contents. Any views or opinions presented are solely
> > those of the author and do not necessarily represent those of
> > Oakford Technology
> Limited.
> > Registered address: Oakford Technology Limited, 10 Prince Maurice
> > Court, Devizes, Wiltshire. SN10 2RT.
> > Registered in England and Wales No. 5971519
> >
> >
>
> --
> Thanks and regards
> Rakesh venkatesh
>
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



Disk controller type

2018-09-20 Thread Adam Witwicki
Hello,

I have a number of of instances using the wrong controller type (ATA) does 
anyone know where this is set in the database so I can start them with the 
VirtIO scsi controller?

Thanks

Adam




Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



RE: Removing a rule from VCP router

2018-08-01 Thread Adam Witwicki
Ignore me, its not an iptables issue
Thanks



Adam

-Original Message-
From: Adam Witwicki 
Sent: 01 August 2018 13:41
To: users@cloudstack.apache.org
Subject: RE: Removing a rule from VCP router

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Dan

I need to allow DHCP requests from a private gateway to the servers in 
cloudstack.
It MUST be persistent.

Thanks

Adam

-Original Message-
From: Dag Sonstebo 
Sent: 01 August 2018 13:38
To: users@cloudstack.apache.org
Subject: Re: Removing a rule from VCP router

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

I assume you are asking as the rule in question can’t be changed from the 
cloudstack GUI?

If so the easiest is:

iptables-save > myrules
edit myrules
iptables-restore < myrules

Just keep in mind the change will not be persistent across VR restarts.

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 01/08/2018, 13:18, "Adam Witwicki"  wrote:

Hello

I need to remove a rule in Chain INPUT (policy drop) from my VPC build, 
what is the best way to do this?

Thanks

Adam


Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have 
checked this e-mail and any attachments for viruses, we can not guarantee that 
they are virus-free. You must therefore take full responsibility for virus 
checking.
This message and any attachments are confidential and should only be read 
by those to whom they are addressed. If you are not the intended recipient, 
please contact us, delete the message from your computer and destroy any 
copies. Any distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford 
Technology Limited does not accept legal responsibility for this message. The 
recipient is responsible for verifying its authenticity before acting on the 
contents. Any views or opinions presented are solely those of the author and do 
not necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519




dag.sonst...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



RE: Removing a rule from VCP router

2018-08-01 Thread Adam Witwicki
Hi Dan

I need to allow DHCP requests from a private gateway to the servers in 
cloudstack.
It MUST be persistent.

Thanks

Adam

-Original Message-
From: Dag Sonstebo 
Sent: 01 August 2018 13:38
To: users@cloudstack.apache.org
Subject: Re: Removing a rule from VCP router

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

I assume you are asking as the rule in question can’t be changed from the 
cloudstack GUI?

If so the easiest is:

iptables-save > myrules
edit myrules
iptables-restore < myrules

Just keep in mind the change will not be persistent across VR restarts.

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 01/08/2018, 13:18, "Adam Witwicki"  wrote:

Hello

I need to remove a rule in Chain INPUT (policy drop) from my VPC build, 
what is the best way to do this?

Thanks

Adam


Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have 
checked this e-mail and any attachments for viruses, we can not guarantee that 
they are virus-free. You must therefore take full responsibility for virus 
checking.
This message and any attachments are confidential and should only be read 
by those to whom they are addressed. If you are not the intended recipient, 
please contact us, delete the message from your computer and destroy any 
copies. Any distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford 
Technology Limited does not accept legal responsibility for this message. The 
recipient is responsible for verifying its authenticity before acting on the 
contents. Any views or opinions presented are solely those of the author and do 
not necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519




dag.sonst...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



Removing a rule from VCP router

2018-08-01 Thread Adam Witwicki
Hello

I need to remove a rule in Chain INPUT (policy drop) from my VPC build, what is 
the best way to do this?

Thanks

Adam


Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



VPC static NAT with Private gateways

2018-07-20 Thread Adam Witwicki
Hello

If we add a static nat to a server in a VPC, after a while it is unable to 
route to the Private gateways assigned in the same VPC.
Has anyone else seen this?

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



VPC ACLs SRC and DST

2018-07-18 Thread Adam Witwicki
Hello

Is there a way we can add the DST IP to the ACL lists in a VPC as well as the 
SRC IP (outbound)

Thanks

Adam



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



RE: Unable to upload volumes 4.11.0

2018-07-16 Thread Adam Witwicki
Hi Paul

That was accepted but returned this error, cert issue.

Failed to upload volume: e6638e70-f346-4a98-aab7-91046e9fcfc7 with error: 
sun.security.validator.ValidatorException: PKIX path building failed: 
sun.security.provider.certpath.SunCertPathBuilderException: unable to find 
valid certification path to requested target

Yet I am able to import as a template from the same source.?
A confusing one

Thanks

Adam

-Original Message-
From: Paul Angus 
Sent: 16 July 2018 11:06
To: users@cloudstack.apache.org
Subject: RE: Unable to upload volumes 4.11.0

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Full disclosure - I used 4.11.1 but I uploaded a 'volume' from centos without a 
problem.
Could you test the same link?
https://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow2


Kind regards,

Paul Angus

paul.an...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue




-Original Message-----
From: Adam Witwicki 
Sent: 16 July 2018 08:02
To: users@cloudstack.apache.org
Subject: RE: Unable to upload volumes 4.11.0

Hi Paul,

The SSVM can curl the file, and the template import (add) works without issue, 
it’s the volume import (add) that fails

Thanks

Adam

-Original Message-
From: Paul Angus 
Sent: 14 July 2018 07:36
To: users@cloudstack.apache.org
Subject: RE: Unable to upload volumes 4.11.0

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

That error is coming from:

if (httpClient.executeMethod(httphead) != HttpStatus.SC_OK) {
throw new IllegalArgumentException("Invalid URL: " + url);

have you tried checking that you can reach the download from the management 
server and the SSVM?

Also does the hostname resolve to an IP which is within the cloudstack 
management networks? If so you need to add the IP(s) to 
secstorage.allowed.internal.sites




paul.an...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue




-Original Message-
From: Adam Witwicki 
Sent: 13 July 2018 09:21
To: users@cloudstack.apache.org
Subject: Unable to upload volumes 4.11.0

Hello

I cant seem to upload (add) a qcow2 volume via a URL, any ideas or other 
methods? we really need to import other systems disks.

I get this in the logs

2018-07-13 09:08:18,435 DEBUG [c.c.s.VolumeApiServiceImpl] 
(API-Job-Executor-42:ctx-a1afd9f2 job-6668 ctx-7da8ec40) (logid:d97e88ec) 
Checking url: 
http://ingestion.xxx.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2
2018-07-13 09:08:18,509 ERROR [c.c.a.ApiAsyncJobDispatcher] 
(API-Job-Executor-42:ctx-a1afd9f2 job-6668) (logid:d97e88ec) Unexpected 
exception while executing 
org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd
java.lang.IllegalArgumentException: Invalid URL: 
http://ingestion.xx.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2
at com.cloud.utils.UriUtils.checkUrlExistence(UriUtils.java:395)
at 
com.cloud.storage.VolumeApiServiceImpl.validateVolume(VolumeApiServiceImpl.java:415)
at 
com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:296)
at 
com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:179)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:338)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:197)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at 
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174)
at 
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174)
at 
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212)
at com.sun.proxy.$Proxy201.uploadVolume(Unknow

RE: Unable to upload volumes 4.11.0

2018-07-16 Thread Adam Witwicki
Hi Paul,

The SSVM can curl the file, and the template import (add) works without issue, 
it’s the volume import (add) that fails

Thanks

Adam

-Original Message-
From: Paul Angus 
Sent: 14 July 2018 07:36
To: users@cloudstack.apache.org
Subject: RE: Unable to upload volumes 4.11.0

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

That error is coming from:

if (httpClient.executeMethod(httphead) != HttpStatus.SC_OK) {
throw new IllegalArgumentException("Invalid URL: " + url);

have you tried checking that you can reach the download from the management 
server and the SSVM?

Also does the hostname resolve to an IP which is within the cloudstack 
management networks? If so you need to add the IP(s) to 
secstorage.allowed.internal.sites




paul.an...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue




-Original Message-----
From: Adam Witwicki 
Sent: 13 July 2018 09:21
To: users@cloudstack.apache.org
Subject: Unable to upload volumes 4.11.0

Hello

I cant seem to upload (add) a qcow2 volume via a URL, any ideas or other 
methods? we really need to import other systems disks.

I get this in the logs

2018-07-13 09:08:18,435 DEBUG [c.c.s.VolumeApiServiceImpl] 
(API-Job-Executor-42:ctx-a1afd9f2 job-6668 ctx-7da8ec40) (logid:d97e88ec) 
Checking url: 
http://ingestion.xxx.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2
2018-07-13 09:08:18,509 ERROR [c.c.a.ApiAsyncJobDispatcher] 
(API-Job-Executor-42:ctx-a1afd9f2 job-6668) (logid:d97e88ec) Unexpected 
exception while executing 
org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd
java.lang.IllegalArgumentException: Invalid URL: 
http://ingestion.xx.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2
at com.cloud.utils.UriUtils.checkUrlExistence(UriUtils.java:395)
at 
com.cloud.storage.VolumeApiServiceImpl.validateVolume(VolumeApiServiceImpl.java:415)
at 
com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:296)
at 
com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:179)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:338)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:197)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at 
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174)
at 
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174)
at 
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212)
at com.sun.proxy.$Proxy201.uploadVolume(Unknown Source)
at 
org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd.execute(UploadVolumeCmd.java:145)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at 
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:581)
at 
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at 
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:529)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTas

RE: Unable to upload volumes 4.11.0

2018-07-13 Thread Adam Witwicki
Hi Andrija

I also tried http://ingestion.xxx.com/Flowmon/1.qcow2

Thanks

Adam

-Original Message-
From: Andrija Panic 
Sent: 13 July 2018 09:34
To: users 
Subject: Re: Unable to upload volumes 4.11.0

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

can you try volume name without underscores ?

Andrija

On Fri, 13 Jul 2018 at 10:21, Adam Witwicki  wrote:

> Hello
>
> I cant seem to upload (add) a qcow2 volume via a URL, any ideas or
> other methods? we really need to import other systems disks.
>
> I get this in the logs
>
> 2018-07-13 09:08:18,435 DEBUG [c.c.s.VolumeApiServiceImpl]
> (API-Job-Executor-42:ctx-a1afd9f2 job-6668 ctx-7da8ec40)
> (logid:d97e88ec) Checking url:
> http://ingestion.xxx.com/Flowmon/Flowmon_Collector_Virtual_All_Plu
> gins-disk-1.qcow2
> 2018-07-13
> <http://ingestion.xxx.com/Flowmon/Flowmon_Collector_Virtual_All_Pl
> ugins-disk-1.qcow22018-07-13>
> 09:08:18,509 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (API-Job-Executor-42:ctx-a1afd9f2 job-6668) (logid:d97e88ec)
> Unexpected exception while executing
> org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd
> java.lang.IllegalArgumentException: Invalid URL:
> http://ingestion.xx.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2
> at com.cloud.utils.UriUtils.checkUrlExistence(UriUtils.java:395)
> at
> com.cloud.storage.VolumeApiServiceImpl.validateVolume(VolumeApiServiceImpl.java:415)
> at
> com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:296)
> at
> com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:179)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:338)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:197)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
> at
> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174)
> at
> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174)
> at
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
> at
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212)
> at com.sun.proxy.$Proxy201.uploadVolume(Unknown Source)
> at
> org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd.execute(UploadVolumeCmd.java:145)
> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
> at
> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
> at
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:581)
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> at
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:529)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

Unable to upload volumes 4.11.0

2018-07-13 Thread Adam Witwicki
Hello

I cant seem to upload (add) a qcow2 volume via a URL, any ideas or other 
methods? we really need to import other systems disks.

I get this in the logs

2018-07-13 09:08:18,435 DEBUG [c.c.s.VolumeApiServiceImpl] 
(API-Job-Executor-42:ctx-a1afd9f2 job-6668 ctx-7da8ec40) (logid:d97e88ec) 
Checking url: 
http://ingestion.xxx.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2
2018-07-13 09:08:18,509 ERROR [c.c.a.ApiAsyncJobDispatcher] 
(API-Job-Executor-42:ctx-a1afd9f2 job-6668) (logid:d97e88ec) Unexpected 
exception while executing 
org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd
java.lang.IllegalArgumentException: Invalid URL: 
http://ingestion.xx.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2
at com.cloud.utils.UriUtils.checkUrlExistence(UriUtils.java:395)
at 
com.cloud.storage.VolumeApiServiceImpl.validateVolume(VolumeApiServiceImpl.java:415)
at 
com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:296)
at 
com.cloud.storage.VolumeApiServiceImpl.uploadVolume(VolumeApiServiceImpl.java:179)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:338)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:197)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at 
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174)
at 
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174)
at 
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212)
at com.sun.proxy.$Proxy201.uploadVolume(Unknown Source)
at 
org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd.execute(UploadVolumeCmd.java:145)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at 
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:581)
at 
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at 
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:529)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-07-13 09:08:18,511 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-42:ctx-a1afd9f2 job-6668) (logid:d97e88ec) Complete async 
job-6668, jobStatus: FAILED, resultCode: 530, result: 
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Invalid
 URL: 
http://ingestion.x.com/Flowmon/Flowmon_Collector_Virtual_All_Plugins-disk-1.qcow2"}



Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distr

RE: Importing Hyper-V to Cloudstack 4.11.0 UEFI and GPT

2018-07-10 Thread Adam Witwicki
Fixed using this

https://www.sevenforums.com/installation-setup/320700-boot-windows-7-8-gpt-bios-system-no-hybrid-mbrs-duet.html

ROOT MBR disk,
Attached GPT disk (imported windows partitions)

select disk 0
clean
create partition primary [size=##]
format
select partition 1
active
list volume
select volume 1
assign
list volume
exit

bcdboot C:\Windows /l en-us /s D:
bootsect /nt60 D: /mbr /force
bcdedit /store D:\boot\bcd /set {bootmgr} device boot


Thanks Everyone

Adam

-Original Message-
From: Adam Witwicki
Sent: 10 July 2018 15:09
To: users 
Subject: RE: Importing Hyper-V to Cloudstack 4.11.0 UEFI and GPT

Is there any way to get cloudstack to boot a GPT disk? This needs to be made 
clearer in the documentation, we have lots of hyper-v GEN2 boxes we need to 
import.

I have found one bootloader on a CD that will boot the windows OS, but am 
having a nightmare getting this installed on the first HDD  
https://sourceforge.net/projects/cloverefiboot/

Thanks

Adam

-Original Message-
From: Andrija Panic 
Sent: 09 July 2018 14:09
To: users 
Subject: Re: Importing Hyper-V to Cloudstack 4.11.0

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Ah yes... if ti has anything to do with UEFI, than it's not possible.

But if plain GPT - there should be a fix possible - check this one:
https://forum.proxmox.com/threads/hyper-v-export-with-gpt-partition-table-will-not-boot.23716/

Cheers

On Mon, 9 Jul 2018 at 14:48, Adam Witwicki  wrote:

> Andrija
>
> It looks like we cannot boot a GPT disk, this will be a huge pain, as
> most of the systems we want to migrate are GPT
>
> Thanks
>
> Aadm
>
> -Original Message-
> From: Andrija Panic 
> Sent: 06 July 2018 14:27
> To: users 
> Subject: Re: Importing Hyper-V to Cloudstack 4.11.0
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> I would not be sure...
>
> Silly question, can you check (ps aux | grep VMNAME) or with virsh
> dumpxml etc... that the volume is actually really attached to the VM ?
> If so, then I would try to mount the volume on the hypervisor host
> (there are ways to mount qcow2 and same with ceph, using rbd map,
> etc...) to "enter" the volume and see if all fine.. or perhaps doing
> qemu-img check... just from top of my head. I find it hard that
> conversion produces damaged volume, but it;s possible,
>
> Actually, pay attention on the conversion process - not sure how/with
> which tool you do conversion - but's it's good idea to export VM (from
> HyperV) to get clean/single VHDX file, and then convert (check the
> VHDX previously also with qemu-img check) Here there is a Windows
> version, that should work (did NOT test it though):
> https://cloudbase.it/qemu-img-windows/
>
> Let me know, really curious what is going on...
>
>
>
>
> On Fri, 6 Jul 2018 at 14:49, Adam Witwicki 
> wrote:
>
> > Andrija,
> >
> > I used qemu-img to convert to qcow2 since I am using KVM with ceph -
> > when I view the console I get the emulated BIOS saying no bootable
> > device found
> > - this must be before any IDE or VirtIO drivers.
> > I have also tried with NFS storage and get the same boot error.
> >
> > This process worked on 4.9, I notice there are more template options
> > on
> > 4.11.0 do I need to do any thing different?
> >
> > Thanks
> >
> > Adam
> >
> > -Original Message-
> > From: Andrija Panic 
> > Sent: 06 July 2018 13:45
> > To: users 
> > Subject: Re: Importing Hyper-V to Cloudstack 4.11.0
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Hi Adam,
> >
> > havent done that myslef (but helped some customers) - if you are
> > running OS TYpe :"Windows XXX" - anything concrete version - this
> > means no VirtIO drives are needed, since all IDE, so no drivers
> > needed)  If using "Windows PV" this means you need to have installed
> > VirtIO drivers inside the OS (I suggest, on HyperV VM, adding new
> > hardware via device manager and loading correct VirtIO drivers for
> > SCSI controller, or also for the network...up to
> > you) - and only then exporting VHDX to qcow2.
> >
> > Btw, I don't know if VHDX can be imported into ACS directly ? -
> > perhaps it needs previous conversion to QCOW2 format, and then
> > upload
> > qcow2 natively (again, not sure,  so I might be wrong here).
> >
> >
> > Also please note that t

RE: Importing Hyper-V to Cloudstack 4.11.0 UEFI and GPT

2018-07-10 Thread Adam Witwicki
Is there any way to get cloudstack to boot a GPT disk? This needs to be made 
clearer in the documentation, we have lots of hyper-v GEN2 boxes we need to 
import.

I have found one bootloader on a CD that will boot the windows OS, but am 
having a nightmare getting this installed on the first HDD
 https://sourceforge.net/projects/cloverefiboot/

Thanks

Adam

-Original Message-
From: Andrija Panic 
Sent: 09 July 2018 14:09
To: users 
Subject: Re: Importing Hyper-V to Cloudstack 4.11.0

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Ah yes... if ti has anything to do with UEFI, than it's not possible.

But if plain GPT - there should be a fix possible - check this one:
https://forum.proxmox.com/threads/hyper-v-export-with-gpt-partition-table-will-not-boot.23716/

Cheers

On Mon, 9 Jul 2018 at 14:48, Adam Witwicki  wrote:

> Andrija
>
> It looks like we cannot boot a GPT disk, this will be a huge pain, as
> most of the systems we want to migrate are GPT
>
> Thanks
>
> Aadm
>
> -Original Message-
> From: Andrija Panic 
> Sent: 06 July 2018 14:27
> To: users 
> Subject: Re: Importing Hyper-V to Cloudstack 4.11.0
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> I would not be sure...
>
> Silly question, can you check (ps aux | grep VMNAME) or with virsh
> dumpxml etc... that the volume is actually really attached to the VM ?
> If so, then I would try to mount the volume on the hypervisor host
> (there are ways to mount qcow2 and same with ceph, using rbd map,
> etc...) to "enter" the volume and see if all fine.. or perhaps doing
> qemu-img check... just from top of my head. I find it hard that
> conversion produces damaged volume, but it;s possible,
>
> Actually, pay attention on the conversion process - not sure how/with
> which tool you do conversion - but's it's good idea to export VM (from
> HyperV) to get clean/single VHDX file, and then convert (check the
> VHDX previously also with qemu-img check) Here there is a Windows
> version, that should work (did NOT test it though):
> https://cloudbase.it/qemu-img-windows/
>
> Let me know, really curious what is going on...
>
>
>
>
> On Fri, 6 Jul 2018 at 14:49, Adam Witwicki 
> wrote:
>
> > Andrija,
> >
> > I used qemu-img to convert to qcow2 since I am using KVM with ceph -
> > when I view the console I get the emulated BIOS saying no bootable
> > device found
> > - this must be before any IDE or VirtIO drivers.
> > I have also tried with NFS storage and get the same boot error.
> >
> > This process worked on 4.9, I notice there are more template options
> > on
> > 4.11.0 do I need to do any thing different?
> >
> > Thanks
> >
> > Adam
> >
> > -Original Message-
> > From: Andrija Panic 
> > Sent: 06 July 2018 13:45
> > To: users 
> > Subject: Re: Importing Hyper-V to Cloudstack 4.11.0
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Hi Adam,
> >
> > havent done that myslef (but helped some customers) - if you are
> > running OS TYpe :"Windows XXX" - anything concrete version - this
> > means no VirtIO drives are needed, since all IDE, so no drivers
> > needed)  If using "Windows PV" this means you need to have installed
> > VirtIO drivers inside the OS (I suggest, on HyperV VM, adding new
> > hardware via device manager and loading correct VirtIO drivers for
> > SCSI controller, or also for the network...up to
> > you) - and only then exporting VHDX to qcow2.
> >
> > Btw, I don't know if VHDX can be imported into ACS directly ? -
> > perhaps it needs previous conversion to QCOW2 format, and then
> > upload
> > qcow2 natively (again, not sure,  so I might be wrong here).
> >
> >
> > Also please note that there is something related to Hardware
> > Abstraction Layer in Windows (if Windows at all ?), when some of the
> > changes (even installing VirtIO in some cases on existing KVM VM)
> > will bring server down unable to boot - bcdedit /detecthal - google
> > for this one - i.e. force OS to detect HAL again, for proper boot/fix.
> >
> >
> >
> > Hope that helps
> >
> > Andrija
> >
> > On Fri, 6 Jul 2018 at 12:39, Adam Witwicki 
> > wrote:
> >
> > > Hello,
> > >
> > > I wonder if anyone can help, I am having issues im

RE: Importing Hyper-V to Cloudstack 4.11.0

2018-07-09 Thread Adam Witwicki
Andrija

It looks like we cannot boot a GPT disk, this will be a huge pain, as most of 
the systems we want to migrate are GPT

Thanks

Aadm

-Original Message-
From: Andrija Panic 
Sent: 06 July 2018 14:27
To: users 
Subject: Re: Importing Hyper-V to Cloudstack 4.11.0

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

I would not be sure...

Silly question, can you check (ps aux | grep VMNAME) or with virsh dumpxml 
etc... that the volume is actually really attached to the VM ? If so, then I 
would try to mount the volume on the hypervisor host (there are ways to mount 
qcow2 and same with ceph, using rbd map, etc...) to "enter" the volume and see 
if all fine.. or perhaps doing qemu-img check... just from top of my head. I 
find it hard that conversion produces damaged volume, but it;s possible,

Actually, pay attention on the conversion process - not sure how/with which 
tool you do conversion - but's it's good idea to export VM (from HyperV) to get 
clean/single VHDX file, and then convert (check the VHDX previously also with 
qemu-img check) Here there is a Windows version, that should work (did NOT test 
it though):
https://cloudbase.it/qemu-img-windows/

Let me know, really curious what is going on...




On Fri, 6 Jul 2018 at 14:49, Adam Witwicki  wrote:

> Andrija,
>
> I used qemu-img to convert to qcow2 since I am using KVM with ceph -
> when I view the console I get the emulated BIOS saying no bootable
> device found
> - this must be before any IDE or VirtIO drivers.
> I have also tried with NFS storage and get the same boot error.
>
> This process worked on 4.9, I notice there are more template options
> on
> 4.11.0 do I need to do any thing different?
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Andrija Panic 
> Sent: 06 July 2018 13:45
> To: users 
> Subject: Re: Importing Hyper-V to Cloudstack 4.11.0
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> havent done that myslef (but helped some customers) - if you are
> running OS TYpe :"Windows XXX" - anything concrete version - this
> means no VirtIO drives are needed, since all IDE, so no drivers
> needed)  If using "Windows PV" this means you need to have installed
> VirtIO drivers inside the OS (I suggest, on HyperV VM, adding new
> hardware via device manager and loading correct VirtIO drivers for
> SCSI controller, or also for the network...up to
> you) - and only then exporting VHDX to qcow2.
>
> Btw, I don't know if VHDX can be imported into ACS directly ? -
> perhaps it needs previous conversion to QCOW2 format, and then upload
> qcow2 natively (again, not sure,  so I might be wrong here).
>
>
> Also please note that there is something related to Hardware
> Abstraction Layer in Windows (if Windows at all ?), when some of the
> changes (even installing VirtIO in some cases on existing KVM VM) will
> bring server down unable to boot - bcdedit /detecthal - google for
> this one - i.e. force OS to detect HAL again, for proper boot/fix.
>
>
>
> Hope that helps
>
> Andrija
>
> On Fri, 6 Jul 2018 at 12:39, Adam Witwicki 
> wrote:
>
> > Hello,
> >
> > I wonder if anyone can help, I am having issues importing a
> > converted Hyper-V (VHDX) to KVM (qcow2).
> > After importing the template and starting the instance, the instance
> > will fail to find the boot device.
> >
> > This worked in 4.9
> >
> >
> > Thanks
> >
> > Adam Witwicki
> >
> >
> > Disclaimer Notice:
> > This email has been sent by Oakford Technology Limited, while we
> > have checked this e-mail and any attachments for viruses, we can not
> > guarantee that they are virus-free. You must therefore take full
> > responsibility for virus checking.
> > This message and any attachments are confidential and should only be
> > read by those to whom they are addressed. If you are not the
> > intended recipient, please contact us, delete the message from your
> > computer and destroy any copies. Any distribution or copying without
> > our prior permission is prohibited.
> > Internet communications are not always secure and therefore Oakford
> > Technology Limited does not accept legal responsibility for this message.
> > The recipient is responsible for verifying its authenticity before
> > acting on the contents. Any views or opinions presented are solely
> > those of the author and do not necessarily represent those of
> > Oakford
> Technology Limited.
> > Registered address: Oa

RE: Importing Hyper-V to Cloudstack 4.11.0

2018-07-06 Thread Adam Witwicki
Andrija,

I used qemu-img to convert to qcow2 since I am using KVM with ceph - when I 
view the console I get the emulated BIOS saying no bootable device found - this 
must be before any IDE or VirtIO drivers.
I have also tried with NFS storage and get the same boot error.

This process worked on 4.9, I notice there are more template options on 4.11.0 
do I need to do any thing different?

Thanks

Adam

-Original Message-
From: Andrija Panic 
Sent: 06 July 2018 13:45
To: users 
Subject: Re: Importing Hyper-V to Cloudstack 4.11.0

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

havent done that myslef (but helped some customers) - if you are running OS 
TYpe :"Windows XXX" - anything concrete version - this means no VirtIO drives 
are needed, since all IDE, so no drivers needed)  If using "Windows PV" this 
means you need to have installed VirtIO drivers inside the OS (I suggest, on 
HyperV VM, adding new hardware via device manager and loading correct VirtIO 
drivers for SCSI controller, or also for the network...up to you) - and only 
then exporting VHDX to qcow2.

Btw, I don't know if VHDX can be imported into ACS directly ? - perhaps it 
needs previous conversion to QCOW2 format, and then upload qcow2 natively 
(again, not sure,  so I might be wrong here).


Also please note that there is something related to Hardware Abstraction Layer 
in Windows (if Windows at all ?), when some of the changes (even installing 
VirtIO in some cases on existing KVM VM) will bring server down unable to boot 
- bcdedit /detecthal - google for this one - i.e. force OS to detect HAL again, 
for proper boot/fix.



Hope that helps

Andrija

On Fri, 6 Jul 2018 at 12:39, Adam Witwicki  wrote:

> Hello,
>
> I wonder if anyone can help, I am having issues importing a converted
> Hyper-V (VHDX) to KVM (qcow2).
> After importing the template and starting the instance, the instance
> will fail to find the boot device.
>
> This worked in 4.9
>
>
> Thanks
>
> Adam Witwicki
>
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, 10 Prince Maurice
> Court, Devizes, Wiltshire. SN10 2RT.
> Registered in England and Wales No. 5971519
>
>

--

Andrija Panić
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



Importing Hyper-V to Cloudstack 4.11.0

2018-07-06 Thread Adam Witwicki
Hello,

I wonder if anyone can help, I am having issues importing a converted Hyper-V 
(VHDX) to KVM (qcow2).
After importing the template and starting the instance, the instance will fail 
to find the boot device.

This worked in 4.9


Thanks

Adam Witwicki


Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



RE: CloudStack - KVM / Ceph Performance

2018-06-26 Thread Adam Witwicki
The speed difference between Centos and Ubuntu KVM hosts is 3 fold.

How do I check the rbd cache configuration on KVM hosts?

Thanks

Adam

-Original Message-
From: Andrija Panic 
Sent: 26 June 2018 15:00
To: users 
Subject: Re: CloudStack - KVM / Ceph Performance

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

You are obviously hitting some issues on Centos vs Ubuntu as KVM host, and can 
be due to difference in kernel, ceph (librbd), libvirt/qemu...

But we have been using ceph (older, hammer release) with Ubuntu 14.04 and dont 
expect any miracle on single volume. BUT if you i.e. start Bitlocker drive 
encryption on multiple VMs at same time, you will be able to nicely saturate 
cluster to its full performance capacity.

It's known feature that CEPH "excellent on parallel streams /io" i.e.
single volume can't really reach nowhere near full performance of the cluster.

Again questions about rbd cache configuration on KVM hosts?

If you will eventually put more serious workloads on this specific cluster, it 
ain't gonna perform satisfactory for any customer - that is reality - been 
there, done that... moved away...
Sorry for being too honest...
(We had same size cluster, just used  Intel DC ssds for journals, collocated 
few journals on single SSD - not very optimal thought)

Cheers

On Jun 26, 2018 15:40, "Adam Witwicki"  wrote:

Used the same guest VM, with a Ubuntu and Centos KVM host

The Ubuntu host performed as expected, the guest on Centos KVM host is very slow

I have been testing with KVM virtio drivers packaged in centos7 and downloaded 
them for windows guests

Thanks

Adam


-Original Message-
From: Simon Weller 
Sent: 26 June 2018 13:35
To: users 
Subject: Re: CloudStack - KVM / Ceph Performance

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **


I assume you've checked to make sure you're using the KVM virtio drivers, right?


- Si



From: Ivan Kudryavtsev 
Sent: Tuesday, June 26, 2018 6:35 AM
To: users
Subject: Re: CloudStack - KVM / Ceph Performance

Hello, Adam. Try to attach md raid0 of two Ceph vols inside VM. I have heard 
that people who run ceph use that practice to improve results. I don't know 
what you are expecting, but read somewhere that all ops to a single RBD volume 
are queued in a single IO queue, thus RAID0 helps here, increasing the speed 
almost twice. I mean you don't see a ceph cluster overall performance, you see 
a librbd+qemu performance in your tests.

вт, 26 июн. 2018 г., 15:57 Adam Witwicki :

> We are days away from completing our production CloudStack / Ceph
> deployment but have run into a small challenge in regards to Ceph
> performance. As you run a setup similar to ours I was wondering if
> you've seen a similar issue?
>
>
>
> Our Ceph cluster consists of 60 X 7.2K SAS drive, spread over 5 nodes
> each with a 960GB Samsung NVMe. Our KVM hypervisors are connected to
> this nodes via 2 x 10Gbps links, per node.
>
>
>
> 3 centos Cloudstack management servers 4.11.0
>
> 4 centos KVM hosts
>
>
>
> The RAW Ceph performance looks great!
>
>
>
> CEPH RAW
>
> *Average IOPS*
>
> *Max IOPS*
>
> *MB/sec*
>
> *Write 4K*
>
> 5,885
>
> 6,190
>
> 22.9907
>
> *Read 4K*
>
> 28,985
>
> 35,025
>
> 113
>
> *Write 4MB*
>
> 204
>
> 219
>
> 816
>
> *Read 4MB*
>
> 361
>
> 399
>
> 1447.51
>
>
>
> However when we run the tests from within KVM we get significantly
> reduced performance, particular in writes:
>
>
>
> VM Running on KVM Hypervisor
>
> *Average IOPS*
>
> *Max IOPS*
>
> *MB/sec*
>
> *Write 4K*
>
> 946.07
>
> 1390
>
> 3.69
>
> *Write 4MB*
>
> 472
>
> 614
>
> 116
>
>
>
> We believe the libvirt/ceph library could be causing the problem with
> in centos as we don't see this on a Ubuntu KVM HOST
>
>
>
> Kind Regards,
>
> [image: Oakford Internet Services] <http://www.oakfordis.com/>
>
> *Adam Witwicki* | Hosted Systems Specialist
>
> 01380 710278 / awitwi...@oakfordis.com
>
> *Oakford Internet Services* Office: 01380 888088
> 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT
> www.oakfordis.com<http://www.oakfordis.com> sa...@oakfordis.com
>
>
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message an

RE: CloudStack - KVM / Ceph Performance

2018-06-26 Thread Adam Witwicki
Used the same guest VM, with a Ubuntu and Centos KVM host

The Ubuntu host performed as expected, the guest on Centos KVM host is very slow

I have been testing with KVM virtio drivers packaged in centos7 and downloaded 
them for windows guests

Thanks

Adam

-Original Message-
From: Simon Weller 
Sent: 26 June 2018 13:35
To: users 
Subject: Re: CloudStack - KVM / Ceph Performance

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

I assume you've checked to make sure you're using the KVM virtio drivers, right?


- Si



From: Ivan Kudryavtsev 
Sent: Tuesday, June 26, 2018 6:35 AM
To: users
Subject: Re: CloudStack - KVM / Ceph Performance

Hello, Adam. Try to attach md raid0 of two Ceph vols inside VM. I have heard 
that people who run ceph use that practice to improve results. I don't know 
what you are expecting, but read somewhere that all ops to a single RBD volume 
are queued in a single IO queue, thus RAID0 helps here, increasing the speed 
almost twice. I mean you don't see a ceph cluster overall performance, you see 
a librbd+qemu performance in your tests.

вт, 26 июн. 2018 г., 15:57 Adam Witwicki :

> We are days away from completing our production CloudStack / Ceph
> deployment but have run into a small challenge in regards to Ceph
> performance. As you run a setup similar to ours I was wondering if
> you've seen a similar issue?
>
>
>
> Our Ceph cluster consists of 60 X 7.2K SAS drive, spread over 5 nodes
> each with a 960GB Samsung NVMe. Our KVM hypervisors are connected to
> this nodes via 2 x 10Gbps links, per node.
>
>
>
> 3 centos Cloudstack management servers 4.11.0
>
> 4 centos KVM hosts
>
>
>
> The RAW Ceph performance looks great!
>
>
>
> CEPH RAW
>
> *Average IOPS*
>
> *Max IOPS*
>
> *MB/sec*
>
> *Write 4K*
>
> 5,885
>
> 6,190
>
> 22.9907
>
> *Read 4K*
>
> 28,985
>
> 35,025
>
> 113
>
> *Write 4MB*
>
> 204
>
> 219
>
> 816
>
> *Read 4MB*
>
> 361
>
> 399
>
> 1447.51
>
>
>
> However when we run the tests from within KVM we get significantly
> reduced performance, particular in writes:
>
>
>
> VM Running on KVM Hypervisor
>
> *Average IOPS*
>
> *Max IOPS*
>
> *MB/sec*
>
> *Write 4K*
>
> 946.07
>
> 1390
>
> 3.69
>
> *Write 4MB*
>
> 472
>
> 614
>
> 116
>
>
>
> We believe the libvirt/ceph library could be causing the problem with
> in centos as we don't see this on a Ubuntu KVM HOST
>
>
>
> Kind Regards,
>
> [image: Oakford Internet Services] <http://www.oakfordis.com/>
>
> *Adam Witwicki* | Hosted Systems Specialist
>
> 01380 710278 / awitwi...@oakfordis.com
>
> *Oakford Internet Services* Office: 01380 888088
> 10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT
> www.oakfordis.com<http://www.oakfordis.com> sa...@oakfordis.com
>
>
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not
> guarantee that they are virus-free. You must therefore take full
> responsibility for virus checking.
> This message and any attachments are confidential and should only be
> read by those to whom they are addressed. If you are not the intended
> recipient, please contact us, delete the message from your computer
> and destroy any copies. Any distribution or copying without our prior
> permission is prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before
> acting on the contents. Any views or opinions presented are solely
> those of the author and do not necessarily represent those of Oakford 
> Technology Limited.
> Registered address: Oakford Technology Limited, 10 Prince Maurice
> Court, Devizes, Wiltshire. SN10 2RT.
> Registered in England and Wales No. 5971519
>
Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefor

CloudStack - KVM / Ceph Performance

2018-06-26 Thread Adam Witwicki
We are days away from completing our production CloudStack / Ceph deployment 
but have run into a small challenge in regards to Ceph performance. As you run 
a setup similar to ours I was wondering if you've seen a similar issue?

Our Ceph cluster consists of 60 X 7.2K SAS drive, spread over 5 nodes each with 
a 960GB Samsung NVMe. Our KVM hypervisors are connected to this nodes via 2 x 
10Gbps links, per node.

3 centos Cloudstack management servers 4.11.0
4 centos KVM hosts

The RAW Ceph performance looks great!

CEPH RAW

Average IOPS

Max IOPS

MB/sec

Write 4K

5,885

6,190

22.9907

Read 4K

28,985

35,025

113

Write 4MB

204

219

816

Read 4MB

361

399

1447.51


However when we run the tests from within KVM we get significantly reduced 
performance, particular in writes:

VM Running on KVM Hypervisor

Average IOPS

Max IOPS

MB/sec

Write 4K

946.07

1390

3.69

Write 4MB

472

614

116


We believe the libvirt/ceph library could be causing the problem with in centos 
as we don't see this on a Ubuntu KVM HOST

Kind Regards,

[Oakford Internet Services]<http://www.oakfordis.com/>
Adam Witwicki | Hosted Systems Specialist
01380 710278 / awitwi...@oakfordis.com<mailto:awitwi...@oakfordis.com>
Oakford Internet Services Office: 01380 888088
10 Prince Maurice Court, Devizes, Wiltshire. SN10 2RT
www.oakfordis.com<http://www.oakfordis.com/> 
sa...@oakfordis.com<mailto:sa...@oakfordis.com>


Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



RE: Agents not reconnecting after reboot.

2018-06-19 Thread Adam Witwicki
Hi,

This might be due to the hosts being in maintenance mode, I got an internal 
error when cancelling maintenance - but the hosts then showed as UP

Thanks

Adam
-Original Message-
From: Adam Witwicki 
Sent: 15 June 2018 16:21
To: users@cloudstack.apache.org
Subject: Agents not reconnecting after reboot.

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello,

I am experiencing an issue where hosts agents are not reconnecting after a host 
reboot. They stay in alert state, When I restart the management servers the 
agents then connect. Any ideas?

Kind Regards
Adam Witwicki


Cloudstack 4.11.0
KVM hosts
HA proxy sticky sessions
Global setting Host: points to HA proxy

Server log: http://termbin.com/4b5z
Agent log: http://termbin.com/9g34





Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



Agents not reconnecting after reboot.

2018-06-15 Thread Adam Witwicki
Hello,

I am experiencing an issue where hosts agents are not reconnecting after a host 
reboot. They stay in alert state,
When I restart the management servers the agents then connect. Any ideas?

Kind Regards
Adam Witwicki


Cloudstack 4.11.0
KVM hosts
HA proxy sticky sessions
Global setting Host: points to HA proxy

Server log: http://termbin.com/4b5z
Agent log: http://termbin.com/9g34





Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court, 
Devizes, Wiltshire. SN10 2RT.
Registered in England and Wales No. 5971519



RE: KVM Problem by deploying VPC

2018-05-24 Thread Adam Witwicki
Hi Ben

" Now i moved back to centos7 and have another problem. all vlan bridges that 
will be created by cloudstack-agent not manual get in ifup state. if i ifup the 
vlan bridges manual all works fine. Have someone a idea how i can force centos 
to automaticly bring up new if devices ?"

I had this issue with 4.9 and ending up writing a dirty script to check the 
down bridges every minute via cron and if up them.

iface=`/usr/sbin/ip add | grep -E "brbond.*DOWN" |  awk -F ':' '{print $2}'`
echo "$iface" | while read -r a; do /usr/sbin/ip link set dev $a up; done


Thanks

Adam

-Original Message-
From: Benjamin Naber 
Sent: 24 May 2018 14:37
To: users@cloudstack.apache.org
Subject: Re: KVM Problem by deploying VPC

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Andrija,

ty for reply. i solved the error. Now i have an other error. Problem was that 
it failed witout a bonding device. i created a bonding device (bond0) wiht a 
single nic now it works without problems On Ubuntu.

Example (didnt work):

auto enp8s0f0
iface enp8s0f0 inet manual

auto cloudbr0
iface cloudbr0 inet static
address 10.253.250.230
gateway 10.253.250.1
netmask 255.255.255.0
dns-nameservers 8.8.8.8 8.8.4.4
bridge_ports enp8s0f0
bridge_fd 5
bridge_stp off
bridge_maxwait 1

Example (works fine):

auto enp8s0f0
iface enp8s0f0 inet manual
bond-master bond0

auto bond0
iface bond0 inet manual
bond-mode active-backup
bond-miimon 100
bond-slaves none


auto cloudbr0
iface cloudbr0 inet static
address 10.253.250.230
gateway 10.253.250.1
netmask 255.255.255.0
dns-nameservers 8.8.8.8 8.8.4.4
bridge_ports bond0
bridge_fd 5
bridge_stp off
bridge_maxwait 1

Now i moved back to centos7 and have another problem. all vlan bridges that 
will be created by cloudstack-agent not manual get in ifup state. if i ifup the 
vlan bridges manual all works fine. Have someone a idea how i can force centos 
to automaticly bring up new if devices ?


Kind regards

Ben

>
> Andrija Panic  hat am 24. Mai 2018 um 00:37 
> geschrieben:
>
> Hi Ben,
>
> interesting parts seems to be:
> 2018-05-23 12:59:47,213 DEBUG [kvm.resource.LibvirtComputingResource]
> (agentRequest-Handler-5:null) (logid:ef8b353e) getting broadcast uri for
> pif enp8s0f0.233 and bridge brenp8s0f0-233
> 2018-05-23 12:59:47,213 DEBUG 
> [resource.virtualnetwork.VirtualRoutingResource]
> (agentRequest-Handler-5:null) (logid:ef8b353e) Transforming
> com.cloud.agent.api.routing.IpAssocVpcCommand to ConfigItems
> 2018-05-23 12:59:47,581 DEBUG 
> [resource.virtualnetwork.VirtualRoutingResource]
> (agentRequest-Handler-5:null) (logid:ef8b353e) Processing FileConfigItem,
> copying 257 characters to ip_associations.json took 340ms
> 2018-05-23 12:59:47,582 DEBUG [kvm.resource.LibvirtComputingResource]
> (agentRequest-Handler-5:null) (logid:ef8b353e) Executing:
> /usr/share/cloudstack-common/scripts/network/domr/router_proxy.sh
> update_config.py 169.254.2.247 ip_associations.json
> 2018-05-23 12:59:47,766 DEBUG [kvm.resource.LibvirtComputingResource]
> (agentRequest-Handler-5:null) (logid:ef8b353e) Exit value is 1
>
> What I believe we see here, is that IP association fails for some reason
> (exit value is 1) and after that ACS will just stop the VM and do the
> cleanup (all log lines after this one)...
>
> Can you check your broadcast URI in the DB ? ACtually... I see it vlan 223
>
> * I did have some issues in past releases, when we wanted to use 
> untagged
>   vlans for Public network, but it seems not to be case here...
>
> Not sure, if it's possible that you also SSH to the VR during this 
> creation
> process, in order to collect logs from inside the VR - before Qemu 
> destroys
> the VR?
>
> ssh -p 3922 -i .ssh/id_rsa.cloud root@ 169.254.2.247 and then try to fetch
> (SCP or something) whole /var/log/ folder to the localhost - from there,
> there is cloud.log and auth.log where most of the commands outputs are
> located (success or failure)
>
> or something like rsync -av -e "ssh -p 3992 -i .ssh.id_rsa.cloud"
> root@169...
> /local/dir/
> and keep repeating until you fetch whatever data to be able to analyze it
>
> Perhaps someone else will have better suggestion...
>
> Best
> Andrija
>
> On 23 May 2018 at 13:08, Benjamin Naber 
> wrote:
>
> > >
> > Hi Andrija,
> >
> > first of all thanks for your reply. I have now testet the setup on a
> > Ubuntu Xenial. Same issu with Default VPC Offering. Redundant VPC 
> > offering
> > works also without any problems. Same as on CentOS.
> >
> > See delow the debug log (censored public Ips):
> >
> > 2018-05-23 12:58:05,161 INFO [cloud.agent.Agent]
> > (agentRequest-Handler-2:null) (logid:0806b407) Proccess agent ready
> > comman

RE: Upgrading from 4.9 to 4.11

2018-05-09 Thread Adam Witwicki
All good now

Thanks

-Original Message-
From: Rohit Yadav 
Sent: 09 May 2018 17:49
To: users@cloudstack.apache.org
Subject: Re: Upgrading from 4.9 to 4.11

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Adam,


With your new setup, were you able to solve the issue or is this still an issue?


If this is still an issue, ensure that the ca strictness global setting is 
false, remove any cert/jks files on KVM host and use provisionCertificate API 
to force provisioning of certificate to an already connected KVM host.


Backup/remove the rpmsave file, looks like you choose to install the package 
provided agent.properties file instead of what you already have. For an already 
added host, you should keep your old agent.properties file instead of use the 
new one which will be blank (empty of configuration).


- Rohit

<https://cloudstack.apache.org>




From: Adam Witwicki 
Sent: Friday, May 4, 2018 5:45:39 PM
To: users@cloudstack.apache.org
Subject: RE: Upgrading from 4.9 to 4.11

Hi Rohit,
Those instructions were followed

There was no keystore.passphrase=  in agent.properties, it was found in 
agent.properties.rpmsave

Removing cloud.jks hasn't worked I now get in management log

2018-05-04 13:03:33,246 DEBUG [c.c.u.s.SSHCmdHelper] 
(qtp510113906-18:ctx-4f329b77 ctx-c350b74b) (logid:29765313) SSH command: 
/usr/share/cloudstack-common/scripts/util/keystore-cert-import 
/etc/cloudstack/agent/agent.properties /etc/cloudstack/agent/
2018-05-04 13:03:33,247 ERROR [c.c.h.k.d.LibvirtServerDiscoverer] 
(qtp510113906-18:ctx-4f329b77 ctx-c350b74b) (logid:29765313) Failed to setup 
certificate in the KVM agent's keystore file, please configure manually!

I can't find any instructions configure manually!
Is anyone able to provide some?

Thanks

Adam



rohit.ya...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue




-Original Message-
From: Rohit Yadav 
Sent: 04 May 2018 13:02
To: users@cloudstack.apache.org
Subject: Re: Upgrading from 4.9 to 4.11

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,


If you're upgrading to 4.11.0.0, please use the correct release notes:

http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.11.0.0/


When you upgrade, you'll need to upgrade both management server(s) and kvm host 
agents to make it work. By default, the new CA service will keep the global 
setting 'ca.plugin.root.auth.strictness ' to false for an existing deployment 
(this is only true for new/fresh installations).


When the above global setting is false, and you want legacy behaviour make sure 
you don't have any cloud.jks in your KVM hosts's /etc/cloudstack/agent/ path. 
On the management server side, 4.11.0.0 creates a cloud.jks which holds a 
random certificate (starting 4.11.1.0 this won't be necessary, and this file 
will not be created in mgmt server's /etc/cloudstack/management/ path).


If you make any changes (and after upgrades), try to restart the management 
server(s) and kvm host agent(s).


- Rohit

<https://cloudstack.apache.org>




From: Adam Witwicki 
Sent: Friday, May 4, 2018 1:06:48 PM
To: users@cloudstack.apache.org
Subject: Upgrading from 4.9 to 4.11

Hello

Upgrading from 4.9 t0 4.11 using this guide 
http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.10/upgrade/upgrade-4.9.html

None of my KVM hosts are connecting with this in the management server log

2018-05-04 08:31:13,774 WARN  [c.c.u.n.Link] 
(AgentManager-SSLHandshakeHandler-4:null) (logid:) SSL Handshake has taken more 
than 15s to connect to: /192.168.200.109:50492. Please investigate this 
connection.

Any Ideas?

Thanks

Adam Witwicki


Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, 10 Prince Maurice Court

RE: Issue upgrading 4.9 to 4.11 Database?

2018-05-08 Thread Adam Witwicki
It may have been my DB connection failing during the update, or running 
/usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt 
before cloudstack-setup-management

Is up now

Thanks

Adam

-Original Message-
From: Adam Witwicki 
Sent: 08 May 2018 10:49
To: users@cloudstack.apache.org
Subject: RE: Issue upgrading 4.9 to 4.11 Database?

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

I'm getting the same error on a clean database trying to install

Name: cloudstack-management
Arch: x86_64
Version : 4.11.0.0
Release : shapeblue0.el7.centos
Size: 100 M
Repo: installed
>From repo   : cloudstack-4.11
Summary : CloudStack management server UI
Licence : ASL 2.0
Description : The CloudStack management server is the central point of 
coordination,
: management, and intelligence in CloudStack.



-Original Message-
From: Rohit Yadav 
Sent: 05 May 2018 17:39
To: users 
Subject: Re: Issue upgrading 4.9 to 4.11 Database?

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Thanks for reporting and sharing, the fix would be to simply add the same 
upgrade path which would be applicable for 4.9.3.1. I'll post a fix on Monday.



- Rohit

<https://cloudstack.apache.org>




From: Rafael Weingärtner 
Sent: Friday, May 4, 2018 9:40:26 PM
To: users
Subject: Re: Issue upgrading 4.9 to 4.11 Database?

Just an update. I will try to fix this for 4.11.1.0

On Fri, May 4, 2018 at 11:36 AM, Rafael Weingärtner < 
rafaelweingart...@gmail.com> wrote:

> So, there you are. This is a consequence of the DB upgrade method we
> are using :(((
> 4.9.3.1 was launched after 4.11. There is no upgrade path from 4.9.3.1
> to 4.11.
>
> What is the state of your version table?
>
> On Fri, May 4, 2018 at 11:28 AM, Adam Witwicki
> 
> wrote:
>
>> ACS 4.9.3.1
>>
>> Thanks
>>
>> Adam
>>
>>
>> -Original Message-
>> From: Rafael Weingärtner 
>> Sent: 04 May 2018 15:27
>> To: users 
>> Subject: Re: Issue upgrading 4.9 to 4.11 Database?
>>
>> ** This mail originated from OUTSIDE the Oakford corporate network.
>> Treat hyperlinks and attachments in this email with caution. **
>>
>> I forgot that was only for people with Apache ID.
>> So is in Unknown column 'network_offerings.supports_public_access' in
>> 'field list' . It seems that some scripts were not executed.
>>
>> That field is created with script "schema-4930to41000.sql". What was
>> your ACS 4.9 version?
>>
>> On Fri, May 4, 2018 at 11:20 AM, Adam Witwicki
>> 
>> wrote:
>>
>> > That URL required a username and password
>> >
>> > Here is the log @ pastebin https://pastebin.com/0xRnqPV3
>> >
>> > Thanks
>> >
>> > Adam
>> >
>> > -Original Message-
>> > From: Rafael Weingärtner 
>> > Sent: 04 May 2018 15:17
>> > To: users 
>> > Subject: Re: Issue upgrading 4.9 to 4.11 Database?
>> >
>> > ** This mail originated from OUTSIDE the Oakford corporate network.
>> > Treat hyperlinks and attachments in this email with caution. **
>> >
>> > Attachements are stripped...
>> > Instead, you can use: https://paste.apache.org/
>> >
>> > On Fri, May 4, 2018 at 11:02 AM, Adam Witwicki
>> > 
>> > wrote:
>> >
>> > > Please find attached
>> > >
>> > >
>> > >
>> > > -Original Message-
>> > > From: Rafael Weingärtner 
>> > > Sent: 04 May 2018 14:52
>> > > To: users 
>> > > Subject: Re: Issue upgrading 4.9 to 4.11 Database?
>> > >
>> > > ** This mail originated from OUTSIDE the Oakford corporate network.
>> > > Treat hyperlinks and attachments in this email with caution. **
>> > >
>> > > We will need more log entries. However, this is looking like a DB
>> > > version issue.
>> > >
>> > > On Fri, May 4, 2018 at 10:49 AM, Adam Witwicki
>> > > 
>> > > wrote:
>> > >
>> > > > Hello,
>> > > >
>> > > > The management service won't start after update, I get this in
>> > > > the log
>> > > >
>> > > > Failed startup of context o.e.j.w.WebAppContext@4148db48
>> > > > {/client,file:///usr/share/clo

RE: Issue upgrading 4.9 to 4.11 Database?

2018-05-08 Thread Adam Witwicki
I'm getting the same error on a clean database trying to install

Name: cloudstack-management
Arch: x86_64
Version : 4.11.0.0
Release : shapeblue0.el7.centos
Size: 100 M
Repo: installed
>From repo   : cloudstack-4.11
Summary : CloudStack management server UI
Licence : ASL 2.0
Description : The CloudStack management server is the central point of 
coordination,
: management, and intelligence in CloudStack.



-Original Message-
From: Rohit Yadav 
Sent: 05 May 2018 17:39
To: users 
Subject: Re: Issue upgrading 4.9 to 4.11 Database?

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Thanks for reporting and sharing, the fix would be to simply add the same 
upgrade path which would be applicable for 4.9.3.1. I'll post a fix on Monday.



- Rohit

<https://cloudstack.apache.org>




From: Rafael Weingärtner 
Sent: Friday, May 4, 2018 9:40:26 PM
To: users
Subject: Re: Issue upgrading 4.9 to 4.11 Database?

Just an update. I will try to fix this for 4.11.1.0

On Fri, May 4, 2018 at 11:36 AM, Rafael Weingärtner < 
rafaelweingart...@gmail.com> wrote:

> So, there you are. This is a consequence of the DB upgrade method we
> are using :(((
> 4.9.3.1 was launched after 4.11. There is no upgrade path from 4.9.3.1
> to 4.11.
>
> What is the state of your version table?
>
> On Fri, May 4, 2018 at 11:28 AM, Adam Witwicki
> 
> wrote:
>
>> ACS 4.9.3.1
>>
>> Thanks
>>
>> Adam
>>
>>
>> -Original Message-
>> From: Rafael Weingärtner 
>> Sent: 04 May 2018 15:27
>> To: users 
>> Subject: Re: Issue upgrading 4.9 to 4.11 Database?
>>
>> ** This mail originated from OUTSIDE the Oakford corporate network.
>> Treat hyperlinks and attachments in this email with caution. **
>>
>> I forgot that was only for people with Apache ID.
>> So is in Unknown column 'network_offerings.supports_public_access' in
>> 'field list' . It seems that some scripts were not executed.
>>
>> That field is created with script "schema-4930to41000.sql". What was
>> your ACS 4.9 version?
>>
>> On Fri, May 4, 2018 at 11:20 AM, Adam Witwicki
>> 
>> wrote:
>>
>> > That URL required a username and password
>> >
>> > Here is the log @ pastebin https://pastebin.com/0xRnqPV3
>> >
>> > Thanks
>> >
>> > Adam
>> >
>> > -Original Message-
>> > From: Rafael Weingärtner 
>> > Sent: 04 May 2018 15:17
>> > To: users 
>> > Subject: Re: Issue upgrading 4.9 to 4.11 Database?
>> >
>> > ** This mail originated from OUTSIDE the Oakford corporate network.
>> > Treat hyperlinks and attachments in this email with caution. **
>> >
>> > Attachements are stripped...
>> > Instead, you can use: https://paste.apache.org/
>> >
>> > On Fri, May 4, 2018 at 11:02 AM, Adam Witwicki
>> > 
>> > wrote:
>> >
>> > > Please find attached
>> > >
>> > >
>> > >
>> > > -Original Message-
>> > > From: Rafael Weingärtner 
>> > > Sent: 04 May 2018 14:52
>> > > To: users 
>> > > Subject: Re: Issue upgrading 4.9 to 4.11 Database?
>> > >
>> > > ** This mail originated from OUTSIDE the Oakford corporate network.
>> > > Treat hyperlinks and attachments in this email with caution. **
>> > >
>> > > We will need more log entries. However, this is looking like a DB
>> > > version issue.
>> > >
>> > > On Fri, May 4, 2018 at 10:49 AM, Adam Witwicki
>> > > 
>> > > wrote:
>> > >
>> > > > Hello,
>> > > >
>> > > > The management service won't start after update, I get this in
>> > > > the log
>> > > >
>> > > > Failed startup of context o.e.j.w.WebAppContext@4148db48
>> > > > {/client,file:///usr/share/cloudstack-management/webapp/,
>> > > > UNAVAILABLE}{/usr/share/cloudstack-management/webapp}
>> > > > org.springframework.context.ApplicationContextException: Failed
>> > > > to start bean 'cloudStackLifeCycle'; nested exception is
>> > > com.cloud.utils.exception.CloudRuntimeException:
>> > > > DB Exception on: com.mysql.jdbc.JDBC4PreparedStatement@ed1d2cf:
>> > > > SELECT network

RE: Issue upgrading 4.9 to 4.11 Database?

2018-05-04 Thread Adam Witwicki
ACS 4.9.3.1

Thanks

Adam


-Original Message-
From: Rafael Weingärtner 
Sent: 04 May 2018 15:27
To: users 
Subject: Re: Issue upgrading 4.9 to 4.11 Database?

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

I forgot that was only for people with Apache ID.
So is in Unknown column 'network_offerings.supports_public_access' in 'field 
list' . It seems that some scripts were not executed.

That field is created with script "schema-4930to41000.sql". What was your ACS 
4.9 version?

On Fri, May 4, 2018 at 11:20 AM, Adam Witwicki 
wrote:

> That URL required a username and password
>
> Here is the log @ pastebin https://pastebin.com/0xRnqPV3
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Rafael Weingärtner 
> Sent: 04 May 2018 15:17
> To: users 
> Subject: Re: Issue upgrading 4.9 to 4.11 Database?
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Attachements are stripped...
> Instead, you can use: https://paste.apache.org/
>
> On Fri, May 4, 2018 at 11:02 AM, Adam Witwicki
> 
> wrote:
>
> > Please find attached
> >
> >
> >
> > -Original Message-
> > From: Rafael Weingärtner 
> > Sent: 04 May 2018 14:52
> > To: users 
> > Subject: Re: Issue upgrading 4.9 to 4.11 Database?
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > We will need more log entries. However, this is looking like a DB
> > version issue.
> >
> > On Fri, May 4, 2018 at 10:49 AM, Adam Witwicki
> > 
> > wrote:
> >
> > > Hello,
> > >
> > > The management service won't start after update, I get this in the
> > > log
> > >
> > > Failed startup of context o.e.j.w.WebAppContext@4148db48
> > > {/client,file:///usr/share/cloudstack-management/webapp/,
> > > UNAVAILABLE}{/usr/share/cloudstack-management/webapp}
> > > org.springframework.context.ApplicationContextException: Failed to
> > > start bean 'cloudStackLifeCycle'; nested exception is
> > com.cloud.utils.exception.CloudRuntimeException:
> > > DB Exception on: com.mysql.jdbc.JDBC4PreparedStatement@ed1d2cf:
> > > SELECT network_offerings.id, network_offerings.name,
> > > network_offerings.unique_name, network_offerings.display_text,
> > > network_offerings.nw_rate, network_offerings.mc_rate,
> > > network_offerings.traffic_type, network_offerings.specify_vlan,
> > > network_offerings.system_only,
> > > network_offerings.service_offering_id,
> > > network_offerings.tags, network_offerings.default,
> > > network_offerings.availability, network_offerings.state,
> > > network_offerings.removed, network_offerings.created,
> > > network_offerings.guest_type,
> > > network_offerings.dedicated_lb_service,
> > > network_offerings.shared_source_nat_service,
> > > network_offerings.specify_ip_ranges, network_offerings.sort_key,
> > > network_offerings.uuid,
> > > network_offerings.redundant_router_service,
> > > network_offerings.conserve_mode,
> > > network_offerings.elastic_ip_service,
> > > network_offerings.eip_associate_public_ip,
> > > network_offerings.elastic_lb_service,
> > > network_offerings.inline, network_offerings.is_persistent,
> > > network_offerings.for_vpc,
> > > network_offerings.egress_default_policy,
> > > network_offerings.concurrent_connections,
> > > network_offerings.keep_alive_enabled,
> > > network_offerings.supports_streched_l2,
> > > network_offerings.supports_public_access,
> > > network_offerings.internal_lb, network_offerings.public_lb,
> > > network_offerings.service_package_id FROM network_offerings WHERE
> > > network_offerings.unique_name = _binary'QuickCloudNoServices'  AND
> > > network_offerings.removed IS NULL  ORDER BY RAND() LIMIT 1
> > >
> > >
> > > Thanks
> > >
> > > Adam
> > >
> > > Disclaimer Notice:
> > > This email has been sent by Oakford Technology Limited, while we
> > > have checked this e-mail and any attachments for viruses, we can
> > > not guarantee that they are virus-free. You must therefore take
> > > full responsibility for virus checking.
> > > This message and any attachments are confidential and should only
> > > b

  1   2   >