Re: Network Bandwidth Stats

2019-06-28 Thread Andrija Panic
With KVM, configure vm.disk.stats.interval and vm.network.stats.interval to
non-zero value, and it will exports some disk and net tx/rx metrics in
Instances --> Metrics.

For VMware its coming in 4.13 afaik.

Check different other *stats.intetval global settings as well.

On Thu, Jun 27, 2019, 08:33 Fariborz Navidan  wrote:

> Hello,
>
> Is there anywhere in ACS I can see network utilization (Mb/s) for physical
> and/or guest network and/or for specific VM?
>
> Thanks
>


Re: Network RX/TX and I/O monitoring for hosts

2019-06-28 Thread Andrija Panic
Try "virt-top" utility as an example.

On Fri, Jun 28, 2019, 18:08 Rakesh v  wrote:

> Yes. Virtio exposes cpu/ram stats of a VM and cloudatack can get this data
> without logging into the VM
>
> Sent from my iPhone
>
> > On 28-Jun-2019, at 4:54 PM, Fariborz Navidan 
> wrote:
> >
> > Hi,
> >
> > Di you mean I can virtio can tell cpu/ram usage inside the guest OS
> without
> > need to logging into guest or use something like perfmon?
> >
> > On Fri, Jun 28, 2019 at 6:47 PM Ivan Kudryavtsev <
> kudryavtsev...@bw-sw.com>
> > wrote:
> >
> >> With VirtIO you don't have host aggregated IO, net numbers (afaik), but
> for
> >> cpu & ram it's true
> >>
> >> пт, 28 июн. 2019 г., 21:11 Rakesh v :
> >>
> >>> Correct me if I'm wrong, I think it can be done using virtio commands
> >>> also. It exposes cpu, memory, disk and network stats of the VM which
> can
> >> be
> >>> exported using libvirt exporter
> >>>
> >>> Sent from my iPhone
> >>>
>  On 28-Jun-2019, at 3:51 PM, Ivan Kudryavtsev <
> kudryavtsev...@bw-sw.com
> >>>
> >>> wrote:
> 
>  Hi. It's easily done with Zabbix. Whole variety of underlying
> >> topologies
> >>> is
>  too difficult to monitor with prebuilt monitoring system... anyway,
> you
> >>> can
>  code it!
> 
>  пт, 28 июн. 2019 г., 20:30 Fariborz Navidan :
> 
> > Hello All,
> >
> > Does ACS provide a way to monitor a host's network bandwidth (RX/TX)
> >> and
> > block storage IOPS  and IO read/write rate for a host?
> >
> > Thanks
> >
> >>>
> >>
>


Re: HOST HA based on ceph(rbd)

2019-06-28 Thread Andrija Panic
Not for now Li.

On Fri, Jun 28, 2019, 09:13 li jerry  wrote:

> Hi Andrija
>  Yes, I am referring to this kvmheqrtbeat.sh.Is there a time plan now?
>
> 发件人: Andrija Panic
> 发送时间: 2019年6月28日 14:35
> 收件人: users
> 抄送: dev
> 主题: Re: HOST HA based on ceph(rbd)
>
> I assume you are referring to the heartbeat scripts (i.e.kvmheqrtbeat.sh)
> that check/write to storage every now and then and if storage is
> unavailable, will restart KVM host ?
>
> If so, then yes, there is some effort already about same kind of thing on
> Ceph, without clear ETA.
>
> On Fri, Jun 28, 2019, 05:19 li jerry  wrote:
>
> > Hi All
> >
> > CLOUDSTACK HOST HA is based on NFS for heart rate detection and HA
> > triggering according to test results.
> > But now CEPH (rbd) +KVM is very stable, and it is also the preferred
> > solution for a large number of cloudstack users.
> > Does the community consider extending host ha's heart rate detection to
> > ceph's rbd?
> >
> >
>
>


Re: Network RX/TX and I/O monitoring for hosts

2019-06-28 Thread Rakesh v
Yes. Virtio exposes cpu/ram stats of a VM and cloudatack can get this data 
without logging into the VM

Sent from my iPhone

> On 28-Jun-2019, at 4:54 PM, Fariborz Navidan  wrote:
> 
> Hi,
> 
> Di you mean I can virtio can tell cpu/ram usage inside the guest OS without
> need to logging into guest or use something like perfmon?
> 
> On Fri, Jun 28, 2019 at 6:47 PM Ivan Kudryavtsev 
> wrote:
> 
>> With VirtIO you don't have host aggregated IO, net numbers (afaik), but for
>> cpu & ram it's true
>> 
>> пт, 28 июн. 2019 г., 21:11 Rakesh v :
>> 
>>> Correct me if I'm wrong, I think it can be done using virtio commands
>>> also. It exposes cpu, memory, disk and network stats of the VM which can
>> be
>>> exported using libvirt exporter
>>> 
>>> Sent from my iPhone
>>> 
 On 28-Jun-2019, at 3:51 PM, Ivan Kudryavtsev >> 
>>> wrote:
 
 Hi. It's easily done with Zabbix. Whole variety of underlying
>> topologies
>>> is
 too difficult to monitor with prebuilt monitoring system... anyway, you
>>> can
 code it!
 
 пт, 28 июн. 2019 г., 20:30 Fariborz Navidan :
 
> Hello All,
> 
> Does ACS provide a way to monitor a host's network bandwidth (RX/TX)
>> and
> block storage IOPS  and IO read/write rate for a host?
> 
> Thanks
> 
>>> 
>> 


Re: Network RX/TX and I/O monitoring for hosts

2019-06-28 Thread Fariborz Navidan
Hi,

Di you mean I can virtio can tell cpu/ram usage inside the guest OS without
need to logging into guest or use something like perfmon?

On Fri, Jun 28, 2019 at 6:47 PM Ivan Kudryavtsev 
wrote:

> With VirtIO you don't have host aggregated IO, net numbers (afaik), but for
> cpu & ram it's true
>
> пт, 28 июн. 2019 г., 21:11 Rakesh v :
>
> > Correct me if I'm wrong, I think it can be done using virtio commands
> > also. It exposes cpu, memory, disk and network stats of the VM which can
> be
> > exported using libvirt exporter
> >
> > Sent from my iPhone
> >
> > > On 28-Jun-2019, at 3:51 PM, Ivan Kudryavtsev  >
> > wrote:
> > >
> > > Hi. It's easily done with Zabbix. Whole variety of underlying
> topologies
> > is
> > > too difficult to monitor with prebuilt monitoring system... anyway, you
> > can
> > > code it!
> > >
> > > пт, 28 июн. 2019 г., 20:30 Fariborz Navidan :
> > >
> > >> Hello All,
> > >>
> > >> Does ACS provide a way to monitor a host's network bandwidth (RX/TX)
> and
> > >> block storage IOPS  and IO read/write rate for a host?
> > >>
> > >> Thanks
> > >>
> >
>


Re: Network RX/TX and I/O monitoring for hosts

2019-06-28 Thread Ivan Kudryavtsev
With VirtIO you don't have host aggregated IO, net numbers (afaik), but for
cpu & ram it's true

пт, 28 июн. 2019 г., 21:11 Rakesh v :

> Correct me if I'm wrong, I think it can be done using virtio commands
> also. It exposes cpu, memory, disk and network stats of the VM which can be
> exported using libvirt exporter
>
> Sent from my iPhone
>
> > On 28-Jun-2019, at 3:51 PM, Ivan Kudryavtsev 
> wrote:
> >
> > Hi. It's easily done with Zabbix. Whole variety of underlying topologies
> is
> > too difficult to monitor with prebuilt monitoring system... anyway, you
> can
> > code it!
> >
> > пт, 28 июн. 2019 г., 20:30 Fariborz Navidan :
> >
> >> Hello All,
> >>
> >> Does ACS provide a way to monitor a host's network bandwidth (RX/TX) and
> >> block storage IOPS  and IO read/write rate for a host?
> >>
> >> Thanks
> >>
>


Re: Network RX/TX and I/O monitoring for hosts

2019-06-28 Thread Rakesh v
Correct me if I'm wrong, I think it can be done using virtio commands also. It 
exposes cpu, memory, disk and network stats of the VM which can be exported 
using libvirt exporter

Sent from my iPhone

> On 28-Jun-2019, at 3:51 PM, Ivan Kudryavtsev  wrote:
> 
> Hi. It's easily done with Zabbix. Whole variety of underlying topologies is
> too difficult to monitor with prebuilt monitoring system... anyway, you can
> code it!
> 
> пт, 28 июн. 2019 г., 20:30 Fariborz Navidan :
> 
>> Hello All,
>> 
>> Does ACS provide a way to monitor a host's network bandwidth (RX/TX) and
>> block storage IOPS  and IO read/write rate for a host?
>> 
>> Thanks
>> 


Re: Network RX/TX and I/O monitoring for hosts

2019-06-28 Thread Ivan Kudryavtsev
Hi. It's easily done with Zabbix. Whole variety of underlying topologies is
too difficult to monitor with prebuilt monitoring system... anyway, you can
code it!

пт, 28 июн. 2019 г., 20:30 Fariborz Navidan :

> Hello All,
>
> Does ACS provide a way to monitor a host's network bandwidth (RX/TX) and
> block storage IOPS  and IO read/write rate for a host?
>
> Thanks
>


Network RX/TX and I/O monitoring for hosts

2019-06-28 Thread Fariborz Navidan
Hello All,

Does ACS provide a way to monitor a host's network bandwidth (RX/TX) and
block storage IOPS  and IO read/write rate for a host?

Thanks


Re: [VOTE] CloudStack 4.11.3.0 RC2

2019-06-28 Thread Rohit Yadav
I'll run smoketests and share my vote soon.


Until then, I've verified the source artifacts:


> gpg --verify apache-cloudstack-4.11.3.0-src.tar.bz2.asc
gpg: assuming signed data in 'apache-cloudstack-4.11.3.0-src.tar.bz2'
gpg: Signature made Wed 26 Jun 2019 01:17:21 AM IST
gpg:using RSA key 8B309F7251EE0BC8
gpg: Good signature from "Paul Angus (apache) " [unknown]
Primary key fingerprint: 70F0 17ED 6DB6 7AC9 2681  66C1 8B30 9F72 51EE 0BC8


There are three commits since RC1:

https://gitbox.apache.org/repos/asf?p=cloudstack.git;a=commit;h=425ad495b1d0675c00b85a34d7a060c145eced57

https://gitbox.apache.org/repos/asf?p=cloudstack.git;a=commit;h=34255061c4d8e678872fa20bfa8dc2879586dd74

https://gitbox.apache.org/repos/asf?p=cloudstack.git;a=commit;h=64d1316e60b2793768be91f1b4c2466695e5a927


Travis CI build for the branch (RC2): 
https://travis-ci.org/apache/cloudstack/builds/550472741


Regards,

Rohit Yadav

Software Architect, ShapeBlue

https://www.shapeblue.com


From: Paul Angus 
Sent: Wednesday, June 26, 2019 2:28:05 AM
To: d...@cloudstack.apache.org; users@cloudstack.apache.org
Subject: [VOTE] CloudStack 4.11.3.0 RC2


Hi All,

I've created a 4.11.3.0 release (RC2), with the following artefacts up for 
testing and a vote:


Git Branch and Commit SH:
https://gitbox.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.11.3.0-RC20190625T2045
Commit: d895983d111086dd392a4bce257726b978465b43

Source release (checksums and signatures are available at the same
location):
https://dist.apache.org/repos/dist/dev/cloudstack/4.11.3.0/

PGP release keys (signed using 51EE0BC8):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

The vote will be open until 29th June.

For sanity in tallying the vote, can PMC members please be sure to indicate 
"(binding)" with their vote?

[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove (and reason why)

Additional information:

For users' convenience, I've built packages from 
d895983d111086dd392a4bce257726b978465b43 and published RC2 repository here:
http://packages.shapeblue.com/testing/41130rc2/

The release notes are still work-in-progress, but the systemvm template upgrade 
section has been updated. You may refer the following for systemvm template 
upgrade testing:
http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/latest/index.html

4.11.3.0 systemvm templates are available from here:
http://packages.shapeblue.com/testing/systemvm/41130rc1/


One commit added since RC1
64d1316e60b2793768be91f1b4c2466695e5a927 | schema: add 4.11.2 to 4.11.3 
systemvmtemplate upgrade path



paul.an...@shapeblue.com
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue




rohit.ya...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 



答复: HOST HA based on ceph(rbd)

2019-06-28 Thread li jerry
Hi Andrija
 Yes, I am referring to this kvmheqrtbeat.sh.Is there a time plan now?

发件人: Andrija Panic
发送时间: 2019年6月28日 14:35
收件人: users
抄送: dev
主题: Re: HOST HA based on ceph(rbd)

I assume you are referring to the heartbeat scripts (i.e.kvmheqrtbeat.sh)
that check/write to storage every now and then and if storage is
unavailable, will restart KVM host ?

If so, then yes, there is some effort already about same kind of thing on
Ceph, without clear ETA.

On Fri, Jun 28, 2019, 05:19 li jerry  wrote:

> Hi All
>
> CLOUDSTACK HOST HA is based on NFS for heart rate detection and HA
> triggering according to test results.
> But now CEPH (rbd) +KVM is very stable, and it is also the preferred
> solution for a large number of cloudstack users.
> Does the community consider extending host ha's heart rate detection to
> ceph's rbd?
>
>