Re: [openstack-dev] [Ceilometer] Doubt about data recollection

2016-04-04 Thread Alberto Gutiérrez Torre
Hello,

In the end the RabbitMQ approach would not suffice our requirements as
in our installation we have RabbitMQ in the controller.

I'm trying to do it with the pipeline approach but trying to maintain
the API working. I did the following with cpu_util:

- name: cpu_sink
  transformers:
  - name: "rate_of_change"
parameters:
target:
name: "cpu_util"
unit: "%"
type: "gauge"
scale: "100.0 / (10**9 *
(resource_metadata.cpu_number or 1))"
  publishers:
  - notifier://
  - udp://127.0.0.1:31337

I want to publish it in both channels but, when this is done, neither
work. If I try sending only data thought UDP it also refuses to work.
Any clues on this? I'm testing it with netcat listening to that port.


Also, is it possible to send an AMQP message to other IP that is not the
one of the controller? In the documentation only makes reference to the
options available for this kind of message, there is no place to specify
the host.

Thanks for your support,
Alberto.


On 15/03/16 16:48, gordon chung wrote:
>
> On 15/03/2016 11:01 AM, Alberto Gutiérrez Torre wrote:
>> What we would like to have is access to the data available in Ceilometer
>> API but by local access. For instance, CPU metrics produced at a given
>> node will be consumed in that same node. Probably we will not need all
>> the available data we're yet finding which variables are of our
>> interest. To start with, CPU usage and memory usage are mandatory.
>>
>> I believe that what we are searching is to access directly to compute
>> agent data. Is this possible, for example, subscribing to  the RabbitMQ
>> queue where the data is being published by the agent? Is there any other
>> way to do so?
> that's exactly one way to do it. the (compute) polling agents build a 
> set of metrics for each poll and publishes them to message queue. the 
> default consumer of these messages is the notification agent which 
> processes the data further (if necessary) and redirects it to a storage 
> or alternative target.
>
> you can configure your compute agent publish to multiple queues by 
> setting notification_topic = notifications, . or you can 
> just disable notification agent and all other non compute agent services 
> if all you want is the data
>
> alternatively, you can use all the services and have the notification 
> agent publish the data to a specific target. to do this, you'll need to 
> edit pipeline.yaml file to send just compute agent metrics to where you 
> want.
>
> cheers,
>


WARNING / LEGAL TEXT: This message is intended only for the use of the
individual or entity to which it is addressed and may contain
information which is privileged, confidential, proprietary, or exempt
from disclosure under applicable law. If you are not the intended
recipient or the person responsible for delivering the message to the
intended recipient, you are strictly prohibited from disclosing,
distributing, copying, or in any way using this message. If you have
received this communication in error, please notify the sender and
destroy and delete any copies you may have received.

http://www.bsc.es/disclaimer

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Ceilometer] Doubt about data recollection

2016-03-15 Thread Alberto Gutiérrez Torre
Hello Gordon,

Thanks for your reply.

What we would like to have is access to the data available in Ceilometer
API but by local access. For instance, CPU metrics produced at a given
node will be consumed in that same node. Probably we will not need all
the available data we're yet finding which variables are of our
interest. To start with, CPU usage and memory usage are mandatory.

I believe that what we are searching is to access directly to compute
agent data. Is this possible, for example, subscribing to  the RabbitMQ
queue where the data is being published by the agent? Is there any other
way to do so?

Thanks for your support.

Best regards,
Alberto.

On 15/03/16 15:39, gordon chung wrote:
>
> On 07/03/2016 11:47 AM, Alberto Gutiérrez Torre wrote:
>> Hello,
>>
>> Istarted working with OpenStack's ceilometer recently and I have some
>> questions that I can not resolve with the documentation I have found.
>>
>> I would like to have the telemetry of a node inside the node itself (for
>> example, a virtual machine that resides in that node and processes the
>> local information in some way) without passing through the global scope
>> (Ceilometer API with the default settings). Is it possible? I have read
>> about agent plugins and it may be a way to approach to the solution
>> (http://docs.openstack.org/developer/ceilometer/contributing/plugins.html).
> sorry, missed this while we were busy with release. can you clarify what 
> data you want? we currently have different agents that gather metrics in 
> various ways.
>
> polling agents - periodic querying of various apis
>   - compute/ipmi agents - exist on host and query for host and guest 
> level metrics
>   - central agent - exist usually on controller node and query service 
> apis
>
> notification agents - listens to service queues for any messages published.
>
> cheers,
>


WARNING / LEGAL TEXT: This message is intended only for the use of the
individual or entity to which it is addressed and may contain
information which is privileged, confidential, proprietary, or exempt
from disclosure under applicable law. If you are not the intended
recipient or the person responsible for delivering the message to the
intended recipient, you are strictly prohibited from disclosing,
distributing, copying, or in any way using this message. If you have
received this communication in error, please notify the sender and
destroy and delete any copies you may have received.

http://www.bsc.es/disclaimer

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Ceilometer] Doubt about data recollection

2016-03-07 Thread Alberto Gutiérrez Torre
Hello,

Istarted working with OpenStack's ceilometer recently and I have some
questions that I can not resolve with the documentation I have found.

I would like to have the telemetry of a node inside the node itself (for
example, a virtual machine that resides in that node and processes the
local information in some way) without passing through the global scope
(Ceilometer API with the default settings). Is it possible? I have read
about agent plugins and it may be a way to approach to the solution
(http://docs.openstack.org/developer/ceilometer/contributing/plugins.html).

Best regards,
Alberto.

WARNING / LEGAL TEXT: This message is intended only for the use of the
individual or entity to which it is addressed and may contain
information which is privileged, confidential, proprietary, or exempt
from disclosure under applicable law. If you are not the intended
recipient or the person responsible for delivering the message to the
intended recipient, you are strictly prohibited from disclosing,
distributing, copying, or in any way using this message. If you have
received this communication in error, please notify the sender and
destroy and delete any copies you may have received.

http://www.bsc.es/disclaimer

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev