Re: [Openstack] FW: [xenserver-ocata] ceilometer compute error Rrd_interface.Internal_error

[Adhi Priharmanto]

Hi Jianghua,

Thanks for your response and attention. For the error of  "
Rrd_interface.Internal_error" , I was installed this update on my xenserver
(https://support.citrix.com/article/CTX225676) , and RRD error now was gone
from ceilometer logs.

I'm still at ocata release , here is my openstack package list on my
compute node

> [root@cmp1-oc-srg ceilometer]# rpm -qa |grep openstack
> centos-release-openstack-ocata-1-1.el7.noarch
> openstack-selinux-0.7.13-2.el7.noarch
> openstack-nova-compute-15.0.0-1.el7.noarch
> openstack-neutron-common-10.0.1-1.el7.noarch
> openstack-ceilometer-polling-8.1.0-1.el7.noarch
> openstack-ceilometer-compute-8.1.0-1.el7.noarch
> openstack-neutron-openvswitch-10.0.1-1.el7.noarch
> openstack-neutron-ml2-10.0.1-1.el7.noarch
> openstack-ceilometer-common-8.1.0-1.el7.noarch
> openstack-nova-common-15.0.0-1.el7.noarch
> openstack-neutron-10.0.1-1.el7.noarch


And here's is my logs as your request
https://paste.fedoraproject.org/paste/Yv8DoGbLziE0~luY6qwbhQ

I still find error at ceilometer-compute logs like this one

2017-09-25 14:31:07.041 9048 INFO ceilometer.agent.manager [-] Polling
> pollster disk.device.iops in the context of all_pollsters
> 2017-09-25 14:31:07.042 9048 ERROR ceilometer.agent.manager [-] Prevent
> pollster disk.device.iops from polling [,  mon-srg>, ] on source all_pollsters anymore!
> 2017-09-25 14:31:07.043 9048 INFO ceilometer.agent.manager [-] Polling
> pollster disk.device.latency in the context of all_pollsters
> 2017-09-25 14:31:07.044 9048 ERROR ceilometer.agent.manager [-] Prevent
> pollster disk.device.latency from polling [,  mon-srg>, ] on source all_pollsters anymore!


I think this error maybe make some of measurement won't works at gnocchi,
and also some of gnocchi metric won't show the unit

[root@localhost ~]# gnocchi metric list |grep disk.device.iops
>
> +---+-+-+---++
> | id| archive_policy/name | name
>  | unit  | resource_id|
>
> +---+-+-+---++
>
>> | 0062d222-2874-4a19-be34-a5bee3051d21 | low |
>> disk.device.iops| None  |
>> 7b089e8e-5be7-599a-b279-15a8129f7bdd |
>
> | 3dc249e4-006d-47a3-935c-58e571ba086c | low |
>> disk.device.iops| None  |
>> 0efeccca-8313-5aec-a1e2-955e091419f9 |
>
> | c2c19329-1709-4165-bdea-3bcf81c5d9d4 | low |
>> disk.device.iops| None  |
>> 78aa9c1e-b199-551c-b295-fecb237639fc |
>
> | cfa1c4bf-591e-4229-bb76-7607fcba640e | low |
>> disk.device.iops| None  |
>> bdf98233-442b-5fe4-aa02-ba567e487dcc |
>
>

Any suggest about the last error of ceilometer-compute  ?

On Mon, Sep 25, 2017 at 1:02 PM, Jianghua Wang 
wrote:

> Adhi,
>
>   Do you still have this problem?
>
>   The following errors may be caused due to this xvda disk doesn’t exist.
> Did you see any issue from the nova?
>
> Rrd.Invalid_data_source(\\"vbd_xvda_read\\")")
>
>
>
> If you are still suffering from this issue, can you send me the following
> log files:
>
> 1.   Log files for the nova-compute and ceilometer services located
> in nova compute node.
>
> 2.   The /var/log/xensource.log from dom0 where the compute node is
> running on.
>
>
>
> And can you confirm the release version? From the title –
> [xenserver-ocata], it may be ocata. But by checking the code line from the
> log, it’s probably already in pike.
>
>
>
> Regards,
>
> Jianghua
>
>
>
> *From:* wjh_fresh [mailto:wjh_fr...@163.com]
> *Sent:* Monday, September 11, 2017 1:38 PM
> *To:* Jianghua Wang 
> *Subject:* Fw: [Openstack] [xenserver-ocata] ceilometer compute error
> Rrd_interface.Internal_error
>
>
>
> 发件人： Adhi Priharmanto 
>
> 发送日期： 2017年09月08日 21:56
>
> 收件人： openstack 
>
> 抄送人：
>
> 主题： [Openstack] [xenserver-ocata] ceilometer compute error
> Rrd_interface.Internal_error
>
> Hi all,
>
>
>
> I'm add ceilometer into my compute node, when I watch the ceilometer
> compute log , I found this error .
>
> 2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters [-] Could
> not get disk.device.write.requests.rate events for
> 59277f16-6ccf-4b5a-9204-c75c8a97dff7: ['INTERNAL_ERROR',
> 'Rrd_interface.Internal_error("Rrd.Invalid_data_source(\\"
> vbd_xvda_read\\")")']: Failure: ['INTERNAL_ERROR',
> 'Rrd_interface.Internal_error("Rrd.Invalid_data_source(\\"
> vbd_xvda_read\\")")']
> 2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters Traceback
> (most recent call last):
> 2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters   File
> 

[Openstack] FW: [xenserver-ocata] ceilometer compute error Rrd_interface.Internal_error

[Jianghua Wang]

Adhi,
  Do you still have this problem?
  The following errors may be caused due to this xvda disk doesn’t exist. Did 
you see any issue from the nova?

Rrd.Invalid_data_source(\\"vbd_xvda_read\\")")

If you are still suffering from this issue, can you send me the following log 
files:

1.   Log files for the nova-compute and ceilometer services located in nova 
compute node.

2.   The /var/log/xensource.log from dom0 where the compute node is running 
on.

And can you confirm the release version? From the title – [xenserver-ocata], it 
may be ocata. But by checking the code line from the log, it’s probably already 
in pike.

Regards,
Jianghua

From: wjh_fresh [mailto:wjh_fr...@163.com]
Sent: Monday, September 11, 2017 1:38 PM
To: Jianghua Wang 
Subject: Fw: [Openstack] [xenserver-ocata] ceilometer compute error 
Rrd_interface.Internal_error

发件人： Adhi Priharmanto
发送日期： 2017年09月08日 21:56
收件人： openstack
抄送人：
主题： [Openstack] [xenserver-ocata] ceilometer compute error 
Rrd_interface.Internal_error
Hi all,

I'm add ceilometer into my compute node, when I watch the ceilometer compute 
log , I found this error .
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters [-] Could not 
get disk.device.write.requests.rate events for 
59277f16-6ccf-4b5a-9204-c75c8a97dff7: ['INTERNAL_ERROR', 
'Rrd_interface.Internal_error("Rrd.Invalid_data_source(\\"vbd_xvda_read\\")")']:
 Failure: ['INTERNAL_ERROR', 
'Rrd_interface.Internal_error("Rrd.Invalid_data_source(\\"vbd_xvda_read\\")")']
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters Traceback 
(most recent call last):
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters   File 
"/usr/lib/python2.7/site-packages/ceilometer/compute/pollsters/__init__.py", 
line 136, in get_samples
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters cache, 
instance, self._inspection_duration)
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters   File 
"/usr/lib/python2.7/site-packages/ceilometer/compute/pollsters/__init__.py", 
line 100, in _inspect_cached
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters result = 
list(result)
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters   File 
"/usr/lib/python2.7/site-packages/ceilometer/compute/virt/xenapi/inspector.py", 
line 176, in inspect_disk_rates
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters vm_ref, 
"vbd_%s_read" % vbd_rec['device']))
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters   File 
"/usr/lib/python2.7/site-packages/os_xenapi/client/objects.py", line 64, in 

2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters return 
lambda *params: self._call_method(method_name, *params)
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters   File 
"/usr/lib/python2.7/site-packages/os_xenapi/client/objects.py", line 61, in 
_call_method
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters return 
self.session.call_xenapi(call, *args)
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters   File 
"/usr/lib/python2.7/site-packages/os_xenapi/client/session.py", line 200, in 
call_xenapi
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters return 
session.xenapi_request(method, args)
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters   File 
"/usr/lib/python2.7/site-packages/os_xenapi/client/XenAPI.py", line 130, in 
xenapi_request
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters result = 
_parse_result(getattr(self, methodname)(*full_params))
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters   File 
"/usr/lib/python2.7/site-packages/os_xenapi/client/XenAPI.py", line 212, in 
_parse_result
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters raise 
Failure(result['ErrorDescription'])
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters Failure: 
['INTERNAL_ERROR', 
'Rrd_interface.Internal_error("Rrd.Invalid_data_source(\\"vbd_xvda_read\\")")']
2017-09-08 20:21:59.214 14826 ERROR ceilometer.compute.pollsters

How to resolve this error ?

The second question, when I check gnocchi metric list, why most of metric have 
a none value in unit column ?

...
| 04df7669-0578-43b6-9e7f-d413e7def0e6 | low | memory.usage 
   | MB| 59277f16-6ccf-4b5a-9204-c75c8a97dff7 |
| 135bd162-fc03-4395-9e24-b4709c438808 | low | memory   
   | MB| 59277f16-6ccf-4b5a-9204-c75c8a97dff7 |
| 1bb63ed1-f1da-4300-9e86-2d6fb902ece6 | low | 
disk.read.requests  | None  | 
59277f16-6ccf-4b5a-9204-c75c8a97dff7 |
| 1c422d14-b254-46d8-b3b5-a78a5068592a | low | 
disk.read.requests.rate | None  | 
59277f16-6ccf-4b5a-9204-c75c8a97dff7 |
|