Bug#889653: netdata: missing python module 'pyyaml2'

[Lennart Weller]

Alright. I already found the issue in the package. I must have accidentally 
removed the python.d patch which I had created previously thinking it was 
obsolete. I'll re-add it and update the package. That should fix it again so 
that the netdata python modules use the system pyyaml.



February 13, 2018 9:39 AM, "Thomas Leuxner"  wrote:

> * Guillaume Clercin  2018.02.12 13:05:
> 
>> Hi,
>> 
>> Finally, after copying "pyyam2" and "pyyaml3" from "python.d/python_modules"
>> from git repository of netdata to 
>> "/usr/lib/x86_64-linux-gnu/netdata/python.d/
>> python_modules". Netdata's python modules works.
> 
> ln -s /usr/lib/python3/dist-packages/yaml/ pyyaml3
> ln -s /usr/lib/python2.7/dist-packages/yaml/ pyyaml2
> 
> Does it for me. Since the packages are already installed elsewhere this is 
> more like a kludge.
> 
> Regards
> Thomas

Bug#889653: netdata: missing python module 'pyyaml2'

[Thomas Leuxner]

* Guillaume Clercin  2018.02.12 13:05:

> Hi,
> 
> Finally, after copying "pyyam2" and "pyyaml3" from "python.d/python_modules" 
> from git repository of netdata to "/usr/lib/x86_64-linux-gnu/netdata/python.d/
> python_modules". Netdata's python modules works.

ln -s /usr/lib/python3/dist-packages/yaml/ pyyaml3
ln -s /usr/lib/python2.7/dist-packages/yaml/ pyyaml2

Does it for me. Since the packages are already installed elsewhere this is more 
like a kludge.

Regards
Thomas


signature.asc
Description: PGP signature

Bug#889653: netdata: missing python module 'pyyaml2'

[Guillaume Clercin]

Hi,

Finally, after copying "pyyam2" and "pyyaml3" from "python.d/python_modules" 
from git repository of netdata to "/usr/lib/x86_64-linux-gnu/netdata/python.d/
python_modules". Netdata's python modules works.

Regards,

Le mercredi 7 février 2018, 12:13:51 CET Guillaume Clercin a écrit :
> With user netdata, if I want to test a python module, I run:
> netdata@kazoo:/usr/lib/x86_64-linux-gnu/netdata$ ./plugins.d/python.d.plugin
> 1 debug trace mdstat Traceback (most recent call last):
>   File "./plugins.d/python.d.plugin", line 31, in 
> from bases.loaders import ModuleAndConfigLoader
>   File
> "/usr/lib/x86_64-linux-gnu/netdata/python.d/python_modules/bases/loaders.py
> ", line 15, in  from pyyaml2 import SafeLoader as YamlSafeLoader
> ImportError: No module named pyyaml2
> 
> According the file
> "/usr/lib/x86_64-linux-gnu/netdata/python.d/python_modules/bases/loaders.py
> ", python2 module require pyyaml2 and python3 module require pyyaml3.
> 
> Import thing, I modified
> "/usr/lib/x86_64-linux-gnu/netdata/plugins.d/python.d.plugin" in order to
> fix the path of "PLUGIN_CONFIG_DIR".
> 
> Le mardi 6 février 2018, 17:41:24 CET Lennart Weller a écrit :
> > It does depend on pyyaml3.
> > 
> > Quote from your submitted bugreport:
> > > Versions of packages netdata depends on:
> > > ii  python3-yaml 3.12-1+b1
> > 
> > On 05/02/2018 11:53, Guillaume Clercin wrote:
> > > Package: netdata
> > > Version: 1.9.0+dfsg-1
> > > Severity: important
> > > 
> > > Dear Maintainer,
> > > 
> > > After upgrading netdata, no python modules were enabled. Python modules
> > > required pyyaml2 or (pyyaml3 maybe) in order to run. These packages
> > > should be provided by netdata. They are available here:
> > > https://github.com/firehol/netdata/tree/v1.9.0/python.d/python_modules
> > > 
> > > Please, package them into netdata packages.
> > > 
> > > 
> > > -- System Information:
> > > Debian Release: buster/sid
> > > 
> > >APT prefers testing
> > >APT policy: (500, 'testing'), (500, 'stable')
> > > 
> > > Architecture: amd64 (x86_64)
> > > 
> > > Kernel: Linux 4.14.0-3-amd64 (SMP w/4 CPU cores)
> > > Locale: LANG=fr_FR.UTF-8, LC_CTYPE=fr_FR.UTF-8 (charmap=UTF-8),
> > > LANGUAGE=
> > > (charmap=UTF-8) Shell: /bin/sh linked to /usr/bin/dash
> > > Init: systemd (via /run/systemd/system)
> > > 
> > > Versions of packages netdata depends on:
> > > ii  adduser  3.117
> > > ii  libc62.26-6
> > > ii  libcap2-bin  1:2.25-1.2
> > > ii  libuuid1 2.30.2-0.3
> > > ii  lsb-base 9.20170808
> > > ii  netdata-data 1.9.0+dfsg-1
> > > ii  python3  3.6.4-1
> > > ii  python3-urllib3  1.22-1
> > > ii  python3-yaml 3.12-1+b1
> > > ii  zlib1g   1:1.2.8.dfsg-5
> > > 
> > > Versions of packages netdata recommends:
> > > ii  curl7.58.0-2
> > > pn  fping   
> > > ii  nodejs  4.8.4~dfsg-1
> > > 
> > > netdata suggests no packages.
> > > 
> > > -- Configuration Files:
> > > /etc/netdata/health_alarm_notify.conf changed [not included]
> > > /etc/netdata/netdata.conf changed [not included]
> > > /etc/netdata/python.d/postgres.conf changed [not included]
> > > 
> > > -- no debconf information


-- 
Guillaume Clercin
Intellique
www.intellique.com
Tél: 01 78 94 84 06

signature.asc
Description: This is a digitally signed message part.

Bug#889653: netdata: missing python module 'pyyaml2'

[Thomas Leuxner]

* Guillaume Clercin  2018.02.07 12:13:

> netdata@kazoo:/usr/lib/x86_64-linux-gnu/netdata$ ./plugins.d/python.d.plugin 
> 1 debug trace mdstat
> Traceback (most recent call last):
>   File "./plugins.d/python.d.plugin", line 31, in 
> from bases.loaders import ModuleAndConfigLoader
>   File 
> "/usr/lib/x86_64-linux-gnu/netdata/python.d/python_modules/bases/loaders.py", 
> line 15, in 
> from pyyaml2 import SafeLoader as YamlSafeLoader
> ImportError: No module named pyyaml2
> 
> According the file 
> "/usr/lib/x86_64-linux-gnu/netdata/python.d/python_modules/bases/loaders.py",
> python2 module require pyyaml2 and python3 module require pyyaml3.
> 
> Import thing, I modified 
> "/usr/lib/x86_64-linux-gnu/netdata/plugins.d/python.d.plugin"
> in order to fix the path of "PLUGIN_CONFIG_DIR".

I can confirm the python plugins don't work for me either and I'm getting 
similar errors when calling the module manually. The suggested patch however 
doesn't change it for me...

Regards
Thomas


signature.asc
Description: PGP signature

Bug#889653: netdata: missing python module 'pyyaml2'

[Guillaume Clercin]

With user netdata, if I want to test a python module, I run:
netdata@kazoo:/usr/lib/x86_64-linux-gnu/netdata$ ./plugins.d/python.d.plugin 1 
debug trace mdstat
Traceback (most recent call last):
  File "./plugins.d/python.d.plugin", line 31, in 
from bases.loaders import ModuleAndConfigLoader
  File 
"/usr/lib/x86_64-linux-gnu/netdata/python.d/python_modules/bases/loaders.py", 
line 15, in 
from pyyaml2 import SafeLoader as YamlSafeLoader
ImportError: No module named pyyaml2

According the file 
"/usr/lib/x86_64-linux-gnu/netdata/python.d/python_modules/bases/loaders.py",
python2 module require pyyaml2 and python3 module require pyyaml3.

Import thing, I modified 
"/usr/lib/x86_64-linux-gnu/netdata/plugins.d/python.d.plugin"
in order to fix the path of "PLUGIN_CONFIG_DIR".

Le mardi 6 février 2018, 17:41:24 CET Lennart Weller a écrit :
> It does depend on pyyaml3.
> 
> Quote from your submitted bugreport:
> > Versions of packages netdata depends on:
> > ii  python3-yaml 3.12-1+b1
> 
> On 05/02/2018 11:53, Guillaume Clercin wrote:
> > Package: netdata
> > Version: 1.9.0+dfsg-1
> > Severity: important
> > 
> > Dear Maintainer,
> > 
> > After upgrading netdata, no python modules were enabled. Python modules
> > required pyyaml2 or (pyyaml3 maybe) in order to run. These packages
> > should be provided by netdata. They are available here:
> > https://github.com/firehol/netdata/tree/v1.9.0/python.d/python_modules
> > 
> > Please, package them into netdata packages.
> > 
> > 
> > -- System Information:
> > Debian Release: buster/sid
> > 
> >APT prefers testing
> >APT policy: (500, 'testing'), (500, 'stable')
> > 
> > Architecture: amd64 (x86_64)
> > 
> > Kernel: Linux 4.14.0-3-amd64 (SMP w/4 CPU cores)
> > Locale: LANG=fr_FR.UTF-8, LC_CTYPE=fr_FR.UTF-8 (charmap=UTF-8), LANGUAGE=
> > (charmap=UTF-8) Shell: /bin/sh linked to /usr/bin/dash
> > Init: systemd (via /run/systemd/system)
> > 
> > Versions of packages netdata depends on:
> > ii  adduser  3.117
> > ii  libc62.26-6
> > ii  libcap2-bin  1:2.25-1.2
> > ii  libuuid1 2.30.2-0.3
> > ii  lsb-base 9.20170808
> > ii  netdata-data 1.9.0+dfsg-1
> > ii  python3  3.6.4-1
> > ii  python3-urllib3  1.22-1
> > ii  python3-yaml 3.12-1+b1
> > ii  zlib1g   1:1.2.8.dfsg-5
> > 
> > Versions of packages netdata recommends:
> > ii  curl7.58.0-2
> > pn  fping   
> > ii  nodejs  4.8.4~dfsg-1
> > 
> > netdata suggests no packages.
> > 
> > -- Configuration Files:
> > /etc/netdata/health_alarm_notify.conf changed [not included]
> > /etc/netdata/netdata.conf changed [not included]
> > /etc/netdata/python.d/postgres.conf changed [not included]
> > 
> > -- no debconf information--- /usr/lib/x86_64-linux-gnu/netdata/plugins.d/python.d.plugin 2018-02-07 12:08:20.280526465 +0100
+++ /usr/lib/x86_64-linux-gnu/netdata/plugins.d/python.d.plugin 2018-01-27 22:30:16.630789251 +0100
@@ -21,7 +21,7 @@
 from time import time
 
 PY_VERSION = version_info[:2]
-PLUGIN_CONFIG_DIR = os.getenv('NETDATA_CONFIG_DIR', os.path.dirname(__file__) + '/../../../../etc/netdata') + '/'
+PLUGIN_CONFIG_DIR = os.getenv('NETDATA_CONFIG_DIR', os.path.dirname(__file__) + '/../../../../../etc/netdata') + '/'
 CHARTS_PY_DIR = os.path.abspath(os.getenv('NETDATA_PLUGINS_DIR', os.path.dirname(__file__)) + '/../python.d') + '/'
 CHARTS_PY_CONFIG_DIR = PLUGIN_CONFIG_DIR + 'python.d/'
 PYTHON_MODULES_DIR = CHARTS_PY_DIR + 'python_modules'


signature.asc
Description: This is a digitally signed message part.

Bug#889653: netdata: missing python module 'pyyaml2'

[Lennart Weller]

It does depend on pyyaml3.
Quote from your submitted bugreport:


Versions of packages netdata depends on:
ii  python3-yaml 3.12-1+b1



On 05/02/2018 11:53, Guillaume Clercin wrote:

Package: netdata
Version: 1.9.0+dfsg-1
Severity: important

Dear Maintainer,

After upgrading netdata, no python modules were enabled. Python modules
required pyyaml2 or (pyyaml3 maybe) in order to run. These packages
should be provided by netdata. They are available here:
https://github.com/firehol/netdata/tree/v1.9.0/python.d/python_modules

Please, package them into netdata packages.


-- System Information:
Debian Release: buster/sid
   APT prefers testing
   APT policy: (500, 'testing'), (500, 'stable')
Architecture: amd64 (x86_64)

Kernel: Linux 4.14.0-3-amd64 (SMP w/4 CPU cores)
Locale: LANG=fr_FR.UTF-8, LC_CTYPE=fr_FR.UTF-8 (charmap=UTF-8), LANGUAGE= 
(charmap=UTF-8)
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)

Versions of packages netdata depends on:
ii  adduser  3.117
ii  libc62.26-6
ii  libcap2-bin  1:2.25-1.2
ii  libuuid1 2.30.2-0.3
ii  lsb-base 9.20170808
ii  netdata-data 1.9.0+dfsg-1
ii  python3  3.6.4-1
ii  python3-urllib3  1.22-1
ii  python3-yaml 3.12-1+b1
ii  zlib1g   1:1.2.8.dfsg-5

Versions of packages netdata recommends:
ii  curl7.58.0-2
pn  fping   
ii  nodejs  4.8.4~dfsg-1

netdata suggests no packages.

-- Configuration Files:
/etc/netdata/health_alarm_notify.conf changed [not included]
/etc/netdata/netdata.conf changed [not included]
/etc/netdata/python.d/postgres.conf changed [not included]

-- no debconf information

Bug#889653: netdata: missing python module 'pyyaml2'

[Guillaume Clercin]

Package: netdata
Version: 1.9.0+dfsg-1
Severity: important

Dear Maintainer,

After upgrading netdata, no python modules were enabled. Python modules
required pyyaml2 or (pyyaml3 maybe) in order to run. These packages
should be provided by netdata. They are available here:
https://github.com/firehol/netdata/tree/v1.9.0/python.d/python_modules

Please, package them into netdata packages.


-- System Information:
Debian Release: buster/sid
  APT prefers testing
  APT policy: (500, 'testing'), (500, 'stable')
Architecture: amd64 (x86_64)

Kernel: Linux 4.14.0-3-amd64 (SMP w/4 CPU cores)
Locale: LANG=fr_FR.UTF-8, LC_CTYPE=fr_FR.UTF-8 (charmap=UTF-8), LANGUAGE= 
(charmap=UTF-8)
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)

Versions of packages netdata depends on:
ii  adduser  3.117
ii  libc62.26-6
ii  libcap2-bin  1:2.25-1.2
ii  libuuid1 2.30.2-0.3
ii  lsb-base 9.20170808
ii  netdata-data 1.9.0+dfsg-1
ii  python3  3.6.4-1
ii  python3-urllib3  1.22-1
ii  python3-yaml 3.12-1+b1
ii  zlib1g   1:1.2.8.dfsg-5

Versions of packages netdata recommends:
ii  curl7.58.0-2
pn  fping   
ii  nodejs  4.8.4~dfsg-1

netdata suggests no packages.

-- Configuration Files:
/etc/netdata/health_alarm_notify.conf changed [not included]
/etc/netdata/netdata.conf changed [not included]
/etc/netdata/python.d/postgres.conf changed [not included]

-- no debconf information