Re: [lustre-discuss] osc and llite stats files are not exported to clients
Hi Thank you very much for your reply. I looked in the /sys but also did not find the osc/*/stats or llite/*/stats files. I understand what you are saying about the lctl becoming the new standard way. But I just want to make sure that this is not due to sth. wrong with my system or setup. FYI, I am using CentOS 7.6 kernel 3.10.0-957.el7.x86_64 and *_lustre* for my clients and lustre servers with Lustre version 2.12.0 using IB FDR as the LNET. Would the missing stats files in /sys/fs/lustre or /proc/fs/lustre considered normal? Any monitoring tool you would suggest to use instead of lustre gmond_python_modules in order to avoid reading stats files? My initial review of LMT3 also indicate that it too reading data from stats file rather than using lctl. Cheers, Utane --- Utane Sawangwit, PhD. Research Astronomer National Astronomical Research Institute of Thailand (NARIT) Sirindhon AstroPark, 260, Mue 4, Donkaew Mae-Rim, Chiang Mai, 50180, Thailand ดร. อุเทน แสวงวิทย์ นักวิจัยชำนาญการ สถาบันวิจัยดาราศาสตร์แห่งชาติ(องค์การมหาชน) อุทยานดาราศาสตร์สิรินธร 260 หมู่ 4 ต.ดอนแก้ว อ.แม่ริม จ.เชียงใหม่ 50180 --- On Thu, 25 Jul 2019 at 22:05, Degremont, Aurelien wrote: > Lustre is transitionning /proc files to /sys per kernel developer requests. > > > > Instead of chasing where these files are located now depending on your > Lustre version, 'lctl get_param' is the official way to read them. > > This command will figure out where to properly read the files. > > > > *De : *lustre-discuss au nom de > U Sawangwit > *Date : *jeudi 25 juillet 2019 à 13:15 > *À : *"lustre-discuss@lists.lustre.org" > *Objet : *[lustre-discuss] osc and llite stats files are not exported to > clients > > > > Dear all, > > > >I am having trouble with lustre monitoring using Ganglia > gmond_python_modules > > (https://github.com/ganglia/gmond_python_modules/tree/master/lustre). > > > > Upon closer inspections, I found that the stats files in > /proc/fs/lustre/osc/*/ > > and /proc/fs/lustre/llite are missing (among other similar files in these > directories). > > > > However, lctl get_param osc.*.stats and lctl get_param llite.*.stats > return > > parameters and values as you would expect. The stats files are what the > > gmond_python_modules wants hence the problem monitoring with Ganglia. > > > > After many searching around, could not figure out what I could have > done to > > have stats export normally to clients and remounting did not help. On MDS > and OSS, > > I can see the obdfiler/*/export/*/stats or mdt/*/export/*/stats > > > > The lustre manual also said that the exporting of these info to client > should be by > > default. > > > > Thank you in advance. > > > > Cheers, > > Utane > > > > > --- > Utane Sawangwit, PhD. > Research Astronomer > National Astronomical Research Institute of Thailand (NARIT) > Sirindhon AstroPark, 260, Mue 4, Donkaew > > Mae-Rim, Chiang Mai, 50180, Thailand > > > > ดร. อุเทน แสวงวิทย์ > นักวิจัยชำนาญการ > สถาบันวิจัยดาราศาสตร์แห่งชาติ(องค์การมหาชน) > อุทยานดาราศาสตร์สิรินธร 260 หมู่ 4 ต.ดอนแก้ว > > อ.แม่ริม จ.เชียงใหม่ 50180 > > > --- > > > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] zfs mounting
On 25/07/2019 11:49, BASDEN, ALASTAIR G. wrote: Hi, I am trying to bring up a new zfs backend file system. CentOS 7.4, Lustre 2.10.3, zfs 0.7.12. I do the following: zpool create -O canmount=off -o cachefile=none test-ost0 raidz2 mkfs.lustre --fsname=test --ost --backfstype=zfs --index=0 --mgsnode=nid1 test-ost0/ost0 This seems to work. However, I can't work out how to mount: mount -t lustre test-ost0/ost0 /mnt/lustre/test-ost0 mount.lustre: mount test-ost0/ost0 at /mnt/lustre/test-ost0 failed: No such device Are the lustre modules loaded? Check /etc/modprobe.conf and /proc/filesystems tail /var/log/messages: Jul 25 15:46:12 oss01 kernel: LustreError: 158-c: Can't load module 'osd-zfs' Did you install the ZFS version of lustre RPM? Jul 25 15:46:12 oss01 kernel: LustreError: 216602:0:(genops.c:318:class_newdev()) OBD: unknown type: osd-zfs Jul 25 15:46:12 oss01 kernel: LustreError: 216602:0:(obd_config.c:402:class_attach()) Cannot create device test-OST-osd of type osd-zfs : -19 Jul 25 15:46:12 oss01 kernel: LustreError: 216602:0:(obd_mount.c:198:lustre_start_simple()) test-OST-osd attach error -19 Jul 25 15:46:12 oss01 kernel: LustreError: 216602:0:(obd_mount_server.c:1832:server_fill_super()) Unable to start osd on test-ost0/ost0: -19 Jul 25 15:46:12 oss01 kernel: LustreError: 216602:0:(obd_mount.c:1506:lustre_fill_super()) Unable to mount (-19) Is that the correct mount command? (I've tried a few others too). Is the problem a version incompatibility between lustre and zfs? Many thanks, Alastair. ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] osc and llite stats files are not exported to clients
Lustre is transitionning /proc files to /sys per kernel developer requests. Instead of chasing where these files are located now depending on your Lustre version, 'lctl get_param' is the official way to read them. This command will figure out where to properly read the files. De : lustre-discuss au nom de U Sawangwit Date : jeudi 25 juillet 2019 à 13:15 À : "lustre-discuss@lists.lustre.org" Objet : [lustre-discuss] osc and llite stats files are not exported to clients Dear all, I am having trouble with lustre monitoring using Ganglia gmond_python_modules (https://github.com/ganglia/gmond_python_modules/tree/master/lustre). Upon closer inspections, I found that the stats files in /proc/fs/lustre/osc/*/ and /proc/fs/lustre/llite are missing (among other similar files in these directories). However, lctl get_param osc.*.stats and lctl get_param llite.*.stats return parameters and values as you would expect. The stats files are what the gmond_python_modules wants hence the problem monitoring with Ganglia. After many searching around, could not figure out what I could have done to have stats export normally to clients and remounting did not help. On MDS and OSS, I can see the obdfiler/*/export/*/stats or mdt/*/export/*/stats The lustre manual also said that the exporting of these info to client should be by default. Thank you in advance. Cheers, Utane --- Utane Sawangwit, PhD. Research Astronomer National Astronomical Research Institute of Thailand (NARIT) Sirindhon AstroPark, 260, Mue 4, Donkaew Mae-Rim, Chiang Mai, 50180, Thailand ดร. อุเทน แสวงวิทย์ นักวิจัยชำนาญการ สถาบันวิจัยดาราศาสตร์แห่งชาติ(องค์การมหาชน) อุทยานดาราศาสตร์สิรินธร 260 หมู่ 4 ต.ดอนแก้ว อ.แม่ริม จ.เชียงใหม่ 50180 --- ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] zfs mounting
Hi, I am trying to bring up a new zfs backend file system. CentOS 7.4, Lustre 2.10.3, zfs 0.7.12. I do the following: zpool create -O canmount=off -o cachefile=none test-ost0 raidz2 mkfs.lustre --fsname=test --ost --backfstype=zfs --index=0 --mgsnode=nid1 test-ost0/ost0 This seems to work. However, I can't work out how to mount: mount -t lustre test-ost0/ost0 /mnt/lustre/test-ost0 mount.lustre: mount test-ost0/ost0 at /mnt/lustre/test-ost0 failed: No such device Are the lustre modules loaded? Check /etc/modprobe.conf and /proc/filesystems tail /var/log/messages: Jul 25 15:46:12 oss01 kernel: LustreError: 158-c: Can't load module 'osd-zfs' Jul 25 15:46:12 oss01 kernel: LustreError: 216602:0:(genops.c:318:class_newdev()) OBD: unknown type: osd-zfs Jul 25 15:46:12 oss01 kernel: LustreError: 216602:0:(obd_config.c:402:class_attach()) Cannot create device test-OST-osd of type osd-zfs : -19 Jul 25 15:46:12 oss01 kernel: LustreError: 216602:0:(obd_mount.c:198:lustre_start_simple()) test-OST-osd attach error -19 Jul 25 15:46:12 oss01 kernel: LustreError: 216602:0:(obd_mount_server.c:1832:server_fill_super()) Unable to start osd on test-ost0/ost0: -19 Jul 25 15:46:12 oss01 kernel: LustreError: 216602:0:(obd_mount.c:1506:lustre_fill_super()) Unable to mount (-19) Is that the correct mount command? (I've tried a few others too). Is the problem a version incompatibility between lustre and zfs? Many thanks, Alastair. ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] osc and llite stats files are not exported to clients
Dear all, I am having trouble with lustre monitoring using Ganglia gmond_python_modules (https://github.com/ganglia/gmond_python_modules/tree/master/lustre). Upon closer inspections, I found that the stats files in /proc/fs/lustre/osc/*/ and /proc/fs/lustre/llite are missing (among other similar files in these directories). However, lctl get_param osc.*.stats and lctl get_param llite.*.stats return parameters and values as you would expect. The stats files are what the gmond_python_modules wants hence the problem monitoring with Ganglia. After many searching around, could not figure out what I could have done to have stats export normally to clients and remounting did not help. On MDS and OSS, I can see the obdfiler/*/export/*/stats or mdt/*/export/*/stats The lustre manual also said that the exporting of these info to client should be by default. Thank you in advance. Cheers, Utane --- Utane Sawangwit, PhD. Research Astronomer National Astronomical Research Institute of Thailand (NARIT) Sirindhon AstroPark, 260, Mue 4, Donkaew Mae-Rim, Chiang Mai, 50180, Thailand ดร. อุเทน แสวงวิทย์ นักวิจัยชำนาญการ สถาบันวิจัยดาราศาสตร์แห่งชาติ(องค์การมหาชน) อุทยานดาราศาสตร์สิรินธร 260 หมู่ 4 ต.ดอนแก้ว อ.แม่ริม จ.เชียงใหม่ 50180 --- ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org