Re: [lustre-discuss] Monitoring Lustre IOPS on OSTs

[Andreas Dilger via lustre-discuss]

Yes, each RPC will increment these stats counters by one. Traditional "IOPS" 
are measured with 4KB read or write, but in this case the IO sizes are variable.

Also, the client may aggregate multiple disjoint writes into a single RPC. This 
can be seen in the osd-ldiskfs.*.brw_stats as "discontiguous pages" so this 
might be considered multiple "IOs" in a single RPC.

Cheers, Andreas

On Jan 23, 2023, at 09:31, Passerini Marco  wrote:

I'd like to monitor the IOPS on the Lustre OSTs.


I have stats like this:


[root@xxx04 ~]# lctl get_param obdfilter.xxx-OST.stats
obdfilter.xxx-OST.stats=
snapshot_time 348287.096066602 secs.nsecs
start_time0.0 secs.nsecs
elapsed_time  348287.096066602 secs.nsecs
read_bytes3075 samples [bytes] 0 1134592 2891776 2568826650624
write_bytes   1312266 samples [bytes] 1 4194304 5424381521966 
4303559271585613940
read  3075 samples [usecs] 0 489 31040 3417458
write 1312266 samples [usecs] 1 1630262 6193336309 
3686004830368845
setattr   20373 samples [usecs] 1 61 133314 1090612
punch 4600 samples [usecs] 3 65 51155 732959
sync  4 samples [usecs] 443 997 2853 2250847
destroy   30777 samples [usecs] 11 42634 20978596 33571893182
create993 samples [usecs] 1 29995 534579 1518818913
statfs135519 samples [usecs] 0 24 610182 4231650
get_info  108 samples [usecs] 1 3092 6218 17971060
set_info  10047 samples [usecs] 1 22 83418 770166

From the docs https://wiki.lustre.org/Lustre_Monitoring_and_Statistics_Guide I 
see:

"""
For read_bytes and write_bytes:

First number = number of times (samples) the OST has handled a read or 
write.

"""


I guess this can be considered as OST IOPS?


Regards,

Marco Passerini

___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Lustre with ZFS Install

[Nick dan via lustre-discuss]

Hi

Thank you for your help. I have found out the keyutils package
While ./configure, the next error I am facing is

checking libmount/libmount.h usability... no
checking libmount/libmount.h presence... no
checking for libmount/libmount.h... no
checking whether to build with libmount... no
configure: error: libmount development package is required

I can not find the lib mount devel package in RedHat 8.6. Can you help with
this?

Regards,
Nick

On Tue, 24 Jan 2023 at 20:55, Laura Hild  wrote:

> Hi, Nick-
>
> keyutils-libs is not the devel package.  I think it is likely if you run
>
>   dnf search keyutils
>
> that you will find the package you need to install.
>
> -Laura
>
>
> 
> Od: lustre-discuss  v imenu Nick
> dan via lustre-discuss 
> Poslano: torek, 24. januar 2023 05:38
> Za: Degremont, Aurelien
> Kp: lustre-discuss@lists.lustre.org
> Zadeva: [EXTERNAL] Re: [lustre-discuss] Lustre with ZFS Install
>
> Hi
>
> I have already installed keyutils
> [root@sv01 lustre-release]# yum install keyutils-libs
> Updating Subscription Management repositories.
> Last metadata expiration check: 0:42:13 ago on Tue 24 Jan 2023 03:23:37 PM
> IST.
> Package keyutils-libs-1.5.10-9.el8.x86_64 is already installed.
> Dependencies resolved.
> Nothing to do.
> Complete!
>
> Tried to install with the command suggested by you
> Error: Unable to find a match: libkeyutils-devel
> FYI
> OS: Red Hat Enterprise Linux 8.6 (Ootpa)
>
> Regards,
> Nick
>
>
> On Tue, 24 Jan 2023 at 15:44, Degremont, Aurelien 
> wrote:
> > configure: WARNING: GSS keyring backend requires libkeyutils
>
> The configure command clearly says that libkeyutils should be installed.
> Did you try to install it?
>
> Under Rhel, this is probably: dnf install libkeyutils-devel
>
>
> Aurélien
>
> [...]
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Lustre with ZFS Install

[Laura Hild via lustre-discuss]

Hi, Nick-

keyutils-libs is not the devel package.  I think it is likely if you run

  dnf search keyutils

that you will find the package you need to install.

-Laura



Od: lustre-discuss  v imenu Nick dan 
via lustre-discuss 
Poslano: torek, 24. januar 2023 05:38
Za: Degremont, Aurelien
Kp: lustre-discuss@lists.lustre.org
Zadeva: [EXTERNAL] Re: [lustre-discuss] Lustre with ZFS Install

Hi

I have already installed keyutils
[root@sv01 lustre-release]# yum install keyutils-libs
Updating Subscription Management repositories.
Last metadata expiration check: 0:42:13 ago on Tue 24 Jan 2023 03:23:37 PM IST.
Package keyutils-libs-1.5.10-9.el8.x86_64 is already installed.
Dependencies resolved.
Nothing to do.
Complete!

Tried to install with the command suggested by you
Error: Unable to find a match: libkeyutils-devel
FYI
OS: Red Hat Enterprise Linux 8.6 (Ootpa)

Regards,
Nick


On Tue, 24 Jan 2023 at 15:44, Degremont, Aurelien  wrote:
> configure: WARNING: GSS keyring backend requires libkeyutils

The configure command clearly says that libkeyutils should be installed.
Did you try to install it?

Under Rhel, this is probably: dnf install libkeyutils-devel


Aurélien

[...]
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] ZFS rpm not getting install.

[Laura Hild via lustre-discuss]

Those dependencies are provided by the kmod-zfs package, which is not included 
in the same repository.  It looks like the oldest kmod-zfs provided by the 
OpenZFS project for EL8.6 is 2.1.4, which might work, but the straightforward 
thing to do is probably just to build a kmod-zfs-2.1.2 yourself following the 
instructions at

https://openzfs.github.io/openzfs-docs/Developer%20Resources/Custom%20Packages.html#kabi-tracking-kmod



Od: lustre-discuss  v imenu Nick dan 
via lustre-discuss 
Poslano: torek, 24. januar 2023 07:41
Za: lustre-discuss@lists.lustre.org; lustre-discuss-requ...@lists.lustre.org; 
lustre-discuss-ow...@lists.lustre.org
Zadeva: [EXTERNAL] [lustre-discuss] ZFS rpm not getting install.

Hi,
I'm trying to install kmod-lustre-osd-zfs-2.15.1-1.el8.x86_64.rpm but it is 
giving some dependency error of ksym.
Error attached below.
Can you please help?
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Lustre with ZFS Install

[Nick dan via lustre-discuss]

Hi

I have already installed keyutils
[root@sv01 lustre-release]# yum install keyutils-libs
Updating Subscription Management repositories.
Last metadata expiration check: 0:42:13 ago on Tue 24 Jan 2023 03:23:37 PM
IST.
Package keyutils-libs-1.5.10-9.el8.x86_64 is already installed.
Dependencies resolved.
Nothing to do.
Complete!

Tried to install with the command suggested by you
Error: Unable to find a match: libkeyutils-devel
FYI
OS: Red Hat Enterprise Linux 8.6 (Ootpa)

Regards,
Nick


On Tue, 24 Jan 2023 at 15:44, Degremont, Aurelien 
wrote:

> > configure: WARNING: GSS keyring backend requires libkeyutils
>
>
>
> The configure command clearly says that libkeyutils should be installed.
>
> Did you try to install it?
>
>
>
> Under Rhel, this is probably: dnf install libkeyutils-devel
>
>
>
>
>
> Aurélien
>
>
>
> *De : *Nick dan 
> *Date : *mardi 24 janvier 2023 à 10:41
> *À : *"Degremont, Aurelien" , "
> lustre-discuss@lists.lustre.org" , "
> lustre-discuss-requ...@lists.lustre.org" <
> lustre-discuss-requ...@lists.lustre.org>, "
> lustre-discuss-ow...@lists.lustre.org" <
> lustre-discuss-ow...@lists.lustre.org>
> *Objet : *RE: [EXTERNAL][lustre-discuss] Lustre with ZFS Install
>
>
>
> *CAUTION*: This email originated from outside of the organization. Do not
> click links or open attachments unless you can confirm the sender and know
> the content is safe.
>
>
>
> Hi
>
>
>
> I have attached the text file. I have got the following error on
> ./configure.
>
> configure: error: Cannot enable gss_keyring. See above for details.
>
>
>
> Can you help with this?
>
>
>
> On Tue, 24 Jan 2023 at 14:47, Degremont, Aurelien 
> wrote:
>
> Hi
>
>
>
> It looks like the ‘./configure’ command was not successful. Did you check
> it?
>
> Also, please copy/paste terminal output as text and not as a picture.
>
>
>
> Aurélien
>
>
>
> *De : *lustre-discuss  au nom de
> Nick dan via lustre-discuss 
> *Répondre à : *Nick dan 
> *Date : *mardi 24 janvier 2023 à 09:31
> *À : *"lustre-discuss@lists.lustre.org" ,
> "lustre-discuss-requ...@lists.lustre.org" <
> lustre-discuss-requ...@lists.lustre.org>, "
> lustre-discuss-ow...@lists.lustre.org" <
> lustre-discuss-ow...@lists.lustre.org>
> *Objet : *[EXTERNAL] [lustre-discuss] Lustre with ZFS Install
>
>
>
> *CAUTION*: This email originated from outside of the organization. Do not
> click links or open attachments unless you can confirm the sender and know
> the content is safe.
>
>
>
> Hi,
>
>
>
> We are trying to use ZFS with Lustre referring to the link:
>
> https://wiki.lustre.org/Lustre_with_ZFS_Install#Build_ZFS
>
>
>
> We are using the following steps to do so and getting error while making
> rpms.
>
>
>
> git clone git://git.whamcloud.com/fs/lustre-release.git
>
> cd lustre-release/
> sh ./autogen.sh
> ./configure --disable-ldiskfs
>
>
>
> make rpms (When we are doing make rpms, we are getting the following
> error) (Error attached in ss below)
>
> [root@sv01 lustre-release]# make rpms
> make: *** No rule to make target 'rpms'.  Stop.
>
>
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Lustre with ZFS Install

[Degremont, Aurelien via lustre-discuss]

> configure: WARNING: GSS keyring backend requires libkeyutils

The configure command clearly says that libkeyutils should be installed.
Did you try to install it?

Under Rhel, this is probably: dnf install libkeyutils-devel


Aurélien

De : Nick dan 
Date : mardi 24 janvier 2023 à 10:41
À : "Degremont, Aurelien" , 
"lustre-discuss@lists.lustre.org" , 
"lustre-discuss-requ...@lists.lustre.org" 
, 
"lustre-discuss-ow...@lists.lustre.org" 
Objet : RE: [EXTERNAL][lustre-discuss] Lustre with ZFS Install


CAUTION: This email originated from outside of the organization. Do not click 
links or open attachments unless you can confirm the sender and know the 
content is safe.


Hi

I have attached the text file. I have got the following error on ./configure.
configure: error: Cannot enable gss_keyring. See above for details.

Can you help with this?

On Tue, 24 Jan 2023 at 14:47, Degremont, Aurelien 
mailto:degre...@amazon.fr>> wrote:
Hi

It looks like the ‘./configure’ command was not successful. Did you check it?
Also, please copy/paste terminal output as text and not as a picture.

Aurélien

De : lustre-discuss 
mailto:lustre-discuss-boun...@lists.lustre.org>>
 au nom de Nick dan via lustre-discuss 
mailto:lustre-discuss@lists.lustre.org>>
Répondre à : Nick dan mailto:nickdan2...@gmail.com>>
Date : mardi 24 janvier 2023 à 09:31
À : "lustre-discuss@lists.lustre.org" 
mailto:lustre-discuss@lists.lustre.org>>, 
"lustre-discuss-requ...@lists.lustre.org"
 
mailto:lustre-discuss-requ...@lists.lustre.org>>,
 
"lustre-discuss-ow...@lists.lustre.org"
 
mailto:lustre-discuss-ow...@lists.lustre.org>>
Objet : [EXTERNAL] [lustre-discuss] Lustre with ZFS Install


CAUTION: This email originated from outside of the organization. Do not click 
links or open attachments unless you can confirm the sender and know the 
content is safe.


Hi,

We are trying to use ZFS with Lustre referring to the link:
https://wiki.lustre.org/Lustre_with_ZFS_Install#Build_ZFS

We are using the following steps to do so and getting error while making rpms.

git clone 
git://git.whamcloud.com/fs/lustre-release.git
cd lustre-release/
sh ./autogen.sh
./configure --disable-ldiskfs

make rpms (When we are doing make rpms, we are getting the following error) 
(Error attached in ss below)
[root@sv01 lustre-release]# make rpms
make: *** No rule to make target 'rpms'.  Stop.
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Lustre with ZFS Install

[Nick dan via lustre-discuss]

Hi

I have attached the text file. I have got the following error on
./configure.
configure: error: Cannot enable gss_keyring. See above for details.

Can you help with this?

On Tue, 24 Jan 2023 at 14:47, Degremont, Aurelien 
wrote:

> Hi
>
>
>
> It looks like the ‘./configure’ command was not successful. Did you check
> it?
>
> Also, please copy/paste terminal output as text and not as a picture.
>
>
>
> Aurélien
>
>
>
> *De : *lustre-discuss  au nom de
> Nick dan via lustre-discuss 
> *Répondre à : *Nick dan 
> *Date : *mardi 24 janvier 2023 à 09:31
> *À : *"lustre-discuss@lists.lustre.org" ,
> "lustre-discuss-requ...@lists.lustre.org" <
> lustre-discuss-requ...@lists.lustre.org>, "
> lustre-discuss-ow...@lists.lustre.org" <
> lustre-discuss-ow...@lists.lustre.org>
> *Objet : *[EXTERNAL] [lustre-discuss] Lustre with ZFS Install
>
>
>
> *CAUTION*: This email originated from outside of the organization. Do not
> click links or open attachments unless you can confirm the sender and know
> the content is safe.
>
>
>
> Hi,
>
>
>
> We are trying to use ZFS with Lustre referring to the link:
>
> https://wiki.lustre.org/Lustre_with_ZFS_Install#Build_ZFS
>
>
>
> We are using the following steps to do so and getting error while making
> rpms.
>
>
>
> git clone git://git.whamcloud.com/fs/lustre-release.git
>
> cd lustre-release/
> sh ./autogen.sh
> ./configure --disable-ldiskfs
>
>
>
> make rpms (When we are doing make rpms, we are getting the following
> error) (Error attached in ss below)
>
> [root@sv01 lustre-release]# make rpms
> make: *** No rule to make target 'rpms'.  Stop.
>
[root@sv01 lustre-release]# ./configure --disable-ldiskfs
configure: loading site script /usr/share/config.site
checking build system type... x86_64-pc-linux-gnu
checking host system type... x86_64-pc-linux-gnu
checking target system type... x86_64-pc-linux-gnu
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... /usr/bin/mkdir -p
checking for gawk... gawk
checking whether make sets $(MAKE)... yes
checking whether make supports nested variables... yes
checking how to create a pax tar archive... gnutar
checking whether to enable maintainer-specific portions of Makefiles... yes
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking whether gcc understands -c and -o together... yes
checking whether make supports the include directive... yes (GNU style)
checking dependency style of gcc... gcc3
checking how to print strings... printf
checking for a sed that does not truncate output... /usr/bin/sed
checking for grep that handles long lines and -e... /usr/bin/grep
checking for egrep... /usr/bin/grep -E
checking for fgrep... /usr/bin/grep -F
checking for ld used by gcc... /usr/bin/ld
checking if the linker (/usr/bin/ld) is GNU ld... yes
checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B
checking the name lister (/usr/bin/nm -B) interface... BSD nm
checking whether ln -s works... yes
checking the maximum length of command line arguments... 1572864
checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu 
format... func_convert_file_noop
checking how to convert x86_64-pc-linux-gnu file names to toolchain format... 
func_convert_file_noop
checking for /usr/bin/ld option to reload object files... -r
checking for objdump... objdump
checking how to recognize dependent libraries... pass_all
checking for dlltool... no
checking how to associate runtime and link libraries... printf %s\n
checking for ar... ar
checking for archiver @FILE support... @
checking for strip... strip
checking for ranlib... ranlib
checking command to parse /usr/bin/nm -B output from gcc object... ok
checking for sysroot... no
checking for a working dd... /usr/bin/dd
checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1
checking for mt... no
checking if : is a manifest tool... no
checking how to run the C preprocessor... gcc -E
checking for ANSI C header files... yes
checking for sys/types.h... yes
checking for sys/stat.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for memory.h... yes
checking for strings.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for unistd.h... yes
checking for dlfcn.h... yes
checking for objdir... .libs
checking if gcc supports -fno-rtti -fno-exceptions... no
checking for gcc option to produce PIC... -fPIC -DPIC
checking if gcc PIC flag -fPIC -DPIC works... yes
checking if gcc static flag -static works... no
checking if gcc supports -c -o file.o... yes
checking if gcc supports -c -o file.o... 

Re: [lustre-discuss] Lustre with ZFS Install

[Degremont, Aurelien via lustre-discuss]

Hi

It looks like the ‘./configure’ command was not successful. Did you check it?
Also, please copy/paste terminal output as text and not as a picture.

Aurélien

De : lustre-discuss  au nom de Nick 
dan via lustre-discuss 
Répondre à : Nick dan 
Date : mardi 24 janvier 2023 à 09:31
À : "lustre-discuss@lists.lustre.org" , 
"lustre-discuss-requ...@lists.lustre.org" 
, 
"lustre-discuss-ow...@lists.lustre.org" 
Objet : [EXTERNAL] [lustre-discuss] Lustre with ZFS Install


CAUTION: This email originated from outside of the organization. Do not click 
links or open attachments unless you can confirm the sender and know the 
content is safe.


Hi,

We are trying to use ZFS with Lustre referring to the link:
https://wiki.lustre.org/Lustre_with_ZFS_Install#Build_ZFS

We are using the following steps to do so and getting error while making rpms.

git clone 
git://git.whamcloud.com/fs/lustre-release.git
cd lustre-release/
sh ./autogen.sh
./configure --disable-ldiskfs

make rpms (When we are doing make rpms, we are getting the following error) 
(Error attached in ss below)
[root@sv01 lustre-release]# make rpms
make: *** No rule to make target 'rpms'.  Stop.
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

[lustre-discuss] Lustre with ZFS Install

[Nick dan via lustre-discuss]

Hi,

We are trying to use ZFS with Lustre referring to the link:
https://wiki.lustre.org/Lustre_with_ZFS_Install#Build_ZFS

We are using the following steps to do so and getting error while making
rpms.

git clone git://git.whamcloud.com/fs/lustre-release.git
cd lustre-release/
sh ./autogen.sh
./configure --disable-ldiskfs

make rpms (When we are doing make rpms, we are getting the following error)
(Error attached in ss below)
[root@sv01 lustre-release]# make rpms
make: *** No rule to make target 'rpms'.  Stop.
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

[lustre-discuss] Lustre with ZFS Install

[Nick dan via lustre-discuss]

Hi,

We are trying to use ZFS with Lustre referring to the link:
https://wiki.lustre.org/Lustre_with_ZFS_Install#Build_ZFS

We are using the following steps to do so and getting error while making
rpms.

git clone git://git.whamcloud.com/fs/lustre-release.git
cd lustre-release/
sh ./autogen.sh
./configure --disable-ldiskfs

make rpms (When we are doing make rpms, we are getting the following error)
[image: image.png]

Can you help with error?
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org