Re: [lustre-discuss] lustre-discuss Digest, Vol 182, Issue 12

[Ms. Megan Larko via lustre-discuss]

Hello Tahari,
What is the result of "lctl ping 10.0.1.70@tcp_0" from the box on which you
are trying to mount the Lustre File System?   Is the ping successful and
then fails after 03 seconds? If yes, you may wish to check the
/etc/lnet.conf file for Lustre LNet path "discovery"  (1 allows LNet
discovery while 0 does not), and drop_asym_route (0 disallows
asymmetrical routing while 1 permits it).   I have worked with a few
complex networks in which we chose to turn off LNet discovery and specify,
via /etc/lnet.conf, the routes.  On one system the asymmetrical routing (we
have 16 LNet boxes between the system and the Lustre storage) seemed to be
a problem, but we couldn't pin it to any particular box.  On that system
disallowing asymmetrical routing seemed to help maintain LNet/Lustre
connectivity.

One may check the lctl ping to narrow down net connectivity from other
possibilities.

Cheers,
megan

On Mon, May 17, 2021 at 3:50 PM 
wrote:

> Send lustre-discuss mailing list submissions to
> lustre-discuss@lists.lustre.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
> or, via email, send a message with subject or body 'help' to
> lustre-discuss-requ...@lists.lustre.org
>
> You can reach the person managing the list at
> lustre-discuss-ow...@lists.lustre.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of lustre-discuss digest..."
>
>
> Today's Topics:
>
>1. Re: problems to mount MDS and MDT (Abdeslam Tahari)
>2. Re: problems to mount MDS and MDT (Colin Faber)
>
>
> --
>
> Message: 1
> Date: Mon, 17 May 2021 21:35:34 +0200
> From: Abdeslam Tahari 
> To: Colin Faber 
> Cc: lustre-discuss 
> Subject: Re: [lustre-discuss] problems to mount MDS and MDT
> Message-ID:
>  bxecepen5dzzd+qxn...@mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Thank you Colin
>
> No i don't have iptables or rules
>
> firewalled is stopped selinux disabled as well
>  iptables -L
> Chain INPUT (policy ACCEPT)
> target prot opt source   destination
>
> Chain FORWARD (policy ACCEPT)
> target prot opt source   destination
>
> Chain OUTPUT (policy ACCEPT)
> target prot opt source   destination
>
>
> Regards
>
>
> Regards
>
> Le lun. 17 mai 2021 ? 21:29, Colin Faber  a ?crit :
>
> > Firewall rules dealing with localhost?
> >
> > On Mon, May 17, 2021 at 11:33 AM Abdeslam Tahari via lustre-discuss <
> > lustre-discuss@lists.lustre.org> wrote:
> >
> >> Hello
> >>
> >> i have a problem to mount the mds/mdt luster, it wont mount at all and
> >> there is no message errors at the console
> >>
> >> -it does not show errors or messages while mounting it
> >>
> >> here are some debug file logs
> >>
> >>
> >> i specify it is a new project that i am doing.
> >>
> >> the version and packages of luter installed:
> >> kmod-lustre-2.12.5-1.el7.x86_64
> >> kernel-devel-3.10.0-1127.8.2.el7_lustre.x86_64
> >> lustre-2.12.5-1.el7.x86_64
> >> lustre-resource-agents-2.12.5-1.el7.x86_64
> >> kernel-3.10.0-1160.2.1.el7_lustre.x86_64
> >> kernel-debuginfo-common-x86_64-3.10.0-1160.2.1.el7_lustre.x86_64
> >> kmod-lustre-osd-ldiskfs-2.12.5-1.el7.x86_64
> >> kernel-3.10.0-1127.8.2.el7_lustre.x86_64
> >> lustre-osd-ldiskfs-mount-2.12.5-1.el7.x86_64
> >>
> >>
> >>
> >> the system(os) Centos 7
> >>
> >> the kernel
> >> Linux lustre-mds1 3.10.0-1127.8.2.el7_lustre.x86_64
> >>  cat /etc/redhat-release
> >>
> >>
> >> when i mount the luster file-system it wont show up and no errors
> >>
> >> mount -t lustre /dev/sda /mds
> >>
> >> lctl dl  does not show up
> >>
> >> df -h   no mount point for /dev/sda
> >>
> >>
> >> lctl dl
> >>
> >> shows this:
> >> lctl dl
> >>   0 UP osd-ldiskfs lustre-MDT-osd lustre-MDT-osd_UUID 3
> >>   2 UP mgc MGC10.0.1.70@tcp 57e06c2d-5294-f034-fd95-460cee4f92b7 4
> >>   3 UP mds MDS MDS_uuid 2
> >>
> >>
> >> but unfortunately it disappears after 03 seconds
> >>
> >> lctl  dl shows nothing
> >>
> >> lctl dk
> >>
> >> shows this debug output
> >>
> >>
> >>
> 0020:0080:18.0:1621276062.004338:0:13403:0:(obd_config.c:1128:class_process_config())
> >> processing cmd: cf006
> >>
> 0020:0080:18.0:1621276062.004341:0:13403:0:(obd_config.c:1147:class_process_config())
> >> removing mappings for uuid MGC10.0.1.70@tcp_0
> >>
> 0020:0104:18.0:1621276062.004346:0:13403:0:(obd_mount.c:661:lustre_put_lsi())
> >> put 9bbbf91d5800 1
> >>
> 0020:0080:18.0:1621276062.004351:0:13403:0:(genops.c:1501:class_disconnect())
> >> disconnect: cookie 0x256dd92fc5bf929c
> >>
> 0020:0080:18.0:1621276062.004354:0:13403:0:(genops.c:1024:class_export_put())
> >> final put 9bbf3e66a400/lustre-MDT-osd_UUID
> >>
> 0020:0100:18.0:1621276062.004361:0:13403:0:(obd_config.c:2100:class_manual_cleanup())
> >> Manual cleanu

Re: [lustre-discuss] lustre-discuss Digest, Vol 182, Issue 12

[Abdeslam Tahari via lustre-discuss]

Hello Ms Megan

Thank you for the reply and your help

I have checked the lctl ping
it seems to be ok the result
 lctl ping 10.0.1.70
12345-0@lo
12345-10.0.1.70@tcp


the ping is good it is always ok .

the problem is when i mount the luster file system

mount -t lustre /dev/sda /mds

i have the following output
 lctl dl
  0 UP osd-ldiskfs lustre-MDT-osd lustre-MDT-osd_UUID 3
  2 UP mgc MGC10.0.1.70@tcp 3ec79ce9-5167-9661-9bd6-0b897fcc42f2 4
  3 UP mds MDS MDS_uuid 2


if i execute the command for the second time i will have no output at all
and the filesystem in reality is not mounted

i think but i am not sure it complains about the UUID of the MDT

from the output of the

lctl dk
0100:0008:78.0:1621365812.955564:0:84913:0:(pinger.c:413:ptlrpc_pinger_del_import())
removing pingable import
lustre-MDT-lwp-MDT_UUID->lustre-MDT_UUID
0100:0008:78.0:1621365812.955567:0:84913:0:(import.c:86:import_set_state_nolock())
9b985701b800 lustre-MDT_UUID: changing import state from DISCONN to
CLOSED
*0100:0008:78.0:1621365812.955571:0:84913:0:(import.c:157:ptlrpc_deactivate_import_nolock())
setting import lustre-MDT_UUID INVALID*
1000:0100:78.0:1621365812.965420:0:84913:0:(mgc_request.c:151:config_log_put())
dropping config log lustre-mdtir

Kind regards


Le mer. 19 mai 2021 à 03:15, Ms. Megan Larko via lustre-discuss <
lustre-discuss@lists.lustre.org> a écrit :

> Hello Tahari,
> What is the result of "lctl ping 10.0.1.70@tcp_0" from the box on which
> you are trying to mount the Lustre File System?   Is the ping successful
> and then fails after 03 seconds? If yes, you may wish to check the
> /etc/lnet.conf file for Lustre LNet path "discovery"  (1 allows LNet
> discovery while 0 does not), and drop_asym_route (0 disallows
> asymmetrical routing while 1 permits it).   I have worked with a few
> complex networks in which we chose to turn off LNet discovery and specify,
> via /etc/lnet.conf, the routes.  On one system the asymmetrical routing (we
> have 16 LNet boxes between the system and the Lustre storage) seemed to be
> a problem, but we couldn't pin it to any particular box.  On that system
> disallowing asymmetrical routing seemed to help maintain LNet/Lustre
> connectivity.
>
> One may check the lctl ping to narrow down net connectivity from other
> possibilities.
>
> Cheers,
> megan
>
> On Mon, May 17, 2021 at 3:50 PM 
> wrote:
>
>> Send lustre-discuss mailing list submissions to
>> lustre-discuss@lists.lustre.org
>>
>> To subscribe or unsubscribe via the World Wide Web, visit
>> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>> or, via email, send a message with subject or body 'help' to
>> lustre-discuss-requ...@lists.lustre.org
>>
>> You can reach the person managing the list at
>> lustre-discuss-ow...@lists.lustre.org
>>
>> When replying, please edit your Subject line so it is more specific
>> than "Re: Contents of lustre-discuss digest..."
>>
>>
>> Today's Topics:
>>
>>1. Re: problems to mount MDS and MDT (Abdeslam Tahari)
>>2. Re: problems to mount MDS and MDT (Colin Faber)
>>
>>
>> --
>>
>> Message: 1
>> Date: Mon, 17 May 2021 21:35:34 +0200
>> From: Abdeslam Tahari 
>> To: Colin Faber 
>> Cc: lustre-discuss 
>> Subject: Re: [lustre-discuss] problems to mount MDS and MDT
>> Message-ID:
>> > bxecepen5dzzd+qxn...@mail.gmail.com>
>> Content-Type: text/plain; charset="utf-8"
>>
>> Thank you Colin
>>
>> No i don't have iptables or rules
>>
>> firewalled is stopped selinux disabled as well
>>  iptables -L
>> Chain INPUT (policy ACCEPT)
>> target prot opt source   destination
>>
>> Chain FORWARD (policy ACCEPT)
>> target prot opt source   destination
>>
>> Chain OUTPUT (policy ACCEPT)
>> target prot opt source   destination
>>
>>
>> Regards
>>
>>
>> Regards
>>
>> Le lun. 17 mai 2021 ? 21:29, Colin Faber  a ?crit :
>>
>> > Firewall rules dealing with localhost?
>> >
>> > On Mon, May 17, 2021 at 11:33 AM Abdeslam Tahari via lustre-discuss <
>> > lustre-discuss@lists.lustre.org> wrote:
>> >
>> >> Hello
>> >>
>> >> i have a problem to mount the mds/mdt luster, it wont mount at all and
>> >> there is no message errors at the console
>> >>
>> >> -it does not show errors or messages while mounting it
>> >>
>> >> here are some debug file logs
>> >>
>> >>
>> >> i specify it is a new project that i am doing.
>> >>
>> >> the version and packages of luter installed:
>> >> kmod-lustre-2.12.5-1.el7.x86_64
>> >> kernel-devel-3.10.0-1127.8.2.el7_lustre.x86_64
>> >> lustre-2.12.5-1.el7.x86_64
>> >> lustre-resource-agents-2.12.5-1.el7.x86_64
>> >> kernel-3.10.0-1160.2.1.el7_lustre.x86_64
>> >> kernel-debuginfo-common-x86_64-3.10.0-1160.2.1.el7_lustre.x86_64
>> >> kmod-lustre-osd-ldiskfs-2.12.5-1.el7.x86_64
>> >> kernel-3.10.0-1127.8.2.el7_lustre.x86_64
>> >> lustre-osd-ldiskfs-mount-2.12.5

Re: [lustre-discuss] lustre-discuss Digest, Vol 182, Issue 12

[Abdeslam Tahari via lustre-discuss]

Hello Ms Megan



I am happy it is resolved


it was a problem of UUID


I will post later on the solution+ problem



Cheers

Le 19/05/2021 à 13:45, Abdeslam Tahari a écrit :

Hello Ms Megan

Thank you for the reply and your help

I have checked the lctl ping
it seems to be ok the result
 lctl ping 10.0.1.70
12345-0@lo
12345-10.0.1.70@tcp


the ping is good it is always ok .

the problem is when i mount the luster file system

mount -t lustre /dev/sda /mds

i have the following output
 lctl dl
  0 UP osd-ldiskfs lustre-MDT-osd lustre-MDT-osd_UUID 3
  2 UP mgc MGC10.0.1.70@tcp 3ec79ce9-5167-9661-9bd6-0b897fcc42f2 4
  3 UP mds MDS MDS_uuid 2


if i execute the command for the second time i will have no output at all
and the filesystem in reality is not mounted

i think but i am not sure it complains about the UUID of the MDT

from the output of the

lctl dk
0100:0008:78.0:1621365812.955564:0:84913:0:(pinger.c:413:ptlrpc_pinger_del_import()) 
removing pingable import 
lustre-MDT-lwp-MDT_UUID->lustre-MDT_UUID
0100:0008:78.0:1621365812.955567:0:84913:0:(import.c:86:import_set_state_nolock()) 
9b985701b800 lustre-MDT_UUID: changing import state from 
DISCONN to CLOSED
*0100:0008:78.0:1621365812.955571:0:84913:0:(import.c:157:ptlrpc_deactivate_import_nolock()) 
setting import lustre-MDT_UUID INVALID*
1000:0100:78.0:1621365812.965420:0:84913:0:(mgc_request.c:151:config_log_put()) 
dropping config log lustre-mdtir


Kind regards


Le mer. 19 mai 2021 à 03:15, Ms. Megan Larko via lustre-discuss 
> a écrit :


Hello Tahari,
What is the result of "lctl ping 10.0.1.70@tcp_0" from the box on
which you are trying to mount the Lustre File System?   Is the
ping successful and then fails after 03 seconds? If yes, you may
wish to check the /etc/lnet.conf file for Lustre LNet path
"discovery"  (1 allows LNet discovery while 0 does not), and
drop_asym_route (0 disallows asymmetrical routing while 1 permits
it).   I have worked with a few complex networks in which we chose
to turn off LNet discovery and specify, via /etc/lnet.conf, the
routes.  On one system the asymmetrical routing (we have 16 LNet
boxes between the system and the Lustre storage) seemed to be a
problem, but we couldn't pin it to any particular box.  On that
system disallowing asymmetrical routing seemed to help maintain
LNet/Lustre connectivity.

One may check the lctl ping to narrow down net connectivity from
other possibilities.

Cheers,
megan

On Mon, May 17, 2021 at 3:50 PM
mailto:lustre-discuss-requ...@lists.lustre.org>> wrote:

Send lustre-discuss mailing list submissions to
lustre-discuss@lists.lustre.org


To subscribe or unsubscribe via the World Wide Web, visit
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

or, via email, send a message with subject or body 'help' to
lustre-discuss-requ...@lists.lustre.org


You can reach the person managing the list at
lustre-discuss-ow...@lists.lustre.org


When replying, please edit your Subject line so it is more
specific
than "Re: Contents of lustre-discuss digest..."


Today's Topics:

   1. Re: problems to mount MDS and MDT (Abdeslam Tahari)
   2. Re: problems to mount MDS and MDT (Colin Faber)


--

Message: 1
Date: Mon, 17 May 2021 21:35:34 +0200
From: Abdeslam Tahari mailto:abes...@gmail.com>>
To: Colin Faber mailto:cfa...@gmail.com>>
Cc: lustre-discuss mailto:lustre-discuss@lists.lustre.org>>
Subject: Re: [lustre-discuss] problems to mount MDS and MDT
Message-ID:
       
mailto:bxecepen5dzzd%2bqxn...@mail.gmail.com>>
Content-Type: text/plain; charset="utf-8"

Thank you Colin

No i don't have iptables or rules

firewalled is stopped selinux disabled as well
 iptables -L
Chain INPUT (policy ACCEPT)
target     prot opt source               destination

Chain FORWARD (policy ACCEPT)
target     prot opt source               destination

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination


Regards


Regards

Le lun. 17 mai 2021 ? 21:29, Colin Faber mailto:cfa...@gmail.com>> a ?crit :

> Firewall rules dealing with localhost?
>
> On Mon, May 17, 2021 at 11:33 AM Abdeslam Tahari via
lustre-discuss <
> lustre-discuss@lists.lustre.org