Hi Soumya,
Please find attached nfs.log file. Regards, Abhishek On Wed, May 4, 2016 at 11:45 AM, ABHISHEK PALIWAL <abhishpali...@gmail.com> wrote: > HI Soumya, > > Thanks for reply. > > Yes, I am getting following error in /var/log/glusterfs/nfs.log file > > [2016-04-25 06:27:23.721851] E [MSGID: 112109] [nfs.c:1482:init] 0-nfs: > Failed to initialize protocols > > Please suggest me how can I resolve it. > > Regards, > Abhishek > > On Wed, May 4, 2016 at 11:33 AM, Soumya Koduri <skod...@redhat.com> wrote: > >> Hi Abhishek, >> >> Below 'rpcinfo' output doesn't list 'nfsacl' protocol. That must be the >> reason client is not able set ACLs. Could you please check the log file >> '/var/lib/glusterfs/nfs.log' if there are any errors logged with respect >> protocol registration failures. >> >> Thanks, >> Soumya >> >> On 05/04/2016 11:15 AM, ABHISHEK PALIWAL wrote: >> >>> Hi Niels, >>> >>> Please reply it is really urgent. >>> >>> Regards, >>> Abhishek >>> >>> On Tue, May 3, 2016 at 11:36 AM, ABHISHEK PALIWAL >>> <abhishpali...@gmail.com <mailto:abhishpali...@gmail.com>> wrote: >>> >>> Hi Niels, >>> >>> Do you require more logs... >>> >>> Regards, >>> Abhishek >>> >>> On Mon, May 2, 2016 at 4:58 PM, ABHISHEK PALIWAL >>> <abhishpali...@gmail.com <mailto:abhishpali...@gmail.com>> wrote: >>> >>> Hi Niels, >>> >>> >>> Here is the output of rpcinfo -p $NFS_SERVER >>> >>> root@128:/# rpcinfo -p $NFS_SERVER >>> program vers proto port service >>> 100000 4 tcp 111 portmapper >>> 100000 3 tcp 111 portmapper >>> 100000 2 tcp 111 portmapper >>> 100000 4 udp 111 portmapper >>> 100000 3 udp 111 portmapper >>> 100000 2 udp 111 portmapper >>> 100005 3 tcp 38465 mountd >>> 100005 1 tcp 38465 mountd >>> 100003 3 tcp 38465 nfs >>> 100227 3 tcp 38465 >>> >>> >>> out of mount command >>> >>> #mount -vvv -t nfs -o acl,vers=3 128.224.95.140:/gv0 /tmp/e >>> mount: fstab path: "/etc/fstab" >>> mount: mtab path: "/etc/mtab" >>> mount: lock path: "/etc/mtab~" >>> mount: temp path: "/etc/mtab.tmp" >>> mount: UID: 0 >>> mount: eUID: 0 >>> mount: spec: "128.224.95.140:/gv0" >>> mount: node: "/tmp/e" >>> mount: types: "nfs" >>> mount: opts: "acl,vers=3" >>> mount: external mount: argv[0] = "/sbin/mount.nfs" >>> mount: external mount: argv[1] = "128.224.95.140:/gv0" >>> mount: external mount: argv[2] = "/tmp/e" >>> mount: external mount: argv[3] = "-v" >>> mount: external mount: argv[4] = "-o" >>> mount: external mount: argv[5] = "rw,acl,vers=3" >>> mount.nfs: timeout set for Mon May 2 16:58:58 2016 >>> mount.nfs: trying text-based options >>> 'acl,vers=3,addr=128.224.95.140' >>> mount.nfs: prog 100003, trying vers=3, prot=6 >>> mount.nfs: trying 128.224.95.140 prog 100003 vers 3 prot TCP >>> port 38465 >>> mount.nfs: prog 100005, trying vers=3, prot=17 >>> mount.nfs: portmap query retrying: RPC: Program not registered >>> mount.nfs: prog 100005, trying vers=3, prot=6 >>> mount.nfs: trying 128.224.95.140 prog 100005 vers 3 prot TCP >>> port 38465 >>> >>> >>> On Mon, May 2, 2016 at 4:36 PM, Niels de Vos <nde...@redhat.com >>> <mailto:nde...@redhat.com>> wrote: >>> >>> On Mon, May 02, 2016 at 04:14:01PM +0530, ABHISHEK PALIWAL >>> wrote: >>> > HI Team, >>> > >>> > I am exporting gluster volume using GlusterNFS with ACL >>> support but at NFS >>> > client while running 'setfacl' command getting "setfacl: >>> /tmp/e: Remote I/O >>> > error" >>> > >>> > >>> > Following is the NFS option status for Volume: >>> > >>> > nfs.enable-ino32 >>> > no >>> > nfs.mem-factor >>> > 15 >>> > nfs.export-dirs >>> > on >>> > nfs.export-volumes >>> > on >>> > nfs.addr-namelookup >>> > off >>> > nfs.dynamic-volumes >>> > off >>> > nfs.register-with-portmap >>> > on >>> > nfs.outstanding-rpc-limit >>> > 16 >>> > nfs.port >>> > 38465 >>> > nfs.rpc-auth-unix >>> > on >>> > nfs.rpc-auth-null >>> > on >>> > nfs.rpc-auth-allow >>> > all >>> > nfs.rpc-auth-reject >>> > none >>> > nfs.ports-insecure >>> > off >>> > nfs.trusted-sync >>> > off >>> > nfs.trusted-write >>> > off >>> > nfs.volume-access >>> > read-write >>> > nfs.export-dir >>> > >>> > nfs.disable >>> > off >>> > nfs.nlm >>> > on >>> > nfs.acl >>> > on >>> > nfs.mount-udp >>> > off >>> > nfs.mount-rmtab >>> > /var/lib/glusterd/nfs/rmtab >>> > nfs.rpc-statd >>> > /sbin/rpc.statd >>> > nfs.server-aux-gids >>> > off >>> > nfs.drc >>> > off >>> > nfs.drc-size >>> > 0x20000 >>> > nfs.read-size (1 * >>> > 1048576ULL) >>> > nfs.write-size (1 * >>> > 1048576ULL) >>> > nfs.readdir-size (1 * >>> > 1048576ULL) >>> > nfs.exports-auth-enable >>> > (null) >>> > nfs.auth-refresh-interval-sec >>> > (null) >>> > nfs.auth-cache-ttl-sec (null) >>> > >>> > Command to mount exported gluster volume on NFS client is >>> > >>> > mount -v -t nfs -o acl,vers=3 128.224.95.140:/gv0 /tmp/e >>> >>> Could you post the output of mounting with 'mount -vvv ...'? >>> In previous >>> emails I've asked for the output of 'rpcinfo -p >>> $NFS_SERVER', I do not >>> think I've seen that yet. >>> >>> The port used for NFSv3 ACLs on the NFS-server should be >>> listed in >>> 'netstat -tulpen' and the PID of the process should be the >>> one of the >>> Gluster/NFS service. >>> >>> HTH, >>> Niels >>> >>> >>> > setfacl -m u:nobody:r /tmp/e >>> > setfacl: /tmp/e: Remote I/O error >>> > >>> > -- >>> > >>> > >>> > >>> > >>> > Regards >>> > Abhishek Paliwal >>> >>> > _______________________________________________ >>> > Gluster-devel mailing list >>> > Gluster-devel@gluster.org <mailto: >>> Gluster-devel@gluster.org> >>> > http://www.gluster.org/mailman/listinfo/gluster-devel >>> >>> >>> >>> >>> -- >>> >>> >>> >>> >>> Regards >>> Abhishek Paliwal >>> >>> >>> >>> >>> -- >>> >>> >>> >>> >>> Regards >>> Abhishek Paliwal >>> >>> >>> >>> >>> -- >>> >>> >>> >>> >>> Regards >>> Abhishek Paliwal >>> >>> >>> _______________________________________________ >>> Gluster-users mailing list >>> gluster-us...@gluster.org >>> http://www.gluster.org/mailman/listinfo/gluster-users >>> >>> > > > -- > > > > > Regards > Abhishek Paliwal > -- Regards Abhishek Paliwal
[2016-04-25 06:27:23.569911] I [MSGID: 100030] [glusterfsd.c:2318:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.7.6 (args: /usr/sbin/glusterfs -s localhost --volfile-id gluster/nfs -p /var/lib/glusterd/nfs/run/nfs.pid -l /var/log/glusterfs/nfs.log -S /var/run/gluster/00912f6f44e8c281cafca6b46971bec1.socket) [2016-04-25 06:27:23.597806] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-04-25 06:27:23.690320] W [MSGID: 112100] [nfs.c:1078:nfs_init_state] 0-nfs: /sbin/rpc.statd not enough permissions to access. Disabling NLM [Operation not permitted] [2016-04-25 06:27:23.690388] W [MSGID: 112101] [nfs.c:1085:nfs_init_state] 0-nfs: /sbin/rpc.statd not a regular file. Disabling NLM [2016-04-25 06:27:23.691028] I [rpcsvc.c:2215:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 16 [2016-04-25 06:27:23.718994] W [MSGID: 112153] [mount3.c:3929:mnt3svc_init] 0-nfs-mount: Exports auth has been disabled! [2016-04-25 06:27:23.721788] E [rpcsvc.c:1370:rpcsvc_program_register_portmap] 0-rpc-service: Could not register with portmap 100005 3 38465 [2016-04-25 06:27:23.721817] E [MSGID: 112088] [nfs.c:341:nfs_init_versions] 0-nfs: Required program MOUNT3 registration failed [2016-04-25 06:27:23.721851] E [MSGID: 112109] [nfs.c:1482:init] 0-nfs: Failed to initialize protocols [2016-04-25 06:27:23.721877] E [MSGID: 101019] [xlator.c:428:xlator_init] 0-nfs-server: Initialization of volume 'nfs-server' failed, review your volfile again [2016-04-25 06:27:23.721903] E [graph.c:322:glusterfs_graph_init] 0-nfs-server: initializing translator failed [2016-04-25 06:27:23.721921] E [graph.c:661:glusterfs_graph_activate] 0-graph: init failed [2016-04-25 06:27:23.722785] W [glusterfsd.c:1236:cleanup_and_exit] (-->/usr/sbin/glusterfs(mgmt_getspec_cbk-0x15ce8) [0x1000fb58] -->/usr/sbin/glusterfs(glusterfs_process_volfp-0x1b1c8) [0x1000a318] -->/usr/sbin/glusterfs(cleanup_and_exit-0x1bd8c) [0x100096dc] ) 0-: received signum (0), shutting down [2016-04-25 06:28:43.079756] I [MSGID: 100030] [glusterfsd.c:2318:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.7.6 (args: /usr/sbin/glusterfs -s localhost --volfile-id gluster/nfs -p /var/lib/glusterd/nfs/run/nfs.pid -l /var/log/glusterfs/nfs.log -S /var/run/gluster/00912f6f44e8c281cafca6b46971bec1.socket) [2016-04-25 06:28:43.101003] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-04-25 06:28:43.112051] W [MSGID: 112100] [nfs.c:1078:nfs_init_state] 0-nfs: /sbin/rpc.statd not enough permissions to access. Disabling NLM [Operation not permitted] [2016-04-25 06:28:43.112116] W [MSGID: 112101] [nfs.c:1085:nfs_init_state] 0-nfs: /sbin/rpc.statd not a regular file. Disabling NLM [2016-04-25 06:28:43.112778] I [rpcsvc.c:2215:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 16 [2016-04-25 06:28:43.139539] W [MSGID: 112153] [mount3.c:3929:mnt3svc_init] 0-nfs-mount: Exports auth has been disabled! [2016-04-25 06:28:43.148721] I [rpc-drc.c:694:rpcsvc_drc_init] 0-rpc-service: DRC is turned OFF [2016-04-25 06:28:43.148766] I [MSGID: 112110] [nfs.c:1494:init] 0-nfs: NFS service started [2016-04-25 06:28:43.151544] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 [2016-04-25 06:28:43.152271] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'rpc-auth.auth-glusterfs' is not recognized [2016-04-25 06:28:43.152339] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'rpc-auth-allow-insecure' is not recognized [2016-04-25 06:28:43.152391] W [graph.c:357:_log_if_unknown_option] 0-nfs-server: option 'transport-type' is not recognized [2016-04-25 06:28:43.153750] I [MSGID: 114020] [client.c:2118:notify] 0-gv0-client-0: parent translators are ready, attempting connect on transport Final graph: +------------------------------------------------------------------------------+ 1: volume gv0-client-0 2: type protocol/client 3: option ping-timeout 42 4: option remote-host 128.224.95.140 5: option remote-subvolume /tmp/brick 6: option transport-type socket 7: option username 42205a53-c435-47ac-b141-7b440ab50551 8: option password 7effea8e-d115-4271-8050-1888682ee77e 9: option send-gids true 10: end-volume 11: 12: volume gv0-dht 13: type cluster/distribute [2016-04-25 06:28:43.155750] I [rpc-clnt.c:1847:rpc_clnt_reconfig] 0-gv0-client-0: changing port to 49152 (from 0) 14: subvolumes gv0-client-0 15: end-volume 16: 17: volume gv0-write-behind 18: type performance/write-behind 19: subvolumes gv0-dht 20: end-volume 21: 22: volume gv0 23: type debug/io-stats 24: option latency-measurement off 25: option count-fop-hits off 26: subvolumes gv0-write-behind 27: end-volume 28: 29: volume nfs-server 30: type nfs/server 31: option rpc-auth.auth-glusterfs on 32: option rpc-auth.auth-unix on 33: option rpc-auth.auth-null on 34: option rpc-auth.ports.insecure on 35: option rpc-auth-allow-insecure on 36: option transport-type socket 37: option transport.socket.listen-port 2049 38: option nfs.dynamic-volumes on 39: option nfs.nlm on 40: option nfs.drc off 41: option rpc-auth.addr.gv0.allow * 42: option nfs3.gv0.volume-id ab2592da-754a-41cb-9b04-0bc8592f1ab2 43: subvolumes gv0 44: end-volume 45: +------------------------------------------------------------------------------+ [2016-04-25 06:28:43.157424] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-gv0-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2016-04-25 06:28:43.165158] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-gv0-client-0: Connected to gv0-client-0, attached to remote volume '/tmp/brick'. [2016-04-25 06:28:43.165220] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-gv0-client-0: Server and Client lk-version numbers are not same, reopening the fds [2016-04-25 06:28:43.170061] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 0-gv0-client-0: Server lk version = 1 [2016-04-25 06:28:43.172523] I [MSGID: 109063] [dht-layout.c:702:dht_layout_normalize] 0-gv0-dht: Found anomalies in / (gfid = 00000000-0000-0000-0000-000000000001). Holes=1 overlaps=0 [2016-04-25 06:28:43.173630] I [MSGID: 109036] [dht-common.c:7869:dht_log_new_layout_for_dir_selfheal] 0-gv0-dht: Setting layout of / with [Subvol_name: gv0-client-0, Err: -1 , Start: 0 , Stop: 4294967295 , Hash: 1 ],
_______________________________________________ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
