Re: [Gluster-devel] [Gluster-users] Input/Output Error on Gluster NFS
Yes ran gluster volume info and didnt grep any nfs.acl meaing it should be ON by default as we did not disable them. Peter > On Feb 5, 2015, at 11:02 PM, Soumya Koduri wrote: > > > >> On 02/05/2015 11:32 PM, Peter Auyeung wrote: >> Hi Soumya >> >> root@glusterprod001:~# gluster volume info | grep nfs.acl >> 02/05/15 10:00:05 [ /root ] >> >> Seems like we do not have ACL enabled. >> >> nfs client is a RHEL4 standard NFS client > > Oh by default ACLs are enabled. It seem to be shown in 'gluster volume info' > only if we explicitly modify its value to ON/OFF. > > Can you please verify if the filesystem where your Gluster bricks have been > created has been mounted with ACLs enabled. > > Thanks, > Soumya > >> >> Thanks >> -Peter >> >> From: Soumya Koduri [skod...@redhat.com] >> Sent: Wednesday, February 04, 2015 11:28 PM >> To: Peter Auyeung; gluster-us...@gluster.org; gluster-devel@gluster.org >> Subject: Re: [Gluster-devel] [Gluster-users] Input/Output Error on Gluster >> NFS >> >> Hi Peter, >> >> Have you disabled Gluster-NFS ACLs . >> >> Please check the option value - >> #gluster v info | grep nfs.acl >> nfs.acl: ON >> >> Also please provide the details of the nfs-client you are using. >> Typically, nfs-clients seem to issue getxattr before doing >> setxattr/removexattr operations and return 'ENOTSUPP' incase of ACLs >> disabled. But from the strace, looks like the client has issued >> 'removexattr' of 'system.posix_acl_default' which returned EIO. >> >> Anyways, 'removexattr' should also have returned EOPNOTSUPP instead of EIO. >> >> Thanks, >> Soumya >> >>> On 02/05/2015 02:31 AM, Peter Auyeung wrote: >>> I was trying to copy a directory of files to Gluster via NFS and getting >>> permission denied with Input/Output error >>> >>> ---> r...@bizratedbstandby.bo2.shopzilla.sea (0.00)# cp -pr db /mnt/ >>> cp: setting permissions for >>> `/mnt/db/full/pr_bizrate_standby_SMLS.F02-01-22-35.d': Input/output error >>> cp: setting permissions for >>> `/mnt/db/full/pr_bizrate_standby_logging.F02-02-18-10.b': Input/output error >>> cp: setting permissions for `/mnt/db/full/pr_bizrate_SMLS.F02-01-22-35.d': >>> Input/output error >>> cp: setting permissions for >>> `/mnt/db/full/pr_bizrate_standby_master.F02-02-22-00': Input/output error >>> cp: setting permissions for `/mnt/db/full': Input/output error >>> cp: setting permissions for `/mnt/db': Input/output error >>> >>> Checked gluster nfs.log and etc log and bricks looks clean. >>> The files ends up able to copy over with right permission. >>> >>> Stack trace the copy and seems like it failed on removexattr >>> >>> removexattr("/mnt/db", "system.posix_acl_default"...) = -1 EIO >>> (Input/output error) >>> >>> http://pastie.org/9884810 >>> >>> Any Clue? >>> >>> Thanks >>> Peter >>> >>> >>> >>> >>> >>> >>> >>> ___ >>> Gluster-devel mailing list >>> Gluster-devel@gluster.org >>> http://www.gluster.org/mailman/listinfo/gluster-devel >>> ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] [Gluster-users] Input/Output Error on Gluster NFS
On 02/05/2015 11:32 PM, Peter Auyeung wrote: Hi Soumya root@glusterprod001:~# gluster volume info | grep nfs.acl 02/05/15 10:00:05 [ /root ] Seems like we do not have ACL enabled. nfs client is a RHEL4 standard NFS client Oh by default ACLs are enabled. It seem to be shown in 'gluster volume info' only if we explicitly modify its value to ON/OFF. Can you please verify if the filesystem where your Gluster bricks have been created has been mounted with ACLs enabled. Thanks, Soumya Thanks -Peter From: Soumya Koduri [skod...@redhat.com] Sent: Wednesday, February 04, 2015 11:28 PM To: Peter Auyeung; gluster-us...@gluster.org; gluster-devel@gluster.org Subject: Re: [Gluster-devel] [Gluster-users] Input/Output Error on Gluster NFS Hi Peter, Have you disabled Gluster-NFS ACLs . Please check the option value - #gluster v info | grep nfs.acl nfs.acl: ON Also please provide the details of the nfs-client you are using. Typically, nfs-clients seem to issue getxattr before doing setxattr/removexattr operations and return 'ENOTSUPP' incase of ACLs disabled. But from the strace, looks like the client has issued 'removexattr' of 'system.posix_acl_default' which returned EIO. Anyways, 'removexattr' should also have returned EOPNOTSUPP instead of EIO. Thanks, Soumya On 02/05/2015 02:31 AM, Peter Auyeung wrote: I was trying to copy a directory of files to Gluster via NFS and getting permission denied with Input/Output error ---> r...@bizratedbstandby.bo2.shopzilla.sea (0.00)# cp -pr db /mnt/ cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_SMLS.F02-01-22-35.d': Input/output error cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_logging.F02-02-18-10.b': Input/output error cp: setting permissions for `/mnt/db/full/pr_bizrate_SMLS.F02-01-22-35.d': Input/output error cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_master.F02-02-22-00': Input/output error cp: setting permissions for `/mnt/db/full': Input/output error cp: setting permissions for `/mnt/db': Input/output error Checked gluster nfs.log and etc log and bricks looks clean. The files ends up able to copy over with right permission. Stack trace the copy and seems like it failed on removexattr removexattr("/mnt/db", "system.posix_acl_default"...) = -1 EIO (Input/output error) http://pastie.org/9884810 Any Clue? Thanks Peter ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] [Gluster-users] Input/Output Error on Gluster NFS
Hi Soumya root@glusterprod001:~# gluster volume info | grep nfs.acl 02/05/15 10:00:05 [ /root ] Seems like we do not have ACL enabled. nfs client is a RHEL4 standard NFS client Thanks -Peter From: Soumya Koduri [skod...@redhat.com] Sent: Wednesday, February 04, 2015 11:28 PM To: Peter Auyeung; gluster-us...@gluster.org; gluster-devel@gluster.org Subject: Re: [Gluster-devel] [Gluster-users] Input/Output Error on Gluster NFS Hi Peter, Have you disabled Gluster-NFS ACLs . Please check the option value - #gluster v info | grep nfs.acl nfs.acl: ON Also please provide the details of the nfs-client you are using. Typically, nfs-clients seem to issue getxattr before doing setxattr/removexattr operations and return 'ENOTSUPP' incase of ACLs disabled. But from the strace, looks like the client has issued 'removexattr' of 'system.posix_acl_default' which returned EIO. Anyways, 'removexattr' should also have returned EOPNOTSUPP instead of EIO. Thanks, Soumya On 02/05/2015 02:31 AM, Peter Auyeung wrote: > I was trying to copy a directory of files to Gluster via NFS and getting > permission denied with Input/Output error > > ---> r...@bizratedbstandby.bo2.shopzilla.sea (0.00)# cp -pr db /mnt/ > cp: setting permissions for > `/mnt/db/full/pr_bizrate_standby_SMLS.F02-01-22-35.d': Input/output error > cp: setting permissions for > `/mnt/db/full/pr_bizrate_standby_logging.F02-02-18-10.b': Input/output error > cp: setting permissions for `/mnt/db/full/pr_bizrate_SMLS.F02-01-22-35.d': > Input/output error > cp: setting permissions for > `/mnt/db/full/pr_bizrate_standby_master.F02-02-22-00': Input/output error > cp: setting permissions for `/mnt/db/full': Input/output error > cp: setting permissions for `/mnt/db': Input/output error > > Checked gluster nfs.log and etc log and bricks looks clean. > The files ends up able to copy over with right permission. > > Stack trace the copy and seems like it failed on removexattr > > removexattr("/mnt/db", "system.posix_acl_default"...) = -1 EIO (Input/output > error) > > http://pastie.org/9884810 > > Any Clue? > > Thanks > Peter > > > > > > > > ___ > Gluster-devel mailing list > Gluster-devel@gluster.org > http://www.gluster.org/mailman/listinfo/gluster-devel > ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] [Gluster-users] Input/Output Error on Gluster NFS
Hi Peter, Have you disabled Gluster-NFS ACLs . Please check the option value - #gluster v info | grep nfs.acl nfs.acl: ON Also please provide the details of the nfs-client you are using. Typically, nfs-clients seem to issue getxattr before doing setxattr/removexattr operations and return 'ENOTSUPP' incase of ACLs disabled. But from the strace, looks like the client has issued 'removexattr' of 'system.posix_acl_default' which returned EIO. Anyways, 'removexattr' should also have returned EOPNOTSUPP instead of EIO. Thanks, Soumya On 02/05/2015 02:31 AM, Peter Auyeung wrote: I was trying to copy a directory of files to Gluster via NFS and getting permission denied with Input/Output error ---> r...@bizratedbstandby.bo2.shopzilla.sea (0.00)# cp -pr db /mnt/ cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_SMLS.F02-01-22-35.d': Input/output error cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_logging.F02-02-18-10.b': Input/output error cp: setting permissions for `/mnt/db/full/pr_bizrate_SMLS.F02-01-22-35.d': Input/output error cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_master.F02-02-22-00': Input/output error cp: setting permissions for `/mnt/db/full': Input/output error cp: setting permissions for `/mnt/db': Input/output error Checked gluster nfs.log and etc log and bricks looks clean. The files ends up able to copy over with right permission. Stack trace the copy and seems like it failed on removexattr removexattr("/mnt/db", "system.posix_acl_default"...) = -1 EIO (Input/output error) http://pastie.org/9884810 Any Clue? Thanks Peter ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
[Gluster-devel] [Gluster-users] Input/Output Error on Gluster NFS
I was trying to copy a directory of files to Gluster via NFS and getting permission denied with Input/Output error ---> r...@bizratedbstandby.bo2.shopzilla.sea (0.00)# cp -pr db /mnt/ cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_SMLS.F02-01-22-35.d': Input/output error cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_logging.F02-02-18-10.b': Input/output error cp: setting permissions for `/mnt/db/full/pr_bizrate_SMLS.F02-01-22-35.d': Input/output error cp: setting permissions for `/mnt/db/full/pr_bizrate_standby_master.F02-02-22-00': Input/output error cp: setting permissions for `/mnt/db/full': Input/output error cp: setting permissions for `/mnt/db': Input/output error Checked gluster nfs.log and etc log and bricks looks clean. The files ends up able to copy over with right permission. Stack trace the copy and seems like it failed on removexattr removexattr("/mnt/db", "system.posix_acl_default"...) = -1 EIO (Input/output error) http://pastie.org/9884810 Any Clue? Thanks Peter ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel