Re: [Gluster-devel] gluster 3.6.2 ls issues
Cancel this issue. I found the problem. Explanation below... We use active directory to manage our user accounts; however, open sssd doesn't seem to play well with gluster. When I turn it on, the cpu load shoots up to between 80-100% and stays there (previously submitted bug report). So, we I did on my gluster machines to keep the uid/gid updated (required due to server.manage-gids=on), is write a script that start opensssd, grabs all of the groups/users from the server, parses out the /etc/group and /etc/passwd file, and then shuts down sssd. I didn't realize that sssd uses the locally cached file. My script was running faster than sssd was updating the cache file, so this particular user wasn't in the SBIR group on all of the machines. He was in that group on gfs01a, but not on gfs01b (replica pair) or gfs02a/02b. I guess this gave him enough permission to cd into the directory, but for some strange reason he couldn't do an ls and have the directory name show up. The only reason I do any of this is because I had to use server.manage-gids to overcome the 32-group limitation. This requires that my storage system have all of the user accounts and groups. The preferred option would be to simply use sssd on my storage systems, but it doesn't seem to play well with gluster. David -- Original Message -- From: David F. Robinson david.robin...@corvidtec.com To: Gluster Devel gluster-devel@gluster.org; gluster-us...@gluster.org gluster-us...@gluster.org Sent: 2/3/2015 12:56:40 PM Subject: gluster 3.6.2 ls issues On my gluster filesystem mount, I have a user who does an ls and all of the directories do not show up. Not that the A15-029 directory doesn't show up. However, as kbutz I can cd into the directory. As root (also tested as several other users), I get the following from an ls -al [root@sb1 2015.1]# ls -al total 16 drwxrws--x 13 streadway sbir 868 Feb 3 12:48 . drwxrws--- 46 root sbir 16384 Feb 3 10:50 .. drwxrws--x 5 cczechsbir 606 Jan 30 12:58 A15-007 drwxrws--x 5 kbutz sbir 291 Feb 3 12:11 A15-029 drwxrws--x 3 randerson sbir 219 Feb 3 11:52 A15-063 drwxrws--x 4 abirnbaum sbir 223 Feb 3 10:14 A15-088 drwxrws--x 2 anelson sbir 270 Jan 27 14:30 AF151-058 drwxrws--x 3 tanderson sbir 216 Jan 28 09:43 AF151-072 drwxrws--x 3 streadway sbir 162 Jan 21 13:28 AF151-102 drwxrws--x 4 aaronward sbir 493 Feb 3 09:58 AF151-114 drwxrws--x 3 streadway sbir 162 Feb 3 12:07 AF151-174 drwxrws--x 3 dstowesbir 192 Jan 27 12:25 AF15-AT28 drwxrws--x 3 kboyett sbir 199 Jan 28 09:43 NASA As user kburz, I get the following: sb1:sbir/2015.1 ls -al total 16 drwxrws--x 13 streadway sbir 868 Feb 3 12:48 ./ drwxrws--- 46 root sbir 16384 Feb 3 10:50 ../ drwxrws--x 3 randerson sbir 219 Feb 3 11:52 A15-063/ drwxrws--x 4 abirnbaum sbir 223 Feb 3 10:14 A15-088/ drwxrws--x 2 anelson sbir 270 Jan 27 14:30 AF151-058/ drwxrws--x 3 streadway sbir 162 Jan 21 13:28 AF151-102/ drwxrws--x 3 streadway sbir 162 Feb 3 12:07 AF151-174/ drwxrws--x 3 kboyett sbir 199 Jan 28 09:43 NASA/ Note, that I can still cd into the non-listed directory as kbutz: [kbutz@sb1 ~]$ cd /homegfs/documentation/programs/sbir/2015.1 A15-063/ A15-088/ AF151-058/ AF151-102/ AF151-174/ NASA/ sb1:sbir/2015.1 cd A15-029 A15-029_proposal_draft_rev1.docx* CB_work/ gun_work/ Refs/ David === David F. Robinson, Ph.D. President - Corvid Technologies 704.799.6944 x101 [office] 704.252.1310 [cell] 704.799.7974 [fax] david.robin...@corvidtec.com http://www.corvidtechnologies.com ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] gluster 3.6.2 ls issues
3.4, not 2.4... Need more coffee!!! On 02/03/2015 11:12 AM, Joe Julian wrote: Odd, I was using sssd with home directories on gluster from 2.0 through 2.4 and never had a problem (I'm no longer at that company, but they still have home directories on Gluster). Might be worth another look. On 02/03/2015 10:45 AM, David F. Robinson wrote: Cancel this issue. I found the problem. Explanation below... We use active directory to manage our user accounts; however, open sssd doesn't seem to play well with gluster. When I turn it on, the cpu load shoots up to between 80-100% and stays there (previously submitted bug report). So, we I did on my gluster machines to keep the uid/gid updated (required due to server.manage-gids=on), is write a script that start opensssd, grabs all of the groups/users from the server, parses out the /etc/group and /etc/passwd file, and then shuts down sssd. I didn't realize that sssd uses the locally cached file. My script was running faster than sssd was updating the cache file, so this particular user wasn't in the SBIR group on all of the machines. He was in that group on gfs01a, but not on gfs01b (replica pair) or gfs02a/02b. I guess this gave him enough permission to cd into the directory, but for some strange reason he couldn't do an ls and have the directory name show up. The only reason I do any of this is because I had to use server.manage-gids to overcome the 32-group limitation. This requires that my storage system have all of the user accounts and groups. The preferred option would be to simply use sssd on my storage systems, but it doesn't seem to play well with gluster. David -- Original Message -- From: David F. Robinson david.robin...@corvidtec.com mailto:david.robin...@corvidtec.com To: Gluster Devel gluster-devel@gluster.org mailto:gluster-devel@gluster.org; gluster-us...@gluster.org gluster-us...@gluster.org mailto:gluster-us...@gluster.org Sent: 2/3/2015 12:56:40 PM Subject: gluster 3.6.2 ls issues On my gluster filesystem mount, I have a user who does an ls and all of the directories do not show up. Not that the A15-029 directory doesn't show up. However, as kbutz I can cd into the directory. _*As root (also tested as several other users), I get the following from an ls -al*_ /[root@sb1 2015.1]# ls -al total 16 drwxrws--x 13 streadway sbir 868 Feb 3 12:48 . drwxrws--- 46 root sbir 16384 Feb 3 10:50 .. drwxrws--x 5 cczechsbir 606 Jan 30 12:58 A15-007 *drwxrws--x 5 kbutz sbir 291 Feb 3 12:11 A15-029* drwxrws--x 3 randerson sbir 219 Feb 3 11:52 A15-063 drwxrws--x 4 abirnbaum sbir 223 Feb 3 10:14 A15-088 drwxrws--x 2 anelson sbir 270 Jan 27 14:30 AF151-058 drwxrws--x 3 tanderson sbir 216 Jan 28 09:43 AF151-072 drwxrws--x 3 streadway sbir 162 Jan 21 13:28 AF151-102 drwxrws--x 4 aaronward sbir 493 Feb 3 09:58 AF151-114 drwxrws--x 3 streadway sbir 162 Feb 3 12:07 AF151-174 drwxrws--x 3 dstowesbir 192 Jan 27 12:25 AF15-AT28 drwxrws--x 3 kboyett sbir 199 Jan 28 09:43 NASA / *_As user kburz, I get the following:_* /sb1:sbir/2015.1 ls -al total 16 drwxrws--x 13 streadway sbir 868 Feb 3 12:48 ./ drwxrws--- 46 root sbir 16384 Feb 3 10:50 ../ drwxrws--x 3 randerson sbir 219 Feb 3 11:52 A15-063/ drwxrws--x 4 abirnbaum sbir 223 Feb 3 10:14 A15-088/ drwxrws--x 2 anelson sbir 270 Jan 27 14:30 AF151-058/ drwxrws--x 3 streadway sbir 162 Jan 21 13:28 AF151-102/ drwxrws--x 3 streadway sbir 162 Feb 3 12:07 AF151-174/ drwxrws--x 3 kboyett sbir 199 Jan 28 09:43 NASA// Note, that I can still cd into the non-listed directory as kbutz: /[kbutz@sb1 ~]$ cd /homegfs/documentation/programs/sbir/2015.1 A15-063/ A15-088/ AF151-058/ AF151-102/ AF151-174/ NASA// / sb1:sbir/2015.1 cd A15-029 A15-029_proposal_draft_rev1.docx* CB_work/ gun_work/ Refs// David === David F. Robinson, Ph.D. President - Corvid Technologies 704.799.6944 x101 [office] 704.252.1310 [cell] 704.799.7974 [fax] david.robin...@corvidtec.com mailto:david.robin...@corvidtec.com http://www.corvidtechnologies.com http://www.corvidtechnologies.com/ ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] gluster 3.6.2 ls issues
Odd, I was using sssd with home directories on gluster from 2.0 through 2.4 and never had a problem (I'm no longer at that company, but they still have home directories on Gluster). Might be worth another look. On 02/03/2015 10:45 AM, David F. Robinson wrote: Cancel this issue. I found the problem. Explanation below... We use active directory to manage our user accounts; however, open sssd doesn't seem to play well with gluster. When I turn it on, the cpu load shoots up to between 80-100% and stays there (previously submitted bug report). So, we I did on my gluster machines to keep the uid/gid updated (required due to server.manage-gids=on), is write a script that start opensssd, grabs all of the groups/users from the server, parses out the /etc/group and /etc/passwd file, and then shuts down sssd. I didn't realize that sssd uses the locally cached file. My script was running faster than sssd was updating the cache file, so this particular user wasn't in the SBIR group on all of the machines. He was in that group on gfs01a, but not on gfs01b (replica pair) or gfs02a/02b. I guess this gave him enough permission to cd into the directory, but for some strange reason he couldn't do an ls and have the directory name show up. The only reason I do any of this is because I had to use server.manage-gids to overcome the 32-group limitation. This requires that my storage system have all of the user accounts and groups. The preferred option would be to simply use sssd on my storage systems, but it doesn't seem to play well with gluster. David -- Original Message -- From: David F. Robinson david.robin...@corvidtec.com mailto:david.robin...@corvidtec.com To: Gluster Devel gluster-devel@gluster.org mailto:gluster-devel@gluster.org; gluster-us...@gluster.org gluster-us...@gluster.org mailto:gluster-us...@gluster.org Sent: 2/3/2015 12:56:40 PM Subject: gluster 3.6.2 ls issues On my gluster filesystem mount, I have a user who does an ls and all of the directories do not show up. Not that the A15-029 directory doesn't show up. However, as kbutz I can cd into the directory. _*As root (also tested as several other users), I get the following from an ls -al*_ /[root@sb1 2015.1]# ls -al total 16 drwxrws--x 13 streadway sbir 868 Feb 3 12:48 . drwxrws--- 46 root sbir 16384 Feb 3 10:50 .. drwxrws--x 5 cczechsbir 606 Jan 30 12:58 A15-007 *drwxrws--x 5 kbutz sbir 291 Feb 3 12:11 A15-029* drwxrws--x 3 randerson sbir 219 Feb 3 11:52 A15-063 drwxrws--x 4 abirnbaum sbir 223 Feb 3 10:14 A15-088 drwxrws--x 2 anelson sbir 270 Jan 27 14:30 AF151-058 drwxrws--x 3 tanderson sbir 216 Jan 28 09:43 AF151-072 drwxrws--x 3 streadway sbir 162 Jan 21 13:28 AF151-102 drwxrws--x 4 aaronward sbir 493 Feb 3 09:58 AF151-114 drwxrws--x 3 streadway sbir 162 Feb 3 12:07 AF151-174 drwxrws--x 3 dstowesbir 192 Jan 27 12:25 AF15-AT28 drwxrws--x 3 kboyett sbir 199 Jan 28 09:43 NASA / *_As user kburz, I get the following:_* /sb1:sbir/2015.1 ls -al total 16 drwxrws--x 13 streadway sbir 868 Feb 3 12:48 ./ drwxrws--- 46 root sbir 16384 Feb 3 10:50 ../ drwxrws--x 3 randerson sbir 219 Feb 3 11:52 A15-063/ drwxrws--x 4 abirnbaum sbir 223 Feb 3 10:14 A15-088/ drwxrws--x 2 anelson sbir 270 Jan 27 14:30 AF151-058/ drwxrws--x 3 streadway sbir 162 Jan 21 13:28 AF151-102/ drwxrws--x 3 streadway sbir 162 Feb 3 12:07 AF151-174/ drwxrws--x 3 kboyett sbir 199 Jan 28 09:43 NASA// Note, that I can still cd into the non-listed directory as kbutz: /[kbutz@sb1 ~]$ cd /homegfs/documentation/programs/sbir/2015.1 A15-063/ A15-088/ AF151-058/ AF151-102/ AF151-174/ NASA// / sb1:sbir/2015.1 cd A15-029 A15-029_proposal_draft_rev1.docx* CB_work/ gun_work/ Refs// David === David F. Robinson, Ph.D. President - Corvid Technologies 704.799.6944 x101 [office] 704.252.1310 [cell] 704.799.7974 [fax] david.robin...@corvidtec.com mailto:david.robin...@corvidtec.com http://www.corvidtechnologies.com http://www.corvidtechnologies.com/ ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
