Re: [Gluster-users] gluster NFS hang observed mounting or umounting at scale
> One last reply to myself. One of the test cases my test scripts triggered turned out to actually be due to my NFS RW mount options. OLD RW NFS mount options: "rw,noatime,nocto,actimeo=3600,lookupcache=all,nolock,tcp,vers=3" NEW options that work better rw,noatime,nolock,tcp,vers=3" I had copied the RO NFS options we use which try to be aggressive about caching. The RO root image doesn't change much and we want it as fast as possible. The options are not appropriate for RW areas that change. (Even though it's a single image file we care about). So now my test scripts run clean but since what we see on larger systems is right after reboot, the caching shouldn't matter. In the real problem case, the RW stuff is done once after reboot. FWIW I attached my current test scripts, my last batch had some errors. The search continues for the actual problem, which I'm struggling to reproduce @ 366 NFs clients. I believe yesterday, when I posted about actual HANGS, that is the real problem we're tracking. I hit that once in my test scripts - only once. My script was otherwise hitting a "file doesn't really exist even though cached" issue and it was tricking my scripts. In any case, I'm changing the RW NFS options we use regardless. Erik nfs-issues.tar.xz Description: application/xz Community Meeting Calendar: APAC Schedule - Every 2nd and 4th Tuesday at 11:30 AM IST Bridge: https://bluejeans.com/441850968 NA/EMEA Schedule - Every 1st and 3rd Tuesday at 01:00 PM EDT Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
[Gluster-users] Invitation: Invitation: Invitation: GlusterFS community meeting @ Tue... @ Tue Jan 28, 2020 11:30am - 12:30pm (IST) (gluster-users@gluster.org)
BEGIN:VCALENDAR PRODID:-//Google Inc//Google Calendar 70.9054//EN VERSION:2.0 CALSCALE:GREGORIAN METHOD:REQUEST BEGIN:VEVENT DTSTART:20200128T06Z DTEND:20200128T07Z DTSTAMP:20200127T053000Z ORGANIZER;CN=ypa...@redhat.com:mailto:ypa...@redhat.com UID:03jdvcminjelci8v617aqjk...@google.com ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE ;CN=ypa...@redhat.com;X-NUM-GUESTS=0:mailto:ypa...@redhat.com ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP= TRUE;CN=gluster-users@gluster.org;X-NUM-GUESTS=0:mailto:gluster-users@glust er.org ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP= TRUE;CN=gluster-de...@gluster.org;X-NUM-GUESTS=0:mailto:gluster-devel@glust er.org ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=TR UE;CN=bangalore-engg-vijayanagara-12-p-vc;X-NUM-GUESTS=0:mailto:redhat.com_ 62616e67616c6f72652d76696a6179616e61676172612d31342d364c5864426d4d5366@reso urce.calendar.google.com X-MICROSOFT-CDO-OWNERAPPTID:-1878305544 CREATED:20200127T052959Z DESCRIPTION:Bridge: \;https://bluejeans.com/441850968";>https:/ /bluejeans.com/441850968 \;Minutes meeting: \; \;https://hackmd.io/vTQAhNadQM63jogs_pB-aQ?both"; id="o w1811" __is_owner="true">https://hackmd.io/vTQAhNadQM63jogs_pB-aQ?both< br>Previous Meeting notes: https://github.com/gluster/comm unity/meetings" id="ow1803" __is_owner="true">https://github.com/gluster/community/meetings\n\n-::~:~::~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~ :~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~::~:~::-\nPlease do not edit this s ection of the description.\n\nView your event at https://www.google.com/cal endar/event?action=VIEW&eid=MDNqZHZjbWluamVsY2k4djYxN2FxamtwaHYgZ2x1c3Rlci1 1c2Vyc0BnbHVzdGVyLm9yZw&tok=MTcjeXBhZGlhQHJlZGhhdC5jb21hZTBjYTQ3OWY5ZWI5M2U 4OWZjNWVlMDc4YWU5ZWI4MWJlZDdkZjNm&ctz=Asia%2FKolkata&hl=en&es=1.\n-::~:~::~ :~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~::~:~ ::- LAST-MODIFIED:20200127T052959Z LOCATION:bangalore-engg-vijayanagara-12-p-vc SEQUENCE:0 STATUS:CONFIRMED SUMMARY:Invitation: Invitation: GlusterFS community meeting @ Tue Jan 28\, 2020 TRANSP:OPAQUE END:VEVENT END:VCALENDAR invite.ics Description: application/ics Community Meeting Calendar: APAC Schedule - Every 2nd and 4th Tuesday at 11:30 AM IST Bridge: https://bluejeans.com/441850968 NA/EMEA Schedule - Every 1st and 3rd Tuesday at 01:00 PM EDT Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
[Gluster-users] Replicated volume load balancing
Hi, using GlusterFS 6.7 with a 2+1 replicated volume, how are read requests load balanced, if at all? The reason I ask is that we see consistently higher usage/load on the first brick when compared to the second data brick. Are there any parameters to influence the read balancing? Thanks, Stefan Community Meeting Calendar: APAC Schedule - Every 2nd and 4th Tuesday at 11:30 AM IST Bridge: https://bluejeans.com/441850968 NA/EMEA Schedule - Every 1st and 3rd Tuesday at 01:00 PM EDT Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
[Gluster-users] Free space reported not consistent with bricks
Hi, why is it that the free space on the volume mount (via FUSE) is never equivalent to any of the bricks' free space in a replicated volume? For example here: $ df -m on host-01: > /dev/mapper/gluster-brick01 7630880 4890922 2722008 65% > /data/glusterfs/backupv01/brick01 $ df -m on host-06: > /dev/mapper/gluster-brick06 7630880 4717589 2897753 62% > /data/glusterfs/backupv01/brick06 $ df -m on client: > host-01:backupv01 7630880 4966615 2664266 66% /mnt/backup01 Stefan Community Meeting Calendar: APAC Schedule - Every 2nd and 4th Tuesday at 11:30 AM IST Bridge: https://bluejeans.com/441850968 NA/EMEA Schedule - Every 1st and 3rd Tuesday at 01:00 PM EDT Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users@gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
